No credit card required
Web Scraper
No credit card required
Crawls arbitrary websites using the Chrome browser and extracts data from pages using a provided JavaScript code. The actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.
Stringification of console.log in browser failed Error
Closed
Stringification of console.log in browser failed Error
Hello @neenakl and thank you for submitting this issue.
Unfortunately, I'm afraid I don't fully understand the issue. Can you please provide some additional information - preferably a link (or the Run ID) to the run where you've encountered this issue?
Thanks!
Hello Jindrich
The scraper finishes with returning no results, there are no error in the code. Here is the run url. https://console.apify.com/organization/tTjFKndB6SjG96nvR/actors/runs/vdaA2DwYivHUP2BVv#log
Hello again - thank you for the repro!
Turns out, that the website you're trying to scrape is quite specific - it doesn't load any content if it cannot load its CSS styles first. The Web Scraper blocks requests for CSS stylesheets, images, fonts etc. by default to save bandwidth.
By setting the Performance and limits > Download CSS files to true, the crawler will allow the CSS stylesheets to be downloaded and loads the page just fine.
You can check the fixed input in my testing run here.
Does this solve your problem? I'll close this issue now, but feel free to ask any additional questions if you have any. Thanks and happy scraping!
Hello Jindrich
Thank you very much for the help. I t didnt work just turning on the Download CSS files option, I had to turn off the browser and debug log too. Its working fine now.
Apify- 2.3k monthly users
- 119 stars
- 99.9% runs succeeded
- 5.2 days response time
- Created in Mar 2019
- Modified about 1 month ago
