Web Scraper
Pricing
Pay per usage
Web Scraper
Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.
4.5 (23)
Pricing
Pay per usage
833
Total users
87K
Monthly users
4.4K
Runs succeeded
>99%
Issues response
21 days
Last modified
21 days ago
Stringification of console.log in browser failed Error
Closed
Stringification of console.log in browser failed Error
Hello @neenakl and thank you for submitting this issue.
Unfortunately, I'm afraid I don't fully understand the issue. Can you please provide some additional information - preferably a link (or the Run ID) to the run where you've encountered this issue?
Thanks!
Hello Jindrich
The scraper finishes with returning no results, there are no error in the code. Here is the run url. https://console.apify.com/organization/tTjFKndB6SjG96nvR/actors/runs/vdaA2DwYivHUP2BVv#log
Hello again - thank you for the repro!
Turns out, that the website you're trying to scrape is quite specific - it doesn't load any content if it cannot load its CSS styles first. The Web Scraper blocks requests for CSS stylesheets, images, fonts etc. by default to save bandwidth.
By setting the Performance and limits > Download CSS files to true, the crawler will allow the CSS stylesheets to be downloaded and loads the page just fine.
You can check the fixed input in my testing run here.
Does this solve your problem? I'll close this issue now, but feel free to ask any additional questions if you have any. Thanks and happy scraping!
Hello Jindrich
Thank you very much for the help. I t didnt work just turning on the Download CSS files option, I had to turn off the browser and debug log too. Its working fine now.
