Web Scraper avatar
Web Scraper
Try for free

No credit card required

View all Actors
Web Scraper

Web Scraper

apify/web-scraper
Try for free

No credit card required

Crawls arbitrary websites using the Chrome browser and extracts data from pages using a provided JavaScript code. The actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

User avatar

Stringification of console.log in browser failed Error

Closed

Neena KL (neenakl) opened this issue
4 months ago

Stringification of console.log in browser failed Error

User avatar

Hello @neenakl and thank you for submitting this issue.

Unfortunately, I'm afraid I don't fully understand the issue. Can you please provide some additional information - preferably a link (or the Run ID) to the run where you've encountered this issue?

Thanks!

User avatar

Neena KL (neenakl)

4 months ago

Hello Jindrich

The scraper finishes with returning no results, there are no error in the code. Here is the run url. https://console.apify.com/organization/tTjFKndB6SjG96nvR/actors/runs/vdaA2DwYivHUP2BVv#log

User avatar

Hello again - thank you for the repro!

Turns out, that the website you're trying to scrape is quite specific - it doesn't load any content if it cannot load its CSS styles first. The Web Scraper blocks requests for CSS stylesheets, images, fonts etc. by default to save bandwidth.

By setting the Performance and limits > Download CSS files to true, the crawler will allow the CSS stylesheets to be downloaded and loads the page just fine. You can check the fixed input in my testing run here.

Does this solve your problem? I'll close this issue now, but feel free to ask any additional questions if you have any. Thanks and happy scraping!

User avatar

Neena KL (neenakl)

4 months ago

Hello Jindrich

Thank you very much for the help. I t didnt work just turning on the Download CSS files option, I had to turn off the browser and debug log too. Its working fine now.

Developer
Maintained by Apify
Actor metrics
  • 3.4k monthly users
  • 99.9% runs succeeded
  • 3.2 days response time
  • Created in Mar 2019
  • Modified about 2 months ago