Web Scraper avatar

Web Scraper

Try for free

No credit card required

View all Actors
Web Scraper

Web Scraper

apify/web-scraper
Try for free

No credit card required

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Do you want to learn more about this Actor?

Get a demo
SI

web-scraper does not extract all text from a URL

Open

simaoka opened this issue
2 months ago

I am new try,

Trying to extract all text from a url, but its not returning all the text present in the website. for example: https://www.eaton.com/us/en-us/products.html

Procedure to reproduce the issue:

  1. Copy the code from https://apify.com/apify/web-scraper/api/client/python
  2. Replace below two lines "startUrls": [{ "url": "https://www.eaton.com/us/en-us/products.html" }], "globs": [{ "glob": "https://www.eaton.com/us/en-us/products/*" }],
  3. Run the python file.
  4. in the 1st output random_text_from_the_page has no texts.

Please note i will be applying random website links each one have different

DP

dis0rder-platinumids

2 months ago

Same issue here.

Developer
Maintained by Apify

Actor Metrics

  • 2.6k monthly users

  • 219 stars

  • >99% runs succeeded

  • 44 days response time

  • Created in Mar 2019

  • Modified 3 months ago