Web Scraper
No credit card required
Web Scraper
No credit card required
Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.
Do you want to learn more about this Actor?
Get a demoI have had 4 failed runs in a row :(
Open
Just trying to scrape a subset of my site, which has a bad sitemap.So when I load up a category page like "website.com/browse/samsung" it has weird pagination- you get the first page of results and then you have to click [view more products] then it loads the next page and so forth, until every single product in that category "samsung" has loaded. Only after that, have I tried to get the crawler/scraper to visit each product URL and grab 6 fields from each one, that I carefully defined by css-selector name
I NEED this to work tonight- my client RAG chatbot is being demoed tomorrow at 10am. If you can help tonight, I would be FOREVER GRATEFUL.... nervous sweating
ApifyActor Metrics
2.6k monthly users
-
219 stars
>99% runs succeeded
44 days response time
Created in Mar 2019
Modified 3 months ago
