Web Scraper
Pricing
Pay per usage
Web Scraper
Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.
4.4 (22)
Pricing
Pay per usage
766
Total users
85K
Monthly users
4.6K
Runs succeeded
>99%
Issues response
31 days
Last modified
2 days ago
Unable to scrape website
Closed
Hi, tried to scrape website - 'https://etenders.gov.in/eprocure/app' for word 'CCTV' but unable to fetch results. 3 attempts failed. What is issue with actor??
Hello, and thank you for your interest in this Actor!
The page function in Web Scraper is executed in the browser environment - i.e. you don't get Playwright's / Puppeteer's page object through the context. See the context fields documentation in the Page function section of the README for this Actor.
context helpers aside, you should be able to run the Page function in your browser console (so to click on a button, you don't use page.click('#searchBtn');, but document.querySelector('#searchBtn').click(), etc.
I'll close this issue now, but feel free to ask additional questions if you have any. Cheers!
