No credit card required

Puppeteer Scraper

apify/puppeteer-scraper

No credit card required

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Do you want to learn more about this Actor?

Get a demo

Back to issues Create new issue

why you are updating actor during the run ? this take many to update the actors ?

Closed

RedabenhAKO opened this issue

2024-04-18T16:46:20.432Z ACTOR: Notifying Actor process about imminent migration to another host. 2024-04-18T16:46:24.661Z INFO PuppeteerCrawler: ## Take snapshot - 1-login-Page 2024-04-18T16:46:25.096Z INFO PuppeteerCrawler: ###-2 LOGIN to PAGE loadedUrl : https://visas-fr.tlscontact.com/visa/ma/maRBA2fr/home 2024-04-18T16:46:26.114Z INFO PuppeteerCrawler: ## Wait for 15000 ms - 2-post-Login 2024-04-18T16:46:53.668Z ACTOR: Run was migrated to a new host. 2024-04-18T16:46:53.675Z ACTOR: Pulling Docker image of build hB12AV7CSfXaybCLd from repository. 2024-04-18T16:46:53.778Z ACTOR: Creating Docker container. 2024-04-18T16:46:53.820Z ACTOR: Starting Docker container. 2024-04-18T16:46:54.469Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1920x1080x24+32 -nolisten tcp 2024-04-18T16:46:54.471Z Executing main command 2024-04-18T16:46:55.615Z INFO System info {"apifyVersion":"3.1.16","apifyClientVersion":"2.9.3","crawleeVersion":"3.8.2","osType":"Linux","nodeVersion":"v18.20.1"} 2024-04-18T16:46:55.739Z INFO Configuring Puppeteer Scraper. 2024-04-18T16:46:56.537Z INFO Configuration completed. Starting the scrape. 2024-04-18T16:46:56.680Z INFO PuppeteerCrawler: Starting the crawler. 2024-04-18T16:47:56.360Z ACTOR: The Actor run has reached the timeout of 120 seconds, aborting it. You can increase the timeout in Settings > Run options.

Jindřich Bär (jindrich.bar)

Hello and thank you for your interest in this Actor!

If you're referring to the "Notifying Actor process about imminent migration to another host" line, this is a regular part of an Actor run. Because of the internal design of our Platform, the running Actors sometimes need to be migrated between the cloud compute instances to achieve the best performance and pricing for our users. This is just an internal implementation detail really.

Note that the Actors are made with this in mind, so aside from the log message, this shouldn't affect your scraper run at all.

I'll close this issue now, but feel free to ask additional questions, if you have any. Cheers!

Add comment

Developer

Apify

Actor Metrics

399 monthly users
79 stars
>99% runs succeeded
65 days response time
Created in Apr 2019
Modified 7 months ago

Categories

Developer tools

Open source

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Apify

73.7k

332

Simple Contact Info and Social Media Scraper

pajoe/simple-contact-info-and-social-media-scraper

This Apify actor is designed to crawl web pages and extract social media handles, emails, and phone numbers using Puppeteer. It can handle dynamic content and navigate through multiple pages, making it suitable for comprehensive data extraction tasks.

va-gasd

Cloudflare Web Scraper

dtrungtin/cloudflare-web-scraper

Prevents Puppeteer from being detected as a bot in services like Cloudflare and allows you to pass captchas without any problems

Tin Duong

Redfin Fast Scraper

mantisus/redfin-fast-scraper

Redfin: Scrape fast, stay light! Skip bloated browser tools. My Redfin scraper extracts property data in a flash, no heavy lifting is needed. Scrape/monitor listings with ease, all without Puppeteer or Playwright. ⚡️

Maksym Bohomolov

Thefork Fast Scraper

mantisus/thefork-fast-scraper

Scrape TheFork.com quickly and easily! Skip bloated browser tools. This scraper extracts restaurant data in a flash, no heavy lifting is needed. Scrape and monitor data with ease, all without Puppeteer or Playwright. ⚡️

Maksym Bohomolov

Redfin Fast Scraper Per Results

mantisus/redfin-fast-scraper-per-results

Maksym Bohomolov

Thefork Fast Scraper Per Result

mantisus/thefork-fast-scraper-per-result

Maksym Bohomolov

cambridge dictionary scraper

dev_bodex/cambridge-dictionary-scraper

This Cambridge Dictionary Scraper Apify Actor automates extracting word definitions, synonyms, examples, and translations from the Cambridge Dictionary. Built with Node.js and Puppeteer, it returns structured data, ideal for language processing, research, and educational use.

Festus Befgrp

Google Direction Scraper

dev_bodex/google-direction-scraper

This actor automates extracting route directions from Google Maps. Using Node.js and Puppeteer, it retrieves travel routes, distances, and estimated times for various transport modes, offering structured data for navigation, logistics, or travel planning applications.

Festus Befgrp

Google Translation Scraper

dev_bodex/google-translation-scraper

This Google Translation Scraper Actor automates extracting translations for any input text from Google Translate. Built with Node.js and Puppeteer, it efficiently retrieves translations in multiple languages, providing structured data for use in language apps, research, or educational projects.

Festus Befgrp