No credit card required

Website Screenshot Generator

apify/screenshot-url

No credit card required

Create a screenshot of a website based on a specified URL. The screenshot is stored as the output in a key-value store. It can be used to monitor web changes regularly after setting up the scheduler.

Back to issues Create new issue

Crawl through website

Closed

mainprotege opened this issue

I want to crawl around the website and take screenshot of multiple pages, similar to the crawling actor. Is it possible to add that functionality? If that were added, I would use this significantly.

Pavlína Vencovská (paja)

Hi,

thanks for reaching out, we'll discuss it within the team and let you know what can be done.

athletic_trophy

+1 for this. IS there any update on planned support?

We would want the runner to visit a website, take a screenshot, and then keep crawling. The logic we would to have access to are: crawlDepth, number of pages, CSS selector to select to find more URLs, crawl through sitemap.

Pavlína Vencovská (paja)

Thanks for the message, we will reprioritize and get back to it!

Lukáš Křivka (lukaskrivka)

Hello,

Sorry for a late reply. This is a really simple Actor, for crawling and other complex use cases, please use https://apify.com/apify/website-content-crawler

Add comment

Developer

Apify

Actor Metrics

157 monthly users
64 bookmarks
>99% runs succeeded
39 days response time
Created in Nov 2018
Modified 2 months ago

Categories

Ultimate Screenshot

dz_omar/ultimate-screenshot

Ultimate Screenshot allows you to extract data in formats like JPEG, PNG, PDF, GIF, and MP4. It supports device emulation, including iPhones, Android phones, tablets, and desktops, or uses a default resolution of 1920x1080 for accurate, versatile screenshots and videos.

Abdlhakim hefaia

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

36.6k

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

6.4k

120

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

76.2k

457

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

5.3k

Download HTML from URLs

mtrunkat/url-list-download-html

This actor takes a list of URLs and downloads HTML of each page.

Marek Trunkát

8.4k

Tiktok Shop Scraper

excavator/tiktok-shop-scraper

This is the Actor for crawling data from the TikTok shop product URLs. For example: https://shop.tiktok.com/view/product/XXXXXXXXXX These URLs are only available for TikTok Shop US. You can test it here: https://apify.com/excavator/tiktok-shop-product

Excavator

Legacy PhantomJS Crawler

apify/legacy-phantomjs-crawler

Replacement for the legacy Apify Crawler product with a backward-compatible interface. The actor uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of front-end JavaScript code.

Apify

1.6k

Extended GPT Scraper

drobnikj/extended-gpt-scraper

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.