Pricing

Pay per usage

Go to Store

Cheerio Scraper

Try for free

apify/cheerio-scraper

Developed by

Apify

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

4.7 (11)

Pricing

Pay per usage

131

Monthly users

601

Runs succeeded

>99%

Last modified

5 months ago

Developer tools Open source

Back to issues Create new issue

Add waiting time

Closed

raphael123 opened this issue

Hi there, would it be possible to add a loading time in seconds before crawling the page. there is some content on the site I'm trying to scrape that takes about 5s to load and it's not picking it up currently.

thanks!

Jindřich Bär (jindrich.bar)

Hello @raphael123 and thank you for your interest in this Actor!

Unfortunately, the Cheerio Scraper will never load the dynamic content you are talking about, because it cannot execute client-side Javascript. Because of this, the Cheerio Scraper can be exceptionally fast... but on the other hand, it can only be used to crawl pages that don't utilize client-side rendering (eg. fetch some extra data after the initial page load via asynchronous requests).

Your best bet is to use one of our other actors - Web Scraper. It's very similar to this Cheerio Scraper, with one big difference - under the hood, the Web Scraper uses an actual instance of Google Chrome, and because of this, it can render the webpage as if you just opened it in your web browser. Using this Actor, you can wait for some time in the custom Page function to make sure all the content has been loaded.

Did this answer your question? I'll close this issue now, but feel free to ask any additional questions in case of any problems. Thanks!

Add comment

Pricing

Pricing model

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.

Zillow Search Results and Detail Scraper (All-in-one)

memo23/zillow-cheerio-scraper

Unleash the full power of Zillow data - no limits, no restrictions. Comprehensive scraping for any search URL, delivering complete property insights at scale.

Muhamed Didovic

Tiktok Transcript Extractor Scraper

memo23/tiktok-transcript-extractor-cheerio

Effortlessly extract TikTok video transcripts in WebVTT format with this reliable scraper. Save time, automate data collection, and customize settings like concurrency and proxies for seamless performance. Perfect for accessibility, analysis, or content repurposing!

Muhamed Didovic

110

Zoopla.co.uk Scraper

memo23/zoopla-cheerio-scraper

Your key to mastering UK real estate data. Get instant access to Zoopla's extensive property listings, complete with pricing, features, and agent details. Perfect for market analysis, lead generation, and property research.

Muhamed Didovic

NoFluffJobs.com Job Listings Scraper

memo23/apify-nofluffjobs-cheerio-scraper

Uncover hidden job opportunities across 5 European countries with one search! This NoFluffJobs scraper delivers comprehensive, real-time data on tech jobs, including salaries, skills, and company insights. Save time, expand your job search, and make informed career decisions with ease.

Muhamed Didovic

Furnishedfinder.com Scraper

memo23/furnishedfinder-scraper-cheerio

The FurnishedFinder Scraper is your ultimate solution for streamlined rental searches, helping you extract detailed property data like amenities, availability, and pricing effortlessly. With customizable settings and persistent storage, it’s perfect for travelers, researchers, or property managers.

Muhamed Didovic

3.0/5

Facebook Ads Library Scraper

memo23/facebook-ads-library-scraper-cheerio

Stealthily decode competitors' Facebook ad strategies in real-time—scrape active campaigns, creatives, and audience targeting data with residential proxies. Gain actionable insights, track trends, and optimize your ads using their winning tactics, undetected.

Muhamed Didovic

5.0/5

Rust Input Function Example

lukaskrivka/rust-input-function-example

Dynamically compile and run input-provided page function. Like Cheerio Scraper but in Rust.

Lukáš Křivka

BeautifulSoup Scraper

apify/beautifulsoup-scraper

Crawls websites using raw HTTP requests. It parses the HTML with the BeautifulSoup library and extracts data from the pages using Python code. Supports both recursive crawling and lists of URLs. This Actor is a Python alternative to Cheerio Scraper.

Apify

801

4.4/5

Vanilla JS Scraper

mstephen190/vanilla-js-scraper

Scrape the web using familiar JavaScript methods! Crawls websites using raw HTTP requests, parses the HTML with the JSDOM package, and extracts data from the pages using Node.js code. Supports both recursive crawling and lists of URLs. This actor is a non jQuery alternative to CheerioScraper.

Matthias Stephens

449

JSDOM Scraper

apify/jsdom-scraper

Parses the HTML using the JSDOM library, providing the same DOM API as browsers do (e.g. `window`). It is able to process client-side JavaScript without using a real browser. Performance-wise, it stands somewhere between the Cheerio Scraper and the browser scrapers.

Apify

4.3/5