Pricing

Pay per usage

Go to Store

Cheerio Scraper

Try for free

Developed by

Apify

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

4.7 (11)

Pricing

Pay per usage

135

Monthly users

739

Runs succeeded

>99%

Last modified

a day ago

Developer tools

Open source

Back to issues Create new issue

Various Bugs

Closed

ollie10 opened this issue

Good Morning I found various bugs in the latest cheerio scraper, I spoke in chat with Tsveta, besides this the fact that you are obliging to use your proxy in a free account is a killer feature that will make user escape but anyway:

If I want to use one of my custom http proxy I get always error even if the proxy is working correctly. I have got error 400 from the proxy, it seems that apify is not making the proper calls.

Besides this the interface is blocking adding the socks5:// protocol even if in your documentation is stated so: https://apify.com/apify/cheerio-scraper#proxy-configuration

Lukáš Křivka (lukaskrivka)

Hello, we are aware of this problem and looking into it now.

As for mandatory proxies, that will stay but we will provide Apify proxies for free users indefinitely soon

ollie10

Another bug I spotted is that globs are not shown once you reload the page after saving it, but they are saved correctly, anyway if you can't see them and you don't know how to use the json editor it's tricky for most users

Lukáš Křivka (lukaskrivka)

Thanks, this is a one-time issue since the Glob input type was just changed. Will be fixed asap

ollie10

You're welcome, regards

Lukáš Křivka (lukaskrivka)

Socks are not supported, we will fix the docs. As I said, very soon free accounts will be granted free proxies forever

ollie10

A little bit of a mess over there, sorry to say: removing features, documentation incorrect... me I'm an hobbist but how companies can build a reliable product with this kind of premises...

Many thanks so I will look forward for the developments

Lukáš Křivka (lukaskrivka)

You are right. Most devs build new actors with Crawlee and Apify SDK directly so the doc issue escaped. As for changes, we are aware of the bad execution of these events, it is not a norm.

Add comment

Pricing

Pricing model

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

6.2k

Web Scraper

apify/web-scraper

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

80.7k

Playwright Scraper

apify/playwright-scraper

Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Apify

1.3k

Vanilla JS Scraper

mstephen190/vanilla-js-scraper

Scrape the web using familiar JavaScript methods! Crawls websites using raw HTTP requests, parses the HTML with the JSDOM package, and extracts data from the pages using Node.js code. Supports both recursive crawling and lists of URLs. This actor is a non jQuery alternative to CheerioScraper.

Matthias Stephens

457

Legacy PhantomJS Crawler

apify/legacy-phantomjs-crawler

Replacement for the legacy Apify Crawler product with a backward-compatible interface. The actor uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of front-end JavaScript code.

Apify

1.6k

BeautifulSoup Scraper

apify/beautifulsoup-scraper

Crawls websites using raw HTTP requests. It parses the HTML with the BeautifulSoup library and extracts data from the pages using Python code. Supports both recursive crawling and lists of URLs. This Actor is a Python alternative to Cheerio Scraper.

Apify

813

Example Sitemap Cheerio

jancurn/example-sitemap-cheerio

An example actor that first downloads a sitemap in XML format and the crawls each page from the sitemap using the fast CheerioCrawler from Apify SDK.

Jan Čurn

Algolia Webcrawler

jancurn/algolia-webcrawler

Crawls a website using one or more sitemaps and imports the data to Algolia search index. The text content is identified using simple CSS selectors.

Jan Čurn

SuperScraper API

apify/super-scraper-api

Generic REST API for scraping websites: send a URL and get back HTML. This Actor is a drop-in replacement for ScrapingBee, ScrapingAnt, and ScraperAPI services. And it is open-source!

Apify

627

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

45.5k