Pricing

Pay per usage

Go to Store

Example Sitemap Cheerio

Try for free

Developed by

Jan Čurn

An example actor that first downloads a sitemap in XML format and the crawls each page from the sitemap using the fast CheerioCrawler from Apify SDK.

0.0 (0)

Pricing

Pay per usage

Monthly users

Runs succeeded

>99%

Last modified

3 years ago

Developer tools

Open source

The Actor has no README.md file. Sad!

Pricing

Pricing model

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.

Sitemap Scraper

pvillalva/sitemap-scraper

The Sitemap Scraper extracts and outputs all URLs from a given sitemap.

Percival Villalva

Find Sitemap from url

eesti/find-sitemap-from-url

A powerful [Apify Actor] that finds sitemap URLs for any website. This Actor helps you discover XML sitemaps by checking common locations, robots.txt files, and analyzing HTML content for sitemap links.

ando

Sitemap Sniffer

vaclavrut/sitemap-sniffer

Sitemap sniffer will check the most used variants of sitemaps and you can use that for crawling. This will just save you time so you don't have to check manually.

Vaclav Rut

562

Sitemap To Request Queue

pocesar/sitemap-to-request-queue

Download sitemap XMLs and put them in a RequestQueue

Paulo Cesar

100

Internal Links Scraper

mysteriousshadow/internal-links-scraper

When given a sitemap of a website, this scraper will go through every page listed on the sitemap and find all the internal links. Useful for SEO, finding orphaned pages, and visualizing internal linking structure.

Mysterious Shadow

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

7.2k

Get URLs from link

boring_code/get-urls-from-link

Extracts URLs from a sitemap or webpage with intuitive path matching. Use comma-separated patterns to include or exclude URL paths with smart matching: '/tags/' for exact paths, '/product' for paths starting with, or simple text for substring matches.

Audrius L.

Page Rank Actor

ludvik/page-rank-actor

Page rank Actor ranks URLs that satisfy the glob patterns.

Ludvík Prokopec

Yellow Pages Italy (Pagine Gialle) Business Lead Generator

lead.gen.labs/yellow-pages-italy-pagine-gialle-business-lead-generator

Yellow Pages Italy (Pagine Gialle) Business Lead Generator is an advanced Apify Actor that extracts business information from Pagine Gialle (Italy's Yellow Pages). Gather company names, contact details, websites, and more to streamline your lead generation, sales prospecting, and market research.

LeadGen Labs

Website Checker Runner Cheerio

lukaskrivka/website-checker-cheerio

Checks the provided website using cheerio. This is a low level runner, most likely you want to use the high level master actor - https://apify.com/lukaskrivka/website-checker