Pricing

Pay per usage

Go to Store

Sitemap To Request Queue

Try for free

Developed by

Paulo Cesar

Download sitemap XMLs and put them in a RequestQueue

0.0 (0)

Pricing

Pay per usage

Monthly users

Runs succeeded

>99%

Last modified

3 years ago

Developer tools

Open source

Back to issues Create new issue

Doesn't work :(

Open

fearless_hedgehog opened this issue

Hello Paulo! I tried to use your actors but it didn't work ((

Add comment

Pricing

Pricing model

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.

Sitemap Scraper

pvillalva/sitemap-scraper

The Sitemap Scraper extracts and outputs all URLs from a given sitemap.

Percival Villalva

Sitemap Sniffer

vaclavrut/sitemap-sniffer

Sitemap sniffer will check the most used variants of sitemaps and you can use that for crawling. This will just save you time so you don't have to check manually.

Vaclav Rut

553

Example Sitemap Cheerio

jancurn/example-sitemap-cheerio

An example actor that first downloads a sitemap in XML format and the crawls each page from the sitemap using the fast CheerioCrawler from Apify SDK.

Jan Čurn

Find Sitemap from url

eesti/find-sitemap-from-url

A powerful [Apify Actor] that finds sitemap URLs for any website. This Actor helps you discover XML sitemaps by checking common locations, robots.txt files, and analyzing HTML content for sitemap links.

ando

Get URLs from link

boring_code/get-urls-from-link

Extracts URLs from a sitemap or webpage with intuitive path matching. Use comma-separated patterns to include or exclude URL paths with smart matching: '/tags/' for exact paths, '/product' for paths starting with, or simple text for substring matches.

Audrius L.

Internal Links Scraper

mysteriousshadow/internal-links-scraper

When given a sitemap of a website, this scraper will go through every page listed on the sitemap and find all the internal links. Useful for SEO, finding orphaned pages, and visualizing internal linking structure.

Mysterious Shadow

React Component Crawler

diarmuidr/react-component-crawler

Get the state out of react components on a webpage, just specify the urls and the css selector for the components for which the state should be extracted.

Diarmuid

Algolia Webcrawler

jancurn/algolia-webcrawler

Crawls a website using one or more sitemaps and imports the data to Algolia search index. The text content is identified using simple CSS selectors.

Jan Čurn

Page Scraping Analyzer

apify/page-analyzer

Performs analysis of a webpage to figure out the best way how to scrape its data. Provide a URL and data points to find and get back a detailed dashboard showing how the data can be scraped. Works with initial and rendered HTML, JavaScript variables and dynamically loaded data.

Apify

1.3k

Gumroad Scraper

muhammetakkurtt/gumroad-scraper

Powerful Gumroad product scraper that extracts digital products, courses, and assets with advanced filtering options. Search by category, price range, rating, and file type. Supports unlimited product collection with structured data output including seller details, ratings, and pricing information.