No credit card required

Example Sitemap Cheerio

jancurn/example-sitemap-cheerio

No credit card required

An example actor that first downloads a sitemap in XML format and the crawls each page from the sitemap using the fast CheerioCrawler from Apify SDK.

API clients

API endpoints

The code examples below show how to run the Actor and get its results. To run the code, you need to have an Apify account. Replace <YOUR_API_TOKEN> in the code with your API token, which you can find under Settings > Integrations in Apify Console. Learn more

Node.js

Python

curl

1# Set API token
2API_TOKEN=<YOUR_API_TOKEN>
3
4# Prepare Actor input
5cat > input.json <<'EOF'
6{}
7EOF
8
9# Run the Actor using an HTTP API
10# See the full API reference at https://docs.apify.com/api/v2
11curl "https://api.apify.com/v2/acts/jancurn~example-sitemap-cheerio/runs?token=$API_TOKEN" \
12  -X POST \
13  -d @input.json \
14  -H 'Content-Type: application/json'

Developer

Jan Čurn

Actor metrics

1 monthly user
2 stars
Created in Jan 2019
Modified almost 2 years ago

Categories

Developer examples

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗LangChain, LlamaIndex, and the wider LLM ecosystem.