No credit card required

Example Sitemap Cheerio

jancurn/example-sitemap-cheerio

No credit card required

An example actor that first downloads a sitemap in XML format and the crawls each page from the sitemap using the fast CheerioCrawler from Apify SDK.

API clients

API endpoints

The code examples below show how to run the Actor and get its results. To run the code, you need to have an Apify account. Replace <YOUR_API_TOKEN> in the code with your API token, which you can find under Settings > Integrations in Apify Console. Learn more

Node.js

Python

curl

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4client = ApifyClient("<YOUR_API_TOKEN>")
5
6# Prepare the Actor input
7run_input = {}
8
9# Run the Actor and wait for it to finish
10run = client.actor("jancurn/example-sitemap-cheerio").call(run_input=run_input)
11
12# Fetch and print Actor results from the run's dataset (if there are any)
13print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
14for item in client.dataset(run["defaultDatasetId"]).iterate_items():
15    print(item)
16
17# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

Developer

Jan Čurn

Actor metrics

1 monthly user
2 stars
Created in Jan 2019
Modified almost 2 years ago

Categories

Developer examples

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗LangChain, LlamaIndex, and the wider LLM ecosystem.