Pricing

from $0.50 / 1,000 pages

Try for free

Go to Apify Store

Website to Markdown & Sitemap to Markdown: RAG, llms.txt

Try for free

Turn any website into clean Markdown for RAG using its sitemap. Incremental mode returns only new and changed pages and lists removed URLs. Heading-aware token chunks and llms.txt in the same run at no extra charge. Link-crawl fallback, contentHash. No browser. $0.50 per 1,000 pages.

Pricing

from $0.50 / 1,000 pages

Rating

0.0

(0)

Developer

Mohamed Bahaa

Actor stats

Bookmarked

Total users

Monthly active users

2 hours ago

Last modified

Website to Markdown & Sitemap to Markdown for RAG, llms.txt API through CLI

The Apify CLI is the official tool that allows you to use Website to Markdown & Sitemap to Markdown: RAG, llms.txt locally, providing convenience functions and automatic retries on errors.

Install Apify CLI

Using installation script (macOS/Linux):

$curl -fsSL https://apify.com/install-cli.sh | bash

Using installation script (Windows):

$irm https://apify.com/install-cli.ps1 | iex

Using Homebrew:

$brew install apify-cli

Using npm:

$npm install -g apify-cli

Other API clients include:

Website to Markdown & Sitemap to Markdown: RAG, llms.txt API in Python

Website to Markdown & Sitemap to Markdown: RAG, llms.txt API in JavaScript

Website to Markdown & Sitemap to Markdown: RAG, llms.txt OpenAPI definition

Website to Markdown & Sitemap to Markdown: RAG, llms.txt API

Instagram Scraper

apify/instagram-scraper

Extract Instagram posts, reels, profiles, places, hashtags, carousels, and comments. Get data from Instagram using one or more Instagram URLs or search queries: content, context, metrics, metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

435K

4.7

(602)

LinkedIn Profile Scraper + Email (No Cookies)

harvestapi/linkedin-profile-scraper

Extract detailed information from LinkedIn profiles in bulk, including complete work experience, education history, skills and more. No cookies or account required.

HarvestAPI

81K

4.6

(93)

TikTok Scraper

clockworks/tiktok-scraper

Extract data from TikTok videos, hashtags, and users. Use URLs or search queries to scrape TikTok profiles, hashtags, posts, URLs, shares, followers, hearts, names, video, and music-related data. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Clockworks

341K

4.7

(370)

Instagram Profile Scraper

apify/instagram-profile-scraper

Scrape all Instagram profile info. Just add Instagram usernames, IDs or URLs and extract name, join date, number of followers, location, bio, website, related profiles, video&post count, latest posts. Export scraped data, schedule scraper via API, and integrate with other tools or AI workflows.

Apify

253K

4.7

(175)

Google Maps Scraper

compass/crawler-google-places

Extract data from thousands of Google Maps locations and businesses, including reviews, reviewer details, images, contact info, including full name, email, and job title, opening hours, prices & more. Export data, run via API, schedule and monitor runs, or integrate with other tools.

Compass

654K

4.7

(1,818)

Facebook Search Actor (No Cookies)

mina_safwat/facebook-search-actor

If you want to search on Facebook at a large scale, this is the best tool available, offering the best accuracy and price.

Mina

406

Instagram Reel Scraper

apify/instagram-reel-scraper

Scrape or download Instagram reels. Just add Instagram profile or reel URL, and get caption, timestamp, transcript, hashtags, mentions, tagged users, comments, likes, shares, views, duration, and downloaded video. Export scraped data, schedule via API, and integrate with other tools or AI workflows.

Apify

167K

4.4

(103)

LinkedIn Profile Posts Scraper (No Cookies)

harvestapi/linkedin-profile-posts

Extract posts from LinkedIn profiles, including content, media, engagement, reactions, comments, and more. No cookies or account required.

HarvestAPI

42K

4.4

(55)

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including caption, metrics, images, mentions, coauthors, recent comments, sponsored status, video duration, views. Export scraped data, schedule scraper via API, integrate with other tools or AI workflows.

Apify

143K

4.3

(138)

Facebook Search Scraper

danek/facebook-search-ppr

Scrap Facebook search results fast and easy. It is designed to be fast and efficient, so it can extract a large number of results for low price. It is also less likely to be blocked by Facebook.