Pricing

$1.50 / 1,000 page extracteds

Try for free

Go to Apify Store

Website to LLM-Ready Dataset - Markdown & Chunks for RAG

Try for free

Crawl a website or docs site and get clean Markdown, token-sized semantic chunks and metadata for every page. Ready for vector databases and RAG pipelines. $1.50 per 1,000 pages.

Pricing

$1.50 / 1,000 page extracteds

Rating

0.0

(0)

Developer

Atesen Software

Actor stats

Bookmarked

Total users

Monthly active users

a day ago

Last modified

Categories

Developer tools

Agents

url

Optional

Final URL of the crawled page (after redirects, without fragment)

Type:string | null

Example:

https://docs.example.com/guide/getting-started

title

Optional

Page title, taken from the main heading of the page when available

Type:string | null

Example:

Getting started

description

Optional

Meta description of the page

Type:string | null

Example:

Install the library and run your first example.

language

Optional

Language code (ISO 639-1 where available), from the page declaration or detected from the text

Type:string | null

Example:

headings

Optional

Headings of the page in document order, as plain text

Type:string[] | null

Example:

[
  "Getting started",
  "Installation",
  "First example"
]

wordCount

Optional

Number of words in the extracted Markdown

Type:integer | null

Example:

842

tokenCount

Optional

Number of tokens in the extracted Markdown (cl100k_base tokenizer)

Type:integer | null

Example:

1210

markdown

Optional

Clean Markdown of the main content only: navigation, footers, sidebars and other boilerplate removed

Type:string | null

Example:

# Getting started Install the library with `pip install example`.

chunks

Optional

The Markdown split into semantic, token-bounded chunks ready for embedding

Type:object[] | null

Example:

[
  {
    "index": 0,
    "text": "# Getting started\n\nInstall the library with `pip install example`.",
    "tokens": 18,
    "section": "Getting started"
  }
]

canonicalUrl

Optional

Canonical URL declared by the page, if any

Type:string | null

Example:

https://docs.example.com/guide/getting-started

publishedAt

Optional

Publication date declared by the page (ISO 8601), if any

Type:string | null

Example:

2025-01-15T12:00:00.000Z

modifiedAt

Optional

Last modification date declared by the page (ISO 8601), if any

Type:string | null

Example:

2025-02-01T09:30:00.000Z

contentHash

Optional

SHA-256 based fingerprint of the Markdown, useful for deduplication and change detection

Type:string | null

Example:

9f2c1e5ab07d4c3e8a61b2d4f7a90c13

crawledAt

Optional

When the page was crawled (ISO 8601)

Type:string | null

Example:

2025-02-02T10:15:00.000Z

Other properties may be included.

Youtube Scraper (Pay Per Result)

apidojo/youtube-scraper

Experience unparalleled efficiency and depth with its ultra-fast capabilities in searching, URL, playlist, channel, and profile scraping. It comes equipped with a variety of filters to customize your data collection precisely. Plus, it's incredibly affordable at only $0.50 per 1000 videos!

API Dojo

35K

3.3

(21)

YouTube Scraper

streamers/youtube-scraper

YouTube crawler and video scraper. Alternative YouTube API with no limits or quotas. Extract and download channel name, likes, number of views, and number of subscribers.

Streamers

177K

4.8

(198)

Facebook Search Scraper

danek/facebook-search-ppr

Scrap Facebook search results fast and easy. It is designed to be fast and efficient, so it can extract a large number of results for low price. It is also less likely to be blocked by Facebook.

Jan Danecki

55K

4.1

(18)

Twitter (X.com) Scraper Unlimited: No Limits

apidojo/twitter-scraper-lite

Introducing Twitter Scraper Unlimited, the most comprehensive Twitter data extraction solution available. Our enterprise-grade scraper offers unmatched capabilities with a transparent event-based pricing model, making it perfect for both small-scale and large-scale data extraction needs.

API Dojo

40K

4.8

(100)

TikTok Scraper

clockworks/tiktok-scraper

Extract data from TikTok videos, hashtags, and users. Use URLs or search queries to scrape TikTok profiles, hashtags, posts, URLs, shares, followers, hearts, names, video, and music-related data. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Clockworks

354K

4.7

(370)

Tweet Scraper V2 - X Scraper / Twitter Scraper / X.com Scraper

apidojo/tweet-scraper

Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.40 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!

API Dojo

113K

3.9

(196)

Facebook Search Scraper — People, Pages, Posts & More

memo23/facebook-search-scraper

The most complete Facebook search: people, pages, places, events, posts, videos and top — in one actor, no login and no cookies. Get names, URLs, profile pictures, verified badges, event dates, and post text with authors. Auto-paginates across results. Export to JSON, CSV or Excel.

Muhamed Didovic

5.6K

5.0

(2)

Instagram Scraper

apify/instagram-scraper

Extract Instagram posts, reels, profiles, places, hashtags, carousels, and comments. Get data from Instagram using one or more Instagram URLs or search queries: content, context, metrics, metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

446K

4.7

(603)

Facebook Search Scraper

silentflow/facebook-search-scraper

Search Facebook by keyword and export posts, pages, places, events and people as clean structured data. Get text, author, reactions breakdown, comment and share counts, images, videos, links and timestamps. No login. Six search types in one actor. For lead generation, social listening, research.

SilentFlow

4.8K

TikTok Search Scraper: Keywords, Hashtags, Creators

xmolodtsov/tiktok-search-scraper

Scrape TikTok search results by keyword or hashtag and discover creators. Pay only per result. Views, likes, comments, shares, bookmarks, channel stats, music, subtitles and direct video URLs as JSON. Output compatible with popular TikTok scrapers. No proxies or login needed. Works via API and MCP.