Pricing

from $1.00 / 1,000 page processeds

Try for free

Go to Apify Store

Suchi.Anantasutra: llms.txt & llms-full.txt Generator

Try for free

Generate a spec-compliant llms.txt and llms-full.txt for any website: robots.txt-respecting crawl, sitemap-first discovery and clean Markdown per page. Pay per page, no subscription.

Pricing

from $1.00 / 1,000 page processeds

Rating

0.0

(0)

Developer

Bhavy Duneja

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

Categories

SEO tools

Developer tools

URL

url

Required

Final URL of the page after redirects.

Type:string

Example:

https://docs.example.com/guides/install

Status

status

Required

ok = processed and included in both files (billed); skipped = not included (see reason, not billed); error = could not be fetched (not billed).

Type:string

Example:

Options:

okskippederror

HTTP status

httpStatus

Optional

HTTP status code of the page.

Type:integer | null

Example:

200

Title

title

Optional

Page title used in llms.txt (H1, og:title or with the site suffix removed).

Type:string | null

Example:

Installation

Description

description

Optional

Link note used in llms.txt (meta description or first paragraph).

Type:string | null

Example:

Install the CLI and create your first project.

Section

section

Optional

The llms.txt H2 section the page is listed under.

Type:string | null

Example:

Guides

In llms.txt

inLlmsTxt

Optional

Whether the page is listed in llms.txt and llms-full.txt.

Type:boolean

Example:

true

Linked URL

linkUrl

Optional

URL used in llms.txt (Markdown alternate or canonical URL when available).

Type:string | null

Example:

https://docs.example.com/guides/install.md

Words

wordCount

Optional

Words of extracted main content (code blocks excluded).

Type:integer | null

Example:

412

Markdown characters

markdownChars

Optional

Length of the extracted Markdown.

Type:integer | null

Example:

2950

Truncated

truncated

Optional

True when the page exceeded the size limits and was cut.

Type:boolean

Example:

false

Prompt injection suspected

promptInjectionSuspected

Optional

True when the page contains text that reads like instructions aimed at AI agents. Such text is never used for the llms.txt title, summary or link notes, but the page content is copied as-is into llms-full.txt: review it before publishing.

Type:boolean

Example:

false

Reason

reason

Optional

Why a page was skipped or failed (for example robots.txt, noindex, little text, or a near-duplicate copy of an earlier page under another session ID or crawl-trap URL).

Type:string | null

Example:

null

Markdown

markdown

Optional

Main content as clean Markdown (only when includeMarkdownInDataset is on).

Type:string | null

Example:

## Requirements - Node.js 22 or newer

Instagram Scraper

apify/instagram-scraper

Extract Instagram posts, reels, profiles, places, hashtags, carousels, and comments. Get data from Instagram using one or more Instagram URLs or search queries: content, context, metrics, metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

441K

4.7

(603)

Instagram Profile Scraper

apify/instagram-profile-scraper

Scrape all Instagram profile info. Just add Instagram usernames, IDs or URLs and extract name, join date, number of followers, location, bio, website, related profiles, video&post count, latest posts. Export scraped data, schedule scraper via API, and integrate with other tools or AI workflows.

Apify

258K

4.7

(175)

TikTok Scraper

clockworks/tiktok-scraper

Extract data from TikTok videos, hashtags, and users. Use URLs or search queries to scrape TikTok profiles, hashtags, posts, URLs, shares, followers, hearts, names, video, and music-related data. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Clockworks

350K

4.7

(370)

Google Maps Scraper

compass/crawler-google-places

Extract data from thousands of Google Maps locations and businesses, including reviews, reviewer details, images, contact info, including full name, email, and job title, opening hours, prices & more. Export data, run via API, schedule and monitor runs, or integrate with other tools.

Compass

660K

4.7

(1,818)

Twitter (X.com) Scraper Unlimited: No Limits

apidojo/twitter-scraper-lite

Introducing Twitter Scraper Unlimited, the most comprehensive Twitter data extraction solution available. Our enterprise-grade scraper offers unmatched capabilities with a transparent event-based pricing model, making it perfect for both small-scale and large-scale data extraction needs.

API Dojo

40K

4.8

(100)

Instagram Reel Scraper

apify/instagram-reel-scraper

Scrape or download Instagram reels. Just add Instagram profile or reel URL, and get caption, timestamp, transcript, hashtags, mentions, tagged users, comments, likes, shares, views, duration, and downloaded video. Export scraped data, schedule via API, and integrate with other tools or AI workflows.

Apify

171K

4.4

(103)

LinkedIn Profile Scraper + Email (No Cookies)

harvestapi/linkedin-profile-scraper

Extract detailed information from LinkedIn profiles in bulk, including complete work experience, education history, skills and more. No cookies or account required.

HarvestAPI

85K

4.6

(93)

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract posts, videos, and engagement metrics from Facebook pages. Get text captions, reactions, video transcripts, images, external links, collaborators, and more from Facebook pages and profiles. Export ad data, schedule runs via API, and integrate with other tools or AI workflows.

Apify

128K

4.7

(236)

Instagram Hashtag Scraper

apify/instagram-hashtag-scraper

Scrape Instagram posts and reels by hashtags. Just add one or more hashtags and extract captions, locations, likes, plays, shares, comments count, images, timestamps, audio, and other hashtags. Export scraped hashtags, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

135K

3.5

(91)

Google Search Results Scraper

apify/google-search-scraper

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, AI Mode, AI overviews, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export data, run the scraper via API, schedule runs, or integrate with other tools.

Apify

213K

4.6

(220)