TAAFT Scraper - Scrape 46,500+ AI Tools from There's An AI For That

Extract comprehensive, structured data from theresanaiforthat.com (TAAFT), the largest AI tools directory with 46,500+ tools across 11,000+ categories.

Quick Start

1. Click Try for free to open this Actor in Apify Console
2. Click Start to run with default settings (scrapes 5 tools)
3. When finished, click Export to download your data as JSON, CSV, or Excel

That's it. Default run takes under 15 seconds and costs less than $0.01.

What This Scraper Does

This scraper visits theresanaiforthat.com and extracts detailed information about every AI tool listed. Unlike scrapers that only pull basic card-level data (name, link, short description), this one visits each tool's full detail page to extract 29+ fields including pricing details, organization info, version history with changelogs, featured alternatives, related tools, and engagement metrics.

You can scrape the entire directory of 46,500+ tools, target specific categories, search by keyword, or provide direct URLs to individual tools.

Input Parameters

Parameter	Type	Default	Description
mode	string	"all"	How to discover tools. Options: "all" (full directory via categories), "category" (specific categories), "urls" (direct tool page URLs), "search" (keyword search)
categories	string[]	[]	Category slugs for "category" mode (e.g. ["chatting", "images", "coding"]). Find slugs at theresanaiforthat.com/tasks/
urls	string[]	[]	Direct TAAFT tool page URLs for "urls" mode (e.g. ["https://theresanaiforthat.com/ai/chatgpt/"])
searchQuery	string	""	Search term for "search" mode (e.g. "image generator")
maxTools	integer	5	Maximum tools to scrape. Set to 0 for unlimited
includeReleases	boolean	true	Extract version/release history. Disable for faster large scrapes

Output Fields

Every tool record includes the following fields:

Field	Type	Example	Description
name	string	"ChatGPT"	AI tool name
slug	string	"chatgpt"	URL identifier
taaftUrl	string	"https://theresanaiforthat.com/ai/chatgpt/"	Full TAAFT listing URL
externalUrl	string	"https://chat.openai.com/chat"	Official website (UTM params stripped)
description	string	"ChatGPT is OpenAI's conversational AI..."	Full tool description
shortDescription	string/null	"AI chatbot by OpenAI..."	One-line summary (null if same as description)
logoUrl	string	"https://media.theresanaiforthat.com/chatgpt.png"	Tool logo/icon URL
version	string	"5.2"	Current software version
dateCreated	string	"2022-11-30T00:00:00.000Z"	Tool creation date (ISO 8601)
dateModified	string	"2025-12-12T06:27:58.000Z"	Last modified date (ISO 8601)
organization	string/null	"OpenAI"	Developer/company name
country	string/null	"United States"	Organization country
verified	boolean	true	Whether the tool is verified on TAAFT
trendingRank	integer/null	14	Position in trending list (null if not trending)
toolId	integer	688	TAAFT internal numeric ID
rating	number/null	4.2	Average user rating (0-5 scale)
reviewCount	integer/null	304	Number of user reviews
saves	integer/null	128	Number of saves/bookmarks (extracted from listing cards)
views	integer	161091	Total view count
discussionCount	integer/null	80	Number of discussion comments
pricingModel	string/null	"Freemium"	Pricing type: Free, Freemium, Paid, Free Trial, Contact for Pricing
paidFrom	string/null	"$20/month"	Starting price
billingFrequency	string/null	"Monthly"	Billing cycle
categories	string[]/null	["Coding", "Writing", "Chatting"]	Task/category tags
taskHierarchy	string[]/null	["Personal", "Relationships", "Chatting"]	Breadcrumb category path
releases	object[]/null	See below	Version release history with changelogs
alternatives	object[]/null	[{"name": "Ormind", "slug": "noagi-chat"}]	Featured alternative tools
otherToolsBySameOrg	object[]/null	[{"name": "Whisper", "slug": "whisper"}]	Other tools by same developer
alsoUsedFor	object[]/null	[{"task": "Coding", "count": 877}]	Related task categories with tool counts
scrapedAt	string	"2026-02-16T21:32:20.792Z"	Extraction timestamp (ISO 8601)

Release history format

{
  "version": "5.2",
  "date": "Dec 12, 2025",
  "notes": "Better at expert-level professional work...",
  "upvotes": 12,
  "downvotes": 0,
  "releaseId": 2014
}

Sample JSON Output

This is actual output from a real scrape of the ChatGPT tool page:

{
  "name": "ChatGPT",
  "slug": "chatgpt",
  "taaftUrl": "https://theresanaiforthat.com/ai/chatgpt/",
  "externalUrl": "https://chat.openai.com/chat",
  "description": "ChatGPT is OpenAI's conversational AI...",
  "organization": "OpenAI",
  "country": "United States",
  "version": "5.2",
  "rating": 4.2,
  "reviewCount": 304,
  "views": 161091,
  "saves": 128,
  "discussionCount": 80,
  "pricingModel": "Freemium",
  "paidFrom": "$20/month",
  "billingFrequency": "Monthly",
  "trendingRank": 14,
  "categories": ["Coding", "Writing", "Chatting", "Search", "Brainstorming"],
  "releases": [
    {
      "version": "5.2",
      "date": "Dec 12, 2025",
      "notes": "Better at expert-level professional work...",
      "upvotes": 12,
      "downvotes": 0
    }
  ],
  "alternatives": [
    {"name": "Ormind", "slug": "noagi-chat"},
    {"name": "Rabbitholes AI", "slug": "rabbitholes-ai"}
  ],
  "otherToolsBySameOrg": [
    {"name": "Whisper", "slug": "whisper"},
    {"name": "Sora", "slug": "sora-by-openai"}
  ],
  "alsoUsedFor": [
    {"task": "Coding", "count": 877},
    {"task": "Writing", "count": 1186}
  ],
  "scrapedAt": "2026-02-16T21:32:20.792Z"
}

Input Modes

All tools (full directory)

Scrapes the entire TAAFT directory by discovering categories from the /tasks/ index page, then crawling each category's tool listings. Set maxTools to limit results.

Use case: Market research, building comprehensive AI tool databases, competitive analysis across the entire AI landscape.

By category

Provide specific category slugs to scrape only tools in those categories. Find category slugs at theresanaiforthat.com/tasks/.

Example slugs: chatting, images, coding, writing, productivity, music, video, sales

Use case: Focused research on specific AI verticals (e.g., all coding tools, all image generators).

Specific URLs

Provide direct TAAFT tool page URLs to scrape individual tools. Useful for monitoring specific tools over time.

Use case: Tracking competitors, monitoring pricing changes, building curated lists.

Search

Search TAAFT by keyword and scrape the matching results.

Use case: Finding tools for a specific need, discovering new tools in a niche.

Cost Estimates

The scraper uses Apify datacenter proxies. Costs depend on your Apify plan and current proxy rates.

Tools	Approx. Duration	Approx. Cost
5 (default)	~10-15 seconds	~$0.002
50	~2 minutes	~$0.02
100	~4 minutes	~$0.04
500	~20 minutes	~$0.20
1,000	~40 minutes	~$0.40
5,000	~3 hours	~$2.00
10,000	~6 hours	~$4.00
46,500 (FULL DIRECTORY)	~24 hours	~$15-20

Why the full directory costs $15-20: Each tool requires its own HTTP request to fetch the full detail page. With 46,500+ tools plus category discovery pages, that's 47,000+ requests through Apify's proxy infrastructure. The cost is dominated by proxy bandwidth and compute time, not by the scraper's efficiency.

Start small! Always test with the default maxTools: 5 first. Then scale up gradually: try 50, then 500, then 5,000. Monitor costs at each step before committing to a full directory scrape.

FAQ

What data fields are extracted? 29+ fields per tool, including name, description, pricing, organization, country, ratings, views, saves, version history, alternatives, related tools, and category hierarchy. See the Output Fields section for the complete list.

How long does a full directory scrape take? Approximately 24 hours for all 46,500+ tools. The scraper uses conservative concurrency (3 parallel requests) to avoid overwhelming the target site. Smaller runs are proportionally faster: 5 tools in ~15 seconds, 500 tools in ~20 minutes.

How much does it cost? The default 5-tool run costs less than $0.01. A full directory scrape costs approximately $15-20. See the Cost Estimates table for detailed breakdowns at various scales.

How often is TAAFT data updated? TAAFT updates continuously as new tools are submitted and existing tools are modified. Tool ratings, views, and trending ranks change frequently. We recommend scheduling regular scrapes (weekly or monthly) for the freshest data.

Can I scrape specific categories only? Yes. Use mode: "category" and provide category slugs like ["chatting", "coding", "images"]. Find all available category slugs at theresanaiforthat.com/tasks/.

Why are saves null for some tools? The saves count is extracted from listing cards during category/search discovery. In "urls" mode (direct tool URLs), saves data is not available because listing cards are not fetched. Use "all" or "category" mode to get saves data.

Why are releases null for some tools? Not all tools have version history on TAAFT. Only tools where the developer has published release notes will have the releases field populated.

Integrations

API Access

Access your scraped data programmatically via the Apify API:

# Get dataset items as JSON
curl "https://api.apify.com/v2/datasets/{DATASET_ID}/items?format=json&token={YOUR_TOKEN}"

# Get dataset items as CSV
curl "https://api.apify.com/v2/datasets/{DATASET_ID}/items?format=csv&token={YOUR_TOKEN}"

Scheduled Runs

Set up automatic recurring scrapes in the Apify Console under the Schedules tab. Common schedules:

• Weekly: Track trending tools and rating changes
• Monthly: Full directory refresh for comprehensive databases

Webhooks

Configure webhooks to trigger actions when a scrape completes. Go to Settings > Integrations in the Apify Console to set up notifications to Slack, email, or custom endpoints.

Programmatic Usage

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_TOKEN' });

const run = await client.actor('lovely_sequoia/taaft-scraper').call({
    mode: 'category',
    categories: ['coding', 'writing'],
    maxTools: 100,
});

const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(`Scraped ${items.length} tools`);

How This Compares

Unlike other TAAFT scrapers that only extract 5-7 card-level fields (name, short description, link, rating), this scraper visits every tool's full detail page to extract 29+ comprehensive fields including:

• Full pricing breakdown (model, starting price, billing frequency)
• Organization name and country
• Version history with changelogs, dates, and community votes
• Featured alternatives with slugs for cross-referencing
• Other tools by the same developer
• "Also used for" categories with tool counts per category
• Trending rank, view counts, discussion counts, and save counts
• Full breadcrumb category hierarchy from structured data

This depth of data enables use cases that card-level scrapers simply cannot support: competitive pricing analysis, developer ecosystem mapping, version tracking, and comprehensive market research.

Also Check Out

For comprehensive AI tool market research, pair this scraper with our Futurepedia AI Tools Scraper to get data from another major AI tools directory. Cross-referencing both sources gives you the most complete picture of the AI tools landscape.