Ai Content Scraper Cleaner

Pricing

Pay per usage

Ai Content Scraper Cleaner

AI Content Scraper & Cleaner — Scrapes structured content (documentation, articles, FAQs, blog posts) and converts it into clean, normalized JSON datasets for LLM training. Extracts text, detects content types, estimates tokens, and removes boilerplate to produce ready-to-use training data.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

JEEVAN JYOTI DASH

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Categories

Lead generation

Integrations

You can access the Ai Content Scraper Cleaner programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

{
  "openapi": "3.0.1",
  "info": {
    "version": "0.0",
    "x-build-id": "L4Y3slxpLSE0Ba4TP"
  },
  "servers": [
    {
      "url": "https://api.apify.com/v2"
    }
  ],
  "paths": {
    "/acts/dashjeevanthedev~ai-content-scraper-cleaner/run-sync-get-dataset-items": {
      "post": {
        "operationId": "run-sync-get-dataset-items-dashjeevanthedev-ai-content-scraper-cleaner",
        "x-openai-isConsequential": false,
        "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
        "tags": [
          "Run Actor"
        ],
        "requestBody": {
          "required": true,
          "content": {
            "application/json": {
              "schema": {
                "$ref": "#/components/schemas/inputSchema"
              }
            }
          }
        },
        "parameters": [
          {
            "name": "token",
            "in": "query",
            "required": true,
            "schema": {
              "type": "string"
            },
            "description": "Enter your Apify token here"
          }
        ],
        "responses": {
          "200": {
            "description": "OK"
          }
        }
      }
    },
    "/acts/dashjeevanthedev~ai-content-scraper-cleaner/runs": {
      "post": {
        "operationId": "runs-sync-dashjeevanthedev-ai-content-scraper-cleaner",
        "x-openai-isConsequential": false,
        "summary": "Executes an Actor and returns information about the initiated run in response.",
        "tags": [
          "Run Actor"
        ],
        "requestBody": {
          "required": true,
          "content": {
            "application/json": {
              "schema": {
                "$ref": "#/components/schemas/inputSchema"
              }
            }
          }
        },
        "parameters": [
          {
            "name": "token",
            "in": "query",
            "required": true,
            "schema": {
              "type": "string"
            },
            "description": "Enter your Apify token here"
          }
        ],
        "responses": {
          "200": {
            "description": "OK",
            "content": {
              "application/json": {
                "schema": {
                  "$ref": "#/components/schemas/runsResponseSchema"
                }
              }
            }
          }
        }
      }
    },
    "/acts/dashjeevanthedev~ai-content-scraper-cleaner/run-sync": {
      "post": {
        "operationId": "run-sync-dashjeevanthedev-ai-content-scraper-cleaner",
        "x-openai-isConsequential": false,
        "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
        "tags": [
          "Run Actor"
        ],
        "requestBody": {
          "required": true,
          "content": {
            "application/json": {
              "schema": {
                "$ref": "#/components/schemas/inputSchema"
              }
            }
          }
        },
        "parameters": [
          {
            "name": "token",
            "in": "query",
            "required": true,
            "schema": {
              "type": "string"
            },
            "description": "Enter your Apify token here"
          }
        ],
        "responses": {
          "200": {
            "description": "OK"
          }
        }
      }
    }
  },
  "components": {
    "schemas": {
      "inputSchema": {
        "type": "object",
        "required": [
          "startUrls"
        ],
        "properties": {
          "startUrls": {
            "title": "Start URLs (comma-separated URLs)",
            "type": "string",
            "description": "Comma-separated list of URLs to start crawling from.",
            "default": "https://crawlee.dev/docs/introduction, https://docs.apify.com/platform/actors, https://developer.mozilla.org/en-US/docs/Web/JavaScript/Guide/Introduction, https://react.dev/learn, https://nextjs.org/docs/getting-started"
          },
          "maxRequestsPerCrawl": {
            "title": "Max requests per crawl",
            "type": "string",
            "description": "Maximum number of requests allowed for this run.",
            "default": "50"
          },
          "contentSelectors": {
            "title": "Content CSS selectors (comma-separated)",
            "type": "string",
            "description": "Comma-separated CSS selectors used to extract main content.",
            "default": "article, .doc-content, .post-content"
          },
          "titleSelectors": {
            "title": "Title CSS selectors (comma-separated)",
            "type": "string",
            "description": "Comma-separated CSS selectors used to extract page title.",
            "default": "h1, .post-title"
          },
          "minimumTextLength": {
            "title": "Minimum text length",
            "type": "string",
            "description": "Ignore content shorter than this many characters.",
            "default": "300"
          },
          "contentType": {
            "title": "Content type override",
            "enum": [
              "auto",
              "faq",
              "article",
              "guide",
              "documentation",
              "blog",
              "other"
            ],
            "type": "string",
            "description": "Force a specific content type.",
            "default": "auto"
          },
          "maxDepth": {
            "title": "Max crawl depth",
            "type": "string",
            "description": "How deep the crawler is allowed to follow links.",
            "default": "2"
          },
          "respectRobotsTxt": {
            "title": "Respect robots.txt",
            "enum": [
              "true",
              "false"
            ],
            "type": "string",
            "description": "Whether the crawler should honor robots.txt rules.",
            "default": "true"
          },
          "useProxy": {
            "title": "Use Apify Proxy",
            "enum": [
              "true",
              "false"
            ],
            "type": "string",
            "description": "Rotate proxies via Apify proxy when available.",
            "default": "true"
          },
          "language": {
            "title": "Language Filter",
            "type": "string",
            "description": "Optional language code (e.g. en). Leave empty for no filter.",
            "default": "en"
          }
        }
      },
      "runsResponseSchema": {
        "type": "object",
        "properties": {
          "data": {
            "type": "object",
            "properties": {
              "id": {
                "type": "string"
              },
              "actId": {
                "type": "string"
              },
              "userId": {
                "type": "string"
              },
              "startedAt": {
                "type": "string",
                "format": "date-time",
                "example": "2025-01-08T00:00:00.000Z"
              },
              "finishedAt": {
                "type": "string",
                "format": "date-time",
                "example": "2025-01-08T00:00:00.000Z"
              },
              "status": {
                "type": "string",
                "example": "READY"
              },
              "meta": {
                "type": "object",
                "properties": {
                  "origin": {
                    "type": "string",
                    "example": "API"
                  },
                  "userAgent": {
                    "type": "string"
                  }
                }
              },
              "stats": {
                "type": "object",
                "properties": {
                  "inputBodyLen": {
                    "type": "integer",
                    "example": 2000
                  },
                  "rebootCount": {
                    "type": "integer",
                    "example": 0
                  },
                  "restartCount": {
                    "type": "integer",
                    "example": 0
                  },
                  "resurrectCount": {
                    "type": "integer",
                    "example": 0
                  },
                  "computeUnits": {
                    "type": "integer",
                    "example": 0
                  }
                }
              },
              "options": {
                "type": "object",
                "properties": {
                  "build": {
                    "type": "string",
                    "example": "latest"
                  },
                  "timeoutSecs": {
                    "type": "integer",
                    "example": 300
                  },
                  "memoryMbytes": {
                    "type": "integer",
                    "example": 1024
                  },
                  "diskMbytes": {
                    "type": "integer",
                    "example": 2048
                  }
                }
              },
              "buildId": {
                "type": "string"
              },
              "defaultKeyValueStoreId": {
                "type": "string"
              },
              "defaultDatasetId": {
                "type": "string"
              },
              "defaultRequestQueueId": {
                "type": "string"
              },
              "buildNumber": {
                "type": "string",
                "example": "1.0.0"
              },
              "containerUrl": {
                "type": "string"
              },
              "usage": {
                "type": "object",
                "properties": {
                  "ACTOR_COMPUTE_UNITS": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATASET_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATASET_WRITES": {
                    "type": "integer",
                    "example": 0
                  },
                  "KEY_VALUE_STORE_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "KEY_VALUE_STORE_WRITES": {
                    "type": "integer",
                    "example": 1
                  },
                  "KEY_VALUE_STORE_LISTS": {
                    "type": "integer",
                    "example": 0
                  },
                  "REQUEST_QUEUE_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "REQUEST_QUEUE_WRITES": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATA_TRANSFER_INTERNAL_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATA_TRANSFER_EXTERNAL_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "PROXY_SERPS": {
                    "type": "integer",
                    "example": 0
                  }
                }
              },
              "usageTotalUsd": {
                "type": "number",
                "example": 0.00005
              },
              "usageUsd": {
                "type": "object",
                "properties": {
                  "ACTOR_COMPUTE_UNITS": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATASET_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATASET_WRITES": {
                    "type": "integer",
                    "example": 0
                  },
                  "KEY_VALUE_STORE_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "KEY_VALUE_STORE_WRITES": {
                    "type": "number",
                    "example": 0.00005
                  },
                  "KEY_VALUE_STORE_LISTS": {
                    "type": "integer",
                    "example": 0
                  },
                  "REQUEST_QUEUE_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "REQUEST_QUEUE_WRITES": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATA_TRANSFER_INTERNAL_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATA_TRANSFER_EXTERNAL_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "PROXY_SERPS": {
                    "type": "integer",
                    "example": 0
                  }
                }
              }
            }
          }
        }
      }
    }
  }
}

Ai Content Scraper Cleaner OpenAPI definition

OpenAPI is a standard for designing and describing RESTful APIs, allowing developers to define API structure, endpoints, and data formats in a machine-readable way. It simplifies API development, integration, and documentation.

OpenAPI is effective when used with AI agents and GPTs by standardizing how these systems interact with various APIs, for reliable integrations and efficient communication.

By defining machine-readable API specifications, OpenAPI allows AI models like GPTs to understand and use varied data sources, improving accuracy. This accelerates development, reduces errors, and provides context-aware responses, making OpenAPI a core component for AI applications.

You can download the OpenAPI definitions for Ai Content Scraper Cleaner from the options below:

OpenAPI.json

If you’d like to learn more about how OpenAPI powers GPTs, read our blog post.

You can also check out our other API clients:

Ai Content Scraper Cleaner API in Python

Ai Content Scraper Cleaner API in JavaScript

Ai Content Scraper Cleaner API through CLI

Ai Content Scraper Cleaner API

YouTube Ultimate Scraper (PPE)

ultimate/youtube-scraper

Scrape videos, comments, replies, transcripts, and channel metadata with YouTube Ultimate Scraper. Designed for flexibility, speed, and reliability, it’s perfect for everything from one-off research to large-scale automation.

Ultimate Insight

5.0

(2)

Medium Public Post Parser Script

hello.datawizards/medium-public-post-parser-script

“A powerful Apify Actor that intelligently parses and extracts clean, structured content from Medium articles. It captures titles, authors, metadata, images, publishers, and fully cleaned article text, delivering accurate, ready-to-use datasets for automation and analysis.”

datawizards

MCP Documentation Hunter

bmerlyns/merlyn-docs-hunter

Enhance your coding assistants with up to date documentation of the frameworks or codebases you use. Actor to be called via MCP and provide realtime data to the coding assistant -> improving LLM's context and reducing hallucinations.

Benjamin Merlyn

Twitter Profile Scraper: Get Profile Tweets + Their Replies

apidojo/twitter-profile-scraper

Extract tweets, replies & engagement data from Twitter profiles. $0.016 per profile includes 40 tweets FREE. Get likes, retweets, views & media URLs. Date filtering, reply extraction, custom data transformation. No authentication, no proxy required. Event-based pricing, only pay for what you scrape!

API Dojo

5.0

(5)

Google Trends Scraper

scraper-engine/google-trends-scraper

Scrape real-time and historical Google Trends data, including interest over time, related queries, topics, and regional popularity. Perfect for SEO, market research, forecasting, and trend analysis. Fast, accurate, and ideal for building data-driven insights.

Scraper Engine

Google Trends Scraper

api-empire/google-trends-scraper

Analyze search trends effortlessly. Scrape keyword popularity, categories, breakout queries, trend comparisons, and geographic data. Perfect for forecasting, SEO planning, market intelligence, and content strategy optimization.

API Empire

Google Trends Scraper

scrapier/google-trends-scraper

This Google Trends Scraper extracts interest-over-time charts, keyword comparisons, related searches, and regional heatmap data. Ideal for SEO teams, analysts, and businesses tracking demand shifts and emerging topics.

Scrapier

Airbnb Reviews Scraper

hello.datawizards/airbnb-reviews-scraper

Extract rich, multilingual Airbnb guest reviews with ratings, translations, reviewer profiles, host responses, and metadata. The Airbnb Reviews Scraper delivers clean, structured JSON perfect for hospitality analytics, sentiment insights, competitor tracking, and automation.

datawizards

Google Trends Scraper

scrapio/google-trends-scraper

Collect Google Trends insights automatically—search popularity, regions, rising queries, related topics, and trending patterns. Great for marketers, analysts, and researchers who need clean, export-ready trend data for reports and strategy.

Scrapio

Google Trends Scraper

simpleapi/google-trends-scraper

Gather real-time and historical Google Trends data at scale. Extract search interest, rising topics, comparisons, and regional stats. Excellent for researchers, strategists, and analysts building trend dashboards or predictive models.

SimpleAPI

Gartner Reviews (Includes likes and Dislikes) Scraper

hello.datawizards/gartner-reviews-includes-likes-and-dislikes-scraper

Extract detailed Gartner reviews, including likes, dislikes, ratings, job titles, and company info with structured JSON. Ideal for market research, competitor analysis, product insights, and sentiment tracking. Fast, proxy-supported, and easy to integrate into data workflows.

datawizards

5.0

(1)