No-BS Content Crawler 🖕

Pricing

from $1.00 / 1,000 web-scraps

Try for free

Go to Apify Store

No-BS Content Crawler 🖕

Try for free

Fast web crawler that extracts clean text from websites. Returns readable content, headings, and links. Perfect for content aggregation, SEO research, and data collection.

Pricing

from $1.00 / 1,000 web-scraps

Rating

5.0

(4)

Developer

hafsah nuzhat

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

24 days ago

Last modified

Start URLs

startUrlsarrayRequired

List of URLs to start scraping from

Default value of this property is [{"url":"https://example.com"}]

Max Requests

maxRequestsPerCrawlintegerOptional

Maximum number of pages to scrape

Default value of this property is 100

Max Pages Per Site

maxPagesPerSiteintegerOptional

Maximum pages to scrape per domain

Default value of this property is 15

Include URL Patterns

includePatternsarrayOptional

Regex patterns for URLs to include

Default value of this property is []

Exclude URL Patterns

excludePatternsarrayOptional

Regex patterns for URLs to exclude

Default value of this property is []

Use Proxy

proxybooleanOptional

Whether to use proxies

Default value of this property is true

Respect Robots.txt

respectRobotsTxtbooleanOptional

Whether to respect robots.txt

Default value of this property is true

Request Delay (ms)

requestDelayMsintegerOptional

Delay between requests

Default value of this property is 400

Same Domain Only

sameDomainbooleanOptional

Only scrape same domain

Default value of this property is true

Website To Markdown

hamzasaleem/website-to-markdown

Convert any webpage to clean, readable Markdown format. Perfect for content extraction and readability.

Hmza

Fast Website Content Crawler

6sigmag/fast-website-content-crawler

A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

David Deng

2.5K

4.3

AI Markdown Maker

onescales/bulk-ai-markdown-maker

Convert any web page into clean, AI ready markdown format in seconds. Perfect for feeding content to AI models, creating documentation, or archiving web content in a portable format. In addition it intelligently parse web content, removing ads, navigation, and other clutter.

One Scales

5.0

Fast URL Content Crawler

6sigmag/fast-url-content-crawler

A high-performance web scraper that rapidly extracts and analyzes content from multiple URLs simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

David Deng

205

5.0

Olostep Web Scraper

olostep/olostep-web-scraper

Automate web search, scraping and crawling with Apify Actors using Olostep — the API to search, extract and structure web data for your workflows.

Olostep

website content crawler

akash9078/website-content-crawler

Powerful website content crawler tool to extract, analyze, and index web pages automatically. Streamline data collection with fast, accurate web scraping technology.

Akash Kumar Naik

Markdown Table Generator

visita/markdown-table-generator

This Actor converts data from multiple sources into a clean, presentation-ready table. You can provide raw text, a direct URL to a file (like `.xlsx` or `.csv`), or Run ID of another Apify Actor, and this tool will automatically format it into Markdown, HTML, or Confluence Wiki markup.

Visita AI & Automation

DRG Phantom Core - Genesis Pilot

tuguidragos/drg-phantom-core-genesis-pilot

A stealth-grade autonomous lead intelligence engine that discovers, enriches, analyzes, and qualifies B2B prospects using multi-source scraping and AI scoring. This pilot release showcases the system’s core capabilities and foundational architecture.

Țugui Dragoș

5.0

Youtube Transcript Extractor ( with Metadata )

devnaz/youtube-transcript-extractor

Extract YouTube video transcripts with complete metadata including title, description, views, likes, channel information, tags, and more.

DevnaZ

YouTube Video Comments scraper

powerai/youtube-video-comment-scraper

Extract comprehensive comments from any YouTube video with detailed metadata including author information, engagement metrics, and timestamps. Perfect for sentiment analysis, community engagement tracking, and content feedback analysis.