Pay $20.00 for 1,000 results

AI Website Content Markdown Scraper

quaking_pail/ai-website-content-markdown-scraper

Pay $20.00 for 1,000 results

This Apify Actor, "Website Content Crawler with Markdown Extraction," is designed to perform a comprehensive crawl of specified websites, extract their text content, convert it into Markdown format, and store it in a structured dataset. The extracted content is suitable for feeding LLMs.

Developer

AI_Builder

Actor Metrics

108 Monthly users
No reviews yet
20 bookmarks
>99% runs succeeded
Created in Jun 2024
Modified 8 hours ago

Categories

Start URLs

start_urlsarrayRequired

URLs to start with

Maximum Depth

max_depthintegerOptional

Depth to which to scrape to

Default value of this property is 1

Max URLs

max_urlsintegerOptional

Maximum number of URLs to retrieve

Default value of this property is 10

Search Engine

search_engineEnumOptional

The search engine to use for queries

Value options:

"Google": string"Bing": string"DuckDuckGo": string

Default value of this property is "Google"

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

39.3k

4.6/5

AI Content Topic Generator 🎯

easyapi/ai-content-topic-generator

🚀 Generate trending content ideas and topics based on keywords! Get AI-powered suggestions with SEO benefits analysis and relevance explanations. Perfect for content creators, marketers, and SEO specialists looking to boost engagement and search rankings. ✨

EasyApi

Backlink Opportunity Finder

easyapi/backlink-opportunity-finder

🔍 Discover high-quality backlink opportunities to boost your domain authority and search rankings. Extract valuable data about potential websites for building authoritative backlinks, including domain metrics, relevance analysis, and estimated SEO impact.

EasyApi

Actor Inspector Agent

jakub.kopecky/actor-inspector-agent

Agent Actor Inspector 🕵️‍♂️: An Apify Actor that rates others on docs 📝, inputs 🔍, code 💻, functionality ⚙️, performance ⏱️, and uniqueness 🌟. Config with actorId array, run, and review results. Helps devs improve, ensures quality, and guides users.

Jakub Kopecký

Lead Pipeline Scraper

maxforbang/lead-pipeline-scraper

Crawl contacts' websites and extract LLM-ready markdown content for AI-personalized messaging.

Max Forbang

Dynamic Markdown Scraper

louisdeconinck/dynamic-markdown-scraper

Effortlessly feed LLM AIs with clean Markdown using our advanced web scraper. Seamlessly scrape dynamic, JavaScript-rendered websites while preserving original formatting. Ideal for AI training, documentation, and content migration.

Louis Deconinck

Website Content to Markdown for LLM Training

easyapi/website-content-to-markdown-for-llm-training

🚀 Transform web content into clean, LLM-ready Markdown! 📘 Scrape multiple pages, extract main content, and convert to Markdown format. Perfect for AI researchers, data scientists, and LLM developers. Fast, efficient, and customizable. Supercharge your AI training data today! 🌐📝🧠

EasyApi

5.0/5

RAG Web Browser

apify/rag-web-browser

Web browser for OpenAI Assistants, RAG pipelines, or AI agents, similar to a web browser in ChatGPT. It queries Google Search, scrapes the top N pages from the results, and returns their cleaned content as Markdown for further processing by an LLM. It can also scrape individual URLs. Supports MCP.

Apify

869

4.6/5

Google Search Results Scraper

apify/google-search-scraper

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, AI overviews, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export scraped data, run the scraper via API, schedule runs, or integrate with other tools.

Apify

54.9k