AI-Powered Web Scraper — Smart Data Extraction

Crawls websites to extract clean, structured content for AI/LLM use, ideal for training datasets, knowledge bases, and RAG systems. Json output includes: * text: Normalized page content * links: Extracted sub-URLs

Firecrawl AI-Powered Web Search & Scrape

alizarin_refrigerator-owner/firecrawl-ai-powered-web-search-scrape

Search the web and get clean, LLM-ready content in one API call. Powered by Firecrawl's /v1/search endpoint. Returns markdown, HTML, or extracted data. Perfect for SEO research, competitor analysis, and AI training data collection.

AI-Powered Smart Web Scraper

cloud9_ai/ai-web-scraper

Intelligent content extraction from any website using Crawlee + AI. Auto-detects structure, adapts to layout changes, handles JavaScript rendering. No custom code needed. Extract articles, products, listings from 1000s of pages.

AI Web Scraper with Playwright Browser (No-Code, MCP)

data_rig/ai-web-scraper

Run a real Playwright browser as an AI web scraper. Extract structured data from any site using natural language—no selectors or scripts. Handles JS-heavy pages, pagination, and interactions. Built for MCP agents like OpenCode and Claude Code.

Fetch any live web page as clean LLM-ready markdown/text/HTML, extract elements by CSS selector, or capture a screenshot — JavaScript fully rendered.

Capture a batch of public web pages as PNG, JPEG, WebP or PDF: full page or viewport, one element by CSS selector, desktop, tablet and mobile presets, dark mode, hidden cookie banners. One result per URL with file URL and size; failed URLs are not charged.

Convert any web page into clean, readable Markdown or plain text — ads, navigation and boilerplate stripped out. Built for feeding AI agents, LLMs and RAG pipelines. Pay only per page.

Instagram Post Monitoring & Comments API

oneary/instagram-post-monitoring-comments-api

Capture Instagram post and Reel details by URL or retrieve comments by media ID. Schedule recurring runs to monitor returned engagement signals, preserve timestamped snapshots, and export structured JSON for campaign tracking, brand monitoring, and analytics.

Create structured Instagram profile snapshots by username for scheduled creator monitoring. Track biography, verification, audience, following, post totals, and other returned profile signals in an integration-ready Apify dataset.

Ai Web Intelligence

hakashi_katake/ai-web-intelligence

AI web crawler and scraper for clean Markdown, text, metadata, JSON-LD, PDFs, RAG chunks, screenshots, and structured web data. HTTP-first crawling with automatic browser fallback, built for AI agents, RAG pipelines, research, and knowledge bases.