RSS Feed Reader: RSS & Atom to JSON, Find Feeds, Only New Items

RSS Feed Scraper — Atom, Podcast & Multi-Feed Aggregator

devilscrapes/rss-feed-scraper

Parse and convert any RSS or Atom feed to a clean dataset — title, link, author, published date, summary, full HTML content, tags, GUID — export to JSON or CSV. A drop-in RSS feed parser for RSS 2.0, Atom 1.0, and the content:encoded / dc:creator extensions. Also a scheduled news feed monitor.

Website Content Crawler - Clean Text, Markdown & RAG Chunks

topapi/website-content-crawler

Crawl any website or URL list for $1.20 per 1,000 pages: one row per page with clean text, Markdown, HTML, metadata, links, headings, tables and RAG chunks. Plain HTTP first, headless Chrome only for JavaScript pages. Sitemaps, llms.txt, PDF/DOCX text, Bing/DuckDuckGo search, change monitor.

Website Content Extractor

tropical_prune/website-content-extractor

CAPABILITIES: extract_content, convert_to_markdown, batch_urls, extract_metadata. INPUT: URLs (single or array), with optional selectors and output format. OUTPUT: structured JSON with title, text, metadata, word_count. FORMATS: json, markdown, text. PRICING: PPE $0.001/page.

Website & Page to Markdown for RAG and LLMs

humble-echidna/page-to-markdown

Turn web pages or whole sites into clean Markdown for RAG and LLMs: main content only, with title, links and word count. Whole-site mode reads the sitemap first, can return only changed pages, and splits pages into heading-based chunks. Respects robots.txt and AI opt-outs. No browser.

AI Website Content Extractor

scrapeai/ai-website-content-extractor

Crawl website pages, strip noise, and convert the main content to clean Markdown for RAG/LLM training.

Contextractor — clean web content extraction for LLMs

markdownee/contextractor

Crawl any website and extract clean main-content text as Markdown, plain text, JSON, or HTML — ready for LLMs, RAG pipelines, and vector databases. Built on the rs-trafilatura engine and an adaptive Crawlee + Playwright crawler.

Turn any URL (HTML page or PDF) into clean, token-efficient Markdown with metadata, ready for an AI agent or LLM. Auto-detects PDFs and renders JavaScript-heavy pages when needed.

Domain RDAP Lookup: modern WHOIS for any TLD

br_data_hub/domain-rdap-lookup

Bulk RDAP lookup on each TLD's official registry server (IANA bootstrap): registrar, creation, update and expiry dates, domain age, EPP status, nameservers, DNSSEC, registrar abuse contact and ready-made alerts. No personal data.

Extracts the text layer from PDFs at http(s) URLs, page by page, with page counts and a needsOcr flag for scanned pages. No OCR, no browser.

Research Agent – Web Search API for RAG & AI, Cited Sources

perceptr0n/research-agent

LLM web search and web research for AI agents and RAG: ask a question, get cited passages (not a written answer) with source URL, date and evidence level from Google web and news, EU and German law, Wikipedia, open-access papers, Stack Overflow and GitHub. Facts cross-checked, old pages flagged.