Website URL Crawler & Link Extractor

A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Link Extractor

automation-lab/link-extractor

Extract all links from any web page or website: URL, anchor text, internal or external, nofollow and rel, page location. Crawl up to 1,000 pages, filter links, export one row per link to CSV. Priced per page, not per link.

Sitemap URL Extractor

onescales/sitemap-url-extractor

Provide a website link to a sitemap.xml and the app will extract and list all URLs in the sitemap as well as additional data in the sitemap (i.e. https://onescales.com/sitemap.xml).

Article Content Extractor 📄

easyapi/article-content-extractor

Extract clean article content, metadata and structured information from any web page. Supports multiple URLs and returns well-formatted JSON with title, description, content, author, publish date and more. 🔍📄

Sitemap Extractor

apify/sitemap-extractor

This Apify Actor extracts all URLs from a website's sitemaps and checks their status codes via lightweight HTTP requests. It provides a clean list of valid links, acting as an ideal pre-processor to ensure your larger crawling projects target only active URLs.

Google Translate API — Bulk Text Translation

maged120/google-translate-scraper

Google Translate API alternative: translate any number of texts into one or many of 100+ languages with Google Translate quality, in bulk. Auto-detects the source language. No Google Cloud account, API key or billing setup needed. Export to CSV, JSON, Excel or API.

SEO Checker — Website SEO Audit & Score in Bulk

maged120/seobility-seo-checker

SEO Checker: bulk SEO audits for any list of URLs. Overall score, category breakdowns (meta, structure, content, links) and actionable hints for every page. No SEO tool subscription needed. Export to CSV, JSON, Excel or API.

Legacy PhantomJS Crawler

apify/legacy-phantomjs-crawler

Replacement for the legacy Apify Crawler product with a backward-compatible interface. The Actor uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of front-end JavaScript code.

Link Relationship Analyzer

zerobreak/link-relationship-analyzer

Link relationship analyzer that crawls any website and maps all internal and external links, so SEO teams can audit anchor text, find orphaned pages, and see how a site's pages connect.