Sitemap URL Extractor — Priced per Sitemap, Not per URL

Sitemap URL Extractor

mikolabs/sitemap-url-extractor

Extract every URL and its metadata from any sitemap.xml in seconds. Paste one or more sitemap URLs, run the Actor, and get a clean, structured dataset with url, lastmod, changefreq, priority, and more — ready to export as CSV, JSON, or Excel.

Solar Installer Directory Scraper - EnergySage Suppliers

jungle_synthesizer/solar-installer-directory-scraper

Scrape EnergySage's US solar installer directory — installers, financiers, and equipment partners. Extracts company names, addresses, phone, email, founding date, services, panel/inverter/battery brands, financing partners, licenses, and EnergySage Approved status.

Google Maps Scraper | $1/1k Places

santamaria-automations/google-maps-scraper

Scrape Google Maps for $1/1k places: 30+ fields, reviews, photos, hours, GPS. Enrich every result with 20+ optional add-ons: emails, phones, socials, LinkedIn, SSL, tech stack, SEO, AI contacts, jobs & icebreakers. All merged into ONE row per business. No dataset joins. MCP-ready for AI agents.

Contextractor — clean web content extraction for LLMs

glueo/contextractor

Crawl any website and extract clean main-content text as Markdown, plain text, JSON, or HTML — ready for LLMs, RAG pipelines, and vector databases. Built on the rs-trafilatura engine and an adaptive Crawlee + Playwright crawler.

College Athlete Recruiting Profiles Scraper — On3 & Rivals

jungle_synthesizer/college-athletes-on3-247-rivals-scraper

Scrape 80,000+ college football and multi-sport recruiting profiles from On3.com (the platform that acquired Rivals in 2023). Extracts star ratings, national/position/state rankings, commitment data, transfer portal status, physical measurements, and social handles across class years 2016-2034.

Robots.txt & Sitemap Analyzer

automation-lab/robots-sitemap-analyzer

This actor fetches and parses robots.txt and sitemap.xml files for any list of websites. It extracts crawl directives (user-agent rules, allowed/disallowed paths, crawl-delay), discovers sitemap URLs, and counts the number of pages listed in each sitemap. Use it for SEO audits, competitive...

Sitemap URL Extractor

automation-lab/sitemap-url-extractor

This actor parses XML sitemaps and extracts all URLs with their metadata. It handles both regular sitemaps and sitemap indexes (recursively follows child sitemaps up to 3 levels deep). For each URL, it captures the last modified date, change frequency, priority, and whether the entry...

Give it a website. Get every URL from its sitemap — loc, lastmod, changefreq, priority — as one clean record per URL. Auto-discovers sitemap.xml, robots.txt Sitemap: directives, and nested sitemap indexes. Perfect for SEO audits, crawl seeding, and URL discovery.

Faire Product Details Scraper

e-commerce/faire-product-details-scraper

Use this scraper to collect data from the Faire marketplace. Extract detailed product information, including prices, descriptions, images, and in-stock availability. Download the data in multiple structured formats for easy analysis and integration.

Link Extractor

automation-lab/link-extractor

This actor extracts all hyperlinks from web pages. For each link, it captures the anchor text, href, rel attributes (nofollow, ugc, sponsored), target attribute, and classifies links as internal or external. It also detects the link's location in the page (nav, header, footer, main content,...