Website Metadata Extractor(sitemap, socialLinks, robotsTxt)

Pricing

$2.50 / 1,000 processedurls

Try for free

Go to Apify Store

Website Metadata Extractor(sitemap, socialLinks, robotsTxt)

Try for free

A very fast metadata extractor to get all meta tags, robots.txt, sitemaps, social links, H1s, word count, and JSON-LD data. Also provides technology detection for a full analysis. Get your data fast for just $2.5 per 1000 results.

Pricing

$2.50 / 1,000 processedurls

Rating

5.0

(1)

Developer

CodeScraper

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

4 days ago

Last modified

Start URLs

startUrlsarrayRequired

A list of website URLs to analyze. Supported urls must start with http:// or https:// for example: https://example.com, http://example.org

Disable Domain Analysis (Fast Mode)

disableDomainAnalysisbooleanOptional

If true, the actor will skip fetching and analyzing robots.txt and sitemap.xml. This is faster but provides less data.

Default value of this property is false

Website Metadata Extractor (meta tags, sitemap, robots) 🔎

powerful_bachelor/website-metadata-extractor

🔍 Website Metadata Extractor 🌐 Extract essential website data: meta tags, robots.txt, and sitemap.xml in one scan. 📊 Analyze SEO elements, crawler directives, and site structure. ✅ Perfect for SEO audits, 🔎 competitor research, and 🚀 understanding how search engines view your website.

Powerful Bachelor

Find Sitemap from url

eesti/find-sitemap-from-url

A powerful [Apify Actor] that finds sitemap URLs for any website. This Actor helps you discover XML sitemaps by checking common locations, robots.txt files, and analyzing HTML content for sitemap links.

ando

140

Meta Tags Scraper

rl1987/meta-tags-scraper

Web page metadata scraper.

R.L.

German Imprint Scraper (Contact+Social Links)

codescraper/german-impressum-scraper-fast

Very fast actor, Get Impressum data for just $1.5/1000 Results. This powerful scraper finds any German impressum page and extracts key company data: companyName, address, registerNumber, taxId, emails, phones, socialLinks, and page metadata. Get clean, reliable B2B data in seconds.

CodeScraper

5.0

LD+JSON Schema scraper

pocesar/json-ld-schema

Extract all LD+JSON tags from the given URLs.

Paulo Cesar

373

Meta Data Extractor

dainty_screw/metadata-extractor-reliable-web-page-metadata-extraction

Metadata Extractor is your go-to tool for extracting meta-data from web pages. Using Cheerio, it parses HTML to extract titles, descriptions, authors, and more.Perfect for content managers and SEO experts.

codemaster devops

5.0

Sitemap URL Extractor

onescales/sitemap-url-extractor

Provide a link to a sitemap.xml and the app will extract and list all URLs in the sitemap as well as additional data in the sitemap (i.e. https://onescales.com/sitemap.xml).

One Scales

219

5.0

LD+JSON Tag Extractor

dainty_screw/ld-json-tag-extractor

Extract LD+JSON tags from URLs with ease! Our Apify actor lets you quickly gather structured data, ideal for SEO analysis, rich snippets, and web page insights. Perfect for web scraping, digital marketing, and data-driven decisions. Simplify your workflow with this powerful tool.

codemaster devops

5.0

Fast Bulk Email and Social Links Finder / Extractor

xmiso_scrapers/fast-bulk-email-and-social-links-finder-extractor

Scrape emails and social links from domains/websites list at blazing speed up to 1000 urls per minute.

Miso

5.0

Sitemap Detector

coder_zoro/sitemap-detector

Find sitemap URLs fast with our free Sitemap Finder tool. Instantly detect sitemaps from any website for SEO audits, indexing checks, and crawl planning. Improve visibility, site structure insights, and search engine performance in just seconds