Metadata Scraper

Pricing

$20.00/month + usage

Try for free

Go to Apify Store

Metadata Scraper

Try for free

Developed by

Louis Deconinck

Maintained by Community

Automatically scrape metadata such as title, description, heading and article from websites. It will crawl the start URLs and then scrape the metadata from the detail pages automatically navigating through the pagination.

5.0 (3)

Pricing

$20.00/month + usage

103

Last modified

a year ago

Automation

Real estate

You can access the Metadata Scraper programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

$echo '{
<  "startUrls": [
<    {
<      "url": "https://gifforddixoncommercialproperty.co.uk/?s=&post_type=listing&locations=&property-types=&tenure=",
<      "scrapeUrlGlobs": [
<        "https://gifforddixoncommercialproperty.co.uk/property/*"
<      ],
<      "paginationUrlGlobs": [
<        "https://gifforddixoncommercialproperty.co.uk/page/*"
<      ]
<    }
<  ]
<}' |
<apify call louisdeconinck/metadata-scraper --silent --output-dataset

Metadata Scraper API through CLI

The Apify CLI is the official tool that allows you to use Metadata Scraper locally, providing convenience functions and automatic retries on errors.

Install the Apify CLI

$npm i -g apify-cli
$apify login

Other API clients include:

Metadata Scraper API in Python

Metadata Scraper API in JavaScript

Metadata Scraper OpenAPI definition

Metadata Scraper API

Metadata Scraper

autofacts/metadata-scraper

A powerful web scraper that extracts various types of structured metadata from web pages, including JSON-LD, Microdata, Open Graph, Twitter Cards, and more. Perfect for SEO analysis, content aggregation, and research purposes.

Autofactor

5.0

Metadata Extractor

jancurn/extract-metadata

A small efficient actor that loads a web page, parses its HTML using Cheerio library and extracts the following meta-data from the <HEAD> tag, such as page title, description, author etc.

Jan Čurn

1.4K

URL Metadata Crawler

easyapi/url-metadata-crawler

Extracting comprehensive metadata from web pages. Gather vital information like meta tags, favicons, Open Graph tags, and more, all while enjoying flexible options for customization. Perfect for SEO specialists, developers, and content creators looking to enhance their web presence! 🌐

EasyApi

Article Content Extractor 📄

easyapi/article-content-extractor

Extract clean article content, metadata and structured information from any web page. Supports multiple URLs and returns well-formatted JSON with title, description, content, author, publish date and more. 🔍📄

EasyApi

Meta Data Extractor

dainty_screw/metadata-extractor-reliable-web-page-metadata-extraction

Metadata Extractor is your go-to tool for extracting meta-data from web pages. Using Cheerio, it parses HTML to extract titles, descriptions, authors, and more.Perfect for content managers and SEO experts.

codemaster devops

Website Metadata Extractor (meta tags, sitemap, robots) 🔎

powerful_bachelor/website-metadata-extractor

🔍 Website Metadata Extractor 🌐 Extract essential website data: meta tags, robots.txt, and sitemap.xml in one scan. 📊 Analyze SEO elements, crawler directives, and site structure. ✅ Perfect for SEO audits, 🔎 competitor research, and 🚀 understanding how search engines view your website.

Powerful Bachelor

TikTok Media and Metadata Retriever

gratenes/tiktok-media-and-metadata-retriever

An api for gathering media and metadata from any TikTok media url, supports vm.tiktok.com, vt.tiktok.com and other TikTok short links.

Get URLs from link

boring_code/get-urls-from-link

Extracts URLs from a sitemap or webpage with intuitive path matching. Use comma-separated patterns to include or exclude URL paths with smart matching: '/tags/' for exact paths, '/product' for paths starting with, or simple text for substring matches.

Audrius L.

168

5.0

URL to Metadata - mail, social and more

njoylab/url-summary-scraper

A powerful Apify actor that extracts essential website information, including title, description, images, mail, and social media links. Perfect for quick data gathering and insights from any URL.

njoylab

5.0

Simple SEO Data Extractor

onescales/simple-seo-data-extractor

Grab SEO data from any webpage / URL and export the URL, Title Tag, Meta Description, Meta Keywords, Status Code, Canonical Tag and Meta Robots easily. Run the scraper for 1-100,000 pages. Run one time or on schedule or via API.