Pricing

$50.00/month + usage

Go to Store

General Purpose Web Scraping and Metadata Extraction

Try for free

Developed by

Jamshaid Arif

This project uses the Apify platform to scrape data from web pages, collect metadata, and store results in an Apify dataset. It features functions for managing date ranges, encoding identifiers, and handling large datasets, aiming to efficiently extract and store structured data for analysis.

0.0 (0)

Pricing

$50.00/month + usage

Total users

Monthly users

Runs succeeded

>99%

Last modified

5 months ago

Automation

Developer tools

You can access the General Purpose Web Scraping and Metadata Extraction programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/sse?actors=moving_beacon-owner1/my-actor-10",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

Configure MCP server with General Purpose Web Scraping and Metadata Extraction

You have a few options for interacting with the MCP server:

Use mcp.apify.com via mcp-remote from your local machine to connect and authenticate using OAuth or an API token (as shown in the JSON configuration above).
Set up the connection directly in your MCP client UI by providing the URL https://mcp.apify.com/sse?actors=moving_beacon-owner1/my-actor-10 along with an API token (or use OAuth).
Connect to mcp.apify.com via Server-Sent Events (SSE), as shown below:

{
    "mcpServers": {
        "apify": {
            "type": "sse",
            "url": "https://mcp.apify.com/sse?actors=moving_beacon-owner1/my-actor-10",
            "headers": {
                "Authorization": "Bearer <YOUR_API_TOKEN>"
            }
        }
    }
}

You can connect to the Apify MCP Server using clients like Tester MCP Client, or any other MCP client of your choice.

If you want to learn more about our Apify MCP implementation, check out our MCP documentation. To learn more about the Model Context Protocol in general, refer to the official MCP documentation or read our blog post.

HTML Scraper pro

scrapingxpert/html-scraper-pro

The HTML Scraper Pro is a powerful tool designed to extract the HTML source code and metadata from websites. It uses advanced web scraping techniques to retrieve the full HTML content of web pages,page title and HTTP status code.This tool is ideal for data extraction, website analysis, and archiving

scrapingxpert

Fast Scraper

danielherman/fast-scraper

Fast Scraper is a blazingly fast web scraper powered by Rust on the backend. It allows you to scrape static HTML pages extremely quickly while using only <128 MB of memory. With this scraper, you can maximize the efficiency of your credits on Apify.

Daniel Herman

Page Scraping Analyzer

apify/page-analyzer

Performs analysis of a webpage to figure out the best way how to scrape its data. Provide a URL and data points to find and get back a detailed dashboard showing how the data can be scraped. Works with initial and rendered HTML, JavaScript variables and dynamically loaded data.

Apify

1.3K

4.4

Metadata Scraper

autofacts/metadata-scraper

A powerful web scraper that extracts various types of structured metadata from web pages, including JSON-LD, Microdata, Open Graph, Twitter Cards, and more. Perfect for SEO analysis, content aggregation, and research purposes.

Autofactor

5.0

Fnac Data Scraping

fayoussef/fnac-data-scraping

Scrape Fnac product data —including name, price, availability, EAN, SKU, images, seller, categories, delivery info, ratings, and reviews—from both search and product pages with seamless proxy support.

youssef farhan

5.0

Custom Web Scraping Service

delicious_zebu/custom-web-scraping-service

Discover professional, tailored web scraping solutions. Input anything to learn about our services, pricing, and process!

ВAH

Target Store Scraper

axlymxp/target-store-scraper

Scrapes Target store locations and details based on a search keyword (city/zip) and radius. Returns store information including name, address, phone, hours, services, and coordinates. Configurable search radius and results limit.

axly

🎯 Instagram Ad Copywriter Creator(Rental)

powerai/instagram-ad-copywriter-creator-rental

Transform your Instagram marketing with AI-powered ad copy! This intelligent tool analyzes your product and target audience to generate compelling, conversion-focused Instagram ad content with professional headlines, persuasive body copy, and strategic CTAs.