Pricing

$50.00/month + usage

Go to Store

General Purpose Web Scraping and Metadata Extraction

Try for free

Developed by

Jamshaid Arif

This project uses the Apify platform to scrape data from web pages, collect metadata, and store results in an Apify dataset. It features functions for managing date ranges, encoding identifiers, and handling large datasets, aiming to efficiently extract and store structured data for analysis.

0.0 (0)

Pricing

$50.00/month + usage

Total users

Monthly users

Runs succeeded

>99%

Last modified

3 months ago

Automation

Developer tools

You can access the General Purpose Web Scraping and Metadata Extraction programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

$echo '{
<  "startUrls": [
<    {
<      "url": "https://www.airbnb.co.uk/rooms/7431972"
<    }
<  ]
<}' |
<apify call moving_beacon-owner1/my-actor-10 --silent --output-dataset

General Purpose Web Scraping and Metadata Extraction API through CLI

The Apify CLI is the official tool that allows you to use General Purpose Web Scraping and Metadata Extraction locally, providing convenience functions and automatic retries on errors.

Install the Apify CLI

$npm i -g apify-cli
$apify login

Other API clients include:

General Purpose Web Scraping and Metadata Extraction API in Python

General Purpose Web Scraping and Metadata Extraction API in JavaScript

General Purpose Web Scraping and Metadata Extraction OpenAPI definition

General Purpose Web Scraping and Metadata Extraction API

Apify Store Scraper

jupri/apify-store

Scrape Apify.com Store

cat

Apify Store Scraper API

louisdeconinck/apify-store-scraper-api

The Apify Store Scraper API allows you to extract detailed information about actors from the Apify Store, including actor details, pricing, metrics, categories, and user information.

Louis Deconinck

HTML Scraper pro

scrapingxpert/html-scraper-pro

The HTML Scraper Pro is a powerful tool designed to extract the HTML source code and metadata from websites. It uses advanced web scraping techniques to retrieve the full HTML content of web pages,page title and HTTP status code.This tool is ideal for data extraction, website analysis, and archiving

scrapingxpert

Apify public actor scraper

eloquent_mountain/apify-public-actor-scraper

Apify Store Actor Scraper Efficiently scrape comprehensive data from Apify Store actors using Selenium. Extracts key information such as URL, Title, Creator, Description, Users, and Stars

Paco

Extract Website With URL

mrahil/extract-website-with-url

The Extract Website with URL API allows users to extract structured data from any webpage by providing a URL. It retrieves HTML, metadata, tables, and images, returning data in JSON format. Ideal for web scraping, SEO analysis, and content extraction. Use it for e-commerce data, news scraping

Mohammed Rahil

Metadata Scraper

autofacts/metadata-scraper

A powerful web scraper that extracts various types of structured metadata from web pages, including JSON-LD, Microdata, Open Graph, Twitter Cards, and more. Perfect for SEO analysis, content aggregation, and research purposes.

Autofactor

Shopify Store Info

pintostudio/shopify-store-info

The Shopify Store Information Scraper is a versatile tool designed to extract detailed store metadata and essential details from any Shopify-powered store.

Pinto Studio

Target Search Scraper

axlymxp/target-search-scraper

A web scraper that searches Target's website for products based on a keyword and store ID. Extracts detailed product information including name, price, description, images, availability and store details. Results are saved to a structured dataset.

axly

App Store Search Scraper

mscraper/app-store-search-scraper

App Store Search Scraper is a specialized web scraping tool designed to extract news from App Store. The Scraper exports the accumulated data to various formats like JSON, XML, CSV or EXCEL

mscraper

eBay Store Scraper

delicious_zebu/ebay-store-scraper

eBay Store Product Scraper allows you to collect detailed information from any eBay store. Simply provide the store URL, and this Actor will scrape all product details, including pricing, images, shipping info, and more.