Pay-as-you-go API / JSON scraper

Pricing

$5.00 / 1,000 results

Pay-as-you-go API / JSON scraper

Scrape as pay-as-you-go any API / JSON URLs directly to the dataset, and return them in CSV, XML, HTML, or Excel formats. Transform and filter the output. Enables you to follow pagination recursively from the payload without the need to visit the HTML page.

Pricing

$5.00 / 1,000 results

Rating

0.0

(0)

Developer

Paulo Cesar

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

5 months ago

Last modified

Categories

Automation

Developer tools

Integrations

You can access the Pay-as-you-go API / JSON scraper programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "startUrls": [{ "url": "https://blockchain.info/latestblock" }],
10    "filterMap": """async ({ request, response, addRequest, flattenObjectKeys, context, Apify, _, moment, data, input, customData }) => {
11  return { url: request.url, data };
12}""",
13    "handleError": """async ({ error, request, response, addRequest, _, moment, Apify, input, context }) => {
14  
15}""",
16    "customData": {},
17    "proxyConfig": { "useApifyProxy": True },
18    "maxRequestRetries": 4,
19}
20
21# Run the Actor and wait for it to finish
22run = client.actor("pocesar/pay-as-you-go-api-json-scraper").call(run_input=run_input)
23
24# Fetch and print Actor results from the run's dataset (if there are any)
25print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
26for item in client.dataset(run["defaultDatasetId"]).iterate_items():
27    print(item)
28
29# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

Pay-as-you-go API / JSON scraper API in Python

The Apify API client for Python is the official library that allows you to use Pay-as-you-go API / JSON scraper API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Pay-as-you-go API / JSON scraper API in JavaScript

Pay-as-you-go API / JSON scraper API through CLI

Pay-as-you-go API / JSON scraper OpenAPI definition

Pay-as-you-go API / JSON scraper API

API / JSON scraper

pocesar/json-downloader

Scrape any API / JSON URLs directly to the dataset, and return them in CSV, XML, HTML, or Excel formats. Transform and filter the output. Enables you to follow pagination recursively from the payload without the need to visit the HTML page.

Paulo Cesar

545

LD+JSON Schema scraper

pocesar/json-ld-schema

Extract all LD+JSON tags from the given URLs.

Paulo Cesar

372

XML to JSON Converter

eloquent_mountain/xml-to-json-converter

XML to JSON Converter Convert any XML file to JSON effortlessly with this Apify actor. Handle complex XML structures and transform them into structured JSON data. Supports input via URL or direct text paste, making it easy to integrate into your data processing workflows.

Paco

JSON to CSV Converter

eloquent_mountain/json-to-csv-converter

JSON to CSV Converter. Effortlessly transform JSON data into CSV with our Apify actor. Handle nested structures, expand lists into rows, and customize separators and delimiters. Input via URL or paste JSON text. Ideal for data analysis and reporting!

Paco

Sitemap Scraper

pvillalva/sitemap-scraper

The Sitemap Scraper extracts and outputs all URLs from a given sitemap.

Percival Villalva

147

5.0

XMLs To Dataset

mtrunkat/xmls-to-dataset

Go to actor anytime you need to download XML files and store them in the dataset.

Marek Trunkát

105

Structured Data Scraper (Schema.org)

datavault/schemaorg

Fast, lightweight scraper that extracts structured data (JSON-LD & microdata) from HTML pages. Ideal for e-commerce and sites that embed schema.org markup without heavy client-side rendering.

Datavault

Metadata Scraper

autofacts/metadata-scraper

A powerful web scraper that extracts various types of structured metadata from web pages, including JSON-LD, Microdata, Open Graph, Twitter Cards, and more. Perfect for SEO analysis, content aggregation, and research purposes.

Autofactor

5.0

Website Metadata Extractor (meta tags, sitemap, robots) 🔎

powerful_bachelor/website-metadata-extractor

🔍 Website Metadata Extractor 🌐 Extract essential website data: meta tags, robots.txt, and sitemap.xml in one scan. 📊 Analyze SEO elements, crawler directives, and site structure. ✅ Perfect for SEO audits, 🔎 competitor research, and 🚀 understanding how search engines view your website.