Pricing

from $0.80 / 1,000 api requests

Try for free

Go to Apify Store

REST API to Dataset: Auto Pagination, Auth & Retries

Try for free

Fetch any JSON REST or GraphQL API into a clean dataset: auto pagination (next links, cursors, pages, offsets), API key auth, retries, rate limits, records extraction and per-row enrichment. Failed requests are free.

Pricing

from $0.80 / 1,000 api requests

Rating

0.0

(0)

Developer

Nicholas Powers

Actor stats

Bookmarked

Total users

Monthly active users

9 days ago

Last modified

REST API to Dataset: Paginate Any JSON or GraphQL API API through CLI

The Apify CLI is the official tool that allows you to use REST API to Dataset: Auto Pagination, Auth & Retries locally, providing convenience functions and automatic retries on errors.

Install Apify CLI

Using installation script (macOS/Linux):

$curl -fsSL https://apify.com/install-cli.sh | bash

Using installation script (Windows):

$irm https://apify.com/install-cli.ps1 | iex

Using Homebrew:

$brew install apify-cli

Using npm:

$npm install -g apify-cli

Other API clients include:

REST API to Dataset: Auto Pagination, Auth & Retries API in Python

REST API to Dataset: Auto Pagination, Auth & Retries API in JavaScript

REST API to Dataset: Auto Pagination, Auth & Retries OpenAPI definition

REST API to Dataset: Auto Pagination, Auth & Retries API

REST API Fetcher & Paginator — Any JSON API to Dataset

alaudinburki/rest-api-paginator

Fetch any JSON REST API into an Apify dataset — extract the items array by dot-path and auto-follow pagination (page, offset, cursor, or next-link). Custom headers for auth. Turns any API into a dataset.

alaudin burki

Dataset Processor in Python

drobnikj/dataset-processor-python

This actor utilizes Python to process the dataset.

Jakub Drobník

Dataset MCP Uploader

lukaskrivka/dataset-mcp-uploader

Dataset MCP Uploader allows you to process datasets on the Apify platform and then publish the results on other platforms that support the MCP protocol

Lukáš Křivka

Forward Dataset to Actor or Task

valek.josef/forward-dataset-to-actor-or-task

Forwards contents of specified dataset to a specified field on the input of another Actor or task.

Josef Válek

API & Endpoint Discovery

lofomachines/api-endpoint-discovery

Discover, test, and fingerprint all API endpoints from any website. Supports bulk input, OpenAPI/Swagger parsing, GraphQL introspection, and deep auth/CORS/rate-limit detection. Use as a Claude MCP tool via Apify.

Lofomachines

GitHub API Scraper: Repos & Profiles

andok/github-api-scraper

Extract GitHub repository stats and user profiles via the official REST API in bulk. Dual-mode targets for OSS research and developer enrichment.

Andok

Diff Dataset Fields

lukaskrivka/diff-dataset-fields

Compare changes in text fields between two datasets. Monitor new and updated content on websites.

Lukáš Křivka

Dataset Validity Checker

equidem/Dataset-Validity-Checker

Automatically checks, whether default datasets created by runs of an actor differ too much from the previously encountered ones, allowing it to warn you about web scraping problems caused by, e.g., a website layout changing, or other significant changes in the resulting data.