Pricing

from $2.00 / 1,000 page fetcheds

Try for free

Go to Apify Store

Paginated REST API Fetcher - Fetch All Pages

Try for free

Export a REST API into one Apify Dataset using page-number, offset, cursor or next-link pagination. Set page and item limits, then check the run summary to see whether the export finished or stopped early.

Pricing

from $2.00 / 1,000 page fetcheds

Rating

0.0

(0)

Developer

Vadim Bezrukov

Actor stats

Bookmarked

Total users

Monthly active users

4 hours ago

Last modified

Categories

Automation

Developer tools

Other

API URL

url

Required

Public http(s) REST endpoint to fetch. Localhost, private, link-local and cloud-metadata targets are rejected. Only ports 80 and 443 are allowed.

Type:string

Min. length:1

Max. length:2048

HTTP method

method

Optional

GET (default) or POST. Body is only allowed with POST.

Type:string

Default:GET

Options:

GETPOST

HTTP headers

headers

Optional

Optional request headers. Do not put secrets in logs; Authorization/Cookie/API-key values are redacted from Actor logs but still sent to the API. Prefer Apify secret inputs where possible.

Type:object

Default:

{}

Query parameters

query

Optional

Base query string parameters merged with query parameters already present in the configured URL for the first and parameter-based page requests. Follow-up nextUrl pages use the returned link.

Type:object

Default:

{}

JSON body

body

Optional

Optional JSON body for POST requests.

Type:object

Items JSON path

itemsPath

Optional

Dotted path to the items array (for example data.items). Use an empty string when the response root is already a JSON array.

Type:string

Max. length:512

Default:

Pagination

pagination

Required

Pagination mode and fields for the target API.

Type:object

Max pages

maxPages

Optional

Hard stop after this many successful or attempted page requests. Stop reason LIMIT_PAGES (run status LIMIT_REACHED).

Type:integer

Minimum:1

Maximum:10000

Default:1000

Max items

maxItems

Optional

Hard stop after this many Dataset ITEM rows. Stop reason LIMIT_ITEMS (run status LIMIT_REACHED).

Type:integer

Minimum:1

Maximum:1000000

Default:100000

Per-request timeout (seconds)

timeoutSeconds

Optional

Timeout applied to each HTTP attempt.

Type:integer

Minimum:5

Maximum:120

Default:30

Max retries

maxRetries

Optional

Extra GET attempts after the first try for timeouts, network errors and retryable HTTP statuses (408/425/429/5xx). POST is never retried automatically because it may be non-idempotent. Deterministic 4xx responses are never retried. Retries are not billed.

Type:integer

Minimum:0

Maximum:5

Default:2

Deduplicate by item id path

dedupeIdPath

Optional

Optional dotted path inside each item for stable-ID deduplication. Off by default. Never invents an id from arbitrary JSON.

Type:string

Ghost Fetch

straightforward_understanding/ghost-fetch

Web fetcher

Yann Feunteun

GraphQL Pagination Endpoint Probe

junipr/graphql-pagination-smoke-tester

Smoke-test GraphQL pagination behavior by running bounded cursor, offset, or page-based query sequences and detecting unstable cursors, duplicates, missing page info, empty pages, and response-shape issues.

junipr

A Shrek REST API

loscpring/a-shrek-rest-api

A Shrek REST API

Kyle Anderson

REST API to MCP Server — AI Agent Tools

wsgcjj/mcp-server-adapter

Convert any REST API into a Model Context Protocol (MCP) server configuration. Automatically generates tools and resources from OpenAPI specs or API documentation.

陈俊杰

Fetch URL, Website & Web Page to HTML, Markdown, Text — Fetcher

shelvick/smart-page-fetcher

Fetch any web page and get HTML, Markdown, clean text, tables, links, and metadata from one fetch — 13 output formats. Tries plain HTTP first, renders JavaScript when needed, and escalates to stealth + residential proxy for bot-defended pages. Pay only for the difficulty each URL needed.

Scott Helvick

Send HTTP Requests in Bulk: Dataset, CSV or Sheet to REST API

nerolabs/dataset-to-rest-api

Sends every row of an Apify dataset, file or Google Sheet URL, or JSON array to any REST API as its own request. Templated URL, body and headers with {{field}} placeholders, auth presets, rate limits, retries. One result row per request. Charged per answered request. Agent-ready via x402 and MCP.

Adam Pearce

REST Countries Info Scraper

parseforge/restcountries-info-scraper

Scrapes country information from the REST Countries API. Filter by name, region, language, or currency code, and return each country as a flat row with fields like capital, population, and flags.

ParseForge

Facebook Page Fetcher

clear_ring/facebook-page-fetcher

This will help to get info about a Facebook Page.

Salvatore Vacante

1.0

REST Countries Scraper

parseforge/restcountries-scraper

Scrapes country data from REST Countries API by region or name search. Returns each country as a flat row with name, capital, region, population, area, currencies, languages, and flag URL.

ParseForge

AI Agent Web Fetcher

abotapi/ai-fetch-python

An advanced web fetcher that can fetch almost all websites and convert them to LLM-friendly Markdown format. Perfect for AI agents, RAG systems, and integration with search actors.