Pricing

$5.00/month + usage

Go to Store

API / JSON scraper

Try Actor

Developed by

Paulo Cesar

Scrape any API / JSON URLs directly to the dataset, and return them in CSV, XML, HTML, or Excel formats. Transform and filter the output. Enables you to follow pagination recursively from the payload without the need to visit the HTML page.

0.0 (0)

Pricing

$5.00/month + usage

Total users

540

Monthly users

Runs succeeded

>99%

Issues response

1.5 days

Last modified

2 months ago

Developer tools

Automation

Integrations

Back to issues Create new issue

Reclaiming failed request back to the list or queue. Bad array

Open

campsider_tools opened this issue

Hello,

Sometimes this actor's task can fail several times with the error: "Reclaiming failed request back to the list or queue. Bad array".

This can happen 4 times until the task fails.

When I retry this actor a few seconds later without modifying the task nor the json source: no error occurs.

Any idea ?

Sincerely

Paulo Cesar (pocesar)

from quickly checking the target URL, the response might have been truncated, by the remote endpoint prematurely closing the connection before receiving the full array (with a closing ]), either the proxy failed to return the full response or the server failed to return it in time. looking at the proxy sessions, I'm assuming it's the server that was failing and later recovered. visiting the JSON url manually it seems to take a long time to download (around 7s for me here)

Add comment

Pay-as-you-go API / JSON scraper

pocesar/pay-as-you-go-api-json-scraper

Scrape as pay-as-you-go any API / JSON URLs directly to the dataset, and return them in CSV, XML, HTML, or Excel formats. Transform and filter the output. Enables you to follow pagination recursively from the payload without the need to visit the HTML page.

Paulo Cesar

Json To Excel

zuzka/json-to-excel

Convert your json into a tabular form, such as CSV, Excel or HTML table fast and easy.

Zuzka Pelechová

Merge, Dedup & Transform Datasets

lukaskrivka/dedup-datasets

The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.

Lukáš Křivka

4.3K

LD+JSON Schema scraper

pocesar/json-ld-schema

Extract all LD+JSON tags from the given URLs.

Paulo Cesar

346

PostgreSQL Insert

petr_cermak/PostgreSQL-insert

This act takes a crawler execution and inserts it's results into a remote PostgreSQL database.

Petr Cermak

MySQL Insert

petr_cermak/MySQL-insert

This act takes a crawler execution and inserts it's results into a remote MySQL database.

Petr Cermak

Forward dataset as POST data

anchor/forward-dataset-webhook

This actor forwards the results of an Actor to an endpoint, instead of having to fetch the results manually. It will download the dataset and attach it to the body of a POST request you will specify. It acts as a new webhook. Simplify your Actor process !!!

Anchor

Batch Runner

useful-tools/batch-runner

Actor for starting several Runs from single Input. It also has capability to merge the Dataset items from the created batch.

Useful tools

5.0

XMLs To Dataset

mtrunkat/xmls-to-dataset

Go to actor anytime you need to download XML files and store them in the dataset.

Marek Trunkát

103

JSON to CSV Converter

eloquent_mountain/json-to-csv-converter

JSON to CSV Converter. Effortlessly transform JSON data into CSV with our Apify actor. Handle nested structures, expand lists into rows, and customize separators and delimiters. Input via URL or paste JSON text. Ideal for data analysis and reporting!