API / JSON scraper avatar

API / JSON scraper

Try for free

1 day trial then $5.00/month - No credit card required now

Go to Store
API / JSON scraper

API / JSON scraper

pocesar/json-downloader
Try for free

1 day trial then $5.00/month - No credit card required now

Scrape any API / JSON URLs directly to the dataset, and return them in CSV, XML, HTML, or Excel formats. Transform and filter the output. Enables you to follow pagination recursively from the payload without the need to visit the HTML page.

URLs

startUrlsarrayRequired

URLs that return application/json as response

Filter / map output

filterMapstringRequired

Filter and/or map the output before pushing to the dataset. Check the README for more information

Default value of this property is "async ({ request, response, addRequest, flattenObjectKeys, context, Apify, _, moment, data, input, customData }) => {\n return { url: request.url, data };\n}"

Error handler

handleErrorstringOptional

Called when errors happen. For more information, see the README

Default value of this property is "async ({ error, request, response, addRequest, _, moment, Apify, input, context }) => {\n \n}"

Custom data

customDataobjectOptional

Any custom data to be available inside the filter map function

Default value of this property is {}

Max number of results

maxRequestsPerCrawlintegerOptional

Leave empty for no limit

Proxy

proxyConfigobjectRequired

Proxies are required to download data from the given input URLs

Default value of this property is {"useApifyProxy":true}

Force parsing

forcebooleanOptional

Force parsing the content regardless of the JSON header.

Default value of this property is false

Max request retries

maxRequestRetriesintegerOptional

How many times failed requests should be retried.

Default value of this property is 4

Enable debug

debugLogbooleanOptional

Display debug messages

Default value of this property is false

Developer
Maintained by Community

Actor Metrics

  • 18 monthly users

  • 5 stars

  • 98% runs succeeded

  • Created in May 2022

  • Modified a year ago