RequestList Bridge

Pricing

Pay per usage

Try for free

Go to Apify Store

RequestList Bridge

Try for free

Developed by

Paulo Cesar

Maintained by Community

Allows you to filter (thus cleaning up your list) and append new data to those requests before sending to your target task. Also enables a workaround to provide requestsFromUrl to existing actors that don't support it natively.

0.0 (0)

Pricing

Pay per usage

Last modified

3 years ago

Developer tools

Open source

Allows you to filter (thus cleaning up your list) and append new data to those requests before sending to your target task.

Also enables a workaround to provide requestsFromUrl to existing actors that dont't support it natively.

Example

Target task accepts a startUrls but as a plain string array:

{
    "taskId": "x02LumCy0WXdGP7nt",
    "requestListSources": [
        {
            "requestsFromUrl": "https://apify-uploads-prod.s3.amazonaws.com/Hhewqx4YNnyWz2qGk-data.csv"
        }
    ],
    "plainArray": true,
    "targetStartUrlsProperty": "startUrls"
}

Target task accepts RequestQueue only:

{
    "taskId": "x02LumCy0WXdGP7nt",
    "requestListSources": [
        {
            "requestsFromUrl": "https://apify-uploads-prod.s3.amazonaws.com/Hhewqx4YNnyWz2qGk-data.csv"
        }
    ],
    "targetStartUrlsProperty": "startUrls"
}

Filter out and transform the requests:

{
    filter: (req) => /apify/i.test(req.url),
    map: (req) => {
        req.userData.isMapped = true;
        return req;
    },
}

License

Apache 2.0

On this page

RequestList Bridge
- Example
- License

Share Actor:

🎉 Apify Actors

prog-party/apify-actors

This Apify Actors Actor retrieves data from Apify, allowing to filter, and returns a list of actors as a Dataset.

Prog Party

Rebuilder

mnmkng/rebuilder

Rebuild your actors easily with a simple regular expression. This actor will fetch all your existing actors and match their names. Those that pass will be rebuilt. Schedule this for maximum effectiveness. It can also rebuild itself!

Ondra Urban

Append to dataset

valek.josef/append-to-dataset

Utility actor that allows you to build a single large dataset from individual default datasets of other actor runs.

Josef Válek

Power Webhook Integration

pocesar/run-webhook-digest

Allows you to provide multiple HTTP endpoints, that receive a more complete JSON from the run, and allow you to hit those endpoints using a proxy, and enable you to do conditional webhook calls with some lines of Javascript code and you can link/chain one actor to another

Paulo Cesar

Website Backup

mhamas/website-backup

Enables to create a backup of any website by crawling it, so that you don’t lose any content by accident. Ideal e.g. for your personal or company blog.

Matej Hamas

301

Web Scraper Task

undrtkr984/web-scraper-task

Matt

127

Target Product Reviews Scraper

eunit/target-reviews-scraper

Easily scrape product reviews and details from Target.com with our reliable scraper. Perfect for market research and analysis. Need custom features? Raise a support ticket, and we’ll tailor it to your needs. Streamline your data collection today!

Emmanuel Uchenna

5.0

Pinterest Scraper

danielmilevski9/pinterest-crawler

Our free Pinterest Scraper allows you to get "pins" along with a user's profile. This unofficial Pinterest API is designed to give you more details than you can see in the web interface. It also enables you to extract public data from Pinterest without limits.

Daniel Milevski

2.5K

3.5

Error Messages Deduplication

petrpatek/get-debug-items-from-dataset

Filter items from the dataset with `#debug` fieldName and saves them to the dataset and deduplicates `errorMessages` so you don't have to go through all the errors.