RequestList Bridge

Pricing

Pay per usage

RequestList Bridge

Allows you to filter (thus cleaning up your list) and append new data to those requests before sending to your target task. Also enables a workaround to provide requestsFromUrl to existing actors that don't support it natively.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Paulo Cesar

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

3 years ago

Last modified

Example

Target task accepts a startUrls but as a plain string array:

{
    "taskId": "x02LumCy0WXdGP7nt",
    "requestListSources": [
        {
            "requestsFromUrl": "https://apify-uploads-prod.s3.amazonaws.com/Hhewqx4YNnyWz2qGk-data.csv"
        }
    ],
    "plainArray": true,
    "targetStartUrlsProperty": "startUrls"
}

Target task accepts RequestQueue only:

{
    "taskId": "x02LumCy0WXdGP7nt",
    "requestListSources": [
        {
            "requestsFromUrl": "https://apify-uploads-prod.s3.amazonaws.com/Hhewqx4YNnyWz2qGk-data.csv"
        }
    ],
    "targetStartUrlsProperty": "startUrls"
}

Filter out and transform the requests:

{
    filter: (req) => /apify/i.test(req.url),
    map: (req) => {
        req.userData.isMapped = true;
        return req;
    },
}

License

Apache 2.0

🎉 Apify Actors

prog-party/apify-actors

This Apify Actors Actor retrieves data from Apify, allowing to filter, and returns a list of actors as a Dataset.

Prog Party

api-gw-lite

amernas/api-gw-lite

This actor serves as a proxy that accepts requests with custom field names and translates them to standard HTTP requests to target APIs. It's designed to work seamlessly on the Apify platform while also supporting local testing

Traffic Architect

Append to dataset

valek.josef/append-to-dataset

Utility actor that allows you to build a single large dataset from individual default datasets of other actor runs.

Josef Válek

Rebuilder

mnmkng/rebuilder

Rebuild your actors easily with a simple regular expression. This actor will fetch all your existing actors and match their names. Those that pass will be rebuilt. Schedule this for maximum effectiveness. It can also rebuild itself!

Ondra Urban

Power Webhook Integration

pocesar/run-webhook-digest

Allows you to provide multiple HTTP endpoints, that receive a more complete JSON from the run, and allow you to hit those endpoints using a proxy, and enable you to do conditional webhook calls with some lines of Javascript code and you can link/chain one actor to another

Paulo Cesar

Website Backup

mhamas/website-backup

Enables to create a backup of any website by crawling it, so that you don’t lose any content by accident. Ideal e.g. for your personal or company blog.

Matej Hamas

304

Web Scraper Task

undrtkr984/web-scraper-task

Matt

129

Target Product Reviews Scraper

eunit/target-reviews-scraper

Easily scrape product reviews and details from Target.com with our reliable scraper. Perfect for market research and analysis. Need custom features? Raise a support ticket, and we’ll tailor it to your needs. Streamline your data collection today!

Emmanuel Uchenna

5.0

Pinterest Scraper

danielmilevski9/pinterest-crawler

Our free Pinterest Scraper allows you to get "pins" along with a user's profile. This unofficial Pinterest API is designed to give you more details than you can see in the web interface. It also enables you to extract public data from Pinterest without limits.

Daniel Milevski

2.5K

3.5

Public Actors Lister

jancurn/public-actors-fetcher

Downloads a list of all Actors published in Apify Store, with all properties such as URL, title, description, etc. This is useful to create a knowledge file for a GPT, so that it knows which Actors can it use.