RequestList Bridge avatar
RequestList Bridge
Try for free

No credit card required

View all Actors
RequestList Bridge

RequestList Bridge

pocesar/request-list-bridge
Try for free

No credit card required

Allows you to filter (thus cleaning up your list) and append new data to those requests before sending to your target task. Also enables a workaround to provide requestsFromUrl to existing actors that don't support it natively.

Allows you to filter (thus cleaning up your list) and append new data to those requests before sending to your target task.

Also enables a workaround to provide requestsFromUrl to existing actors that dont't support it natively.

Example

Target task accepts a startUrls but as a plain string array:

1{
2    "taskId": "x02LumCy0WXdGP7nt",
3    "requestListSources": [
4        {
5            "requestsFromUrl": "https://apify-uploads-prod.s3.amazonaws.com/Hhewqx4YNnyWz2qGk-data.csv"
6        }
7    ],
8    "plainArray": true,
9    "targetStartUrlsProperty": "startUrls"
10}

Target task accepts RequestQueue only:

1{
2    "taskId": "x02LumCy0WXdGP7nt",
3    "requestListSources": [
4        {
5            "requestsFromUrl": "https://apify-uploads-prod.s3.amazonaws.com/Hhewqx4YNnyWz2qGk-data.csv"
6        }
7    ],
8    "targetStartUrlsProperty": "startUrls"
9}

Filter out and transform the requests:

1{
2    filter: (req) => /apify/i.test(req.url),
3    map: (req) => {
4        req.userData.isMapped = true;
5        return req;
6    },
7}

License

Apache 2.0

Developer
Maintained by Community
Actor metrics
  • 1 monthly users
  • days response time
  • Created in Sep 2020
  • Modified over 1 year ago
Categories