RequestList Bridge avatar

RequestList Bridge

Try for free

No credit card required

Go to Store
RequestList Bridge

RequestList Bridge

pocesar/request-list-bridge
Try for free

No credit card required

Allows you to filter (thus cleaning up your list) and append new data to those requests before sending to your target task. Also enables a workaround to provide requestsFromUrl to existing actors that don't support it natively.

Allows you to filter (thus cleaning up your list) and append new data to those requests before sending to your target task.

Also enables a workaround to provide requestsFromUrl to existing actors that dont't support it natively.

Example

Target task accepts a startUrls but as a plain string array:

1{
2    "taskId": "x02LumCy0WXdGP7nt",
3    "requestListSources": [
4        {
5            "requestsFromUrl": "https://apify-uploads-prod.s3.amazonaws.com/Hhewqx4YNnyWz2qGk-data.csv"
6        }
7    ],
8    "plainArray": true,
9    "targetStartUrlsProperty": "startUrls"
10}

Target task accepts RequestQueue only:

1{
2    "taskId": "x02LumCy0WXdGP7nt",
3    "requestListSources": [
4        {
5            "requestsFromUrl": "https://apify-uploads-prod.s3.amazonaws.com/Hhewqx4YNnyWz2qGk-data.csv"
6        }
7    ],
8    "targetStartUrlsProperty": "startUrls"
9}

Filter out and transform the requests:

1{
2    filter: (req) => /apify/i.test(req.url),
3    map: (req) => {
4        req.userData.isMapped = true;
5        return req;
6    },
7}

License

Apache 2.0

Developer
Maintained by Community

Actor Metrics

  • 1 monthly user

  • 0 No stars yet

  • Created in Sep 2020

  • Modified 2 years ago

Categories