No credit card required
Batch Runner
No credit card required
Actor for starting several Runs from single Input. It also has capability to merge the Dataset items from the created batch.
Batch Runner Input
Closed
Can you provide a complete example of how to run this Actor?
For instance I am trying to use the Actor compass/crawler-google-places and pasted the input into this Batch Runner Actor from my crawler-google-places input.
However the run fails and does not provide any useful information as to why it failed. I need help to understand what the issue is and how to fix it so that it will work with the compass/crawler-google-places Actor in batch running mode
warm_evergreen
Below is the input for the Batch Runner Actor. As a result of running this batch the crawler-google-places fails with error INVALID INPUT: You have to provide at least one of: "searchStringsArray", "startUrls" or "allPlacesNoSearchAction".
Why does it say this if the searchStringsArray was indeed provided as part of the input to the actor compass/crawler-google-places
{ "batch": [ { "actorId": "compass/crawler-google-places", "input": { "minWaitTime": 30, "dataset": { "items": [ { "deeperCityScrape": false, "includeWebResults": false, "language": "en", "locationQuery": "77547, usa", "maxCrawledPlacesPerSearch": 65, "maxImages": 1, "maxQuestions": 0, "maxReviews": 0, "onlyDataFromSearchPage": false, "scrapeDirectories": false, "scrapeImageAuthors": false, "scrapeResponseFromOwnerText": true, "scrapeReviewId": true, "scrapeReviewUrl": true, "scrapeReviewerId": true, "scrapeReviewerName": true, "scrapeReviewerUrl": true, "searchStringsArray": [ "Manufacturer" ], "skipClosedPlaces": false, "reviewsSort": "newest", "reviewsFilterString": "", "searchMatching": "all", "placeMinimumStars": "", "allPlacesNoSearchAction": "" } ] } } }, { "actorId": "useful-tools/wait-and-finish", "input": { "dataset": { "items": [ { "key": "value1" }, { "key": "value2" } ] } } } ], "doNotImportDuplicities": false, "failOnAnyRunFails": false, "maxConcurrency": 25, "maxMemoryMb": 32768, "mergeDatasets": false }
warm_evergreen
I have been playing with this for a little while now and have figured it out. Thanks for everything the tool seems useful to begin with
warm_evergreen Thanks for reaching out. I am glad you figured out and find this tool useful. I will take this as a suggestion to add more examples with other Actors as well.
Useful tools- 2 monthly users
- 3 stars
- 94.9% runs succeeded
- Created in Sep 2023
- Modified 5 months ago
