Twitter Scraper avatar
Twitter Scraper

Deprecated

Pricing

$1.50 / 1,000 tweets

Go to Store
Twitter Scraper

Twitter Scraper

Deprecated

Developed by

Caleb David

Caleb David

Maintained by Community

Twitter Scraper searches and extracts data from Twitter (with historic data from 2006) - parses and converts the data to structured formats: HTML table, JSON, CSV, Excel and XML.

5.0 (1)

Pricing

$1.50 / 1,000 tweets

61

Total users

13.2k

Monthly users

38

Runs succeeded

>99%

Last modified

7 months ago

IG

Some crawling runs timeout

Closed

inexhaustible_gale opened this issue
a year ago

Our jobs are small, just 10 twitter search results per run. Why do some runs timeout? How to avoid it? How to increase a timeout threshold to 100 s? Would it help? Would resurrection help? How to resurrect via API?

microworlds avatar

Some runs time out because the actor isn't given enough time to pull the desired results. Increasing the timeout to 100s might help but I'd recommend setting the timeout to 300s. You can set the timeout like so:

You don't need to resurrect the actor to resolve this issue. Setting a higher timeout value is simply enough