Pay $3.50 for 1,000 posts
Twitter Scraper
Pay $3.50 for 1,000 posts
Scrape tweets from any Twitter user profile. Top Twitter API alternative to scrape Twitter hashtags, threads, replies, followers, images, videos, statistics, and Twitter history. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.
Valid tweet URLs with long User Ids are not supported
Closed
For a run using Tweet URL, I have provided URL with this format
https://twitter.com/<user-id>/status/<tweet-id>
However, some user Ids are 18 characters long, which doesn't seem to be supported.
Here is an example of error message in the logs (I have replaced the exact ids with placeholders):
2023-11-18T12:23:18.790Z WARN Url https://twitter.com/<author-url (18 char)>/status/<tweet url> didn't match any supported type. You can provide search, events and profile urls
Just copy-pasting the URL in a browser shows that the URL does indeed link to a valid tweet, so it should be accepted by the Actor.
Would it be possible to modify the validator rule to allow those (valid) URLs?
Hello, thank you for reaching out! Our delivery team will look into it and will be back with you soon.
Hello, happy to let you know that the issue with long user ids has been fixed. However, in the meantime, Twitter has moved more of its data behind login, which comes with limitations in terms of the number of results scraped.
Quacker- 1.1k monthly users
- 36.5% runs succeeded
- 8.2 days response time
- Created in Jun 2019
- Modified 29 days ago
