Pricing

Pay per event

Go to Store

Twitter (X.com) Scraper Unlimited ($0.0004 / tweet): No Limits

Try for free

Developed by

API Dojo

Introducing Twitter Scraper Unlimited, the most comprehensive Twitter data extraction solution available. Our enterprise-grade scraper offers unmatched capabilities with a transparent event-based pricing model, making it perfect for both small-scale and large-scale data extraction needs.

3.1 (24)

Pricing

Pay per event

236

Total users

7.9K

Monthly users

2.3K

Runs succeeded

>99%

Issues response

7.2 hours

Last modified

a day ago

Social media

Lead generation

Automation

Back to issues Create new issue

Inconsistent Column Values Returned by Crawler

Closed

brisk_zest opened this issue

Hello, Crawling the same post URL once a day, but the column values returned differ with each attempt, making automation difficult.

Request 1: https://console.apify.com/view/runs/yiaTt2OhCBeSUcdJw Request 2: https://console.apify.com/view/runs/yUPdxw9y9pho1kc8u

Although both requests use the same input URL, the number and names of the returned columns differ. Please look into this issue.

API Dojo (apidojo)

Hello,

Have you checked the raw response? The returned value is identical besides isVerified and location variables of the author. You can use a diff tool (like https://jsondiff.com/) to verify this, I am attaching a very zoomed out screenshot to show you both together.

The reason of the difference for these 2 fields is purely related to Twitter as sometimes it doesn't return them.

Can you please elaborate on which values look different and make your automation difficult?

Cheers

brisk_zest

Hello,

The differences I mentioned mainly occur in the author field, particularly in columns like isVerified and location, as you pointed out. The issue is that the data returned in this field is not consistent.

I crawl the same URL every day, but today the canDm and canMediaTag fields are missing. (Reference: https://console.apify.com/view/runs/Sdi1NvbsHnekRYR93)

Is it inherently random which fields are returned and which are omitted, depending on Twitter’s response behavior?

API Dojo (apidojo)

Hello again,

Thanks a lot for the example. As mentioned, we are using the exact same logic each time you scrape a URL and don't have any custom filters. We directly provide you the raw response we get from Twitter.

I will redirect this to our engineering team to have a second look.

Cheers

Add comment

🏯 Twitter (X) User Scraper (Pay Per Result)

apidojo/twitter-user-scraper

Introducing Twitter (X) User Scraper, the ultimate solution for direct user extraction from Twitter (X). It offers blazing speed and comprehensiveness, delivering lightning-fast user extraction features.

API Dojo

2.5K

4.8

Twitter (X.com) Search Scraper

web.harvester/easy-twitter-search-scraper

Easily extract tweets from Twitter (X.com) search results with our powerful Twitter Search Scraper. Get full tweet data, including text, engagement, media, and user info. Export in JSON, CSV, Excel, or HTML—perfect for social media monitoring, market research, competitor analysis, and trend tracking

Web Harvester

4.8K

2.3

Twitter Tweets Scraper

gentle_cloud/twitter-tweets-scraper

Enter the Twitter URL to quickly collect the latest tweet data. Based on the Twitter search interface, with countless quantity and time constraints, the tweet results are sorted in reverse chronological order.

Monkey Coder

1.7K

3.9

Twitter X-Plorer 🦜

jupri/twitter-scraper

💫 All-in-one Twitter X.com Scraper 🐦🐦‍⬛🐤

cat

605

5.0

Twitter Scraper

quacker/twitter-scraper

Scrape tweets from any Twitter user profile. Top Twitter API alternative to scrape Twitter hashtags, threads, replies, followers, images, videos, statistics, and Twitter history. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Quacker

33K

4.3

Tweet(X)/Twitter scraper|$0.35/1K| Pay-Per Result v2

fastcrawler/tweet-x-twitter-scraper-0-35-1k-pay-per-result-v2

Need a no-code, online Twitter (X)/Tweet scraper? Get real-time data for just $0.35 per 1K results with our pay-per-result model—no hidden fees! Extract tweets, profiles, and engagement metrics instantly. Fast, reliable, and cost-effective. Start scraping now! 🚀

fastcrawler

Best Twitter Scraper

zhangzhenhu/best-twitter-scraper

Twitter scraper that scrapes the latest Twitter content of any user. Since you need to be logged in to Twitter to crawl, you need to provide a Twitter account. Twitter 抓取器，可以抓取任意用户最新的Twitter内容。因为需要先登录 Twitter 才能抓取，所以需要提供一个 Twitter 的账号。

zhang zhenhu

1.0

🏯 Twitter (X) List Scraper (Pay Per Result)

apidojo/twitter-list-scraper

Discover the Twitter (X) List Scraper you've been looking for! Find the ultimate tool for extracting Tweets List from X / Twitter! It offers unparalleled speed and comprehensiveness, ensuring lightning-fast extraction of Tweets.

API Dojo

391

5.0