Pay $2.50 for 1,000 posts
Twitter URL Scraper
Pay $2.50 for 1,000 posts
Copy any Twitter URL and extract Twitter usernames, profile photos, follower count, tweets, hashtags, favorite count, and more. Export scraped datasets, run the scraper via API, schedule and monitor runs or integrate with other tools.
Problem with profile user info for retweets
Closed
I use this actor to get data about the profile (number of followers, number of following, etc), so I set the number of tweets to scrape to just 1. When the first tweet of the profile is a RETWEET, the actor retrieves the user data of the retweeted user, not the "original" one. Is there a way to overcome this problem? Thank you.
Hi Mario, In your specific situation, we recommend utilizing the "twitter-scraper" actor instead of "twitter-url-scraper" and enabling the "useAdvancedSearch" option with handles that exclude retweets. Please keep in mind that you should only use the handle, not the entire Handle URL.
hophouse2021
Thank you, I'll give it a try.
hophouse2021
I see now that I had already tried to use "twitter-scraper", see the following input: I still get the user data of the retweeted user instead of the user represented by the handle in the input. I tried to set useAdvancedSearch to true in the json editor but I don't know how to exclude retweets exactly?
{ "addTweetViewCount": true, "addUserInfo": true, "debugLog": false, "extendOutputFunction": "async ({ data, item, page, request, customData, Apify }) => {\n return item;\n}", "extendScraperFunction": "async ({ page, request, addSearch, addProfile, _, addThread, addEvent, customData, Apify, signal, label }) => {\n \n}", "handle": [ "LaProvinciadiCO" ], "handlePageTimeoutSecs": 500, "maxIdleTimeoutSecs": 60, "maxRequestRetries": 6, "mode": "own", "profilesDesired": 1, "proxyConfig": { "useApifyProxy": true }, "searchMode": "live", "tweetsDesired": 1, "useAdvancedSearch": false, "useCheerio": true }
Quacker- 324 monthly users
- 89.1% runs succeeded
- 12.1 days response time
- Created in Mar 2022
- Modified about 2 months ago
