Twitter Profile Scraper
3 days trial then $10.00/month - No credit card required now
Twitter Profile Scraper
3 days trial then $10.00/month - No credit card required now
Scrape any Twitter profile of any user. Extract tweets, replies, favorites, retweets, conversation threads and many more without any limit. Gather user related information such as verification, location, profile image, friends, followers, following and much more! No limits on Twitter!
Crawling is taking much longer
Closed
Just need follower count. How to set the crawler just for that? Problem is, it is taking too long and too much CPU scraping all the fields which are not required. Can we select what to scrape from an entered URL?
Hey there!
Thank you very much for reaching out. You can enable the option of "Only get user information" from the Input Schema and let the actor retrieve only the user information.
Please let me know if you need any further assistance, Best
fancy_xebec
Done that. But user information has multiple fields. Need only follower count. How to do that?
Hey again,
I understand the problem now. We've integrated a new functionality called customMapFunction. This function applies to all output objects and changes their structure or values. Specifically in your use case, we thought it could help. You can check the run below and see if it works as you want.
Another important note about the time and resource consumption is that; this functionality will not change both of them. The actor will scrape everything as usual but change the output only. Therefore, reduction of the time or CPU is not possible at the current moment.
This is the link for the run I mentioned: https://console.apify.com/view/runs/1XRUuziukxIcocekN
Best
epctexActor Metrics
103 monthly users
-
15 stars
>99% runs succeeded
Created in Jul 2022
Modified 19 hours ago
