Twitter Profile Scraper avatar
Twitter Profile Scraper
Try for free

3 days trial then $10.00/month - No credit card required now

View all Actors
Twitter Profile Scraper

Twitter Profile Scraper

epctex/twitter-profile-scraper
Try for free

3 days trial then $10.00/month - No credit card required now

Scrape any Twitter profile of any user. Extract tweets, replies, favorites, retweets, conversation threads and many more without any limit. Gather user related information such as verification, location, profile image, friends, followers, following and much more! No limits on Twitter!

User avatar

Crawling is taking much longer

Closed

fancy_xebec opened this issue
6 months ago

Just need follower count. How to set the crawler just for that? Problem is, it is taking too long and too much CPU scraping all the fields which are not required. Can we select what to scrape from an entered URL?

User avatar

epctex (epctex)

6 months ago

Hey there!

Thank you very much for reaching out. You can enable the option of "Only get user information" from the Input Schema and let the actor retrieve only the user information.

Please let me know if you need any further assistance, Best

User avatar

fancy_xebec

6 months ago

Done that. But user information has multiple fields. Need only follower count. How to do that?

User avatar

epctex (epctex)

6 months ago

Hey again,

I understand the problem now. We've integrated a new functionality called customMapFunction. This function applies to all output objects and changes their structure or values. Specifically in your use case, we thought it could help. You can check the run below and see if it works as you want.

Another important note about the time and resource consumption is that; this functionality will not change both of them. The actor will scrape everything as usual but change the output only. Therefore, reduction of the time or CPU is not possible at the current moment.

This is the link for the run I mentioned: https://console.apify.com/view/runs/1XRUuziukxIcocekN

Best

Developer
Maintained by Community
Actor metrics
  • 120 monthly users
  • 99.8% runs succeeded
  • 0.4 days response time
  • Created in Jul 2022
  • Modified about 21 hours ago