🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper avatar

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

Try for free

Pay $0.40 for 1,000 tweets

View all Actors
🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

apidojo/tweet-scraper
Try for free

Pay $0.40 for 1,000 tweets

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.30 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!

GO

Different columns in two runs

Closed

goldsmif opened this issue
3 days ago

Hi I have made two runs today and they seem to have different columns in the results. The first one returned data with a specific set of columns but the second one didn’t have the same set of columns and is missing a couple of columns I exported from the the earlier run like fullText, likeCount. Can you advise please.

Earlier run - https://console.apify.com/actors/runs/EBnrmdpp7Jg8XpbfL#output

Later run - https://console.apify.com/actors/runs/eSvciaNgjXiCRt4Xm#output

Another issue I have is how to drill down into the Author section, I don't really need all those fields just a selection but the field selector does not allow me to add author/createdAt etc

apidojo avatar

Hello,

Excel output functionality is an Apify feature and doesn't fall under the responsibility of our actor. We only provide a JSON export and cannot give support with the excel output.

Also, if you want to change the fields, you can use customMapFunction in the INPUT.

Cheers

GO

goldsmif

2 days ago

Hi,

I am not sure I have explained the problem, two runs using your actor have different lists of columns in the output. Are you are saying that the Excel columns that you can export from each APIFY.com run is random? Very confused now as I used the old Twitter scraper and the Instagram scraper last year maybe a hundred times and have just done about 30 runs of the instagram scraper this and the list of columns has always been the same. Surely there must be a difference in the JSON source format produced by your actor between these two runs that causes this? cheers, Andy

GO

goldsmif

2 days ago

see above

apidojo avatar

Hello,

I completely understood your issue. If you check the JSON outputs of the two runs, they will be identical. I see that you are fetching more items with a different keyword in one of them so it is possible that you got some new fields in the JSON. However this doesn't affect or break the format of a JSON file.

What I was saying is that the export functionality is Apify's feature and uses our JSON output to produce this. It is not possible for us to interfere that functionality. For instance, you mentioned there is a author/createdAt field in the excel sheet, for us it us an author object with a createdAt field in the JSON.

I hope these clear things out.

Cheers

GO

goldsmif

2 days ago

To add some more information, the fullText column is displayed in the data preview for both these runs its just the later one doesn't offer in the export. You are saying that I need to report this as an error rather than the actor developer?

GO

goldsmif

2 days ago

the files have the same fields, they are just both hashtags scrapes. as I mention above the preview works, the data is in the JSON as you say, its just in the excel export it goes wrong. The APIFY.com docs imply that when I raise an issue that it goes to the 'team' as well you. Is that happening, can you please advise me on how to raise a ticket with APIFY.com or pass this ticket to them, I know its not your problem but you keep closing the ticket saying its not your problem :-)

GO

goldsmif

2 days ago

the files have the same fields, they are just both hashtags scrapes. as I mention above the preview works, the data is in the JSON as you say, its just in the excel export it goes wrong. The APIFY.com docs imply that when I raise an issue that it goes to the 'team' as well you. Is that happening, can you please advise me on how to raise a ticket with APIFY.com or pass this ticket to them, I know its not your problem but you keep closing the ticket saying its not your problem :-)

apidojo avatar

Hello,

Yes, I checked the JSON file and couldn't see any issues, that's why I am closing the ticket because there is no issue with the actor :) Unfortunately there is no way to pass this issue to Apify, Actor Issues are totally different than Apify support.

I think you can check the following links and also maybe use the chat icon in the bottom right of the page.

Cheers

GO

goldsmif

2 days ago

thanks have a great weekend

apidojo avatar

you too! 🙌

Developer
Maintained by Community

Actor Metrics

  • 1.7k monthly users

  • 306 stars

  • 99% runs succeeded

  • 4.3 hours response time

  • Created in Nov 2023

  • Modified 18 hours ago