Actor - App Store Scraper

App Store scraper

Since Apple Store doesn't provide a good and valid API, this actor should help you to retrieve data from it.

The App Store data scraper supports the following features:

• Get reviews - Get reviews of anything from iTunes! No limits, extremely fast!

• Search any keyword - You can search any keyword you would like to have and get the results

• Scrape and media types - Scrape any type of media type that you need to get from the Apple Store

• Scrape iTunes or App Store URLs - Get any iTunes or App Store URLs from their detail page.

• Scrape publishers - You can gather intelligence from your rivals by gathering information from them

• Scrape by filters - Media type, country, or keyword. You can customize the results

• Lookup by multiple ids - If you need to scrape multiple media or multiple competitors you can retrieve them at once.

Bugs, fixes, updates, and changelog

This scraper is under active development. If you have any feature requests you can create an issue from here.

Input Parameters

The input of this scraper should be JSON containing the list of pages on the App Store that should be visited. Possible fields are:

• term: (Optional) (String) Keyword that you want to search on App Store.

• startUrls: (Optional) (Array) List of Apple Store URLs. You should only provide detailed URLs from iTunes or App Store.

• country: (Optional) (String) Country of the App Store that you'd like to scrape on.

• mediaType: (Optional) (String) Media Type of the assets that you will get from the App Store.

• mode: (Optional) (String) Mode of the actor. It can be "search" or "lookup".

• includeReviews: (Optional) (Boolean) If you want to include the reviews per each of the applications, you can enable this option. Please keep in mind that reviews will be retrieved in a paginated manner. Therefore the number of requests proportionally increases.

• endPage: (Optional) (Number) Final number of page that you want to scrape. The default is Infinite. This applies to all search requests and startUrls individually.

• maxItems: (Optional) (Number) You can limit scraped items. This should be useful when you search through the big lists or search results.

• proxy: (Required) (Proxy Object) Proxy configuration.

• customMapFunction: (Optional) (String) Function that takes each object's handle as an argument and returns the object with executing the function.

This solution requires the use of Proxy servers, either your own proxy servers or you can use Apify Proxy.

Tip

If you want to scrape a specific id or media, always use Lookup mode. Lookup mode is suggested for searching up specific values or assets on the App Store or iTunes. For example; if you want to search for the id of 400763833, then select Lookup mode and enter 400763833 into the Term section.

On the other hand, if you want to search over specific keywords or filters, Search mode will do the job for you.

Compute Unit Consumption

The actor is optimized to run blazing fast and scrape many listings as possible. Therefore, it forefronts all listing detail requests. If the actor doesn't block very often it'll scrape 100 listings in 2 minutes with ~0.01-0.02 compute units.

App Store Scraper Input example

1{
2    "startUrls": [
3        "https://itunes.apple.com/us/movie/inception/id400763833",
4        "https://apps.apple.com/us/app/angry-birds-2/id880047117"
5    ],
6    "term": "game dev",
7    "country": "us",
8    "mediaType": "all",
9    "mode": "search",
10    "includeReviews":true,
11    "maxItems": 3
12}

During the Run

During the run, the actor will output messages letting you know what is going on. Each message always contains a short label specifying which page from the provided list is currently specified. When items are loaded from the page, you should see a message about this event with a loaded item count and total item count for each page.

If you provide incorrect input to the actor, it will immediately stop with a failure state and output an explanation of what is wrong.

App Store Export

During the run, the actor stores results into a dataset. Each item is a separate item in the dataset.

You can manage the results in any language (Python, PHP, Node JS/NPM). See the FAQ or our API reference to learn more about getting results from this Appstore actor.

Scraped App Store Media

The structure of each item that you'll receive from the App Store looks like this:

Item Detail

1{
2    "wrapperType": "track",
3    "kind": "podcast",
4    "collectionId": 1043547750,
5    "trackId": 1043547750,
6    "artistName": "Game Dev Unchained",
7    "collectionName": "Game Dev Unchained",
8    "trackName": "Game Dev Unchained",
9    "collectionCensoredName": "Game Dev Unchained",
10    "trackCensoredName": "Game Dev Unchained",
11    "collectionViewUrl": "https://podcasts.apple.com/us/podcast/game-dev-unchained/id1043547750?uo=4",
12    "feedUrl": "https://anchor.fm/s/651ae57c/podcast/rss",
13    "trackViewUrl": "https://podcasts.apple.com/us/podcast/game-dev-unchained/id1043547750?uo=4",
14    "artworkUrl30": "https://is5-ssl.mzstatic.com/image/thumb/Podcasts125/v4/3e/ea/04/3eea0406-7b9f-30f6-c626-6b9a4cef5597/mza_16385274979335913443.jpg/30x30bb.jpg",
15    "artworkUrl60": "https://is5-ssl.mzstatic.com/image/thumb/Podcasts125/v4/3e/ea/04/3eea0406-7b9f-30f6-c626-6b9a4cef5597/mza_16385274979335913443.jpg/60x60bb.jpg",
16    "artworkUrl100": "https://is5-ssl.mzstatic.com/image/thumb/Podcasts125/v4/3e/ea/04/3eea0406-7b9f-30f6-c626-6b9a4cef5597/mza_16385274979335913443.jpg/100x100bb.jpg",
17    "collectionPrice": 0,
18    "trackPrice": 0,
19    "trackRentalPrice": 0,
20    "collectionHdPrice": 0,
21    "trackHdPrice": 0,
22    "trackHdRentalPrice": 0,
23    "releaseDate": "2021-11-02T23:11:00Z",
24    "collectionExplicitness": "cleaned",
25    "trackExplicitness": "cleaned",
26    "trackCount": 332,
27    "country": "USA",
28    "currency": "USD",
29    "primaryGenreName": "Video Games",
30    "contentAdvisoryRating": "Clean",
31    "artworkUrl600": "https://is5-ssl.mzstatic.com/image/thumb/Podcasts125/v4/3e/ea/04/3eea0406-7b9f-30f6-c626-6b9a4cef5597/mza_16385274979335913443.jpg/600x600bb.jpg",
32    "genreIds": ["1509", "26", "1502"],
33    "genres": ["Video Games", "Podcasts", "Leisure"],
34    "reviews": [
35        {
36            "id": "9519350766",
37            "userName": "ultrageoffe",
38            "userUrl": "https://itunes.apple.com/us/reviews/id212958678",
39            "version": "2.3",
40            "score": 1,
41            "title": "Ad nightmare",
42            "text": "Ads every few seconds. Don’t waste your time",
43            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
44        },
45        {
46            "id": "9519118710",
47            "userName": "blake42059",
48            "userUrl": "https://itunes.apple.com/us/reviews/id1241179837",
49            "version": "2.3",
50            "score": 1,
51            "title": "To many adds and pop ups trash game don’t recommend to anyone.",
52            "text": "To many adds and pop ups trash game don’t recommend to anyone.",
53            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
54        },
55        {
56            "id": "9518589385",
57            "userName": "Skinny1K",
58            "userUrl": "https://itunes.apple.com/us/reviews/id1339960005",
59            "version": "2.3",
60            "score": 1,
61            "title": "Found a bug😂",
62            "text": "The game stopped working before I could finish level 1",
63            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
64        },
65        {
66            "id": "9516124853",
67            "userName": "Epictrollcreeper",
68            "userUrl": "https://itunes.apple.com/us/reviews/id351259271",
69            "version": "2.3",
70            "score": 3,
71            "title": "Rating",
72            "text": "Good concept, too many ads.",
73            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
74        },
75        {
76            "id": "9515904349",
77            "userName": "ORION THA GREAT",
78            "userUrl": "https://itunes.apple.com/us/reviews/id1400556177",
79            "version": "2.3",
80            "score": 1,
81            "title": "No sound.",
82            "text": "The app has no sound ? Why ?",
83            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
84        },
85        {
86            "id": "9515358167",
87            "userName": "aj12ski",
88            "userUrl": "https://itunes.apple.com/us/reviews/id1159671746",
89            "version": "2.3",
90            "score": 1,
91            "title": "Not good",
92            "text": "So many ads and it bothers you and says you gotta click on these little things that bring you to a obvious scam for a gift card. Also, pistons don’t all fire at the same time. Very bad game.",
93            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
94        },
95        {
96            "id": "9512381960",
97            "userName": "86spence",
98            "userUrl": "https://itunes.apple.com/us/reviews/id889838843",
99            "version": "2.3",
100            "score": 5,
101            "title": "I thought this would be bad but it’s way better than that",
102            "text": "i genuinely think this game is fun!",
103            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
104        },
105        {
106            "id": "9512157356",
107            "userName": "K.video",
108            "userUrl": "https://itunes.apple.com/us/reviews/id1320845055",
109            "version": "2.3",
110            "score": 3,
111            "title": "Wow",
112            "text": "A fun game but to much ads",
113            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
114        },
115        {
116            "id": "9511169577",
117            "userName": "bruh dis is broke",
118            "userUrl": "https://itunes.apple.com/us/reviews/id455293667",
119            "version": "2.3",
120            "score": 1,
121            "title": "Crazy ads",
122            "text": "This game is absolutely an ad farm. It feeds you a ridiculous amount of ads. Most games it gives you the option to receive a reward for watching an ad and some ads mixed in here and there. This game forces you to watch an ad every few seconds, no option to pay for no ads, i wonder how much they make for selling your data. I deleted this game after 5 minutes, its a shame because it is really fun.",
123            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
124        },
125        {
126            "id": "9510639374",
127            "userName": "Zeus Zeus 1",
128            "userUrl": "https://itunes.apple.com/us/reviews/id532959786",
129            "version": "2.3",
130            "score": 1,
131            "title": "less pop ups to make the game fun",
132            "text": "to many pops of stuff we can see along side to even enjoy the game cause after all that we have ads to watch",
133            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
134        },
135        {
136            "id": "9509057238",
137            "userName": "fhfhghhhhg fun",
138            "userUrl": "https://itunes.apple.com/us/reviews/id1395367311",
139            "version": "2.3",
140            "score": 5,
141            "title": "Fun",
142            "text": "I like it",
143            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
144        },
145        {
146            "id": "9507809623",
147            "userName": "boodclaws0",
148            "userUrl": "https://itunes.apple.com/us/reviews/id874642291",
149            "version": "2.3",
150            "score": 2,
151            "title": "eh",
152            "text": "way too many ads",
153            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
154        },
155        {
156            "id": "9504616350",
157            "userName": "Fell in love with a girl",
158            "userUrl": "https://itunes.apple.com/us/reviews/id363783248",
159            "version": "2.3",
160            "score": 2,
161            "title": "Stupid ad's",
162            "text": "This game has way to many pop ups/ad's and makes the games a little ridiculous to play and I don't recommend. They are just looking for their money.",
163            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
164        },
165        {
166            "id": "9504002907",
167            "userName": "gcpwilson",
168            "userUrl": "https://itunes.apple.com/us/reviews/id261803549",
169            "version": "2.3",
170            "score": 1,
171            "title": "Way too many ads",
172            "text": "For too many ads for anyone’s liking, in my opinion. The app is development and the game is seemingly repetitive to other games out there.",
173            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
174        },
175        {
176            "id": "9503418821",
177            "userName": "Regulator1988",
178            "userUrl": "https://itunes.apple.com/us/reviews/id114773095",
179            "version": "2.3",
180            "score": 1,
181            "title": "Just ads",
182            "text": "Nothing more than an ad generator",
183            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
184        },
185        {
186            "id": "9502409312",
187            "userName": "isyounoob",
188            "userUrl": "https://itunes.apple.com/us/reviews/id1269971507",
189            "version": "2.3",
190            "score": 4,
191            "title": "Good",
192            "text": "It’s good but it’s not a online game if it was it would be better",
193            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
194        },
195        {
196            "id": "9500880396",
197            "userName": "Ahmet İkbal Adlığ",
198            "userUrl": "https://itunes.apple.com/us/reviews/id1281714308",
199            "version": "2.3",
200            "score": 5,
201            "title": "Engine pistons",
202            "text": "Watching engine pistons has never been this fun 😍",
203            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
204        },
205        {
206            "id": "9500687874",
207            "userName": "Honest review of games",
208            "userUrl": "https://itunes.apple.com/us/reviews/id1487869741",
209            "version": "2.3",
210            "score": 2,
211            "title": "It’s meh",
212            "text": "Very pushy with “2x speed for 15 seconds” and similar boosts, the buttons are already on the side, and covering the screen while you need to tap to go fast and “be satisfying” is just a bit irritating. Another problem is how some upgrades have a level cap and cannot upgrade further other than pistons and cars from then on. I do not know if this changes on further levels because after level one, my car turned invisible, has infinite nitro, and cannot pass cars. The floating pistons just keeps passing the same place of a rival car over and over. Other than that, the game is alright with designs and the engine “building” is quite fun. Overall, not worth investing a lot of time into and seems like this game was just made with the sole purpose to have people watch ads rather than have more of a balance between a fun game and watching ads like the game “Mob Control” or “Cats and Soup” and other games I love where things aren’t shoved in my face and are more of an option. Then again, I am not the target audience of a young child.",
213            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
214        },
215        {
216            "id": "9499867302",
217            "userName": "Noahthegamer5",
218            "userUrl": "https://itunes.apple.com/us/reviews/id428324534",
219            "version": "2.2",
220            "score": 1,
221            "title": "Cool concept",
222            "text": "This game is fun but literally not 10 seconds passes between ads. It’s unplayable due to how greedy the devs are.",
223            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
224        },
225        {
226            "id": "9497199859",
227            "userName": "berrymckokner",
228            "userUrl": "https://itunes.apple.com/us/reviews/id104183840",
229            "version": "2.2",
230            "score": 1,
231            "title": "Not good",
232            "text": "This game is terrible nothing is correct and it’s nothing like the ads",
233            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
234        },
235        {
236            "id": "9496484784",
237            "userName": "Mk//z06",
238            "userUrl": "https://itunes.apple.com/us/reviews/id1487454997",
239            "version": "2.1",
240            "score": 1,
241            "title": "Too many ads",
242            "text": "Game is an ad-trap. The game is even insistent that it needs Wi-Fi to be played. Constant pop-ups with videos that you have to watch. Then, even in-game, constant pop ups and buttons all over the side that get you to watch an ad. Giant waste of time, with little developer effort.",
243            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
244        },
245        {
246            "id": "9491770410",
247            "userName": "×͜× ☻︎",
248            "userUrl": "https://itunes.apple.com/us/reviews/id1314706716",
249            "version": "2.1",
250            "score": 1,
251            "title": "Ads",
252            "text": "Way to many ads barely even playable because every 30 seconds there’s a ad",
253            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
254        },
255        {
256            "id": "9491177174",
257            "userName": "Kennyotter",
258            "userUrl": "https://itunes.apple.com/us/reviews/id1451044140",
259            "version": "2.1",
260            "score": 1,
261            "title": "Ads the game",
262            "text": "Not even one minute into the game I got ten different pop ups asking if I wanted to increase my speed, or have auto tap, or merge for free. Right after clicking away from all of those an ad force played. Don’t forget the ad at the bottom either.",
263            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
264        },
265        {
266            "id": "9486738863",
267            "userName": "BrennanXSMax",
268            "userUrl": "https://itunes.apple.com/us/reviews/id596576786",
269            "version": "2.1",
270            "score": 1,
271            "title": "Ads",
272            "text": "Yet another game on the App Store that fills games with so many ads the game is rendered unplayable.",
273            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
274        },
275        {
276            "id": "9482862225",
277            "userName": "daniel casaus",
278            "userUrl": "https://itunes.apple.com/us/reviews/id1258520205",
279            "version": "2.1",
280            "score": 5,
281            "title": "Anazing game",
282            "text": "Ive always loved how pistons moved up and down and this game pretty much answered that and i knew i had to download it",
283            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
284        },
285        {
286            "id": "9482806686",
287            "userName": "TheKnight2468",
288            "userUrl": "https://itunes.apple.com/us/reviews/id446572279",
289            "version": "2.1",
290            "score": 2,
291            "title": "Levels break after level 1",
292            "text": "The game was great until I finished level 1 and it wouldn’t let me get the reward and move to level 2. I then tried closing and re-opening the game but then I was just sent to the end of the next level where I still had the same issue.",
293            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
294        },
295        {
296            "id": "9425759392",
297            "userName": "BOOMXD8642",
298            "userUrl": "https://itunes.apple.com/us/reviews/id482243206",
299            "version": "1.0",
300            "score": 2,
301            "title": "Waste of time",
302            "text": "Wasted 40mins to get to the end and not be able to beat the 1st place car.",
303            "url": "https://itunes.apple.com/us/review?id=1660464064&type=Purple%20Software"
304        }
305    ]
306}

Contact

Please visit us through epctex.com to see all the products that are available for you. If you are looking for any custom integration or so, please reach out to us through the chat box in epctex.com. In need of support? devops@epctex.com is at your service.