Actor - Playstation Store Scraper

Playstation Store scraper

Since Playstation Store doesn't provide a good and free API, this actor should help you to retrieve data from it.

The PlayStation Store data scraper supports the following features:

• Search any keyword - You can search any keyword you would like to have and get the results

• Scrape lists - Scrape any list that you'd like to get from PlayStation Store

• Scrape category - You can check the categories and scrape the information of the newest updates.

• Scrape concept - If you want to get concepts of a certain product, just type the URL.

• Scrape product - Scrape very detailed information for each of the products that you'd like to get.

Bugs, fixes, updates, and changelog

This scraper is under active development. If you have any feature requests you can create an issue from here.

Input Parameters

The input of this scraper should be JSON containing the list of pages on the Playstation Store that should be visited. Possible fields are:

• search: (Optional) (String) Keyword that you want to search on PlayStation Store.

• startUrls: (Optional) (Array) List of Playstation Store URLs. You should only provide concept, search, collection, category, or product detail URLs.

• country: (Optional) (String) PlayStation store country that you want to search on PlayStation Store.

• endPage: (Optional) (Number) Final number of page that you want to scrape. The default is Infinite. This applies to all search requests and startUrls individually.

• maxItems: (Optional) (Number) You can limit scraped items. This should be useful when you search through the big lists or search results.

• proxy: (Required) (Proxy Object) Proxy configuration.

• extendOutputFunction: (Optional) (String) Function that takes a JQuery handle ($) as an argument and returns an object with data.

• customMapFunction: (Optional) (String) Function that takes each object's handle as an argument and returns the object with executing the function.

This solution requires the use of Proxy servers, either your own proxy servers or you can use Apify Proxy.

Tip

When you want to scrape over a specific listing URL, just copy and paste the link as one of the startUrl.

If you would like to scrape only the first page of a list then put the link for the page and have the endPage as 1.

With the last approach that is explained above you can also fetch any interval of pages. If you provide the 5th page of a list and define the endPage parameter as 6 then you'll have the 5th and 6th pages only.

Compute Unit Consumption

The actor is optimized to run blazing fast and scrape many listings as possible. Therefore, it forefronts all listing detail requests. If the actor doesn't block very often it'll scrape 100 listings in 2 minutes with ~0.07-0.09 compute units.

Playstation Store Scraper Input example

1{
2  "startUrls":[
3    "https://store.playstation.com/en-tr/product/EP4389-CUSA17440_00-DCLGAMEEU0000000",
4    "https://store.playstation.com/en-tr/search/game",
5    "https://store.playstation.com/en-tr/concept/10000886",
6    "https://store.playstation.com/en-tr/category/d42c9dc6-5516-4a34-a511-c09894266d98/1"
7  ],
8  "search":"food game",
9  "includeReviews": false,
10  "proxy": {
11      "useApifyProxy": true
12  },
13  "endPage": 5,
14  "maxItems": 100
15}

During the Run

During the run, the actor will output messages letting you know what is going on. Each message always contains a short label specifying which page from the provided list is currently specified. When items are loaded from the page, you should see a message about this event with a loaded item count and total item count for each page.

If you provide incorrect input to the actor, it will immediately stop with failure state and output an explanation of what is wrong.

Playstation Store Export

During the run, the actor stores results into a dataset. Each item is a separate item in the dataset.

You can manage the results in any languague (Python, PHP, Node JS/NPM). See the FAQ or our API reference to learn more about getting results from this Playstation Store actor.

Scraped Playstation Store Properties

The structure of each item in Playstation Store looks like this:

Item Detail

1{
2  "url": "https://store.playstation.com/en-tr/product/EP9000-BCES00850_00-LBPDLCORIGCO0083",
3  "id": "EP9000-BCES00850_00-LBPDLCORIGCO0083",
4  "privacyPolicy": null,
5  "publisherName": "Sony Interactive Entertainment Europe",
6  "descriptions": [
7    {
8      "type": "LONG",
9      "subType": "NONE",
10      "value": "Game For Anything<br>Turn your Sackboy® into a creative genius with this Game Writer costume, complete with a fashion-statement moustache and ironic T-shirt.<br><br>Sackboy® Says:<br>• This costume is also available to download from PlayStation®Store in the Sackboy's Casual Friday Costume Pack.<br><br>This add-on is for LittleBigPlanet™ 2.<br><br>Buy this add-on for LBP™ 2 and get the LittleBigPlanet™ Karting, LittleBigPlanet™ PlayStation®Vita and LittleBigPlanet™ 3 (PS4™ and PS3™) versions at NO EXTRA COST.<br><br>After purchase, open the PlayStation®Store “Download List” to find this add-on ready to be downloaded.<br><br>1-4 Players, 1300MB minimum space required, HDTV screen resolution: 720p, Network Features, Network Players 2-4, PlayStation®Move Optional<br><br>Download of this product is subject to the Sony Entertainment Network Terms of Service/User Agreement and any specific additional conditions applying to this product. If you do not wish to accept these terms, do not download this product. See Terms of Service for more important information.<br> PS4: One-time licence fee to download to multiple PS4 systems. Sign in to PSN is not required to use this on your primary PS4, but is required for use on other PS4 systems.<br>PS3: One-time fee for use of downloads on up to 2 activated PS3 systems.<br>PS Vita: One-time fee for use of downloads on up to 3 activated compatible Portable Console systems.<br>See Health Warnings for important health information before using this product.<br>Library programs ©Sony Computer Entertainment Inc. exclusively licensed to Sony Computer Entertainment Europe. Software Usage Terms apply, See eu.playstation.com/legal for full usage rights.<br><br>LittleBigPlanet™ 2 ©2010 Sony Computer Entertainment Europe. Published by Sony Computer Entertainment Europe. Developed by Media Molecule. “LittleBigPlanet”, “LittleBigPlanet logo”, “Sackboy” and “Sackgirl” are trademarks or registered trademarks of Sony Computer Entertainment Europe. All rights reserved."
11    }
12  ],
13  "localizedGenres": null,
14  "releaseDate": "2013-07-31T00:00:00Z",
15  "spokenLanguages": [],
16  "screenLanguages": [],
17  "platforms": [
18    "PS4"
19  ],
20  "contentRating": {
21    "authority": "PEGI",
22    "description": "PEGI 7+",
23    "name": "PEGI_7",
24    "url": "https://image.api.playstation.com/grc/images/ratings/hd/pegi/7.png",
25    "interactiveElements": [],
26    "descriptors": [
27      {
28        "description": "Fear",
29        "name": "PEGI_FEAR",
30        "url": "https://image.api.playstation.com/grc/images/descriptors/hd/pegi/fear.png"
31      },
32      {
33        "description": "Online",
34        "name": "PEGI_ONLINE",
35        "url": "https://image.api.playstation.com/grc/images/descriptors/hd/pegi/online.png"
36      },
37      {
38        "description": "Violence",
39        "name": "PEGI_VIOLENCE",
40        "url": "https://image.api.playstation.com/grc/images/descriptors/hd/pegi/violence.png"
41      }
42    ]
43  },
44  "name": "Game Writer Costume",
45  "concept": null,
46  "skus": [
47    {
48      "__ref": "Sku:EP9000-BCES00850_00-LBPDLCORIGCO0083-E001"
49    },
50    {
51      "__ref": "Sku:EP9000-BCES00850_00-LBPDLCORIGCO0083-E002"
52    }
53  ],
54  "isAgeRestricted": false,
55  "activeCtaId": "ADD_TO_CART:ADD_TO_CART:EP9000-BCES00850_00-LBPDLCORIGCO0083-E001:OUTRIGHT",
56  "webctas": [
57    {
58      "__ref": "GameCTA:ADD_TO_CART:ADD_TO_CART:EP9000-BCES00850_00-LBPDLCORIGCO0083-E001:OUTRIGHT"
59    }
60  ],
61  "isInWishlist": false,
62  "isWishlistable": true,
63  "edition": null,
64  "media": [
65    {
66      "type": "IMAGE",
67      "role": "MASTER",
68      "url": "https://image.api.playstation.com/cdn/EP9000/BCES00850_00/cbixxOGGNeGKWQpapaWWQ2HKRaSQP3NA.png"
69    }
70  ],
71  "prices": [
72    "4,50 TL"
73  ],
74  "editions": []
75}

Contact

Please visit us through epctex.com to see all the products that are available for you. If you are looking for any custom integration or so, please reach out to us through the chat box in epctex.com. In need of support? devops@epctex.com is at your service.