Actor - Metacritic Scraper

Metacritic scraper

Since Metacritic doesn't provide a good and free API, this actor should help you to retrieve data from it.

The Metacritic data scraper supports the following features:

• Search any keyword - You can search any keyword to retrieve games, people, music, movies, TV shows, companies, and many more things Metacritic provides. Type any keyword you want to get the results of.

• Scrape lists - Scrape any list that you'd like to get from Metacritic

• Scrape reviews - Get reviews from any object. Even if it is a game or music, you can get all the reviews from Metacritic.

• Movies, Games, Albums, TV Shows, People, or Companies. All of the information can be retrieved right away from Metacritic!

Bugs, fixes, updates, and changelog

This scraper is under active development. If you have any feature requests you can create an issue from here.

Input Parameters

The input of this scraper should be JSON containing the list of pages on Metacritic that should be visited. Possible fields are:

• startUrls: (Optional) (Array) List of Metacritic URLs. You can provide search, browse, game detail, movie detail, music detail, TV show detail, and many more different detail URLs.

• search: (Optional) (String) Keyword that you want to search on Metacritic.

• searchMode: (Optional) (String) Search mode is only required when search attribute is provided in the scraper. It changes the search results and provides you with the best outcome from Metacritic.

• includeReviews: (Optional) (Boolean) This will add all the reviews that Metacritic provides inside the data points. Please keep in mind that the time and resources the actor uses will increase proportionally by the number of reviews.

• endPage: (Optional) (Number) Final number of page that you want to scrape. The default is Infinite. This applies to all search requests and startUrls individually.

• maxItems: (Optional) (Number) You can limit scraped items. This should be useful when you search through the big lists or search results.

• proxy: (Required) (Proxy Object) Proxy configuration.

• extendOutputFunction: (Optional) (String) Function that takes a JQuery handle ($) as an argument and returns an object with data.

• customMapFunction: (Optional) (String) Function that takes each object's handle as an argument and returns the object with executing the function.

This solution requires the use of Proxy servers, either your own proxy servers or you can use Apify Proxy.

Tip

When you want to scrape over a specific listing URL, just copy and paste the link as one of the startUrl.

If you would like to scrape only the first page of a list then put the link for the page and have the endPage as 1.

With the last approach that is explained above you can also fetch any interval of pages. If you provide the 5th page of a list and define the endPage parameter as 6 then you'll have the 5th and 6th pages only.

Compute Unit Consumption

The actor is optimized to run blazing fast and scrape as many items as possible. Therefore, it forefronts all detail requests. If the actor doesn't block very often it'll scrape 100 items in 2 minutes with ~0.04-0.06 compute units.

Metacritic Scraper Input example

1{
2  "startUrls": [
3    "https://www.metacritic.com/music/sos/sza",
4    "https://www.metacritic.com/tv/the-witcher-blood-origin",
5    "https://www.metacritic.com/movie/whitney-houston-i-wanna-dance-with-somebody",
6    "https://www.metacritic.com/game/playstation-5/elden-ring",
7    "https://www.metacritic.com/search/all/hel/results",
8    "https://www.metacritic.com/search/game/hel/results",
9    "https://www.metacritic.com/browse/movies/score/metascore/all/filtered/netflix",
10    "https://www.metacritic.com/browse/tv/score/metascore/year/filtered?sort=desc&view=detailed",
11    "https://www.metacritic.com/browse/games/genre/date/action/ps4"
12  ],
13  "search": "last of us",
14  "searchMode": "all",
15  "includeReviews": false,
16  "proxy": {
17      "useApifyProxy": true
18  },
19  "endPage": 5,
20  "maxItems": 100
21}

During the Run

During the run, the actor will output messages letting you know what is going on. Each message always contains a short label specifying which page from the provided list is currently specified. When items are loaded from the page, you should see a message about this event with a loaded item count and total item count for each page.

If you provide incorrect input to the actor, it will immediately stop with a failure state and output an explanation of what is wrong.

Metacritic Export

During the run, the actor stores results into a dataset. Each item is a separate item in the dataset.

You can manage the results in any language (Python, PHP, Node JS/NPM). See the FAQ or our API reference to learn more about getting results from this Metacritic actor.

Scraped Metacritic Properties

The structure of each item in Metacritic looks like this:

Movie Detail

1{
2	"type": "movie",
3	"url": "https://www.metacritic.com/movie/whitney-houston-i-wanna-dance-with-somebody",
4	"title": "Whitney Houston: I Wanna Dance With Somebody",
5	"year": "2022",
6	"metascore": 51,
7	"userscore": 6,
8	"summary": "The joyous, emotional and heart-breaking celebration of the life and music of Whitney Houston, the greatest female R&B pop vocalist of all time. Tracking her journey from obscurity to musical super stardom",
9	"genres": [
10		"Biography",
11		"Drama",
12		"Music"
13	],
14	"buyLinks": [
15		"https://play.google.com/store/movies/details/Whitney_Houston_I_Wanna_Dance_with_Somebody?id=-9kQ6ddektQ.P&hl=en&gl=US&PAffiliateID=1100lHMW&PCamRefID=[subid_value]",
16		"https://www.anrdoezrs.net/links/9011673/type/dlg/sid/[subid_value]/https://www.vudu.com/content/movies/details/Whitney-Houston-I-Wanna-Dance-With-Somebody/2231428?"
17	],
18	"trailer": "https://video.internetvideoarchive.net/video.mp4?cmd=6&fmt=4&customerid=654126&publishedid=113544&e=2208902400&videokbrate=1500&h=b9cde4201f3fe05746a315a21f5fe202"
19}

Game Detail

1{
2	"type": "game",
3	"url": "https://www.metacritic.com/game/playstation-5/elden-ring",
4	"title": "Elden Ring",
5	"publisherName": "Bandai Namco Games",
6	"publisherUrl": "https://www.metacritic.com/company/bandai-namco-games",
7	"summary": "A New World Created By Hidetaka Miyazaki And George R. R. Martin. ELDEN RING, developed by FromSoftware, Inc. and BANDAI NAMCO Entertainment Inc., is a fantasy action-RPG adventure set within a world created by Hidetaka Miyazaki creator of the influential DARK SOULS video game series; and George R.R. Martin author of The New York Times best-selling fantasy series, A Song of Ice and Fire. Danger and discovery lurk around every corner in FromSoftware's largest game to-date.  Hidetaka Miyazaki, President and Game Director of FromSoftware Inc. Known for directing critically-acclaimed games in beloved franchises including Armored Core, Dark Souls, and Sekiro: Shadows Die Twice.  George R.R. Martin is the #1 New York Times bestselling author of many novels, including the acclaimed series A Song of Ice and Fire - A Game of Thrones, A Clash of Kings, A Storm of Swords, A Feast For Crows, and A Dance with Dragons. As a writer-producer, he has worked on The Twilight Zone, Beauty and the Beast, and various feature films and pilots that were never made.",
8	"metascore": 96,
9	"userscore": 7.7,
10	"genres": [
11		"Role-Playing",
12		"Action RPG"
13	],
14	"trailer": "https://mt-rv-v1.gamespot.com/vr/2022/03/04/trailer_eldenring_lore_8000.mp4",
15	"awards": [
16		"#1 Best PlayStation 5 Game of 2022",
17		"#3 Most Discussed PlayStation 5 Game of 2022"
18	],
19	"platform": [
20		"PC",
21		"PlayStation 4",
22		"Xbox One",
23		"Xbox Series X",
24		"PlayStation 5"
25	],
26		"platformReviews": [
27		{
28			"name": "PC",
29			"score": 96,
30			"normalizedScore": 96.0672,
31			"positiveCount": 111,
32			"reviewCount": 119,
33			"negativeCount": 0,
34			"neutralCount": 1,
35			"url": "https://www.metacritic.com/game/baldurs-gate-3/critic-reviews/?platform=pc"
36		},
37		{
38			"name": "PlayStation 5",
39			"score": 96,
40			"normalizedScore": 95.775,
41			"positiveCount": 37,
42			"reviewCount": 39,
43			"negativeCount": 0,
44			"neutralCount": 0,
45			"url": "https://www.metacritic.com/game/baldurs-gate-3/critic-reviews/?platform=playstation-5"
46		},
47		{
48			"name": "Xbox Series X",
49			"score": 99,
50			"normalizedScore": 99.1111,
51			"positiveCount": 9,
52			"reviewCount": 10,
53			"negativeCount": 0,
54			"neutralCount": 0,
55			"url": "https://www.metacritic.com/game/baldurs-gate-3/critic-reviews/?platform=xbox-series-x"
56		}
57	],
58	"pcUserReviews": {
59		"name": "PC",
60		"score": 96,
61		"normalizedScore": 96.0672,
62		"positiveCount": 111,
63		"reviewCount": 119,
64		"negativeCount": 0,
65		"neutralCount": 1,
66		"url": "https://www.metacritic.com/game/baldurs-gate-3/critic-reviews/?platform=pc"
67	},
68	"playStation5UserReviews": {
69		"name": "PlayStation 5",
70		"score": 96,
71		"normalizedScore": 95.775,
72		"positiveCount": 37,
73		"reviewCount": 39,
74		"negativeCount": 0,
75		"neutralCount": 0,
76		"url": "https://www.metacritic.com/game/baldurs-gate-3/critic-reviews/?platform=playstation-5"
77	},
78	"xboxSeriesXUserReviews": {
79		"name": "Xbox Series X",
80		"score": 99,
81		"normalizedScore": 99.1111,
82		"positiveCount": 9,
83		"reviewCount": 10,
84		"negativeCount": 0,
85		"neutralCount": 0,
86		"url": "https://www.metacritic.com/game/baldurs-gate-3/critic-reviews/?platform=xbox-series-x"
87	},
88}

Series Detail

1{
2	"type": "series",
3	"url": "https://www.metacritic.com/tv/the-witcher-blood-origin",
4	"title": "The Witcher: Blood Origin",
5	"metascore": 45,
6	"userscore": 1,
7	"distributor": [
8		{
9			"title": "NETFLIX",
10			"url": "https://www.metacritic.com/company/netflix"
11		}
12	],
13	"releaseDate": "December 25, 2022",
14	"summary": "The six-part prequel to The Witcher set 1200 years before Geralt of Rivia tells the story of the first Witcher and the events that led to the conjunction of the spheres.",
15	"genres": [
16		"Drama",
17		"Movie/Mini-Series",
18		"Action & Adventure",
19		"Fantasy",
20		"Science Fiction"
21	],
22	"buyLinks": [
23		"https://www.netflix.com/watch/81323602?"
24	],
25	"trailer": "https://video.internetvideoarchive.net/video.mp4?cmd=6&fmt=4&customerid=654126&publishedid=41256&e=2208902400&videokbrate=1500&h=4e642389faf74cf174271c6cf62a3a03",
26	"episodes": [
27		{
28			"title": "S1:E4. Of Mages, Malice, and Monstrous Mayhem",
29			"airDate": "November 30, -0001",
30			"url": "https://www.metacritic.com/tv/the-witcher-blood-origin/season-1/episode-4-of-mages-malice-and-monstrous-mayhem"
31		},
32		{
33			"title": "S1:E3. Of Warriors, Wakes, and Wondrous Worlds",
34			"airDate": "November 30, -0001",
35			"url": "https://www.metacritic.com/tv/the-witcher-blood-origin/season-1/episode-3-of-warriors-wakes-and-wondrous-worlds"
36		},
37		{
38			"title": "S1:E2. Of Dreams, Defiance, and Desperate Deeds",
39			"airDate": "November 30, -0001",
40			"url": "https://www.metacritic.com/tv/the-witcher-blood-origin/season-1/episode-2-of-dreams-defiance-and-desperate-deeds"
41		},
42		{
43			"title": "S1:E1. Of Ballads, Brawlers, and Bloodied Blades",
44			"airDate": "November 30, -0001",
45			"url": "https://www.metacritic.com/tv/the-witcher-blood-origin/season-1/episode-1-of-ballads-brawlers-and-bloodied-blades"
46		}
47	]
48}

Music Detail

1{
2	"type": "music",
3	"url": "https://www.metacritic.com/music/sos/sza",
4	"title": "S.O.S.",
5	"musician": "SZA",
6	"companyName": "RCA",
7	"companyUrl": "https://www.metacritic.com/company/rca",
8	"summary": "The second full-length studio release for R&B artist SZA features guest appearances from Phoebe Bridgers, Ol' Dirty Bastard, Travis Scott, and Don Toliver.",
9	"metascore": 90,
10	"userscore": 8.6,
11	"genres": [
12		"R&B"
13	],
14	"buyLink": "https://www.amazon.com/dp/B0BNXZPL4G%3Ftag%3Dmetacritic-musiccat-20%26linkCode%3Dosi%26th%3D1%26psc%3D1"
15}

With Reviews

1{
2	"type": "music",
3	"url": "https://www.metacritic.com/music/cacti/billy-nomates",
4	"title": "Cacti",
5	"musician": "Billy Nomates",
6	"companyName": "Invada",
7	"companyUrl": "https://www.metacritic.com/company/invada",
8	"summary": "The second full-length release for British singer-songwriter Billy Nomates was produced with James Trevascus.",
9	"metascore": 85,
10	"userscore": null,
11	"genres": [
12		"Pop/Rock"
13	],
14	"buyLink": "https://www.amazon.com/dp/B0BJTZT1HZ%3Ftag%3Dmetacritic-musiccat-20%26linkCode%3Dosi%26th%3D1%26psc%3D1",
15	"userReviewsSummary": {
16		"positive": 0,
17		"mixed": 1,
18		"negative": 0
19	},
20	"userReviews": [
21		{
22			"score": 5,
23			"date": "Jan 13, 2023",
24			"review": "Nach der Scheiße, freut sich jeder Mensch auf „Every Loser“ von Iggy, bitte als Kompliment auffassen.",
25			"source": "jens76"
26		}
27	],
28	"criticReviewsSummary": {
29		"positive": 10,
30		"mixed": 1,
31		"negative": 0
32	},
33	"criticReviews": [
34		{
35			"score": 90,
36			"date": "Jan 13, 2023",
37			"review": "Despite all the changes she introduces on Cacti, the honesty of Maries' music remains paramount, and the savvy and polish she brings to the album confirm she's an excitingly hard-to-pin-down artist.",
38			"source": "AllMusic"
39		},
40		{
41			"score": 90,
42			"date": "Jan 12, 2023",
43			"review": "It’s a statement of intent from Billy Nomates, unbalancing sonic scales and weaving this into a force to be reckoned with.",
44			"source": "Clash Music"
45		},
46		{
47			"score": 90,
48			"date": "Jan 11, 2023",
49			"review": "Cacti is relentless, laser-focused and irresistible. [Feb 2023, p.32]",
50			"source": "Uncut"
51		},
52		{
53			"score": 80,
54			"date": "Jan 17, 2023",
55			"review": "Best described as a punk with a keyboard and tunes to burn, Nomates has dug even deeper for Cacti, her songwriting broadening its reach. Her deadpan takedowns remain heroic.",
56			"source": "The Observer (UK)"
57		},
58		{
59			"score": 80,
60			"date": "Jan 13, 2023",
61			"review": "This is a softer, more introspective approach than her barn-storming debut, but this 12-track album doesn’t lack the punch and bite of its debut in spite of this.",
62			"source": "The Telegraph (UK)"
63		},
64		{
65			"score": 80,
66			"date": "Jan 11, 2023",
67			"review": "A seething but persevering energy flows intensely CACTI.",
68			"source": "Exclaim"
69		},
70		{
71			"score": 80,
72			"date": "Jan 11, 2023",
73			"review": "The narrative lines are fractured, the satire removed; these songs play out like stress responses, fight-or-flight impulses, each one a little panic room. ... There’s not a lot of feeling OK on CACTI, but for once, it feels like exactly the right place for Billy Nomates. She’s brought herself, entirely. [Feb 2023, p.86]",
74			"source": "Mojo"
75		},
76		{
77			"score": 80,
78			"date": "Jan 11, 2023",
79			"review": "Cacti might show Maries in survival mode, but revealing vulnerability has seen her songwriting soften and come into its own.",
80			"source": "Record Collector"
81		},
82		{
83			"score": 70,
84			"date": "Jan 13, 2023",
85			"review": "Bottom line: if you like diva pop with a little edge, have at it. But if you got into Billy Nomates because she reminded you of the Sleaford Mods, maybe sit CACTI out.",
86			"source": "Dusted Magazine"
87		},
88		{
89			"score": 70,
90			"date": "Jan 11, 2023",
91			"review": "There’s still that personable rawness to her production – the synthetic drums and often sparse arrangement mirroring her frequently despondent lyrical themes (“The death of everything real has happened…” begins ‘apathy is wild’). But her vocal offers warmth.",
92			"source": "DIY Magazine"
93		},
94		{
95			"score": 60,
96			"date": "Jan 11, 2023",
97			"review": "CACTI is understandably more subdued than her self-titled debut, but the boisterous numbers it does contain, like spite, might feel more dynamic played live by humans – it feels like the energy that makes her such a captivating performer is being restricted by her drum machine.",
98			"source": "The Skinny"
99		}
100	]
101}

Contact

Please visit us through epctex.com to see all the products that are available for you. If you are looking for any custom integration or so, please reach out to us through the chat box in epctex.com. In need of support? devops@epctex.com is at your service.