What is News Article Scraper?

News Article Scraper is a straightforward a simple yet powerful tool to extract news articles from a variety of popular news websites.

Supported websites

• The Verge
• CNET
• Wired
• TechCrunch
• Ars Technica
• ..more coming soon

Note: Scraper scrape articles based on UTC date.

Input sample

1{
2    "source": "",
3    "maxRecords": 1,
4    "proxy": {
5        "useApifyProxy": true,
6        "apifyProxyGroups": [],
7        "apifyProxyCountry": "US"
8    },
9    "startDate": "2024-06-21",
10    "endDate": "2024-07-22",
11    "maxConcurrency": 5,
12    "maxRequestsPerMinute": 20
13}

Output sample

1{
2    "source": "TheVerge",
3	"title": "Persona director says making beautiful menus is ‘actually really annoying’",
4	"author": [
5		"Andrew Webster"
6	],
7	"lang": "en",
8	"content": "<div id=\"readability-page-1\" class=\"page\"><div><p><em>Persona</em> is one of the rare video game series where people actually talk about the menus. They’re functional, sure, but they’re also so incredibly stylish that you almost don’t mind constantly pausing to equip gear or heal your party. So when I had the chance to talk to longtime<em> Persona</em> director Katsura Hashino about his new game, <em>Metaphor: ReFantazio</em>, which continues this tradition of beautiful menus, I had to ask how they do it.</p><p>The answer, as Hashino explains it, is simply a lot of work:</p><div><blockquote><p>In general, the way most game developers make UI is very simple. That’s what we try to do as well — we try to keep things simple, practical, and usable. But maybe the reason that we’ve achieved both ...more",
9	"textContext": "Persona is one of the rare video game series where people actually talk about the menus. They’re functional, sure, but they’re also so incredibly stylish that you almost don’t mind constantly pausing to equip gear or heal your party. So when I had the chance to talk to longtime Persona director Katsura Hashino about his new game, Metaphor: ReFantazio, which continues this tradition of beautiful ...more",
10	"length": 1848,
11	"excerpt": "‘It takes a lot of time,’ Katsura Hashino explains ahead of the launch of Metaphor: ReFantazio.",
12	"rawPublishedTime": "",
13	"publishedTime": "2024-10-07T14:30:00.000Z",
14	"indexedTime": "2024-10-07T14:30:00.000Z",
15	"image": "https://duet-cdn.vox-cdn.com/thumbor/0x0:3840x2160/2400x1600/filters:focal(1920x1080:1921x1081):format(webp)/cdn.vox-cdn.com/uploads/chorus_asset/file/25658719/ss_6956a6d6ff1745101aa0cd4a8445ff2d19853bfa.jpg",
16	"tag": [
17		"gaming",
18		"entertainment",
19		"tech"
20	],
21	"topic": [
22		"gaming",
23		"entertainment",
24		"tech"
25	],
26	"url": "https://www.theverge.com/2024/10/7/24262357/persona-metaphor-menu-design",
27	"category": []
28}

Have any question?

Please feel free to raise an issue in the actor's issue page.

Note: For a given date range in query, the scrapers scrapes articles based on the order they are listed/indexed on the source website. This is an important point to note because, for some sources e.g. CNET, the order they are listed doesn't necessary match the order they were published which for some reason doesn't tally.