3 days trial then $5.00/month - No credit card required now

In Depth News Scraper

sync-network/in-depth-news-scraper

3 days trial then $5.00/month - No credit card required now

Extract full length articles from top news sources, streamlining the collection of the latest updates on any subject. Its key feature is retrieving complete content—not just headlines. Customise your output from concise summaries to complete articles, transforming your news gathering process.

You can access the In Depth News Scraper programmatically from your own applications by using the Apify API. You can choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

1{
2  "openapi": "3.0.1",
3  "info": {
4    "version": "0.0",
5    "x-build-id": "AIanS5tKCE1cQkgQT"
6  },
7  "servers": [
8    {
9      "url": "https://api.apify.com/v2"
10    }
11  ],
12  "paths": {
13    "/acts/sync-network~in-depth-news-scraper/run-sync-get-dataset-items": {
14      "post": {
15        "operationId": "run-sync-get-dataset-items-sync-network-in-depth-news-scraper",
16        "x-openai-isConsequential": false,
17        "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
18        "tags": [
19          "Run Actor"
20        ],
21        "requestBody": {
22          "required": true,
23          "content": {
24            "application/json": {
25              "schema": {
26                "$ref": "#/components/schemas/inputSchema"
27              }
28            }
29          }
30        },
31        "parameters": [
32          {
33            "name": "token",
34            "in": "query",
35            "required": true,
36            "schema": {
37              "type": "string"
38            },
39            "description": "Enter your Apify token here"
40          }
41        ],
42        "responses": {
43          "200": {
44            "description": "OK"
45          }
46        }
47      }
48    },
49    "/acts/sync-network~in-depth-news-scraper/runs": {
50      "post": {
51        "operationId": "runs-sync-sync-network-in-depth-news-scraper",
52        "x-openai-isConsequential": false,
53        "summary": "Executes an Actor and returns information about the initiated run in response.",
54        "tags": [
55          "Run Actor"
56        ],
57        "requestBody": {
58          "required": true,
59          "content": {
60            "application/json": {
61              "schema": {
62                "$ref": "#/components/schemas/inputSchema"
63              }
64            }
65          }
66        },
67        "parameters": [
68          {
69            "name": "token",
70            "in": "query",
71            "required": true,
72            "schema": {
73              "type": "string"
74            },
75            "description": "Enter your Apify token here"
76          }
77        ],
78        "responses": {
79          "200": {
80            "description": "OK",
81            "content": {
82              "application/json": {
83                "schema": {
84                  "$ref": "#/components/schemas/runsResponseSchema"
85                }
86              }
87            }
88          }
89        }
90      }
91    },
92    "/acts/sync-network~in-depth-news-scraper/run-sync": {
93      "post": {
94        "operationId": "run-sync-sync-network-in-depth-news-scraper",
95        "x-openai-isConsequential": false,
96        "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
97        "tags": [
98          "Run Actor"
99        ],
100        "requestBody": {
101          "required": true,
102          "content": {
103            "application/json": {
104              "schema": {
105                "$ref": "#/components/schemas/inputSchema"
106              }
107            }
108          }
109        },
110        "parameters": [
111          {
112            "name": "token",
113            "in": "query",
114            "required": true,
115            "schema": {
116              "type": "string"
117            },
118            "description": "Enter your Apify token here"
119          }
120        ],
121        "responses": {
122          "200": {
123            "description": "OK"
124          }
125        }
126      }
127    }
128  },
129  "components": {
130    "schemas": {
131      "inputSchema": {
132        "type": "object",
133        "required": [
134          "newsCategory"
135        ],
136        "properties": {
137          "newsCategory": {
138            "title": "News Category",
139            "enum": [
140              "World",
141              "Business",
142              "Technology",
143              "Entertainment",
144              "Health",
145              "Science",
146              "Sports",
147              "Politics"
148            ],
149            "type": "string",
150            "description": "Select a news category to filter articles (this is mandatory)",
151            "default": "World"
152          },
153          "additionalKeywords": {
154            "title": "Additional Search Keywords",
155            "type": "string",
156            "description": "Optional keywords to narrow down your search further",
157            "default": ""
158          },
159          "numberOfItems": {
160            "title": "Number of Items",
161            "minimum": 1,
162            "maximum": 100,
163            "type": "integer",
164            "description": "The number of news items to fetch (default: 1, maximum: 100)",
165            "default": 1
166          },
167          "filterBadKeywords": {
168            "title": "Filter Bad Keywords",
169            "type": "array",
170            "description": "List of keywords to filter out from results",
171            "items": {
172              "type": "string"
173            }
174          },
175          "contentLength": {
176            "title": "Content Length",
177            "enum": [
178              "Full",
179              "Summary"
180            ],
181            "type": "string",
182            "description": "Choose whether to extract the full article content or just a summary",
183            "default": "Full"
184          },
185          "timeRange": {
186            "title": "Time Range",
187            "enum": [
188              "Any time",
189              "Past hour",
190              "Past 24 hours",
191              "Past week",
192              "Past year"
193            ],
194            "type": "string",
195            "description": "Time range for news articles",
196            "default": "Any time"
197          },
198          "retrieveImage": {
199            "title": "Retrieve Image",
200            "type": "boolean",
201            "description": "Whether to retrieve image URLs for articles (may slow down the actor)",
202            "default": false
203          }
204        }
205      },
206      "runsResponseSchema": {
207        "type": "object",
208        "properties": {
209          "data": {
210            "type": "object",
211            "properties": {
212              "id": {
213                "type": "string"
214              },
215              "actId": {
216                "type": "string"
217              },
218              "userId": {
219                "type": "string"
220              },
221              "startedAt": {
222                "type": "string",
223                "format": "date-time",
224                "example": "2025-01-08T00:00:00.000Z"
225              },
226              "finishedAt": {
227                "type": "string",
228                "format": "date-time",
229                "example": "2025-01-08T00:00:00.000Z"
230              },
231              "status": {
232                "type": "string",
233                "example": "READY"
234              },
235              "meta": {
236                "type": "object",
237                "properties": {
238                  "origin": {
239                    "type": "string",
240                    "example": "API"
241                  },
242                  "userAgent": {
243                    "type": "string"
244                  }
245                }
246              },
247              "stats": {
248                "type": "object",
249                "properties": {
250                  "inputBodyLen": {
251                    "type": "integer",
252                    "example": 2000
253                  },
254                  "rebootCount": {
255                    "type": "integer",
256                    "example": 0
257                  },
258                  "restartCount": {
259                    "type": "integer",
260                    "example": 0
261                  },
262                  "resurrectCount": {
263                    "type": "integer",
264                    "example": 0
265                  },
266                  "computeUnits": {
267                    "type": "integer",
268                    "example": 0
269                  }
270                }
271              },
272              "options": {
273                "type": "object",
274                "properties": {
275                  "build": {
276                    "type": "string",
277                    "example": "latest"
278                  },
279                  "timeoutSecs": {
280                    "type": "integer",
281                    "example": 300
282                  },
283                  "memoryMbytes": {
284                    "type": "integer",
285                    "example": 1024
286                  },
287                  "diskMbytes": {
288                    "type": "integer",
289                    "example": 2048
290                  }
291                }
292              },
293              "buildId": {
294                "type": "string"
295              },
296              "defaultKeyValueStoreId": {
297                "type": "string"
298              },
299              "defaultDatasetId": {
300                "type": "string"
301              },
302              "defaultRequestQueueId": {
303                "type": "string"
304              },
305              "buildNumber": {
306                "type": "string",
307                "example": "1.0.0"
308              },
309              "containerUrl": {
310                "type": "string"
311              },
312              "usage": {
313                "type": "object",
314                "properties": {
315                  "ACTOR_COMPUTE_UNITS": {
316                    "type": "integer",
317                    "example": 0
318                  },
319                  "DATASET_READS": {
320                    "type": "integer",
321                    "example": 0
322                  },
323                  "DATASET_WRITES": {
324                    "type": "integer",
325                    "example": 0
326                  },
327                  "KEY_VALUE_STORE_READS": {
328                    "type": "integer",
329                    "example": 0
330                  },
331                  "KEY_VALUE_STORE_WRITES": {
332                    "type": "integer",
333                    "example": 1
334                  },
335                  "KEY_VALUE_STORE_LISTS": {
336                    "type": "integer",
337                    "example": 0
338                  },
339                  "REQUEST_QUEUE_READS": {
340                    "type": "integer",
341                    "example": 0
342                  },
343                  "REQUEST_QUEUE_WRITES": {
344                    "type": "integer",
345                    "example": 0
346                  },
347                  "DATA_TRANSFER_INTERNAL_GBYTES": {
348                    "type": "integer",
349                    "example": 0
350                  },
351                  "DATA_TRANSFER_EXTERNAL_GBYTES": {
352                    "type": "integer",
353                    "example": 0
354                  },
355                  "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
356                    "type": "integer",
357                    "example": 0
358                  },
359                  "PROXY_SERPS": {
360                    "type": "integer",
361                    "example": 0
362                  }
363                }
364              },
365              "usageTotalUsd": {
366                "type": "number",
367                "example": 0.00005
368              },
369              "usageUsd": {
370                "type": "object",
371                "properties": {
372                  "ACTOR_COMPUTE_UNITS": {
373                    "type": "integer",
374                    "example": 0
375                  },
376                  "DATASET_READS": {
377                    "type": "integer",
378                    "example": 0
379                  },
380                  "DATASET_WRITES": {
381                    "type": "integer",
382                    "example": 0
383                  },
384                  "KEY_VALUE_STORE_READS": {
385                    "type": "integer",
386                    "example": 0
387                  },
388                  "KEY_VALUE_STORE_WRITES": {
389                    "type": "number",
390                    "example": 0.00005
391                  },
392                  "KEY_VALUE_STORE_LISTS": {
393                    "type": "integer",
394                    "example": 0
395                  },
396                  "REQUEST_QUEUE_READS": {
397                    "type": "integer",
398                    "example": 0
399                  },
400                  "REQUEST_QUEUE_WRITES": {
401                    "type": "integer",
402                    "example": 0
403                  },
404                  "DATA_TRANSFER_INTERNAL_GBYTES": {
405                    "type": "integer",
406                    "example": 0
407                  },
408                  "DATA_TRANSFER_EXTERNAL_GBYTES": {
409                    "type": "integer",
410                    "example": 0
411                  },
412                  "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
413                    "type": "integer",
414                    "example": 0
415                  },
416                  "PROXY_SERPS": {
417                    "type": "integer",
418                    "example": 0
419                  }
420                }
421              }
422            }
423          }
424        }
425      }
426    }
427  }
428}

In Depth News Scraper OpenAPI definition

OpenAPI is a standard for designing and describing RESTful APIs, allowing developers to define API structure, endpoints, and data formats in a machine-readable way. It simplifies API development, integration, and documentation.

OpenAPI is effective when used with AI agents and GPTs by standardizing how these systems interact with various APIs, for reliable integrations and efficient communication.

By defining machine-readable API specifications, OpenAPI allows AI models like GPTs to understand and use varied data sources, improving accuracy. This accelerates development, reduces errors, and provides context-aware responses, making OpenAPI a core component for AI applications.

You can download the OpenAPI definitions for In Depth News Scraper from the options below:

OpenAPI.json

If you’d like to learn more about how OpenAPI powers GPTs, read our blog post.

You can also check out our other API clients:

In Depth News Scraper API in Python

In Depth News Scraper API in JavaScript

In Depth News Scraper API through CLI

In Depth News Scraper API

Developer

Alam

Actor Metrics

2 monthly users
2 bookmarks
>99% runs succeeded
Created in Feb 2025
Modified 17 days ago

Categories

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

apidojo/tweet-scraper

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.40 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!

API Dojo

12.1k

568

🏯 Instagram Scraper (Pay Per Result)

apidojo/instagram-scraper

Famous for its blazing-fast speed and completeness, it offers rapid and efficient scraping of many URLs such as; location, audio, tag, and profile. It's incredibly cost-effective at only $0.50 for every 1000 posts, capable of scraping 100-200 posts each second!

API Dojo

1.2k

Instagram Followers Scraper

devil_port369-owner/instagram-followers-scraper

The Instagram Followers Scraper extracts follower data from public Instagram account. Ideal for influencer marketing, audience analysis, and business intelligence. Safe API rates ensure account protection while providing valuable insights.

DataFusionX

367

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

36.8k

Twitter Tweets and Profiles Scraper

web.harvester/twitter-scraper

Easily search and extract tweets from profiles or directly using a URL with our tool. Scrape tweets and replies effortlessly. Download data in formats like JSON, CSV, XML, RSS, or HTML Table, perfect for integration with various applications, databases, and social media analytics tools.

Web Harvester

3.1k

Download HTML from URLs

mtrunkat/url-list-download-html

This actor takes a list of URLs and downloads HTML of each page.

Marek Trunkát

8.4k

Reddit Scraper Lite

trudax/reddit-scraper-lite

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Gustavo Rudiger

4.7k

Google Trends Scraper

emastra/google-trends-scraper

Scrape data from Google Trends by search terms or URLs. Specify locations, define time ranges, select categories to get interest by subregion and over time, related queries and topics, and more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Emiliano Mastragostino

Tiktok Shop Scraper

excavator/tiktok-shop-scraper

This is the Actor for crawling data from the TikTok shop product URLs. For example: https://shop.tiktok.com/view/product/XXXXXXXXXX These URLs are only available for TikTok Shop US. You can test it here: https://apify.com/excavator/tiktok-shop-product

Excavator

Easy Twitter Search Scraper

web.harvester/easy-twitter-search-scraper

Easily Scrape tweets with our Twitter Search Scraper. Export data in formats like JSON and Excel perfect for integration with various applications, databases, and data analysis tools.

Web Harvester