Pay $3.00 for 1,000 articles

Fast News Scraper

timgreen/fast-news-scraper

Pay $3.00 for 1,000 articles

Extract full article text and metadata from popular news sites like The New York Times, Bloomberg, Reuters, BBC, CNBC, and Wired. Scrape thousands of articles in just a few minutes. Scape a single site or provide a list of article URLs to scrape.

Back to issues Create new issue

Using specific website

Open

Intellicon opened this issue

An error shows whenever I try to use the "search by URL" part as a way to circumvent my earlier issue.

This is the link I am trying it to access: https://www.wired.com/

Here is my log: 2024-07-18T06:25:43.163Z ACTOR: Pulling Docker image of build d0DmsxfYtWaVJGb6I from repository. 2024-07-18T06:25:45.912Z ACTOR: Creating Docker container. 2024-07-18T06:25:46.417Z ACTOR: Starting Docker container. 2024-07-18T06:25:48.731Z INFO System info {"apifyVersion":"3.2.0","apifyClientVersion":"2.9.3","crawleeVersion":"3.9.2","osType":"Linux","nodeVersion":"v20.14.0"} 2024-07-18T06:25:49.981Z INFO Scraping provided list of articleURLs. Ignoring other inputs... 2024-07-18T06:25:51.653Z node:internal/url:797 2024-07-18T06:25:53.934Z this.#updateContext(bindingUrl.parse(input, base)); 2024-07-18T06:25:53.978Z ^ 2024-07-18T06:25:53.983Z 2024-07-18T06:25:53.986Z TypeError: Invalid URL 2024-07-18T06:25:53.992Z at new URL (node:internal/url:797:36) 2024-07-18T06:25:53.993Z at file:///usr/src/app/src/main.js:137:17 2024-07-18T06:25:54.015Z at Array.map () 2024-07-18T06:25:54.017Z at file:///usr/src/app/src/main.js:136:33 2024-07-18T06:25:54.018Z at process.processTicksAndRejections (node:internal/process/task_queues:95:5) { 2024-07-18T06:25:54.019Z code: 'ERR_INVALID_URL', 2024-07-18T06:25:54.020Z input: '[object Object]' 2024-07-18T06:25:54.021Z } 2024-07-18T06:25:54.021Z 2024-07-18T06:25:54.022Z Node.js v20.14.0

Tim Green (timgreen)

There was a bug that's now fixed related to individual URLs. However, this feature is meant to scrape individual article URLs, so entering the base url won't work. See my comment on your other issue for next steps.

Add comment

Developer

Tim Green

Actor Metrics

35 monthly users
6 stars
>99% runs succeeded
14 days response time
Created in May 2024
Modified 5 months ago

Categories

News

Fast Google News Scraper

aymorato/fast-google-news-scraper

Extract details from Google News articles, such as images, titles, links, and other relevant information.

Alwin Morato

Super Fast Google News Scraper (pay per result)

aymorato/super-fast-google-news-scraper-pay-per-result

Experience the fast and efficient Google News scraper! It can extract a large amount of items in seconds and requires only 256 MB of RAM to run.

Alwin Morato

172

Super Fast Google News Scraper

aymorato/super-fast-google-news-scraper

Experience the fast and efficient Google News scraper! It can extract a large amount of items in seconds and requires only 256 MB of RAM to run.

Alwin Morato

Instagram Reel Scraper

apify/instagram-reel-scraper

Scrape data from Instagram reels. Just add one or more Instagram usernames and get your data in seconds including hashtags, mentions, comments, images, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

4.7k

117

DuckDuckGo Scraper

epctex/duckduckgo-scraper

Search anything from DuckDuckGo without any limits! Get images, videos, news, or search results from DuckDuckGo right away! Extremely fast, unlimited usage. Adjust your results by region or safety modes. Export your data by XML, JSON, CSV, Excel, or HTML!

epctex

116

Tweet Scraper 2024 | $0.25/1000 Tweets | Pay-Per-Result API

kaitoeasyapi/twitter-x-data-tweet-scraper-pay-per-result-cheapest

Only $0.25/1000 tweets for Twitter scraping, 100% reliability, swift data retrieval.This incredible low price is almost too good to be true.Thanks to our large-scale operations and efficient servers, we can offer you rock-bottom prices that no competitors can match. Don't miss this opportunity !

Kaito Easy API

261

Newsweek Scraper

epctex/newsweek-scraper

Scrape the latest articles right away from Newsweek. Retrieve your news directly with the information of title, body, published time, updated time, keywords, images, videos, and many more! Get your data with JSON, XML, Excel, CSV, or many other options. Extremely fast, optimized, and with no limits!

epctex

[New] Fast Airbnb Scraper

tri_angle/new-fast-airbnb-scraper

Scrape destinations on Airbnb. Extract places and their prices, ratings, reviews counts, images and other details. Download scraped data in various formats including HTML, JSON and Excel.

Tri⟁angle

204

(New) Reddit Scraper Pro - Fast, Affordable, Supported

harshmaur/reddit-scraper-pro

Reddit Scraper Pro is a powerful, user-friendly tool for extracting data from Reddit without API limitations. Offers scraping of posts, users, comments, and communities, advanced search capabilities, and multiple export options. Perfect for brand monitoring, trend tracking, and competitor research.