Pay $3.00 for 1,000 articles

Fast News Scraper

timgreen/fast-news-scraper

Pay $3.00 for 1,000 articles

Extract full article text and metadata from popular news sites like The New York Times, Bloomberg, Reuters, BBC, CNBC, and Wired. Scrape thousands of articles in just a few minutes. Scape a single site or provide a list of article URLs to scrape.

Back to issues Create new issue

Using specific website

Open

Intellicon opened this issue

An error shows whenever I try to use the "search by URL" part as a way to circumvent my earlier issue.

This is the link I am trying it to access: https://www.wired.com/

Here is my log: 2024-07-18T06:25:43.163Z ACTOR: Pulling Docker image of build d0DmsxfYtWaVJGb6I from repository. 2024-07-18T06:25:45.912Z ACTOR: Creating Docker container. 2024-07-18T06:25:46.417Z ACTOR: Starting Docker container. 2024-07-18T06:25:48.731Z INFO System info {"apifyVersion":"3.2.0","apifyClientVersion":"2.9.3","crawleeVersion":"3.9.2","osType":"Linux","nodeVersion":"v20.14.0"} 2024-07-18T06:25:49.981Z INFO Scraping provided list of articleURLs. Ignoring other inputs... 2024-07-18T06:25:51.653Z node:internal/url:797 2024-07-18T06:25:53.934Z this.#updateContext(bindingUrl.parse(input, base)); 2024-07-18T06:25:53.978Z ^ 2024-07-18T06:25:53.983Z 2024-07-18T06:25:53.986Z TypeError: Invalid URL 2024-07-18T06:25:53.992Z at new URL (node:internal/url:797:36) 2024-07-18T06:25:53.993Z at file:///usr/src/app/src/main.js:137:17 2024-07-18T06:25:54.015Z at Array.map () 2024-07-18T06:25:54.017Z at file:///usr/src/app/src/main.js:136:33 2024-07-18T06:25:54.018Z at process.processTicksAndRejections (node:internal/process/task_queues:95:5) { 2024-07-18T06:25:54.019Z code: 'ERR_INVALID_URL', 2024-07-18T06:25:54.020Z input: '[object Object]' 2024-07-18T06:25:54.021Z } 2024-07-18T06:25:54.021Z 2024-07-18T06:25:54.022Z Node.js v20.14.0

Tim Green (timgreen)

There was a bug that's now fixed related to individual URLs. However, this feature is meant to scrape individual article URLs, so entering the base url won't work. See my comment on your other issue for next steps.

Add comment

Developer

Tim Green

Actor Metrics

34 monthly users
6 stars
>99% runs succeeded
12 days response time
Created in May 2024
Modified 5 months ago

Categories

News

Fast Google News Scraper

aymorato/fast-google-news-scraper

Extract details from Google News articles, such as images, titles, links, and other relevant information.

Alwin Morato

Super Fast Google News Scraper (pay per result)

aymorato/super-fast-google-news-scraper-pay-per-result

Experience the fast and efficient Google News scraper! It can extract a large amount of items in seconds and requires only 256 MB of RAM to run.

Alwin Morato

172

Super Fast Google News Scraper

aymorato/super-fast-google-news-scraper

Experience the fast and efficient Google News scraper! It can extract a large amount of items in seconds and requires only 256 MB of RAM to run.

Alwin Morato

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

21.5k

171

Reddit Scraper Lite

trudax/reddit-scraper-lite

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Gustavo Rudiger

Reddit Scraper

trudax/reddit-scraper

Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Gustavo Rudiger

DuckDuckGo Scraper

epctex/duckduckgo-scraper

Search anything from DuckDuckGo without any limits! Get images, videos, news, or search results from DuckDuckGo right away! Extremely fast, unlimited usage. Adjust your results by region or safety modes. Export your data by XML, JSON, CSV, Excel, or HTML!

epctex

116

Tweet Scraper 2024 | $0.25/1000 Tweets | Pay-Per-Result API

kaitoeasyapi/twitter-x-data-tweet-scraper-pay-per-result-cheapest

Only $0.25/1000 tweets for Twitter scraping, 100% reliability, swift data retrieval.This incredible low price is almost too good to be true.Thanks to our large-scale operations and efficient servers, we can offer you rock-bottom prices that no competitors can match. Don't miss this opportunity !

Kaito Easy API

252

Newsweek Scraper

epctex/newsweek-scraper

Scrape the latest articles right away from Newsweek. Retrieve your news directly with the information of title, body, published time, updated time, keywords, images, videos, and many more! Get your data with JSON, XML, Excel, CSV, or many other options. Extremely fast, optimized, and with no limits!

epctex

[New] Fast Airbnb Scraper

tri_angle/new-fast-airbnb-scraper

Scrape destinations on Airbnb. Extract places and their prices, ratings, reviews counts, images and other details. Download scraped data in various formats including HTML, JSON and Excel.