7 days trial then $20.00/month - No credit card required now

The Sun Scraper

hanatsai/the-sun-scraper

7 days trial then $20.00/month - No credit card required now

Scrape news data from the-sun.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Start URLs

startUrlsarrayRequired

Can be main page URL or any category URLs. Article pages are found and enqueued from these.

Maximum number of articles

maxArticlesPerCrawlintegerOptional

Maximum number of valid articles scraped. The crawler will stop automatically after reaching this number.

Date from

dateFromstringOptional

Only articles from this day to present will be scraped. If empty, all articles will be scraped. Format is YYYY-MM-DD, e.g. 2019-12-31, or Number type e.g. 1 week or 20 days

Only new articles

onlyNewArticlesPerDomainbooleanOptional

If true, will scrape only new articles each time you run it. All URLs you scraped are compared with saved ones. Scraped articles are saved in one dataset per each domain, datasets are named 'ARTICLES-SCRAPED-domain'

Default value of this property is false

Developer

Hana Tsai

Actor Metrics

1 monthly user
2 stars
>99% runs succeeded
Created in May 2022
Modified 2 years ago

Categories

News

Spotify Play Count Scraper

beatanalytics/spotify-play-count-scraper

Scrape play counts and statistics for Spotify artists, albums, and tracks. Download scraped data as JSON or CSV, run the scraper via API, schedule and monitor runs or integrate with other tools.

Beat Analytics

Amazon Url Scraper (pay by request)

sellez/amazon-url-scraper-pay-by-request

The **Amazon Product Scraper** extracts detailed product information from Amazon listings, such as pricing, descriptions, reviews, specifications, and media assets. This tool is ideal for e-commerce analysis, competitor research, catalog management, and market insights.

sellez

Google Trends Scraper

emastra/google-trends-scraper

Scrape data from Google Trends by search terms or URLs. Specify locations, define time ranges, select categories to get interest by subregion and over time, related queries and topics, and more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Emiliano Mastragostino

3.8k

Twitter Tweets and Profiles Scraper

web.harvester/twitter-scraper

Easily search and extract tweets from profiles or directly using a URL with our tool. Scrape tweets and replies effortlessly. Download data in formats like JSON, CSV, XML, RSS, or HTML Table, perfect for integration with various applications, databases, and social media analytics tools.

Web Harvester

2.5k

Smart Article Extractor

lukaskrivka/article-extractor-smart

📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.

Lukáš Křivka

4.2k

Reddit Scraper Lite

trudax/reddit-scraper-lite

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Gustavo Rudiger

4.1k

Dun & Bradstreet Scraper

epctex/dnb-scraper

Effortlessly extract valuable company information, financial projections, industry insights, and more from the extensive Dun & Bradstreet commercial database. Dive deep into the D&B Data Cloud, Business Directory, articles, companies, and industries with customized search terms.

epctex

1.8k

Google News Scraper

lhotanova/google-news-scraper

Gets featured articles from Google News with title, link, source, publication date and image.

Kristýna Lhoťanová

TikTok Comment API

novi/tiktok-comment-api

Unlock the power of a blazing fast TikTok Comment API. Seamlessly retrieve comments with speed and efficiency. Optimize your TikTok data analysis with this powerful tool.

Novi

273

Twitter Scraper

quacker/twitter-scraper

Scrape tweets from any Twitter user profile. Top Twitter API alternative to scrape Twitter hashtags, threads, replies, followers, images, videos, statistics, and Twitter history. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.