7 days trial then $20.00/month - No credit card required now

Politico Scraper

mtrunkatova/politico-scraper

7 days trial then $20.00/month - No credit card required now

Scrape news data from politico.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Back to issues Create new issue

Unable to limit scraping to sections

Open

API_rasmus opened this issue

Hi! Great scraper! But I am unable to limit scraping to the section of Politico that I am interested in (https://politico.eu/section/energy). Even though I have specified the section URL, the scraper collects all articles from Politico.eu. Is there any way I can achieve the more limited scraping that I need? Thanks in advance.

Add comment

Developer

Markéta Trunkátová

Actor Metrics

1 monthly user
1 star
>99% runs succeeded
Created in May 2022
Modified 2 years ago

Categories

News

Sneaker Politics Scraper

mshopik/sneaker-politics-scraper

Scrape Sneaker Politics and extract data on casual apparel from sneakerpolitics.com. Our Sneaker Politics API lets you crawl product information and pricing. The saved data can be downloaded as HTML, JSON, CSV, Excel, and XML.

Mark Carter

Reddit Scraper Lite

trudax/reddit-scraper-lite

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Gustavo Rudiger

Reddit Scraper

trudax/reddit-scraper

Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Gustavo Rudiger

Google Trends Scraper

emastra/google-trends-scraper

Scrape data from Google Trends by search terms or URLs. Specify locations, define time ranges, select categories to get interest by subregion and over time, related queries and topics, and more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Emiliano Mastragostino

3.8k

Twitter Tweets and Profiles Scraper

web.harvester/twitter-scraper

Easily search and extract tweets from profiles or directly using a URL with our tool. Scrape tweets and replies effortlessly. Download data in formats like JSON, CSV, XML, RSS, or HTML Table, perfect for integration with various applications, databases, and social media analytics tools.

Web Harvester

2.4k

Smart Article Extractor

lukaskrivka/article-extractor-smart

📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.

Lukáš Křivka

4.1k

Dun & Bradstreet Scraper

epctex/dnb-scraper

Effortlessly extract valuable company information, financial projections, industry insights, and more from the extensive Dun & Bradstreet commercial database. Dive deep into the D&B Data Cloud, Business Directory, articles, companies, and industries with customized search terms.

epctex

1.7k

Google News Scraper

lhotanova/google-news-scraper

Gets featured articles from Google News with title, link, source, publication date and image.

Kristýna Lhoťanová

TikTok Comment API

novi/tiktok-comment-api

Unlock the power of a blazing fast TikTok Comment API. Seamlessly retrieve comments with speed and efficiency. Optimize your TikTok data analysis with this powerful tool.