3 days trial then $15.00/month - No credit card required now

Articles Extractor

web.harvester/articles-extractor

3 days trial then $15.00/month - No credit card required now

A fast and powerful tool for extracting article data from URLs. It uses advanced scraping techniques to parse HTML and extract relevant information such as the article title, author, publication date, and content. Download your data in any format (JSON, CSV, XML, RSS, HTML Table).

Back to issues Create new issue

Some valid article content not being scraped

Open

releasd opened this issue

In this article the last two paragraphs of text are not extracted: https://www.sussexexpress.co.uk/news/people/father-and-daughter-team-up-at-bellway-development-in-crawley-4379088

The extracted text ends with "£455,000 and £605,000 respectively."

The following two paragraphs are missed:

"To find out more about the development, visit https://www.bellway.co.uk/new-homes/south-london/riverbrook-place or call the sales team on 01293 306782.

To find out more about careers with Bellway, visit https://www.bellwaycareers.co.uk/."

Why would this text not be scraped?

Thanks

Add comment

Developer

Web Harvester

Actor metrics

34 monthly users
4 stars
100.0% runs succeeded
8.1 hours response time
Created in Jun 2023
Modified about 1 month ago

Categories

News

SEO tools

Smart Article Extractor

lukaskrivka/article-extractor-smart

📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.

Lukáš Křivka

3.6k

Fox News Scraper

hanatsai/fox-news-scraper

Scrape news data from foxnews.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Hana Tsai

BBC Scraper

theo/bbc-scraper

Scrape news data from bbc.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis

Newsweek Scraper

mtrunkatova/newsweek-scraper

Scrape news data from newsweek.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Markéta Trunkátová

Article Text Extractor

mtrunkat/article-text-extractor

Simply extracts article texts and other meta info from the given URL. Uses https://github.com/ageitgey/node-unfluff which is a NodeJS implementation of https://github.com/grangier/python-goose.

Marek Trunkát

858

New York Times Scraper

theo/new-york-times-scraper

Scrape news data from nytimes.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis

138

Washington Post Scraper

theo/washington-post-scraper

Scrape news data from washingtonpost.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis

CNBC Scraper

maria.f/cnbc-scraper

Scrape news data from cnbc.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Mariachiara Faraon

AP News Scraper

theo/ap-news-scraper

Scrape news data from apnews.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis