3 days trial then $15.00/month - No credit card required now

Articles Extractor

web.harvester/articles-extractor

3 days trial then $15.00/month - No credit card required now

A fast and powerful tool for extracting article data from URLs. It uses advanced scraping techniques to parse HTML and extract relevant information such as the article title, author, publication date, and content. Download your data in any format (JSON, CSV, XML, RSS, HTML Table).

Back to issues Create new issue

Some valid article content not being scraped

Open

releasd opened this issue

In this article the last two paragraphs of text are not extracted: https://www.sussexexpress.co.uk/news/people/father-and-daughter-team-up-at-bellway-development-in-crawley-4379088

The extracted text ends with "£455,000 and £605,000 respectively."

The following two paragraphs are missed:

"To find out more about the development, visit https://www.bellway.co.uk/new-homes/south-london/riverbrook-place or call the sales team on 01293 306782.

To find out more about careers with Bellway, visit https://www.bellwaycareers.co.uk/."

Why would this text not be scraped?

Thanks

Add comment

Developer

Web Harvester

Actor Metrics

26 monthly users
10 stars
>99% runs succeeded
Created in Jun 2023
Modified a month ago

Categories

News

SEO tools

Smart Article Extractor

lukaskrivka/article-extractor-smart

📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.

Lukáš Křivka

4.1k

Article Text Extractor

mtrunkat/article-text-extractor

Simply extracts article texts and other meta info from the given URL. Uses https://github.com/ageitgey/node-unfluff which is a NodeJS implementation of https://github.com/grangier/python-goose.

Marek Trunkát

930

Test Youtube Structured Transcript Extractor

karamelo/test-youtube-structured-transcript-extractor

Extract YouTube transcripts instantly. Save time & effort . Get accurate structured transcripts or captions in seconds. Export in various formats,, JSON, XML, HTML, CSV, EXCEL... Boost your productivity!

karamelo

130

Allrecipes Advanced Scraper

epctex/allrecipes-advanced-scraper

Advanced scraping on Allrecipes for data on millions of recipes, articles, galleries, and many more. Crawl Recipes and extract descriptions, images, steps, ingredients, nutrition, and all other properties. You can specify search terms, filters, mappings, and much more.

epctex

Tasty Scraper

epctex/tasty-scraper

Gather data on millions of recipes, articles, and compilations. Extract descriptions, images, ingredients, videos, and more. Customize your searches with filters for targeted results.

epctex

New York Times Scraper

theo/new-york-times-scraper

Scrape news data from nytimes.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis

149

Fox News Scraper

hanatsai/fox-news-scraper

Scrape news data from foxnews.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Hana Tsai

103

CNBC Scraper

maria.f/cnbc-scraper

Scrape news data from cnbc.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Mariachiara Faraon

Forbes Scraper

natasha.lekh/forbes-scraper

Scrape news data from forbes.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Natasha Lekh

AP News Scraper

theo/ap-news-scraper

Scrape news data from apnews.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis