Collect news article headlines and dates from a news site

Created by

Rowcraft

Actor

Structured Data Extractor: JSON-LD, Schema.org, Open Graph

Start from the home page of a public technology news site and let the actor follow its sitemap and internal links, within robots.txt rules, up to twelve pages. Only pages with structured data are delivered: headline, publication and modification date, publisher, breadcrumb and whether the article markup passes the Google minimum. Change the site or the page limit.

Try for free

Structured Data Extractor: JSON-LD, Schema.org, Open Graphrowcraft/structured-data-extractor

Address that was requested

Headline of the first Article, NewsArticle or BlogPosting found (the author is never read)

Publication date exactly as written in the page (usually ISO 8601)

Last modification date exactly as written in the page

+6 fields

Input

Pages or websites(required):https://techcrunch.com/

Add more pages of the same site:true

Maximum pages per site:12

Deliver only pages that have structured data:true

Output fields

Address that was requested

Headline of the first Article, NewsArticle or BlogPosting found (the author is never read)

Publication date exactly as written in the page (usually ISO 8601)

Last modification date exactly as written in the page

Name of the first Event found (any Event subtype)

Start date of that event exactly as written in the page

Place of that event as text: place name, city and country; never a street address

Breadcrumb trail in position order, joined with " > "

Number of questions in FAQPage markup (0 when none)

Number of steps in HowTo markup, sections included (0 when none)

How it works

Sign up on Apify or log in

The Structured Data Extractor: JSON-LD, Schema.org, Open Graph Actor is ready to run with the inputs already set for "Collect news article headlines and dates from a news site". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "Collect news article headlines and dates from a news site" task

The Structured Data Extractor: JSON-LD, Schema.org, Open Graph Actor will start running based on the input automatically. You can also change all the input fields, like pages or websites, add more pages of the same site, and more, to match your specific use case.

Receive the "Collect news article headlines and dates from a news site" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as address that was requested, headline of the first article, newsarticle or blogposting found (the author is never read), publication date exactly as written in the page (usually iso 8601), and more.