MarketWatch Scraper

MarketWatch (marketwatch.com) is a US financial news and market media website. This actor collects structured article data from MarketWatch search pages and story detail pages.

Introduction

The MarketWatch scraper starts from search or article URLs, collects article detail links from search results, continues through additional result pages when applicable, and extracts structured article data such as title, summary, authors, publication dates, keywords, article body, and paragraphs.

Use Cases

• News monitoring: Track new MarketWatch coverage for specific keywords, topics, or sectors.
• Financial research: Build structured article datasets for market sentiment and editorial trend analysis.
• Content intelligence: Monitor article metadata, authors, categories, and update timestamps over time.
• Analytics pipelines: Feed downstream warehousing, BI tools, or NLP workflows with normalized article data.

Input

Provide the following fields:

• startUrls (array, required): MarketWatch search URLs or story URLs.
• maxItems (integer, optional): Maximum number of article items to extract per original URL.
• proxyConfiguration (object, optional): Apify proxy settings.

Notes:

• If a startUrl is a search URL, the actor collects article links from the first page and additional result pages until maxItems is reached or no more results are found.
• If a startUrl is a story URL, the actor extracts that article directly.
• Crawling stops per source URL when maxItems is reached.
• It is highly recommended to use a US residential proxy for better stability and access consistency.
• Proxies are recommended for stability on larger runs.

Input Examples

1) Start URLs

{
  "startUrls": [
    {
      "url": "https://www.marketwatch.com/search?q=gold&ts=0&tab=All%20News"
    },
    {
      "url": "https://www.marketwatch.com/story/think-the-rally-is-safe-this-elite-market-timing-indicator-says-a-correction-is-overdue-8049c27f?mod=search_headline"
    }
  ],
  "maxItems": 10,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}

Output

Each dataset item contains fields like:

{
  "url": "https://www.marketwatch.com/story/think-the-rally-is-safe-this-elite-market-timing-indicator-says-a-correction-is-overdue-8049c27f?mod=search_headline",
  "title": "Think the rally is safe? This elite market-timing indicator says a correction is overdue.",
  "headline": "Think the rally is safe? This elite market-timing indicator says a correction is overdue.",
  "summary": "The gold-platinum ratio suggests the stock market is living on borrowed time",
  "description": "The gold-platinum ratio suggests the stock market is living on borrowed time.",
  "section": "Investing",
  "authors": ["Mark Hulbert"],
  "publishedAt": "2026-04-17T12:05:00.000Z",
  "updatedAt": "2026-04-18T00:48:00.000Z",
  "imageUrl": "https://images.mktw.net/im-31076220/social",
  "keywords": ["gold", "platinum", "stockmarket", "investing"],
  "articleBody": "The U.S. stock market’s prospects continue to deteriorate... ",
  "paragraphs": [
    "The U.S. stock market’s prospects continue to deteriorate, according to the gold-platinum ratio...",
    "I say “continue” because the ratio of gold..."
  ]
}

The scraper paginates through MarketWatch search results and stops when maxItems is reached per start URL or when no more article result items are found.

Why use the MarketWatch Scraper?

• Focused: Built specifically for MarketWatch search and article flows.
• Structured output: Ready-to-use JSON article records for automation and analysis.
• Per-URL limits: maxItems is enforced per start URL.
• Flexible input: Supports both search URLs and direct story URLs.
• Apify-native: Works with Apify datasets, request queue, and proxy config.

FAQ

• How many articles can it extract?
  Controlled by maxItems per source URL.

• Does it paginate search results?
  Yes. It collects the initial search page and continues through additional result pages until the limit is reached or no more results are returned.

• Can I start from a direct article URL?
  Yes. Story URLs are supported and will be scraped directly.

• Do I need proxies?
  Not always, but proxies are recommended for larger runs and better stability.

• What if MarketWatch changes their website structure?
  The actor may require selector or extraction updates to remain stable.

Need to scrape other news or finance platforms?

Check out our other scrapers:

• Construction Dive Scraper - Scrape news articles and press releases with structured metadata, authors, and article content.
• Ynet.co.il Scraper - Extract headlines, summaries, authors, and metadata from a major news publisher.
• ElEspanol.com Scraper - Scrape article pages, headlines, authors, publish dates, and article body content from a major digital newspaper.

---

Need help or want a custom solution?

Lexis Solutions is a certified Apify Partner. We can help with custom data extraction projects.

Contact us over Email or LinkedIn.

Support Our Work

If you're happy with our work and scrapers, you're welcome to leave us a company review here and leave a review for the scrapers you're subscribed to.

Image Credit

Image credit: marketwatch.com.