# RSS to JSONL Publisher (`junipr/rss-to-jsonl-publisher`) Actor

Convert RSS and Atom feeds into normalized JSONL-style dataset rows with item metadata, deduplication, enclosures, content hashes, feed metadata, and optional incremental state.

- **URL**: https://apify.com/junipr/rss-to-jsonl-publisher.md
- **Developed by:** [junipr](https://apify.com/junipr) (community)
- **Categories:** SEO tools, Developer tools
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $3.90 / 1,000 record profileds

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

## RSS to JSONL Publisher

### Store Positioning

**Store title:** RSS to JSONL Publisher

**Short description:** Convert RSS and Atom feeds into normalized JSONL-style dataset rows with item metadata, deduplication, enclosures, content hashes, feed metadata, and optional incremental state.

**SEO title:** RSS to JSONL Publisher — data QA, validation, and cleanup utility

**SEO description:** Convert RSS and Atom feeds into normalized JSONL-style dataset rows with item metadata, deduplication, enclosures, content hashes, feed metadata, and optional incremental state. Use it to validate rows, schemas, duplicates, field quality, and delivery-readiness before handing data to clients or automations.

**Categories:** SEO\_TOOLS, DEVELOPER\_TOOLS

**Keywords:** rss, jsonl, publisher, data qa, dataset qa, data/schema qa utility

### Pay-Per-Event Pricing

This actor uses pay-per-event pricing. Event prices include Apify platform usage; users are not expected to pay a separate platform-usage pass-through charge for the configured pricing model.

- Tier: U2 — Data/schema QA utility
- Primary event: `record-profiled` at $0.00390 base
- Default max charge: $5.00
- Store discounts: FREE/BRONZE base, SILVER discounted, GOLD deepest approved discount

Event set:

- `actor-start`: base $0.00500, GOLD $0.00400. RSS To Jsonl Publisher: charged when actor start is completed. The price includes Apify platform usage; no separate usage pass-through is intended.
- `record-profiled`: base $0.00390, GOLD $0.00312. RSS To Jsonl Publisher: charged when record profiled is completed. The price includes Apify platform usage; no separate usage pass-through is intended.
- `issue-detected`: base $0.00372, GOLD $0.00298. RSS To Jsonl Publisher: charged when issue detected is completed. The price includes Apify platform usage; no separate usage pass-through is intended.
- `qa-report-generated`: base $0.05000, GOLD $0.04000. RSS To Jsonl Publisher: charged when qa report generated is completed. The price includes Apify platform usage; no separate usage pass-through is intended.

The actor accepts `actor-start` before work, accepts the primary event before each dataset row, and accepts the configured report event before writing report files. If `maxChargeUsd` or the live PPE limit blocks a charge, the corresponding row or report is not written.

### Public Task Concepts

- Audit RSS to JSONL Publisher controls on a capped public sample
- Find high-priority RSS to JSONL Publisher issues before release
- Validate RSS to JSONL Publisher evidence from supplied pages
- Prioritize RSS to JSONL Publisher fixes with severity and proof
- Export RSS to JSONL Publisher QA rows for client review

Convert RSS and Atom feeds into normalized JSONL-style dataset rows with item metadata, deduplication, enclosures, content hashes, feed metadata, and optional incremental state.

### What it does

- Accept RSS/Atom feed URLs or raw feed XML.
- Parse feed-level metadata and item-level metadata.
- Normalize title, link, GUID/ID, published date, updated date, author, categories, summary, content, enclosures, media URLs, and source feed fields.
- Deduplicate by GUID, link, title/date, or content hash.
- Support since-date filters, max item caps, incremental state keys, and KVS JSONL export.
- Generate feed health and conversion reports.

### What it does not do

- No article body scraping beyond feed-provided content.
- No copyright circumvention, feed hosting unless output is explicitly saved, spam posting, paywalled bypass, or guarantee of complete publisher content.

### Input fields

Primary inputs from the locked actor spec: `feedUrls`, `rawFeedXmlInputs`, `sinceDate`, `untilDate`, `max sample wrapper keyPerFeed`, `deduplicateBy`, `includeEnclosures`, `includeContentHtml`, `stripHtmlToText`, `outputJsonlToKvs`, `stateKey`, `requestDelayMs`, `timeoutMs`. `maxChargeUsd` keeps runs capped during production use.

### Output fields

Dataset rows include: `feedUrl`, `feedTitle`, `feedDescription`, `feedLanguage`, `itemId`, `itemTitle`, `itemLink`, `publishedAt`, `updatedAt`, `author`, `categories`, `summaryText`, `contentHtml`, `contentText`, `enclosureUrls`, `mediaUrls`, `contentHash`, `isDuplicate`, `warning`.

### Starter example

Use `examples/input.tiny.json` as a small starter input. Keep the first run capped and review the dataset before increasing limits.

### Public task examples

- Run RSS to JSONL Publisher on supplied sample data: Run RSS to JSONL Publisher on supplied sample data using a small bounded input.
- Generate a RSS to JSONL Publisher QA report: Generate a RSS to JSONL Publisher QA report using a small bounded input.
- Find invalid rows with RSS to JSONL Publisher: Find invalid rows with RSS to JSONL Publisher using a small bounded input.
- Create a capped local endpoint readiness check for RSS to JSONL Publisher: Create a capped local endpoint readiness check for RSS to JSONL Publisher using a small bounded input.
- Prepare RSS to JSONL Publisher output for downstream automation: Prepare RSS to JSONL Publisher output for downstream automation using a small bounded input.

### Public source provenance

The starter input converts three items from GitHub Blog's public RSS feed at `https://github.blog/feed/` into normalized rows and JSONL output.

### Reports

- `rss-to-jsonl-report.md`
- `rss-feed-metadata.json`
- `rss-items.jsonl`
- `duplicate-items.json`
- `feed-errors.json`

### Limitations and safe use

Start with supplied-input runs, then enable live endpoints only with tight caps, domain allowlists, and no secrets in public examples.

# Actor input Schema

## `feedUrls` (type: `array`):

Public feed URLs to fetch or inspect for RSS to JSONL Publisher.

## `rawFeedXmlInputs` (type: `array`):

Optional supplied feed XML documents to parse without fetching remote URLs.

## `sinceDate` (type: `string`):

Since Date controls RSS to JSONL Publisher processing for the supplied inputs; keep values conservative for first runs.

## `untilDate` (type: `string`):

Until Date controls RSS to JSONL Publisher processing for the supplied inputs; keep values conservative for first runs.

## `maxItemsPerFeed` (type: `number`):

Maximum items per feed to process in one run; keep defaults low for safe first runs.

## `deduplicateBy` (type: `string`):

Deduplicate By controls RSS to JSONL Publisher processing for the supplied inputs; keep values conservative for first runs.

## `includeEnclosures` (type: `boolean`):

Include enclosures in output rows or reports when available.

## `includeContentHtml` (type: `boolean`):

Include content HTML in output rows or reports when available.

## `stripHtmlToText` (type: `boolean`):

Supplied strip HTML to text to analyze directly.

## `outputJsonlToKvs` (type: `boolean`):

Output option controlling how RSS to JSONL Publisher writes results or reports.

## `stateKey` (type: `string`):

State Key controls RSS to JSONL Publisher processing for the supplied inputs; keep values conservative for first runs.

## `requestDelayMs` (type: `number`):

Request Delay ms controls RSS to JSONL Publisher processing for the supplied inputs; keep values conservative for first runs.

## `timeoutMs` (type: `number`):

Maximum time in milliseconds allowed for the RSS to JSONL Publisher operation before it is treated as timed out.

## `maxChargeUsd` (type: `number`):

Maximum estimated PPE charge allowed for the run before the actor stops gracefully.

## Actor input object example

```json
{
  "feedUrls": [
    "https://github.blog/feed/"
  ],
  "rawFeedXmlInputs": [],
  "sinceDate": "",
  "untilDate": "",
  "maxItemsPerFeed": 3,
  "deduplicateBy": "guid",
  "includeEnclosures": true,
  "includeContentHtml": true,
  "stripHtmlToText": true,
  "outputJsonlToKvs": true,
  "stateKey": "",
  "requestDelayMs": 0,
  "timeoutMs": 15000,
  "maxChargeUsd": 1
}
```

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {};

// Run the Actor and wait for it to finish
const run = await client.actor("junipr/rss-to-jsonl-publisher").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {}

# Run the Actor and wait for it to finish
run = client.actor("junipr/rss-to-jsonl-publisher").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{}' |
apify call junipr/rss-to-jsonl-publisher --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,junipr/rss-to-jsonl-publisher"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/1cM4KoKW2U3ojFMBr/builds/LOGm0ATcpArfhgozv/openapi.json