Kafka Integration

Pricing

$10.00/month + usage

Kafka Integration

This integration facilitates the processing of data from an Apify dataset and its delivery to a Kafka topic. It is configured via a schema that includes details about the dataset, Kafka configuration, and batch processing size.

Pricing

$10.00/month + usage

Rating

0.0

(0)

Developer

Brasil Scrapers

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

a year ago

Last modified

Categories

Integrations

Automation

You can access the Kafka Integration programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1import { ApifyClient } from 'apify-client';
2
3// Initialize the ApifyClient with your Apify API token
4// Replace the '<YOUR_API_TOKEN>' with your token
5const client = new ApifyClient({
6    token: '<YOUR_API_TOKEN>',
7});
8
9// Prepare Actor input
10const input = {
11    "kafkaConfig": {
12        "clientId": "apify-kafka-producer",
13        "brokers": [
14            "localhost:9092"
15        ],
16        "topic": "test-topic",
17        "ssl": false
18    }
19};
20
21// Run the Actor and wait for it to finish
22const run = await client.actor("brasil-scrapers/kafka-integration").call(input);
23
24// Fetch and print Actor results from the run's dataset (if any)
25console.log('Results from dataset');
26console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
27const { items } = await client.dataset(run.defaultDatasetId).listItems();
28items.forEach((item) => {
29    console.dir(item);
30});
31
32// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

Kafka Integration API in JavaScript

The Apify API client for JavaScript is the official library that allows you to use Kafka Integration API in JavaScript or TypeScript, providing convenience functions and automatic retries on errors.

Install the apify-client

$npm install apify-client

Other API clients include:

Kafka Integration API in Python

Kafka Integration API through CLI

Kafka Integration OpenAPI definition

Kafka Integration API

RabbitMQ Integration

brasil-scrapers/rabbitmq-integration

This integration processes data from an Apify dataset and delivers it to a RabbitMQ queue. It is configured via a schema that includes details about the dataset and RabbitMQ connection settings.

Brasil Scrapers

Dataset(s) To Schema

zuzka/dataset-to-schema

Takes a Dataset ID(s) and outputs a JSON schema of the contents of the dataset into key value store.

Zuzka Pelechová

5.0

Validate Dataset(s) with JSON Schema

jaroslavhejlek/validate-dataset-with-json-schema

This Actor validates items in one or more datasets against a provided JSON Schema. Use it if you planning to add a dataset validation schema to your actor and you want test it.

Jaroslav Hejlek

Dataset Download

idiatech/apify-Dataset-Download

Download any dataset from the Apify platform automatically and in any format you want. Use this actor along with a Dataset toolbox automation tool.

idIA Tech

Monitoring Checker Schema

apify/monitoring-checker-schema

The monitoring checker schema is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

4.8

Booking Scraper

runtime/booking-scraper

This Apify actor scrapes hotel data from Booking.com. It supports robust navigation, proxy configuration, batch processing, and flexible extraction limits.

scraping automation

4.3

YouTube Description Extractor 📝

easyapi/youtube-description-extractor

Extract complete descriptions from YouTube videos automatically. Perfect for content analysis, SEO research, and marketing insights. Supports batch processing with proxy integration for reliable results. 🎥 📝

EasyApi

5.0

Dataset Query Engine

jiri.spilka/dataset-query-engine

Use natural language queries to retrieve results from an Apify dataset. This Actor provides a query engine that loads a dataset, executes SQL queries, and synthesizes results.

Jiří Spilka

4.7

random-data-generator

limitless_moccasin/random-data-generator

This actor generates random rows of test data. Each row includes an ID, a random name, a numeric value, and an active flag. The number of rows to generate can be configured through the actor input. It is useful for testing workflows, pipelines, or integrations that consume dataset outputs.

chimu

Forward dataset as POST data

anchor/forward-dataset-webhook

This actor forwards the results of an Actor to an endpoint, instead of having to fetch the results manually. It will download the dataset and attach it to the body of a POST request you will specify. It acts as a new webhook. Simplify your Actor process !!!