2 hours trial then $10.00/month - No credit card required now

Kafka Integration

brasil-scrapers/kafka-integration

2 hours trial then $10.00/month - No credit card required now

This integration facilitates the processing of data from an Apify dataset and its delivery to a Kafka topic. It is configured via a schema that includes details about the dataset, Kafka configuration, and batch processing size.

You can access the Kafka Integration programmatically from your own applications by using the Apify API. You can choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

1echo '{
2  "kafkaConfig": {
3    "clientId": "apify-kafka-producer",
4    "brokers": [
5      "localhost:9092"
6    ],
7    "topic": "test-topic",
8    "ssl": false
9  }
10}' |
11apify call brasil-scrapers/kafka-integration --silent --output-dataset

Kafka Integration API through CLI

The Apify CLI is the official tool that allows you to use Kafka Integration locally, providing convenience functions and automatic retries on errors.

Install the Apify CLI

1npm i -g apify-cli
2apify login

Other API clients include:

Kafka Integration API in Python

Kafka Integration API in JavaScript

Kafka Integration API

Developer

Brasil Scrapers

Actor Metrics

1 monthly user
1 star
Created in Nov 2024
Modified a month ago

Categories

Integrations

Automation

🔥 LinkedIn Jobs Scraper

bebity/linkedin-jobs-scraper

ℹ️ Designed for both personal and professional use, simply enter your desired job title and location to receive a tailored list of job opportunities. Try it today!

Bebity

4.6k

103

Traffic Generator (Youtube, Web, Etsy, Behance and many more!)

epctex/traffic-generator

Maximize your website's performance and visibility with our Traffic Generator. Drive targeted traffic, simulate page views, and stress-test against potential threats. With the power to generate millions of visits, it's the ultimate solution for boosting your online presence.

epctex

26.4k

198

Download HTML from URLs

mtrunkat/url-list-download-html

This actor takes a list of URLs and downloads HTML of each page.

Marek Trunkát

8.2k

Instagram Followers Count Scraper

apify/instagram-followers-count-scraper

Scrape the number of followers & follows from any Instagram profile. Schedule the scraper to run regularly to monitor how the numbers change. You can also export scraped data, run the scraper via API, monitor runs or integrate with other tools.

Apify

3.2k

Youtube Video Downloader

epctex/youtube-video-downloader

Effortlessly download YouTube videos of your preferred quality with our user-friendly Video Downloader. Try it now!

epctex

521

Autotrader Canada

fayoussef/autotrader-canada

Our autotrader.ca scraper effortlessly gathers URLs from all pages and extracts detailed information from each listing card.

youssef farhan

Github Users Scraper

dtrungtin/github-users-scraper

Github Users Scraper is an Apify actor for extracting users or emails from Github. It allows you to extract all watchers, stargazers, and members from a repository page.

Tin Duong

178

Pinecone Integration

apify/pinecone-integration

This integration transfers data from Apify Actors to a Pinecone and is a good starting point for a question-answering, search, or RAG use case.

Apify

120

Rightmove Scraper

dhrumil/rightmove-scraper

Scrape rightmove.co.uk to crawl millions of sale/rent real estate properties from United Kingdom. Our real estate scraper also lets you monitor specific listing for new updates/listing. You can provide multiple search result listings to scrape/monitor.