Pricing

from $5.00 / 1,000 results

Try for free

Go to Apify Store

Incremental Sync Engine

Try for free

Fetches JSON or HTML data from your URLs and returns only what changed since the last run: added, modified and deleted items, matched by an ID field. Use it to sync catalogs, listings or APIs into your database.

Pricing

from $5.00 / 1,000 results

Rating

0.0

(0)

Developer

Technical Dost Solutions

Actor stats

Bookmarked

Total users

Monthly active users

18 days ago

Last modified

Categories

Developer tools

Automation

Integrations

Security

You can access the Incremental Sync Engine programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "startUrls": [{ "url": "https://jsonplaceholder.typicode.com/posts" }],
10    "syncMode": "incremental",
11}
12
13# Run the Actor and wait for it to finish
14run = client.actor("technicaldost/incremental-sync-engine").call(run_input=run_input)
15
16# Fetch and print Actor results from the run's dataset (if there are any)
17print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
18for item in client.dataset(run.default_dataset_id).iterate_items():
19    print(item)
20
21# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

Incremental Sync Engine - Delta Data Sync & Dedupe API in Python

The Apify API client for Python is the official library that allows you to use Incremental Sync Engine API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Incremental Sync Engine API in JavaScript

Incremental Sync Engine API through CLI

Incremental Sync Engine OpenAPI definition

Incremental Sync Engine API

Link Preview API — Bulk OpenGraph & Metadata Unfurl

technicaldost/link-preview-api

High-volume link previews: OpenGraph, Twitter Cards, JSON-LD, titles, images, favicons, canonicals, authors, dates, language and feeds. No fixed run timeout, browser or third-party API key.

Technical Dost Solutions

Email Verifier & Validator

technicaldost/email-verifier

Bulk-verify email deliverability: syntax, MX records, disposable/role/free-provider detection, and a 0-100 deliverability score. Clean your lead lists before you send.

Technical Dost Solutions

Job Listing Aggregator

technicaldost/job-listing-aggregator

Returns tech and remote job listings from the Remotive, Himalayas and Arbeitnow job APIs: title, company, location, salary, job type, tags, posting date and apply link, deduplicated. Input: keywords and an optional location.

Technical Dost Solutions

Domain WHOIS Lookup

technicaldost/domain-whois-lookup

Look up WHOIS records for any domain: registrar, creation and expiry dates, name servers and registrant details. Bulk domain lookups exported as structured JSON.

Technical Dost Solutions

Ecommerce Price Tracker

technicaldost/ecommerce-price-tracker

Track product prices on Amazon and most online stores (Shopify, WooCommerce and other shops that publish product data). Get price, availability, seller and image, with price-change history between runs and alerts on big changes.

Technical Dost Solutions

Sitemap Change Orchestrator

tri_angle/sitemap-change-orchestrator

Monitor website sitemaps for new, updated, or removed URLs. Integration with the Website Content Crawler (WCC) allows feeding only relevant URLs. This ensures your web crawls are efficient, targeted, and resource-optimized, keeping your datasets fresh for any application.

Tri⟁angle

Government Bid Tracker

technicaldost/government-bid-tracker

Returns US federal contract opportunities from SAM.gov's public search: title, agency, sub-agency, office, notice type, solicitation number, posted date, response deadline, description and link. Input: keywords and a posting window.

Technical Dost Solutions

Event Ticket Price Monitor

technicaldost/event-ticket-price-monitor

Track ticket prices and availability for events. Paste single event pages or listing pages such as an Eventbrite city or category page; every listed event is opened. Returns event, venue, date, min/max price, currency and availability.

Technical Dost Solutions

Multi-Engine Search Scraper — Google, Bing, DuckDuckGo

maged120/search-engines-scraper

Scrape organic search results from Google, Bing, Yahoo, DuckDuckGo, and more in one run. Get titles, URLs, snippets, and source domains — no API keys needed.

Maged

WeChat Official Account Scraper → Markdown 公众号

technicaldost/wechat-article-markdown-scraper

Turn any WeChat Official Account (微信公众号) article into clean, RAG-ready Markdown with title, author, account name, publish time, cover and image URLs. No API key or WeChat account needed for article URLs; optional keyword discovery via Sogou WeChat search.

Technical Dost Solutions