No credit card required

Diff Datasets

pocesar/diff-datasets

No credit card required

Take one dataset on Apify platform, compare it to another, and output the missing ones. This can also be used to output only changed items, using a compound key

Base dataset

baseDatasetIdstringRequired

This dataset ID that will serve as base and collect the unique items.

Other dataset

otherDatasetIdstringRequired

Only non-existing items from base will be ouput using this other dataset

Data fields

uniqueFieldsarrayRequired

Unique fields to create a compound key. For example, an unique ID field might not be unique, so you place two fields that make the item itself unique

Default value of this property is []

Max Buffer size

maxBufferSizeintegerOptional

How many items to buffer in memory before outputting it

Default value of this property is 20000

Developer

Paulo Cesar

Actor metrics

3 monthly users
0.0 days response time
Created in Jun 2020
Modified over 1 year ago

Categories

Automation

Content Checker

jakubbalada/content-checker

Monitor a website or web page for content changes. Automatically saves before and after screenshots and sends an email notification when content changes are detected.

Jakub Balada

AI Web Agent

apify/ai-web-agent

Use natural language prompts to browse the web, click on elements, fill and submit forms, extract data, and take screenshots using the OpenAI API.

Apify

358

Merge, Dedup & Transform Datasets

lukaskrivka/dedup-datasets

The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.

Lukáš Křivka

1.6k

Send Email

apify/send-mail

The actor automatically sends an email to a specific address. This actor is useful for notifications and reporting. With only 3 lines of javascript code, you'll be on top of your scraping actors and never miss important results or issues.

Apify

2.4k

Instagram Followers Count Scraper

apify/instagram-followers-count-scraper

Scrape the number of followers & follows from any Instagram profile. Schedule the scraper to run regularly to monitor how the numbers change. You can also export scraped data, run the scraper via API, monitor runs or integrate with other tools.

Apify

1.9k

Anti Captcha Recaptcha

petr_cermak/anti-captcha-recaptcha

🧰 Actor for solving Google reCAPTCHA using the anti-captcha.com service. You need to have an anti-captcha subscription.

Petr Cermak

1.3k

Page Scraping Analyzer

apify/page-analyzer

Performs analysis of a webpage to figure out the best way how to scrape its data. Provide a URL and data points to find and get back a detailed dashboard showing how the data can be scraped. Works with initial and rendered HTML, JavaScript variables and dynamically loaded data.

Apify

Google Sheets Import & Export

lukaskrivka/google-sheets

Import data from datasets or JSON files to Google Sheets. Programmatically process data in Sheets. Easier and faster than the official Google Sheets API and perfect for importing data from scraping.

Lukáš Křivka

854

Website Checker

lukaskrivka/website-checker

Check any website you plan to scrape for expected Compute unit consumption, anti-scraping software, and reliability.

Lukáš Křivka

727

Dataset Image Downloader & Uploader

lukaskrivka/images-download-upload

Download image files from image URLs in your datasets and save them to a Zip file, Key-Value store, or directly your AWS S3 bucket.

Lukáš Křivka

282

Dataset processing on Apify

How to deduplicate scraped data

What is an online aggregator and how to create your own

Build new tools

Are you a developer? Build your own Actors and run them on Apify.

Learn more

Get a custom solution

Get a custom web scraping or RPA solution.

Book a demo

Diff Datasets

Base dataset

Other dataset

Data fields