No credit card required

Diff Datasets

pocesar/diff-datasets

No credit card required

Take one dataset on Apify platform, compare it to another, and output the missing ones. This can also be used to output only changed items, using a compound key

Base dataset

baseDatasetIdstringRequired

This dataset ID that will serve as base and collect the unique items.

Other dataset

otherDatasetIdstringRequired

Only non-existing items from base will be ouput using this other dataset

Data fields

uniqueFieldsarrayRequired

Unique fields to create a compound key. For example, an unique ID field might not be unique, so you place two fields that make the item itself unique

Default value of this property is []

Max Buffer size

maxBufferSizeintegerOptional

How many items to buffer in memory before outputting it

Default value of this property is 20000

Developer

Paulo Cesar

Actor Metrics

1 monthly user
2 stars
Created in Jun 2020
Modified 2 years ago

Categories

Automation

Open source

Diff Dataset Fields

lukaskrivka/diff-dataset-fields

Compare changes in text fields between two datasets. Monitor new and updated content on websites.

Lukáš Křivka

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

5.8k

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Apify

72.8k

281

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

4.8k

🔥 LinkedIn Jobs Scraper

bebity/linkedin-jobs-scraper

ℹ️ Designed for both personal and professional use, simply enter your desired job title and location to receive a tailored list of job opportunities. Try it today!

Bebity

4.6k

103

Traffic Generator (Youtube, Web, Etsy, Behance and many more!)

epctex/traffic-generator

Maximize your website's performance and visibility with our Traffic Generator. Drive targeted traffic, simulate page views, and stress-test against potential threats. With the power to generate millions of visits, it's the ultimate solution for boosting your online presence.

epctex

26.4k

198

Download HTML from URLs

mtrunkat/url-list-download-html

This actor takes a list of URLs and downloads HTML of each page.

Marek Trunkát

8.2k

Instagram Followers Count Scraper

apify/instagram-followers-count-scraper

Scrape the number of followers & follows from any Instagram profile. Schedule the scraper to run regularly to monitor how the numbers change. You can also export scraped data, run the scraper via API, monitor runs or integrate with other tools.

Apify

3.2k