No credit card required

Diff Dataset Fields

lukaskrivka/diff-dataset-fields

Try for free

No credit card required

Compare changes in text fields between two datasets. Monitor new and updated content on websites.

Old Dataset ID

oldDatasetIdstringOptional

ID of the old dataset to compare.

New Dataset ID

newDatasetIdstringOptional

ID of the new dataset to compare.

Field to Map Items By

fieldToMapBystringOptional

Field used to find which items should be matched for comparison. Usually some identifier like url or id.

Default value of this property is "url"

Fields to Diff

fieldsToDiffarrayOptional

Fields that will be compared between matched items. Usually fields like text, description, markdown.

What to output

outputTypesarrayOptional

Which items should be pushed to the default dataset

Default value of this property is ["new","removed","updated","unchanged"]

Output Dataset ID or name (optional)

outputDatasetIdstringOptional

Enables storing the diff items into a separate dataset. Useful for tracking historical changes or integration workflows.

Only Load and Store Diffed and Mapping Fields (cost saving)

onlyLoadStoreDiffedFieldsbooleanOptional

If enabled, only the fields specified in fieldsToDiff and fieldToMapBy will be loaded and stored in the output diff dataset. This helps to reduce storage costs and make the run faster.

Default value of this property is false

Developer

Lukáš Křivka

Actor Metrics

1 monthly user
1 star
Created in Sep 2024
Modified 2 months ago

Categories

Automation

Developer tools

Diff Datasets

pocesar/diff-datasets

Take one dataset on Apify platform, compare it to another, and output the missing ones. This can also be used to output only changed items, using a compound key

Paulo Cesar

Monitor Text Changes

lukaskrivka/monitor-changes

Monitor changes on websites or APIs and get back a detailed diff for selected fields. Run as an integration after any scraping Actor.

Lukáš Křivka

G2 Product Scraper

omkar-cloud/g2-product-scraper

G2 Product Scraper helps you collect G2 product data, including names, product descriptions, reviews, ratings, comparisons, alternatives, and many more.

Chetan Jain

273

TripAdvisor Scraper

epctex/tripadvisor-scraper

Explore with our Trip Advisor Scraper: an easy search for hotels, restaurants, attractions, and more by keywords or start URL. Enter check-in/out dates, and select currency and language. Promote locations, capture details, and retrieve emails and phone numbers if shared.

epctex

410

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

26.7k

655

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

5.6k

Traffic Generator (Youtube, Web, Etsy, Behance and many more!)

epctex/traffic-generator

Maximize your website's performance and visibility with our Traffic Generator. Drive targeted traffic, simulate page views, and stress-test against potential threats. With the power to generate millions of visits, it's the ultimate solution for boosting your online presence.

epctex

24.1k

169

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Apify

71.5k

223

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

4.6k

Google Search Results Scraper

apify/google-search-scraper

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, AI overviews, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export scraped data, run the scraper via API, schedule runs, or integrate with other tools.

Apify

49.6k

233