Crawler Results Deduplicate

Deprecated

Pricing

Pay per usage

See alternative Actors

Go to Apify Store

Crawler Results Deduplicate

Deprecated

See alternative Actors

This acts takes crawler execution results and deduplicates them.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Petr Cermak

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

5 years ago

Last modified

act-crawler-results-deduplicate

This acts takes crawler execution results and deduplicates them.

Example input:

{
    "_id": "EXECUTION_ID",
    "data": "{
        \"compareKey\": \"YOUR_COMPARE_KEY\"
    }"
}

The optional "data" attribute must be a stringified JSON and can contain a "compareKey" attribute. This key is used to select an object attribute for comparison. If no key is provided, whole object will be used for comparison. It is expected to be called from a crawler webhook.

Galaxus API Scraper

petr_cermak/galaxus-scraper

Petr Cermak

AliExpress Phone Number Scraper

scraper-mind/aliexpress-phone-number-scraper

[𝗖𝗵𝗲𝗮𝗽𝗲𝘀𝘁 𝗣𝗿𝗶𝗰𝗲] AliExpress Phone Number Scraper extracts publicly available phone numbers from AliExpress for research & outreach. Fast, accurate, and easy to use. Ideal for marketers & businesses.

Scraper Mind

Real Estate Aggregator

tri_angle/real-estate-aggregator

Multi-source scraper for real estate data. Supports rent and sale listings, deduplication, and consistent output from Zillow, Realtor, Zumper, Apartments.com, and Rightmove.

Tri⟁angle

115

Zara

datasaurus/zara

Scrape products from zara.com websites. All available countries and languages. Filter by Category or Product. Fast and efficient.

datasaurus

104

5.0

(1)

Bershka

datasaurus/bershka

Scrape products from bershka.com websites. All countries and languages. Scrape the full website or scrape by product category or individual product. Fast and efficient.

datasaurus

5.0

(1)

ZaraHome

datasaurus/zarahome

Scrape products from zarahome.com websites. All countries and languages. Scrape the full website or scrape by product category or individual product. Fast and efficient.

datasaurus

5.0

(1)

Massimo Dutti

datasaurus/massimodutti

Scrape products from Massimo Dutti. All countries and languages. Scrape the full website or scrape by product category or individual product. Fast and efficient.

datasaurus

Pull&Bear

datasaurus/pullandbear

Scrape products from pullandbear.com websites. All countries and languages. Scrape the full website or scrape by product category or individual product. Fast and efficient.

datasaurus

5.0

(1)

Stradivarius

datasaurus/stradivarius

Scrape products from stradivarius.com websites. All countries and languages. Scrape the full website or scrape by product category or individual product. Fast and efficient.

datasaurus

Oysho

datasaurus/oysho

Scrape products from oysho.com websites. All countries and languages. Scrape the full website or scrape by product category or individual product. Fast and efficient.

datasaurus