Deprecated

Pricing

Pay per usage

See alternative Actors

Go to Store

Crawler Results Deduplicate

Deprecated

See alternative Actors

Developed by

Petr Cermak

This acts takes crawler execution results and deduplicates them.

0.0 (0)

Pricing

Pay per usage

Total users

Monthly users

Last modified

4 years ago

Developer tools

Open source

act-crawler-results-deduplicate

This acts takes crawler execution results and deduplicates them.

Example input:

{
    "_id": "EXECUTION_ID",
    "data": "{
        \"compareKey\": \"YOUR_COMPARE_KEY\"
    }"
}

The optional "data" attribute must be a stringified JSON and can contain a "compareKey" attribute. This key is used to select an object attribute for comparison. If no key is provided, whole object will be used for comparison. It is expected to be called from a crawler webhook.

On this page

act-crawler-results-deduplicate

Share Actor:

Google Maps Scraper

compass/crawler-google-places

Extract data from thousands of Google Maps locations and businesses. Get Google Maps data including reviews, reviewer details, images, contact info, opening hours, location, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

116K

4.2

Contact Details Scraper

vdrmota/contact-info-scraper

Free email extractor and lead scraper to extract and download emails, phone numbers, Facebook, Twitter, LinkedIn, and Instagram profiles from any website. Extract contact information at scale from lists of URLs and download the data as Excel, CSV, JSON, HTML, and XML.

Vojta Drmota

33K

3.8

Eventbride + Ticketmaster

dr.ollie/eventbride-ticketmaster

Integrated scraper for Eventbrite & Meetup events. Filters by city, radius, and keywords. Outputs deduplicated results in HTML, Excel, CSV, JSON, and ICS calendar formats. Fast, browser-optimized. Ideal for users, analysts, marketers, and app builders.

Dr. Ollie

Google Map Business Scraper

logical_scrapers/google-map-business-scraper

Scrapes business information from Google Maps including name, address, phone, website, ratings, opening Hours and more.

Goldmine

166

2.1

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

57K

3.6

Amazon Bestsellers Scraper

junglee/amazon-bestsellers

Scrape the Amazon Best Sellers categories and extract details on top 100 most popular items on Amazon. Download product name, price, URL, and thumbnail image. Best used on .com, .co.uk, .de, .fr, .es, and .it domains. Download your data in various formats: HTML table, JSON, CSV, Excel, and more.

Junglee

1.3K

4.3

Linkedin Company Posts Batch Scraper | No Cookies

apimaestro/linkedin-company-posts-batch-scraper-no-cookies

Extract public posts data in batch from companies including post content, reactions, comments count, and media attachments

API Maestro

5.0

Google Maps Scraper

omerace/google-maps-scraper

Quickly extract data from hundreds of locations. Scrape Google Maps using keywords, categories, locations, or direct URLs. Collect business names, contact details, addresses, opening hours, popular times, menus, pricing info, and more.

Omer Yilmaz

5.0

Google Search Results Scraper

apify/google-search-scraper

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, AI overviews, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export scraped data, run the scraper via API, schedule runs, or integrate with other tools.

Apify

61K

4.8

🏘️immobilienscout24.de search results scraper (By search URL)

azzouzana/immobilienscout24-de-search-results-scraper-by-search-url

🔥 Scrape immobilienscout24.de search results pages and monitor them for new or delisted ads, easily exportable to JSON, CSV, Excel, or as an API... Simply enter the search page URL and get your data! Blazing fast & affordable ⚡

Azzouzana

5.0

Clutch.co Search Results Scraper ( Pay Per Results)

gopalakrishnan/clutch-companies-scraper

This Apify actor swiftly scrapes Clutch.co search results for lead generation. Get essential company data—names, URLs, ratings—for $2/1000 results. Integrates seamlessly with enrichment tools. Fast, efficient, and cost-effective!