No credit card required

Crawler Results Deduplicate

petr_cermak/crawler-results-deduplicate

Try for free

No credit card required

This acts takes crawler execution results and deduplicates them.

act-crawler-results-deduplicate

This acts takes crawler execution results and deduplicates them.

Example input:

1{
2    "_id": "EXECUTION_ID",
3    "data": "{
4        \"compareKey\": \"YOUR_COMPARE_KEY\"
5    }"
6}

The optional "data" attribute must be a stringified JSON and can contain a "compareKey" attribute. This key is used to select an object attribute for comparison. If no key is provided, whole object will be used for comparison. It is expected to be called from a crawler webhook.

Developer

Petr Cermak

Actor Metrics

1 monthly user
1 star
Created in Oct 2017
Modified 4 years ago

Categories

Developer tools

Google Maps Scraper Orchestrator

lukaskrivka/google-maps-scraper-orchestrator

Run multiple locations and search terms together with parallel runs for maximum speed.

Lukáš Křivka

119

Google Maps Scraper

compass/crawler-google-places

Extract data from hundreds of Google Maps locations and businesses. Get Google Maps data including reviews, images, contact info, opening hours, location, popular times, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

78.8k

557

Galaxus API Scraper

petr_cermak/galaxus-scraper

Petr Cermak

Facebook Hashtag Search Scraper

easyapi/facebook-hashtag-search-scraper

Scrape Facebook hashtag posts with ease! Extract post content, user info, reactions, comments count and more from any public Facebook hashtag search results. Perfect for social media monitoring and trend analysis.

EasyApi

Contact Details Scraper

vdrmota/contact-info-scraper

Free email extractor to extract and download emails, phone numbers, Facebook, Twitter, LinkedIn, and Instagram profiles from any website. Extract contact information at scale from lists of URLs and download the data as Excel, CSV, JSON, HTML, and XML.

Vojta Drmota

24.6k

194

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

26.7k

655

Website Social Scraper Api

oussemafr/website-social-scraper-api

You will get access to the Website Contact Details - Get Contact Info Efficiently!

Oussema FRIKHA

Software Advice

canadesk/software-advice

Get Products, Reviews, Statistics and Search results from Software Advice/Capterra. It's fast and costs little.

Canadesk Support

Actor Testing

pocesar/actor-testing

Test your actors with varying inputs and expected outputs, duplicates, bad output fields, or unexpected log messages using Jasmine

Paulo Cesar

Snowflake Marketplace Scraper

crawlr/snowflake-marketplace

Advanced Snowflake Marketplace Scraper built with TypeScript, leveraging Crawlee and Cheerio to efficiently extract and compile comprehensive data product listings from the Snowflake Marketplace for data-driven insights and analytics.