No credit card required

Merge, Dedup & Transform Datasets

lukaskrivka/dedup-datasets

Try for free

No credit card required

The ultimate dataset processor. Extremely fast merging, deduplications & transformations all in a single run.

Do you want to learn more about this Actor?

Can't get it to work?

Opened a month ago by Clickle, last comment a month ago by Lukáš Křivka (lukaskrivka)

It's not merging and deduping like it used to

Opened 3 months ago by Moudi, last comment a month ago by Pavlína Vencovská (paja)

what does it mean when it threw out an exeption.

Opened 3 months ago by Moudi, last comment 3 months ago by Lukáš Křivka (lukaskrivka)

Merge and Dedup to a single dataset

Opened 4 months ago by graphext, last comment a month ago by Lukáš Křivka (lukaskrivka)

testeestetset

Opened 5 months ago by Lukáš Křivka (lukas-test), last comment 5 months ago by Lukáš Křivka (lukas-test)

combining runs did not work due to inconsistent column numbers, any refund?

Opened 5 months ago by johnzhu1, last comment 5 months ago by Lukáš Křivka (lukaskrivka)

How to search for keywords in given dataset?

Opened 6 months ago by sensible_market, last comment 5 months ago by Lukáš Křivka (lukaskrivka)

Specific requested fields are not being exported

Opened 6 months ago by blazing_zittern, last comment 6 months ago by Lukáš Křivka (lukaskrivka)

De-duplicate dataset error

Opened 7 months ago by data_explorer, last comment 7 months ago by Lukáš Křivka (lukaskrivka)

Select contact details

Opened 8 months ago by nico_v, last comment 8 months ago by Lukáš Křivka (lukaskrivka)

Not working

Opened 9 months ago by user-vRWgRoj3vcGC9QrDk, last comment 9 months ago by Lukáš Křivka (lukaskrivka)

Tutorial for beginners

Opened a year ago by graphext, last comment a year ago by Míša Fialová (misa)

Customization?

Opened 2 years ago by tfarzalo, last comment 2 years ago by Zuzka Pelechová (zuzka)

Macy's Actor

Opened 2 years ago by 82society, last comment 2 years ago by Míša Fialová (misa)

Developer

Lukáš Křivka

Actor Metrics

188 monthly users
55 stars
97% runs succeeded
1.1 days response time
Created in Apr 2020
Modified 3 days ago

Categories

Automation

Developer tools

Integrations

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

28.6k

722

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

5.7k

Traffic Generator (Youtube, Web, Etsy, Behance and many more!)

epctex/traffic-generator

Maximize your website's performance and visibility with our Traffic Generator. Drive targeted traffic, simulate page views, and stress-test against potential threats. With the power to generate millions of visits, it's the ultimate solution for boosting your online presence.

epctex

25.9k

187

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Apify

72.3k

245

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

4.7k

🔥 LinkedIn Jobs Scraper

bebity/linkedin-jobs-scraper

ℹ️ Designed for both personal and professional use, simply enter your desired job title and location to receive a tailored list of job opportunities. Try it today!

Bebity

4.4k

Download HTML from URLs

mtrunkat/url-list-download-html

This actor takes a list of URLs and downloads HTML of each page.

Marek Trunkát

8.2k

Instagram Followers Count Scraper

apify/instagram-followers-count-scraper

Scrape the number of followers & follows from any Instagram profile. Schedule the scraper to run regularly to monitor how the numbers change. You can also export scraped data, run the scraper via API, monitor runs or integrate with other tools.

Apify

3.2k

Legacy PhantomJS Crawler

apify/legacy-phantomjs-crawler

Replacement for the legacy Apify Crawler product with a backward-compatible interface. The actor uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of front-end JavaScript code.

Apify

1.6k

Extended GPT Scraper

drobnikj/extended-gpt-scraper

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.