Web scraping and automation success stories

Research

Scraping American real estate market for research

Read about the challenges of collecting data on the American real estate market for extensive tax research. Explore how Apify's web scraper simplified the whole process and provided much sought-after answers for one talented researcher.

Data Analytics

From Scrapy to Apify: how a retail data agency saved 90% costs on web scraping

Daltix is a company highly committed to providing quality data to European enterprises active in retail. Read on how they managed to make a big move from Scrapy to Apify, from Python to JavaScript - all within one year - and what were the payoffs.

Paid Actors

A journey from 1 to 200 actors: how to build web scrapers and earn passive income

Discover how our first paid actors program applicant and a long-term freelancer tread his path to web scraping, developed a strategy on actor building and earns passive income from his projects.

Research

Analyzing holiday home prices with web scraping

Find out how two students used real estate listings data to analyze how the cost of holiday homes across the Czech Republic has risen in recent years, the impact of COVID-19, and how wages are not growing at the same pace as prices.

Content

Scaling up AI-powered content agency with data extraction

Our customer's line of business is analyzing user engagement on the websites and being able to forecast their further interest in content. Discover how Apify platform and data extraction enhanced the workflow of this content analysis agency.

Jobs

Bringing IT opportunities closer to women

Czechitas is a Czech non-profit organization of women and men on a mission to reach a higher level of digital proficiency among women and the new generation. See how they teamed up with Apify for the ultimate job scraping job.

Tech

RSS feed from any website

Want to keep tabs on a website that doesn't provide an RSS feed? This guide shows you how you can use an Apify crawler to make your own. Use jQuery to find specific HTML elements and CSS classes, and then return a list of JSON objects that each represent an RSS feed item.

Culture

Personalised concert tips

Great guide to using Apify and Songkick to be notified of concerts and gigs by artists similar to your favorites. Smoothly combines Apify actors, key-value store, and a crawler to produce an RSS feed.

Search engine

Scraping Amazon Search Results

How to use Apify to scrape Amazon search results. Shows you how a request queue can drill down for product details and provides extensively commented code to guide you through the process.

Tech

Apify based chatbot

One of our users developed a Telegram-based chatbot that helps scooter chargers be more efficient, by sending them push notifications according to their live location.

Real estate

Real Estate Aggregator

Using Apify, a real estate aggregator scrapes listings from the 23 largest websites offering properties for sale and rent.

Tech

SEO Audit Tool

Finding on-page SEO issues can be tricky. Imagine doing it on many sites with hundreds of pages... That's why Apify helped develop one crawler to audit them all.

Retail

Black Friday Analysis

Apify conducted an extensive month-long daily scraping of prices to determine the average and real Black Friday discount at three of the largest Czech e-stores.

Retail

E-shop price checker extension

After another revealing analysis of Black Friday discounts in 2018, Apify worked together with other partners to create a browser extension to enable users to check historical prices on the three largest Czech e-commerce websites.

Jobs

Scraping job offers for moms

Apify actors scrape part-time employment positions for an agency dedicated to helping mothers return to work.

Media

Terror or Clickbait?

Students at the Czechitas Digital Academy created an interactive dashboard demonstrating how the Czech media covers terrorism.

Retailer price monitoring
Retail

Retailer price monitoring

Apify worked with a leading manufacturer to implement a solution that allows the manufacturer to continuously monitor the prices of their products on the e-commerce websites that sell them to ensure they are never priced lower than the agreed minimum.

Tech

Illegal content detector

Detecio is software that continuously monitors the web and helps content publishers reduce losses by automatically removing unauthorized copies. Detecio protects thousands of books and other audiovisual content in Czechia by monitoring the Internet for any unlicensed work.

Detecio app
Tech

Keyword research and content ideation tool

Topic is an AI-powered platform that enables content teams to write better SEO content and drive more organic search traffic by analyzing top-performing content and delivering a content brief that shows how to write your next article, blog post, or guide. The platform analyzes the existing top results in Google to surface valuable insights.

Tech

Automated competitive intelligence

Human Coders are a group of passionate information technology professionals who offer a variety of IT trainings, mostly geared towards developers. Human Coders set up a series of serverless apps to run weekly on the Apify Platform. These apps extract available data about all related courses offered in France. They target both their competitor's as well as their own websites on a weekly basis.

Tech

The lost dog app

Shadow is a community-led organization whose mission is to reunite lost dogs (and cats!) with their humans. Using serverless apps hosted on the Apify platform, Shadow crawls hundreds of thousands of listings at regular intervals across the entire United States.

Fighting child traffickers with technology
Tech

Fighting child traffickers with technology

Thorn is a non-profit organization dedicated to defending children against sexual abuse. By pinpointing the critical data needed to identify child exploitation and automating the data collection process, the team at Thorn has been able to identify and rescue thousands of children from sex trafficking and commercial sexual exploitation.

Tech

Helping the planet with data

Omdena is a platform where the global AI community collaborates to find innovative and ethical solutions to real-world issues. Omdena used Apify's readymade Google Search Results Scraper to scrape and download thousands of policy documents that could then be used to identify ways to promote forest and landscape restoration in Latin America.