Clutch.co Company & Agency Data Scraper

Extract verified B2B company listings from Clutch.co directory pages at scale. Collect company names, ratings, review counts, project budgets, hourly rates, employee ranges, structured location data, service offerings, phone numbers, logo images, website URLs, and listing metadata — all from the listing cards without the cost and overhead of visiting individual profile pages.

Features

• 80+ directory categories across Advertising & Marketing, Development, Design & Production, IT Services, and Business Services
• 21 data fields per listing extracted directly from directory cards
• Location filtering by city, region, or country via on-page dropdown interaction
• Unlimited pagination — scrape all pages or set a maximum per category
• Minimum rating filter — only keep listings above a target rating threshold
• Featured/excluded toggle — include or skip promoted/sponsored results
• Multi-category batch scraping — select any combination of categories in one run
• Custom URL support — paste any Clutch.co directory URL not in the preset list
• Optional email discovery — visit each company's website to extract contact emails (disabled by default)
• Proxy integration — Apify proxy recommended to avoid rate limiting and Cloudflare challenges
• Automatic Cloudflare resolution — retries with proxy rotation on challenge pages
• CSV/JSON/XML export via Apify dataset

How to Use

Quick Start

1. Select one or more categories from the dropdown (or enter custom URLs in the text area)
2. Optionally enter a location to filter results (e.g. London, England)
3. Set Max Pages per Category (default 3; set to 0 for unlimited)
4. Click Start

Input Reference

Field	Type	Description
Pick Categories	Multi-select dropdown	Choose from 80+ Clutch.co directory categories organized by service group
Custom URLs	Textarea (one per line)	Additional directory URLs not in the preset list, e.g. https://clutch.co/web-developers
Location Filter	Free text	Filter by city or region. Single: London, England. Multiple: [London] [New York]
Max Pages per Category	Integer (0–5000)	How many pagination pages to scrape. 0 = no limit (scrapes until no more pages exist)
Minimum Rating	Decimal (0–5)	Only keep listings with at least this star rating. 0 = include all
Exclude Featured	Boolean	Skip promoted/sponsored listings at the top of each results page
Scrape Emails	Boolean	When enabled, visits each company's website to extract email addresses. Adds significant runtime
Page Timeout	Integer (ms)	Maximum wait time per page load before retrying
Proxy Configuration	Apify proxy object	Proxy pool for IP rotation and Cloudflare bypass

Location Filter Details

The location filter interacts with Clutch.co's autocomplete dropdown. Enter a city or region, wait for the suggestion to appear, and the scraper selects the matching item. The page URL updates to reflect the location filter (e.g. /uk/england/london).

Examples:

• London, England — single city filter
• New York, United States — single city with country
• [London, England] [New York, United States] — scrape the same category twice, once per location

Note: Location results vary by category. The filter only shows locations that have matching listings. If a dropdown item does not appear within the retry window, the category is skipped.

Category Coverage

The actor supports 80+ directory categories across five service groups:

Group	Example Categories
Advertising & Marketing	SEO, PPC, Social Media Marketing, Content Marketing, Branding, PR, Video Production, Email Marketing, Digital Strategy, Conversion Optimization, Media Buying
Development	Web Developers, Mobile App Development (iOS, Android), AI/ML, Blockchain, eCommerce, Ruby on Rails, WordPress, Drupal, Magento, .NET, PHP, IoT, AR/VR, Software Testing
Design & Production	Web Design, UX/UI, Graphic Design, Logo Design, Product Design, Packaging Design, Print Design, Interior Design
IT Services	Cybersecurity, Cloud Consulting, BI & Big Data Analytics, Staff Augmentation, Managed Service Providers (MSP)
Business Services	Call Centers, BPO, HR & Recruiting, Accounting & Payroll, Translation, Transcription, Real Estate, Legal, Logistics & Supply Chain

Output Schema

Each dataset record represents one company listing from a Clutch.co directory page.

Field	Type	Description
category	string	Human-readable category name (e.g. Full Service Digital (Advertising & Marketing))
categoryUrl	string	Clutch.co directory category URL this listing was scraped from
currentPageUrl	string	Exact page URL where the listing was found (includes location filter and pagination)
name	string	Company name
profileUrl	string	Full Clutch.co profile URL
website	string	Company website URL (redirects resolved, UTM parameters stripped)
phone	string	Publicly listed phone number
rating	string	Star rating displayed on the listing (e.g. 4.5)
reviewCount	string	Number of reviews
minProject	string	Minimum project budget (e.g. $1,000+)
hourlyRate	string	Hourly rate range (e.g. $50 - $99 / hr)
employees	string	Employee count range (e.g. 50 - 249)
location	string	Location text from the listing card
addressLocality	string	City from structured address metadata
addressRegion	string	State or region from structured address metadata
addressCountry	string	Country code from structured address metadata
streetAddress	string	Street address from structured address metadata
postalCode	string	Postal code from structured address metadata
services	string	Comma-separated list of services offered (from chart tooltip or services list)
description	string	Short description or project highlight text
verified	string	Whether the listing has a Clutch Verified checkmark (true/false)
logo	string	URL of the company logo image
listingType	string	featured for promoted/sponsored listings, regular for organic results
emails	string	Email addresses extracted from the company's website (only when email scraping is enabled)

Technical Details

Pagination

The scraper uses a two-tier content loading strategy for paginated results:

1. Browser fetch (fast path) — uses the page's own fetch() API to request the next page's HTML. If the response contains listing cards, it sets the content directly via page.setContent().
2. Full navigation (fallback) — if the fetch response does not contain valid listing HTML, falls back to page.goto() with waitForSelector to ensure cards are rendered.

This minimizes page transitions and speeds up multi-page scraping.

Location Filter

The location feature simulates human interaction with Clutch.co's autocomplete input. The scraper:

1. Locates the location input field using multiple selectors
2. Types the query character by character with realistic delays
3. Polls for the dropdown to appear and match against the query text
4. Clicks the matching item using a trusted click event
5. Waits for the page URL to reflect the location change
6. Validates that listing cards load in the filtered view

If the dropdown does not appear after multiple retries with full page reloads, the category is skipped.

Email Scraping

When enabled, the actor visits each company's website (from the website field) and extracts email addresses using:

• mailto: links on the page
• Regex pattern matching for email addresses in the page text and HTML
• Deduplication and filtering of common false positives (noreply@, example.com, etc.)

Email scraping is processed concurrently (5 sites at a time) and is disabled by default due to the significant runtime it adds.

Proxy & Cloudflare Handling

• Proxy configuration is required for reliable operation at scale. Apify proxy with rotating IPs is recommended.
• The actor detects Cloudflare challenge pages by title and waits up to 15 seconds for resolution
• If a challenge is not resolved within the wait window, the proxy is rotated (up to 3 attempts)
• On repeated Cloudflare failures, the actor falls through to the next proxy group

Rate Limits & Timeouts

• Each page load has a configurable timeout (default 60s)
• Email scraping uses a 25s per-site timeout
• Location filter waits up to 20 seconds for URL change after selection
• Pagination retries once with a full reload if cards do not appear

Use Cases

• Lead generation — build targeted prospect lists filtered by category, location, and minimum rating
• Market research — analyze the competitive landscape across service verticals and geographies
• Sales intelligence — enrich CRM data with company size, budget ranges, services, and contact information
• Agency discovery — find agencies, consultancies, and service providers by expertise and location
• Data enrichment — supplement existing datasets with Clutch.co verification, ratings, and review counts