DesignRush B2B Agency Scraper
Pricing
from $3.00 / 1,000 results
DesignRush scraper & API: find marketing, design and development agencies by category and location and export agency name, rating and reviews, hourly rate, min budget, team size, location and website. B2B agency discovery and lead generation — fast, no login.
HTTP 403 Cloudflare "Just a moment" challenges to the previous Chrome/got-scraping transport — even over Residential proxy — so most profile fetches failed and fell back to thin listing-only records (a fresh pre-fix run carried full profile detail on only ~12% of records). Two changes fix it:
impit instead of Chrome/got-scraping. The Firefox fingerprint clears the Cloudflare challenge where Chrome is blocked.403 / 429 / 5xx — until a clean IP answers. If the proxy input is left empty or set to datacenter, it auto-upgrades to Residential so runs don't silently return block-degraded data.--omit=optional from the Dockerfile npm install so impit's platform-native binary (shipped as an optional dependency) installs in the container.proxyConfiguration now points at Residential (required for the site).CHANGELOG.md.?page=N pagination per category/location with de-duplication by agency slug; configurable maxRecords, maxPagesPerCategory, minRating, minReviews, awardWinnersOnly, concurrency and request delay.