GoodFirms Scraper — Global B2B Agencies & IT Companies API

Scrapes GoodFirms — a global B2B ratings and reviews directory covering 150,000+ IT service firms, software companies, and digital agencies worldwide — into clean JSON on Apify.

Store: https://apify.com/umararshad2/goodfirms-scraper

Why this Actor

GoodFirms ranks agencies and software vendors across software development, web design, mobile apps, digital marketing, AI, SEO, DevOps, and more, with country-scoped directories (US, UK, Germany, Canada, Australia, India, UAE, …). Procurement teams, agencies, and lead-gen builders need structured vendor lists (rating, hourly rate, team size, location, website) without hand-copying directory pages. Dedicated Store competitors are thin and often expensive per enriched profile — this Actor is framed as a global GoodFirms companies / agencies scraper API, not a single-country product.

What it scrapes

1. Directory listings — category and country pages under https://www.goodfirms.co/directory/… (JSON-LD ItemList / LocalBusiness)
2. Company profiles — https://www.goodfirms.co/company/{slug} (website, founded year, employees, phone, email, social links when present)
3. Direct URLs — pass directory or company links via startUrls

Uses Crawlee CheerioCrawler (SSR HTML + JSON-LD). Defaults to Apify Proxy.

Built-in category shortcuts

Input category	Directory path
software-development	/directory/languages/top-software-development-companies
web-development	/directory/platforms/top-web-development-companies
mobile-app-development	/directory/platforms/top-mobile-app-development-companies
web-design	/directory/platforms/top-web-design-companies
digital-marketing	/directory/marketing-services/top-digital-marketing-companies
it-services	/directory/services/top-it-services-companies
artificial-intelligence	/directory/services/top-artificial-intelligence-companies
seo	/directory/marketing-services/top-seo-companies

Optional country (e.g. us, gb, de, ca, au) scopes to /directory/country/top-…-companies/{country}.

Pricing (PPE)

$1.20 / 1,000 companies via custom event company-scraped ($0.0012 each), plus a small apify-actor-start. No usage pass-through. Do not enable synthetic apify-default-dataset-item alongside company-scraped (avoids double billing). Memory: 512–2048 MB (default 1024).

Example input

{
  "category": "software-development",
  "country": "us",
  "maxCompanies": 100,
  "maxPages": 5,
  "includeProfileDetails": true,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

Or pass explicit directory / company URLs:

{
  "startUrls": [
    "https://www.goodfirms.co/directory/languages/top-software-development-companies",
    "https://www.goodfirms.co/company/instinctools"
  ],
  "maxCompanies": 50,
  "includeProfileDetails": true
}

Example output

{
  "companyId": "instinctools",
  "name": "Instinctools",
  "profileUrl": "https://www.goodfirms.co/company/instinctools",
  "website": "https://www.instinctools.com/",
  "rating": 4.9,
  "reviewCount": 27,
  "hourlyRate": "$25 - $49",
  "employees": "250 - 999 Employees",
  "foundedYear": 2000,
  "city": "Potomac",
  "region": "Maryland",
  "country": "us",
  "phone": "+12028214280",
  "email": "contact@instinctools.com",
  "description": "Your AI-powered Engineering Partner",
  "services": [],
  "socialLinks": [
    "https://www.linkedin.com/company/instinctools"
  ],
  "category": "software-development",
  "position": 1,
  "source": "goodfirms",
  "scrapedAt": "2026-09-25T12:00:00.000Z"
}

Proxy notes

Directory JSON-LD often works with datacenter or auto proxy. Profile pages and some geo paths may need RESIDENTIAL if you see empty listings or challenge pages. Set apifyProxyGroups: ["RESIDENTIAL"] when that happens. The Actor falls back to bundled fixtures only when useMockData is true (local CI).

Use cases

• B2B agency / IT vendor lead lists for outbound
• Competitive landscape maps by category + country
• Hourly-rate and team-size benchmarking
• Enrich CRM with GoodFirms ratings and review counts
• Feed procurement / RFP shortlists

Sibling Actors (same publisher)

• Adzuna Jobs Scraper — multi-country jobs API
• Foundit Jobs Scraper
• Instahyre Jobs Scraper
• Mustakbil Jobs Scraper
• Whatmobile Scraper

Keywords

GoodFirms scraper, GoodFirms API, GoodFirms companies scraper, B2B agency directory scraper, IT services lead generation, software development companies list, digital marketing agencies scraper, web design agencies data, global agency ratings export, GoodFirms hourly rates, Apify GoodFirms

Disclaimer

This Actor collects publicly available directory and profile information for legitimate research, lead generation, and market analysis. Respect GoodFirms terms of use and applicable laws. You are responsible for how you use the data.