# DesignRush Agency Scraper & Lead Extractor (`nocodeninja_ng/designrush-agency-scraper-lead-extractor`) Actor Scrape DesignRush to extract B2B leads instantly. Get high-converting data from SEO, Shopify, AI, Webflow, and PPC agencies. Extracts websites, emails, phone numbers, pricing, and social links. Ultra-fast, lightweight Cheerio crawler optimized for low-cost lead generation. - **URL**: https://apify.com/nocodeninja\_ng/designrush-agency-scraper-lead-extractor.md - **Developed by:** [NoCodeNinja](https://apify.com/nocodeninja_ng) (community) - **Categories:** Lead generation, Automation, Jobs - **Stats:** 2 total users, 1 monthly users, 0.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $2.50 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## DesignRush Agency Scraper - Extract Agency Data from DesignRush Directory Fast and reliable DesignRush scraper for extracting agency listings, contact information, ratings, and detailed profiles from DesignRush.com. Built with Crawlee for production-scale web scraping on Apify. ### Why Use This Scraper? Generic directory scrapers don't give you targeted data. This actor allows you to target specific, high-converting buyer intent keywords. Use it to: * **Scrape SEO Agencies** for competitive intelligence or partnership pitches. * **Scrape Shopify & Webflow Agencies** to find high-value e-commerce and development leads. * **Scrape AI & PPC Agencies** to discover fast-growing tech teams needing your services. ### What does the DesignRush Scraper do? This Apify actor scrapes agency data from DesignRush, the leading B2B marketplace for finding digital agencies. Extract comprehensive agency information including contact details, services, pricing, reviews, and locations from DesignRush category pages and agency profiles. **Perfect for:** - Lead generation and business development - Market research and competitor analysis - Building agency databases - Sales prospecting and outreach campaigns - Industry benchmarking and pricing research ### Features ✅ **Keyword-based search** - Enter plain text like "Shopify developers in California" and automatically crawl matching categories ✅ **Direct URL support** - Scrape specific DesignRush category pages ✅ **Comprehensive data extraction** - Agency name, website, email, phone, services, pricing, reviews, locations ✅ **Detailed profile scraping** - Optionally crawl individual agency pages for complete information ✅ **Smart pagination** - Automatically handles multi-page category listings ✅ **Proxy support** - Built-in Apify proxy integration with datacenter and residential options ✅ **Session management** - Intelligent rotation to avoid blocks ✅ **Structured output** - Clean, ready-to-use JSON/CSV/Excel datasets ### Input Configuration ```json { "keyword": "Shopify developers in California", "maxPages": 5, "maxItems": 500, "includeDetails": true } ```` **Or use direct URLs:** ```json { "startUrls": [ { "url": "https://www.designrush.com/agency/web-development-companies" } ], "maxPages": 5, "maxItems": 500, "includeDetails": true } ``` #### Input Parameters | Parameter | Type | Description | Default | |-----------|------|-------------|---------| | `keyword` | String | Plain-text search term to find matching DesignRush categories | - | | `startUrls` | Array | Direct DesignRush category URLs (overrides keyword) | - | | `maxPages` | Number | Maximum listing pages to scrape | 10 | | `maxItems` | Number | Maximum agencies to extract | 1000 | | `includeDetails` | Boolean | Scrape individual agency profile pages for complete data | false | | `maxConcurrency` | Number | Concurrent requests (1-10) | 6 | | `proxyConfiguration` | Object | Apify proxy settings (auto, datacenter, residential) | auto | > **Note:** The actor has been tested successfully extracting 200+ agencies without proxy. However, for larger scraping jobs or to avoid potential rate limiting, using Apify's datacenter or residential proxies is recommended. ### Output Data Each scraped agency record includes: ```json { "agencyName": "Essential Designs", "profileUrl": "https://www.designrush.com/agency/profile/essential-designs", "website": "https://www.essentialdesigns.net/?utm_source=DesignRush&utm_medium=Categories&utm_campaign=March", "hourlyRate": "$50/hr", "minBudget": "$25,000 - $50,000", "employees": "50 - 99", "reviewScore": "5.0★", "reviewCount": "30", "services": [ "Software Development", ".Net", "PHP" ], "email": "admin@essentialdesigns.net", "phone": "8886946269", "socialLinks": { "facebook": "https://www.facebook.com/teamessentialdesigns", "twitter": "https://twitter.com/essentialdesig", "linkedin": "https://www.linkedin.com/company/essential-designs-inc./https://www.linkedin.com/company/essential-designs-inc./", "instagram": "https://www.instagram.com/essentialdesignsapps/" }, "industries": [ "Design", "Software & IT Services", "Education", "Health Care", "Beauty", "HR", "Hardware & Networking", "Media & Communications", "Hospitality", "Fintech" ], "description": "From Concept to Completion - We Build Apps That Work\n\nSince 2008, we have been helping businesses and entrepreneurs turn ideas into powerful applications. Our team works closely with clients to:\n\nDefine & refine their vision\nSelect the best coding & software solutions\nDeliver a high-quality final product on time and on budget\nExpertise Across All Platforms & Technologies\n\nWhether you need Android or Apple, Native or Responsive, or Web or Mobile, our experienced coding team has you covered. We specialize in leading technologies, including:\n\nASP & PHP\nSwift & Java\nWeb-based & Native Mobile App Development\nWhy Choose Essential Designs?\n\nBoost Business Efficiency - We build apps that streamline workflow, improve accountability, and solve complex problems\nExperienced & Reliable - Our team of senior developers, top designers, and UI/UX specialists ensures exceptional results\nFixed-Cost & On-Time Delivery - No hidden fees, no surprises - just a solid final product that meets and exceeds expectations\nFuture-Proof Support - We've been in business for over a decade, and we'll be here when you need updates or new features\nWe have built hundreds of applications for businesses of all sizes, spanning industries such as:\n\nHealthcare\nEducation\nMining\nFinance\nEnterprise Solutions\nStartups & Entrepreneurs\nWith offices in Vancouver, Calgary, Toronto, Los Angeles and San Diego, were available for face-to-face consultations to discuss your Application Development needs.\n\nContact us today to get started!", "aggregateRating": "5", "headquarters": "55 Water Street #408, Vancouver, V6B 1A1, Canada", "otherLocations": [ "10000 Washington Blvd, Culver City, Culver City, California 90232, United States", "10250 Constellation Blvd, Los Angeles, California 90067, United States", "600 B St, San Diego, California 92101, United States", "630 8 Avenue Southwest #600, Calgary, T2G 2M1, Canada", "545 King Street West, Toronto, M5V 1M1, Canada", "18117 Biscayne Blvd Miami, FL 33160 United States" ] } ``` **Export formats:** JSON, CSV, Excel, HTML, RSS, XML ### Use Cases #### Lead Generation Extract qualified agency leads with verified contact information, services offered, and pricing for targeted outreach campaigns. #### Competitive Intelligence Monitor competitor agencies, analyze their service offerings, pricing strategies, client reviews, and market positioning. #### Market Research Build comprehensive databases of agencies by specialization, location, size, and pricing for industry analysis and benchmarking. #### Partnership Discovery Identify potential agency partners based on complementary services, target industries, and geographic coverage. ### How to Run #### On Apify Platform 1. Navigate to [Apify Store](https://apify.com/store) 2. Search for "DesignRush Scraper" 3. Click **Try for free** 4. Configure input parameters 5. Click **Start** 6. Download results in your preferred format #### Locally ```bash npm install npm start ``` Create `storage/key_value_stores/default/INPUT.json` with your configuration. ### API Integration Integrate DesignRush scraping into your applications: ```javascript const { ApifyClient } = require('apify-client'); const client = new ApifyClient({ token: 'YOUR_API_TOKEN', }); const input = { keyword: "web development agencies in San Francisco", maxItems: 100, includeDetails: true }; const run = await client.actor("YOUR_ACTOR_ID").call(input); const { items } = await client.dataset(run.defaultDatasetId).listItems(); console.log(items); ``` ### Performance & Cost - **Speed:** 50-100 agencies per minute with details enabled - **Cost-effective:** Lightweight scraping without browser rendering - **Scalable:** Handles thousands of agency records efficiently - **Reliable:** Built-in retry logic and anti-blocking measures - **Tested:** Successfully extracts 200+ leads without proxy; larger jobs benefit from proxy usage ### Compliance & Ethics This scraper respects DesignRush's `robots.txt` and implements responsible scraping practices including rate limiting and session rotation. Extracted data should be used in compliance with DesignRush's Terms of Service and applicable data protection regulations. ### Support Need help or have questions? - 📧 Contact via Apify Console - 📝 Report issues on the actor page - 💬 Join the Apify Discord community Made with ❤️ for the Apify community | Powered by Crawlee # Actor input Schema ## `startUrls` (type: `array`): Optional DesignRush category or listing page URLs to scrape directly. If provided, these take priority over keyword matching. ## `keyword` (type: `string`): Optional plain-text search term such as Shopify developers in California. Used only when Start URLs are not provided. ## `maxPages` (type: `integer`): Maximum number of listing pages to crawl across all start URLs. ## `maxItems` (type: `integer`): Maximum number of agency records to push to the dataset. ## `includeDetails` (type: `boolean`): Open each agency profile page and merge JSON-LD/DOM details into the listing record. ## `maxConcurrency` (type: `integer`): Conservative request concurrency. Recommended range is 5-10. ## `minDelayMs` (type: `integer`): Minimum random delay before processing each page. ## `maxDelayMs` (type: `integer`): Maximum random delay before processing each page. ## `proxyConfiguration` (type: `object`): Select proxies to be used by the crawler. ## Actor input object example ```json { "startUrls": [ { "url": "https://www.designrush.com/agency/web-development-companies" } ], "keyword": "Shopify developers in California", "maxPages": 5, "maxItems": 500, "includeDetails": true, "maxConcurrency": 4, "minDelayMs": 400, "maxDelayMs": 1600 } ``` # Actor output Schema ## `results` (type: `string`): No description ## `runSummary` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ { "url": "https://www.designrush.com/agency/web-development-companies" } ], "keyword": "Shopify developers in California" }; // Run the Actor and wait for it to finish const run = await client.actor("nocodeninja_ng/designrush-agency-scraper-lead-extractor").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": [{ "url": "https://www.designrush.com/agency/web-development-companies" }], "keyword": "Shopify developers in California", } # Run the Actor and wait for it to finish run = client.actor("nocodeninja_ng/designrush-agency-scraper-lead-extractor").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ { "url": "https://www.designrush.com/agency/web-development-companies" } ], "keyword": "Shopify developers in California" }' | apify call nocodeninja_ng/designrush-agency-scraper-lead-extractor --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=nocodeninja_ng/designrush-agency-scraper-lead-extractor", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "DesignRush Agency Scraper & Lead Extractor", "description": "Scrape DesignRush to extract B2B leads instantly. Get high-converting data from SEO, Shopify, AI, Webflow, and PPC agencies. Extracts websites, emails, phone numbers, pricing, and social links. Ultra-fast, lightweight Cheerio crawler optimized for low-cost lead generation.", "version": "1.0", "x-build-id": "frtIJHQu4wvs03ZV2" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/nocodeninja_ng~designrush-agency-scraper-lead-extractor/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-nocodeninja_ng-designrush-agency-scraper-lead-extractor", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/nocodeninja_ng~designrush-agency-scraper-lead-extractor/runs": { "post": { "operationId": "runs-sync-nocodeninja_ng-designrush-agency-scraper-lead-extractor", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/nocodeninja_ng~designrush-agency-scraper-lead-extractor/run-sync": { "post": { "operationId": "run-sync-nocodeninja_ng-designrush-agency-scraper-lead-extractor", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "startUrls": { "title": "Start URLs", "type": "array", "description": "Optional DesignRush category or listing page URLs to scrape directly. If provided, these take priority over keyword matching.", "items": { "type": "object", "required": [ "url" ], "properties": { "url": { "type": "string", "title": "URL of a web page", "format": "uri" } } } }, "keyword": { "title": "Keyword", "type": "string", "description": "Optional plain-text search term such as Shopify developers in California. Used only when Start URLs are not provided." }, "maxPages": { "title": "Maximum listing pages", "minimum": 1, "type": "integer", "description": "Maximum number of listing pages to crawl across all start URLs.", "default": 5 }, "maxItems": { "title": "Maximum agencies", "minimum": 1, "type": "integer", "description": "Maximum number of agency records to push to the dataset.", "default": 500 }, "includeDetails": { "title": "Include agency details", "type": "boolean", "description": "Open each agency profile page and merge JSON-LD/DOM details into the listing record.", "default": true }, "maxConcurrency": { "title": "Maximum concurrency", "minimum": 1, "maximum": 10, "type": "integer", "description": "Conservative request concurrency. Recommended range is 5-10.", "default": 4 }, "minDelayMs": { "title": "Minimum delay in milliseconds", "minimum": 0, "type": "integer", "description": "Minimum random delay before processing each page.", "default": 400 }, "maxDelayMs": { "title": "Maximum delay in milliseconds", "minimum": 0, "type": "integer", "description": "Maximum random delay before processing each page.", "default": 1600 }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Select proxies to be used by the crawler." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```