# Pub.dev Package Scraper — Dart & Flutter Package Metadata (`klondikeking/pub-dev-scraper`) Actor Extract metadata, scores, dependencies, and publisher details for Dart and Flutter packages from the public Pub.dev API. - **URL**: https://apify.com/klondikeking/pub-dev-scraper.md - **Developed by:** [Pierrick McD0nald](https://apify.com/klondikeking) (community) - **Categories:** Developer tools, Business - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js/docs.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python/docs.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Pub.dev Package Scraper — Dart & Flutter Package Metadata, Scores & Dependencies The Pub.dev Package Scraper extracts structured metadata for Dart and Flutter packages from the public [Pub.dev](https://pub.dev/) API. It is built for mobile developers, DevOps teams, security researchers, and data analysts who need to inventory Flutter dependencies, track package popularity, compare SDK constraints, or monitor the Dart ecosystem. This Actor accepts a list of Pub.dev package names (for example, `bloc`, `http`, `provider`, `shared_preferences`) and returns a clean dataset with the latest version, description, publisher, license, SDK constraints, dependency counts, topic tags, source links, and Pub.dev score data including likes and 30-day downloads. You can also supply a search query to discover packages through Pub.dev search before extraction. ### Use Cases - **Dependency inventory** — Audit every Dart and Flutter package used across your organization and export the results to a spreadsheet, SIEM, or data warehouse. - **Supply-chain monitoring** — Track new releases, deprecated packages, license changes, and SDK compatibility for critical dependencies. - **Competitive research** — Compare Pub.dev scores, likes, and download counts to identify the most trusted and widely adopted libraries in the Flutter ecosystem. - **Security triage** — Flag discontinued packages and outdated SDK constraints that may need upgrading or replacement. - **Dataset creation** — Build a structured corpus of Flutter package metadata for research, search, or internal tooling. - **Migration planning** — Collect SDK constraints (Dart and Flutter) across a package list to plan version upgrades. ### Input | Field | Type | Required | Description | |-------|------|----------|-------------| | `packageNames` | Array | Yes | Pub.dev package names to scrape, e.g., `["bloc", "http", "provider"]` | | `searchQuery` | String | No | Pub.dev search query used to discover additional packages | | `maxItems` | Number | No | Maximum results to output (default: 100) | | `includeScore` | Boolean | No | Fetch Pub.dev score, likes, and 30-day downloads (default: true) | | `includePublisher` | Boolean | No | Fetch the verified publisher ID for each package (default: true) | | `proxyConfiguration` | Object | No | Apify proxy configuration (recommended for production runs) | ### Output The Actor outputs a dataset with one row per Pub.dev package: ```json { "packageName": "bloc", "latestVersion": "9.2.1", "description": "A predictable state management library that helps implement the BLoC design pattern.", "publisherId": "bloclibrary.dev", "license": "mit", "publishedAt": "2025-10-15T00:00:00.000Z", "sdkConstraint": ">=2.14.0 <4.0.0", "dartConstraint": ">=2.14.0 <4.0.0", "flutterConstraint": "", "homepageUrl": "https://github.com/felangel/bloc", "repositoryUrl": "https://github.com/felangel/bloc/tree/master/packages/bloc", "issueTrackerUrl": "https://github.com/felangel/bloc/issues", "documentationUrl": "https://bloclibrary.dev", "dependencyCount": 1, "devDependencyCount": 3, "dependencyNames": "meta", "devDependencyNames": "bloc_lint, mocktail, test", "topicCount": 2, "topics": "bloc, state-management", "grantedPoints": 160, "maxPoints": 160, "likeCount": 3201, "downloadCount30Days": 1881848, "tags": "is:flutter-favorite, publisher:bloclibrary.dev, sdk:dart, sdk:flutter, platform:android, platform:ios, platform:web, license:mit", "deprecated": false, "url": "https://pub.dev/packages/bloc" } ```` ### Pricing Pay per event: **$0.001 per package extracted**. The Actor charges only after successfully extracting metadata, so you never pay for failed or empty requests. ### Limitations - The Actor relies on the public Pub.dev API. Availability and rate limits are governed by Google. - Package names must match the canonical Pub.dev slug exactly (e.g., `shared_preferences`, not `Shared Preferences`). - Score, publisher, and version detail endpoints add one extra API call each per package. - The license field is extracted from the pubspec or Pub.dev score tags when available. ### FAQ **Q: Do I need a Pub.dev account?** A: No. The public Pub.dev API does not require authentication. **Q: Can I scrape all Pub.dev packages at once?** A: The Actor is designed for targeted lists or search queries. Use `maxItems` to cap output and respect API limits. **Q: Why are some fields empty?** A: Pub.dev maintainers provide metadata voluntarily. If a field such as `homepageUrl` or `repositoryUrl` is missing from the upstream package, the output will be blank. ### Changelog - **v1.0.0** — Initial release: package metadata, version details, Pub.dev scores, publisher IDs, dependencies, and source links. # Actor input Schema ## `packageNames` (type: `array`): List of Pub.dev package names to scrape (e.g., bloc, http, provider, shared\_preferences). Each name is treated as a package. ## `searchQuery` (type: `string`): Optional Pub.dev search query. When provided, the Actor discovers packages matching the query and merges them with the explicit package names above. ## `maxItems` (type: `integer`): Maximum number of package records to output. ## `includeScore` (type: `boolean`): Fetch Pub.dev score data (granted points, max points, likes, 30-day downloads, tags) for each package. Adds one extra API call per result. ## `includePublisher` (type: `boolean`): Fetch the verified publisher ID for each package. Adds one extra API call per result. ## `proxyConfiguration` (type: `object`): Select a proxy to route requests through. Residential proxies are recommended for high-volume runs. ## Actor input object example ```json { "packageNames": [ "bloc", "http", "provider" ], "searchQuery": "", "maxItems": 100, "includeScore": true, "includePublisher": true, "proxyConfiguration": { "useApifyProxy": true } } ``` # Actor output Schema ## `results` (type: `string`): No description ## `stats` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "packageNames": [ "bloc", "http", "provider" ], "searchQuery": "", "maxItems": 100, "includeScore": true, "includePublisher": true, "proxyConfiguration": { "useApifyProxy": true } }; // Run the Actor and wait for it to finish const run = await client.actor("klondikeking/pub-dev-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "packageNames": [ "bloc", "http", "provider", ], "searchQuery": "", "maxItems": 100, "includeScore": True, "includePublisher": True, "proxyConfiguration": { "useApifyProxy": True }, } # Run the Actor and wait for it to finish run = client.actor("klondikeking/pub-dev-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "packageNames": [ "bloc", "http", "provider" ], "searchQuery": "", "maxItems": 100, "includeScore": true, "includePublisher": true, "proxyConfiguration": { "useApifyProxy": true } }' | apify call klondikeking/pub-dev-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=klondikeking/pub-dev-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Pub.dev Package Scraper — Dart & Flutter Package Metadata", "description": "Extract metadata, scores, dependencies, and publisher details for Dart and Flutter packages from the public Pub.dev API.", "version": "1.0", "x-build-id": "W1IxDKxwh9WJ3Iv3m" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/klondikeking~pub-dev-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-klondikeking-pub-dev-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/klondikeking~pub-dev-scraper/runs": { "post": { "operationId": "runs-sync-klondikeking-pub-dev-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/klondikeking~pub-dev-scraper/run-sync": { "post": { "operationId": "run-sync-klondikeking-pub-dev-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "packageNames" ], "properties": { "packageNames": { "title": "Package Names", "minItems": 1, "type": "array", "description": "List of Pub.dev package names to scrape (e.g., bloc, http, provider, shared_preferences). Each name is treated as a package.", "items": { "type": "string" }, "default": [ "bloc", "http", "provider" ] }, "searchQuery": { "title": "Search Query", "type": "string", "description": "Optional Pub.dev search query. When provided, the Actor discovers packages matching the query and merges them with the explicit package names above.", "default": "" }, "maxItems": { "title": "Maximum Results", "type": "integer", "description": "Maximum number of package records to output.", "default": 100 }, "includeScore": { "title": "Include Pub Score & Popularity", "type": "boolean", "description": "Fetch Pub.dev score data (granted points, max points, likes, 30-day downloads, tags) for each package. Adds one extra API call per result.", "default": true }, "includePublisher": { "title": "Include Publisher ID", "type": "boolean", "description": "Fetch the verified publisher ID for each package. Adds one extra API call per result.", "default": true }, "proxyConfiguration": { "title": "Proxy Configuration", "type": "object", "description": "Select a proxy to route requests through. Residential proxies are recommended for high-volume runs.", "default": { "useApifyProxy": true } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```