npm Package Scraper

Extract data from the npm registry. Get package details including download statistics, dependencies, maintainers, and npm quality scores.

Features

• 5 Scrape Modes: Popular, Search, Keyword, Author, Details
• Rich Data: Downloads, dependencies, maintainers, scores, license info
• Fast API-Based: Direct npm registry API access
• Quality Scores: npm's popularity, quality, and maintenance scores

Use Cases

• JavaScript Ecosystem Research: Analyze package trends and popularity
• Dependency Auditing: Track dependencies and their maintainers
• Competitor Analysis: Monitor competing packages
• Author Portfolio: Get all packages from specific developers
• Tech Trend Tracking: Discover trending packages and technologies

Input Parameters

Parameter	Type	Description
scrapeMode	string	Mode: popular, search, keyword, author, details
searchQuery	string	Search term (for search mode)
keyword	string	Package keyword/tag (for keyword mode)
author	string	Author username (for author mode)
packageNames	array	List of package names (for details mode)
sortBy	string	Sort by: popularity, quality, maintenance, optimal
maxResults	integer	Maximum results (1-1000)

Output Data

Each package includes:

{
  "name": "express",
  "version": "4.18.2",
  "description": "Fast, unopinionated, minimalist web framework",
  "keywords": ["express", "framework", "web", "http", "rest", "api"],
  "author_name": "TJ Holowaychuk",
  "publisher_name": "dougwilson",
  "maintainers": ["dougwilson", "jasnell"],
  "license": "MIT",
  "homepage": "http://expressjs.com/",
  "repository_url": "https://github.com/expressjs/express",
  "npm_url": "https://www.npmjs.com/package/express",
  "downloads_weekly": 25000000,
  "downloads_monthly": 100000000,
  "dependents_count": 85000,
  "dependencies": ["accepts", "body-parser", "..."],
  "dev_dependencies": ["mocha", "nyc", "..."],
  "has_types": false,
  "score_final": 0.95,
  "score_quality": 0.92,
  "score_popularity": 0.99,
  "score_maintenance": 0.88
}

Example Usage

Get Most Popular Packages

{
  "scrapeMode": "popular",
  "maxResults": 100
}

Search for React Packages

{
  "scrapeMode": "search",
  "searchQuery": "react",
  "sortBy": "popularity",
  "maxResults": 50
}

Get Packages by Keyword

{
  "scrapeMode": "keyword",
  "keyword": "cli",
  "maxResults": 100
}

Get All Packages from an Author

{
  "scrapeMode": "author",
  "author": "sindresorhus",
  "maxResults": 200
}

Get Details for Specific Packages

{
  "scrapeMode": "details",
  "packageNames": ["lodash", "express", "react", "vue", "angular"]
}

Popular Keywords

• cli - Command line tools
• framework - Web frameworks
• database - Database clients
• testing - Testing utilities
• typescript - TypeScript tools
• react - React ecosystem
• vue - Vue ecosystem
• utility - Utility libraries

npm Quality Scores

The scraper includes npm's official quality metrics:

• Popularity: Based on downloads and dependents
• Quality: Based on tests, documentation, linting
• Maintenance: Based on release frequency, issue response

Integrations

Export data to:

• JSON, CSV, Excel
• Google Sheets
• Webhooks
• API endpoints

Pricing

Pay-per-result: $2.00 per 1,000 packages

Support

For issues or feature requests, contact the developer through Apify.