📦 Hex.pm Package Scraper

🚀 Export Elixir and Erlang package data from Hex.pm in seconds. Search or browse the full Hex.pm registry by keyword or sort order, and pull download stats, versions, licenses, links, and timestamps. No API key, no login, no parser maintenance.

The Hex.pm Package Scraper exports structured metadata for every Elixir and Erlang package published to hex.pm - the package manager for the BEAM ecosystem. Each record captures 12 fields, including the package name, latest version, description, cumulative and recent download counts, licenses, external links, owner API endpoint, and ingestion timestamps.

Hex.pm is the primary distribution hub for Phoenix, Ecto, LiveView, and thousands of BEAM-compatible libraries. This Actor makes the entire catalog queryable and exportable without you writing a single parser.

🎯 Target Audience	💡 Primary Use Cases
Elixir/Erlang developers, open-source researchers, security teams, ecosystem analysts, developer-tool builders, data scientists	Dependency auditing, popularity analysis, ecosystem research, vulnerability triage, trend tracking, OSS discovery

📋 What the Hex.pm Package Scraper does

Four workflows in a single run:

• 📦 Full registry export. Every public package on Hex.pm sorted by your chosen field.
• 🔍 Keyword search. Search for packages matching a term like phoenix, ecto, or json.
• 📊 Popularity ranking. Sort by total downloads, recent activity, name, or newest first.
• 🕒 Timestamped snapshots. Every record includes insertedAt, updatedAt, and scrapedAt for point-in-time tracking.

Each record includes the package name, direct Hex.pm URL, latest version, description, total and recent downloads, license list, external links object, owners API endpoint, and both Hex.pm timestamps.

💡 Why it matters: manually browsing Hex.pm is fine for finding one library - but auditing your company's full dependency surface, tracking ecosystem trends, or building a package-search tool requires bulk structured data. This Actor delivers that in under a minute, without touching the HTML.

📊 Data fields

Each record includes: description, insertedAt, latestVersion, licenses, name, recentDownloads, results, scrapedAt, totalDownloads, updatedAt, url. These field names come straight from the actor's dataset schema, so what you see here is what lands in your dataset.

🚀 How to use

1. 📝 Sign up. Create a free account with $5 credit (takes 2 minutes).
2. 🌐 Open the Actor. Go to the Hex.pm Package Scraper page on the Apify Store.
3. 🎯 Set input. Optionally enter a search term, choose a sort order, and set maxItems.
4. 🚀 Run it. Click Start and let the Actor collect your packages.
5. 📥 Download. Grab your results in the Dataset tab as CSV, Excel, JSON, or XML.

⏱️ Total time from signup to downloaded dataset: 3-5 minutes. No coding required.

🔗 Recommended Actors

• 📦 npm Registry Scraper - JavaScript and Node.js package metadata from npmjs.com
• 🦀 Crates.io Scraper - Rust package registry with download stats and metadata
• 💎 RubyGems Scraper - Ruby gem metadata, versions, and download counts
• 🐍 PyPI Scraper - Python package index with classifiers and dependency data
• 📦 NuGet Scraper - .NET package registry with version history and stats

💡 Pro Tip: browse the complete ParseForge collection for more registry and developer-tool scrapers.

⚠️ Disclaimer: this Actor is an independent tool and is not affiliated with, endorsed by, or sponsored by Hex.pm, Dashbit, or Erlang Ecosystem Foundation. All trademarks mentioned are the property of their respective owners. Only publicly available data from the Hex.pm public REST API is collected.

🆘 Need Help?

If you hit a bug, have questions about setup, or need a scraper we haven't built yet, open our contact form or write to parseforge@protonmail.com. We also take on paid custom data projects.

For faster answers, join our Discord. It's the best place to get support and suggest new actors.