Hex.pm Packages Scraper

Hex.pm Packages Scraper

Scrape Hex.pm packages by search query, up to a million per run. Every package comes with its name, version, downloads, and metadata. No login or API key. Export to CSV, JSON, Excel, or XML.

Hex.pm is the official package registry for Elixir and Erlang, but browsing it manually is slow and the API requires authentication. This Actor reads the public package list directly, filtered by search term, and returns each match in one fixed schema.

Who uses it	What they scrape Hex.pm for
Elixir developers	Which libraries are available for a given task
Erlang developers	Which packages are actively maintained
Market researchers	Which packages are trending in the Elixir ecosystem
DevOps engineers	Which dependencies a project should pin

What it does

This Actor collects Hex.pm packages by search query and returns each one as a flat row.

• 🔍 Search by keyword: find packages by name or description, like phoenix or ecto.
• 📦 Full package list: leave the search empty to browse every package on Hex.pm.
• ⚙️ Flexible limits: collect from 1 to 1,000,000 packages per run.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

What you can do with Hex.pm data

📈 Track package popularity.

A developer runs the Actor weekly with a search for 'phoenix' to see which related packages are gaining downloads and decide what to adopt.

🔎 Audit dependencies.

A DevOps engineer scrapes all packages used by a project to check their latest versions and licenses before a release.

🧪 Research the ecosystem.

A market researcher collects the full package list to analyze which categories are growing and which are stagnant.

📚 Build a package index.

A startup scrapes Hex.pm daily to populate its own searchable database of Elixir libraries.

Why choose this scraper

	What you get
No API key	Scrape Hex.pm without registering an application or managing tokens.
One fixed schema	Every package returns the same fields, so you can merge runs without cleaning.
Export anywhere	Download as CSV, JSON, Excel, or XML, or push to Apify storage.

How it compares

This Actor focuses on search-driven scraping with a high item limit, while competitors offer different field sets or pricing models.

Feature	ParseForge	Hexpm Scraper	Hex.pm Package Scraper	Hex.pm Scraper - Elixir & Erlang Packages
Search by keyword	Yes	Not listed	Yes	Not listed
Fetch by package name	Not listed	Not listed	Yes	Not listed
Download statistics	Yes	Yes	Yes	Yes
Version history	Not listed	Yes	Not listed	Not listed
License information	Not listed	Not listed	Yes	Yes
Repository links	Not listed	Not listed	Yes	Not listed
Max items per run	1,000,000	Not listed	Not listed	Not listed

Configure the run

Drive the Actor with a search query, and set a maximum number of packages to collect. The search runs as each package is read, so only matches reach your dataset. The Input tab lists every parameter.

A first run with the defaults:

{
 "searchQuery": "phoenix",
 "maxItems": 10
}

A larger pull:

{
 "searchQuery": "phoenix",
 "maxItems": 200
}

Pricing

Pay-per-result: $0.021 per result collected. You pay only for the results written to your dataset.

Results collected	Approximate cost
100 results	$2.10
1,000 results	$21.00
10,000 results	$210.00

New Apify accounts start with $5 in free credit.

Free users

Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.

Run it

1. Create a free Apify account with $5 in credit.
2. Open the Hex.pm Packages Scraper.
3. Set your inputs and any filters, then click Start.
4. Export the results as CSV, Excel, JSON, or XML from the Dataset tab.

Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.

Use with AI agents (MCP)

Give an AI agent live access to Hex.pm through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

$claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/hexpm-elixir-packages-scraper"

Then prompt it in plain language to run the scraper and read back the results.

Troubleshooting

Why am I getting no results?

Check your search query. If it is too specific, try a broader term. Also ensure the maximum packages is set high enough.

Why is the run slow?

Hex.pm may rate-limit requests. Reduce the maximum packages or add a delay between requests if the platform allows.

Why are some fields empty?

Not all packages have every metadata field. Empty fields mean the data is not available on the public listing.

Can I scrape a specific package by name?

Yes. Enter the exact package name in the search query, and it will return that package if it exists.

FAQ

Question	Answer
Do I need a Hex.pm API key?	No. This Actor reads the public package list directly, so no authentication is required.
Can I scrape all packages on Hex.pm?	Yes. Leave the search query empty and set a high maximum to collect the full list, up to one million packages per run.
What data does each package include?	Each row includes the package name, latest version, download count, and other metadata available on the public listing.
How do I filter packages?	Use the search query field to match package names or keywords. The filter is applied as packages are read, so only matches are returned.
Can I export the results?	Yes. You can download the dataset as CSV, JSON, Excel, or XML, or access it via the Apify API.
Is there a limit on how many packages I can scrape?	You can set the maximum packages per run from 1 to 1,000,000. The default is 10.
Does this work for Erlang packages too?	Yes. Hex.pm hosts both Elixir and Erlang packages, and this Actor scrapes both.
Can I schedule this Actor to run automatically?	Yes. Use Apify's scheduler to run it daily, weekly, or on any cron schedule.

Related actors

Browse the full ParseForge collection for more scrapers.

🆘 Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.

⚠️ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Hex.pm. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.