conda-forge Packages Scraper
Pricing
from $19.00 / 1,000 results
conda-forge Packages Scraper
Scrapes conda-forge packages by search term or name prefix and returns each package as a flat row with name, summary, description, and metadata. Export to CSV, JSON, Excel, or XML.
Pricing
from $19.00 / 1,000 results
Rating
0.0
(0)
Developer
ParseForge
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
3 days ago
Last modified
Categories
Share
conda-forge Packages Scraper
Scrape conda-forge packages by search term or name prefix, up to a million per run. Every package comes with its name, version, summary, and full metadata. No login or API key. Export to CSV, JSON, Excel, or XML.
conda-forge hosts over 25,000 community-maintained conda packages for Python, R, and scientific computing, but browsing the channel by hand is slow and the official API needs registration. This Actor reads the public package index directly, filters by a search term or name prefix, and returns each match in one fixed schema.
| Who uses it | What they scrape conda-forge for |
|---|---|
| Data scientists | Audit which conda-forge packages are available for a dependency before pinning versions |
| DevOps engineers | Build an inventory of conda-forge packages used across environments |
| Package maintainers | Monitor the conda-forge channel for packages that match a naming convention |
| Security researchers | List conda-forge packages by prefix to review metadata for supply-chain checks |
What it does
This Actor collects conda-forge package records by search term or name prefix, and returns each one as a flat row with its name, version, summary, and metadata.
- ๐ Search filter: keep only packages whose name, summary, or description contains your term, like numpy or gis.
- ๐ค Name prefix: keep only packages whose name starts with a prefix, like py or gdal.
- ๐ Pagination: use Offset and Maximum packages to page through the full channel alphabetically.
- ๐ฆ Flat rows: every package is returned as one row, ready for CSV, JSON, Excel, or XML export.
Results export to CSV, JSON, Excel, or XML, or straight from the API.
What you can do with conda-forge data
๐ Audit dependencies.
A data scientist searches conda-forge for a package name to confirm it exists and check its summary before adding it to an environment.yml.
๐๏ธ Build a package inventory.
A DevOps engineer pages through conda-forge with a prefix like py to list all matching packages and export them to CSV for an internal registry.
๐ Monitor naming conventions.
A package maintainer runs the Actor weekly with a prefix to see if new conda-forge packages match their project's namespace.
๐ก๏ธ Review metadata for security.
A security researcher collects conda-forge packages by search term and reviews the returned metadata for suspicious summaries or versions.
Why choose this scraper
| What you get | |
|---|---|
| No API key | Reads the public conda-forge package index directly, no registration or rate limits |
| Filter as you go | Search term and name prefix filters run before collection, so only matches reach your dataset |
| Page through everything | Offset and Maximum packages let you collect the full channel in chunks |
| Fixed schema | Every package returns the same flat fields, so downstream processing is predictable |
How it compares
This Actor focuses on simple search and prefix filtering of conda-forge packages, while the competitors below offer additional features like maintainer listing or Anaconda-specific data.
| Feature | ParseForge | Conda-Forge Scraper | Anaconda Conda Package Scraper - Versions & Downloads |
|---|---|---|---|
| Search by package name or summary | Yes | Yes | Not listed |
| Filter by name prefix | Yes | Not listed | Not listed |
| List packages by maintainer | Not listed | Yes | Not listed |
| Package versions and downloads | Not listed | Not listed | Yes |
| License and platform data | Not listed | Not listed | Yes |
| Export to CSV, JSON, Excel, XML | Yes | Not listed | Yes |
Configure the run
Drive the Actor with a search term or a name prefix, alone or together, and use Offset and Maximum packages to page through the channel. The Input tab lists every parameter.
A first run with the defaults:
{"offset": 0,"maxItems": 10}
A larger pull:
{"offset": 0,"maxItems": 200}
Pricing
Pay-per-result: $0.021 per result collected. You pay only for the results written to your dataset.
| Results collected | Approximate cost |
|---|---|
| 100 results | $2.10 |
| 1,000 results | $21.00 |
| 10,000 results | $210.00 |
New Apify accounts start with $5 in free credit.
Free users
Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.
Run it
- Create a free Apify account with $5 in credit.
- Open the conda-forge Packages Scraper.
- Set your inputs and any filters, then click Start.
- Export the results as CSV, Excel, JSON, or XML from the Dataset tab.
Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.
Use with AI agents (MCP)
Give an AI agent live access to conda-forge through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:
$claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/conda-forge-packages-scraper"
Then prompt it in plain language to run the scraper and read back the results.
Troubleshooting
Why am I getting no results?
Check that your Search term or Name Starts With input is not too restrictive. Try leaving both empty and setting a small Maximum packages to see the first packages in the channel.
Why did the run stop before collecting all packages?
The Maximum packages input limits the run. Increase it, or use Offset to continue from where the previous run stopped.
Why is the output missing some fields?
The Actor returns the fields available in the conda-forge index. Some packages may have empty values for optional metadata like summary.
Can I use this Actor for the Anaconda default channel?
No, this Actor scrapes conda-forge only. For the Anaconda default channel, use a different scraper.
FAQ
| Question | Answer |
|---|---|
| What is conda-forge? | conda-forge is a community-led collection of conda packages for scientific Python, R, and other languages. It is the default channel for many data science environments. |
| Do I need an API key or login? | No. This Actor reads the public conda-forge package index directly, so there is no registration, OAuth, or rate limit to manage. |
| How do I search for a package? | Set the Search term input to a word like numpy or gis. The Actor keeps only packages whose name, summary, or description contains that text. |
| How do I list packages by name prefix? | Set the Name Starts With input to a prefix like py or gdal. The filter is case-insensitive and runs before collection. |
| Can I collect all conda-forge packages? | Yes. Leave Search term and Name Starts With empty, set Maximum packages to a high number, and use Offset to page through the full channel alphabetically. |
| What fields does each package row contain? | Each row includes the package name, version, summary, and other metadata from the conda-forge index. The exact fields are shown in the sample output. |
| What export formats are supported? | You can export the dataset to CSV, JSON, Excel, or XML from the Apify platform. |
| How many packages can I collect in one run? | The Maximum packages input accepts up to 1,000,000, so you can collect the entire channel in a single run if needed. |
| Is this the same as the Anaconda package repository? | No. conda-forge is a separate community channel. This Actor scrapes conda-forge only, not the Anaconda default channel. |
| Can I filter by package version or license? | Not directly. The Actor filters by search term and name prefix only. You can post-process the exported data to filter by version or license. |
Related actors
Browse the full ParseForge collection for more scrapers.
๐ Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.
โ ๏ธ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by conda-forge community. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.
