conda-forge Packages Scraper avatar

conda-forge Packages Scraper

Pricing

from $19.00 / 1,000 results

Go to Apify Store
conda-forge Packages Scraper

conda-forge Packages Scraper

Scrapes conda-forge packages by search term or name prefix and returns each package as a flat row with name, summary, description, and metadata. Export to CSV, JSON, Excel, or XML.

Pricing

from $19.00 / 1,000 results

Rating

0.0

(0)

Developer

ParseForge

ParseForge

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

3 days ago

Last modified

Share

ParseForge

conda-forge Packages Scraper

Scrape conda-forge packages by search term or name prefix, up to a million per run. Every package comes with its name, version, summary, and full metadata. No login or API key. Export to CSV, JSON, Excel, or XML.

conda-forge hosts over 25,000 community-maintained conda packages for Python, R, and scientific computing, but browsing the channel by hand is slow and the official API needs registration. This Actor reads the public package index directly, filters by a search term or name prefix, and returns each match in one fixed schema.

Who uses itWhat they scrape conda-forge for
Data scientistsAudit which conda-forge packages are available for a dependency before pinning versions
DevOps engineersBuild an inventory of conda-forge packages used across environments
Package maintainersMonitor the conda-forge channel for packages that match a naming convention
Security researchersList conda-forge packages by prefix to review metadata for supply-chain checks

What it does

This Actor collects conda-forge package records by search term or name prefix, and returns each one as a flat row with its name, version, summary, and metadata.

  • ๐Ÿ” Search filter: keep only packages whose name, summary, or description contains your term, like numpy or gis.
  • ๐Ÿ”ค Name prefix: keep only packages whose name starts with a prefix, like py or gdal.
  • ๐Ÿ“„ Pagination: use Offset and Maximum packages to page through the full channel alphabetically.
  • ๐Ÿ“ฆ Flat rows: every package is returned as one row, ready for CSV, JSON, Excel, or XML export.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

What you can do with conda-forge data

๐Ÿ“Š Audit dependencies.

A data scientist searches conda-forge for a package name to confirm it exists and check its summary before adding it to an environment.yml.

๐Ÿ—‚๏ธ Build a package inventory.

A DevOps engineer pages through conda-forge with a prefix like py to list all matching packages and export them to CSV for an internal registry.

๐Ÿ”Ž Monitor naming conventions.

A package maintainer runs the Actor weekly with a prefix to see if new conda-forge packages match their project's namespace.

๐Ÿ›ก๏ธ Review metadata for security.

A security researcher collects conda-forge packages by search term and reviews the returned metadata for suspicious summaries or versions.

Why choose this scraper

What you get
No API keyReads the public conda-forge package index directly, no registration or rate limits
Filter as you goSearch term and name prefix filters run before collection, so only matches reach your dataset
Page through everythingOffset and Maximum packages let you collect the full channel in chunks
Fixed schemaEvery package returns the same flat fields, so downstream processing is predictable

How it compares

This Actor focuses on simple search and prefix filtering of conda-forge packages, while the competitors below offer additional features like maintainer listing or Anaconda-specific data.

FeatureParseForgeConda-Forge ScraperAnaconda Conda Package Scraper - Versions & Downloads
Search by package name or summaryYesYesNot listed
Filter by name prefixYesNot listedNot listed
List packages by maintainerNot listedYesNot listed
Package versions and downloadsNot listedNot listedYes
License and platform dataNot listedNot listedYes
Export to CSV, JSON, Excel, XMLYesNot listedYes

Configure the run

Drive the Actor with a search term or a name prefix, alone or together, and use Offset and Maximum packages to page through the channel. The Input tab lists every parameter.

A first run with the defaults:

{
"offset": 0,
"maxItems": 10
}

A larger pull:

{
"offset": 0,
"maxItems": 200
}

Pricing

Pay-per-result: $0.021 per result collected. You pay only for the results written to your dataset.

Results collectedApproximate cost
100 results$2.10
1,000 results$21.00
10,000 results$210.00

New Apify accounts start with $5 in free credit.

Free users

Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.

Run it

  1. Create a free Apify account with $5 in credit.
  2. Open the conda-forge Packages Scraper.
  3. Set your inputs and any filters, then click Start.
  4. Export the results as CSV, Excel, JSON, or XML from the Dataset tab.

Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.

Use with AI agents (MCP)

Give an AI agent live access to conda-forge through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

$claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/conda-forge-packages-scraper"

Then prompt it in plain language to run the scraper and read back the results.

Troubleshooting

Why am I getting no results?

Check that your Search term or Name Starts With input is not too restrictive. Try leaving both empty and setting a small Maximum packages to see the first packages in the channel.

Why did the run stop before collecting all packages?

The Maximum packages input limits the run. Increase it, or use Offset to continue from where the previous run stopped.

Why is the output missing some fields?

The Actor returns the fields available in the conda-forge index. Some packages may have empty values for optional metadata like summary.

Can I use this Actor for the Anaconda default channel?

No, this Actor scrapes conda-forge only. For the Anaconda default channel, use a different scraper.

FAQ

QuestionAnswer
What is conda-forge?conda-forge is a community-led collection of conda packages for scientific Python, R, and other languages. It is the default channel for many data science environments.
Do I need an API key or login?No. This Actor reads the public conda-forge package index directly, so there is no registration, OAuth, or rate limit to manage.
How do I search for a package?Set the Search term input to a word like numpy or gis. The Actor keeps only packages whose name, summary, or description contains that text.
How do I list packages by name prefix?Set the Name Starts With input to a prefix like py or gdal. The filter is case-insensitive and runs before collection.
Can I collect all conda-forge packages?Yes. Leave Search term and Name Starts With empty, set Maximum packages to a high number, and use Offset to page through the full channel alphabetically.
What fields does each package row contain?Each row includes the package name, version, summary, and other metadata from the conda-forge index. The exact fields are shown in the sample output.
What export formats are supported?You can export the dataset to CSV, JSON, Excel, or XML from the Apify platform.
How many packages can I collect in one run?The Maximum packages input accepts up to 1,000,000, so you can collect the entire channel in a single run if needed.
Is this the same as the Anaconda package repository?No. conda-forge is a separate community channel. This Actor scrapes conda-forge only, not the Anaconda default channel.
Can I filter by package version or license?Not directly. The Actor filters by search term and name prefix only. You can post-process the exported data to filter by version or license.

Browse the full ParseForge collection for more scrapers.

๐Ÿ†˜ Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.

โš ๏ธ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by conda-forge community. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.