Julia Packages Scraper
Pricing
from $3.00 / 1,000 results
Julia Packages Scraper
Scrape Julia package metadata from the official Julia General Registry. Search packages by name or fetch specific packages - get version, repo URL, dependencies, and more.
Pricing
from $3.00 / 1,000 results
Rating
5.0
(4)
Developer
Crawler Bros
Maintained by CommunityActor stats
4
Bookmarked
2
Total users
1
Monthly active users
2 days ago
Last modified
Categories
Share
Scrape Julia package metadata from the official Julia General Registry. Search for packages by name or fetch specific packages — get UUID, latest version, repository URL, dependencies, and more.
Features
- Search packages by name query (prefix and substring matching)
- Fetch specific packages by exact name
- Extracts: package name, UUID, latest version, repository URL, dependencies, source URL
- No authentication required — uses publicly available GitHub raw content
- Handles the full Julia General Registry (10,000+ packages)
Input
| Field | Type | Description | Default |
|---|---|---|---|
mode | String (select) | searchPackages or getByName | searchPackages |
searchQuery | String | Name query for package search | DataFrames |
packageNames | Array of strings | Exact package names for getByName mode | [] |
maxItems | Integer (1–500) | Maximum number of records to return | 10 |
Mode: searchPackages
Search the Julia General Registry for packages whose name matches the query string. Prefix matches are ranked first, followed by substring matches.
Example input:
{"mode": "searchPackages","searchQuery": "DataFrames","maxItems": 10}
Mode: getByName
Fetch specific packages by their exact registered name (case-insensitive).
Example input:
{"mode": "getByName","packageNames": ["DataFrames", "Plots", "Flux"],"maxItems": 10}
Output
Each record contains:
| Field | Type | Description |
|---|---|---|
packageName | String | Registered package name |
uuid | String | Unique identifier from registry |
version | String | Latest registered version |
repositoryUrl | String | Git repository URL |
description | String | Package description (if available) |
license | String | License (if specified in Package.toml) |
dependencies | Array | Names of direct dependencies |
sourceUrl | String | JuliaHub package page URL |
registryUrl | String | GitHub registry entry URL |
recordType | String | Always "package" |
scrapedAt | String | ISO 8601 timestamp |
Sample Output Record
{"packageName": "DataFrames","uuid": "a93c6f00-e57d-5684-b7b6-d8193f3e46c0","version": "1.8.2","repositoryUrl": "https://github.com/JuliaData/DataFrames.jl.git","dependencies": ["CategoricalArrays","DataAPI","DataStructures","InvertedIndices","PooledArrays","PrettyTables","Printf","Random","Reexport","SentinelArrays","SortingAlgorithms","Statistics","TableTraits","Tables","Unicode"],"sourceUrl": "https://juliahub.com/ui/Packages/DataFrames","registryUrl": "https://github.com/JuliaRegistries/General/tree/master/D/DataFrames","recordType": "package","scrapedAt": "2026-05-30T12:00:00+00:00"}
Data Source
Data is sourced directly from the Julia General Registry on GitHub — the official central registry for Julia packages. No authentication is required.
FAQs
Q: How many Julia packages are in the registry? A: The Julia General Registry contains over 10,000 registered packages.
Q: Does the actor require a GitHub API token?
A: No. The actor fetches raw TOML files directly from raw.githubusercontent.com, which does not require authentication.
Q: What if a package has no description?
A: The description field is omitted. Julia's Package.toml format does not always include a description field.
Q: How is the latest version determined?
A: The actor reads Versions.toml from the registry and takes the last listed version entry.
Q: Why is there a registryUrl and a sourceUrl?
A: registryUrl points to the package's folder in the Julia General Registry on GitHub. sourceUrl points to the JuliaHub page, which provides a richer browsing experience.
Q: Can I fetch a specific version? A: The actor always retrieves the latest registered version. Fetching specific versions is not supported.