SourceForge Software Search Scraper

This actor allows you to discover and extract comprehensive software listings from SourceForge.net by providing a search URL. It automatically navigates through multiple pages and collects detailed information about each software product.

Features

• URL-based Scraping: Find software by providing a complete SourceForge search URL
• Automatic Pagination: Automatically clicks through pagination links to collect results across multiple pages
• Comprehensive Software Data: Extract detailed information about each software listing including:
  • Product name and description
  • Company or developer information
  • Icon and branding assets
  • Rating and review counts
  • Pricing information
• Smart Navigation: Handles pagination gracefully until reaching the end of results or maximum item limit

Input Parameters

Field	Type	Required	Description
searchUrl	string	Yes	Complete SourceForge search URL to scrape
maxItems	integer	No	Maximum number of software products to fetch
proxyConfiguration	object	No	Proxy settings for the actor

Output

The output is a main list of software product objects, each containing:

• searchUrl: The original search URL used
• productUrl: Direct URL to the software product page
• iconUrl: URL of the software icon or logo
• name: Name of the software product
• company: Company or developer name
• description: Brief description of the software
• ratingsCount: Number of ratings/reviews
• startingPrice: Starting price or pricing information
• scrapedAt: Timestamp of when the data was collected

Example output:

[
  {
    "searchUrl": "https://sourceforge.net/software/?q=ai&page=1",
    "productUrl": "https://sourceforge.net/software/product/Vertex-AI/",
    "iconUrl": "//a.fsdn.com/allura/s/google-cloud-ml-engine/icon?...",
    "name": "Vertex AI",
    "company": "Google",
    "description": "Use Vertex Data Labeling to generate highly accurate labels for your data collection...",
    "ratingsCount": 783,
    "startingPrice": "Free ($300 in free credits)",
    "scrapedAt": "2025-02-05T10:30:00.000Z"
  },
  ...
]

Use Cases

• Software discovery and market research
• Competitor analysis in the open-source ecosystem
• Technology trend identification
• Building software directories and catalogs
• Pricing research and comparison
• Developer tool evaluation

Notes

• The actor automatically navigates through pagination until no more results are available
• Results are limited by the maxItems parameter to control execution time and costs
• All data is timestamped when scraped for tracking purposes
• The actor includes appropriate delays between actions to ensure reliable data collection

---

Start discovering software solutions on SourceForge today!