Github Insight Scraper

GitHub Repository Insight Scraper

Extracts real-time repository velocity, contributor statistics, pull request movement, issue tracking, and commit volume metrics across target GitHub repositories.

By harvesting raw pulse data over custom time intervals, this tool gives engineering leads, product managers, and open-source analysts deep visibility into repository activity without rate-limit constraints.

FEATURES

Flexible Pulse Windows: Analyze repository velocity over daily, halfweekly, weekly, or monthly time ranges.

Modular Insight Extraction: Target specific reporting features using modular configurations:

overview: High-level tracking of merged PRs, new issues, releases, and discussions.

summary: Line-level code churn metrics (additions, deletions, filesChanged, and total master commits).

top_commits: Ranking individual contributor commit volume (commits, author handles, and gravatar avatars).

contributors: Weekly breakdown of commits, additions, and deletions per individual contributor.

commit_activity: Daily commit counts mapped across a 7-day weekly breakdown (days array starting from Sunday).

code_frequency: Historical weekly volume of code lines added (additions) and removed (deletions).

PR & Issue Activity Auditing: Monitor active pull requests (mergedPulls, newPulls) and issue resolutions (closedIssues, newIssues) along with author engagement counts.

Release & Discussion Tracking: Map structural tagged releases (releases) alongside active community discussions (discussions).

Multi-Repository Batch Auditing: Query multiple public GitHub repositories in a single run.

USE CASES

Engineering Velocity & Contribution Tracking: Audit developer productivity and team bandwidth across open-source or internal repositories by monitoring commit distributions and active author metrics.

Competitor Open-Source Benchmarking: Compare contribution speeds, code churn (additions vs. deletions), and release frequencies across competing open-source projects (e.g., framework or AI model repositories).

Automated Weekly Executive Summaries: Generate weekly project health summaries to track newly opened bugs, merged pull requests, and tagging timelines.

Contributor Community Sourcing: Identify key contributors (authorsWithCommits, numAuthorsMergedPulls) driving core features within targeted open-source ecosystems.

INPUT

period: "daily", "halfweekly", "weekly" or "monthly"

feature: "overview", "summary", "top_commits", "contributors", "commit_activity" or "code_frequency"

repositories: list of targeted repositories

ex : ["https://github.com/anthropics/claude-code", "https://github.com/deepseek-ai/DeepSeek-V3"]

OUTPUTS

Top Commits

{
  "name": "Félix Malfait",
  "login": "FelixMalfait",
  "gravatar": "https://avatars.githubusercontent.com/u/6399865?s=60&v=4",
  "commits": 73,
  "hovercard_url": "/users/FelixMalfait/hovercard"
}

Summary

{
  "authorsWithCommits": 35,
  "filesChanged": 3619,
  "additions": 88797,
  "deletions": 69740,
  "masterCommits": 225,
  "totalCommits": 648,
  "defaultBranch": "main",
  "comparePathUrl": "/twentyhq/twenty/compare/763d31a859d420efffe9fa6788a80f25803c180f...main"
}

Overview

{
  "period": "weekly",
  "rangeLabel": "July 26, 2026 – August 2, 2026",
  "totalPullRequests": 270,
  "totalIssues": 44,
  "mergedPulls": [
      {
          "title": "i18n - docs translations",
          "createdAt": "2026-08-01T16:48:45Z",
          "mergedAt": "2026-08-01T16:48:56Z",
          "number": 23670,
          "path": "/twentyhq/twenty/pull/23670"
      }
  ],
  "numAuthorsMergedPulls": 23,
  "newPulls": [
      {
          "title": "Twenty-front: Record Calendar multi drag functionality",
          "createdAt": "2026-07-26T12:54:16Z",
          "mergedAt": null,
          "number": 23316,
          "path": "/twentyhq/twenty/pull/23316"
      }
  ],
  "numAuthorsNewPulls": 24,
  "closedIssues": [
      {
          "title": "Misleading error message for invalid nav menu item config",
          "createdAt": "2026-07-29T09:34:14Z",
          "closedAt": "2026-07-31T16:36:10Z",
          "number": 23484,
          "path": "/twentyhq/twenty/issues/23484"
      }
  ],
  "numAuthorsClosedIssues": 8,
  "newIssues": [
      {
          "title": "Kanban board on mobile: scrolling and dragging conflict, making navigation nearly impossible",
          "createdAt": "2026-08-02T06:53:41Z",
          "closedAt": null,
          "number": 23675,
          "path": "/twentyhq/twenty/issues/23675"
      }
  ],
  "numAuthorsNewIssues": 10,
  "discussions": [
      {
          "title": "User invite role select is only interactive after navigating to roles tab",
          "createdAt": "2026-07-26T14:27:16Z",
          "number": 23302,
          "path": "https://github.com/twentyhq/twenty/issues/23302",
          "commentCount": 0
      }
  ],
  "numAuthorsDiscussions": 12,
  "releases": [
      {
          "title": "twenty/v2.25.0",
          "createdAt": "2026-07-29T08:19:59Z",
          "number": "twenty/v2.25.0",
          "path": "/twentyhq/twenty/releases/tag/twenty%2Fv2.25.0"
      }
  ],
  "numAuthorsReleases": 2
}

Contributors

{
  "author": {
    "id": 263973075,
    "login": "jportner-ant",
    "avatar": "https://avatars.githubusercontent.com/u/263973075?s=60&v=4",
    "path": "/jportner-ant",
    "hovercard_url": "/users/jportner-ant/hovercard"
  },
  "total": 1,
  "weeks": [
    {
      "week": 1739664000,
      "week_date": "16-02-2025",
      "additions": 0,
      "commits": 0,
      "deletions": 0
    },
    {
      "week": 1740268800,
      "week_date": "23-02-2025",
      "additions": 0,
      "commits": 0,
      "deletions": 0
    }
  ]
}

Commit Activity

{
  "days": [
    0,
    6,
    0,
    0,
    3,
    3,
    3
  ],
  "total": 15,
  "week": 1754784000,
  "week_date": "10-08-2025"
}

Code Frequency

{
  "timestamp": 1739664000,
  "date": "16-02-2025",
  "additions": 315,
  "deletions": 0
}

🛟 SUPPORT

Share your runs with the developer team and create issues on error to help us improve actor quality.

You might discover edge case we didn't test yet

We stay available anytime