articleschannelstagsspacestoolkit
Microsoft Dev Blogs

Visualize ROI of your GitHub Copilot Usage, How it works!

View Original
thumbnail

Copilot Usage Advanced Dashboard

Data Collection

The system utilizes four key Copilot APIs to gather comprehensive usage data: Organization team listing, Team usage summaries, Organizational seat information and settings, and Seat assignment tracking.

Key Features

  1. Long-term Data Persistence

    • Historical data stored in Elasticsearch beyond the 28-day limit.
    • Flexible time period selection for trend analysis.
    • Granular organizational and team-level data filtering.

  2. Advanced Analytics

    • Language and editor usage breakdown.
    • Team performance comparisons.
    • Seat utilization metrics.
    • Activation rate tracking.
    • Custom alert configuration for inactive users.

  3. Integration Capabilities

    • Seamless integration with existing Grafana deployments.
    • Export capabilities for third-party visualization tools.
    • Flexible data source additions for comprehensive DevOps metrics.

Why Built This

This project aims to offer a more comprehensive and lasting view of GitHub Copilot usage beyond the default 28-day limit. By storing and updating data over time, supporting multiple organizations and teams, and providing flexible options for external data integration, this project helps users gain deeper insights into both ROI of Copilot usage and related DevOps metrics within a unified dashboard.

Organization

  • Get all the teams under the organization.
  • Calculate complete Organization-level data based on team summaries.

Teams

  • Aggregate data by teams to obtain data comparisons of different teams.
  • Data includes the number of teams, top teams by accepted prompts, acceptance rate, and team breakdown.

Languages

  • Aggregate data by languages to obtain data comparisons for different languages.
  • Data includes the number of languages, top languages by accepted prompts, acceptance rate, and languages breakdown.

Editors

  • Aggregate data by editors to obtain data comparisons for different editors.

Copilot Chat

  • Analyze the usage of Copilot Chat based on team summaries.

Breakdown Heatmap

  • Analyze data by languages and editors to provide insights through a heatmap visualization.

Copilot Seat Info & Top Languages

  • View the distribution of seats between Enterprise and Business license types.

Copilot Usage Total Insight

  • Analyze the total number of recommendations and adoption rate trends based on count of lines and chats.