Managing Scorecards
Create and manage engineering scorecards to define service health standards, track compliance with weighted rules, and monitor maturity across teams.
Service Scorecards (/scorecards) let you define measurable standards for service quality, then track every team's compliance over time. Each scorecard contains weighted rules that evaluate metrics like deployment frequency, test coverage, PR size, and cycle time against thresholds you set.
Scorecards overview page
The main page at /scorecards shows:
Summary tiles
Four tiles at the top summarize the current state:
- Healthy -- scorecards where all rules are passing
- Warning -- scorecards with some rules below threshold
- Critical -- scorecards with significant failures
- Maturity -- organization-wide maturity tier based on average score (Elite, Gold, Silver, or Bronze)
Compliance overview
A table showing per-repository maturity levels across all scorecards, with average scores and level distribution (Gold, Silver, Bronze, None). This gives leadership a single view of where each repository stands.
Heatmap
A visual heatmap of scorecard scores across teams and repositories. Color intensity indicates the score, making it easy to spot weak areas at a glance.
Scorecard grid
A card grid of all defined scorecards. Each card shows:
- Scorecard name and description
- Latest evaluation score (out of 100) with a progress bar
- Status indicator (healthy, warning, or critical)
- Number of rules and last evaluation date
Click any card to open the scorecard detail page.
Creating a scorecard
Click New Scorecard on the scorecards page to open the creation form at /settings/scorecards/new.
Defining rules
Each scorecard contains one or more rules. A rule evaluates a specific metric against a threshold:
| Field | Description |
|---|---|
| Metric | The metric to evaluate (e.g., deployment frequency, test coverage, cycle time, PR size, review time, change failure rate, MTTR, open PRs, security vulnerabilities) |
| Operator | Comparison operator: greater than or equal to, less than or equal to, greater than, less than, or equals |
| Threshold | The target value |
| Weight | How many points this rule contributes to the total score |
| Severity | How important a failure is: critical, warning, or info |
The total score (out of 100) is calculated from the weighted sum of passing rules.
Weight distribution
When a scorecard has multiple rules, the detail page shows a visual weight distribution bar. Each rule's weight is shown as a proportional segment, so you can see at a glance which rules have the most impact on the overall score.
Scorecard detail page
Click a scorecard card to open /scorecards/[id], which shows:
- Score ring -- a circular SVG visualization of the current score with status color coding
- Current status -- healthy, warning, or critical, with the last evaluation date
- Score history -- a bar chart of up to 20 recent evaluations, showing score trends over time
- Scoring rules -- each rule displayed with its metric, operator, threshold, weight, and severity
- Score trend chart -- a line chart of scores over time
- Edit link -- opens the scorecard editor to modify rules
Evaluation statuses
Scorecards are evaluated periodically. Each evaluation produces a score and a status:
| Status | Meaning |
|---|---|
| Healthy | Score meets or exceeds expectations |
| Warning | Score is below target but not critical |
| Critical | Score is significantly below target |
Maturity tiers
The organization-wide maturity tier is derived from the average score across all evaluated scorecards:
| Tier | Average score |
|---|---|
| Elite | 90 and above |
| Gold | 80 -- 89 |
| Silver | 60 -- 79 |
| Bronze | Below 60 |
Automation integration
Scorecards integrate with the Automations system. You can set up automation rules that fire when a scorecard drops below or exceeds a threshold, using the SCORECARD_BELOW_THRESHOLD and SCORECARD_ABOVE_THRESHOLD triggers.