Skip to content

Risk and Quality

matic treats risk and quality as operational primitives rather than afterthoughts. Every work item, task, milestone, and project carries a risk profile that determines guardrail strictness, HITL checkpoint placement, dry-run requirements, and budget gate enforcement, so governance constraints are derived from assessed risk instead of being applied uniformly. Quality is measured through structured evals, continuous telemetry, and outcome tracking, giving operators evidence-based visibility into agent performance and output integrity.

Risk Classes

Risk Classes explains the six operational categories used to classify registered risks across the org: budget, technical, dependency, governance, model, and external.

Risk Profiles

Risk Profiles describes how risk is characterized per entity, including failure impact, likelihood, required guardrails, HITL placement, dry-run flags, and regression indicators.

Risk Registry

Risk Registry covers the org-level aggregated view of all active risk profiles, including severity, ownership, mitigation status, and escalation state.

Quality Scoring

Quality Scoring shows how matic combines eval results, telemetry, and outcome data into actionable quality signals for operators and governance stakeholders.

Mitigation Strategies

Mitigation Strategies documents the concrete actions tied to risk profiles that reduce failure likelihood or impact, from context rot curation to baseline regression controls.

Dry-Run Requirements

Dry-Run Requirements explains the side-effect-free execution mode used to validate consequential work before committing live, including when it is required, how it is scoped, and how results are reviewed.

Evals

Evals introduces the structured assessment framework covering automated, human-scored, outcome-driven, coverage, and regression evals, along with the schemas, runners, and rubrics that power them.