Institutional layer · Pilot measurement
Institutional value and renewal
How a pilot is measured. Each metric has a baseline captured before any AI-assisted workflow runs, so the institution can judge the difference rather than accept a claim.
Pilot scope
1 programme
One cohort, one competency domain
Pilot duration
16 weeks
Configurable at launch
Renewal decision
Metric-based
Agreed with the named programme owner
Demonstration data — not evidence of product effectiveness. Figures illustrate how the pilot would be measured, not observed results.
Baseline versus AI-assisted
Demonstration figures shown in the format a pilot report would use.
| Metric | Baseline | AI-MEDICS-assisted | Change |
|---|---|---|---|
| Time to identify a competency gap | 48 days | 11 days | −37 days |
| Residents with sufficient evidence | 61% | 88% | +27 pts |
| Time to initiate remediation | 19 days | 4 days | −15 days |
| Remediation completion rate | 54% | 82% | +28 pts |
| Verified gap-closure rate | 31% | 67% | +36 pts |
| Evaluation completion rate | 72% | 91% | +19 pts |
| Faculty administrative hours per month | 46 h | 28 h | −18 h |
| Hours to prepare CCC evidence | 22 h | 6 h | −16 h |
| Work-hour compliance | 89% | 97% | +8 pts |
| Resident engagement (weekly active) | 44% | 79% | +35 pts |
Why an institution renews
Measured gap closure
Gaps are not only detected — closure is verified by reassessment of the same competency and recorded with its evidence trail.
Evidence completeness
The proportion of competency decisions with sufficient supporting evidence is visible before a committee sits, not after.
Faculty workload
Assessment capture and committee preparation take fewer faculty hours, and the saving is attributable to specific workflows.
Reporting speed
Programme evidence is assembled from existing activity rather than reconciled manually from disconnected systems.
Structured, traceable evidence aligned to the institution's selected framework and prepared for institutional review or potential accreditation submission, subject to applicable regulatory requirements. Concept