Competency-based medical education requires repeated assessment and deliberate practice to achieve mastery of complex clinical tasks. Programs that depend on direct demonstration of competence to expert preceptors—preceptorial models—face scalability constraints as enrollment grows. Frequent formative assessments, limited expert educator availability, and administrative tasks for portfolio management, exam logistics, and case development create bottlenecks that can outpace traditional infrastructure.
This report describes the implementation of a unified, zero-cost digital infrastructure intended to address parallel administrative and content-scarcity barriers in a national mechanical ventilation curriculum.
The primary objective was to deploy a unified digital workflow requiring no institutional licensing or dedicated IT support to: (1) support scalable formative and summative assessment across multiple centers during a year-long mechanical ventilation preceptorial, and (2) minimize administrative burden on volunteer expert educators while preserving the preceptorial teaching relationship.
Two complementary systems were implemented using tools from the Google ecosystem. No institutional licenses or external IT services were required.
For formative assessment and portfolio tracking, the team standardized a work product (WP) with defined milestone deadlines and implemented an automated, zero-cost tracking and reminder system to prompt learners and monitor completion.
For summative assessment, the team developed a case-based waveform examination (CBWE) that paired multiple-choice items with waveform images. The exam used an expert-defined partial-credit scoring rubric and was graded automatically.
The fall milestone completion under the automated system (Fall 2025) was compared with the prior cycle that used manual, educator-dependent tracking and reminders (Fall 2024). The automated CBWE was evaluated for scoring accuracy, grading time saved, analytics generation, and capacity for immediate individualized feedback.
The standardized WP and automated reminders were launched for the Fall 2025 cycle. Key comparisons between Fall 2024 (manual tracking) and Fall 2025 (standardized requirements plus automated tracking) included total waveform submissions, portfolio submission rates, and completeness of required waveform uploads among those who submitted.
The CBWE operationalized an expert partial-credit rubric for waveform interpretation questions. The automated grading system produced item-level analytics and provided immediate individualized feedback to learners. The automation eliminated manual scoring steps and allowed graders to access analytic output rather than perform routine scoring tasks.
Implementing the standardized WP plus automated tracking was associated with a marked increase in learner engagement and submission volume. Total number of waveform images submitted rose from 194 in Fall 2024 to 1,498 in Fall 2025, a 7.7-fold increase.
The overall portfolio submission rate increased from 45.6% (31/68 learners) in Fall 2024 to 68.5% (63/92 learners) in Fall 2025. Among learners who submitted portfolios, those who completed and uploaded all required waveforms increased from 29.0% to 55.6% between the two cycles.
For the summative CBWE, automated grading confirmed scoring accuracy relative to the expert rubric, generated item-level analytics, and allowed immediate individualized feedback. The automated process eliminated 8.5 hours of manual grading per grader per assessment cycle, demonstrating a substantial time-savings benefit.
The zero-cost digital infrastructure redistributed administrative tasks away from volunteer expert faculty, reducing time spent on reminders, portfolio tracking, and manual grading. By decreasing educator administrative load, the tools aimed to preserve the high-fidelity teaching relationship central to the preceptorial model while enabling the program to accept and manage larger cohorts.
The approach provides a replicable model for other competency-based assessment programs that face similar constraints from growing enrollment and limited expert educator availability.
The Institutional Review Board of the NIH Clinical Center deemed this educational research project exempt. The authors declared no competing interests. The report states that all relevant ethical guidelines were followed and that any necessary participant consent and documentation were archived. All data produced in the study are available upon reasonable request to the authors.
A unified, zero-cost digital system built on freely available Google tools increased learner submissions and completeness of portfolios, produced reliable automated grading for a waveform-based examination, and materially reduced manual grading time per grader. By lowering administrative barriers for volunteer faculty, this infrastructure facilitated scalable formative and summative assessment in a national mechanical ventilation preceptorial program and offers a practical template for other competency-based educational initiatives.