Advanced Assessment Contract
This rubric applies to the ten studios. It is an authored assessment proposal, not a calibrated instrument or a percentile ranking. Ask a reviewer to score independently before comparing notes. Record disagreements and revise ambiguous criteria.
| Dimension | 0: absent | 1: guided | 2: independent | 3: transferable |
|---|---|---|---|---|
| Correctness | result missing or materially wrong | works only on supplied case | meets declared contract and boundary cases | explains an unseen counterexample and repairs it |
| Explanation | claim without mechanism | repeats a provided explanation | derives the model and its assumptions | identifies when the model stops applying |
| Evidence | result cannot be reproduced | partial commands or curated screenshots | complete inputs, commands, observations, and failures | second person reproduces and challenges it |
| Judgment | no baseline or tradeoff | preference without evidence | compares alternatives under stated constraints | changes the decision rationally when constraints change |
| Communication and stewardship | undocumented or unsafe to hand over | author must guide every step | clear setup, limitations, cleanup, and handover | another person operates or extends it successfully |
Pass: score at least 2 on every dimension, meet the lesson's specific acceptance checks, and complete its independent transfer task. Do not average away a correctness or reproducibility failure. Advanced distinction: at least 3 on correctness, explanation, and judgment after a reviewer chooses a fresh variant; the remaining dimensions must still pass. These thresholds are program decisions, not claims of validated educational cutoffs.
Defense and remediation
For each lesson, give a 10-15 minute defense: draw the mechanism, reproduce a failure, explain a rejected alternative, then respond to one changed constraint. A written or recorded asynchronous defense is acceptable when scheduling or accessibility requires it. Preserve the question and original response.
If you fail, identify the exact missing competency, return to the relevant example or source topic, and submit a new case. Replaying the same memorized case is insufficient. Never quietly replace a failed first attempt with a polished answer; the revision history demonstrates learning.
Residency gate
In addition to the per-lesson rubric, lesson 10 requires two releases separated by observed use, a compatible or explicitly managed data migration, a recovery exercise, and a handover attempt. A production job is not required: a small project used by a consenting peer is adequate. Synthetic workloads and simulated incidents must be labeled as such.
External review strengthens evidence, but a reviewer must be able to reject the work. Record review scope; a favorable comment on documentation does not validate concurrency correctness. If no external reviewer participates, finish the self-assessed packet and leave the external-review gate pending.