Worked Examples

Calculate queueing and tail latency under burst traffic; compare static and continuous batching; correlate a quality regression with a tokenizer and retrieval-index change; and decide between rollback, traffic shaping, and degraded service.

Required evidence

Submit reproducible deployment configuration, correlated telemetry, load and failure results, user-impact and unit-cost calculations, one rejected alternative, and the executed response. A dashboard screenshot without raw query and version context does not pass.

Oral defense

Trace one request across boundaries, explain a tail-latency or quality regression, demonstrate containment and rollback, and defend the residual operational risk.

Source backbone

Use Building Secure and Reliable Systems, Google SRE books, OpenTelemetry specifications, and NIST AI RMF.