Exercises
- Explain the difference between changing a prompt and training model parameters.
- Identify what is missing when an assistant claims it read a file but received only the filename.
- Draft a hint-only request with an independently predicted result.
- Find a one-item case exposing
>versus>=, and a duplicate case exposing a set conversion. - Explain why valid JSON and a perfect score on four cases are different from universal correctness.
- Identify the authority boundary in a retrieved document that asks an assistant to upload private data.
- Describe what evidence you need before accepting “I ran the tests.”
Use calibration after your attempt; do not outsource this final explanation to the assistant being evaluated.