Transformer From Components

Implement and test a small masked transformer block. Inject an incorrect mask and detect it with adversarial sequences.

Evidence and review

Deliver shape assertions, tests, and profile. Claims must trace to versioned code and artifacts. Screenshots, unexplained generated prose, and a single favorable run do not pass.

Oral defense

Explain the mechanism, identify the most dangerous assumption, interpret one failure from raw evidence, and name the condition that would reverse your decision.

Source backbone

Use Dive into Deep Learning, PyTorch documentation, primary papers, and Designing Data-Intensive Applications selectively.