Transformer models, the backbone of modern language AI, rely on the attention mechanism to process context when generating output. During inference, the attention...