note
·
March 2, 2026
·
1 min
Speculative Decoding & Friends
ai
inference
Welcome to my notes on speculative decoding, and more generally, the family of inference algorithms that increase the number of predictions per forward pass.