Speculative Decoding and Beyond: An In-Depth Review of Techniques

Speculative Decoding and Beyond: An In-Depth Review of Techniques

Posted on March 3, 2025

Yunhai Hu, Zining Liu, Zhenyuan Dong, Tianfan Peng, Bradley McDanel, and Sai Qian Zhang