Our work “Speculative Decoding: Performance or Illusion?” have been accepted by MLSys 2026. Here are the Preprint and Simulator Code. If you are curious about how and why speculative decoding perform in more realistic settings (e.g. with continuous batching and CUDA Graph), this paper is worth a read!