Spec-Bench is a comprehensive benchmark designed for assessing Speculative Decoding methods across diverse scenarios. Based on Spec-Bench, we aim to establish and maintain a unified evaluation ...

If you’ve ever heard the sound of an aircraft passing overhead and looked at an online plane tracker to try and figure out ...