Paper Notes: SpecInfer

last updated 2026-07-15

Source

SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification

Xupeng Miao, et al.·arXiv · 2023

joe barrow · research scientist · rss