speculators
vllm-project/speculators
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
462stars
Forks
90
Open issues
41
Watchers
462
Size
45.8 MB
PythonApache License 2.0
Created: Apr 8, 2025
Updated: May 26, 2026
Last push: May 26, 2026