speculators
vllm-project/speculators
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
768stars
Forks
202
Open issues
142
Watchers
768
Size
49.7 MB
PythonApache License 2.0
Created: Apr 8, 2025
Updated: Aug 27, 2026
Last push: Aug 27, 2026