speculators
vllm-project/speculators
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
248stars
Forks
44
Open issues
31
Watchers
248
Size
44.4 MB
PythonApache License 2.0
Created: Apr 8, 2025
Updated: Feb 27, 2026
Last push: Feb 28, 2026