speculators
vllm-project/speculators
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
877stars
Forks
253
Open issues
167
Watchers
877
Size
50.7 MB
PythonApache License 2.0
speculative-decoding
Created: Apr 8, 2025
Updated: Oct 12, 2026
Last push: Oct 12, 2026