speculators
vllm-project/speculators
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
342stars
Forks
67
Open issues
64
Watchers
342
Size
44.9 MB
PythonApache License 2.0
Created: Apr 8, 2025
Updated: Apr 14, 2026
Last push: Apr 14, 2026