llm-compressor
vllm-project/llm-compressor
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
3,532stars
Forks
577
Open issues
111
Watchers
3,532
Size
38.4 MB
PythonApache License 2.0
compressionquantization
Created: Jun 20, 2024
Updated: Jul 11, 2026
Last push: Jul 10, 2026