llm-compressor
vllm-project/llm-compressor
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
3,734stars
Forks
643
Open issues
139
Watchers
3,734
Size
39.7 MB
PythonApache License 2.0
compressionquantization
Created: Jun 20, 2024
Updated: Aug 28, 2026
Last push: Aug 28, 2026