DeepSpeed-MII
deepspeedai/DeepSpeed-MII
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
2,108stars
Forks
191
Open issues
209
Watchers
2,108
Size
6.7 MB
PythonApache License 2.0
deep-learninginferencepytorch
Created: Mar 23, 2022
Updated: Jul 11, 2026
Last push: Jun 30, 2025