DeepSpeed-MII
deepspeedai/DeepSpeed-MII
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
2,096stars
Forks
190
Open issues
209
Watchers
2,096
Size
6.7 MB
PythonApache License 2.0
deep-learninginferencepytorch
Created: Mar 23, 2022
Updated: Feb 28, 2026
Last push: Jun 30, 2025