DeepSpeed-MII
deepspeedai/DeepSpeed-MII
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
2,111stars
Forks
192
Open issues
209
Watchers
2,111
Size
6.7 MB
PythonApache License 2.0
deep-learninginferencepytorch
Created: Mar 23, 2022
Updated: Aug 15, 2026
Last push: Jun 30, 2025