DeepSpeed-MII
deepspeedai/DeepSpeed-MII
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
2,109stars
Forks
190
Open issues
209
Watchers
2,109
Size
6.7 MB
PythonApache License 2.0
deep-learninginferencepytorch
Created: Mar 23, 2022
Updated: Apr 13, 2026
Last push: Jun 30, 2025