DeepSpeed-MII
deepspeedai/DeepSpeed-MII
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
2,114stars
Forks
192
Open issues
209
Watchers
2,114
Size
6.7 MB
PythonApache License 2.0
deep-learninginferencepytorch
Created: Mar 23, 2022
Updated: Oct 1, 2026
Last push: Jun 30, 2025