LitServe
Lightning-AI/LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
3,946stars
Forks
309
Open issues
64
Watchers
3,946
Size
1.3 MB
PythonApache License 2.0
aiapiartificial-intelligencedeep-learningdeveloper-toolsfastapirest-apiservingweb
Created: Dec 12, 2023
Updated: Oct 9, 2026
Last push: Oct 8, 2026