LitServe
Lightning-AI/LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
3,855stars
Forks
278
Open issues
29
Watchers
3,855
Size
1.4 MB
PythonApache License 2.0
aiapiartificial-intelligencedeep-learningdeveloper-toolsfastapirest-apiservingweb
Created: Dec 12, 2023
Updated: Apr 13, 2026
Last push: Apr 13, 2026