LitServe
Lightning-AI/LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
3,886stars
Forks
286
Open issues
35
Watchers
3,886
Size
1.4 MB
PythonApache License 2.0
aiapiartificial-intelligencedeep-learningdeveloper-toolsfastapirest-apiservingweb
Created: Dec 12, 2023
Updated: May 29, 2026
Last push: May 4, 2026