LitServe
Lightning-AI/LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
3,885stars
Forks
286
Open issues
35
Watchers
3,885
Size
1.4 MB
PythonApache License 2.0
aiapiartificial-intelligencedeep-learningdeveloper-toolsfastapirest-apiservingweb
Created: Dec 12, 2023
Updated: May 27, 2026
Last push: May 4, 2026