LitServe
Lightning-AI/LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
3,911stars
Forks
294
Open issues
48
Watchers
3,911
Size
1.4 MB
PythonApache License 2.0
aiapiartificial-intelligencedeep-learningdeveloper-toolsfastapirest-apiservingweb
Created: Dec 12, 2023
Updated: Jul 8, 2026
Last push: Jul 6, 2026