LitServe
Lightning-AI/LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
3,803stars
Forks
268
Open issues
25
Watchers
3,803
Size
1.4 MB
PythonApache License 2.0
aiapiartificial-intelligencedeep-learningdeveloper-toolsfastapirest-apiservingweb
Created: Dec 12, 2023
Updated: Feb 28, 2026
Last push: Feb 25, 2026