LitServe
Lightning-AI/LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
3,930stars
Forks
300
Open issues
46
Watchers
3,930
Size
1.3 MB
PythonApache License 2.0
aiapiartificial-intelligencedeep-learningdeveloper-toolsfastapirest-apiservingweb
Created: Dec 12, 2023
Updated: Aug 25, 2026
Last push: Aug 17, 2026