genai-bench
sgl-project/genai-bench
Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.
327stars
Forks
61
Open issues
24
Watchers
327
Size
2.8 MB
PythonMIT License
Created: Jun 19, 2025
Updated: Sep 4, 2026
Last push: Jul 29, 2026