Berri AI

Top repositories by stars

• BerriAI/litellm(on leaderboard)

  Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

  Python36,242
• BerriAI/reliableGPT

  Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors

  Python696
• BerriAI/liteLLM-proxy

  Python188
• BerriAI/instructprompt

  Python107
• BerriAI/clerkie-cli

  Clerkie-cli is a terminal tool that uses an LLM to help debug and troubleshoot coding errors in any programming language. It offers explanations, suggested fixes, guidance, alternative approaches, and code examples. It is useful for developers of all skill levels.

  Python97
• BerriAI/bettertest

  Python75
• BerriAI/litellm-pgvector

  Python53
• BerriAI/bettershot

  Python30
• BerriAI/Awesome-LLMOps

  An awesome & curated list of best LLMOps tools for developers

  Shell25
• BerriAI/openai-proxy

  Python21
• BerriAI/litellm-CodeLlama-server

  Python15
• BerriAI/Berri-chat-fe

  Next.js frontend for berri chat

  JavaScript12
• BerriAI/terraform-provider-litellm

  litellm terraform provider

  Go10
• BerriAI/example_openai_endpoint

  An example OpenAI /chat/completions endpoint

  Python10
• BerriAI/llm-benchmark

  List of good LLM Benchmarks

  8
• BerriAI/litellm_playground_fe_template

  Python8
• BerriAI/example_litellm_gcp_cloud_run

  Example Repo to deploy LiteLLM Proxy (AI Gateway) on GCP Cloud Run

  Dockerfile6
• BerriAI/proxy_load_tester

  Python6
• BerriAI/litellm-ecs-deployment

  HCL4
• BerriAI/litellm-backstage

  TypeScript4
• BerriAI/simple_proxy_openai

  Python4
• BerriAI/litellm-staging

  Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

  Python4
• BerriAI/Automated_Perf_Tests

  Python3
• BerriAI/python-sdk

  The official Python SDK for Model Context Protocol servers and clients

  Python3
• BerriAI/provider-litellm-http

  Crossplane Provider designed to facilitate sending LiteLLM HTTP requests as resources.

  Go3
• BerriAI/example_anthropic_endpoint

  An example anthropic API Endpoint

  Python3
• BerriAI/Berri-chatGPT-UI

  JavaScript3
• BerriAI/LangChat

  Enjoy our curated collection of examples and solutions. Use these patterns to build your own robust and scalable applications.

  TypeScript3
• BerriAI/litellm-agent-mcp

  MCP server giving AI agents access to 100+ LLMs through LiteLLM

  Python2
• BerriAI/provider-litellm

  LiteLLM Gateway (Proxy) crossplane provider

  Go2
• BerriAI/simple_litellm_proxy

  Python2
• BerriAI/trend-api

  Anomaly detection and forecasting API

  R2
• BerriAI/openai-proxy-ab-testing

  Python2
• BerriAI/anthropic_playground

  Python2
• BerriAI/ci-cd-fixer-skill

  Skill for AI agents to diagnose and fix CI/CD failures

  1
• BerriAI/litellm-guardrails

  Registry of public custom code guardrails for the litellm proxy server

  Svelte1
• BerriAI/fireworks-ai-cost-agent

  Python1
• BerriAI/serxng-deployment

  Dockerfile1
• BerriAI/cloudzero-litellm-etl

  LiteLLM data analysis, transformation and transmission to CloudZero utility

  Python1
• BerriAI/locust-load-tester

  Python1
• BerriAI/prometheus-deploy

  A Blueprint for deploying Prometheus to render.com

  Dockerfile1
• BerriAI/proxy_load_tester_2

  Python1
• BerriAI/llm-zoo

  Python1
• BerriAI/break-our-bot

  1
• BerriAI/betterpipe

  Pipe your data from your python files to a place to check it out later

  Python1
• BerriAI/discord-clerkie

  Python1
• BerriAI/litellm-performance-benchmarks

  A reproducible benchmarking suite for measuring LiteLLM latency, throughput, and scalability under real-world workloads.

  Python0
• BerriAI/mock-mcp-server

  Mock MCP Server (MCP SDK) for testing LiteLLM OBO token exchange

  Python0
• BerriAI/mock-token-exchange-server

  Mock OAuth 2.0 Token Exchange Server (RFC 8693) for testing LiteLLM OBO flow

  Python0
• BerriAI/mock-oauth2-mcp-server

  A mock OAuth2 + MCP (Model Context Protocol) server for testing client_credentials flows. Useful for E2E testing LiteLLM proxy MCP OAuth2 M2M authentication.

  Python0
• BerriAI/litellm-observatory

  End-to-end testing suite for LiteLLM deployments - provider tests, performance metrics, and API validation

  Python0
• BerriAI/LiteLLM-Performance

  Performance tracking and benchmarks for LiteLLM.

  0
• BerriAI/Roo-Code-Docs

  This is the documentation for Roo Code (prev. Roo Cline), an AI-powered autonomous coding agent that lives in your editor.

  TypeScript0
• BerriAI/litellm-linear-mcp

  TypeScript0
• BerriAI/proxy_load_tester_4

  Python0
• BerriAI/proxy_load_tester_3

  Python0
• BerriAI/locust-github-action

  Shell0
• BerriAI/assistants_test_project

  test project using OpenAI assistants API

  0
• BerriAI/error-logs-ui

  JavaScript0
• BerriAI/Berri-chatGPT-fe

  chat app that retains history of query/answers

  0
• BerriAI/berri-help-widget2

  Next.js frontend for berri chat

  0
• BerriAI/berri_dev_docs

  0
• BerriAI/python-flask-demo

  Python0
• BerriAI/test

  0