What changed
Weekly minor version release (from v1.88.x). Adds two new enterprise agent provider integrations (Watsonx Orchestrate, LangFlow with A2A session bridging), per-MCP-server RPM rate limiting scoped to API keys and teams, native Kubernetes graceful shutdown via /health/drain, and OpenInference observability parity for Arize/Phoenix. Fixes include Vertex AI Haiku 4.5 output_config.effort stripping, PostgreSQL NUL byte corruption in spend logs, and Datadog batch requeue loop on 413 errors.
TL;DR
LiteLLM v1.89.0 adds Watsonx Orchestrate and LangFlow A2A as agent providers, per-MCP-server RPM limits for teams, and /health/drain Kubernetes preStop hook support — no benchmark data, feature/fix release only.
Developer signal
Five specific changes worth evaluating for your setup: (1) MCP per-server rate limiting — you can now set per-server RPM limits scoped to API keys or teams, and per-server environment variables at global and per-user scopes. If you share MCP tool servers across teams via the LiteLLM proxy, this resolves the common issue of one team's tool calls exhausting shared server capacity. (2) Kubernetes graceful drain — add /health/drain as your pod's preStop hook; it properly drains in-flight requests before termination, replacing the sleep 15 workaround common in LiteLLM Helm deployments. (3) Vertex AI Haiku 4.5 fix — output_config.effort is now correctly stripped before sending to Vertex, fixing 400 errors introduced when Haiku 4.5 launched. If you're on Vertex with Haiku 4.5 and seeing 400s, this is your fix. (4) Arize/Phoenix observability — OpenInference traces now include tool calls, cost attribution, passthrough I/O, session/user metadata, multimodal, and cache token fields that were previously missing. (5) Agent providers — if you're integrating Watsonx Orchestrate or LangFlow workflows into a LiteLLM gateway, these are now first-class providers with A2A session bridging for LangFlow. Upgrade: pip install litellm==1.89.0.