DOC-1867 AI Gateway #477
Draft
DOC-1867 AI Gateway #477
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Contributor
|
Important Review skippedDraft detected. Please check the settings in the CodeRabbit UI or the You can disable this status message by setting the Comment |
✅ Deploy Preview for rp-cloud ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
c4milo
reviewed
Jan 6, 2026
c4milo
reviewed
Jan 6, 2026
|
|
||
| The orchestrator is a built-in MCP server that enables programmatic tool calling. The agent can generate JavaScript to call multiple tools in a single orchestrated step, which reduces the number of round trips. For example, a workflow requiring 47 file reads can be reduced from 49 round trips to just 1. | ||
|
|
||
| *REVIEWERS: When/how exactly do you use the orchestrator? Also what happens after they create a gateway? Please provide an example of how to validate end-to-end routing against the gateway endpoint!* |
Member
There was a problem hiding this comment.
it is an MCP server exposing tools, so it is used as another regular MCP server. I can provide examples.
|
|
||
| This can reduce token usage significantly (for example, 80-90% depending on how many servers/tools are configured). | ||
|
|
||
| == Observability |
Member
There was a problem hiding this comment.
I haven't gotten to the observability implementation yet, probably next week.
|
|
||
| This is central to governance: You can see and control usage by gateway boundary (for example, by team, environment, customer, or product). | ||
|
|
||
| *REVIEWERS: Where do those metrics appear in the UI, or how does a user validate observability after setup?* |
micheleRP
force-pushed
the
DOC-1867-Document-feature-AI-Gateway-help-cloud-team-polish-clean-up
branch
from
9aef822 to
b28bea7
Compare
c4milo
reviewed
Jan 6, 2026
| ---- | ||
| { | ||
| "claude.mcpServers": { | ||
| "redpanda-ai-gateway": { |
Member
There was a problem hiding this comment.
This configuration should use http as transport. For example, to configure our internal MCP gateway in Claude Code, it would look roughly like this:
claude mcp add --transport http redpanda-aigateway https://gw.ai.panda.dev/mcp --header "Authorization: Bearer YOUR_API_KEY" --header "rp-aigw-id: GATEWAY_ID"
Member
There was a problem hiding this comment.
There is also a way to disallow people from using other MCP servers. I'm going to have to dedicate some time to documenting and testing all the integrations with popular AI coding agents.
# Conflicts: # modules/ROOT/nav.adoc
Added 7 new documentation files for AI Gateway: - what-is-ai-gateway.adoc: Overview, problem/solution framing, common patterns - quickstart-enhanced.adoc: Step-by-step quickstart with time markers - observability-logs.adoc: Request logs, filtering, and debugging - observability-metrics.adoc: Dashboards, analytics, and cost tracking - migration-guide.adoc: Safe migration from direct provider integration - cel-routing-cookbook.adoc: CEL routing patterns with examples - mcp-aggregation-guide.adoc: MCP aggregation and orchestration All files follow Redpanda documentation standards: - Sentence case headings - Imperative verbs for action headings - AsciiDoc format - Comprehensive placeholders for product-specific details Co-Authored-By: Claude Sonnet 4.5 <[email protected]>
Add personas, learning objectives, and prerequisites to all AI Gateway documentation pages. Remove DRAFT prefixes from titles and time estimates from quickstart. Fix passive voice in multiple locations. Changes: - Add page-personas attributes to all 7 files - Add learning objectives in ABCD format - Add prerequisites sections where missing - Remove "DRAFT:" from all page titles - Remove time estimates from quickstart-enhanced.adoc - Fix passive voice constructions - Improve page descriptions - Preserve all placeholder comments for future content Co-Authored-By: Claude Sonnet 4.5 <[email protected]>
micheleRP
force-pushed
the
DOC-1867-Document-feature-AI-Gateway-help-cloud-team-polish-clean-up
branch
from
1297ef0 to
49a573f
Compare
Provide admin and user guides for configuring Claude Code, Cline, Continue.dev, Cursor IDE, and GitHub Copilot to work with AI Gateway, enabling centralized LLM routing and MCP tool aggregation. Co-Authored-By: Claude Sonnet 4.5 <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This pull request introduces the AI Gateway in Redpanda Cloud.
Resolves https://redpandadata.atlassian.net/browse/DOC-1867
Review deadline: GA = Feb 6
Page previews
AI Gateway Quickstart
Checks