|
| 1 | +# Agentic chat |
| 2 | + |
| 3 | +<p className="subtitle"> Learn about the agentic chat experience, an exclusive chat-based AI agent with enhanced capabilities.</p> |
| 4 | + |
| 5 | +<Callout type="info">Agentic chat is currently in the Experimental stage for Cody Pro and Enterprise and is supported on VS Code, JetBrains, Visual Studio editor extensions and Web. Usage may be limited at this stage.</Callout> |
| 6 | + |
| 7 | +Cody's agentic chat experience is an AI agent that can evaluate context and fetch any additional context (OpenCtx, terminal, etc.) by providing enhanced, context-aware chat capabilities. It extends Cody's functionality by proactively understanding your coding environment and gathering relevant information based on your requests before responding. These features help you get noticeably higher-quality responses. |
| 8 | + |
| 9 | +This agentic chat experience aims to reduce the learning curve associated with traditional coding assistants by minimizing users' need to provide context manually. It achieves this through agentic context retrieval, where the AI autonomously gathers and analyzes context before generating a response. |
| 10 | + |
| 11 | +## Capabilities of agentic chat |
| 12 | + |
| 13 | +The agentic chat experience leverages several key capabilities, including: |
| 14 | + |
| 15 | +- **Proactive context gathering**: Automatically gathers relevant context from your codebase, project structure, and current task |
| 16 | +- **Agentic context reflection**: Review the gathered context to ensure it is comprehensive and relevant to your query |
| 17 | +- **Iterative context improvement**: Performs multiple review loops to refine the context and ensure a thorough understanding |
| 18 | +- **Enhanced response accuracy**: Leverages comprehensive context to provide more accurate and relevant responses, reducing the risk of hallucinations |
| 19 | + |
| 20 | +## Enable agentic chat |
| 21 | + |
| 22 | +Pro users can find the agentic chat option in the LLM selector drop-down. Enterprise customers must opt-in to access this agentic chat feature. |
| 23 | + |
| 24 | + |
| 25 | + |
| 26 | +### Getting agentic chat access for Enterprise customers |
| 27 | + |
| 28 | +For the experimental release, agentic chat is specifically limited to using Claude 3.5 Haiku for the reflection steps and Claude 3.5 Sonnet for the final response to provide a good balance between quality and latency. Therefore, your enterprise instance must have access to both Claude 3.5 Sonnet and Claude 3.5 Haiku to use agentic chat. These models may be changed during the experimental phase to optimize for quality and/or latency. |
| 29 | + |
| 30 | +Additionally, enterprise users need to upgrade their supported client (VS Code, JetBrains, and Visual Studio) to the latest version of the plugin by enabling the following feature flags on their Sourcegraph Instance: |
| 31 | + |
| 32 | +- `agentic-chat-experimental` to get access to the feature |
| 33 | +- `agentic-chat-cli-tool-experimental` to allow [terminal access](#terminal-commands) |
| 34 | + |
| 35 | +## What can agentic chat do? |
| 36 | + |
| 37 | +Agentic chat can help you with the following: |
| 38 | + |
| 39 | +### Tool Usage |
| 40 | + |
| 41 | +It has access to a suite of tools for retrieving relevant context. These tools include: |
| 42 | + |
| 43 | +- **Code Search**: Performs code searches |
| 44 | +- **Codebase File**: Retrieves the full content from a file in your codebase |
| 45 | +- **Terminal**: Executes shell commands in your terminal |
| 46 | +- **Web Browser*: Searches the web for live context |
| 47 | +- **OpenCtx**: Any OpenCtx providers could be used by the agent |
| 48 | + |
| 49 | +It integrates seamlessly with external services, such as web content retrieval and issue tracking systems, using OpenCtx providers. To learn more, [read the OpenCtx docs](/cody/capabilities/openctx). |
| 50 | + |
| 51 | + |
| 52 | +<Callout type="info">Terminal access is not supported on the Web. It currently only works with VS Code, JetBrains, and Visual Studio editor extensions.</Callout> |
| 53 | + |
| 54 | +## Terminal access |
| 55 | + |
| 56 | +Agentic chat can use the CLI Tool to request the execution of shell commands to gather context from your terminal. Its ability to execute terminal commands enhances its context-gathering capabilities. However, it’s essential to understand that any information accessible via your terminal could potentially be shared with the LLM. It's recommended not to request information that you don't want to share. Here's what you should consider: |
| 57 | + |
| 58 | +- **Requires user consent**: Agentic chat will pause and ask for permission each time before executing any shell command. |
| 59 | +- **Trusted workspaces only**: Commands can only be executed within trusted workspaces with a valid shell |
| 60 | +- **Potential data sharing**: Any terminal-accessible information may be shared with the LLM |
| 61 | + |
| 62 | +Commands are generated by the agent/LLM based on your request. Avoid asking it to execute destructive commands. |
| 63 | + |
| 64 | +## Use cases |
| 65 | + |
| 66 | +Agentic chat can be helpful to assist you with a wide range of tasks, including: |
| 67 | + |
| 68 | +- **Improved response quality**: Helps you get better and more accurate responses than other LLMs, making up for the additional processing time for context gathering a non-issue |
| 69 | +- **Error resolution**: It can automatically identify error sources and suggest fixes by analyzing error logs |
| 70 | +- **Better unit tests**: Automatically includes imports and other missing contexts to generate better unit tests |
| 71 | + |
| 72 | +## Known limitations |
| 73 | + |
| 74 | +### Enterprise deployments |
| 75 | + |
| 76 | +All customers are required to have Claude 3.5 Sonnet and Claude 3.5 Haiku enabled on their Sourcegraph instance (this requires Sourcegraph v5.9 and new [model configuration](/cody/enterprise/model-configuration)). |
0 commit comments