Sambanova Cookbook

Note: Fork and clone this repository if needed

1. Create and activate a virtual environment

python3 -m venv ~/.venvs/aienv
source ~/.venvs/aienv/bin/activate

2. Export your SAMBANOVA_API_KEY

export SAMBANOVA_API_KEY=***

3. Install libraries

pip install -U openai phidata

4. Run Agent without Tools

• Streaming on

python cookbook/providers/sambanova/basic_stream.py

• Streaming off

python cookbook/providers/sambanova/basic.py

Disclaimer:

Sambanova does not support all OpenAI features. The following features are not yet supported and will be ignored:

• logprobs
• top_logprobs
• n
• presence_penalty
• frequency_penalty
• logit_bias
• tools
• tool_choice
• parallel_tool_calls
• seed
• stream_options: include_usage
• response_format

Please refer to https://community.sambanova.ai/t/open-ai-compatibility/195 for more information.