Skip to content

feat: [Orchestration] Adding New Models #485

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 13 commits into from
Jul 17, 2025
Merged

feat: [Orchestration] Adding New Models #485

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
9d53974
Added 4 new Orchestration Models
n-o-u-r-s-a-p Jul 4, 2025
6f5aca4
Fixed Naming of the new models
n-o-u-r-s-a-p Jul 4, 2025
9ccba37
Fixed spacing in release notes
n-o-u-r-s-a-p Jul 4, 2025
f2ec52e
Added some new models and deprecated other models as well
n-o-u-r-h-a-n Jul 15, 2025
795b7b4
Deprecated the MIXTRAL_8X7B_INSTRUCT_V01 model and added its replacem…
n-o-u-r-h-a-n Jul 15, 2025
f3656f7
Merge branch 'main' into Adding-new-orchestration-models
n-o-u-r-h-a-n Jul 15, 2025
3e1f058
Fixed naming of the comment about a deprecated model
n-o-u-r-h-a-n Jul 15, 2025
5fb1c5c
Adding and Deprecating Models in OpenAiModel to match with the Orches…
n-o-u-r-h-a-n Jul 15, 2025
f5b79eb
Formatting
bot-sdk-js Jul 15, 2025
4a5def7
Fixed Format of OpenAiModel Class
n-o-u-r-h-a-n Jul 15, 2025
41f83b6
Added changes made to OpenAiModel to release notes.
n-o-u-r-h-a-n Jul 15, 2025
c438864
Merge remote-tracking branch 'origin/Adding-new-orchestration-models'…
n-o-u-r-h-a-n Jul 15, 2025
b9a1d55
Fixed changes in OpenAiModel Class and release notes part associated …
n-o-u-r-h-a-n Jul 16, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions docs/release_notes.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,12 @@
- The same applies to helper methods `DpiMasking#createConfig()` and `MaskingProvider#createConfig()`.
- [Orchestration] `OrchestrationTemplate.withTemplate()` has been deprecated. Please use `OrchestrationTemplate.withTemplateMessages()` instead.
- [Orchestration] The method `createConfig()` is removed from `ContentFilter`, `AzureContentFilter` and `LlamaGuardFilter` and is replaced by `createInputFilterConfig()` and `createOutputFilterConfig()`.
- [Orchestration] Deprecated : `LLAMA3_1_70B_INSTRUCT`, `CLAUDE_3_SONNET`, `TITAN_TEXT_LITE`, `TITAN_TEXT_EXPRESS`, `GPT_4`, `GPT_4_0613`, `MIXTRAL_8X7B_INSTRUCT_V01`.
- `GPT_4` and `GPT_4_0613` are replaced by : `GPT_40`or `GPT_41`.
- `CLAUDE_3_SONNET` is replaced by `CLAUDE_4_SONNET`.
- `MIXTRAL_8X7B_INSTRUCT_V01` is replaced by `MISTRAL_SMALL_INSTRUCT`.
- [OpenAI] Deprecated : `GPT_4`.
- `GPT_4`is replaced by : `GPT_40`or `GPT_41`.

- [Prompt Registry] Resource group has been added as a optional parameter to all endpoints. Set it to `"default"` if it was not set before. Examples:
- `client.importPromptTemplate(File)` --> `client.importPromptTemplate("default", File)`.
Expand All @@ -35,6 +41,7 @@

- [Orchestration] Added support for [transforming a JSON output into an entity](https://sap.github.io/ai-sdk/docs/java/orchestration/chat-completion#json_schema)
- [Orchestration] Added `AzureContentFilter#promptShield()` available for input filtering.
- [Orchestration] Added new models for `OrchestrationAiModel`: `GEMINI_2_5_FLASH`, `GEMINI_2_5_PRO`, `ALEPHALPHA_PHARIA_1_7B_CONTROL`, `OPENAI_O4_MINI`, `CLAUDE_4_OPUS`, `CLAUDE_4_SONNET`, `OPENAI_O3`.

### 📈 Improvements

Expand Down
12 changes: 8 additions & 4 deletions ...ation-models/openai/src/main/java/com/sap/ai/sdk/foundationmodels/openai/OpenAiModel.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45,14 +45,18 @@ public record OpenAiModel(@Nonnull String name, @Nullable String version) implem
@Deprecated
public static final OpenAiModel GPT_35_TURBO_16K = new OpenAiModel("gpt-35-turbo-16k", null);

/** Azure OpenAI GPT-4 model */
public static final OpenAiModel GPT_4 = new OpenAiModel("gpt-4", null);
/**
* Azure OpenAI GPT-4 model
*
* @deprecated This model is deprecated on AI Core with a planned retirement on 2025-09-01. The
* suggested replacement model is {@link OpenAiModel#GPT_4O} or {@link OpenAiModel#GPT_41}.
*/
@Deprecated public static final OpenAiModel GPT_4 = new OpenAiModel("gpt-4", null);

/**
* Azure OpenAI GPT-4 model
*
* @deprecated This model is deprecated on AI Core with a planned retirement on 2025-05-13. The
* suggested replacement model is {@link OpenAiModel#GPT_4O}.
* @deprecated This model is deprecated on AI Core.
*/
@Deprecated public static final OpenAiModel GPT_4_32K = new OpenAiModel("gpt-4-32k", null);

Expand Down
108 changes: 93 additions & 15 deletions orchestration/src/main/java/com/sap/ai/sdk/orchestration/OrchestrationAiModel.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -52,25 +52,45 @@ public class OrchestrationAiModel {
public static final OrchestrationAiModel MISTRAL_LARGE_INSTRUCT =
new OrchestrationAiModel("mistralai--mistral-large-instruct");

/** MistralAI Mixtral 8x7B Instruct v01 model */
/** MistralAI Mistral Small Instruct model */
public static final OrchestrationAiModel MISTRAL_SMALL_INSTRUCT =
new OrchestrationAiModel("mistralai--mistral-small-instruct");

/**
* MistralAI Mixtral 8x7B Instruct v01 model
*
* @deprecated This model is deprecated on AI Core. The suggested replacement model is {@link
* OrchestrationAiModel#MISTRAL_SMALL_INSTRUCT}.
*/
@Deprecated
public static final OrchestrationAiModel MIXTRAL_8X7B_INSTRUCT_V01 =
new OrchestrationAiModel("mistralai--mixtral-8x7b-instruct-v01");

/**
* Meta Llama3 70B Instruct model
*
* @deprecated This model is deprecated on AI Core with a planned retirement on 2024-12-15. The
* suggested replacement model is {@link OrchestrationAiModel#LLAMA3_1_70B_INSTRUCT}.
* @deprecated This model is deprecated on AI Core.
*/
@Deprecated
public static final OrchestrationAiModel LLAMA3_70B_INSTRUCT =
new OrchestrationAiModel("meta--llama3-70b-instruct");

/** Meta Llama3.1 70B Instruct model */
/**
* Meta Llama3.1 70B Instruct model
*
* @deprecated This model is deprecated on AI Core with a planned retirement on 2025-07-30.
*/
@Deprecated
public static final OrchestrationAiModel LLAMA3_1_70B_INSTRUCT =
new OrchestrationAiModel("meta--llama3.1-70b-instruct");

/** Anthropic Claude 3 Sonnet model */
/**
* Anthropic Claude 3 Sonnet model
*
* @deprecated This model is deprecated on AI Core with a planned retirement on 2025-07-21. The
* suggested replacement model is {@link OrchestrationAiModel#CLAUDE_4_SONNET}.
*/
@Deprecated
public static final OrchestrationAiModel CLAUDE_3_SONNET =
new OrchestrationAiModel("anthropic--claude-3-sonnet");

Expand All @@ -90,11 +110,29 @@ public class OrchestrationAiModel {
public static final OrchestrationAiModel CLAUDE_3_7_SONNET =
new OrchestrationAiModel("anthropic--claude-3.7-sonnet");

/** Amazon Titan Text Lite model */
/** Anthropic Claude 4 Opus model */
public static final OrchestrationAiModel CLAUDE_4_OPUS =
new OrchestrationAiModel("anthropic--claude-4-opus");

/** Anthropic Claude 4 Sonnet model */
public static final OrchestrationAiModel CLAUDE_4_SONNET =
new OrchestrationAiModel("anthropic--claude-4-sonnet");

/**
* Amazon Titan Text Lite model
*
* @deprecated This model is deprecated on AI Core with a planned retirement on 2025-08-15.
*/
@Deprecated
public static final OrchestrationAiModel TITAN_TEXT_LITE =
new OrchestrationAiModel("amazon--titan-text-lite");

/** Amazon Titan Text Express model */
/**
* Amazon Titan Text Express model
*
* @deprecated This model is deprecated on AI Core with a planned retirement on 2025-08-15.
*/
@Deprecated
public static final OrchestrationAiModel TITAN_TEXT_EXPRESS =
new OrchestrationAiModel("amazon--titan-text-express");

Expand All @@ -112,7 +150,7 @@ public class OrchestrationAiModel {
/**
* Azure OpenAI GPT-3.5 Turbo model
*
* @deprecated This model is deprecated on AI Core with a planned retirement on 2025-02-13. The
* @deprecated This model is deprecated on AI Core with a planned retirement on 2025-09-01. The
* suggested replacement model is {@link OrchestrationAiModel#GPT_4O_MINI}.
*/
@Deprecated
Expand All @@ -121,8 +159,7 @@ public class OrchestrationAiModel {
/**
* Azure OpenAI GPT-3.5 Turbo model
*
* @deprecated This model is deprecated on AI Core with a planned retirement on 2025-02-13. The
* suggested replacement model is {@link OrchestrationAiModel#GPT_4O_MINI}.
* @deprecated This model is deprecated on AI Core.
*/
@Deprecated
public static final OrchestrationAiModel GPT_35_TURBO_16K =
Expand All @@ -131,25 +168,48 @@ public class OrchestrationAiModel {
/**
* Azure OpenAI GPT-3.5 Turbo model
*
* @deprecated This model is deprecated on AI Core with a planned retirement on 2025-02-22. The
* @deprecated This model is deprecated on AI Core with a planned retirement on 2025-09-01. The
* suggested replacement model is {@link OrchestrationAiModel#GPT_4O_MINI}.
*/
@Deprecated
public static final OrchestrationAiModel GPT_35_TURBO_0125 =
new OrchestrationAiModel("gpt-35-turbo-0125");

/** Azure OpenAI GPT-4 model */
public static final OrchestrationAiModel GPT_4 = new OrchestrationAiModel("gpt-4");
/**
* Azure OpenAI GPT-4 model
*
* @deprecated This model is deprecated on AI Core with a planned retirement on 2025-09-01. The
* suggested replacement model is {@link OrchestrationAiModel#GPT_4O} or {@link
* OrchestrationAiModel#GPT_41}.
*/
@Deprecated public static final OrchestrationAiModel GPT_4 = new OrchestrationAiModel("gpt-4");

/** Azure OpenAI GPT-4.1-mini model */
public static final OrchestrationAiModel GPT_41_MINI = new OrchestrationAiModel("gpt-4.1-mini");

/** Azure OpenAI GPT-4.1 model */
public static final OrchestrationAiModel GPT_41 = new OrchestrationAiModel("gpt-4.1");

/** Azure OpenAI GPT-4.1-nano model */
public static final OrchestrationAiModel GPT_41_NANO = new OrchestrationAiModel("gpt-4.1-nano");

/**
* Azure OpenAI GPT-4 model
*
* @deprecated This model is deprecated on AI Core with a planned retirement on 2025-05-13. The
* suggested replacement model is {@link OrchestrationAiModel#GPT_4O}.
* @deprecated This model is deprecated on AI Core.
*/
@Deprecated
public static final OrchestrationAiModel GPT_4_32K = new OrchestrationAiModel("gpt-4-32k");

/**
* Azure OpenAI GPT-4 version 0613 model
*
* @deprecated This model is deprecated on AI Core.The suggested replacement model is {@link
* OrchestrationAiModel#GPT_4O} or {@link OrchestrationAiModel#GPT_41}.
*/
@Deprecated
public static final OrchestrationAiModel GPT_4_0613 = new OrchestrationAiModel("gpt-4-0613");

/** Azure OpenAI GPT-4o model */
public static final OrchestrationAiModel GPT_4O = new OrchestrationAiModel("gpt-4o");

Expand All @@ -162,6 +222,12 @@ public class OrchestrationAiModel {
/** Azure OpenAI o3-mini model */
public static final OrchestrationAiModel OPENAI_O3_MINI = new OrchestrationAiModel("o3-mini");

/** Azure OpenAI o4-mini model */
public static final OrchestrationAiModel OPENAI_O4_MINI = new OrchestrationAiModel("o4-mini");

/** Azure OpenAI o3 model */
public static final OrchestrationAiModel OPENAI_O3 = new OrchestrationAiModel("o3");

/**
* Google Cloud Platform Gemini 1.0 Pro model
*
Expand Down Expand Up @@ -189,6 +255,18 @@ public class OrchestrationAiModel {
public static final OrchestrationAiModel GEMINI_2_0_FLASH_LITE =
new OrchestrationAiModel("gemini-2.0-flash-lite");

/** Google Cloud Platform Gemini 2.5 Flash model */
public static final OrchestrationAiModel GEMINI_2_5_FLASH =
new OrchestrationAiModel("gemini-2.5-flash");

/** Google Cloud Platform Gemini 2.5 Pro model */
public static final OrchestrationAiModel GEMINI_2_5_PRO =
new OrchestrationAiModel("gemini-2.5-pro");

/** Alephalpha-pharia-1-7b-control model */
public static final OrchestrationAiModel ALEPHALPHA_PHARIA_1_7B_CONTROL =
new OrchestrationAiModel("alephalpha-pharia-1-7b-control");

/** DeepSeek-R1 */
public static final OrchestrationAiModel DEEPSEEK_R1 =
new OrchestrationAiModel("deepseek-ai--deepseek-r1");
Expand Down