[FEATURE] OpenAi O1 doesn't support temperature, waiting for LangChain4J upgrade

[stephanj]

We need to remove the temperature param when OpenAI o1 is selected.

An unexpected error occurred: CompletionException - com.devoxx.genie.service.exception.ProviderUnavailableException: dev.ai4j.openai4j.OpenAiHttpException: { "error": { "message": "Unsupported parameter: 'temperature' is not supported with this model.", "type": "invalid_request_error", "param": "temperature", "code": "unsupported_parameter" } } Caused by: ProviderUnavailableException - dev.ai4j.openai4j.OpenAiHttpException: { "error": { "message": "Unsupported parameter: 'temperature' is not supported with this model.", "type": "invalid_request_error", "param": "temperature", "code": "unsupported_parameter" } } Please check the IDE log for more details.

[stephanj]

Langchain4J sets the default temperature to 0.7 when it has a null value. So there's no way to override this.
A fix will be included in a very near future release of LC4J 🤩

this.defaultRequestParameters = OpenAiChatRequestParameters.builder()
                // common parameters
                .modelName(getOrDefault(getOrDefault(modelName, commonParameters.modelName()), GPT_3_5_TURBO))
                .temperature(getOrDefault(getOrDefault(temperature, commonParameters.temperature()), 0.7))
                .topP(getOrDefault(topP, commonParameters.topP()))
       ...

[stephanj]

Wip 👇 👀
langchain4j/langchain4j@0a75a33

[stephanj]

"Try out @openai's latest o3-mini model using #LangChain4j 1.0.0-alpha2-SNAPSHOT version (the official release version will be available early next week)"

<dependency>
    <groupId>dev.langchain4j</groupId>
    <artifactId>langchain4j-open-ai</artifactId>
    <version>1.0.0-alpha2-SNAPSHOT</version>
</dependency>

OpenAiChatModel model = OpenAiChatModel.builder()
        .apiKey(System.getenv("OPENAI_API_KEY"))
        .defaultRequestParameters(OpenAiChatRequestParameters.builder()
                .modelName("o3-mini")
                .reasoningEffort("medium")
                .build())
        .build();

String answer = model.chat("Explain the difference between O3 and O2");