Skip to content

Bug: Model not found using basic example #2

@SchoolyB

Description

@SchoolyB

I am trying to work with the (basic Ollama)[https://github.com/agent-api/examples/blob/main/ollama/basic/main.go] example but I am having an issue.

When using models.GEMMA3_LATEST then building and running the example program
I get the following printed to my console:

2025-03-23T11:12:24.703-0500	INFO	ollama@v0.0.0-20250320002643-ac6641ede049/provider.go:37	 Creating new Provider
2025-03-23T11:12:24.704-0500	INFO	ollama@v0.0.0-20250320002643-ac6641ede049/provider.go:60	 Setting model	 {"modelID": "gemma3:latest"}
2025-03-23T11:12:24.704-0500	DEBUG	agent/agent.go:119	retrieving messages from memory backend
2025-03-23T11:12:24.704-0500	DEBUG	agent/agent.go:125	sending messages{"messages": [{"ID":0,"Role":"user","Content":"Why is the sky blue?","Images":[],"ToolCalls":null,"ToolResult":null,"Metadata":null,"Error":null}]}
2025-03-23T11:12:24.704-0500	DEBUG	agent/agent.go:380	sending message with generate options	 {"genOpts": {"Messages":[{"ID":0,"Role":"user","Content":"Why is the sky blue?","Images":[],"ToolCalls":null,"ToolResult":null,"Metadata":null,"Error":null}],"Tools":[],"Temperature":0,"TopP":0,"MaxTokens":0,"StopSequences":null,"PresencePenalty":0,"FrequencyPenalty":0}}
2025-03-23T11:12:24.704-0500	INFO	ollama@v0.0.0-20250320002643-ac6641ede049/provider.go:67	 Generate request received	 {"modelID": "gemma3:latest"}
2025-03-23T11:12:24.704-0500	INFO	ollama@v0.0.0-20250320002643-ac6641ede049/provider.go:72	 Converting tools to Ollama format	 {"toolCount": 0}
2025-03-23T11:12:24.719-0500	INFO	ollama@v0.0.0-20250320002643-ac6641ede049/provider.go:91	 request failed with status 404: {"error":"model \"gemma3:latest\" not found, try pulling it first"}	  {"client error": "request failed with status 404: {\"error\":\"model \\\"gemma3:latest\\\" not found, try pulling it first\"}"}
2025-03-23T11:12:24.719-0500	INFO	nlp/main.go:109	failed sending message to agent	{"err": "error calling client chat method: request failed with status 404: {\"error\":\"model \\\"gemma3:latest\\\" not found, try pulling it first\"}"}

The very last line saying gemma3:latest was not found even though I do have the gemma3 model through Ollama installed on my machine.

Specs:

OS:      macOS Sequoia 15.0.1 (build: 24A348, kernel: 24.0.0)
CPU:     Apple M2
RAM:     8192 MiB
Ollama Version: 0.6.2
Gemma Version: gemma3:1b

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions