Skip to content

Conversation

sjrl
Copy link
Contributor

@sjrl sjrl commented Aug 8, 2025

Related Issues

  • fixes #issue-number

Proposed Changes:

How did you test it?

Notes for the reviewer

Checklist

@sjrl sjrl self-assigned this Aug 8, 2025
@sjrl sjrl requested review from anakin87 and Amnah199 August 8, 2025 09:08
@sjrl sjrl marked this pull request as ready for review August 8, 2025 09:08
@sjrl sjrl requested a review from a team as a code owner August 8, 2025 09:08
@sjrl sjrl requested review from vblagoje and removed request for a team and vblagoje August 8, 2025 09:08
@sjrl sjrl changed the title fix: Try to unpin llama stack from 0.2.14 fix: Unpin llama stack from 0.2.14 Aug 8, 2025
Copy link
Member

@anakin87 anakin87 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would modify the title to sth like "chore: unpin Llama Stack version" (for changelog generation)

shell: bash
run: |
pip install uv
INFERENCE_MODEL=llama3.2:3b uv run --with llama-stack llama stack build --template ollama --image-type venv --run < /dev/null > server.log 2>&1 &
uv run --with llama-stack llama stack build --distro starter --image-type venv --run < /dev/null > server.log 2>&1 &
Copy link
Contributor Author

@sjrl sjrl Aug 8, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

They changed --template to --distro llamastack/llama-stack#3035

And they combined all basic providers into a starter distro (docs here) instead of a distro per provider. You switch between the different providers by setting specific env variables which I've done above.

@sjrl sjrl changed the title fix: Unpin llama stack from 0.2.14 chore: Unpin Llama Stack version Aug 8, 2025
@sjrl sjrl merged commit bf44f9f into main Aug 8, 2025
6 checks passed
@sjrl sjrl deleted the unpin-llama-stack branch August 8, 2025 09:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants