Skip to content

Commit 111a530

Browse files
authored
revert to new fmi (#3707)
1 parent e33b6db commit 111a530

File tree

1 file changed

+4
-4
lines changed
  • assets/training/model_management/environments/foundation-model-inference/context

1 file changed

+4
-4
lines changed

assets/training/model_management/environments/foundation-model-inference/context/Dockerfile

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -48,12 +48,12 @@ RUN pip install git+https://github.com/stanford-futuredata/megablocks.git@5897cd
4848
# RUN pip install -e ./ --no-cache-dir
4949

5050
# When copied to assets repo, change to install from public pypi
51-
RUN pip install llm-optimized-inference==0.2.7 --no-cache-dir
51+
RUN pip install llm-optimized-inference==0.2.16 --no-cache-dir
5252

53+
RUN pip uninstall transformers -y
5354
RUN pip uninstall -y vllm
54-
55-
# Install patched vllm wheel
56-
RUN pip install https://automlsamplenotebookdata.blob.core.windows.net/vllm/vllm-0.5.3.post1-cp310-cp310-linux_x86_64.whl
55+
RUN pip install vllm==0.6.1.post2
56+
RUN pip install transformers==4.46.2
5757

5858
# clean conda and pip caches
5959
RUN rm -rf ~/.cache/pip

0 commit comments

Comments
 (0)