v1.1-djl-0.30.0-inf-trt-0.12.0
For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
Images Published:
763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.30.0-tensorrtllm0.12.0-cu125-v1.1
sha256:8f5afb881a423c15d770b02a7e882384a2fc7e76c56bef15ab3d11883e7e7c48
All tags:
0.30.0-tensorrtllm0.12.0-cu125-v1.1
0.30.0-tensorrtllm0.12.0-cu125-v1.1-2024-12-17-19-48-38
0.30.0-tensorrtllm0.12.0-cu125
0.30-tensorrtllm0.12.0-cu125-v1
Important Packages:
| pip packages | apt|deb packages |
|---|---|
| PyYAML==6.0.2 | cuda-command-line-tools-12-5 |
| absl-py==2.1.0 | libcublas-12-5 & libcublas-dev-12-5 |
| awscli==1.36.18 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
| botocore==1.35.77 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
| cloudpickle==3.1.0 | libnccl-dev & libnccl2 |
| datasets==2.19.1 | libnccl-dev |
| filelock==3.16.1 | libstdc++-11-dev:amd64 & libstdc++6:amd64 |
| h5py==3.10.0 | |
| mpi4py==4.0.1 | |
| ninja==1.11.1.2 | |
| numpy==1.26.4 | |
| packaging==24.2 | |
| pandas==2.2.3 | |
| pillow==10.3.0 | |
| protobuf==5.29.1 | |
| regex==2024.11.6 | |
| requests==2.32.3 | |
| s3transfer==0.10.4 | |
| scipy==1.14.1 | |
| sentencepiece==0.2.0 | |
| setuptools==75.6.0 | |
| tokenizers==0.19.1 | |
| torch==2.4.0 | |
| torchvision==0.19.0 | |
| transformers==4.44.2 |