NVIDIA
NVIDIA
Llama-3.1-70b-instruct
Container
NVIDIA
NVIDIA
Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

LayerLabelCreated
27343bfeffbdb8fe5cb5efdc657be0aea1659115235e430d1645b4d1a8e29678CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /
09/10/2025 5:04 AM UTC
e1031ae38dfdc50d628d4064099f4c3dafa0052d998745df21cd4b68eeaf742eCOPY
CONTAINER_LICENSE /opt/nim/LICENSE
09/10/2025 5:04 AM UTC
2383714b1a612d9d1111150765b720b26fafbfe7a370b7c1a154f0b246d94c33COPY
./notices/* /opt/nim/
09/10/2025 5:04 AM UTC
ed8c62d7afcb24e2ae5c3e50a35db7606d204a5fe5561ddce88377433b2b87f8COPY
banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
09/10/2025 5:04 AM UTC
87bf0c2ec687d08c0c9575139e4fc8bc515ab31f1c4729f6f4d054ab30918671COPY
MODEL_LICENSE /opt/nim/MODEL_LICENSE
09/10/2025 5:04 AM UTC
99944b186f6059bf2cfbb0d4f8a97f70e8a8e3c62192d2c7336a03afa3e8a757COPY
model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
09/10/2025 5:04 AM UTC
5f5a1d7a5f6d84cad2eaae969a8f49535b67233a2a50648a1d14787d469ca113ENV
_NIM_FORCE_TRUST_REMOTE_CODE=1
09/05/2025 3:21 PM UTC
cc0478526a0f2a03a77e050c1082722fdf701c76e75caf669652b741604aadb3ENV
NIM_FORCE_TRUST_REMOTE_CODE=1
09/05/2025 3:21 PM UTC
e3b4563605df6b3c69275c924597f2cb173055bb2e0f061db176c1f318b21203ENV
NIM_HTTP_API_PORT=8000
09/05/2025 3:21 PM UTC
47e195569b57a02546349d7a7e2bcdb49e74dff7acebb34f5f1e21844830d9f7ENV
NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct
09/05/2025 3:21 PM UTC
...