ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Llama-3.1-70b-instruct
Container
NVIDIA
NVIDIA
Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise SupportedNVIDIA NIM
LayerLabelCreated
b713f31041fc46030b645c1390f84c232663558a1e1a2f0252f6f6b2a1c7440eCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
10/17/2025 3:19 AM UTC
a1a43d38a4ea30f1ecd23ec4067fe59510785ae867de2a2d4dd25227e0f122bbCOPY
CONTAINER_LICENSE /opt/nim/LICENSE
10/17/2025 3:19 AM UTC
6eecd0f30bb93f52053301d403ecf895a691cd57b1fdb63da5533677df2ee3cdCOPY
./notices/* /opt/nim/
10/17/2025 3:19 AM UTC
ca5c93e856e5eaa1ae1e3997e250622ea0d3c605860974f7a8cf15bd9242bc03COPY
banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
10/17/2025 3:19 AM UTC
e9bd685161782106daff682cccf434aafd88dfaec923bb36eeaece21f3f76b34COPY
MODEL_LICENSE /opt/nim/MODEL_LICENSE
10/17/2025 3:19 AM UTC
cac3fc0e8297c358b574fd9fddbf1a0b90b4942854111a4d872d023e1cdd1c9fCOPY
model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
10/17/2025 3:19 AM UTC
c3d42fa15bc9239511ebd87391aff19ff04a7e05f9d6ac9847cfc483c53791a5ENV
_NIM_FORCE_TRUST_REMOTE_CODE=1
10/14/2025 11:07 AM UTC
1218ecc6e8ee2b263c67c7e0fea6d05f0482b18b1151a9fbf4d09607b8655270ENV
NIM_FORCE_TRUST_REMOTE_CODE=1
10/14/2025 11:07 AM UTC
f03409fe7af6931ad31d230d970e3cca4afb151e32fe1283848329ed3bab8062ENV
NIM_HTTP_API_PORT=8000
10/14/2025 11:07 AM UTC
b4e19a7608666f0f472dd589a41a4f80652ea8e24a879bb55c12d531955eaebbENV
NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct
10/14/2025 11:07 AM UTC
...