NVIDIA
NVIDIA
Llama-3.1-70b-instruct
Container
NVIDIA
NVIDIA
Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

LayerLabelCreated
5f9e44667170bb86330cf79b58f6725bb63d06d61caa063c675dbc27445917d4CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
01/16/2026 8:32 PM UTC
0fe7a5198040b20c05e3546c3841f46b7142377a8f09cb1a0efb8cf16c780672COPY
CONTAINER_LICENSE /opt/nim/LICENSE
01/16/2026 8:32 PM UTC
a47d77e9c3e993c48ce13c5c5d2f3cf3579181b6536922a25bb7dc3739541936COPY
./notices/* /opt/nim/
01/16/2026 8:32 PM UTC
d6fd66707da6ccd9f80ce7121d496e0d09351942e100a455b5b0ca804711a0e7COPY
banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
01/16/2026 8:32 PM UTC
f07b2908ecd8bdfc13632645ac74910b266d4832cbaeb8e4fb413e67d63b4e11COPY
MODEL_LICENSE /opt/nim/MODEL_LICENSE
01/16/2026 8:32 PM UTC
6613ed3b3e92f9c6629a39a38b40a9eb8fa3fb8371c9ff586691969e4d6bea3dCOPY
model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
01/16/2026 8:32 PM UTC
15e7ca821fd839365fbe8d207fa56d167f5bd98ad446bcabce3ab21c59654572ENV
NIM_HTTP_API_PORT=8000
01/15/2026 3:53 AM UTC
89ae60f6e8d62abb342513850a30ab85d13ca545a4b98fd6feb4b54e45e79d35ENV
_NIM_FORCE_TRUST_REMOTE_CODE=1
01/15/2026 3:53 AM UTC
8b21e69b3b4591b383886aea6591b8755e0dd01e506cb7921de96c022d0f161cENV
NIM_FORCE_TRUST_REMOTE_CODE=1
01/15/2026 3:53 AM UTC
248a731c1243d07a4920b4a70518647b606f58229c566c5eb4652bb5a9094eb8ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.15.4
01/15/2026 3:53 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.