NVIDIA
NVIDIA
Llama-3.1-70b-instruct
Container
NVIDIA
NVIDIA
Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

LayerLabelCreated
ebaeb32750e7347c0bee4b6bdedf04265a814b951f70d1ea6b5a74352771c806CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
01/28/2026 2:19 PM UTC
45f21bc5733320e61f396fde921c26c2bb877f369071537bb2a3fbb0f3594701COPY
CONTAINER_LICENSE /opt/nim/LICENSE
01/28/2026 2:19 PM UTC
d804ffce11c473e10321f2ee75ebf24d572d0bcd5f402ff3b4e70907e9cd822dCOPY
./notices/* /opt/nim/
01/28/2026 2:19 PM UTC
eff24c2a85b02e4f8a10d9e749f031bea3cd543287322d12b5f892a76859b576COPY
banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
01/28/2026 2:19 PM UTC
a1b045cf6cf5de24b7f5ce9275fc9a5b6a2d6c6be93650c085e61fc0acbeca85COPY
MODEL_LICENSE /opt/nim/MODEL_LICENSE
01/28/2026 2:19 PM UTC
a68fe98b0e283a34c9a11c398f3c488e8e0db2edf3d0449fea0f149bb022cf3dCOPY
model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
01/28/2026 2:19 PM UTC
54b613920de420596fe57a6302af19681ad0581333fc896bea187763b1ea070fENV
NIM_HTTP_API_PORT=8000
01/28/2026 2:19 PM UTC
804f5ede8269acc1444725989dba8ceb570c8a885090bffc5fbcd9fe0584cf3cENV
_NIM_FORCE_TRUST_REMOTE_CODE=1
01/28/2026 2:19 PM UTC
4ec317bd43b8cc6c35f194feb0a03b3b4d2fc7dd65d29829c394ea4b941ffdecENV
NIM_FORCE_TRUST_REMOTE_CODE=1
01/28/2026 2:19 PM UTC
ef8071dee2dd17725763e6db76e6b81a825838bf39035e77f2cbaafc8d39e3e4ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.15.5
01/28/2026 2:19 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.