NVIDIA
Llama-3.1-Nemotron-Nano-8B-v1
Container
NVIDIA
Llama-3.1-Nemotron-Nano-8B-v1

NVIDIA NIM for GPU accelerated Llama-3.1-Nemotron-Nano-8B-v1 inference through OpenAI compatible APIs

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
1000
04/10/2025 9:30 PM UTC
sha256:6324bee50f49c4a742931b5715cf823b27dfa24bc63fa50ec779db0c0ee7b522RUN
NIM_MODEL_NAME=nvidia/llama-3.1-nemotron-nano-8b-v1 NIM_VERSION=1.8.3 NIM_CONTAINER_NSPECT_ID=NSPECT-CNS2-2J2H NIM_MODEL_NSPECT_ID=NSPECT-KZF6-2OL5 NIM_TYPE=llm NIM_USER_ID=1000 rm /opt/nvidia/entrypoint.d/30-container-license.txt &&
  rm /opt/nvidia/entrypoint.d/15-container-copyright.txt &&
  mkdir /.triton &&
  chown ${NIM_USER_ID}:${NIM_USER_ID} /.triton &&
  mkdir -p /etc/nim/config/ &&
  ln -s /opt/nim/etc/default/model_manifest.yaml /etc/nim/config/model_manifest.yaml &&
  if [ -f /opt/nim/start-server.sh ]; then ln -s /opt/nim/start-server.sh /opt/nim/start_server.sh; fi
04/10/2025 9:30 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
0
04/10/2025 9:30 PM UTC
sha256:a187ef21af5dc1be89b50546af957b712797cd2198a46ff0bba9f63e1e395b39COPY
./CONTAINER_LICENSE /opt/nim/LICENSE
04/10/2025 9:30 PM UTC
sha256:f3d5e1db6dc41ce156e2d82e707b85196f8c36439b877d61a4fb201695fbb703COPY
./NOTICES/* /opt/nim/
04/10/2025 9:30 PM UTC
sha256:51c4f16bbcb8c9f3bb8dcc8cb400dc93cb497936396df1704c4728a0258b105cCOPY
./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
04/10/2025 9:30 PM UTC
sha256:629a084f54e20da6d408d3f283c7dd51172d824ddb61949be6f6ae137728d3a8COPY
CONTAINER_COPYRIGHT /opt/nvidia/entrypoint.d/15-container-copyright.txt
04/10/2025 9:30 PM UTC
sha256:b802ce2228cfc9269d3db9079dde86a33bc00c07f061a1c6aa4175f9ee390be2COPY
./MODEL_LICENSE /opt/nim/MODEL_LICENSE
04/10/2025 9:30 PM UTC
sha256:476af8e2d28a6b50ebcc1f1c2dfbe41058d43bdd6998345162e8ec5f9e86ac2aCOPY
model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
04/10/2025 9:30 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NAME=nvidia/llama-3.1-nemotron-nano-8b-v1
04/10/2025 9:30 PM UTC
...