NVIDIA
NVIDIA
Llama-3.3-nemotron-super-49b-v1.5
Container
NVIDIA
NVIDIA
Llama-3.3-nemotron-super-49b-v1.5

This container houses the Llama-3.3-Nemotron-Super-49B-v1.5, which is a significantly upgraded version of Llama-3.3-Nemotron-Super-49B-v1 and is a large language model (LLM) which is a derivative of Meta Llama-3.3-70B-Instruct

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
/opt/nim/start_server.sh
03/19/2026 5:20 PM UTC
sha256:866312e4069b743ab38ab93fbe5c4a2eb22c9deda52582cc421abe7eab0b7ad1COPY
--chown=nim:nim NOTICE_1 /opt/nim/NOTICE_1
03/19/2026 5:20 PM UTC
sha256:44cc2f1c4bb2f2518dae3655cc9b2f9642a3fc61c5a978bd068ec1f30d666c58COPY
--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
03/19/2026 5:20 PM UTC
sha256:68784e5e9ca8c91077d2ca8a4777e023c9e244b805943aa1fe0002ab4db174f4COPY
--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
03/19/2026 5:20 PM UTC
sha256:85c7fe3b6d97b9c99481663a755144ada38fd8ac5ef9a10c96bb035b197f4e35COPY
--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
03/19/2026 5:20 PM UTC
sha256:0cf2821f2786b0d5cdf9269ad874ca82ce367046a029f083481a6437e2423885COPY
--chown=nim:nim VERSION /opt/nim/VERSION
03/19/2026 5:20 PM UTC
sha256:b019a243f8399cb1fae2254a4e329fb015a349ac4f2cca33804f09547bb48960COPY
--chown=nim:nim LICENSE /opt/nim/LICENSE
03/19/2026 5:20 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
VLLM_GPU_MEMORY_UTILIZATION=0.9
03/19/2026 5:20 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
PYTORCH_ALLOC_CONF=expandable_segments:True
03/19/2026 5:20 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_TRUST_CUSTOM_CODE=True
03/19/2026 5:20 PM UTC
...