ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    NVIDIA-Nemotron-Nano-9B-v2
    Container
    NVIDIA
    NVIDIA-Nemotron-Nano-9B-v2

    NVIDIA-Nemotron-Nano-9B-v2 is a language model that can follow instructions, complete requests, and generate creative text formats. The NVIDIA-Nemotron-Nano-9B-v2 Large Language Model (LLM) is an instruct fine-tuned version of the Nemotron-Nano.

  • LayerLabelCreated
    sha256:86d5b398368711631d78f6168e46ea2fdf0a3d2653cfdd6c1dcf31fee30c1f40RUN
    NIM_USER_ID=1000 NIM_MODEL_NAME=nvidia/nvidia-nemotron-nano-9b-v2 NIM_VERSION=1.12.2 NIM_NSPECT_ID=NSPECT-4D96-ZHXL NIM_MODEL_NSPECT_ID=NSPECT-G9R0-9QVY NIM_FORCE_TRUST_REMOTE_CODE=1 ( cd /opt/nim/llm/.venv/lib/python3.12/site-packages/vllm &&
  patch -p1 < mamba.patch &&
  patch -p1 < mamba_float32.patch &&
  patch -p1 < cve.patch &&
  patch -p1 < cve2.patch )
    		08/29/2025 12:17 AM UTC
    sha256:056b14fe8a5725b022c813562c451017d5c63a1ee888f77eae1e94a4dfbedb85RUN
    NIM_USER_ID=1000 NIM_MODEL_NAME=nvidia/nvidia-nemotron-nano-9b-v2 NIM_VERSION=1.12.2 NIM_NSPECT_ID=NSPECT-4D96-ZHXL NIM_MODEL_NSPECT_ID=NSPECT-G9R0-9QVY NIM_FORCE_TRUST_REMOTE_CODE=1 ( cd /opt/nim/llm/.venv/lib/python3.12/site-packages/nim_llm_sdk &&
  patch -p1 < tool_parser.patch &&
  patch -p1 < max_seqs.patch &&
  patch -p1 < mamba.patch &&
  patch -p1 < mamba_ssm_cache_arg.patch )
    		08/29/2025 12:16 AM UTC
    sha256:9e4d98e03cd889419b8bf6d40c1da205423755d7ca40e0eb443c28cd56a9025eRUN
    NIM_USER_ID=1000 NIM_MODEL_NAME=nvidia/nvidia-nemotron-nano-9b-v2 NIM_VERSION=1.12.2 NIM_NSPECT_ID=NSPECT-4D96-ZHXL NIM_MODEL_NSPECT_ID=NSPECT-G9R0-9QVY NIM_FORCE_TRUST_REMOTE_CODE=1 ( cd /opt/nim/llm/.venv/lib/python3.12/site-packages &&
  patch -p3 < bc.patch &&
  patch -p1 < bc2.patch )
    		08/29/2025 12:16 AM UTC
    sha256:914b56be06b9377f0390d3ebac1bb275531232024eeb6c02ca2f0b6c7307c757COPY
    ./patches/bc/cve2.patch /opt/nim/llm/.venv/lib/python3.12/site-packages/vllm/cve2.patch
    		08/29/2025 12:16 AM UTC
    sha256:d2f40c3f2c0e63ec267a4cc66b3d84d69503ca21adf70d0e3d2250c7e8efbc8fCOPY
    ./patches/bc/cve.patch /opt/nim/llm/.venv/lib/python3.12/site-packages/vllm/cve.patch
    		08/29/2025 12:16 AM UTC
    sha256:6cb8b968c7c0c2861e2b5f340fee536f46256c444e24d3cb5502e4a1eac5264cCOPY
    ./patches/bc/mamba_float32.patch /opt/nim/llm/.venv/lib/python3.12/site-packages/vllm/mamba_float32.patch
    		08/29/2025 12:16 AM UTC
    sha256:4a73b7c7ceee6eb9a9001f7098ba57cd8239b4bc1728d04ecb1cf8b83840403fCOPY
    ./patches/bc/mamba_patch_vllm.patch /opt/nim/llm/.venv/lib/python3.12/site-packages/vllm/mamba.patch
    		08/29/2025 12:16 AM UTC
    sha256:22c518225798d2d3fd013b30288c3b4917c2f04808b9231fc960d6e6f12b530eCOPY
    ./patches/bc/mamba_ssm_cache_arg.patch /opt/nim/llm/.venv/lib/python3.12/site-packages/nim_llm_sdk/mamba_ssm_cache_arg.patch
    		08/29/2025 12:16 AM UTC
    sha256:36a28e0a1761a508b488eb1ce99ef6800e9f649f48b16384d6c3b319c0fcacabCOPY
    ./patches/bc/mamba_patch_nim_llm_sdk.patch /opt/nim/llm/.venv/lib/python3.12/site-packages/nim_llm_sdk/mamba.patch
    		08/29/2025 12:16 AM UTC
    sha256:5c84c9490aa8aef74cf597132ebf8b3d30b97cbe35a8839342a0c63d9351192aCOPY
    ./patches/bc/max_seqs.patch /opt/nim/llm/.venv/lib/python3.12/site-packages/nim_llm_sdk/max_seqs.patch
    		08/29/2025 12:16 AM UTC
    ...