ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
GPT-OSS-20B
Container
NVIDIA
NVIDIA
GPT-OSS-20B

NVIDIA NIM for GPU accelerated GPT-OSS-20B Model inference through OpenAI compatible APIs

NVIDIA AI Enterprise SupportedNVIDIA NIM
LayerLabelCreated
sha256:36f8d6c43c0b2f7320d207cc6c0318154da3cf2c4e707615752ba26a324c7e10COPY
./docker/nim/NSPECT-SW5U-LCYW/notices/* /opt/nim/
10/14/2025 8:44 PM UTC
sha256:50ae9d3f96c84d5c90f4c48f9a05c2445b5de6b710f8bc257ecceff34418bbbdCOPY
./docker/nim/NSPECT-SW5U-LCYW/banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
10/14/2025 8:44 PM UTC
sha256:4d7e5a8c1a24586e0c644c406cd123013f0dd7da8a19c6732af941ec06936867COPY
./docker/nim/NSPECT-SW5U-LCYW/LICENSE /opt/nim/MODEL_LICENSE
10/14/2025 8:44 PM UTC
sha256:9e419e72799e494efc43278c5532f90593dc6bd0c3d3cd277e07fb3ee0031bf3RUN
NIM_USER_ID=1000 NIM_MODEL_NAME=openai/gpt-oss-20b NIM_VERSION=1.12.4 NIM_NSPECT_ID=NSPECT-LJGD-9W15 NIM_MODEL_NSPECT_ID=NSPECT-SW5U-LCYW NIM_FORCE_TRUST_REMOTE_CODE=0 ln -s /opt/nim/etc/default/model_manifest.yaml /etc/nim/config/model_manifest.yaml
10/14/2025 8:44 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
1000
10/14/2025 8:44 PM UTC
sha256:b3c0fc14cad79787862011f47d6adb926eae5274671d191ab98d9596b06bb430RUN
NIM_USER_ID=1000 NIM_MODEL_NAME=openai/gpt-oss-20b NIM_VERSION=1.12.4 NIM_NSPECT_ID=NSPECT-LJGD-9W15 NIM_MODEL_NSPECT_ID=NSPECT-SW5U-LCYW NIM_FORCE_TRUST_REMOTE_CODE=0 cd /opt/nim/llm/.venv/lib/python3.12/site-packages &&
  patch -p1 < /tmp/0001-harmony-utils-fix-assistant-channel.patch &&
  patch -p1 < /tmp/0002-serving-chat-improve-harmony-error-handling.patch &&
  rm /tmp/0001-harmony-utils-fix-assistant-channel.patch /tmp/0002-serving-chat-improve-harmony-error-handling.patch
10/14/2025 8:44 PM UTC
sha256:d79b859aba19eea039202125f15ebfc35cced0e8a6b2556522eac67aef3ba4feCOPY
docker/patches/0002-serving-chat-improve-harmony-error-handling.patch /tmp/
10/14/2025 8:44 PM UTC
sha256:20a632c45d55bc3bfb25877afe638b0aacf73e1961f642fe0f2b5e959ab7272eCOPY
docker/patches/0001-harmony-utils-fix-assistant-channel.patch /tmp/
10/14/2025 8:44 PM UTC
sha256:eac02963600d608107c500f2a7c53aa808fd6dfa91fbd806392f600e750e0792RUN
NIM_USER_ID=1000 NIM_MODEL_NAME=openai/gpt-oss-20b NIM_VERSION=1.12.4 NIM_NSPECT_ID=NSPECT-LJGD-9W15 NIM_MODEL_NSPECT_ID=NSPECT-SW5U-LCYW NIM_FORCE_TRUST_REMOTE_CODE=0 python3 /tmp/vllm-0.10.2-hf-hub-offline-fix.py &&
  rm /tmp/vllm-0.10.2-hf-hub-offline-fix.py
10/14/2025 8:44 PM UTC
sha256:c42a8080dd84c57ef7da2e873a1bb0ae498dd836e392d5abaa8631b19ce5b145COPY
docker/vllm-0.10.2-hf-hub-offline-fix.py /tmp/vllm-0.10.2-hf-hub-offline-fix.py
10/14/2025 8:44 PM UTC
...