NVIDIA
NVIDIA
GPT-OSS-20B
Container
NVIDIA
NVIDIA
GPT-OSS-20B

NVIDIA NIM for GPU accelerated GPT-OSS-20B Model inference through OpenAI compatible APIs

LayerLabelCreated
3a6ade057c0b64b1a3d9235c4b4e10f2b66e5aebeed1c0d1bb78d60f9abd0078CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /
08/05/2025 8:00 PM UTC
a538ab53a80efd12029f018fbc04eed185f4e5b0845946bfd287619093c65205COPY
./docker/nim/NSPECT-SW5U-LCYW/banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
08/05/2025 8:00 PM UTC
fd3210bc893332ec1bbde32c1c228aff43898fe3546174d9af0392988dbc94c3COPY
./docker/nim/NSPECT-SW5U-LCYW/LICENSE /opt/nim/MODEL_LICENSE
08/05/2025 8:00 PM UTC
f2678feca218211741e26ee3484968b92ba9d15ed9cda31ede02efd90f95d8d9RUN
NIM_USER_ID=1000 NIM_MODEL_NAME=openai/gpt-oss-20b NIM_VERSION=1.2.1 NIM_NSPECT_ID=NSPECT-LJGD-9W15 NIM_MODEL_NSPECT_ID=NSPECT-SW5U-LCYW NIM_FORCE_TRUST_REMOTE_CODE=0 ln -s /opt/nim/etc/default/model_manifest.yaml /etc/nim/config/model_manifest.yaml
08/05/2025 8:00 PM UTC
3940c010e484f8bb81768c9339801f21f1c673a1771d34ab365f5db9694633dcUSER
1000
08/05/2025 8:00 PM UTC
2f88a8f349ad6dd403b1418a3a0e1f22fc8fc6068d02d6aec90d607d078929f0RUN
NIM_USER_ID=1000 NIM_MODEL_NAME=openai/gpt-oss-20b NIM_VERSION=1.2.1 NIM_NSPECT_ID=NSPECT-LJGD-9W15 NIM_MODEL_NSPECT_ID=NSPECT-SW5U-LCYW NIM_FORCE_TRUST_REMOTE_CODE=0 cd /opt/nim/llm/.venv/lib/python3.12/site-packages &&
  for patch in /tmp/patches/*.patch; do echo "Applying patch: $patch"; patch -p1 < "$patch"; done &&
  rm -rf /tmp/patches
08/05/2025 8:00 PM UTC
87590a185fefb7c5f4caf9cbaaba51c5e311bb22a15e4a9b3a17b2cae3eddea0COPY
docker/orangina-patches /tmp/patches
08/05/2025 8:00 PM UTC
576ad4fbff9ad7e9326f4a5c80ea43180fd736f5d350d90670fbe187ac3bdd31RUN
NIM_USER_ID=1000 NIM_MODEL_NAME=openai/gpt-oss-20b NIM_VERSION=1.2.1 NIM_NSPECT_ID=NSPECT-LJGD-9W15 NIM_MODEL_NSPECT_ID=NSPECT-SW5U-LCYW NIM_FORCE_TRUST_REMOTE_CODE=0 find /opt/nim/llm/.venv/lib/python3.12/site-packages/ -name "*.exe" -delete
08/05/2025 8:00 PM UTC
8374d5e1a8e397741b79357f40205237ea03ff3f11e09781c2227edb81c02082RUN
NIM_USER_ID=1000 NIM_MODEL_NAME=openai/gpt-oss-20b NIM_VERSION=1.2.1 NIM_NSPECT_ID=NSPECT-LJGD-9W15 NIM_MODEL_NSPECT_ID=NSPECT-SW5U-LCYW NIM_FORCE_TRUST_REMOTE_CODE=0 cd /workspace/harmony &&
  pip install pandas datasets maturin puccinialin colorama &&
  pip install . --verbose --no-build-isolation
08/05/2025 8:00 PM UTC
a4d6cdfe25277282320cf72e3c78c377d065cee2668105f371708da68246ec7dCOPY
orangina-reference-code_vv11/open-weight-model-pre-release/gpt_oss /usr/local/lib/python3.12/dist-packages/gpt_oss
08/05/2025 7:59 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.