NVIDIA
GPT-OSS-20B
Container
NVIDIA
GPT-OSS-20B

NVIDIA NIM for GPU accelerated GPT-OSS-20B Model inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    07/07/2026 12:49 PM UTC
    sha256:68375145aafbe5618ec07fa5e4f9e3ae88c7f54a36ea0a2ded2fc521c1bfa190COPY
    --chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
    07/07/2026 12:49 PM UTC
    sha256:64995aa413aa0e700afa1fcc289b728306036b353a057668a4f069c8550758edCOPY
    --chown=nim:nim NOTICE /opt/nim/NOTICE
    07/07/2026 12:49 PM UTC
    sha256:2f79dd8e45d625b388b928b74f641a52f8b8aaff8628a7a34aabb3bfc3dc8937COPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    07/07/2026 12:49 PM UTC
    sha256:d80e537334fcbf823c078d657f9db46b593eadb59bab57314c46bd69c45b889aCOPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    07/07/2026 12:49 PM UTC
    sha256:2bc931b3116e3ac9029ce81115f59a8cd79cec9806cffe4368b0fa5794bd9feaCOPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    07/07/2026 12:49 PM UTC
    sha256:2c549c56d534eb7b0cd6ecccf8870e4641981e682f68ca854677c5c98c1c777cCOPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    07/07/2026 12:49 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.8
    07/07/2026 12:49 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=openai/gpt-oss-20b
    07/07/2026 12:49 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    07/07/2026 12:49 PM UTC
    ...