NVIDIA
NVIDIA
GPT-OSS-120B
Container
NVIDIA
NVIDIA
GPT-OSS-120B

NVIDIA NIM for GPU accelerated GPT-OSS-120B Model inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    07/07/2026 12:49 PM UTC
    sha256:20342722466b0a8fe88eee8d2287bafb39a07913c5cfd26983149403d1b803e4COPY
    --chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
    07/07/2026 12:49 PM UTC
    sha256:01250cf0efbd2ea875cb845b0e43ef2207e44f0647a4641a35d07a3bf09acb41COPY
    --chown=nim:nim NOTICE /opt/nim/NOTICE
    07/07/2026 12:49 PM UTC
    sha256:04f06df90668857c7451ad11f81d43c800b937a31e41fcf952ffadf6fe5a31edCOPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    07/07/2026 12:49 PM UTC
    sha256:ebb8628e0e9c8558c05b627051e07fd08526f78ef9554a118316bdc0845b9d7fCOPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    07/07/2026 12:49 PM UTC
    sha256:2bc931b3116e3ac9029ce81115f59a8cd79cec9806cffe4368b0fa5794bd9feaCOPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    07/07/2026 12:49 PM UTC
    sha256:2c549c56d534eb7b0cd6ecccf8870e4641981e682f68ca854677c5c98c1c777cCOPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    07/07/2026 12:49 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.8
    07/07/2026 12:49 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=openai/gpt-oss-120b
    07/07/2026 12:49 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    07/07/2026 12:49 PM UTC
    ...