NVIDIA
NVIDIA
GPT-OSS-120B
Container
NVIDIA
NVIDIA
GPT-OSS-120B

NVIDIA NIM for GPU accelerated GPT-OSS-120B Model inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    07/20/2026 4:52 AM UTC
    sha256:eba1524d898549378d71843f86ed8055a5f32d0507c5228aa3800c8b0944cbd1COPY
    --chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
    07/20/2026 4:52 AM UTC
    sha256:122a692271f236134829f590160cc406e9043877443aa6e250aa192fe1f02f6eCOPY
    --chown=nim:nim NOTICE /opt/nim/NOTICE
    07/20/2026 4:52 AM UTC
    sha256:02ae90aee717852d3d935ea0637ddbd13c58c4fd6739ba135df1ddebc8c387ceCOPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    07/20/2026 4:52 AM UTC
    sha256:81e275a5988b29c2ce6415841e94fd665cbbc263e6156ea4a564ebd9ee1667dfCOPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    07/20/2026 4:52 AM UTC
    sha256:de4d07b93fed6f65cb45cca45ddd779930f8d4fc0ee2a07f3b47a8cfbf0e0cc5COPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    07/20/2026 3:52 AM UTC
    sha256:fe1fb3e38f2d11d288777dba852d5004a64681fb5e3c00ba1b610809f8f579b9COPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    07/20/2026 3:52 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.9
    07/20/2026 3:52 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=openai/gpt-oss-120b
    07/20/2026 3:52 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    07/20/2026 3:52 AM UTC
    ...