NVIDIA
NVIDIA
GPT-OSS-120B
Container
NVIDIA
NVIDIA
GPT-OSS-120B

NVIDIA NIM for GPU accelerated GPT-OSS-120B Model inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    05/06/2026 8:44 PM UTC
    sha256:3e0f5547d8b19530d9ba58f1707851b45542ca3b8a10f142475f0c24b5b4220fCOPY
    --chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
    05/06/2026 8:44 PM UTC
    sha256:3eb9937fa1cc928521566330352f981b884e0330fdce769c82781704cf31ed91COPY
    --chown=nim:nim NOTICE /opt/nim/NOTICE
    05/06/2026 8:44 PM UTC
    sha256:dba479e761164c0e3cfed7260c85a0b9bf7e22f9fed14c1c1be6f3482e8221c6COPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    05/06/2026 8:44 PM UTC
    sha256:c3ab2d129506c7da0772d6a13bf95adc28324452913df845f0c1a25b63997ee7COPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    05/06/2026 8:44 PM UTC
    sha256:d033ab8cda0acc471fc1f8836692bc4b18cbeb0185908617727b4953a6067785COPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    05/06/2026 8:44 PM UTC
    sha256:f056d86898a3a87f860255523689102cb9ba5cd6001c90fed35fbfa06934ce2dCOPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    05/06/2026 8:44 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.4
    05/06/2026 8:44 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=openai/gpt-oss-120b
    05/06/2026 8:44 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    05/06/2026 8:44 PM UTC
    ...