NVIDIA
NVIDIA
GPT-OSS-120B
Container
NVIDIA
NVIDIA
GPT-OSS-120B

NVIDIA NIM for GPU accelerated GPT-OSS-120B Model inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    03/19/2026 5:23 PM UTC
    sha256:6ae2798d2e0b1862f41ba71bd3884b3986a20bb68f679c1aeb54b70b2191fc92COPY
    --chown=nim:nim NOTICE_1 /opt/nim/NOTICE_1
    03/19/2026 5:23 PM UTC
    sha256:b3b1f896b7de4dd04283590b1e50604697f880fd38370076ad4d0bf1d04931d7COPY
    --chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
    03/19/2026 5:23 PM UTC
    sha256:7569860c26c7732b7b410f4274f2f56949af88f8df69cf5696044e52b73dc7ddCOPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    03/19/2026 5:23 PM UTC
    sha256:4a35f6cef7f27af06021b172af2f1242052b7b1a494b1f86a02491b2e3fb0373COPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    03/19/2026 5:23 PM UTC
    sha256:6dfcb606037f061b88076261882a891b33e47d1919fa7a492d422b86400beea8COPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    03/19/2026 5:23 PM UTC
    sha256:085542288dfc1b84906c491b22a67da6911455ef422ef5466388804f88fb4c2cCOPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    03/19/2026 5:23 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.1
    03/19/2026 5:23 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=openai/gpt-oss-120b
    03/19/2026 5:23 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    03/19/2026 5:23 PM UTC
    ...