NVIDIA
NVIDIA
GPT-OSS-120B
Container
NVIDIA
NVIDIA
GPT-OSS-120B

NVIDIA NIM for GPU accelerated GPT-OSS-120B Model inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    05/18/2026 5:12 PM UTC
    sha256:acfd6c124831f6578b37a5575c9b38126133678d2d0770609ed67545b471a4e6COPY
    --chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
    05/18/2026 5:12 PM UTC
    sha256:a437028c0cd274bcba7c5384d25c3b718f38b3efe2613c860effed721f386ccfCOPY
    --chown=nim:nim NOTICE /opt/nim/NOTICE
    05/18/2026 5:12 PM UTC
    sha256:b3416718033e770ad80f6597a0da7d64785bbf585a600495073e1df02b7f2bf2COPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    05/18/2026 5:12 PM UTC
    sha256:3aa4a29ab8f084324be18a125390521ad42acb608b2548a9f495cf77d366802dCOPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    05/18/2026 5:12 PM UTC
    sha256:698418096ea8d8e4fe8cebec2f977e2e30759f236c0579608db7da720ccea6cbCOPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    05/18/2026 5:02 PM UTC
    sha256:4e6d59c296bc5314152192add32b54ee71822f2b3d3b6d862931103b0561a409COPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    05/18/2026 5:02 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.5
    05/18/2026 5:02 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=openai/gpt-oss-120b
    05/18/2026 5:02 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    05/18/2026 5:02 PM UTC
    ...