NVIDIA
NVIDIA
GPT-OSS-120B
Container
NVIDIA
NVIDIA
GPT-OSS-120B

NVIDIA NIM for GPU accelerated GPT-OSS-120B Model inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    06/23/2026 9:26 PM UTC
    sha256:deb63c51b3b751f27cf40f6121f6ab7305e2a8aa22422f6411a93f475ed15210COPY
    --chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
    06/23/2026 9:26 PM UTC
    sha256:7cfd168adfe3b02abe254d9db9cae92b2b589effb4ddbef730a95eccd4f6071eCOPY
    --chown=nim:nim NOTICE /opt/nim/NOTICE
    06/23/2026 9:26 PM UTC
    sha256:6afe2227c35a28ebae45710bd63342f6a0c1e649cd2b893b3b9307993c763f9aCOPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    06/23/2026 9:26 PM UTC
    sha256:bc3b145bdd20373a0882a50c40ca5e763a02424a637e01da73d085cec365c753COPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    06/23/2026 9:26 PM UTC
    sha256:d2ee6ff10dedf787ff392246e0a6ca3dff1adad84410d1d39c7d538a4df9283dCOPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    06/23/2026 9:10 PM UTC
    sha256:b4175d2923932ab6c6d4e93398043bc1d687e70dc33e522619f986f852ea3a51COPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    06/23/2026 9:10 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.7
    06/23/2026 9:10 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=openai/gpt-oss-120b
    06/23/2026 9:10 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    06/23/2026 9:10 PM UTC
    ...