NVIDIA
NVIDIA
GPT-OSS-120B
Container
NVIDIA
NVIDIA
GPT-OSS-120B

NVIDIA NIM for GPU accelerated GPT-OSS-120B Model inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    04/17/2026 8:33 PM UTC
    sha256:1d8e1529ed16e1341caa2ad031b9372e544000fff9f64cfc66a2b23135c7e5dbCOPY
    --chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
    04/17/2026 8:33 PM UTC
    sha256:a05ec4286142bc7d82c9df44a26f30c58c29cf89db67dbe6fc8e8efde2964e2dCOPY
    --chown=nim:nim NOTICE /opt/nim/NOTICE
    04/17/2026 8:33 PM UTC
    sha256:ab539ba98909428ad8837c911030bb1da542eaba1da7d97d084880271668670aCOPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    04/17/2026 8:33 PM UTC
    sha256:c54daca4c670339164c7dbd194223b5634050bf535a00e42479c4d63cc43dc75COPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    04/17/2026 8:33 PM UTC
    sha256:ef03823baa976520123f755dc9c2680bafed32a5f81471b7aac1a26db55b8622COPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    04/17/2026 8:18 PM UTC
    sha256:321e7e9d6f5ff28dcba8452b9119e5961d0601deaf57ba40ae38963c9ec249f7COPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    04/17/2026 8:18 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.3
    04/17/2026 8:18 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=openai/gpt-oss-120b
    04/17/2026 8:18 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    04/17/2026 8:18 PM UTC
    ...