NVIDIA
GPT-OSS-120B
Container
NVIDIA
GPT-OSS-120B

NVIDIA NIM for GPU accelerated GPT-OSS-120B Model inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    08/16/2026 7:55 AM UTC
    sha256:45d476ab9afa00123a96a4ef738e1bf4403c54b5658c8bdfab5cf80adbe55f56COPY
    --chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
    08/16/2026 7:55 AM UTC
    sha256:05fa269b07ca366bc510346de45c29309cea9c245277e3b6b5f77d0601f2141cCOPY
    --chown=nim:nim NOTICE /opt/nim/NOTICE
    08/16/2026 7:55 AM UTC
    sha256:fe02f2cefbb7f97fd720b6a661037e7d6da8e88c7173363c7b35f5c8a17bd2a9COPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    08/16/2026 7:55 AM UTC
    sha256:2d15f0e047f6bcd686ce361191c3e57305df7ae7869f24121793b4f2f50fd5b9COPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    08/16/2026 7:55 AM UTC
    sha256:6f763bf69dc32704f5ed985fb4343eb5e4ad975edb0c7824b3847f515fbcf8c9COPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    08/16/2026 7:55 AM UTC
    sha256:223734e8241ea38e1250616a7d577375f562be81adc111bdc71fa07e39e12c99COPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    08/16/2026 7:55 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.11
    08/16/2026 7:55 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=openai/gpt-oss-120b
    08/16/2026 7:55 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    08/16/2026 7:55 AM UTC
    ...