NVIDIA
NVIDIA
GPT-OSS-120B
Container
NVIDIA
NVIDIA
GPT-OSS-120B

NVIDIA NIM for GPU accelerated GPT-OSS-120B Model inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    04/07/2026 12:32 AM UTC
    sha256:8af62b1552595f62827073cafcee35865685d518940b8f675e827b90309af0c8COPY
    --chown=nim:nim NOTICE_1 /opt/nim/NOTICE_1
    04/07/2026 12:32 AM UTC
    sha256:ad056feed6074b8b549634feb867d9c2151df9ebe5949ad4f7273bf94249a7a6COPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    04/07/2026 12:32 AM UTC
    sha256:fd8d21c7121b70bc91fbd343d383be365e69995c53751dc885452d20c12a79d0COPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    04/07/2026 12:32 AM UTC
    sha256:d01f7508d71e699201bc13e2e40db5ff046cf17d6252774df39c0241f718fa90COPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    04/07/2026 12:32 AM UTC
    sha256:d913fce406489bff43b4cdda79b89f4b8c1a2fb463b93bea8c6157b19c95e05bCOPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    04/07/2026 12:32 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.2
    04/07/2026 12:32 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=openai/gpt-oss-120b
    04/07/2026 12:32 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    04/07/2026 12:32 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_MODEL_NSPECT_ID=NSPECT-EEZS-7JBM
    04/07/2026 12:32 AM UTC
    ...