NVIDIA
NVIDIA
GPT-OSS-120B
Container
NVIDIA
NVIDIA
GPT-OSS-120B

NVIDIA NIM for GPU accelerated GPT-OSS-120B Model inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    08/04/2026 6:07 AM UTC
    sha256:8a8ac9988e023f51886dbe8875c102ce7f57b1dac41160b34cb6099f2afdc339COPY
    --chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
    08/04/2026 6:07 AM UTC
    sha256:2900a7186b27c6ae9fb609dab71a83a90758c61f4b2c9087697921e035473badCOPY
    --chown=nim:nim NOTICE /opt/nim/NOTICE
    08/04/2026 6:07 AM UTC
    sha256:32931566dd78f72f848ea590d913ed4b9c83e79597003337a609c5caa6d50465COPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    08/04/2026 6:07 AM UTC
    sha256:07b1d0f53d428f670d1972a267f20ab78b01310304db6e40858a48ed57097261COPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    08/04/2026 6:07 AM UTC
    sha256:eeb9be1861210fb29d6801be79b23d09cd388775f9f616f1bfbfe1f5e1df2610COPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    08/04/2026 6:07 AM UTC
    sha256:3837f371783e90cfef45f8998ca7f6c2cd8dbd484cb110587293455222717351COPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    08/04/2026 6:07 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.10
    08/04/2026 6:07 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=openai/gpt-oss-120b
    08/04/2026 6:07 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    08/04/2026 6:07 AM UTC
    ...