NVIDIA
NVIDIA
GPT-OSS-120B
Container
NVIDIA
NVIDIA
GPT-OSS-120B

NVIDIA NIM for GPU accelerated GPT-OSS-120B Model inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    06/02/2026 5:33 PM UTC
    sha256:0a403487b15f74a84dae7c181466f45264a2bef9749d3df3849a8538019a9fdcCOPY
    --chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
    06/02/2026 5:33 PM UTC
    sha256:2f899223d89a3653c057f0b9572aa55897a9f22dc5b6af5b2a231e3435113a6dCOPY
    --chown=nim:nim NOTICE /opt/nim/NOTICE
    06/02/2026 5:33 PM UTC
    sha256:7b67011d4e390ae822d18bf6852cc9077bfec7eb85e699b05fac14d131f3bd49COPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    06/02/2026 5:33 PM UTC
    sha256:95881ab1e5ca200beb3ad69a178f74f7530561d79175b523479911f4b3ae4991COPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    06/02/2026 5:33 PM UTC
    sha256:4d179a29cab5eab475582c92d286270dd15dc3bbc2f1c16d2bb45a14ebb9780cCOPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    06/02/2026 4:48 PM UTC
    sha256:52d3f49bdc039779c4be37d423ecae4b242db28da9c79b9c5a1d82072fffd4b2COPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    06/02/2026 4:48 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.6
    06/02/2026 4:48 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=openai/gpt-oss-120b
    06/02/2026 4:48 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    06/02/2026 4:48 PM UTC
    ...