NVIDIA
GPT-OSS-20B
Container
NVIDIA
GPT-OSS-20B

NVIDIA NIM for GPU accelerated GPT-OSS-20B Model inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    04/07/2026 12:35 AM UTC
    sha256:996d505f2f726be99c260827ad12593f7d9d23efc3a2d6479815c023e648ac7cCOPY
    --chown=nim:nim NOTICE_1 /opt/nim/NOTICE_1
    04/07/2026 12:35 AM UTC
    sha256:b9b6b01d8a6f9010771f825d27a8ca669a00b5b2b19bb3d6fd93540c4144925cCOPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    04/07/2026 12:35 AM UTC
    sha256:fbd957d518eff1ce8bbfe1c1b1a7364d5ea3d1ebb482b4fca45997b4c7001372COPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    04/07/2026 12:35 AM UTC
    sha256:685e25bb3ba37af748bd9455478410b6cd32c5c3ebf8b3defe56b3699a8ea266COPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    04/07/2026 12:35 AM UTC
    sha256:e78c75b3962623adefd3aae8acd4ebf29fd0540d98252f1db7d10ea6a0ed5cabCOPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    04/07/2026 12:35 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.2
    04/07/2026 12:35 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=openai/gpt-oss-20b
    04/07/2026 12:35 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    04/07/2026 12:35 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_MODEL_NSPECT_ID=NSPECT-SW5U-LCYW
    04/07/2026 12:35 AM UTC
    ...