NVIDIA
GPT-OSS-20B
Container
NVIDIA
GPT-OSS-20B

NVIDIA NIM for GPU accelerated GPT-OSS-20B Model inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    04/17/2026 8:18 PM UTC
    sha256:b9c13a759dc55bcbf9e472c1701fa1f6628065d163ea63705bd2270c93a35f9bCOPY
    --chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
    04/17/2026 8:18 PM UTC
    sha256:b34c160fdf4aa8031a4c4fe8071bfb040a7cacf1278a7207d05725e4853eb00fCOPY
    --chown=nim:nim NOTICE /opt/nim/NOTICE
    04/17/2026 8:18 PM UTC
    sha256:cd68bcde416e20bee518ab055b15979b4984c16091182612263b02a0287387f2COPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    04/17/2026 8:18 PM UTC
    sha256:84f14922a792a50bf71dbbf34381848ce5d185e393ffaa95fb7eabc18883e9d3COPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    04/17/2026 8:18 PM UTC
    sha256:ef03823baa976520123f755dc9c2680bafed32a5f81471b7aac1a26db55b8622COPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    04/17/2026 8:18 PM UTC
    sha256:321e7e9d6f5ff28dcba8452b9119e5961d0601deaf57ba40ae38963c9ec249f7COPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    04/17/2026 8:18 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.3
    04/17/2026 8:18 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=openai/gpt-oss-20b
    04/17/2026 8:18 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    04/17/2026 8:18 PM UTC
    ...