NVIDIA
NVIDIA
GPT-OSS-20B
Container
NVIDIA
NVIDIA
GPT-OSS-20B

NVIDIA NIM for GPU accelerated GPT-OSS-20B Model inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    08/04/2026 6:07 AM UTC
    sha256:a0798d9765c5176b643e11b333e1a31bbf6285349505ba77051a8357ff341fd8COPY
    --chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
    08/04/2026 6:07 AM UTC
    sha256:9b3bf9497b68d5cf9777312274b7a750a1899c37a9f87079580de0fdd3347aefCOPY
    --chown=nim:nim NOTICE /opt/nim/NOTICE
    08/04/2026 6:07 AM UTC
    sha256:b307b9113a7f42e66b2ed1785a4e496f30d7dca42fa370620845b35b804f98d9COPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    08/04/2026 6:07 AM UTC
    sha256:cbb79f9ebd2840dd9543f34fee9c0277b1695492af37bad7a6d52b75c63f3048COPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    08/04/2026 6:07 AM UTC
    sha256:da773c1230bd3513c81c84fc2b5eac335f992a86f631d038d197418e01ca5046COPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    08/04/2026 6:07 AM UTC
    sha256:e80b608f50c5ef09922deedf939d8ff3b4f26882db484a6e7f37e1b15c3cbb5eCOPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    08/04/2026 6:07 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.10
    08/04/2026 6:07 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=openai/gpt-oss-20b
    08/04/2026 6:07 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    08/04/2026 6:07 AM UTC
    ...