NVIDIA
GPT-OSS-20B
Container
NVIDIA
GPT-OSS-20B

NVIDIA NIM for GPU accelerated GPT-OSS-20B Model inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    08/19/2026 6:37 AM UTC
    sha256:1182f277e31741d74483c31eef6deda23a07ec2446b7016f1dd0ef62eeb1d90dCOPY
    --chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
    08/19/2026 6:37 AM UTC
    sha256:346aa01c1a9699298f17885736c63399c1d4b4a65f586dc7c3fb4b1d0e0e6150COPY
    --chown=nim:nim NOTICE /opt/nim/NOTICE
    08/19/2026 6:37 AM UTC
    sha256:5b39689c5dbd294a96163508e4da3aafd8541d17b8be42c87b543f108c9b6db6COPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    08/19/2026 6:37 AM UTC
    sha256:f869bf7a47b444609b1449746cc109178efb24775692e5a5d5bf4315b0c03b4fCOPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    08/19/2026 6:37 AM UTC
    sha256:237be21a655669fbd12c4942bf44b62e58bf62f262e10c6bc2493d0871aa5cb7COPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    08/19/2026 6:37 AM UTC
    sha256:dd0264928f56fd0d3485dac004597c8f06a652c27b26843e0b1a4da49b14aa14COPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    08/19/2026 6:37 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.11
    08/19/2026 6:37 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=openai/gpt-oss-20b
    08/19/2026 6:37 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    08/19/2026 6:37 AM UTC
    ...