NVIDIA
GPT-OSS-20B
Container
NVIDIA
GPT-OSS-20B

NVIDIA NIM for GPU accelerated GPT-OSS-20B Model inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    05/06/2026 8:55 PM UTC
    sha256:40bf4029e8e58c279a9dfdcbfb682e2c9753cb4c73ad2f5ce8656c0ff780eea9COPY
    --chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
    05/06/2026 8:55 PM UTC
    sha256:156d6fbb2e5d514929c578259bf928573505be7ac7c8621bc647432c86bf73d1COPY
    --chown=nim:nim NOTICE /opt/nim/NOTICE
    05/06/2026 8:55 PM UTC
    sha256:db9bffd3b4c3a14ac5a3f7fb11d3d93dc492a819bfb667d524225b5f775e7d61COPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    05/06/2026 8:55 PM UTC
    sha256:f0378d8cf7000a38d51f5209353cb213cea6bccbea07549bef4bb9196794228aCOPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    05/06/2026 8:55 PM UTC
    sha256:a2efef0fa77020fa387f3ea0be9694ce22cff4e0152b1b7b89b238b664fa718cCOPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    05/06/2026 8:48 PM UTC
    sha256:495a06b33a8bfb33172867488625c05b6662c1be4205dc020f6c3b32fd490a16COPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    05/06/2026 8:48 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.4
    05/06/2026 8:48 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=openai/gpt-oss-20b
    05/06/2026 8:48 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    05/06/2026 8:48 PM UTC
    ...