NVIDIA
NVIDIA
GPT-OSS-120B
Container
NVIDIA
NVIDIA
GPT-OSS-120B

NVIDIA NIM for GPU accelerated GPT-OSS-120B Model inference through OpenAI compatible APIs

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
/opt/nim/start_server.sh
04/17/2026 8:33 PM UTC
sha256:e6fdc8487bfe6d764301ef3634bc6c043841dc3ab05ca14f81e69c0f92562d46COPY
--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
04/17/2026 8:33 PM UTC
sha256:7e9d3b636b446fc6c5b3a8eedc86d1ac0466769cb9d77de5e1d1d6fb1f48a2d7COPY
--chown=nim:nim NOTICE /opt/nim/NOTICE
04/17/2026 8:33 PM UTC
sha256:3a2ba8ed1759d7cbce29083ee49ea2054d79525d52e89d300d0c9293633db120COPY
--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
04/17/2026 8:33 PM UTC
sha256:5eaf68e8e5564b2c355394f4d32b6ac9e91df6c465813eea08ea49b08fa84a75COPY
--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
04/17/2026 8:33 PM UTC
sha256:c03b8ec8dd332435fbc4c1fe6eeb6f0e8e8da2dd9d5ddcb50ad14c4a7ebf8939COPY
--chown=nim:nim VERSION /opt/nim/VERSION
04/17/2026 8:18 PM UTC
sha256:b7053b807313cff567fff7e41c98400dfc2a442686d551327190dd777cd8e5f0COPY
--chown=nim:nim LICENSE /opt/nim/LICENSE
04/17/2026 8:18 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.3
04/17/2026 8:18 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_SERVED_MODEL_NAME=openai/gpt-oss-120b
04/17/2026 8:18 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_HTTP_API_PORT=8000
04/17/2026 8:18 PM UTC
...