NVIDIA
NVIDIA
GPT-OSS-120B
Container
NVIDIA
NVIDIA
GPT-OSS-120B

NVIDIA NIM for GPU accelerated GPT-OSS-120B Model inference through OpenAI compatible APIs

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
/opt/nim/start_server.sh
05/06/2026 8:44 PM UTC
sha256:12403f88a1054ff59ff86fb6c6623e916416a7d213639ca666b53d4400c5cc9aCOPY
--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
05/06/2026 8:44 PM UTC
sha256:c327bf13a03a6e91b0e93c9c86f548fd414d3bab9e53a09ab840a78827a3bde5COPY
--chown=nim:nim NOTICE /opt/nim/NOTICE
05/06/2026 8:44 PM UTC
sha256:5c04029b1239fd11e9779003e6bd46610f115cc00779d78227f6d4dd1a6fb2fdCOPY
--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
05/06/2026 8:44 PM UTC
sha256:cadec1e9319420ae0d1db1e735e489edb0f6b33dea6b03cd95ea82e5d9c1f112COPY
--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
05/06/2026 8:44 PM UTC
sha256:526d5438c009ab7178af1646fed10ff6f47a73f5a1ae7b9f49e63e4ade7e3ae6COPY
--chown=nim:nim VERSION /opt/nim/VERSION
05/06/2026 8:44 PM UTC
sha256:b437d12a4d9c6f0bd8bdabc1eba0019a847442d22aa0a2b5f0237a11a9f7c543COPY
--chown=nim:nim LICENSE /opt/nim/LICENSE
05/06/2026 8:44 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.4
05/06/2026 8:44 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_SERVED_MODEL_NAME=openai/gpt-oss-120b
05/06/2026 8:44 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_HTTP_API_PORT=8000
05/06/2026 8:44 PM UTC
...