NVIDIA
NVIDIA
GPT-OSS-20B
Container
NVIDIA
NVIDIA
GPT-OSS-20B

NVIDIA NIM for GPU accelerated GPT-OSS-20B Model inference through OpenAI compatible APIs

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
/opt/nim/start_server.sh
06/23/2026 9:10 PM UTC
sha256:f00e375e53677ac8c40ee2d3c59614c6ea16d3d8364cc11d02edb48cdba7924fCOPY
--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
06/23/2026 9:10 PM UTC
sha256:b4e567498958498286aab22e23c57bce48c68c9f93e28c8a50117ac23f7200eaCOPY
--chown=nim:nim NOTICE /opt/nim/NOTICE
06/23/2026 9:10 PM UTC
sha256:3c8880832cf31357e1c66cd63d242feb45e8a0ae97cffc02c99f14f4d95372a4COPY
--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
06/23/2026 9:10 PM UTC
sha256:f94038ef8b56b046778935da7cfca6171370c5436e206391d3b209d855ea4723COPY
--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
06/23/2026 9:10 PM UTC
sha256:d2ee6ff10dedf787ff392246e0a6ca3dff1adad84410d1d39c7d538a4df9283dCOPY
--chown=nim:nim VERSION /opt/nim/VERSION
06/23/2026 9:10 PM UTC
sha256:b4175d2923932ab6c6d4e93398043bc1d687e70dc33e522619f986f852ea3a51COPY
--chown=nim:nim LICENSE /opt/nim/LICENSE
06/23/2026 9:10 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.7
06/23/2026 9:10 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_SERVED_MODEL_NAME=openai/gpt-oss-20b
06/23/2026 9:10 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_HTTP_API_PORT=8000
06/23/2026 9:10 PM UTC
...