NVIDIA
NVIDIA
GPT-OSS-20B
Container
NVIDIA
NVIDIA
GPT-OSS-20B

NVIDIA NIM for GPU accelerated GPT-OSS-20B Model inference through OpenAI compatible APIs

LayerLabelCreated
8c06fe7030c9b5f03a6a78df1eb6fa53933f7ab1b6e370a9a0c8641b7999d657CONFIG
Entrypoint /opt/nim/start_server.sh; WorkingDir /opt/nim; ExposedPorts 8000/tcp
07/07/2026 12:49 PM UTC
b57118a57046f7fe5df9bd0e772c8a184fac12bb08fd53571ca58e0daaec8edfCOPY
--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
07/07/2026 12:49 PM UTC
9f253e59629aee358dd133e5285d9ab698d167ea29bf308e61494b22436a309eCOPY
--chown=nim:nim NOTICE /opt/nim/NOTICE
07/07/2026 12:49 PM UTC
f8ca59cdf18d8b877267910a51d70a6b778ff0b101c0c01b422dbb1fb5de5b5bCOPY
--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
07/07/2026 12:49 PM UTC
ea4e040b5802e759bffe521bdff5bd4ac534352e645bd24ea4472ab0c7a630bcCOPY
--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
07/07/2026 12:49 PM UTC
b604ffb944b8cbac8408990dfd0217fc1895c40b33906763c399848de4ad3608COPY
--chown=nim:nim VERSION /opt/nim/VERSION
07/07/2026 12:49 PM UTC
2dd903a131357a10a96adc301867c347f02ea19d4ebd2d9046a44f67d64b7ccdCOPY
--chown=nim:nim LICENSE /opt/nim/LICENSE
07/07/2026 12:49 PM UTC
a97a2864a24ff1b0730159c6ae144de391e470bed3ecadbef7987b04f383d3d6ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.8
07/07/2026 12:49 PM UTC
18e5c53ce679e78b211a15898cbaeea63480a03221ffb72fdcbbc0ba58234695ENV
NIM_SERVED_MODEL_NAME=openai/gpt-oss-20b
07/07/2026 12:49 PM UTC
df5f5c2ee1b86699281fd80f95cdec0d7e4194137ed558b71b597f716998ff35ENV
NIM_HTTP_API_PORT=8000
07/07/2026 12:49 PM UTC
...