NVIDIA
NVIDIA
GPT-OSS-20B
Container
NVIDIA
NVIDIA
GPT-OSS-20B

NVIDIA NIM for GPU accelerated GPT-OSS-20B Model inference through OpenAI compatible APIs

LayerLabelCreated
8c06fe7030c9b5f03a6a78df1eb6fa53933f7ab1b6e370a9a0c8641b7999d657CONFIG
Entrypoint /opt/nim/start_server.sh; WorkingDir /opt/nim; ExposedPorts 8000/tcp
07/07/2026 12:49 PM UTC
b57118a57046f7fe5df9bd0e772c8a184fac12bb08fd53571ca58e0daaec8edfCOPY
--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
07/07/2026 12:49 PM UTC
9f253e59629aee358dd133e5285d9ab698d167ea29bf308e61494b22436a309eCOPY
--chown=nim:nim NOTICE /opt/nim/NOTICE
07/07/2026 12:49 PM UTC
f8ca59cdf18d8b877267910a51d70a6b778ff0b101c0c01b422dbb1fb5de5b5bCOPY
--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
07/07/2026 12:49 PM UTC
ea4e040b5802e759bffe521bdff5bd4ac534352e645bd24ea4472ab0c7a630bcCOPY
--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
07/07/2026 12:49 PM UTC
b604ffb944b8cbac8408990dfd0217fc1895c40b33906763c399848de4ad3608COPY
--chown=nim:nim VERSION /opt/nim/VERSION
07/07/2026 12:49 PM UTC
2dd903a131357a10a96adc301867c347f02ea19d4ebd2d9046a44f67d64b7ccdCOPY
--chown=nim:nim LICENSE /opt/nim/LICENSE
07/07/2026 12:49 PM UTC
a97a2864a24ff1b0730159c6ae144de391e470bed3ecadbef7987b04f383d3d6ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.8
07/07/2026 12:49 PM UTC
18e5c53ce679e78b211a15898cbaeea63480a03221ffb72fdcbbc0ba58234695ENV
NIM_SERVED_MODEL_NAME=openai/gpt-oss-20b
07/07/2026 12:49 PM UTC
df5f5c2ee1b86699281fd80f95cdec0d7e4194137ed558b71b597f716998ff35ENV
NIM_HTTP_API_PORT=8000
07/07/2026 12:49 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.