NVIDIA
NVIDIA
GPT-OSS-120B
Container
NVIDIA
NVIDIA
GPT-OSS-120B

NVIDIA NIM for GPU accelerated GPT-OSS-120B Model inference through OpenAI compatible APIs

LayerLabelCreated
9f1ff99cf2c40192f9c8b33531b8fdd3539b5c44fc3fefbff93c73c2ce09ba01CONFIG
Entrypoint /opt/nim/start_server.sh; WorkingDir /opt/nim; ExposedPorts 8000/tcp
07/07/2026 12:49 PM UTC
55bd8d3c15e32dbc63cd91449e6365656316c7b8b9bc68ae592fbacf0c423a8aCOPY
--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
07/07/2026 12:49 PM UTC
e95e4d3f65e76d310c19c3d75fe537e2caca5914f7da69a700776842c9aaebffCOPY
--chown=nim:nim NOTICE /opt/nim/NOTICE
07/07/2026 12:49 PM UTC
481de5e407ac952bd4db02320a66f048831b304086fad4faa9568ca07591b42bCOPY
--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
07/07/2026 12:49 PM UTC
d57aac98f9a0f342eea58010307c3cd1f672c90fd456379368b80779f0b1d91dCOPY
--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
07/07/2026 12:49 PM UTC
b604ffb944b8cbac8408990dfd0217fc1895c40b33906763c399848de4ad3608COPY
--chown=nim:nim VERSION /opt/nim/VERSION
07/07/2026 12:49 PM UTC
2dd903a131357a10a96adc301867c347f02ea19d4ebd2d9046a44f67d64b7ccdCOPY
--chown=nim:nim LICENSE /opt/nim/LICENSE
07/07/2026 12:49 PM UTC
a97a2864a24ff1b0730159c6ae144de391e470bed3ecadbef7987b04f383d3d6ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.8
07/07/2026 12:49 PM UTC
18e5c53ce679e78b211a15898cbaeea63480a03221ffb72fdcbbc0ba58234695ENV
NIM_SERVED_MODEL_NAME=openai/gpt-oss-120b
07/07/2026 12:49 PM UTC
df5f5c2ee1b86699281fd80f95cdec0d7e4194137ed558b71b597f716998ff35ENV
NIM_HTTP_API_PORT=8000
07/07/2026 12:49 PM UTC
...