NVIDIA
NVIDIA
GPT-OSS-120B
Container
NVIDIA
NVIDIA
GPT-OSS-120B

NVIDIA NIM for GPU accelerated GPT-OSS-120B Model inference through OpenAI compatible APIs

LayerLabelCreated
6442082acad8d5291c667dd49c8a33d107d201bd08e1028abddb62386f6dd82dCONFIG
Entrypoint /opt/nim/start_server.sh; WorkingDir /opt/nim; ExposedPorts 8000/tcp
06/23/2026 9:26 PM UTC
aca558de754cc446126fbdf050afa9ba35f57494305c801db9719be51ef63441COPY
--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
06/23/2026 9:26 PM UTC
957383c1d729636eed0d6c8d9c043d98ae5ce5bf71094eca879b18d0939ba3e2COPY
--chown=nim:nim NOTICE /opt/nim/NOTICE
06/23/2026 9:26 PM UTC
93941172c8e590b082ea0a39c91bc7e166478179076a5e5bed57308f6f4f64cdCOPY
--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
06/23/2026 9:26 PM UTC
950a9188d7e350a6f2f08a9ba6a7a7bab049a7a1c32147142bdf6fc0fe93a3adCOPY
--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
06/23/2026 9:26 PM UTC
d903a5022759679fb4f7d849cea9d524cf017b4d0ef851c61f1cd098178c3eacCOPY
--chown=nim:nim VERSION /opt/nim/VERSION
06/23/2026 9:11 PM UTC
9b2256f3287f5a34aa064f88ad2fea10bc19a60f6b7b54453021b19f8d7f28c4COPY
--chown=nim:nim LICENSE /opt/nim/LICENSE
06/23/2026 9:11 PM UTC
2e79e5f09815c68024f5a359e04b88e6441aadd209a27d32a931e84ea381937aENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.7
06/23/2026 9:11 PM UTC
4a2596524a71c60d86a50c34ee2c8e989badbd930e343da2a6801ecbf61d73b0ENV
NIM_SERVED_MODEL_NAME=openai/gpt-oss-120b
06/23/2026 9:11 PM UTC
9e0bfe10709528e186948d46ba3357c0abcae7513257410feaf587dd3db751aeENV
NIM_HTTP_API_PORT=8000
06/23/2026 9:11 PM UTC
...