NVIDIA
Qwen2.5-Coder-32B-Instruct
Container
NVIDIA
Qwen2.5-Coder-32B-Instruct

NVIDIA NIM for GPU accelerated Qwen2.5-Coder-32B-Instruct inference through OpenAI compatible APIs

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
model.manifest.yaml=H4sIAAAAAAAC/+2YzY5cuQ2F9/0UtfOq26JESVQDQRAkXgRIskgewKAk0lNx/zhV7ZkgT59TdtsTu6YdFOAueKG7ql/pnkuKPPz24ye71dc/226/vb+73ryIV+HFxbvdvW9v7PXebmw84IvXY7d9sN1Wrzf6/uH+4vZ+2s315l+/2F28ypcDb3eXKfbL7d3+Yfd+PFzs8Ffd2/WGruSKP624v7643Gzn9Ya9BZ65klsJ7pFLyz2bRVWOU7OMziVUqdqKOJloaJ61mpRYo8yLzeZB32C5DS43fXh9c7/D3b1wvdnbiw8f39zcvra7N9s73MXPePPhw3fv8CP6+IN3Oxvbj7q7U/nw2cPn73+5373dv9Nhj5t8vP3Nh+svf/7jq7/949Wnt5vN+932enP3Zly/fHm3vX15eDAvn3461z/5ZRLy0colAjDe7t/f/v6wwe8eF/687qdvcYc3+tbSdR5We/I2OVCoNmqr1ZPVEUeO5MHiNOmx9drNCjdr1CVR4zRGpzkeV/77qz/86a+vrm7n95fweemnRdSCeHOJOqo34sy1jxjVRrQqMlJi8U65QChJyTVBZFMpmlqos/rFl+vurx7X/e5avt7haUlDqFuLjHhEzcxafcScvA+WgniFZNMCK7MzEr31FEtIMfZRw0ghfJJ0f+fbN1f/3CMpv7+aXxd/Wggyi5FbsxafUFBKV+upzG6ZahrB0iRD5unhVWENQwaklUkzRqmfEuyN3dlOP9aO59T02/s8LW+m7mlAiQSi4UYoQj2QzACZc6hLqrFXhGqGmXOsPceiSta51Rz5ceUPBfAy4KLLez+8IL7aq9uD3e3vd/vvL/T/7fi05JB6jN6ULUypvZWWVHKYsSZP1YW1EKpGcanEOrjlFhBuajSmzRGOJMezS44nSi4QSWl2ManBWWnwSFxHRmlMYzpy1sOI3qeKhSye3FJvORj6UOZ5JDmdXXI6NcqcmnlnptZCGYGsRCFJ2iKeQ8uTuIdIRUuhipTPnSQjLWwMR+OtR5L57JL5RMlJWud4OMjW2hhlFkF+W++jodUZF4hnTTLwbCSW0UNnk6whaMlI9yPJ+eyS84mSKRlXdP5IpIQ2Oj1Fr6PUyHnMIJVNuZWEQ1wcPTaS4ZfBZAzBcT+WXM4uuZya2PAt3CAkm0fqxZqS1DI5z5FybUNT1cmUDfK1sBCyoqFHxVKJaj+SXM8uuZ6a2HNwh8wZciKPuGREnmYNSpG8TVJHRNVHl0PtDixCQ6TVFGnkdCRZzi5ZTo2yNdTmeUjuKbMHmXXiAJOWEEaLUhwmEClPAU+hM6Fy8+HgG9pzRkU7ktzOLrmdKJl7RIOy5DAcHGxQgcSGY9pFI2ufVVjCRJxhl+FJkmlG2c7o3aNn9a8lUzi35Cd2/Eb58mGH+a0NghuxNFIU5WRwJGhapc3sqGt4KNMRZjRoWDTJNFC1OWi2I8lnd190qvtCDcqpJs6lag3mTOIaYkIjFsw3kVvzwBQbhgQmZHtkmGw0MPhvRPo4ymd3X3Sq+5KZh7vnhvBN/Gs2CthAi86IHB4zaeyUcmj5YKtjdQwOEZUdT8dg144kn9190anuS4RhQuC9HO5RVfoUa6F1hyNrOrOmgkPbcJiRzM1VKqz1DGl6R9bHdiT57O6LTnVfjsZTFDNv6biyTSRzrjAjogNjbx7JC2MezgnTYhA8DDXM7py4oAjQF5L/d8er7d20fz/TuPit3b5xhtGMYoiNYkhlzNpTE8ZHrccSB16LKnsmDPm91JlgvXrtlWFSOM3P/fjh/q3dbf9ju2cS9+X6T8vpmI1SHBjdq2YXwzRs7vANKVW4JoTNCd0X4cRvWgx58sCcbEONZ4n0tZznnfB/c5tvxKpFo9wy/EKhzCi9XVFaRNBpomQ7YEX4iwLLnNrEiYRdltmQsBoQWH1c+ef7of2ZFP269rcKSqo5xcbZMcE6dfOayQ/DTtdKGOknodog68QxxZesxXtkHN9ZRnZ75KzVlRXfYQZKSRzjn3nBbNS41YpzOnX0iruZyOGJSYnbwIvosCLoSj09L2eNi7Muzro46+Ksi7Muzro46+Ksi7Muzro46+Ksi7Muzro46+Ksi7Muzro46+KsPzxnHQKXoaGI5aI5E7psLikkHNeK0V9gGgdGfS0JM0QRP1gwbRbUMT/Wrs/LWXlx1sVZF2ddnHVx1sVZF2ddnHVx1sVZF2ddnHVx1sVZF2ddnHVx1sVZF2ddnPWH56zeMiZ5OswJaU6MfokCVkRvOfSjUAnHtmNuiGjEIpq7Rg+Zs7Y2+2zxeTmrLM66OOvirIuzLs66OOvirIuzLs66OOvirIuzLs66OOvirIuzLs66OOvirIuz/sCc9b/50+7NElYAAA==
06/26/2025 2:51 AM UTC
sha256:66b983891abb92db182f492cfaf2828332cece2a72eda32e81c53962e816573aCOPY
CONTAINER_LICENSE /opt/nim/LICENSE
06/26/2025 2:51 AM UTC
sha256:135334d464f66f5393bdba4645b65a03c95b825d9399749f0ebc11cec9f149c0COPY
./notices/* /opt/nim/
06/26/2025 2:51 AM UTC
sha256:df9ae0bc76083e9911eaaa9588da5766c31f043d9361cdd6c628d0e810355f0aCOPY
banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
06/26/2025 2:51 AM UTC
sha256:804d6a80cd5707f2639e81f82c210206d21d01027486724eb881ddda2993a837COPY
MODEL_LICENSE /opt/nim/MODEL_LICENSE
06/26/2025 2:51 AM UTC
sha256:b145342c4d8e4a31f11f18c44ec802b7358fb33f4104f8bf5f1b989953e3b427COPY
model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
06/26/2025 2:51 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_HTTP_API_PORT=8000
06/25/2025 8:24 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.8.5
06/25/2025 8:24 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NSPECT_ID=NSPECT-TODO-TODO
06/25/2025 8:24 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_NSPECT_ID=NSPECT-TODO-TODO
06/25/2025 8:24 AM UTC
...