Use the NGC CLI to download:
Copied!
Model
The Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out).
Use the NGC CLI to download:
Copied!
Latest (trtllmapi-pt-runtime-params-a100-sxm4-40gbx8-throughput-bf16-uoswlqfxbq)Signed
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-a100-sxm4-40gbx8-throughput-bf16-uoswlqfxbqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h200x2-latency-fp8-3ur-jvqwswSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-rtx6000-blackwell-svx4-latency-bf16-teblpznxhqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h100-nvlx4-throughput-lora-bf16-evps2vqmuaSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gh200-144gbx1-throughput-bf16-rwzxefagaaSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-a10gx8-throughput-lora-bf16-xgayfmpmdwSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-rtx6000-blackwell-svx4-throughput-lora-bf16--gs1zcvpbgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-rtx6000-blackwell-svx1-throughput-lora-fp8-b-speomfcgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-l40sx8-throughput-lora-bf16-q4wavaf-yaSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-l40sx4-throughput-lora-fp8-8j4f0lap6aSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h200x2-throughput-lora-bf16-xs4cesuamwSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h200x1-throughput-lora-fp8-wifrr0lgbgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h200-nvlx2-throughput-lora-bf16-dqcohc52-wSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h200-nvlx1-throughput-lora-fp8-klyyvlydraSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h100x4-throughput-lora-bf16-mftrp6-wiqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h100x2-throughput-lora-fp8-re-sjmcqhqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h100-nvlx4-throughput-lora-bf16--ix7eqfnvwSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h100-nvlx1-throughput-lora-fp8-udvyhbe7tgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gh200-480gbx1-throughput-lora-fp8-so1wbjnqvwSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gh200-144gbx2-throughput-lora-bf16-poaiagtxhwSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gh200-144gbx1-throughput-lora-fp8-ympsjmv1kaSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gh200-144gbx1-throughput-bf16-q5zpqywmfaSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gb200x1-throughput-lora-fp8-a95si3pbhqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gb200x1-throughput-lora-bf16-uiwiw63xlqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-b200x1-throughput-lora-fp8-jsjhx0fliaSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-b200x1-throughput-lora-bf16-c9rmkudj4gSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-a100x4-throughput-lora-bf16-aijyxdkkrgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-a100-sxm4-40gbx8-throughput-lora-bf16-kikwdoesqaSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-a100-sxm4-40gbx4-throughput-bf16-z6eh-d-klqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
bf16-6f6073b423013f6a7d4d9f39144961bfbfbc386bSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-rtx6000-blackwell-svx4-latency-fp8-rjbbutwgowSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-rtx6000-blackwell-svx4-latency-bf16-lmjdu45fbgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-rtx6000-blackwell-svx2-throughput-bf16-hkhtcznolaSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-rtx6000-blackwell-svx2-throughput-lora-bf16-4qsdosckyaSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-rtx6000-blackwell-svx2-latency-nvfp4-pvyovawtraSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-rtx6000-blackwell-svx1-throughput-nvfp4-cj0lb0pxzwSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-rtx6000-blackwell-svx1-throughput-lora-fp8-hqo5kbjr7aSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-rtx6000-blackwell-svx1-throughput-fp8-kjlz6ej8qaSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-l40sx4-throughput-lora-bf16-mdptyecydqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-l40sx4-throughput-bf16-hjnsn-l62qSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-l40sx4-latency-bf16-ceab5atcgqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-l40sx4-latency-fp8-wasnfa5nqqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-l40sx2-throughput-fp8-npxd9s3vgaSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h200x4-latency-bf16-3-tuwwk2zgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h200x2-throughput-lora-bf16-amhpkaf5dgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h200x2-throughput-bf16-fxr1bhtncgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h200x1-throughput-lora-fp8-mckbwsdw6gSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h200x1-throughput-fp8-g1ahdkwydqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h200-nvlx4-latency-bf16-sa27xy-b-qSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h200-nvlx2-throughput-lora-bf16-d27u-el8mqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h200-nvlx2-throughput-bf16--r9iuus-kgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h200-nvlx2-latency-fp8-pbiys1g11qSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h200-nvlx1-throughput-lora-fp8-5fb-5h-70qSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h200-nvlx1-throughput-fp8-cgkqbh3ywaSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h200-nvlx1-throughput-bf16--veca7jj7qSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h100x8-latency-bf16-5a8lbcmubgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h100x4-throughput-lora-bf16-ehyq4czzzgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h100x4-throughput-bf16-ilpx26ubzqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h100x2-throughput-bf16-9tpvvvsdgqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h100x2-latency-fp8-m6ubgz1shgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h100x1-throughput-fp8-japezlp9bgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h100-nvlx8-latency-bf16-pilgx9msawSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h100-nvlx4-throughput-lora-bf16-0zy39j3qrwSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h100-nvlx4-throughput-bf16-fai7cplxrqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h100-nvlx2-throughput-bf16-m7hdnagekqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h100-nvlx2-latency-fp8-i3h1lgxdvwSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h100-nvlx1-throughput-lora-fp8-nt3n466bfwSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-h100-nvlx1-throughput-fp8-cocyoyn9owSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gh200-480gbx1-throughput-lora-fp8-u8vvpff5naSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gh200-480gbx1-throughput-fp8-h6henhr0ygSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gh200-480gbx1-latency-fp8-pvmm1jqvmqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gh200-144gbx2-throughput-lora-bf16-321uk4extgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gh200-144gbx2-throughput-bf16-io6jk-ssvqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gh200-144gbx2-latency-fp8-6adckifjrgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gh200-144gbx2-latency-bf16-ew77smwpyaSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gh200-144gbx1-throughput-lora-fp8-xc5vr-be8gSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gh200-144gbx1-throughput-fp8-fcapklsu4wSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gh200-144gbx1-throughput-bf16-l994appnugSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gb200x2-latency-nvfp4-r372zyhjsaSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gb200x2-latency-fp8-1tld-qb-lqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gb200x2-latency-bf16-3x7wdojfraSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gb200x1-throughput-nvfp4-vuze3lfd0gSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gb200x1-throughput-lora-fp8-fws6td64hgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gb200x1-throughput-lora-bf16-5-mvpnnobqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gb200x1-throughput-fp8-wbnh5om15qSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-gb200x1-throughput-bf16-s8yniyzhlgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-b200x2-latency-nvfp4-kvkxu1wpvwSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-b200x2-latency-fp8-ktjp-grolaSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-b200x2-latency-bf16-gekrsdtlcgSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-b200x1-throughput-nvfp4-0cmo68cacqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-b200x1-throughput-lora-fp8-9mylqcazswSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-b200x1-throughput-lora-bf16-xmegi0qbwaSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-b200x1-throughput-fp8-gcmckoihnqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-b200x1-throughput-bf16-yg-ypifuhaSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-a10gx8-throughput-bf16-y9-kvkf5zwSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-a10gx8-latency-bf16-hajemtkosqSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-a100x4-throughput-lora-bf16-ebqpfmbcraSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-a100x8-latency-bf16-rmu2wihslwSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-a100x4-throughput-bf16-xxxvtm3hnaSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.
trtllmapi-pt-runtime-params-a100x2-throughput-bf16-lioi8a040wSigned
This image has a digital signature verifying that it has not been altered or corrupted since its signing.