Llama-3.3-70B-Instruct

Meta

The Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out).

NVIDIA AI Enterprise Supported NVIDIA NIM

Use the NGC CLI to download:

Copied!

Latest (trtllmapi-pt-runtime-params-a100-sxm4-40gbx8-throughput-bf16-uoswlqfxbq)Signed

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-a100-sxm4-40gbx8-throughput-bf16-uoswlqfxbqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h200x2-latency-fp8-3ur-jvqwswSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-rtx6000-blackwell-svx4-latency-bf16-teblpznxhqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h100-nvlx4-throughput-lora-bf16-evps2vqmuaSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gh200-144gbx1-throughput-bf16-rwzxefagaaSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-a10gx8-throughput-lora-bf16-xgayfmpmdwSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-rtx6000-blackwell-svx4-throughput-lora-bf16--gs1zcvpbgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-rtx6000-blackwell-svx1-throughput-lora-fp8-b-speomfcgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-l40sx8-throughput-lora-bf16-q4wavaf-yaSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-l40sx4-throughput-lora-fp8-8j4f0lap6aSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h200x2-throughput-lora-bf16-xs4cesuamwSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h200x1-throughput-lora-fp8-wifrr0lgbgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h200-nvlx2-throughput-lora-bf16-dqcohc52-wSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h200-nvlx1-throughput-lora-fp8-klyyvlydraSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h100x4-throughput-lora-bf16-mftrp6-wiqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h100x2-throughput-lora-fp8-re-sjmcqhqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h100-nvlx4-throughput-lora-bf16--ix7eqfnvwSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h100-nvlx1-throughput-lora-fp8-udvyhbe7tgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gh200-480gbx1-throughput-lora-fp8-so1wbjnqvwSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gh200-144gbx2-throughput-lora-bf16-poaiagtxhwSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gh200-144gbx1-throughput-lora-fp8-ympsjmv1kaSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gh200-144gbx1-throughput-bf16-q5zpqywmfaSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gb200x1-throughput-lora-fp8-a95si3pbhqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gb200x1-throughput-lora-bf16-uiwiw63xlqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-b200x1-throughput-lora-fp8-jsjhx0fliaSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-b200x1-throughput-lora-bf16-c9rmkudj4gSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-a100x4-throughput-lora-bf16-aijyxdkkrgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-a100-sxm4-40gbx8-throughput-lora-bf16-kikwdoesqaSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-a100-sxm4-40gbx4-throughput-bf16-z6eh-d-klqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

bf16-6f6073b423013f6a7d4d9f39144961bfbfbc386bSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-rtx6000-blackwell-svx4-latency-fp8-rjbbutwgowSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-rtx6000-blackwell-svx4-latency-bf16-lmjdu45fbgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-rtx6000-blackwell-svx2-throughput-bf16-hkhtcznolaSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-rtx6000-blackwell-svx2-throughput-lora-bf16-4qsdosckyaSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-rtx6000-blackwell-svx2-latency-nvfp4-pvyovawtraSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-rtx6000-blackwell-svx1-throughput-nvfp4-cj0lb0pxzwSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-rtx6000-blackwell-svx1-throughput-lora-fp8-hqo5kbjr7aSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-rtx6000-blackwell-svx1-throughput-fp8-kjlz6ej8qaSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-l40sx4-throughput-lora-bf16-mdptyecydqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-l40sx4-throughput-bf16-hjnsn-l62qSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-l40sx4-latency-bf16-ceab5atcgqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-l40sx4-latency-fp8-wasnfa5nqqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-l40sx2-throughput-fp8-npxd9s3vgaSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h200x4-latency-bf16-3-tuwwk2zgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h200x2-throughput-lora-bf16-amhpkaf5dgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h200x2-throughput-bf16-fxr1bhtncgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h200x1-throughput-lora-fp8-mckbwsdw6gSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h200x1-throughput-fp8-g1ahdkwydqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h200-nvlx4-latency-bf16-sa27xy-b-qSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h200-nvlx2-throughput-lora-bf16-d27u-el8mqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h200-nvlx2-throughput-bf16--r9iuus-kgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h200-nvlx2-latency-fp8-pbiys1g11qSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h200-nvlx1-throughput-lora-fp8-5fb-5h-70qSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h200-nvlx1-throughput-fp8-cgkqbh3ywaSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h200-nvlx1-throughput-bf16--veca7jj7qSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h100x8-latency-bf16-5a8lbcmubgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h100x4-throughput-lora-bf16-ehyq4czzzgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h100x4-throughput-bf16-ilpx26ubzqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h100x2-throughput-bf16-9tpvvvsdgqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h100x2-latency-fp8-m6ubgz1shgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h100x1-throughput-fp8-japezlp9bgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h100-nvlx8-latency-bf16-pilgx9msawSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h100-nvlx4-throughput-lora-bf16-0zy39j3qrwSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h100-nvlx4-throughput-bf16-fai7cplxrqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h100-nvlx2-throughput-bf16-m7hdnagekqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h100-nvlx2-latency-fp8-i3h1lgxdvwSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h100-nvlx1-throughput-lora-fp8-nt3n466bfwSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-h100-nvlx1-throughput-fp8-cocyoyn9owSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gh200-480gbx1-throughput-lora-fp8-u8vvpff5naSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gh200-480gbx1-throughput-fp8-h6henhr0ygSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gh200-480gbx1-latency-fp8-pvmm1jqvmqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gh200-144gbx2-throughput-lora-bf16-321uk4extgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gh200-144gbx2-throughput-bf16-io6jk-ssvqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gh200-144gbx2-latency-fp8-6adckifjrgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gh200-144gbx2-latency-bf16-ew77smwpyaSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gh200-144gbx1-throughput-lora-fp8-xc5vr-be8gSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gh200-144gbx1-throughput-fp8-fcapklsu4wSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gh200-144gbx1-throughput-bf16-l994appnugSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gb200x2-latency-nvfp4-r372zyhjsaSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gb200x2-latency-fp8-1tld-qb-lqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gb200x2-latency-bf16-3x7wdojfraSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gb200x1-throughput-nvfp4-vuze3lfd0gSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gb200x1-throughput-lora-fp8-fws6td64hgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gb200x1-throughput-lora-bf16-5-mvpnnobqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gb200x1-throughput-fp8-wbnh5om15qSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-gb200x1-throughput-bf16-s8yniyzhlgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-b200x2-latency-nvfp4-kvkxu1wpvwSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-b200x2-latency-fp8-ktjp-grolaSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-b200x2-latency-bf16-gekrsdtlcgSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-b200x1-throughput-nvfp4-0cmo68cacqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-b200x1-throughput-lora-fp8-9mylqcazswSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-b200x1-throughput-lora-bf16-xmegi0qbwaSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-b200x1-throughput-fp8-gcmckoihnqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-b200x1-throughput-bf16-yg-ypifuhaSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-a10gx8-throughput-bf16-y9-kvkf5zwSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-a10gx8-latency-bf16-hajemtkosqSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-a100x4-throughput-lora-bf16-ebqpfmbcraSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-a100x8-latency-bf16-rmu2wihslwSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-a100x4-throughput-bf16-xxxvtm3hnaSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

trtllmapi-pt-runtime-params-a100x2-throughput-bf16-lioi8a040wSigned

This image has a digital signature verifying that it has not been altered or corrupted since its signing.

View all 372 versions...

OverviewOverview Version HistoryVersion History File BrowserFile Browser

372 Versions

trtllmapi-pt-runtime-params-a100-sxm4-40gbx8-throughput-bf16-uoswlqfxbqSigned