Skip to main content
NVIDIA
Llama-3.3-70b-Instruct
Container
NVIDIA
Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    08/17/2026 1:49 PM UTC
    sha256:3e8fb88c82edf6b2fe93d02f934dc97d0dc4dc2539a781586b23c49cb8fac300COPY
    --chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
    08/17/2026 1:49 PM UTC
    sha256:23637eec2f99e1997316d77f0286974c4560fd2f5eb3dcd8abc334e5ee9bf2aeCOPY
    --chown=nim:nim NOTICE /opt/nim/NOTICE
    08/17/2026 1:49 PM UTC
    sha256:d8ae938bd926128c856fac0d7ebcc5273ebb543e4bd13eaa742b5bd378173b0bCOPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    08/17/2026 1:49 PM UTC
    sha256:10a3b06fa8698286bd9e82c1a455342668c74b86269f27466a06ef8d08912eb7COPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    08/17/2026 1:49 PM UTC
    sha256:765a6aca9df43ffdd284aee2b9f0990a4da324b39975c3fb5f2c1b623e3c0b74COPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    08/17/2026 1:49 PM UTC
    sha256:d7e2659034f0ca7e20de4d707948a4bcc26f4cd57557249ec8ba13b7d7c00f36COPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    08/17/2026 1:49 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.11
    08/17/2026 1:49 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct
    08/17/2026 1:49 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    08/17/2026 1:49 PM UTC
    ...