Skip to main content
NVIDIA
Llama-3.3-70b-Instruct
Container
NVIDIA
Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    04/20/2026 5:25 AM UTC
    sha256:28b0bde536904f738f227bcb2117f03e28a5d4994784ab2f7a94b8fc2838367eCOPY
    --chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
    04/20/2026 5:25 AM UTC
    sha256:2dbeca6e8da53f5c6820693ba48f9490a678b3b6fe366fc81ae925f00d66d23aCOPY
    --chown=nim:nim NOTICE /opt/nim/NOTICE
    04/20/2026 5:25 AM UTC
    sha256:8ea22c12d93a439d6f1b1b8e33885bc1e74f5a6b0691f8c47de27eef887a45efCOPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    04/20/2026 5:25 AM UTC
    sha256:ffc142e4580344fbc09d90cfaddd16a6bc130697fbf151c5716a7deb8c510749COPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    04/20/2026 5:25 AM UTC
    sha256:b273566864e94ed6776d6a98e2f01b7adad1724bcff637177b620d8c46d65d2dCOPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    04/20/2026 5:25 AM UTC
    sha256:97d1f66110ed8e7a0636ad68b432e039e3bbc0b72c32768ed98cbe1c8da3652eCOPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    04/20/2026 5:25 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.3
    04/20/2026 5:25 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct
    04/20/2026 5:25 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    04/20/2026 5:25 AM UTC
    ...