Skip to main content
NVIDIA
Llama-3.3-70b-Instruct
Container
NVIDIA
Llama-3.3-70b-Instruct

This container houses the Llama-3.3-70B-Instruct, a 70B parameter, text-only language model for chat, coding and data generation. It offers strong performance comparable to larger models but with lower hardware requirements, and is optimized for dialogue.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    08/27/2026 4:12 PM UTC
    sha256:ca5da56b85e663dc8766022fe3af1e3a0827ad12575218eff803d8b7c37e42a6COPY
    --chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2
    08/27/2026 4:12 PM UTC
    sha256:e074da0e5e776e6cbb17d38c14df8a5667d0e779b99ea7fa2ac78dae99ad46c7COPY
    --chown=nim:nim NOTICE /opt/nim/NOTICE
    08/27/2026 4:12 PM UTC
    sha256:a6cb8aecc30c7f5e5ceb47a2167de4eeb9d254c6484172b7d87081bd2299508dCOPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    08/27/2026 4:12 PM UTC
    sha256:0e1fc5672c3f0011774a98a9182a044d0ee9013b5822afbbe718ea74c5954695COPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    08/27/2026 4:12 PM UTC
    sha256:236bc479c63c52f033415574bf44ce24c1a93dba03113f1496b8f77c0f996fbfCOPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    08/27/2026 4:12 PM UTC
    sha256:d45c29376be04dc6628d7841dce4205cd13960db967b60588a8db3051f99fe4dCOPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    08/27/2026 4:12 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.12
    08/27/2026 4:12 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_SERVED_MODEL_NAME=meta/llama-3.3-70b-instruct
    08/27/2026 4:12 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    08/27/2026 4:12 PM UTC
    ...