Mistral-Small-3.2-24B-Instruct-2506

Mistral AI

Container

Mistral AI

Mistral-Small-3.2-24B-Instruct-2506

Mistral Small 3.2 24B adds state-of-the-art vision understanding and enhances long context capabilities up to 128k tokens without compromising text performance.

NVIDIA NIM

Layer	Label		Created
sha256:7d8e5274ec14b857f08d26e100af422d8ec915854d4333679680a92833cc460c	RUN	`NIM_MODEL_NAME=mistralai/mistral-small-3.2-24b-instruct-2506 NIM_VERSION=1.3.1.rc3 NIM_CONTAINER_NSPECT_ID=NSPECT-RVCA-XZTD NIM_MODEL_NSPECT_ID=NSPECT-Q85I-2R1T NIM_TYPE=llm NIM_USER_ID=1000 sed -i 's/num_new_tokens + num_external_tokens/request.num_tokens - num_computed_tokens + num_external_tokens/g' /opt/nim/llm/.venv/lib/python3.12/site-packages/vllm/v1/core/sched/scheduler.py`	08/06/2025 9:39 PM UTC
sha256:24647feb2eae333ffa604c7ad535d61926a0df57d3053da2e47e8d713466d483	RUN	`NIM_MODEL_NAME=mistralai/mistral-small-3.2-24b-instruct-2506 NIM_VERSION=1.3.1.rc3 NIM_CONTAINER_NSPECT_ID=NSPECT-RVCA-XZTD NIM_MODEL_NSPECT_ID=NSPECT-Q85I-2R1T NIM_TYPE=llm NIM_USER_ID=1000 sed -i 's/get_num_embeds()/length/g' /opt/nim/llm/.venv/lib/python3.12/site-packages/vllm/multimodal/profiling.py`	08/06/2025 9:39 PM UTC
sha256:5756e1e952c80d1855b608c6c0a43a201fb96c244d6eb3b2c6a384296d7ff187	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	08/06/2025 9:39 PM UTC
sha256:48d4c5ea9ff074a1df75950d4de7386a5b3f214c420e015ed5e95bed7ebe2410	COPY	`./NOTICES/* /opt/nim/`	08/06/2025 9:39 PM UTC
sha256:82f451b37a413d091344e084fe7681eb4d9efd7cfed9cbdb54628c887b9c249d	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	08/06/2025 9:39 PM UTC
sha256:5ab8a1f8f68449e3492d777b25ffc20280230244613f08d7b785f1751e3ecc2e	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	08/06/2025 9:39 PM UTC
sha256:f8b777d232e5ac19064630a5c34164570f828ee55f543661c635bd5c30ee0b36	COPY	`./VERSION /opt/nim/VERSION`	08/06/2025 9:39 PM UTC
sha256:8419cdb07d964d4c917c7f4078601ef9fc80a9df15606f4f32129d9187d32ca9	COPY	`./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	08/06/2025 9:39 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`VLLM_ATTENTION_BACKEND=FLASH_ATTN`	08/06/2025 9:39 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_GUIDED_DECODING_BACKEND=xgrammar`	08/06/2025 9:39 PM UTC