nemotron-3.5-lightning

NVIDIA

Container

NVIDIA

nemotron-3.5-lightning

NVIDIA-Nemotron-3.5-Lightning-30B-A3B is a large language model (LLM) trained by NVIDIA. The model employs a hybrid Mixture-of-Experts architecture, utilizing interleaved Mamba-2 and MoE layers, along with select Attention layers.

NVIDIA NIM

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	09/16/2026 2:52 PM UTC
sha256:ceb7385b9e1b9560e1b342e407a91cdb7adaca7d16335e38ea435817320442d9	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	09/16/2026 2:52 PM UTC
sha256:83aaf6fe8c255cfe34ecfb30d1d99cff86e4557d42af44347bf61f7a912aac7e	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	09/16/2026 2:52 PM UTC
sha256:be70eda0593dce1394446fffa72172eb9a94863e7d5ac0049e2675d4e244cd50	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	09/16/2026 2:52 PM UTC
sha256:8a1564017c720996c7b452e1fb96a2f1db130942bea1ff7dc76536b4a3bf950d	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	09/15/2026 10:26 PM UTC
sha256:e6a383a8aec7a4ab479d17d846932131abaafc7a7581e95d879863103746361a	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	09/15/2026 10:26 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NAME=nvidia/nemotron-3.5-lightning`	09/15/2026 10:26 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.13`	09/15/2026 10:26 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=nvidia/nemotron-3.5-lightning`	09/15/2026 10:26 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	09/15/2026 10:26 PM UTC