Inkling | NVIDIA NGC

Thinking Machines Lab

Inkling

Container

Thinking Machines Lab

Inkling

This NIM container houses Inkling model, which is a 66-layer decoder-only transformer with a sparse Mixture-of-Experts (MoE) feed-forward backbone, featuring 975B total parameters and 41B active parameters

NVIDIA NIM

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	08/25/2026 12:42 AM UTC
sha256:c067cdd71ea707accb85b737403bbdfa3298449afe7c06b1d6fc359281976033	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	08/25/2026 12:42 AM UTC
sha256:bc7675b9b24427ba58107681be5d7835f44ca55b9528bf667ee2393ac7f80b9f	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	08/25/2026 12:42 AM UTC
sha256:f711375486c8f0f3afb795150e42f6e783ef28fef525621d62db4cd953caaa8d	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	08/25/2026 12:42 AM UTC
sha256:1529412ddf907df3e34ed60409402d9da9787c07c8eeab27ab15e9effaed6f69	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	08/25/2026 12:42 AM UTC
sha256:17b778223d67f34d9b5714289c19770620ca3684a824a67a550fd42aeaf8ac0b	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	08/25/2026 12:42 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_ALLOW_NVFP4_EMULATION=1`	08/25/2026 12:42 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_PASSTHROUGH_ARGS=--tokenizer-mode inkling --reasoning-parser inkling --tool-call-parser inkling --enable-auto-tool-choice --exclude-tools-when-tool-choice-none --structured-outputs-config '{"enable_in_reasoning":false}'`	08/25/2026 12:42 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_KVCACHE_PERCENT=0.80`	08/25/2026 12:42 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.10-variant`	08/25/2026 12:42 AM UTC