ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • Thinking Machines Lab
    Inkling
    Container
    Thinking Machines Lab
    Inkling

    This NIM container houses Inkling model, which is a 66-layer decoder-only transformer with a sparse Mixture-of-Experts (MoE) feed-forward backbone, featuring 975B total parameters and 41B active parameters

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    /opt/nim/start_server.sh
    		08/25/2026 12:42 AM UTC
    sha256:c067cdd71ea707accb85b737403bbdfa3298449afe7c06b1d6fc359281976033COPY
    --chown=nim:nim NOTICE /opt/nim/NOTICE
    		08/25/2026 12:42 AM UTC
    sha256:bc7675b9b24427ba58107681be5d7835f44ca55b9528bf667ee2393ac7f80b9fCOPY
    --chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE
    		08/25/2026 12:42 AM UTC
    sha256:f711375486c8f0f3afb795150e42f6e783ef28fef525621d62db4cd953caaa8dCOPY
    --chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    		08/25/2026 12:42 AM UTC
    sha256:1529412ddf907df3e34ed60409402d9da9787c07c8eeab27ab15e9effaed6f69COPY
    --chown=nim:nim VERSION /opt/nim/VERSION
    		08/25/2026 12:42 AM UTC
    sha256:17b778223d67f34d9b5714289c19770620ca3684a824a67a550fd42aeaf8ac0bCOPY
    --chown=nim:nim LICENSE /opt/nim/LICENSE
    		08/25/2026 12:42 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_ALLOW_NVFP4_EMULATION=1
    		08/25/2026 12:42 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_PASSTHROUGH_ARGS=--tokenizer-mode inkling --reasoning-parser inkling --tool-call-parser inkling --enable-auto-tool-choice --exclude-tools-when-tool-choice-none --structured-outputs-config '{"enable_in_reasoning":false}'
    		08/25/2026 12:42 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_KVCACHE_PERCENT=0.80
    		08/25/2026 12:42 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.10-variant
    		08/25/2026 12:42 AM UTC
    ...