NVIDIA
Llama-3.1-Typhoon2-70B-Instruct
Container
NVIDIA
Llama-3.1-Typhoon2-70B-Instruct

This container houses the Llama3.1-Typhoon2-70b-Instruct, an instruction-tuned LLM by SCB 10X & VISTEC. Fine-tuned from Meta's Llama 3.1-70B, it excels in complex generative and conversational tasks for both Thai and English.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
model.manifest.yaml=H4sIAAAAAAAC/+3dT29ctxUF8L0/hXZeSeblfwooigLtspt+AeGSvHRUjyRjRk7dfvqeJ9uJk7GcDJBoNsdIDEUzmjfke7w89+mHyWH8YHd686PtD7cP99cXr/2Ve/3q/f5h3e7s5mA7G4944Gbsbx9tf6vXF/rh8eHV3cO03fXFbqd3ehmu5PLxv+9/eHi495fF9cvb+8Pj/sN4fLXHz+vBri/kStyVfHndw/Wry4vbeX3hnBQ/qkTJriSpsrwLKfipIfZaLRTp1VWZXmd1MtsMTsSZ1jr6aunVxcWjvsXLXeDPMn282T3s8R5f4/D2+pffvbnTjzd7vX+Hh4P/9OBud3dj929v7/EWH+3+8LDf48m7u6cH37/HM+XTE9/vbdx+mqG+JD9973F7PH56/HH/uL1W/3C7m9p39tVb+M/D/t3hvQ77/C4/jf/i6c+//vG3v//zH1d388s3Li4+7G+vL+7fjus3b+5v794cRhf38c1vTPT1D+vS1Lmx4iV+6vLDwS4fHx52lz/6v24H/MtPB/rpODjv493hwx0GtNN3Fq6DtTW6jyXaSphunBiVoGHEOqRaaepTGmWlnrbzkHJtuY8pamt239urX77u4erz6/7JI/v18Z4fYPXWcllZC4Y3Ei6upbWv1MQ5N5sbJaacuvcrWu5pOcuxudZMNQRb+mWAD/fr9u3Vvw+4GP7ssf18qOeH5UqopersoQcpS2JuxZWegzPLLdblh8sZozPXXF89ZCwdVzyeiieXL8N6a/e2109r/eVG+O2jPj/YpC16wZVosyZXg/NmcaKCTIzZ55GXlemS9VRthlJ7s+mjw0muNfingrH9eSpflzjtTi4f1vZFcFcHXfapCBz+7GH/1vGfnwDpTi3mFPuwpAurNCfXwpgrlOn7lBS0Je1tlKxTC2apWJ1TQtKx/DyaAH/mCfAnToDlgks7BIkxBusZy7WttbBoV+9TZxR1zXrQWtSHWHGdu9VlWO+YlxqOJiCceQLCiRMwccV7E4suYPV661gDK6+caguz1TJrXjW7WKVLH5JR3/JcXeccq9ZlRxMQzzwB8dQlgFPrU9/Ob7Q+m0jE2HS0Pn320rRaEmkzjTo0TXzfuRRLmsk7h8eOJiCdeQLSiROwbUZFkqrWuMytNWqv2Y9ZQqhWIyqgPk2QyxPpaoVRdRXscdla1FmOJiCfeQLyiRMQR8/qtg3OXEE4iWGrcs0nvERPbo4+cL1jEpxVFERDPsmrJOx7tpaG4yJYzjwB5cQJyCmVbg4pLQ4ptYiUsDJCjPejhYDBa94mAFXPCTa/tMW6WTJyQhz1GxNQzzwB9dQJ8DJ7MU2o+8HSQprDeCdeqIfoesBKEPMxKUKtZHQPNmLMNcvIoUQXjyagnXkC2qkTgA7JsAPUUbetH8XfS8HuX30bKbWgY6IKlhHcwLQgpy+pDRtCbilbXPLrCRB33gl45vjf2QXybDnXiWjeXOpx5ibe20hFR1bFOGuuqPm6XEOx0FgVEQjBsTVB2chHE3DmJCinJsEoY7k6OzKvSEIfFtaqUrtr0+URW+puqBfJKPkrIfd3r90FVMxkqx9vg3LmJCinJsEZnaL6o/1xpWI1xIbOZ7iBiu86LoMsrW/lMYViqbrR2sQ7ztrxU21KP5qAMydBOTUJriWpa6haszZtFkyH4tR6JP4o2P2T+Jldys2cCfIBFkiWvj0TkzT90QScOQnKqUlwVpdKDKN4XPj4t9eInjeOJGiArVrrWtHF4xJYyRmugBlyRmhCIzxQJt3RBJw5CcrJSbBMdMET13PK3VWEAOvV+daiq/gr1NhLr94S/iOa1+VLU2lIxKJdjnOAnDkJyqlJEFugc4Y34SY6gZnQ92OX8+j2S0VIjClEbHZ1YA/wUxy6goglkPFwmrO3413gzElQTk2CEavbl63Xr6lYCIg6SaIu6ZZRE7tbFlpDOC5VxjDsl+gFMpIjqsRwUY8m4MxJUE5Ngk6TpeLndj8ou7CwyYXpXcG1JHW2Iq0mP9Aim4xatdUhSAxYC6iCQfxROyxnToJyahLUiYWcxgzejYLtYLszMtEgWOpzjaRRUBVSWL205vvKuprb7p2MICtWd7QN+jMnQX9yEhy4zrHRjbHabNo7gkDyATviGDjzpayZc6yGMhgRC0NGdcgmmqThutGjbdCfOQn6U5MgytyMC12vSew5SEWZ70jCeeaF2aheFsZt29aQYlvoGHx0HvOxgq/B6tEEnDkJ+lOToG4rILTgx2iGwt6w93tJRbAvKk479kJ0hi7OiEWPRqmXsTwCMS4Z1RiO7gn6MydBf2oS9GiAWze0tijsbuDEuumxDUhShIqYVkDTXwwJy3kMvre+fCxISmJYKcd3hPyZk6A/NQl6X1sIpU/UdhRBt7Y73oZaF2MtIyqu87VyGIZFElbUhjy4nEvoIev2G6+jCThzEvSnJsGSs8QsVqxkxHvUN9FRy8wxT80Z+13H9ZBbywMNAPrAHvAjE2HQ8GA6SoL+zEnQn5oEV0GHj/ONUDPWahaz9ynXorbdD87R0PwudNnWYupj4aGc6yiKeqiluONd4MxJ0J+aBNP260vxtQ8UeYeq32vA0FBMMOy6UlMsEh8HsiDG7joujTLGtkekge2zHU3AmZOgPzUJ4kxitBZXQaU3WdsNQWRAvzS4ahKw2mdKwdAE95jKU2TKPiAijTlDP7oh4s+cBP2pSVCCmFvo/2zUhPjf0OJU7HGh2Cy4MlboWjxqYBstYztQjL32mJdYdeKPmqFw5iQYTk2CuJgRfJ3V4M0W4l3JDltfS2l1n3zq3Ve0AmladLg8usMGiY4YYRjJCIvk6wn4+ohXt/fTPr7IL8S/d+zv3AjRzWz0tMbCmBQ7X3SzRVdq325+SNvuiEkX5GHkny0KqKuzYuOb6Ardl+3v8N7Gre5uHh/e4eA3d/r+Rcb8zGG/c6E7Q2zF2UWIXzXoLNGvvlQLEn1WNH8loC/MAas8uS0WbncB+kIaxkUfv9z3eTre7f9s/yKj/OXRvlPHBUt3hVFmqjYczmToeP8+O3QxsRVk+tjRycUkBUXO+pi5NF9mRZQt1n89uJfkHN886HduXpSwBP1rbrngrCXNPpkf2+8wEFcw9hWweYfus6kZUlzrITktqNp95GI/DfVhd4P38vmgNz/6FxrsNw/7nVVa3MRZ9Tid3iF7TWxWI0vC/myzSYk5hOyRVQUZrmCYyYuWXnHusWK7fkZzMkvPLuLCTwg9peF66WvWGFwsazhc+KgGbhXfUhwa68CGH6rI6pjP5dqzaG7p7mB/FIyrhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcb8PxqGSjdh6nK2h1teZZ+ySOva1FluTDSwFH9cqKWB5FI3irSSPPqevrSU4/6fJEc0RzRHNEc0RzRHNEc0RzRHNEc0RzRHNEc0RzRHNEc0RzRHNEc0RzRHNEc0RzRHNEc0RzRHNEc0RzRHNEc0RzRHNEc0RzRHNEc0Rzf1ONBdKmsOtVbOEMLxG7PDdmi1Evbrm2m76bhcNdn8Nvdp21JpEKzbI5uZ8mU+T84RxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHG/D8Zhe4/b3T409IaW18ry6P+f2oaIXD+GSRt1GVqg7tHnC9Z6ROKrrVgdLb0MjIuEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxhHGEcYRxvw/GlaVRMVd1uBDqkozFn2Ui2KDg6VhTBzK+9lnjdrtnxDbwhUf8bcvFHk6FcT+e/klxNG80bzRvNG80bzRvNG80bzRvNG80bzRvNG80bzRvNG80bzRvNG80bzRvNG80bzRvNG80bzRvNG80bzRvNG80bzRvNG80bzRvNG80b0/mrQ/ZnJb6UEIVvEStmp3GufW7KfS+/Z5n2hgdV4QzwWaPsF8MuUcrOsRnzduXT2n76rtYjB9v9nr/Dg8HTw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD/fHebhRY/fq8hZrNKGLdTltJCKhypdV68A/aAUVcTeXXFH6JgKvOUWdzwjHf+5nwEWaN5o3mjeaN5o3mjeaN5o3mjeaN5o3mjeaN5o3mjeaN5o3mjeaN5o3mjeaN5o3mjeaN5o3mjeaN5o3mjeaN5o3mjeaN5o3mjeaN5q3n83b2u7f9oYFHUUQ5pNfZeiaBcE/pxhSi3OgF/RuFbyU+I5R5C37pl56PN9nwNHD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cP97OFmQMLp1c+6hsWpFeE+zLV1QGK+eBf7cKNV62Yt4EnLapwrrIGK557uePxhHu5TkdrjySf/v1Hx9f5xe63+4XY3te/sq7dANEc0RzRHNEc0RzRHNEc0RzRHNEc0RzRHNEc0RzRHNEc0RzRHNEc0RzRHNEc0RzRHNEc0RzRHNEc0RzRHNEc0RzRHNEc0RzRHNEc094TmTHNQQRVvOOfofUPYbvl4V3Hlb78CxVueqOfNZSyN5lWxGSRFUUA4Quxf5/sQuUoPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw9HD0cPRw/3k4dbLaHTk+1z4cJExUPZd2nhupjpaRrxYqFPVz26u1o1dfULjV/S7Qb4bP5ZD7d0dzCaN5o3mjeaN5o3mjeaN5o3mjeaN5o3mjeaN5o3mjeaN5o3mjeaN5o3mjeaN5o3mjeaN5o3mjeaN5o3mjeaN5o3mjeaN5o3mjeaN5q3P8K8/R87/TALbtUBAA==
08/06/2025 8:14 AM UTC
sha256:1d7e97db6b489d4dedee0ebbec91b7ceef36e35613d9c8291be8ce7771f272abCOPY
CONTAINER_LICENSE /opt/nim/LICENSE
08/06/2025 8:14 AM UTC
sha256:5910923aa6302fbf92127d7de3f54658ce2e94d539d25cbd23c8fa70a5123c86COPY
./notices/* /opt/nim/
08/06/2025 8:14 AM UTC
sha256:199536a416120bfb87074227045952b39db28534dd3e26cebf207b4783defe79COPY
banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
08/06/2025 8:14 AM UTC
sha256:57a044c02688874e6835ddfd364bfd9ad71139c90525b33a2f5e45683a9a7798COPY
MODEL_LICENSE /opt/nim/MODEL_LICENSE
08/06/2025 8:14 AM UTC
sha256:dec29cb9ee5bd1d11a8ab67eaac7809c1910a512c521e9dcd74b2320d0f903c8COPY
model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
08/06/2025 8:14 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_HTTP_API_PORT=8000
07/22/2025 6:05 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_SERVED_MODEL_NAME=scb10x/llama-3.1-typhoon2-70b-instruct
07/22/2025 6:05 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NAME=scb10x/llama-3.1-typhoon2-70b-instruct
07/22/2025 6:05 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.10.1
07/22/2025 6:05 AM UTC
...