👋 Welcome to MLC LLM¶
Machine Learning Compilation for Large Language Models (MLC LLM) is a high-performance universal deployment solution that allows native deployment of any large language models with native APIs with compiler acceleration. The mission of this project is to enable everyone to develop, optimize and deploy AI models natively on everyone’s devices with ML compilation techniques.
Quick Start¶
Check out Quick Start for quick start examples of using MLC LLM.
Introduction to MLC LLM¶
Check out Introduction to MLC LLM for the introduction and tutorial of a complete workflow in MLC LLM.