3.8.1. 常用¶

推理框架¶

MLC_LLM¶

Universal LLM Deployment Engine with ML Compilation
https://llm.mlc.ai/
GitHub: https://github.com/mlc-ai/mlc-llm