常用
####



推理框架
========


MLC_LLM
-------

* Universal LLM Deployment Engine with ML Compilation
* https://llm.mlc.ai/
* GitHub: https://github.com/mlc-ai/mlc-llm