MLC-LLM for Android
https://mlc.ai/blog/2023/05/08/bringing-hardware-accelerated-language-models-to-android-devices blog
https://github.com/mlc-ai/mlc-llm/tree/main/android repo
Samsung Galaxy S23(Snapdragon 8 Gen 2 Mobile Platform)にVicuna 7Bモデルを効率的にデプロイできた