#On-Device AI

Running Llama 3 on Mobile: The Ultimate Guide to Local LLMs with Flutter

The future of AI is offline. In this 4,500-word tutorial, we compile Llama 3 to run on iOS and Android using MLC LLM and Flutter. We benchmark token speed, memory usage, and battery drain.

2/8/202632 min read

Browser-Native AI: Running LLMs on the Client in 2026

Running Llama 3 on Mobile: The Ultimate Guide to Local LLMs with Flutter