#On-Device AI

Running Llama 3 on Mobile: The Ultimate Guide to Local LLMs with Flutter

The future of AI is offline. In this 4,500-word tutorial, we compile Llama 3 to run on iOS and Android using MLC LLM and Flutter. We benchmark token speed, memory usage, and battery drain.

2/8/202632 min read

On-Device Vector Search: SQLite + AI Embeddings in Flutter Apps

Running Llama 3 on Mobile: The Ultimate Guide to Local LLMs with Flutter