top of page
FlutterCon_logo.png

16 - 17 JULY 2026

ORLANDO

FlutterCon_icon_turned.png
Anita_Singh_edited.jpg

( SPEAKER )

Jhin Lee

Flutter GDE | GDG & Flutter Montreal | FCAIC | Senior Dev @Unity

( SESSION )

Flight Mode AI: Building Local LLM Apps Easily with LlamaDart

We are used to "high confidence" coding with cloud models like Gemini, but what happens when the WiFi cuts out at 30,000 feet? I started building a writing assistant for myself and quickly realized that true reliability meant going local. But integrating llama.cpp—the gold standard for local inference—usually means entering "dependency hell," managing complex C++ builds across Linux, Windows, Android, and iOS. In this talk, I will show you how llamadart(https://pub.dev/packages/llamadart) solves this. By leveraging modern Dart 3.10 build hooks and GitHub Actions, I’ve automated the heavy lifting: the library detects your platform and auto-downloads the correct pre-compiled binary at build time. We will move beyond the low-level architecture and focus on the developer experience available right now. I’ll demonstrate how easy it is to spin up an offline AI: Zero Configuration: No CMake, no NDKs, no manual compilation. High-Level APIs: Initialize a model and start chatting with just a few lines of Dart code. Auto-Templating: Forget manual string formatting; let the library handle the chat templates for you. Whether you want to build a privacy-first assistant or just ensure your app works in "Flight Mode," you’ll leave this session ready to build your first offline AI app today.
bottom of page