thinking out loud

Writing

What I'm learning as I build — algorithms, systems, on-device AI, hardware, and the occasional rabbit hole that turned out to be worth it.

AllAndroid1On-device AI1Systems1RSS
6 min read

Two models, one phone, 2GB

I wanted an assistant that never talks to a server. That meant running a speech model and a language model on a mid-range Android phone — and the naive way to do it gets you killed by the OOM reaper in about four seconds.

  • On-device AI
  • Android
  • Systems
Read it