I keep a lot of notes, and I rarely remember the words I used in them. In March I wrote a note called "Rent split with Arjun". In October I searched for "what does my flatmate owe". Keyword search found nothing, because the two share no words.
So when I built VB Notes, a markdown notes app where every note is a plain .md file in a folder you choose, search by meaning was the part I cared about most. I also wanted it to run on the device. Notes are private, and I wouldn't use a search box that sends every question to a server for my own notes.
This is what it took to run a 350-million-parameter embedding model next to the notes on an iPhone, and the same model on Mac, Windows and Linux.
VB Notes on iPhone: searching "what does my flatmate owe" finds the note "Rent split with Arjun", marked "by meaning"
Picking the model
The phone app is Expo and React Native, and the model runs through react-native-executorch.…