Background
A lot of what I read is still on paper: letters from the bank, school handouts, a recipe, a library book. I often want to listen to them instead, and I want to follow the words while I listen, so my eyes have something to hold on to.
So I built Outloud Reader. You take a photo of a printed page (or open a PDF, or paste text), the app reads it out loud, and the phrase being spoken is highlighted on screen. It runs on iOS and Android, and it can translate a page before reading it.
This post is about the reading screen , the part people look at for minutes at a time. It turned out to be the hardest screen in the app to get right.
What I wanted from it:
the current phrase highlighted, the current sentence easy to find, the rest of the page calm;
tap any word to jump the audio there;
a "just listen" mode with the text hidden, which you can still peek at;
Japanese, Chinese and Thai behaving like any other language.
What I tried
Word-by-word highlighting, like karaoke.…