Menu

Building a read-aloud screen: phrases, tappable words and a finger that drifts
📰

Building a read-aloud screen: phrases, tappable words and a finger that drifts

DEV Community: swift·Alex S·about 12 hours ago
#FNAROrpy
#devtoswift#devto#dev#word#words
Reading 0:00
15s threshold

Background

A lot of what I read is still on paper: letters from the bank, school handouts, a recipe, a library book. I often want to listen to them instead, and I want to follow the words while I listen, so my eyes have something to hold on to.

So I built Outloud Reader. You take a photo of a printed page (or open a PDF, or paste text), the app reads it out loud, and the phrase being spoken is highlighted on screen. It runs on iOS and Android, and it can translate a page before reading it.

This post is about the reading screen , the part people look at for minutes at a time. It turned out to be the hardest screen in the app to get right.

What I wanted from it:

the current phrase highlighted, the current sentence easy to find, the rest of the page calm;

tap any word to jump the audio there;

a "just listen" mode with the text hidden, which you can still peek at;

Japanese, Chinese and Thai behaving like any other language.

What I tried

Word-by-word highlighting, like karaoke.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.