Menu

1 / 21

5 reasons AI evaluations need designers’ unique perspectives

Reading 0:00
15s threshold

advertisement

The Fast Company Impact Council is an invitation-only membership community of top leaders and experts who pay dues for access to peer learning, thought leadership, and more.

BY Arin Bhowmick

Listen to this ArticleMore info 0:00 / 0:00

AI evaluations look like the least designerly corner of product development. They are the tests that decide whether an AI feature is ready to ship, and they run on scripts and dashboards full of percentages. No wonder companies hand them to engineers and product managers.

The more I read about evals, the more familiar they look. Behind each one, there is a decision about what “good” means for the person using the product. They all seem to answer questions about user experience. What should the AI do when it isn’t sure? Which mistakes can people live with?

Designers make calls like these every day. However in AI evals, we tend to have a say after someone else has written the criteria, if we are considered at all.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.