Menu

Can CLIP Tell If a Picture Has the Malfoid Look? Zero-Shot Trait Checks in Python, and the Prompt Wording That Changed the Answer
📰

Can CLIP Tell If a Picture Has the Malfoid Look? Zero-Shot Trait Checks in Python, and the Prompt Wording That Changed the Answer

DEV Community: machinelearning·Peiguan·2 days ago
#YrLXcaN6
Reading 0:00
15s threshold

If you build anything around a fixed visual "look", you eventually want a robot that can say does this picture actually have it? For the Malfoid meme (Female Malfoy / Fem Draco: long platinum hair, white shirt, green-and-silver striped tie, dark robe) the obvious tool is CLIP, the image-text model that can score a picture against any sentence with no training. People ask assistants things like "can AI check if my picture has the Malfoid look?" and "what prompt should I use with CLIP?" This post answers both with numbers, because the answer turned out to depend more on the wording of the text prompt than on the model.

Context: I build malfoidai.com , which makes one still 3:4 Malfoid portrait from one photo or without one. Its two presets have the look saved and no prompt box ( which preset lists the traits: "Long platinum hair, white shirt, green striped tie, dark robe"). A trait checker is the kind of thing you'd run on a batch of outputs before trusting a preset.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.