Menu

1 / 5

I asked two phones where my office is. They did not agree.

DEV Community: ios·Ján Turský·about 13 hours ago
#lqnqcH3D
#devtoios#devto#dev#model#json
Reading 0:00
15s threshold

I asked two phones where my office is located. They did not agree. One of them also thinks it's an account problem.

Before you ask, no, I don't have an office. I just wanted to check if a tiny prompt survives a model update, and the office question happend to be case number twelve. That's it. That's the whole origin story.

The "experiment" (I use that word loosely)

What did I do? I wrote a support ticket classifier. Five labels: Billing, Bug, Account, Feature, Other. Twelve tickets, each one run three times, temperature 0.2, exact match against the expected label. That's the whole experiment. (Source: Trust me bro, but also the JSON files, they are public.)

val suite = evalSuite ( "ticket-classifier" ) { prompt ( version = "v1" ) { input -> "Classify this support ticket as one of Billing, Bug, Account, Feature or Other.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.