Menu

1 / 16

[Day 5] My Cat-LoRA Got Worse With 45x More Photos. So I Figured Out Why and Fixed It.

DEV Community·PEPPERCORN·6 months ago
#VFWRwYK5
#hypothesis#variation#canonical#localllm#lora
Reading 0:00
15s threshold

[Day 5] My Cat-LoRA Got Worse With 45x More Photos. So I Figured Out Why and Fixed It.

Intro

Day 5!

Today was originally going to be "have AI analyze a year of my Amazon order history," but downloading the Amazon purchase history just wouldn't work no matter what I tried. So that was a bust.

Pivoted. On Day 4 the AI sorted my iPhone library and pulled out 999 photos it thought were cats. I figured: why not feed those into the Day 2 cat-LoRA pipeline and re-train at scale?

Day 2 used 22 photos. Today: 45x that. Surely the LoRA gets stronger, right?

Spoiler: it got worse. So I dug into why, fixed it, then ran a second experiment to test a different hypothesis.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.