Menu

I Threw Away Half My Training Data and Lost Nothing. Then I Threw Away Half My People and Lost Three Points
📰

I Threw Away Half My Training Data and Lost Nothing. Then I Threw Away Half My People and Lost Three Points

DEV Community: datascience·b1ackjack12·7 days ago
#Qbyv2M06
#devtodatascience#science#devto#dev#subject
Reading 0:00
15s threshold

The HAR lane of this blog keeps circling one fact from different directions: subject identity is the hard axis . Split by subject and accuracy drops eight points; the worst subject in any split trails the average by fifteen; every augmentation win and every robustness trick earns its keep disproportionately on the hardest person. All of which raises the question any real project has to answer before any of that tuning: when you're planning data collection with a fixed budget, do you spend it recruiting more people or recording more hours per person?

That's measurable with the usual harness . Fifty paired splits; in each one, 9 random test subjects held out and a pool of 21 to train from. The dose-response arms train on all windows from 21, 15, 10, or 5 randomly chosen pool subjects. And then the arm that actually decides the question: mix10 , which trains on windows drawn from all 21 pool subjects but subsampled to exactly match the 10-subject arm's window count, split by split.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.