Last Tuesday I lost a full day to a stream that was mostly healthy.
Forty-one runs failed my own latency check.
Not one of them was a slow model. The ruler was broken.
Here is the letter I needed before run one.
It is specific, it is short, and it takes forty minutes to follow.
The goal was a boring probe
I wanted a repeatable measurement for an endpoint I did not control.
That endpoint sat behind a free server option, so cold starts were plausible.
I needed first-token time and total time as separate numbers.
I also needed to know when a retry is safe.
That question turned out to be the expensive one.
Setup, and what is claimed
MonkeyCode is described by its operator as an open-source project with free model access and a free server option. The same operator states the free allowance includes ten million tokens.
Disclosure: This article was prepared as part of MonkeyCode's product outreach.
I have not audited the repository, the network, or the quota terms.…