Menu

1 / 3

The wrong setting for AI cache can cost you a lot of cash

Reading 0:00
15s threshold

ai and ml

Beware of the temptation to drop just a few more dollars to get the work done

Be wary of AI costs. You may be spending more than you think and end up with nothing to show for it but an eye-popping invoice.

Register readers are finding themselves on the sharp, pointy end of AI billing, confused about which costs are covered by what, and surprised by "features" that burn through credit, seemingly without warning.

Startups without the deep pockets of established companies are the first to feel the squeeze.

Sometimes, the approach feels more like an app that urges users to deposit extra cash to keep that streak going than a helpful coding assistant. Take one reader, who told The Register about Claude burning through credits at a ferocious rate after a cache setting was reset in the background.

The cache setting controlled how long Claude "remembered" requests and was set to one hour. It's a useful feature, and it lets Claude reuse material that has already been processed.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.