AI +ML

Binary digits arranged into a bug shape on a black background.

UK researchers find LLMs are learning to finish jobs faster and improving all the time

The UK AI Security Institute (AISI) has found that frontier models are quickly becoming more efficient when asked to do some cybersecurity work.

AISI measures this with its "time window benchmark for cybersecurity," which estimates how much work an AI can do compared to a human. Using the benchmark could lead to findings such as Claude Sonnet 4.5 can do what a human cybersecurity expert can do in 16 minutes about 80 percent of the time, given a budget of 2.5m tokens.

AISI has found the human-comparable task time – 16 minutes in this instance – is growing, fast.…