Menu

1 / 41

One gigabyte of Wikipedia losslessly compressed to 105.39MB with self-learning AI transformer model — 'tufazip' needs two Nvidia B200 GPUs and about a week to compress or decompress

#tomshardware#uses#predictor#compression#tufa
Reading 0:00
15s threshold

Tufa Labs’ tufazip has compressed 1GB of information from Wikipedia into just 105MB of space, losslessly, without using any hand-built models, according to a research post. The method uses a 163-million-parameter Transformer model as a predictor instead, and similar compression or decompression would take two Nvidia B200 GPUs about a week to manage. It’s the smallest result on the Large Text Compression Benchmark from any entry that uses a neural network as its only predictor.

Get Tom's Hardware's best news and in-depth reviews, straight to your inbox.