Menu

Post image 1
Post image 2
1 / 2
0

Talkie Is a 'Vintage LLM' Trained on Pre-1930 Data to Help Facilitate 'Time Travel'

Gizmodo·Tom Hawking·5 months ago
#vxYrAciq
Reading 0:00
15s threshold

If you’ve ever heard the term “vintage LLM”, you might have found yourself wondering if the AI-pocalypse has really been going on for long enough that early chatbots are worthy of nostalgia. Happily, though, that’s not what the term means; instead, it applies to an LLM that seeks to emulate the perspective of a certain point in the past. The idea is that you restrict the training data provided to the model to material published before a given date. In the case of Talkie , aka 13B 1930 LM, the cutoff is, as the name suggests, the year 1930. This choice of year might seem arbitrary, but it’s not: as we discussed here back in January , many forms of copyright expire on January 1 of the year that comes 95 years after the copyrighted material was released. This means that a whole lot of material released in 1930 went into the public domain at the start of this year.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More