Menu

#TransFormEr

25 posts

Feed·
20 of 25 posts
Accelerating Dropless MoE Training in JAX with NVIDIA Transformer Engine
🖼️
0Read More

Accelerating Dropless MoE Training in JAX with NVIDIA Transformer Engine

NVIDIA Technical Blog·Tanya Lenz·8 days ago
#YUMaVPtz
#developer#remat#offload#expert#training

Mixture of experts (MoE) has become one of the defining architectural trends in large-scale AI model training. DeepSeek, Qwen, and Mixtral are examples of MoE…

15s
Overfitted a 900KB Transformer to Compress a 100MB CSV into 7MB
📰
0Read More

Overfitted a 900KB Transformer to Compress a 100MB CSV into 7MB

Hacker News·4 months ago
#8BQRotVU
#news#model#compression#file#transformer

Somewhat related is stavros's method to compress 500KB to something like 50 bytes https://www.stavros.io/posts/compressing-images-with-stable-...

15s
Introducing 1-bit and Ternary Bonsai Image 4B: Image Generation for Local Devices
🖼️
0Read More

Introducing 1-bit and Ternary Bonsai Image 4B: Image Generation for Local Devices

Hacker News·5 months ago
#PFjrFPvc

Images generated from Ternary Bonsai Image 4BToday we’re releasing Bonsai Image 4B, a family of compact image-generation models designed to run high-quality diffusion inference on local hardware: from laptops to phones.Bonsai Image 4B comes in two…

15s
Amazon's Panos Panay denies a new Fire Phone is in the works but doesn't shut the door
🖼️
0Read More

Amazon's Panos Panay denies a new Fire Phone is in the works but doesn't shut the door

Tom's Guide·Scott Younker·6 months ago
#ZDETacd6
#amazon#openai#att#tmobile#panay

From Tomsguide RSS Feed: Amazon's Panos Panay denies a new Fire Phone is in the works but doesn't shut the door

15s
Transformer Neural Network Architecture Diagram — A Visual Guide for Engineers
🖼️
0Read More

Transformer Neural Network Architecture Diagram — A Visual Guide for Engineers

DEV Community·Mia·6 months ago
#dfeZLTf0
#why#breaking#comment#ai#attention

From Dev.to - machinelearning: Transformer Neural Network Architecture Diagram — A Visual Guide for Engineers

15s
The EU AI Act classified a TypeScript data serialisation library as High Risk. Here is what happened.
🖼️
0Read More

The EU AI Act classified a TypeScript data serialisation library as High Risk. Here is what happened.

DEV Community·Olebeng·6 months ago
#qZS1VmE2
#ai#security#typescript#devops#high

From Dev.to - typescript: The EU AI Act classified a TypeScript data serialisation library as High Risk. Here is what happened.

15s
TRiP: 15,000 lines of C implementing a complete transformer AI engine from scratch [Project]
📰
0Read More

TRiP: 15,000 lines of C implementing a complete transformer AI engine from scratch [Project]

Reddit r/learnmachinelearning·u/RelevantShape3963·6 months ago
#phfX9ak8
#trip#github#complete#transformer#engine

I'm a firmware engineer (17 years in embedded systems). In 18 months (up to August 2025), during my lunch breaks and weekend nights, I built a complete transformer engine in C: inference, training with full backpropagation, tokenizer(+vocabulary…

15s