Menu

#EnCodeR

17 posts

Feed·
17 of 17 posts
When to Use Encode-Prefill-Decode Disaggregation to Accelerate Multimodal Model Serving
🖼️
0Read More

When to Use Encode-Prefill-Decode Disaggregation to Accelerate Multimodal Model Serving

NVIDIA Technical Blog·Tanya Lenz·5 days ago
#4enJjbWy
#developer#encoder#aggregated#workers#vision

Encode-prefill-decode (EPD) disaggregation is an inference optimization technique for multimodal models that separates the vision encoder stage from the prefill…

15s
Gemma 4 12B: Encoder-Free Coding on a 16GB Laptop
🖼️
0Read More

Gemma 4 12B: Encoder-Free Coding on a 16GB Laptop

DEV Community: machinelearning·Max Quimby·5 months ago
#WyrUXDAL
#dev#model#coding#gemma#encoder

Google's Gemma 4 12B ditches vision encoders, scores 72% on LiveCodeBench, and runs on 16GB. Here's why researchers are swapping Qwen for it.

15s
Transformer Neural Network Architecture Diagram — A Visual Guide for Engineers
🖼️
0Read More

Transformer Neural Network Architecture Diagram — A Visual Guide for Engineers

DEV Community·Mia·6 months ago
#dfeZLTf0
#why#breaking#comment#ai#attention

From Dev.to - machinelearning: Transformer Neural Network Architecture Diagram — A Visual Guide for Engineers

15s
When the Reranker Hurts: Recall@5 Cases Where Two-Stage Retrieval Loses to One
🖼️
0Read More

When the Reranker Hurts: Recall@5 Cases Where Two-Stage Retrieval Loses to One

DEV Community·Gabriel Anhaia·6 months ago
#HfIB3aD1
#ai#rag#llm#reranker#query

Cross-encoder rerankers don't always help. Four cases where two-stage retrieval drops recall@5 below the bi-encoder, with code and a decision rule.

15s
T5Gemma: A new collection of encoder-decoder Gemma models
📰
0Read More

T5Gemma: A new collection of encoder-decoder Gemma models

deepmind.google·Biao Zhang, Paul Suganthan, Ben Hora·6 months ago
#Pw6vvrNM
#arrow#chevron#post#menu#decoder

T5Gemma is a new family of encoder-decoder LLMs developed by converting and adapting pretrained decoder-only models based on the Gemma 2 framework, offering superior performance and efficiency compared to its decoder-only counterparts, particularly for…

15s