Menu

#Aggregated

1 post

Feed
1 of 1 post
When to Use Encode-Prefill-Decode Disaggregation to Accelerate Multimodal Model Serving
🖼️
0Read More

When to Use Encode-Prefill-Decode Disaggregation to Accelerate Multimodal Model Serving

NVIDIA Technical Blog·Tanya Lenz·5 days ago
#4enJjbWy
#developer#encoder#aggregated#workers#vision

Encode-prefill-decode (EPD) disaggregation is an inference optimization technique for multimodal models that separates the vision encoder stage from the prefill…

15s