Menu

#Dynosim

1 post

Feed
1 of 1 post
DynoSim: Simulating the Pareto Frontier
🖼️
0Read More

DynoSim: Simulating the Pareto Frontier

NVIDIA Technical Blog·Yongming Ding·5 months ago
#GVzBoSJs
#developer#planner#cache#engine#replay

Modern LLM serving is hard to tune because each deployment is a stack of interacting choices: model backend, tensor-parallel shape, prefill/decode split…

15s