Originally published on tamiz.pro .
GPU portability for LLM inference is still a fiction for most teams: the operator stack that makes PyTorch fast on NVIDIA is precisely the stack that makes it slow (or broken) on AMD, Intel, and emerging accelerators. The reason is architectural, not political. CUDA kernels, cuBLAS heuristics, and hand-tuned FlashAttention variants encode assumptions about warp scheduling, memory hierarchy, and tensor-core layouts that simply do not translate to ROCm or SYCL. Triton offers calmer water. It lets you write operators as tiled SSA programs, then compiles that representation to PTX, HSACO, or SPIR-V depending on the backend.…