DSpark for Spark-X2.6-4B is now available. Faster inference. More magic. 🪄

The published benchmarks show more than double the average BF16 inference throughput: 2.14x on NVIDIA RTX 4090 with llama.cpp and 2.50x on Apple M5 Pro with MLX , across the six reported datasets.

Download on Hugging Face · Download on ModelScope

A small draft model, fewer sequential decoding steps

DSpark is a 624M-parameter BF16 draft model for speculative decoding with Spark-X2.6-4B. The draft proposes up to seven tokens per pass , and the target model verifies them in parallel. This reduces the number of sequential target decoding steps.

This release provides the draft in BF16 GGUF format, paired with Spark-X2.6-4B-GGUF . The target can use BF16 or quantized GGUF weights.…