What changed
10+ builds shipped on July 15 (b10015 through b10032, with gaps at b10022–b10024, b10026–b10030 not yet visible on releases page). Heavy focus on SYCL/Intel GPU work, with one standout inference performance build and a new CUDA operation.
| Build | UTC | Change |
|-------|-----|--------|
| b10032 | 19:52 | CUDA: GGML_OP_LIGHTNING_INDEXER implementation with generic vector and wmma kernels (Turing+) |
| b10031 | 19:15 | Tokenizer: drop --stdin mutual-exclusion check (aligns CLI with completion tools) |
| b10025 | 16:10 | CUDA: relax tensor contiguity requirements for quantized concat ops |
| b10021 | 14:19 | DeepSeekV4: reduce graph splits — complexity optimization for graph execution |
| b10020 | 13:38 | SYCL: fix get_rows for quantized types Q2_K, Q4_K, Q5_K |
| b10019 | 13:01 | SYCL: add fp16 kernel support for conv2d_dw |
| b10018 | 12:21 | SYCL: implement xielu activation op |
| b10017 | 11:37 | SYCL: raise USM system allocation buffer threshold from 1 GiB to 4 GiB |
| b10016 | 09:10 | SYCL: Flash Attention with XMX engine via oneDNN — 4.26× prefill speedup at 80k tokens, 1.21× at 512 tokens, for Qwen3-27b-Q8_0 on Battlemage; 32% FA1 bench improvement |
| b10015 | 03:24 | OpenCL: fix deprecated clCreateBufferWithProperties usage for CL 2.x targets |
TL;DR
b10016 is the headline — SYCL Flash Attention using Intel XMX hardware via oneDNN achieves 4.26× prefill speedup at 80k context for Qwen3-27b-Q8_0 on Intel Arc Battlemage (Xe2), with 1.21× improvement even at shorter 512-token prefills.
Developer signal
Five items worth attention: (1) b10016 — SYCL Flash Attention XMX: If you run llama.cpp on Intel Arc Battlemage (the Xe2 architecture, e.g. B580 or Arc Pro B60), upgrade to b10016+. The 4.26× speedup at 80k-token prefill is the largest single-build inference gain for Intel GPUs in recent memory. The XMX path activates only on Battlemage; other Intel GPU architectures fall back to the existing kernel. Test with your specific model and context length — the speedup varies by scenario (80k tokens sees the full gain; 512 tokens sees 1.21×). (2) b10021 — DeepSeekV4 graph splits: If you serve DeepSeek V4-Pro or V4-Flash, the graph-split reduction may improve throughput by reducing dispatch overhead; this is a correctness-preserving optimization, no behavior changes. Upgrade and benchmark. (3) b10032 — GGML_OP_LIGHTNING_INDEXER: A new CUDA operation for index-based tensor access. Not user-facing yet but likely unlocks model architectures that use non-sequential token indexing. (4) b10017 — SYCL USM threshold: The USM (Unified Shared Memory) buffer threshold increase from 1 GiB to 4 GiB reduces unnecessary buffer splits on larger Intel GPU models. If you were hitting SYCL memory allocation overhead on larger quantized models, this should help. (5) b10015 — OpenCL CL 2.x fix: If you use OpenCL on devices that don't support clCreateBufferWithProperties (some older OpenCL 2.x implementations), upgrade to b10015+ to avoid init failures.