← All digests
AI Developer Digest

Mon, Jun 29, 2026

17 signals that cleared the gate18 min read
The Signal — start here
June 28–29 is quiet on the lab announcement front — no model releases, no breaking API changes from Anthropic, OpenAI, Google, Mistral, or Meta. The story this period is local inference: llama.cpp b9840 adds DeepSeek V4 support (both the 1.6T-parameter Pro and 284B Flash variants), making the open-weight 1M-context MoE model runnable locally for the first time. This continues a sustained June build cadence where llama.cpp has expanded architecture coverage (Mamba2, MiniCPM5, DFlash v2, DeepSeek V4) across consecutive releases. The other signal worth acting on today: Google's June 30 deadline is tomorrow — imagen-3.0-capability-001 (mask-based inpainting/editing) and the video generation model endpoints both shut down June 30, with no managed API replacement for mask-based editing.
Must-reads today
1
llama.cpp b9840 DeepSeek V4 local inference — first local inference support for the 1.6T-parameter open-weight MoE; single-sequence only initially, but the architecture is now in tree and follow-up PRs expected
2
Google June 30 deadline is TOMORROW — imagen-3.0-capability-001 mask-based editing and video generation both end June 30; there is no managed API replacement for inpainting/background masking; self-hosted alternatives only

Breaking Changes

No breaking changes in the June 28–29 scan window.

Model Releases

No model releases in the June 28–29 scan window. Grok 4.5 entered private beta at SpaceX and Tesla (announced June 28) but is not publicly accessible — see Worth Watching.

API & SDK Changes

No API or SDK changes from Anthropic, OpenAI, Google, Mistral, Meta, Groq, or Together AI in the June 28–29 scan window.

Research

Nothing cleared the quality bar this period. No papers from recognized labs with both a linked code repository and measurable benchmark numbers were newly submitted to arXiv cs.AI, cs.CL, or cs.LG specifically in the June 28–29 window. Brain2Qwerty v2 (Meta FAIR / Nature Neuroscience, 61% word accuracy from MEG on 9 participants) was published June 25 — 3 days outside the scan window; see Near-misses.

Tooling

2
Medium

llama.cpp b9840: DeepSeek V4 (1.6T MoE Pro + 284B Flash) Now Supported for Local Inference

What changed
DeepSeek V4-Pro (1.6T total parameters, 49B activated per token, 1M token context, MIT license) and V4-Flash (284B total, 13B activated) GGUF inference support added to llama.cpp via PR #24162 — first local inference support for either variant. Prior to b9840, there was no path to run DeepSeek V4 locally in llama.cpp; inference was API-only through DeepSeek's hosted service.
TL;DR
llama.cpp b9840 ships DeepSeek V4 support (Pro and Flash), including GGUF conversion tooling, Flash Attention, graph reuse optimizations, and RoPE fixes — with initial support limited to single-sequence operation (n_seq=1).
Developer signal
Update to b9840+ to run DeepSeek V4-Flash or V4-Pro locally. Download quantized GGUF weights from deepseek-ai/DeepSeek-V4-Flash or deepseek-ai/DeepSeek-V4-Pro on Hugging Face (unsloth and community conversions appear faster than official). Critical constraint: initial support is n_seq=1 (single sequence only) — batched inference, concurrent request serving, and parallel decoding will fail or produce incorrect output until follow-up PRs land. Plan accordingly: use V4-Flash for memory-constrained setups (13B activated params means ~26–52GB VRAM depending on quant); V4-Pro requires significantly more (49B activated, ~100GB+ for 4-bit). Flash Attention and graph reuse are enabled, so decode performance benefits from the optimizations. Watch the release stream for n_seq>1 support — the architecture is now in tree and the constraint is targeted for removal.

Affects you ifYou want to run DeepSeek V4-Flash or V4-Pro locally for evaluation, offline agentic work, or cost avoidance; you are benchmarking open-weight 1M-context MoE models on local hardware; you build tools or pipelines that need to run inference without calling DeepSeek's API.EffortModerate (update binary, source or download GGUF weights which are large files; note and accommodate n_seq=1 constraint until follow-up PR lands).
Notable

llama.cpp b9837: --reasoning-preserve Flag — Persist Chain-of-Thought Across Multi-Turn Local Chats

What changed
Added --reasoning-preserve CLI flag (PR #25105) that retains the model's reasoning/thinking content from prior assistant turns when building the conversation context. Before b9837, llama.cpp stripped <think> blocks from prior assistant messages during context construction — saving tokens but discarding the model's visible reasoning history from its own context for subsequent turns.
TL;DR
llama.cpp b9837 adds --reasoning-preserve, which keeps prior thinking blocks in the conversation context — costing 43–193 additional tokens per prior turn but enabling the model to see its own chain-of-thought history across multi-turn exchanges.
Developer signal
If you run multi-turn conversations with thinking/reasoning models (Qwen3 family, DeepSeek R-series, Mistral reasoning variants) via llama.cpp CLI or the server API, add --reasoning-preserve to your invocation and test quality on your specific multi-step tasks. Without it (current default): prior thinking is stripped, saving tokens but losing reasoning continuity. With it: each prior turn contributes its thinking tokens to context — cost scales linearly with conversation length and reasoning block size (observed +43 to +193 tokens per prior assistant turn per reasoning block). Measure quality vs. token cost on your workload before committing — the tradeoff is worthwhile for tasks where the model's prior reasoning is itself relevant context (debugging, planning, iterative analysis), but wasteful for pure retrieval or single-pass summarization. Note this flag controls context serialization, not reasoning budget — it does not affect how much the model thinks on the current turn.

Affects you ifYou use llama.cpp's CLI (--reasoning-preserve) or server for multi-turn conversations with Qwen3, DeepSeek reasoning variants, or any model whose chat template supports <think> blocks; you are observing quality degradation in long multi-turn reasoning sessions on local models.EffortQuick (add --reasoning-preserve to CLI invocation or server startup; no code changes required).

Benchmarks & Leaderboards

No leaderboard movements or new SOTA entries confirmed in the June 28–29 scan window.

  • LMArena Overall: Top 5 unchanged — Claude Opus 4.8 (~1510 ELO), GPT-5.5 Pro, Gemini 3.1 Pro Preview, Claude Opus 4.7, GPT-5.5. GPT-5.6 not yet submitted (limited to ~20 partner organizations).
  • SWE-bench Verified: No changes confirmed. Last known: Claude Mythos 5 at 95.5%, Claude Fable 5 at 95.0%, Claude Opus 4.8 at 88.6%.
  • SWE-bench Pro: Claude Opus 4.8 at 69.2%; no changes in window.

Technical Discussions

Nothing cleared the quality bar this period. No Hacker News threads with score >200 for AI developer topics confirmed for June 28–29. Simon Willison's weblog shows no entries confirmed for June 28–29. No r/MachineLearning or r/LocalLlama threads with sufficient technical depth and confirmed in-window recency surfaced.

Quick Hits

  • LiteLLM v1.91.0-rc.1 (June 28, 03:46 UTC) — MCP OAuth token management foundation: shared challenge/store seam, expiry-aware cache, single-flight refresh across concurrent requests. Also fixes event-loop blocking from oversized requests and adds stream cancellation when clients disconnect during initial token generation. Pre-release candidate — watch for v1.91.0 stable. [https://github.com/BerriAI/litellm/releases/tag/v1.91.0-rc.1]
  • llama.cpp b9842 (June 29, 16:18 UTC) — Deduplicates preset and cached model entries in /v1/models API response; eliminates duplicate model listings when using named presets alongside cached models. [https://github.com/ggml-org/llama.cpp/releases/tag/b9842]

Worth Watching (Announced, Not Yet Shipped)

14

⚠️⚠️⚠️⚠️⚠️ imagen-3.0-capability-001 Retirement — **JUNE 30 (TOMORROW — ACT NOW)**

(Countdown: 1 day)

imagen-3.0-capability-001 (Vertex AI mask-based editing: inpainting, background masking, semantic editing) retires June 30 with no managed API replacement. Evaluate third-party alternatives (FLUX Fill, Stable Diffusion inpainting) now — these are self-hosted only.

⚠️⚠️⚠️⚠️⚠️ Video Generation Models Shutdown — **JUNE 30 (TOMORROW)**

(Countdown: 1 day)

Video generation models shut down June 30. Recommended migration: Veo 3.1 preview model IDs.

⚠️⚠️⚠️ Grok 4.5 — **Private Beta at SpaceX and Tesla (June 28 announced, no public access)**

(New this digest — announced but not shipped publicly)

Grok 4.5 entered private beta at SpaceX and Tesla on June 28. Built on xAI's V9 foundation (1.5T parameters, 3× scale increase from prior v8-small at 500B). Trained with Cursor coding data and reinforced via Grok Build harness. Early internal evaluations claim performance close to or exceeding Claude Opus — but no independent benchmark has been run and no third party has access to the model. No public release date confirmed. xAI's stated roadmap: new models monthly through end of 2026 via SpaceX training runs. Watch x.ai/news for GA announcement; do not architect production dependencies on claimed capabilities without independent benchmark data.

Elon Musk / xAI | Link: https://x.ai/news

⚠️⚠️ GPT-5.6 Sol/Terra/Luna General Availability — **Coming Weeks (unconfirmed)**

(Status unchanged — limited to ~20 partner organizations)

No GA date set. When GA lands, cache write pricing (1.25× write cost) and explicit cache breakpoints go live — audit caching architecture before adopting.

⚠️⚠️ GPT-5.6 Sol on Cerebras — **July 2026 (imminent)**

(Countdown: ~1–2 days)

GPT-5.6 Sol at up to 750 tokens/second on Cerebras hardware. Targeted early July 2026; no specific date.

⚠️⚠️ Gemini Code Assist for GitHub Full Shutdown — **~Mid-July (~15 days)**

(Countdown updated — was ~16 days)

New organizational installs blocked June 18. Full request serving ends approximately mid-July. Organizations dependent on Gemini Code Assist for GitHub need an alternative now.

⚠️⚠️ Kimi K2.7 Code Third-Party Benchmarks — **Still Pending**

(Status unchanged — no independent results as of June 29 scan)

Weights released June 12; Arena entry June 17. No SWE-bench Verified, LiveCodeBench, or GPQA results from independent evaluators confirmed as of June 29.

⚠️ Claude Mythos 5 — **Still Suspended**

(Status unchanged)

Remains suspended under US export-control directive. Claude Fable 5 reinstated June 18. Mythos 5 reinstatement timeline not announced. Migrate agentic workloads to claude-opus-4-8.

⚠️ Imagen 4 Model Shutdown — **August 17 (49 days)**

(Countdown updated — was 50 days)

Imagen 4 standard, ultra, and fast endpoints deprecated with August 17, 2026 shutdown date.

Apple iOS 27 / macOS Golden Gate / Core AI GA — **Fall 2026 (September)**

(Status unchanged)

Includes Siri Extensions API, Core AI (replaces Core ML), Foundation Models multi-provider support (call Claude/Gemini via same Swift API as on-device model).

Apple Developer / WWDC 2026 | Link: https://developer.apple.com/ios/

⚠️ OpenAI Reusable Prompts / Evals Platform / Agent Builder Shutdown — **November 30 (154 days)**

(Countdown updated — was 155 days)

Export eval configs before October 31. Migrate Agent Builder to Agents SDK. Move prompt content from v1/prompts to application code.

Filtered from 30+ primary sources against a published quality rubric. No press releases, no fluff — only what changes what you build.