Inkling Landed and Nobody Had the Infra Ready
July 14-20 had no flagship fireworks. Open source did the real shipping — a 975B MoE from Thinking Machines, a run of tiny specialist embeds, and papers that poke holes in how we eval agents.
Flagships took the week off. Open source didn't — it just shipped the boring stuff that actually matters.
If you were waiting for a new frontier chat model between July 14-20, there wasn't one. If you were watching Hugging Face and arXiv, it was busy.
###Inkling is big, and that's the point
Thinking Machines dropped thinkingmachines/Inkling on July 14 — API createdAt: 2026-07-14, blog welcome July 15. It's 975B total, 41B active. MoE at a scale we haven't seen in open weights before.
Day-zero infra wasn't ready. huggingface/transformers shipped v5.14.0 on July 15 specifically to add Inkling — Add Inkling model #47347 — then v5.14.1 on July 16 to patch EncoderDecoderCache and assisted generation bugs that showed up integrating it. vllm cut v0.25.1 on July 14, though that was a small patch (FFmpeg/TorchCodec fix), not an Inkling bring-up.
from transformers import AutoModelForCausalLM, AutoTokenizer tok = AutoTokenizer.from_pretrained("thinkingmachines/Inkling") model = AutoModelForCausalLM.from_pretrained("thinkingmachines/Inkling", device_map="auto")
You won't run this on one card. That's not the point. The point is a lab shipped a frontier-scale MoE as open weights and forced the ecosystem to catch up in 48 hours. Contrast that with last week's usual dance of API-only releases. Tradeoff is clear: you get weights, you also get the integration pain.
Quants landed same day — Inkling-NVFP4 and unsloth/inkling-GGUF both July 14 — so you can at least try it without a DGX cluster on fire.
###Small models did the useful shipping
The most immediately usable drops were small:
- Nvidia Nemotron-3-Embed 8B/1B — both
createdAt: 2026-07-14T07:38:49Z. Embeddings, not chat. If you're doing RAG, these are the ones to bench. - Microsoft bitnet-embedding-0.6b —
createdAt: 2026-07-15. 0.6B, 1-bit adjacent. Hanno Labs posted the same day (July 14) claiming #2 on MTEB Law with a 0.6B — different model, same thesis: sub-billion specialists are competitive where it counts. - Microsoft Fara1.5 4B / 27B — July 17. Hard to place without verified evals, but they're there if you track Microsoft's small-model arc.
No new Qwen, Llama, or DeepSeek weights verified in-window. Their next drops cluster July 28 onward — I checked, nothing to backdate.
###Papers that fix how we eval
ArXiv was active. The search API was rate-limited when I checked, so I verified via monthly lists and individual Submitted on banners. Three papers worth your time, all in-window:
VarRate (2607.15498, Jul 16) — training-free variable-rate KV cache compression for long context. Two leading families both waste memory; VarRate adapts per-layer. If you're paying for 128K context, this is directly about your bill.
Verbalizable Representations Form a Global Workspace (2607.15495, Jul 16) — argues LLMs already develop a brain-like global workspace where only a subset of representations become verbally reportable. Speculative, but it's a clean lens on why probing and verbalized confidence diverge.
Operational Hallucination and Safety Drift (2607.18366, Jul 20) — multi-turn tool-using agents drift in reliability and safety over long runs. Pairs with two Jul 14 papers: LLM Judges Can Be Too Generous Without Reference (2607.12885) and How Many Tasks Are Enough for Agent Benchmarks? (2607.12338). Same takeaway: our evals are too generous and too short. If you're shipping agents, shorten your trust and lengthen your eval.
Also in tools: ComfyUI v0.28.0 shipped July 15. Not a model, but AGENTS.md in the changelog signals where even image workflows are heading.
###What I'd do Monday
Pull Nemotron-3-Embed or bitnet-embedding and run it against your current embed on your own retrieval set — not MTEB. If you have the iron, try Inkling under transformers 5.14.1 and see what breaks. And read VarRate before you buy more KV cache.
It was a quiet week at the top and a busy week at the bottom. That's usually how it goes before the next flagship.