The Context Window Arms Race Is Solving the Wrong Problem Everyone in AI tooling is chasing bigger context windows. Gemini 1.5 Pro hit 1 million tokens. Claude’s window sits at 200k. The marketing around these numbers is relentless, as if raw capacity is the thing standing between developers and a perfect AI coding session. It…
The Supply Chain Attack Nobody Is Talking About Enough Everyone is watching Optimus videos this week. I get it. The robot stuff is genuinely impressive. But I keep coming back to something far more unsettling, something that directly affects every team shipping AI products right now. TeamPCP just ran a multi-stage supply chain attack across…
The Thread We Were Hanging By Every AI engineer reading this should stop what they are doing and pay attention. This week, Andrej Karpathy flagged one of the most alarming supply chain attacks I have seen target our specific corner of the software world. The litellm package on PyPI was poisoned. A single pip install…
The PyPI Dependency Trap Nobody Wants to Talk About Last week, ML engineers got a very clear look at how fragile the tooling ecosystem really is. A poisoned PyPI release of litellm, version 1.82.8, sat live on the registry for less than an hour. In that window, it was fully capable of exfiltrating SSH keys,…
Evals First. Everything Else Second. Most engineers I know treat evals like cleanup work. Something you wire up after the “real” engineering is done, right before you push to production and hope nobody notices the weird edge cases. I have done this. You have probably done this too. It is the wrong order of operations,…
The End of the GPU Tax I’ve spent years watching the AI hardware conversation circle the same drain. More VRAM. Bigger clusters. Faster interconnects. The implicit assumption baked into every serious LLM deployment is that you need specialized, expensive hardware just to run inference. Microsoft just kicked that assumption in the teeth. BitNet is an…
BitNet and the End of the GPU Requirement I’ve been watching quantization research for years. The pattern has always been the same: you shrink the model, you pay for it in accuracy. The tradeoff felt like physics. You want a model that fits in memory? Fine, but expect your benchmarks to slide. Running inference on…
ByteDance just dropped Seedance 2.0, and the short films being made with it are genuinely difficult to distinguish from real production footage. That’s the news. Here’s what I actually think. We crossed a threshold somewhere in the last 90 days where AI video stopped being a party trick and started being a production pipeline. The…
Plausible Is Not Correct, and That Gap Is Where Production Dies There is a framing going around right now that I think every engineer working with AI-generated code needs to internalize before they ship another feature. It comes from a post by @KatanaLarp, and the core argument is this: LLMs do not write correct code….
