The Shareable Unit Just Changed Something Andrej Karpathy posted last weekend has been sitting with me, and I think most of the commentary around it missed the actual point. He shared a gist describing how he’s been using LLMs to build personal knowledge bases, and that part got plenty of attention. But the line that…
Andrej Karpathy’s LLM Knowledge Base Workflow Is the Personal Computing Shift Nobody’s Talking About Most people use LLMs like a search engine with better grammar. Ask a question, get an answer, close the tab. Nothing carries forward. Every conversation starts cold. Karpathy just published a workflow that flips that pattern completely, and I think it…
The Capability Trap: Why Your LLM’s Confidence Problem Won’t Be Solved With More Data OpenAI just published a study on how 700 million people use ChatGPT. Seven hundred million. That number alone will send half the industry rushing to the same conclusion: collect more, train harder, scale faster. I think that instinct is wrong, and…
The Context Window Arms Race Is Solving the Wrong Problem Everyone in AI tooling is chasing bigger context windows. Gemini 1.5 Pro hit 1 million tokens. Claude’s window sits at 200k. The marketing around these numbers is relentless, as if raw capacity is the thing standing between developers and a perfect AI coding session. It…
The Supply Chain Attack Nobody Is Talking About Enough Everyone is watching Optimus videos this week. I get it. The robot stuff is genuinely impressive. But I keep coming back to something far more unsettling, something that directly affects every team shipping AI products right now. TeamPCP just ran a multi-stage supply chain attack across…
The Thread We Were Hanging By Every AI engineer reading this should stop what they are doing and pay attention. This week, Andrej Karpathy flagged one of the most alarming supply chain attacks I have seen target our specific corner of the software world. The litellm package on PyPI was poisoned. A single pip install…
The PyPI Dependency Trap Nobody Wants to Talk About Last week, ML engineers got a very clear look at how fragile the tooling ecosystem really is. A poisoned PyPI release of litellm, version 1.82.8, sat live on the registry for less than an hour. In that window, it was fully capable of exfiltrating SSH keys,…
Evals First. Everything Else Second. Most engineers I know treat evals like cleanup work. Something you wire up after the “real” engineering is done, right before you push to production and hope nobody notices the weird edge cases. I have done this. You have probably done this too. It is the wrong order of operations,…
A 400 Billion Parameter Model on a MacBook. Let That Sink In. I’ve been doing AI/ML work long enough to remember when running a 7B model locally felt like a party trick. This week, someone ran a 397 billion parameter model on a laptop. Not a workstation. Not a rack-mounted inference server. A MacBook with…
Microsoft just open sourced BitNet, and I think people are sleeping on how significant this actually is. While most of the AI conversation stays locked on GPU clusters, foundation model releases, and cloud API pricing, something quietly landed that could change the entire equation for how and where large language models actually run. Let me…
