Hot take: automated ML experiment loops change the skill profile of researchers, not the need for them, and the real risk is engineers who never learned what questions to ask
The Part of ML Research Nobody Talks About Most of the commentary around Andrej Karpathy’s new autoresearch repo is missing the point entirely. The repo, roughly 630 lines of code on a single GPU, runs LLM training in an autonomous loop. The agent picks architectures, tunes hyperparameters, commits code, and iterates again without a human…