bitter lesson.

The Bitter Lesson Ate Your AI Factory

For every AI workflow we define, the next model makes it useless.What’s worse: most of us keep clinging to the outdated workflows for months after they’ve outlived their usefulness.Remember how everyone was excited about AI code completion? How about prompt engineering? Harness engineering? Spec-driven development? Loop engineering? Software factory? Dark factory? They are all dead because of the bitter lesson. To summarize it: no matter what “domain knowledge”, “harness”, or “workflow” you try to integrate above your AI model, it will be outshone by just a larger, smarter model. This happened in chess when the program that beat Kasparov in 1997 won with massive, deep search, not with the human understanding of chess that most researchers had spent years encoding. And it keeps happening to us today.That’s why whenever somebody tries to build yet another factory or a really constraining skill, I roll my eyes since modern models perform worse

продолжить чтение