2026-03-08XQuote

Source item

This is why we built Software Factory. Human guardrails that are built thoughtfully and maintained accurately prevent drift and are crucial for production software to work over long time horizons. Otherwise it’s just vibe theater. Software Factory has replaced Agile, scrum, waterfall and everything in between. It’s a collaborative space where humans and agents work in a tight, synchronized loop to write exceptional PRDs, Eng Plans, Work Orders and then do the ongoing testing and feedback to keep it all in synch. This is the only credible way to rebuild and replace the trillions of lines of legacy code riddling every enterprise. Try it here: https://t.co/fkfTXgdfXK

Quoted context

These are the quoted author’s words.

🚨BREAKING: Alibaba tested AI coding agents on 100 real codebases, spanning 233 days each. the agents failed spectacularly. turns out passing tests once is easy. maintaining code for 8 months without breaking everything is where AI collapses. SWE-CI is the first benchmark that measures long-term code maintenance instead of one-shot bug fixes. each task tracks 71 consecutive commits of real evolution. 75% of AI models break previously working code during maintenance. only Claude Opus 4 stays above 50% zero-regression rate. every other model accumulates technical debt that compounds over iterations. here's the brutal part: - HumanEval and SWE-bench measure "does it work right now" - SWE-CI measures "does it still work after 6 months of changes" agents optimized for snapshot testing write brittle code that passes tests today but becomes unmaintainable tomorrow. Alibaba built EvoScore to weight later iterations heavier than early ones. agents that sacrifice code quality for quick wins get punished when consequences compound. the AI coding narrative just got more honest: most models can write code. almost none can maintain it.
alex_verem ↗