manager at ska walgreens
![Measuring Only the Easy Half
LLMs make code generation faster, and that half is easy to measure. The other half is harder: time spent reviewing LLM-generated code for correctness, time lost debugging confidently wrong suggestions, security vulnerabilities introduced by plausible-looking but insecure code, and technical debt from suggestions that solved the immediate problem while ignoring the surrounding design. A study of GitHub Copilot’s code found that a substantial fraction of generated code contained security vulnerabilities, and that developers under time pressure accepted insecure suggestions at higher rates [Pearce2022]. A 2025 evaluation of five major LLMs found that none produced web application code meeting industry security standards [Dora2025]. A large-scale analysis of over 300,000 AI-authored commits found that more than 15% introduce at least one quality issue, and nearly a quarter of those issues persist in the codebase long-term [Liu2026]. Measuring only the inputs that go up while ignoring the costs that also rise is not measurement; it is marketing.](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:7bmyhqo3pwxtczomwpxia3px/bafkreia72tmwxip5q5mngosffk76wizzm7ul5jmoazklxqfsd27rbrosgm)
![csar 12 hours ago | prev | next [–]
Getting feedback on a plan or implementation is valuable because you get a fresh set of eyes. Using multiple models may help though it always feels a bit silly to me (if nothing else you’re increasing non-determinism because you know have to understand 2 LLM’s quirks).
But the “playing house” approach of experts is somewhere between pointless and actively harmful. It was all the rage in June and I thought people abandoned that later in the summer.
If you want the model to eg review code instead of fixing things, or document code without suggesting improvements (for writing docs), that’s useful. But there’s. I need for all these personas.
reply
bahaAbunojaim 9 hours ago | parent | next [–]
The way it works is that each agent think independently, discuss the solution and each agent opinion then one will synthesize a solution.
reply](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:7bmyhqo3pwxtczomwpxia3px/bafkreidfqfxu74pay56bp2jzqsznhq2vfomi5fn67xjz3pssa762z3laem)
manager at ska walgreens