Despite all the enthusiasm for agents, these high-stakes uses raise a clear question: can they actually be trusted with something as serious as law or taxes? AI hallucinations, which have frequently tripped up users of ChatGPT, currently have no remedy in sight. More fundamentally, as IBM presciently stated in 1979, “a computer can never be held accountable” — and as a corollary, “a computer must never make a management decision.” Rather than autonomous decision-makers, AI assistants are best viewed as what they truly are: powerful but imperfect tools for low-stakes tasks. Is that worth the big bucks AI companies hope people will pay?
You are viewing a single comment's thread from: