I have often heard anecdotes from lawyers at ProVisors that use of AI could result in more legal work not less and this article from the Economist, “Vibe lawyering: AI chatbots are creating chaos in courts,” says yes and details how self‑represented litigants are increasingly using AI to draft legal filings. Courts are now drowning in hallucinated case law, fabricated citations, and overly aggressive AI‑generated arguments. According to research by Anand Shah of the Massachusetts Institute of Technology and Joshua Levy of the University of Southern California, In American federal civil courts 17% of people represented themselves in 2025, up from a steady 11% for many years before. They also find that this year 18% of complaints have probably contained AI generated text. Apart from inventing cases, AI chatbots also encourage people to litigate, not settle and overstate chances of success. I have also heard that documents prepared by AI could lead to future litigation.
What does this mean for hallucinations in finance, wealth planning, valuation, accounting, therapy, etc? What happens when the chatbots contradict what experts are saying? Who bears the risk for incorrect advice? Is the proverbial human in the loop still important? Please share your thoughts