In a precedent-setting move that highlights the growing dangers of unregulated technology in the judiciary, the Supreme Court of India has officially taken cognisance of a startling incident where a trial court reportedly relied on “fake” verdicts generated by Artificial Intelligence. The issue came to light during an appeal process when it was discovered that a lower court’s judgment cited several non-existent case laws and legal precedents that appeared highly authoritative but were actually “hallucinations” produced by a generative AI tool. The apex court expressed deep concern over this “grave lapse” in judicial scrutiny, noting that the blind reliance on AI-generated content without rigorous manual verification threatens the very foundation of the rule of law and the integrity of the justice system. By treating these fictitious citations as valid legal grounds, the trial court had inadvertently compromised the rights of the litigants involved, prompting the Supreme Court to intervene and demand a thorough investigation into how such fabricated data entered the official judicial record.
The Supreme Court bench emphasized that while AI can be a powerful tool for research and administrative efficiency, it cannot replace the human intellect, legal reasoning, and ethical oversight required of a judicial officer. The justices warned that “algorithmic bias” and the tendency of AI to confidently present false information as fact—often referred to as hallucination—pose a significant risk to the delivery of fair and accurate justice. This case has sparked an urgent nationwide debate on the need for a comprehensive regulatory framework or a “code of conduct” for the use of AI within the Indian legal fraternity, including both lawyers and judges. Legal experts argue that as AI tools become more sophisticated and accessible, the temptation to use them for drafting complex orders increases, yet the responsibility for the accuracy of those orders remains solely with the presiding officer. The Supreme Court is expected to issue a set of guidelines to ensure that all citations and precedents used in future judgments are cross-referenced with official law journals and government databases. As the world watches this first-of-its-kind judicial challenge, the Indian judiciary finds itself at a crossroads, needing to balance technological progress with the absolute necessity of maintaining a fact-based, human-centric legal process that prevents “fake” law from becoming a part of the nation’s jurisprudence.
