The Lawxy Times
Supreme Court Warns Against AI Hallucinations in Court
The Supreme Court of India quashed orders passed by the National Company Law Tribunal (NCLT) and the National Company Law Appellate Tribunal (NCLAT) due to their reliance on fabricated AI-generated case laws. This decision highlights the importance of human control and verification in the use of artificial intelligence. The ruling affects tribunals and courts that may have relied on similar AI-generated materials, with potential implications for the validity of decisions based on unverified AI precedents.
Full News Breakdown
The dispute was triggered when the NCLT relied on AI-generated material and cited six non-existent Supreme Court judgments in an insolvency case. The fake judgments also escaped scrutiny by NCLAT. Key points from the case include:
Court: Supreme Court of India
Bench: Justices P S Narasimha and Alok Aradhe
Date: July 3, 2026
Primary Legal Issue: The use of AI-generated non-existent case laws and verdicts in judicial decisions
Court Reasoning: The bench cautioned against the unchecked use of AI, emphasizing the need for human control and verification
Operative Order: The court directed the Bar Council of India to constitute a committee to deliberate on the problem of lawyers submitting fake or hallucinated AI-generated material as legal precedents
How Does This Affect You?
The Supreme Court has clarified that any decision relying on fake or hallucinated AI material is invalid. Tribunals and courts must adopt a zero-tolerance approach to unverified AI precedents, maintaining human control and verification in the use of AI. This shift creates a compliance obligation for lawyers, law students, and businesses to review their use of AI in legal research and proceedings.
For Lawyers & Advocates
Lawyers may wish to verify the authenticity of case laws and precedents cited in their arguments to avoid reliance on fake AI-generated materials.
The use of AI in legal research may be supplemented with human verification to ensure the accuracy of cited precedents.
Drafting of legal documents, such as petitions and appeals, may involve reviewing the authenticity of cited case laws.
Lawyers may consider being cautious when relying on precedents from lower courts that may have been based on AI-generated materials.
The risk of citing fake AI-generated case laws can be mitigated by reviewing the authenticity of cited precedents.
For Law Students
The decision provides an opportunity to examine the importance of verifying the authenticity of documents and precedents in legal proceedings. Relevant areas of study include:
Legal Method and Justice Delivery
The role of technology in justice delivery
The importance of human oversight in the use of AI in legal proceedings
Comparable cases such as State of Karnataka v. Krishnappa (2018) and Swapnil Tripathi v. Supreme Court of India (2018) provide insights into the importance of human oversight in the use of AI in legal proceedings.
For Businesses
Companies involved in insolvency proceedings may want to consider reviewing the authenticity of cited case laws and precedents.
Businesses may find it useful to review their internal documentation and filing processes to take into account the Supreme Court's directive on the use of AI-generated materials.
Companies may want to consider implementing measures to prevent the use of fake AI-generated case laws in their legal dealings.
The potential implications of inaction could be the overturning of decisions based on unverified AI precedents, leading to significant financial and reputational losses.
Key Takeaways
The legal principle established is that the use of fake AI-generated case laws and verdicts in judicial decisions is invalid.
The practice consequence is that lawyers and tribunals may wish to verify the authenticity of cited precedents to avoid reliance on fake AI-generated materials.
The enforcement consequence is that regulators and courts may find it useful to review their use of AI-generated materials, maintaining human control and verification in justice delivery.
The Bar Council of India's committee deliberations on the problem of lawyers submitting fake or hallucinated AI-generated material as legal precedents may influence future developments in this area.
Lawyers may want to review their legal research processes to take into account the Supreme Court's directive.
References
Source: SC nixes rulings by NCLT, NCLAT based on fake AI citations

