The Lawxy Times

Author Image
Lawxy Times Reporter

Supreme Court Warns Against AI Hallucinations in Court

The Supreme Court of India quashed orders passed by the National Company Law Tribunal (NCLT) and the National Company Law Appellate Tribunal (NCLAT) due to their reliance on fabricated AI-generated case laws. This decision highlights the importance of human control and verification in the use of artificial intelligence. The ruling affects tribunals and courts that may have relied on similar AI-generated materials, with potential implications for the validity of decisions based on unverified AI precedents.

Full News Breakdown

The dispute was triggered when the NCLT relied on AI-generated material and cited six non-existent Supreme Court judgments in an insolvency case. The fake judgments also escaped scrutiny by NCLAT. Key points from the case include:

  • Court: Supreme Court of India

  • Bench: Justices P S Narasimha and Alok Aradhe

  • Date: July 3, 2026

  • Primary Legal Issue: The use of AI-generated non-existent case laws and verdicts in judicial decisions

  • Court Reasoning: The bench cautioned against the unchecked use of AI, emphasizing the need for human control and verification

  • Operative Order: The court directed the Bar Council of India to constitute a committee to deliberate on the problem of lawyers submitting fake or hallucinated AI-generated material as legal precedents

How Does This Affect You?

The Supreme Court has clarified that any decision relying on fake or hallucinated AI material is invalid. Tribunals and courts must adopt a zero-tolerance approach to unverified AI precedents, maintaining human control and verification in the use of AI. This shift creates a compliance obligation for lawyers, law students, and businesses to review their use of AI in legal research and proceedings.

For Lawyers & Advocates

  • Lawyers may wish to verify the authenticity of case laws and precedents cited in their arguments to avoid reliance on fake AI-generated materials.

  • The use of AI in legal research may be supplemented with human verification to ensure the accuracy of cited precedents.

  • Drafting of legal documents, such as petitions and appeals, may involve reviewing the authenticity of cited case laws.

  • Lawyers may consider being cautious when relying on precedents from lower courts that may have been based on AI-generated materials.

  • The risk of citing fake AI-generated case laws can be mitigated by reviewing the authenticity of cited precedents.

For Law Students

The decision provides an opportunity to examine the importance of verifying the authenticity of documents and precedents in legal proceedings. Relevant areas of study include:

For Businesses

  • Companies involved in insolvency proceedings may want to consider reviewing the authenticity of cited case laws and precedents.

  • Businesses may find it useful to review their internal documentation and filing processes to take into account the Supreme Court's directive on the use of AI-generated materials.

  • Companies may want to consider implementing measures to prevent the use of fake AI-generated case laws in their legal dealings.

  • The potential implications of inaction could be the overturning of decisions based on unverified AI precedents, leading to significant financial and reputational losses.

Key Takeaways

  • The legal principle established is that the use of fake AI-generated case laws and verdicts in judicial decisions is invalid.

  • The practice consequence is that lawyers and tribunals may wish to verify the authenticity of cited precedents to avoid reliance on fake AI-generated materials.

  • The enforcement consequence is that regulators and courts may find it useful to review their use of AI-generated materials, maintaining human control and verification in justice delivery.

  • The Bar Council of India's committee deliberations on the problem of lawyers submitting fake or hallucinated AI-generated material as legal precedents may influence future developments in this area.

  • Lawyers may want to review their legal research processes to take into account the Supreme Court's directive.

References

  1. Supreme Court of India | India

  2. National Company Law Tribunal

  3. NCLT Appellate Tribunal Services | Expert Legal Assistance

  4. Bar Council of India

  5. Sri.Krishnappa vs The State Of Karnataka on 4 June, 2018

  6. Swapnil Tripathi vs Supreme Court Of India on 26 September, 2018

Source: SC nixes rulings by NCLT, NCLAT based on fake AI citations

LAWXY

Legal Intelligence Layer Businesses Rely On

Copyright© 2025 Lawxy AI. All Rights Reserved.

Secure by design. Built for enterprise.

More About Security

Lawxy AI is designed with encrypted infrastructure, access controls, audit visibility, and enterprise-grade security standards.

SOC 2 Type I, II

GDPR

ISO 27001

VAPT Tested

LAWXY

Legal Intelligence Layer Businesses Rely On

Copyright© 2025 Lawxy AI. All Rights Reserved.

Secure by design. Built for enterprise.

More About Security

Lawxy AI is designed with encrypted infrastructure, access controls, audit visibility, and enterprise-grade security standards.

SOC 2 Type I, II

GDPR

ISO 27001

VAPT Tested

LAWXY

Legal Intelligence Layer Businesses Rely On

Copyright© 2025 Lawxy AI. All Rights Reserved.

Secure by design. Built for enterprise.

More About Security

Lawxy AI is designed with encrypted infrastructure, access controls, audit visibility, and enterprise-grade security standards.

SOC 2 Type I, II

GDPR

ISO 27001

VAPT Tested