Tech

US Capitol lawmakers struggle with AI-drafted legislation errors

Congressional lawyers report spending more time correcting AI-generated drafts than writing them from scratch, citing missed nuances and incorrect citations.

Editorial persona
Owen Mercer
Markets and Finance Editor
Published
Draft
Source: Engadget · View original source
AI-generated bills are reportedly causing problems in the Capitol
Office of Legislative Counsel develops new tool to counter hallucinations in bills generated by ChatGPT and Claude

The US House Office of Legislative Counsel is facing significant operational strain due to an influx of legislative proposals drafted using general artificial intelligence tools, including ChatGPT and Claude. According to reports from Politico, the volume of error-ridden bills has overwhelmed the office, with congressional lawyers spending excessive time correcting wrong terms, incorrect citations, and missing legal nuances in the drafts.

Sources indicate that representatives' offices are increasingly relying on publicly available general AI tools to write their legislative proposals. This shift has resulted in a situation where lawyers at the Office of Legislative Counsel report spending more time reviewing and rewriting AI-drafted bills than they would have if they had written them from scratch. The inefficiency stems from the AI tools' tendency to miss crucial details and legal distinctions that are vital for accurate statutory interpretation.

Wade Ballou, who headed the Office of Legislative Counsel for nearly a decade until 2024, highlighted specific technical failures in AI-generated text. He noted that AI tools often struggle to distinguish between complex financial mechanisms, such as whether a provision should be classified as a tax credit, tax deduction, tax exclusion, or a grant. Furthermore, the tools frequently misclassify the term "state," often excluding the District of Columbia and tribal nations from federal programs that should legally include them.

Beyond technical errors, there are concerns regarding the depth of understanding among congressional staff. Lawyers and staffers reported that because they rely on AI to draft proposals, they are not forced to engage deeply with the issues at hand. This reduced familiarity with the content and intent of bills they do not write themselves poses a risk to the quality and coherence of legislative work.

In response to the growing workload and the need for greater precision, the Office of Legislative Counsel is exploring the use of specialised AI to improve efficiencies. A working group within the office has developed a tool called the Comparative Print Suite, designed to visualise how proposals change current laws. Unlike general AI models, this internal tool returns an error if it cannot locate where changes should be made, a feature intended to prevent hallucinations from entering draft bills.

Continue reading

More from Tech

Read next: Ethernet Cable Length Matters Most at Higher Network Speeds
Read next: Engadget weighs MagSafe against USB-C for MacBook charging
Read next: Essay challenges reported claims of a 10% AI extinction risk