黑人高中生起诉AI将多力多滋包装袋误认为枪支
Black high school students sue after AI mistakes Doritos bag for gun

原始链接: https://www.lawyerscommittee.org/lawyers-committee-files-lawsuit-on-behalf-of-black-students-detained-and-searched-due-to-ai-alert-falsely-identifying-a-bag-of-chips-as-a-firearm/

民权法下律师委员会(The Lawyers’ Committee for Civil Rights Under Law)代表四名黑人学生(Taki Allen、Yui-Osa Ogbeide、Devon Thompson Jr. 和 Keith Winfield III)起诉Omnilert、巴尔的摩县公立学校和巴尔的摩县警察局,涉及2025年10月的一起事件。Omnilert Gun Detect是一种AI武器检测系统,在Kenwood高中将一名学生的薯片袋误认为枪支,触发了声称有90%概率为枪支的虚假警报。尽管工作人员和警方已查看图像并取消警报,武装警员仍被派往现场,命令这些青少年跪下、用手铐铐住并搜身。起诉书指控技术与人为失职,包括缺乏防止已取消警报触发警方响应的规程。该案在巴尔的摩县巡回法院提起,主张宪法权利侵犯、过失和重大过失,并要求改革学校和警方程序、加强培训、监督、透明度和社区参与。此案凸显了公共安全领域不受监管AI的危险及其对黑人社区的不成比例影响。

Hacker News 最新 | 过去 | 评论 | 提问 | 展示 | 招聘 | 提交 登录 黑人高中生因AI将多力多滋袋子误认为枪支而起诉(lawyerscommittee.org) 36分 由 DeepLogin 2小时前 | 隐藏 | 过去 | 收藏 | 1条评论 帮助 readthenotes1 2分钟前 [–] 不确定学生的种族与故事有什么关系,还是说暗示AI不会把多力多滋袋子认定为白人学生的武器? 回复 指南 | 常见问题 | 列表 | API | 安全 | 法律 | 申请YC | 联系 搜索:
相关文章

原文

Case focuses on alleged failures surrounding AI systems and impact on students

BALTIMORE COUNTY, MD – Today, the Lawyers’ Committee for Civil Rights Under Law filed a lawsuit on behalf of four Black current and former students against Omnilert, LLC, Baltimore County Public Schools (BCPS) and personnel, the Baltimore County Police Department, and individual officers for the unlawful detention and search of the students due to both technological and human errors involving an AI weapon-detection surveillance system. In Allen, et al. v. Omnilert, et al., the Lawyers’ Committee represents the four teenagers, Taki Allen, Yui-Osa Ogbeide, Devon Thompson Jr., and Keith Winfield III. The Lawyers’ Committee is joined by Willkie Farr & Gallagher LLP, as pro bono counsel, and Engel Law Group, P.C. 

This lawsuit stems from events that took place in October 2025 when Omnilert Gun Detect, an AI gun-detection system used throughout Baltimore County Public Schools, mistook a teenager’s bag of chips for a firearm at Kenwood High School in Baltimore County, Maryland. The false alert eventually led to armed local police swarming the teenagers on campus just steps away from their school’s entrance. They were ordered to their knees, handcuffed, and searched, despite doing nothing wrong. 

The AI surveillance system’s error prompted the false alarm and set off a chain of human failures, with everyone from Omnilert’s own staff and the school principal to the Baltimore County Police Department all missing or ignoring clear evidence there was no gun. The system, which school officials knew regularly produced false alerts, erroneously alerted the school that there was a 90% probability of a gun being on campus, and that alert kept going even after school staff and local police reviewed the image and determined it was a mistake. School and police officials cancelled the alert, but armed police were dispatched anyway because school and police officials failed to have sufficient protocols in place to prevent cancelled alerts from triggering armed police responses.

“These students were failed not only by a technology that is prone to false alerts, but also by the very adults meant to keep them safe when we send them to school. Instead of this protection, they were met with guns and traumatized. And it could have been even worse,” said Damon Hewitt, president and executive director of the Lawyers’ Committee for Civil Rights Under Law. “Overreliance on artificial intelligence technology mixed with inept communication and coordination among key officials is a toxic mix. We need a reckoning on how AI is being used, especially concerning public safety and kids. We are fighting to deliver justice in this case, but it also holds lessons for educators and police officials across the country who should think twice before putting our children’s fate in the hands of AI.”

“Unregulated AI has profound consequences, especially when involving young people. As this technology gains more widespread adoption, it cannot happen at the expense of clear regulations, guardrails, and expectations for the adults that interact with it,” said Leah Frazier, director of the Digital Justice Initiative at the Lawyers’ Committee for Civil Rights Under Law. “This should have never been escalated to the police. It simply should not have happened, and we filed this lawsuit to prevent this from ever happening again.”

“The police told my son this could have been a real problem. No child in Baltimore County should face this kind of danger while waiting outside his own school for a ride home from his mother,” said Freida Winfield,who was on her way to pick up her son Keith and the students when they were all ordered to their knees, handcuffed, and searched.

Through the lawsuit, the Lawyers’ Committee seeks to reform local police and school procedures to ensure that these public actors verify reports from AI threat-detection platforms, evaluate whether this AI technology is appropriate for use in schools, and develop sufficient policies to ensure that false alerts do not trigger armed police responses. 

The Lawyers’ Committee argues that police and schools require more training, oversight, and transparency relating to errors and outcomes, as well as community input on how this technology is utilized. 

This injustice also raises a broader concern regarding the use and reliability of AI-powered technology in public safety where accuracy is essential in life-and-death situations. The Lawyers’ Committee has been vocal about assessing and regulating the use of AI technology across these critical areas for this reason, especially as any harms and inaccuracies disproportionately impact Black communities and other people of color. This is especially true when it comes to criminal justice. 

The Lawyers’ Committee filed the case in the Circuit Court for Baltimore County, Maryland. The complaint alleges violations of the teenagers’ federal and state Constitutional rights, negligence and gross negligence, and other violations by the defendants, including Omnilert, Baltimore County school officials, and Baltimore County Police Department officers. 

The complaint may be found here.

###

About the Lawyers’ Committee for Civil Rights Under Law: Lawyers’ Committee for Civil Rights Under Law is a nonpartisan, nonprofit organization, formed in 1963 at the request of President John F. Kennedy to mobilize the nation’s leading lawyers as agents for change in the Civil Rights Movement. Today, the Lawyers’ Committee uses legal advocacy to achieve racial justice, fighting inside and outside the courts to ensure that Black people and other people of color have the voice, opportunity, and power to make the promises of our democracy real. The Lawyers’ Committee implements its mission and objectives by marshaling the pro bono resources of the bar for litigation, public policy, advocacy and other forms of service by lawyers to the cause of civil rights.

联系我们 contact @ memedata.com