구글, 드론 떼 프로그램 종료 – 직원들이 윤리적 두려움에 반발

Google amended its existing contract with the U.S. Department of Defense on Monday to extend Gemini's availability to classified networks, granting the Pentagon permission to deploy the models for "any lawful government purpose." Separately, Bloomberg reported the same day that Google had withdrawn from a $100 million Pentagon prize challenge to build voice-controlled autonomous drone swarm technology in February, following an internal ethics review. Google joins OpenAI and Elon Musk's xAI in granting the Pentagon broad classified AI access. On the deal, Pentagon AI chief Cameron Stanley said that avoiding dependence on a single vendor was a priority. Google's agreement requires the company to help modify its AI safety settings and filters at the government's request, with the contract including language stating that the AI system shouldn’t be used for domestic mass surveillance or autonomous weapons “without appropriate human oversight and control,” but also specifies that the deal doesn’t give Google “any right to… veto lawful government operational decision-making,” which doesn’t make the agreed restrictions appear particularly solid. Article continues belowA spokesperson for Google Public Sector told The Information that the company is "proud to be part of a broad consortium of leading AI labs and technology and cloud companies providing AI services and infrastructure in support of national security." Google notified the government on February 11 that it wouldn’t continue in the drone swarm challenge, which sought technology for converting spoken commands into digital instructions for coordinating autonomous drones. The company officially cited a lack of resources, but internal records reviewed by Bloomberg showed the withdrawal followed an ethics review. More than 600 Google employees delivered a letter to CEO Sundar Pichai on Monday urging him to reject the classified deal, arguing that it was the only way to prevent Google's AI from being misused. Google faced a similar internal revolt in 2018 over Project Maven, a Pentagon contract for AI analysis of drone surveillance footage. The company let that contract lapse after roughly 4,000 employees signed a petition, and Palantir assumed the work, which has since grown into a $13 billion program of record. Get Tom's Hardware's best news and in-depth reviews, straight to your inbox. Anthropic declined to agree to similar "any lawful purpose" terms earlier this year, insisting on explicit restrictions against autonomous weapons and domestic mass surveillance. The Pentagon responded by designating the company a supply chain risk, a label a federal judge later called "Orwellian" while blocking its enforcement. That litigation remains ongoing. Follow Tom's Hardware on Google News, or add us as a preferred source, to get our latest news, analysis, & reviews in your feeds. Luke James is a freelance writer and journalist. Although his background is in legal, he has a personal interest in all things tech, especially hardware and microelectronics, and anything regulatory. - Reply Anthropic declined to agree to similar "any lawful purpose" terms earlier this year, insisting on explicit restrictions against autonomous weapons and domestic mass surveillance. The Pentagon responded by designating the company a supply chain risk, a label a federal judge later called "Orwellian" while blocking its enforcement. That litigation remains ongoing. Anthropic was right in principal and then tangibly displayed as right by that move by the Pentagon. Great term that that judge used after such petty punishment move. Who's the gatekeeper and enforcer of "any lawful purpose?" It gets a lot harder to track this when we're talking about classified information. - Reply This is the part that stuck out to me too, as the current administration has already done several things that are deemed as unlawful or unconstitutional, so if they are deciding what's "unlawful" and what's not, then who knows what purposes they will use it for.DS426 said:Who's the gatekeeper and enforcer of "any lawful purpose?" It gets a lot harder to track this when we're talking about classified information.