SIMA 2:一个与你在虚拟3D世界中一起玩耍、推理和学习的智能体。
SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds

原始链接: https://deepmind.google/blog/sima-2-an-agent-that-plays-reasons-and-learns-with-you-in-virtual-3d-worlds/

这项研究是SIMA 2团队的大规模协作成果,该团队由50多名研究人员组成,并感谢谷歌和谷歌DeepMind领导的大力支持。该项目受益于过往团队成员、游戏开发者(包括《Valheim》、《No Man’s Sky》和《Teardown》的开发者)以及专注于模型开发(Genie 3)和关键项目组件的合作伙伴团队的贡献。 许多谷歌内部团队——包括法律、营销和安全部门——也提供了重要帮助。这项工作献给已故的同事菲利克斯·希尔和法比奥·帕尔多,以表彰他们对该领域的持久影响。致谢强调了这项研究工作的真正跨学科和协作性质。

## SIMA 2:虚拟世界中的AI智能体 - 摘要 DeepMind的SIMA 2 是一款设计用于在3D虚拟环境中进行游戏、推理和学习的AI智能体。该智能体展示了通过试错和Gemini模型的反馈来执行越来越复杂的任务的能力,甚至可以随着时间的推移改进自身的能力。一个关键亮点是它的速度——以大约30fps的速度控制鼠标和读取屏幕,这是计算机使用智能体的一项重大进步。 讨论的重点在于其潜在应用,从自动化游戏中繁琐的任务(如刷级)到创建更智能的NPC,甚至协助现实世界的机器人技术。用户希望AI能够处理手机任务或自动化工作流程。然而,对于其实用性存在一些怀疑,人们担心其能否迁移到现实世界,以及目前在未见过的任务上的成功率(15%)。 该项目引发了关于AI研究方向的争论——是专注于模拟所有可能的情况,还是构建“真正的智能”——并提出了关于日益强大的AI智能体的伦理影响的问题,包括其对电子竞技和游戏经济的潜在影响。
相关文章

原文

This research was developed by the SIMA 2 team: Maria Abi Raad, John Agapiou, Frederic Besse, Andrew Bolt, Sarah Chakera, Harris Chan, Jeff Clune, Alexandra Cordell, Martin Engelcke, Ryan Faulkner, Maxime Gazeau, Arne Olav Hallingstad, Tim Harley, Ed Hirst, Drew Hudson, Laura Kampis, Sheleem Kashem, Thomas Keck, Matija Kecman, Oscar Knagg, Alexander Lerchner, Bonnie Li, Yulan Liu, Cong Lu, Maria Loks-Thompson, Joseph Marino, Kay McKinney, Piermaria Mendolicchio, Anna Mitenkova, Alexandre Moufarek, Fabio Pardo, Ollie Purkiss, David Reichert, John Reid, Tyson Roberts, Daniel P. Sawyer, Tim Scholtes, Daniel Slater, Hubert Soyer, Kaustubh Sridhar, Peter Stys, Tayfun Terzi, Davide Vercelli, Bojan Vujatovic, Jane X. Wang, Luyu Wang, Duncan Williams, and Lei M. Zhang.

For their leadership, guidance, and support, we thank: Satinder Singh Baveja, Adrian Bolton, Zoubin Ghahramani, Raia Hadsell, Demis Hassabis, Shane Legg, Volodymyr Mnih, and Daan Wierstra.

With much gratitude to partial contributors and past members: Alex Cullum, Karol Gregor, Rosemary Ke, Junkyung Kim, Matthew Jackson, Andrew Lampinen, Loic Matthey, Hannah Openshaw, and Zhengdong Wang.

Special thanks to all of the game developers who partnered with us: Coffee Stain (Valheim, Satisfactory, Goat Simulator 3), Foulball Hangover (Hydroneer), Hello Games (No Man's Sky), Keen Software House (Space Engineers), RubberbandGames (Wobbly Life), Strange Loop Games (Eco), Thunderful Games (ASKA, The Gunk, Road 96, Steamworld Build), and Tuxedo Labs & Saber Interactive (Teardown).

We thank Vika Koriakin, Duncan Smith, Nilesh Ray, Matt Miller, Leen Verburgh, Ashyana Kachra, Phil Esposito, Dimple Vijaykumar, Piers Wingfield, Lucie Kerley for their invaluable partnership in developing and refining key components of this project.

We also thank Jack Parker-Holder, Shlomi Fruchter, and the rest of the Genie team for access to the Genie 3 model.

We’d like to recognize the many teams across Google and Google DeepMind that have contributed to this effort including Legal, Marketing, Communications, Responsibility and Safety Council, Responsible Development and Innovation, Policy, Strategy and Operations, and our Business and Corporate Development teams. We'd also like to thank all GDM teams that are not explicitly mentioned here for their continued support.

Finally, we dedicate this work to the memory of our colleagues Felix Hill and Fabio Pardo, whose contributions to our field continue to inspire us.

联系我们 contact @ memedata.com