Download pdf
A research of artificial intelligence game agent application
- 1 Hangzhou Dianzi University
- 2 Xi’an Jiaotong University
* Author to whom correspondence should be addressed.
Abstract
Currently, large language models are on the rise with breakthrough progress in artificial intelligence. Existing reviews of AI game agents have not covered these latest developments, requiring a combing and analysis of the newest research advancements in game AI agents. This paper summarizes the application scenarios of game AI agents in four aspects: combat AI, Non-Player Character (NPC) interaction, automated testing, and Artificial General Intelligence (AGI) testing. In combat AI, there is a progressive developmental trend, with the introduction of Monte Carlo tree search and reinforcement learning enabling AI game agents to fully surpass humans in traditional board games. In NPC interaction, full AI is unnecessary. Game developers only need to incorporate AI for abilities related to player experience to increase appeal, with controllable generation results. In automated testing, game AI agents lack generalizability for testing so far. In AGI testing, academia has helpfully explored general game AI, but capabilities remain limited to certain games. Introducing large language models to game AI agents shows unprecedented capabilities. Finally, this paper provides an outlook on the hot topics and future directions of this research subject.
Keywords
AI game agent, NPC interaction, automated game testing, artificial general intelligence testing
[1]. Campbell M, Hoane A J and Hsu F 2002 Deep Blue Artif. Intell. 134 57–83
[2]. Silver D et al 2016 Mastering the game of Go with deep neural networks and tree search Nature 529 484–489
[3]. Wang G, Xie Y, Jiang Y, Mandlekar A, Xiao C, Zhu Y, Fan L, and Anandkumar A 2023 Voyager: An Open-Ended Embodied Agent with Large Language Models Preprint arxiv/2305.16291
[4]. Lu Y and Li W 2022 Techniques and Paradigms in Modern Game AI Systems Algorithms 15 282
[5]. OpenAI et al 2019 Dota 2 with Large Scale Deep Reinforcement Learning Preprint arxiv/1912.06680
[6]. Webster R W 1991 Useful AI tools-a review of heuristic search methods IEEE Potentials 10 51–54
[7]. Yannakakis G N and Togelius J 2018 Artificial Intelligence and Games (Berlin: Springer)
[8]. Huang S, Su H, Zhu J, Chen T 2019 Combo-Action: Training Agent For FPS Game with Auxiliary Tasks Proc. AAAI Conf. Artif. Intell. 33 954–961
[9]. Kopel M and Hajas T 2018 Implementing AI for Non-player Characters in 3D Video Games 2018 Intell. Inf. Database Syst. 610–619
[10]. Mascarenhas S, Guimarães M, Prada R, Santos P A, Dias J and Paiva A 2022 FAtiMA Toolkit: Toward an Accessible Tool for the Development of Socio-emotional Agents ACM Trans. Interact. Intell. Syst. 12 8:1-8:30
[11]. Kuchaiev O et al 2019 NeMo: a toolkit for building AI applications using Neural Modules Preprint arxiv/1909.09577
[12]. Soni B and Hingston P 2008 Bots trained to play like a human are more fun 2008 IEEE Int. Jt. Conf. Neural Netw. IEEE World Congr. Comput. Intell. 363–369
[13]. Edwards G, Subianto N, Englund D, Goh J W, Coughran N, Milton Z, Mirnateghi N and Ali Shah S A 2021 The Role of Machine Learning in Game Development Domain - A Review of Current Trends and Future Directions 2021 Digit. Image Comput. Tech. Appl. 01–07
[14]. Sagredo-Olivenza I, Gómez-Martín P P, Gómez-Martín M A and González-Calero P A 2019 Trained Behavior Trees: Programming by Demonstration to Support AI Game Designers IEEE Trans. Games 11 5–14
[15]. Ferdous R, Kifetew F, Prandi D and Susi A 2023 Towards Agent-Based Testing of 3D Games using Reinforcement Learning Proc. 37th IEEEACM Int. Conf. Autom. Softw. Eng. 1–8
[16]. Paduraru C, Paduraru M and Stefanescu A 2022 RiverGame - a game testing tool using artificial intelligence 2022 IEEE Conf. Softw. Test. Verification Valid. 422–432
[17]. Politowski C, Guéhéneuc Y and Petrillo F 2022 Towards automated video game testing: still a long way to go Proc. 6th Int. Workshop Games Softw. Eng. Eng. Fun Inspir. Motiv. 37–43
[18]. Silver D et al 2018 A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play Science 362 1140–1144
[19]. Schrittwieser J et al 2020 Mastering Atari, Go, chess and shogi by planning with a learned model Nature 588 604–609
[20]. Perez-Liebana D, Samothrakis S, Togelius J, Schaul T and Lucas S 2016 General Video Game AI: Competition, Challenges and Opportunities Proc. AAAI Conf. Artif. Intell. 30
[21]. Gaina R D and Stephenson M 2019 “Did You Hear That?“ Learning to Play Video Games from Audio Cues 2019 IEEE Conf. Games CoG. 1–4
[22]. Park J S, O’Brien J C, Cai C J, Morris M R, Liang P and Bernstein M S 2023 Generative Agents: Interactive Simulacra of Human Behavior Preprint arxiv/2304.03442
[23]. Youssef A E, Missiry S E, Nabil El-gaafary I, ElMosalami J S, Awad K M and Yasser K 2019 Building your kingdom Imitation Learning for a Custom Gameplay Using Unity ML-agents 2019 IEEE 10th Annu. Inf. Technol. Electron. Mob. Commun. Conf. 0509–0514
Cite this article
Lan,Y.;Li,Z. (2024). A research of artificial intelligence game agent application. Applied and Computational Engineering,37,123-129.
Data availability
The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.
Disclaimer/Publisher's Note
The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of EWA Publishing and/or the editor(s). EWA Publishing and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
About volume
Volume title: Proceedings of the 2023 International Conference on Machine Learning and Automation
© 2024 by the author(s). Licensee EWA Publishing, Oxford, UK. This article is an open access article distributed under the terms and
conditions of the Creative Commons Attribution (CC BY) license. Authors who
publish this series agree to the following terms:
1. Authors retain copyright and grant the series right of first publication with the work simultaneously licensed under a Creative Commons
Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this
series.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the series's published
version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial
publication in this series.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and
during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See
Open access policy for details).