Enticing Player-NPC Dialogue System in a Visual Novel Game Using Intent Recognition with BERT

Cesar D.  Galingana; Rolan B.  Cagadas

doi:10.55927/eajmr.v2i7.4887

Authors

Cesar D. Galingana De Lasalle University - Dasmariñas
Rolan B. Cagadas National University - Dasmarinas

DOI:

https://doi.org/10.55927/eajmr.v2i7.4887

Keywords:

Bidirectional Encoder Representations from Transformers (BERT) Algorithm, Non-Player Character, Intent Recognition, Visual Novel Games, Immersion

Abstract

This study aims to develop a visual novel game in which the user can actively interact with an NPC by entering their own response rather than selecting dialogue options, as well as to improve the immersion of the Player-NPC dialogue system by obtaining the player's in-game text inputs while using intent recognition with the BERT transformer model. The researchers developed two different versions of the visual novel game to achieve their goal. The first version of the game uses the standard visual novel game mechanics, while the second version uses text input to communicate with NPCs, and the BERT algorithm was integrated in this version for the intent recognition of the player's text inputs. The retraining of the model achieved an accuracy of 0.9375. To measure the players’ immersion in both versions, a Modified Immersion Experience Questionnaire was given to the players to complete after each playthrough of the visual novel games. Based on the research findings, the researchers concluded that when participants played the game that uses Intent Recognition with BERT, their level of immersion significantly improved.

References

Astrand, M. (2020, February 28). ‘Sorry, I didn’t understand that’: A comparison of methods for intent classification for social robotics applications (Dissertation). Retrieved from http://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-272124

Baffa, A., Sampaio, P., Feijó B. & Lana, M. (2017). Dealing with the Emotions of Non Player Characters. 16th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames), pp. 76-87. Retrieved from https://0-ieeexplore.ieee.org.ustlib.ust.edu.ph/document/8400320

Bazinski, Barstosz. “The Value of Good Intent Detection”. D Labs, August 10, 2020. https://dlabs.ai/blog/the-value-of-good-intent-detection/

Canonico, M., & De Russis, L. (2018). A Comparison and Critique of Natural Language Understanding Tools. In CLOUD COMPUTING 2018: The Ninth International Conference on Cloud Computing, GRIDs, and Virtualization. pp. 110-115. Retrieved from https://iris.polito.it/retrieve/handle/11583/2694629/188100/cloud_co mputing_2018_6_20_20057.pdf

Carrera, J. (2022, February 9). What are visual novels? Electra Street.Retrieved from https://electrastreet.net/2019/11/what-are-visual-novels/

Chan, H.Y., & Tsai, M.H. (2019). Question-answering dialogue system for emergency operations. International Journal of Disaster Risk Reduction, 41. Retrieved from https://www.sciencedirect.com/science/article/pii/S22124209193043 39

Chen, Y., Kou, X., Bai, J., & Tong, Y. (2021). Improving BERT With Self-Supervised Attention. IEEE Access, 9, 144129–144139. Retrieved from https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9584911

Cheng, M.T., Lin, Y.W., She, H.C., & Kuo, P.C. (2017). Is immersion of any value? Whether, and to what extent, game immersion experience during serious gaming affects science learning. British Journal of Educational Technology, 48(2), pp. 246-263. Retrieved from https://doi.org/10.1111/bjet.12386

Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805. Retrieved from https://arxiv.org/pdf/1810.04805.pdf

Fraser, J., Papaioannou, I., & Lemon, O. (2018). Spoken Conversational Ai in VideoGames: Emotional Dialogue Management Increases User Engagement. In Proceedings of the 18th International Conference on Intelligent Virtual Agents. pp. 179-184. Retrieved from https://doi.org/10.1145/3267851.3267896

Goethe, O. (2019). Immersion in Games and Gamification. Gamification Mindset, pp. 108-112. Retrieved from https://link.springer.com/chapter/10.1007/978-3-030-11078-9_10

González-Carvajal, S. & Garrido-Merchán, E. C. (2020). Comparing BERT against traditional machine learning text classification. https://doi.org/10.48550/arXiv.2005.13012

Huggins, M., Alghowinem, S., Jeong, S., Colon-Hernandez, P., Breazeal, C., Park H. W. (2021). Practical guidelines for intent recognition: BERT with minimal training data evaluated in real-world HRI application. ACM/IEEE International Conference on Human-Robot Interaction. https://hdl.handle.net/1721.1/137130

Justesen, N., Bontrager, P., Togelius, J., & Risi, S. (2020). Deep Learning for Video Game Playing. IEEE Transactions on Games, 12(1), 1-20. https://doi.org/10.1109/TG.2019.2896986

Kasthuriarachchy, B., Chetty, M., Karmakar, G. & Walls, D. (2020). Pre-trained Language Models with Limited Data for Intent Classification. 2020 International Joint Conference on Neural Networks (IJCNN), 1-9. https://doi.org/10.1109/IJCNN48605.2020.9207121

Khan, V. & Meenai, T.A. (2021). Pretrained Natural Language Processing Model for Intent Recognition (BERT-IR). Human-Centric Intelligent Systems, 1(3-4), 66-74. https://doi.org/10.2991/hcis.k.211109.001

Lockhart, B. (2017, November 7). 5 radical ideas for dialogue systems. Game Developer. Retrieved April 11, 2022, from https://www.gamedeveloper.com/design/5-radical-ideas-for-dialogue-systems

Makri, S. & Charalambous, P. (2021). Towards a multi-agent non-player character road network: a Reinforcement Learning approach. 2021 IEEE Conference on Games (CoG), 1-5.https://doi.org/10.1109/CoG52621.2021.9619047

Marshall, C. (2020, August 31). What is intent recognition and how can I use it?. Retrieved from https://medium.com/mysuperai/what-is-intent-recognition-and-how- can-i-use-it-9ceb35055c4f

Qasim, R., Bangyal, W. H., Alqarni, M. A., & Ali Almazroi, A. (2022). A Fine-Tuned BERT-Based Transfer Learning Approach for Text Classification. Journal of Healthcare Engineering, 2022, 3498123. Retrieved from https://www.hindawi.com/journals/jhe/2022/3498123/

Rahimabad, R. M. & Rezvani, M. H. (2020). Identifying Factors Affecting the Immersion and Concentration of Players in Serious Games. 2020 International Serious Games Symposium (ISGS), 61-67. https://doi.org/10.1109/ISGS51981.2020.9375239

Roohi, S., & Forouzandeh, A. (2019). Regarding color psychology principles in adventure games to enhance the sense of immersion. Entertainment Computing, 30. Retrieved from https://www.sciencedirect.com/science/article/pii/S18759521183004 17

Rustagi, M. (2021, June 25). How To Implement Intent Recognition With BERT. Retrieved from https://analyticsindiamag.com/how-to-implement intent-recognition- with-bert/

Saravia, E., Liu, H. C.T., Huang, Y. H., Wu, J., & Chen, Y. S., (2018). CARER: Contextualized Affect Representations for Emotion Recognition. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (pp. 3687–3697). Association for Computational Linguistics. https://www.aclweb.org/anthology/D18-1404

Stegner, B. (2021, August 6). What Is a Visual Novel Video Game?. Retrieved from https://www.makeuseof.com/what-is-visual-novel-video-game/

Sun, Y., Zheng, Y., Hao, C., & Qiu, H. (2021). NSP-BERT: A Prompt-based Zero-Shot Learner Through an Original Pre-training Task--Next Sentence Prediction. https://arxiv.org/pdf/2109.03564.pdf

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. Advances in neural information processing systems, 30. Retrieved from https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd 053c1c4a845aa-Paper.pdf

Warpefelt, H. (2016). The Non-Player Character – Exploring the believability of NPC presentation and behavior. Retrieved from https://su.diva-portal.org/smash/get/diva2:912617/FULLTEXT01.pdf

Wong, P., Rigby, J., & Brumby, D. (2017). Game & Watch: Are “Let’s Play” Gaming Videos as Immersive as Playing Games? Retrieved from https://discovery.ucl.ac.uk/id/eprint/10040064/

Zhao, M. (2020). Analysis on the Connection Between Nonplayer Character and Artificial Intelligence. 2020 International Conference on Intelligent Computing and Human-Computer Interaction (ICHCI), 105-108. https://doi.org/10.1109/ICHCI51889.2020.00030