How Effective are Tabletop Role-Playing (Serious) Games in Understanding and Validating the Predictive Capabilities of Disaster Response Agent-based Models?

From the paper

Abstract

Tabletop role-playing games (TRPGs) for disaster response management are collaborative exercises in which participants take on the roles of characters and are guided by a “game master.” TRPGs are useful tools for training, improving the preparedness of emergency responders, and understanding/validating agent-based models (ABMs). This study evaluated the knowledge of participants and assessed the effectiveness of utilizing TRPGs in validating a NetLogo model. The central components of the ABM were transformed into a Disaster Response Tabletop Role-Playing Game (DRTRPG). Medical doctors and master’s students were divided into two groups and participated in the exercise based on defined disaster response strategies. Multiple pre- and post-assessment tests were used to evaluate each group's knowledge, while a performance scoring matrix was used to generate data from in-game activity. The data were analyzed using Pandas and MS Excel data analytical tools. Pre- and post-assessment test results (n = 8) revealed 11.5% and 3.1% increases in the knowledge of disaster and healthcare decision-making, respectively, among medical doctors and students. A visual comparison between the ABM and DRTRPG results revealed partial model validity. However, the statistical comparison showed clear variation in the outcomes. The “alternate” policy strategy resulted in better disaster response outcomes. The design and implementation of the DRTRPG resulted in a collaborative understanding and communication of the ABMS model with promising results. However, there were significant differences between the two methodologies, highlighting the challenge of validating the predictive ability of ABMS using RPGs.