From CIRCA
LaTeX code for Serious Educational Game Assessment - Leonard Annetta and Stephen Bronack (Eds.)
Click here for a plain text version of this LaTeX code.
\documentclass[a4paper,11pt]{article}
\usepackage{ulem}
\usepackage{a4wide}
\usepackage[dvipsnames,svgnames]{xcolor}
\usepackage[pdftex]{graphicx}
\usepackage{hyperref}
% commands generated by html2latex
\begin{document}
Annetta, L., \& Bronack, S. (2010). Serious Educational Game Assessment: Practical Methods and Models for Educational Games, Simulations and Virtual Worlds. Sense Publishers.
\textit{Pr??cis ??? Calen Henry ??? February 2011}
Serious Educational Games, Simulations and Virtual worlds are the 21st century. There is a push for technology use in schools, but assessment techniques remain archaic. The book tries to provide some accounts of how Serious Games pioneers are using virtual worlds and assessing their effectiveness.
\begin{tabular}
\subsection{Contents}
\begin{itemize}
\item \hyperlink{1._Assessing_Gaming.2C_Computer_and_Scientific_Inquiry_Self-efficacy_in_a_Virtual_Environment_.E2.80.93_p._1}{11. Assessing Gaming, Computer and Scientific Inquiry Self-efficacy in a Virtual Environment ??? p. 1}
\item \hyperlink{2._Self-Regulation_within_Game-based_Learning_Environments_.E2.80.93_p._19}{22. Self-Regulation within Game-based Learning Environments ??? p. 19}
\item \hyperlink{3._The_Wild_West_of_Assessment:_Measuring_Aggression_and_Violence_in_Video_Games_.E2.80.93_p._43}{33. The Wild West of Assessment: Measuring Aggression and Violence in Video Games ??? p. 43}
\item \hyperlink{4._Diagrammatic_Inquiry:_Rosario_is_not_Virtual_and_it.E2.80.99s_not_Reality_.E2.80.93_p._57}{44. Diagrammatic Inquiry: Rosario is not Virtual and it???s not Reality ??? p. 57}
\item \hyperlink{5._Assessing_Serious_Educational_Games:_The_Development_of_a_Scoring_Rubric_.E2.80.93_p._75}{55. Assessing Serious Educational Games: The Development of a Scoring Rubric ??? p. 75}
\item \hyperlink{6._Game_Assessment_Using_the_E.2FE_Grid_.E2.80.93_p._95}{66. Game Assessment Using the E/E Grid ??? p. 95}
\item \hyperlink{7._Assessment_Using_After-action_Review:_Without_Footage_its_Fiction_-_p._119}{77. Assessment Using After-action Review: Without Footage its Fiction - p. 119}
\item \hyperlink{8._Usability_and_Play_Testing:_The_Often_Missed_Assessment_.E2.80.93_p._131}{88. Usability and Play Testing: The Often Missed Assessment ??? p. 131}
\item \hyperlink{9._Change_is_Constant.3B_The_Game_is_Serious:_Managing_Change_with_a_Serious_Game_at_One_Automotive_Company_.E2.80.93_p._147}{99. Change is Constant; The Game is Serious: Managing Change with a Serious Game at One Automotive Company ??? p. 147}
\item \hyperlink{10._Learning_in_Virtual_Worlds:_Assessment_Challenges_and_Opportunities_.E2.80.93_p._159}{1010. Learning in Virtual Worlds: Assessment Challenges and Opportunities ??? p. 159}
\item \hyperlink{11._Mitigating_the_Hawthorne_Effect_Using_Computer_Simulations_.E2.80.93_p._175}{1111. Mitigating the Hawthorne Effect Using Computer Simulations ??? p. 175}
\item \hyperlink{12._Endogenous_Learning_in_Multi_User_Virtual_Environments_.E2.80.93_p._189}{1212. Endogenous Learning in Multi User Virtual Environments ??? p. 189}
\item \hyperlink{13._Art_Education_Avatars_in_Action:_Learning.2C_Teaching.2C_and_Assessing_in_3D_Virtual_Worlds_.E2.80.93_p._201}{1313. Art Education Avatars in Action: Learning, Teaching, and Assessing in 3D Virtual Worlds ??? p. 201}
\item \hyperlink{14._Assessing_Learning_and_Identity_in_Augmented_Reality_Science_Games_.E2.80.93_p._221}{1414. Assessing Learning and Identity in Augmented Reality Science Games ??? p. 221}
\item \hyperlink{15._Semi-virtual_Embodied_Learning-Real_World_STEM_Assessment_.E2.80.93_p._241}{1515. Semi-virtual Embodied Learning-Real World STEM Assessment ??? p. 241}
\item \hyperlink{16._An_Open-ended.2C_Emergent_Approach_for_Studying_Serious_Games_.E2.80.93_p._259}{1616. An Open-ended, Emergent Approach for Studying Serious Games ??? p. 259}
\end{itemize}
\end{tabular}\hypertarget{1._Assessing_Gaming.2C_Computer_and_Scientific_Inquiry_Self-efficacy_in_a_Virtual_Environment_.E2.80.93_p._1}{}
\subsection{1. Assessing Gaming, Computer and Scientific Inquiry Self-efficacy in a Virtual Environment ??? p. 1}
\textit{Diane Jass Ketelhut}
Ketelhut outlines the development, piloting and revision of a tool for measuring student self-efficacy, initiated because she noticed a decline in interest in studying science in high school student, as compared to elementary school students. Scientific inquiry has shown to increase interest in a scientific career and virtual environments have been investigated for scientific inquiry-based curricula. Multi-user virtual environments (MUVEs) have been used to teach scientific inquiry so self-efficacy assessment can start there.
Self-Efficacy in Technology and Science (SETS) tool developed. \textit{Surver Monkey} was used to ask students self-efficacy questions.
SETS showed that once students perceive themselves as competent their effort and perseverance increases and they can be given greater challenges.\textbf{}\hypertarget{2._Self-Regulation_within_Game-based_Learning_Environments_.E2.80.93_p._19}{}
\subsection{2. Self-Regulation within Game-based Learning Environments ??? p. 19}
\textit{John Neitfeld and Lucy R. Shores}
Digital games have proven capable of capturing the attention of youth for long periods of time and compelling them contend with steep learning curves in order to succeed. For this reason, Game Based Learning Environments (GBLEs) interest educators. The chapter investigates implementing Self-Regulated Learning (SRL) in GBLEs and goes through existing SRL research. SRL is described as beliefs, motives, strategies and reflective processes that allow learners to autonomously direct their own learning. It requires cognitive strategies and an environment conducive to learning and seeking help when appropriate.\hypertarget{3._The_Wild_West_of_Assessment:_Measuring_Aggression_and_Violence_in_Video_Games_.E2.80.93_p._43}{}
\subsection{3. The Wild West of Assessment: Measuring Aggression and Violence in Video Games ??? p. 43}
\textit{Christopher J. Ferguson}
The chapter reviews assessment in violent video game studies, acknowledging that much of it has been problematic and poorly researched. The study showed that using standardized and valid measures is a must and that the best outcome measures are developed by groups not evaluating the game as there is a tendency toward bias. They also found that the quality of assessment limits conclusions. Many violent video game researchers have been too ready to ignore the limits of aggression assessments when generalizing serious real-world examples of violence. By paying close attention to measurement and the mistakes of others serious games has much to offer for use of assessments in outcome research.\textbf{}\hypertarget{4._Diagrammatic_Inquiry:_Rosario_is_not_Virtual_and_it.E2.80.99s_not_Reality_.E2.80.93_p._57}{}
\subsection{4. Diagrammatic Inquiry: Rosario is not Virtual and it???s not Reality ??? p. 57}
\textit{Owen Kelly}
Reports on the Marinetta Ombro project that created a synthetic culture on the island of Rosario. The project needed to be assessed but they were unsure how to suitably do so. Based upon the terms ???cyberspace??? and ???virtual reality???, the Internet has come to be unduly viewed in spatial terms. They concluded that Second Life is best viewed as a tool, not as a geographical space and the best analysis is diagrammatic and not statistical. Diagrammetric thought is said to be using a set of understood relations to model a set of relations that are not understood.\hypertarget{5._Assessing_Serious_Educational_Games:_The_Development_of_a_Scoring_Rubric_.E2.80.93_p._75}{}
\subsection{5. Assessing Serious Educational Games: The Development of a Scoring Rubric ??? p. 75}
\textit{Leonard A. Annetta, Richard Lamb and Marcus Stone}
Bad educational games do not teach well, so a standard must be developed. Games must be able to show that goals have been specified and met. They developed an assessment rubric, taking into account the following types of learning: experiential, inquiry-based, self-efficacy, goal setting, continuous feedback and cooperation (team learning). A list of 15 elements all serious games should have was compiled:
\begin{itemize}
\item Prologue
\item Tutorial/Practice Level
\item Interactive
\item Feedback
\item Identity
\item Immersion
\item Pleasurable frustration
\item Manipulation
\item Increasing Complexity
\item Rules
\item Informed Learning
\item Learning
\item Pedagogical Effectiveness
\item Reading Efficiency
\item Communication
\item Psychometrics
\end{itemize}\hypertarget{6._Game_Assessment_Using_the_E.2FE_Grid_.E2.80.93_p._95}{}
\subsection{6. Game Assessment Using the E/E Grid ??? p. 95}
\textit{Ricardo Javier Rademacher Mena}
The author had previously presented the E/E Grid as a framework combining education and entertainment theories to study games. The grid uses Bartle???s player types: socializer, explorer, achiever, killer on one axis of the grid and Callois??? taxonomy of playstyles: competition, chance, mimicry, vertigo on the other. It then asks if there are game types that appease each combination of player type and gameplay style. It combines the latter with a grid placing Gardner???s intelligence types: physical, lingual, interpersonal, logical, spatial, musical on one axis and Anderson/Krathwohl???s knowledge domains: metacognitive, conceptual, procedural, factual on the other. The combined graph allows for entertainment and education analysis of games to be simultaneously displayed in one diagram.\hypertarget{7._Assessment_Using_After-action_Review:_Without_Footage_its_Fiction_-_p._119}{}
\subsection{7. Assessment Using After-action Review: Without Footage its Fiction - p. 119}
\textit{Randy Brown}
Chapter discusses options and usefulness for analyzing recorded game footage. \hypertarget{8._Usability_and_Play_Testing:_The_Often_Missed_Assessment_.E2.80.93_p._131}{}
\subsection{8. Usability and Play Testing: The Often Missed Assessment ??? p. 131}
\textit{Scott Warren, Greg Jones and Lin Lin}
Learning in games often takes longer than traditional face to face methods to achieve increases in formal learning outcomes. Many serious games are not play tested before being rolled out. They conclude that play testing is important as it helps to see parts of the game that interfere with learning objectives and could result in the gamer failing. It also helps to release high quality products that can achieve goals without wasting time with things that could have been fixed. Lastly, involving users in the development cycle helps developers see the game through the user???s eyes. Usability was tested through recording audio and videos of users playing games with usability testers, reading teacher and students in a classroom setting and closed usability lab.\hypertarget{9._Change_is_Constant.3B_The_Game_is_Serious:_Managing_Change_with_a_Serious_Game_at_One_Automotive_Company_.E2.80.93_p._147}{}
\subsection{9. Change is Constant; The Game is Serious: Managing Change with a Serious Game at One Automotive Company ??? p. 147}
\textit{Kristen Cromer}
Game is still a dirty word in many corporate environments. Because of this it???s important to reference things like play theory, flow theory, social learning theory and dynamic assessment when talking about games for training. Challenges in implementation included assessment in the affective domain, a heterogeneous target audience, and the personal level of the objectives. Assessment strategies used included self-assessment, game play as assessment, performance feedback and scoring, failure and replay and real world assessment and follow-through.\hypertarget{10._Learning_in_Virtual_Worlds:_Assessment_Challenges_and_Opportunities_.E2.80.93_p._159}{}
\subsection{10. Learning in Virtual Worlds: Assessment Challenges and Opportunities ??? p. 159}
\textit{Margaret Corbit, Jennifer Wofford and Suzanne Kolodziej}
Many virtual worlds log user activity. Commercial game designers are experts at analyzing and using this data on the fly. Educators have limited access and knowledge in this area. The project discusses assessment methods used to assess Active Worlds. They found that students are motivated to build and create in virtual worlds. CyberCiv is presented as a refined structure for assessing building. The SciFair rubric adds self-assessment and chat and building log analysis can be used to develop tools for tracking real-time progress. \hypertarget{11._Mitigating_the_Hawthorne_Effect_Using_Computer_Simulations_.E2.80.93_p._175}{}
\subsection{11. Mitigating the Hawthorne Effect Using Computer Simulations ??? p. 175}
\textit{Shawn Y. Holmes}
Presents methods to mitigate the Hawthorne effect, subject???s tendency to alter behaviour as they know they are being studied. Using digital environments allows every participant to experience the same environment and allows them to self-assess. Answers are then analyzed and catalogued depending on how often participants refer to being assessed.\hypertarget{12._Endogenous_Learning_in_Multi_User_Virtual_Environments_.E2.80.93_p._189}{}
\subsection{12. Endogenous Learning in Multi User Virtual Environments ??? p. 189}
\textit{Dave R. Dannenberg and Michael A. Evans}
The chapter examines endogenous learning in \textit{World of Warcraft }and \textit{Second Life}. Endogenous games are games that are designed with gameplay tying to a specific curriculum or set of teaching goals. Good endogenous games should make distinguishing between learning and gameplay difficult. A player should have to master the content and context to master an endogenous game.\hypertarget{13._Art_Education_Avatars_in_Action:_Learning.2C_Teaching.2C_and_Assessing_in_3D_Virtual_Worlds_.E2.80.93_p._201}{}
\subsection{13. Art Education Avatars in Action: Learning, Teaching, and Assessing in 3D Virtual Worlds ??? p. 201}
\textit{Lilly Lu}
The chapter outlines how virtual worlds and avatars can benefit art education. The Second Life based VLE is collaborative, student-centered and activity-based. It treats SL as a study subject, a virtual world an emerging visual culture. Effective SL learning came from appropriate technical training. The duration of the course was only 8 weeks and the author wonders whether students kept up with SL.\hypertarget{14._Assessing_Learning_and_Identity_in_Augmented_Reality_Science_Games_.E2.80.93_p._221}{}
\subsection{14. Assessing Learning and Identity in Augmented Reality Science Games ??? p. 221}
\textit{Matt Dunleavy and Brittney Simmons}
This chapter describes assessment strategies for AR games for k-12.
\textbf{Research Questions}
How do students describe and understand:
\begin{enumerate}
\item how playing the AR simulation aids or hinders their understanding of comprehension of the scientific inquiry process
\item how playing AR simulations is different from a typical science class
\item assuming different roles aids and/or hinders their motivation and learning
\item understanding of complex systemic situations
\item pedagogical practices and supports
\end{enumerate}
AR games are promising for teaching collaborative problem solving. They can be viewed as mobile, physically intensive learning spaces with lowered real world consequences. AR simulations encourage risk free learning and capitalize on students??? ability to filter out relevant information.\hypertarget{15._Semi-virtual_Embodied_Learning-Real_World_STEM_Assessment_.E2.80.93_p._241}{}
\subsection{15. Semi-virtual Embodied Learning-Real World STEM Assessment ??? p. 241}
\textit{Mina C. Johnson-Glenberg, David Birchfield, Philippos Savvides and Colleen Megowan-Romanowicz}
The chapter talks about SMALLab, a learning environment that allows users to move freely in a space while interacting with dynamic sonic and visual media. Game-like scenarios are presented using SMALLlab. 1 scenario is compared to a normal classroom study and the other is assesses embodiment and learning separately, compared to a desktop environment. The objective is to ascertain whether embodied learning is more effective that ???mouse-driven??? learning. They found the embodied environment to be conducive to learning, even complex concepts, but not more so than the desktop.\hypertarget{16._An_Open-ended.2C_Emergent_Approach_for_Studying_Serious_Games_.E2.80.93_p._259}{}
\subsection{16. An Open-ended, Emergent Approach for Studying Serious Games ??? p. 259}
\textit{Matthew J. Sharritt}
The author tries to devise an in-depth, descriptive research design to provide a detailed account of the collaborative use of serious games. The approach is ethnomethodological and uses grounded theory and was found to be effective in conveying what was happening , in addition to findings from participants self-analysis.
\end{document}
