The Development and Validation of the Game User Experience Satisfaction Scale (GUESS)

Mikki H. Phan; Joseph R. Keebler; Barbara S. Chaparro

doi:10.1177/0018720816669646

The Development and Validation of the Game User Experience Satisfaction Scale (GUESS)

Mikki H. Phan, Joseph R. Keebler, Barbara S. Chaparro

Human Factors & Behavioral Neurobiology

Wichita State University

Research output: Contribution to journal › Article › peer-review

Abstract

   Objective  : The aim of this study was to develop and psychometrically validate a new instrument that comprehensively measures video game satisfaction based on key factors.
   Background  : Playtesting is often conducted in the video game industry to help game developers build better games by providing insight into the players’ attitudes and preferences. However, quality feedback is difficult to
 obtain from playtesting sessions without a quality gaming assessment tool. There is a need for a psychometrically
 validated and comprehensive gaming scale that is appropriate for playtesting and game evaluation purposes.
   Method  : The process of developing and validating this new scale followed current best practices of scale development and validation. As a result, a mixed-method design that consisted of item pool generation, expert review, questionnaire pilot study, exploratory factor analysis (N = 629), and confirmatory factor analysis (N = 729) was implemented.
   Results  : A new instrument measuring video game satisfaction, called the Game User Experience Satisfaction
 Scale (GUESS), with nine subscales emerged. The GUESS was demonstrated to have content validity, internal consistency, and convergent and discriminant validity.
   Conclusion  : The GUESS was developed and validated based on the assessments of over 450 unique video game titles across many popular genres. Thus, it can be applied across many types of video games in the industry both as a way to assess what aspects of a game contribute to user satisfaction and as a tool to aid in debriefing users on their gaming experience.
   Application  : The GUESS can be administered to evaluate user satisfaction of different types of video games by a variety of users.

Original language	American English
Journal	Human Factors
Volume	58
DOIs	https://doi.org/10.1177/0018720816669646
State	Published - Dec 2016

Keywords

games
psychometrics
scaling
interface evaluation
usability/acceptance measurement and research

Disciplines

Game Design
Graphics and Human Computer Interfaces
Communication Technology and New Media
Human Factors Psychology
Other Psychology

Access to Document

10.1177/0018720816669646License: Unspecified

Cite this

@article{3ec5ae76587d4969bf4b355c034b227f,

title = "The Development and Validation of the Game User Experience Satisfaction Scale (GUESS)",

abstract = " Objective : The aim of this study was to develop and psychometrically validate a new instrument that comprehensively measures video game satisfaction based on key factors. Background : Playtesting is often conducted in the video game industry to help game developers build better games by providing insight into the players{\textquoteright} attitudes and preferences. However, quality feedback is difficult to obtain from playtesting sessions without a quality gaming assessment tool. There is a need for a psychometrically validated and comprehensive gaming scale that is appropriate for playtesting and game evaluation purposes. Method : The process of developing and validating this new scale followed current best practices of scale development and validation. As a result, a mixed-method design that consisted of item pool generation, expert review, questionnaire pilot study, exploratory factor analysis (N = 629), and confirmatory factor analysis (N = 729) was implemented. Results : A new instrument measuring video game satisfaction, called the Game User Experience Satisfaction Scale (GUESS), with nine subscales emerged. The GUESS was demonstrated to have content validity, internal consistency, and convergent and discriminant validity. Conclusion : The GUESS was developed and validated based on the assessments of over 450 unique video game titles across many popular genres. Thus, it can be applied across many types of video games in the industry both as a way to assess what aspects of a game contribute to user satisfaction and as a tool to aid in debriefing users on their gaming experience. Application : The GUESS can be administered to evaluate user satisfaction of different types of video games by a variety of users.",

keywords = "games, psychometrics, scaling, interface evaluation, usability/acceptance measurement and research",

author = "Phan, {Mikki H.} and Keebler, {Joseph R.} and Chaparro, {Barbara S.}",

note = "The process of developing and validating this new scale followed current best practices of scale development and validation. As a result, a mixed-method design that consisted of item pool generation, expert review, questionnaire pilot study, exploratory factor analysis ( N = 629), and confirmatory factor analysis ( N = 729) was implemented.",

year = "2016",

month = dec,

doi = "10.1177/0018720816669646",

language = "American English",

volume = "58",

journal = "Human Factors",

issn = "1547-8181",

}

TY - JOUR

T1 - The Development and Validation of the Game User Experience Satisfaction Scale (GUESS)

AU - Phan, Mikki H.

AU - Keebler, Joseph R.

AU - Chaparro, Barbara S.

N1 - The process of developing and validating this new scale followed current best practices of scale development and validation. As a result, a mixed-method design that consisted of item pool generation, expert review, questionnaire pilot study, exploratory factor analysis ( N = 629), and confirmatory factor analysis ( N = 729) was implemented.

PY - 2016/12

Y1 - 2016/12

N2 - Objective : The aim of this study was to develop and psychometrically validate a new instrument that comprehensively measures video game satisfaction based on key factors. Background : Playtesting is often conducted in the video game industry to help game developers build better games by providing insight into the players’ attitudes and preferences. However, quality feedback is difficult to obtain from playtesting sessions without a quality gaming assessment tool. There is a need for a psychometrically validated and comprehensive gaming scale that is appropriate for playtesting and game evaluation purposes. Method : The process of developing and validating this new scale followed current best practices of scale development and validation. As a result, a mixed-method design that consisted of item pool generation, expert review, questionnaire pilot study, exploratory factor analysis (N = 629), and confirmatory factor analysis (N = 729) was implemented. Results : A new instrument measuring video game satisfaction, called the Game User Experience Satisfaction Scale (GUESS), with nine subscales emerged. The GUESS was demonstrated to have content validity, internal consistency, and convergent and discriminant validity. Conclusion : The GUESS was developed and validated based on the assessments of over 450 unique video game titles across many popular genres. Thus, it can be applied across many types of video games in the industry both as a way to assess what aspects of a game contribute to user satisfaction and as a tool to aid in debriefing users on their gaming experience. Application : The GUESS can be administered to evaluate user satisfaction of different types of video games by a variety of users.

AB - Objective : The aim of this study was to develop and psychometrically validate a new instrument that comprehensively measures video game satisfaction based on key factors. Background : Playtesting is often conducted in the video game industry to help game developers build better games by providing insight into the players’ attitudes and preferences. However, quality feedback is difficult to obtain from playtesting sessions without a quality gaming assessment tool. There is a need for a psychometrically validated and comprehensive gaming scale that is appropriate for playtesting and game evaluation purposes. Method : The process of developing and validating this new scale followed current best practices of scale development and validation. As a result, a mixed-method design that consisted of item pool generation, expert review, questionnaire pilot study, exploratory factor analysis (N = 629), and confirmatory factor analysis (N = 729) was implemented. Results : A new instrument measuring video game satisfaction, called the Game User Experience Satisfaction Scale (GUESS), with nine subscales emerged. The GUESS was demonstrated to have content validity, internal consistency, and convergent and discriminant validity. Conclusion : The GUESS was developed and validated based on the assessments of over 450 unique video game titles across many popular genres. Thus, it can be applied across many types of video games in the industry both as a way to assess what aspects of a game contribute to user satisfaction and as a tool to aid in debriefing users on their gaming experience. Application : The GUESS can be administered to evaluate user satisfaction of different types of video games by a variety of users.

KW - games

KW - psychometrics

KW - scaling

KW - interface evaluation

KW - usability/acceptance measurement and research

U2 - 10.1177/0018720816669646

DO - 10.1177/0018720816669646

M3 - Article

SN - 1547-8181

VL - 58

JO - Human Factors

JF - Human Factors

ER -