User Testing Phases

Once the test begins, we need to quietly observe and record the players’ behaviour from a position where they cannot see us.

If conditions allow, we can consider observing through one-way glass or via video footage in another room. We must minimise interference with the test subjects, allowing them to understand the game rules on their own, providing help only when the game cannot proceed. For example, at the start of the game, we should not explain the rules or controls beforehand, but let the test subjects figure it out for themselves. If they experience confusion or misunderstand something, we can record their feedback.

Recording during the test process is crucial. While observing players, we should note any questions they ask and details worth mentioning. These records will help us organise the information later and provide a basis for the questions and discussion after the test.

If the test subjects are too quiet during the process, we can proactively remind and encourage them to express their thoughts, as we did initially. As observers, we cannot directly understand the true feelings of the test subjects. Even if we notice changes in their facial expressions, we cannot easily analyse their emotions. Even if we could measure emotional changes, we still wouldn’t know what specifically influenced those emotions. Therefore, merely observing is not enough to fully understand their inner experience.

To better grasp their feelings, we need to encourage them to express their thoughts on the game, including what they liked or disliked and any confusion or misunderstanding they encountered. This feedback will make it easier to analyse the game’s effectiveness.

After the test phase, we need to arrange for a post-test discussion and ask questions about the players’ experiences during the game. Typically, we will ask about their understanding of the game, how fun they found it, and its difficulty level. During questioning, we should take into account the issues they encountered and the details worth noting from the test. Our records from the testing phase will be helpful in this section.

When asking questions, we need to keep the following points in mind: ask open-ended questions, avoid leading or biased questions, and encourage participants to give ratings or feedback. In this section, we must not only ask questions but also pay attention to recording information for later analysis.