(Tentative) Assessment Framework Questions

Use these question categories in the process of answering your own questions relevant to a specific project.Fill in category sub-questions as best you can, add your own or skip questions as needed.

Stakeholders

• Who are the stakeholders?
• Who is the targeted audience for the game?
  • What will the audience take away from the game?
• Is there a market or test group available, already existing or in demand?
• Does working with these stakeholders require REB ethics clearance?

Expectations

• What is the main purpose of the project?
• What are the stakeholders??? main goals?
  • Can one stakeholder???s expectations be met while meeting another???s?
    • What would be the requirements of success?
• What deliverables are due to each stakeholder (what are they getting out of the project)?
• What are the stakeholders' responsibilities to the group?
• Do we need/have a project contract?
• What is the project timeline?
  • What are our deliverables' timelines
• How will we conclude this project (what will the end-state look like?)

Resources

• What are the deliverables?

• What is the budget?
  • Who is responsible for all aspects of the budget?

• What technology or tools are required to build, maintain, and play the game?

• What is the length of time it would take to build and run the game?
  • Is there a deadline? Or can this project be delayed?

• Is there previous work, either ours or another group???s, in this area?

• How long should the project be able to last?

• Are any outside stakeholders responsible for providing content/information/materials/funding/etc.?

• Who is responsible for maintaining the project?

• What does the end-state of the project look like?

Execution

• Does the game work?
  • What doesn't work?
    • Is the problem technical, conceptual, or both?
  • Can the game be fixed or is this a future cautionary tale?

• Who did the game work for (or not work for)?
  • How did the stakeholders react to the game?

• Does the game advance our research goals?
• Is this a successful research project?
• Is this a successful game?

• Are there ways to improve the game or the platform based on the results of this attempt?

• Should the game be more intuitive or instructional?
  • How quickly will the target audience be able to learn the game?

• If the project is repeatable, will we learn new things or benefit from running the game again?

Feedback

• Who and how do we want to give or receive feedback? (I think this needs to be broken down into several questions - SL)
  • How will we present findings to our stakeholders?
  • Who will we solicit feedback from?
    • What type of feedback is required? (qualitative? quantitative? game metrics?)
• What would be the most efficient method - time and resource wise - of gathering assessment data?
• Do the chosen assessment techniques require ethics clearance?
  • Do we need new ethics or can this fall under a previous project?
• What tools will give us the most useful data?
• What questions should the assessment tools pose?
  • Should there be multiple feedback tools available?

(I think this section needs to be much more detailed since this was the original focus of the framework - the assessment process) - SL

Misc. categories (fun, education, technology, etc...)

• What are measurable variables that can be defined as '____'?
• Can the game teach anything different than a textbook, class, or other resources?
  • Can this game teach something that can be gained through other resources in a way that the targeted audience finds preferable?
• Is there technology involved? Or theory?
• Do we need to advertise?

Other Frameworks

External Links