CIRCA:The Expanded GRAND Assessment Framework

From CIRCA

Jump to: navigation, search

This is the original GRAND Assessment Framework. Though it is not up to date yet, it will eventually serve as an expanded list to further articulate sections and questions.

Contents

Affiliations (Stakeholders)

  • Who are the existing stakeholders?
    • administrative
    • ethical / legal
    • research
    • audience / customer
    • others
  • Who are the legacy stakeholders?
    • sponsors
    • returning group members
    • community partners
    • audience demographics
    • notion of a corporate "brand" with feedback mechanisms about its reputation
  • Who are new stakeholders, or what are recent changes in makeup/orientation/capacity?
  • Who are potential stakeholders?
    • Is there a market or test group available, already existing or in demand?
      • What are potential inclusion or exclusion factors (Does working with these stakeholders require REB ethics clearance?)
  • Where can more information be found about a particular stakeholder, how can this information be used?
  • How will you rank or sort stakeholders?
  • Which stakeholders will own the work when the project is done?

Expectations

  • What is the purpose of the project?
  • What are the minimum requirements of success?
  • What are the stakeholder groups' main goals?
    • What is each stakeholder group getting out of the project?
  • What ought to be the shared ambition of this project?
  • What are the stakeholders' responsibilities to the group?
  • To what extent is the project contract to be formalized or kept informal?

Resources

  • What are the deliverables?
    • What are our deliverables' timelines
  • What is the budget?
    • Who is responsible for all aspects of the budget?
  • What skills and technology do group members already have?
  • What technology or tools are required to build, maintain, and play the game?
  • What is the project timeline?
  • What amenities does the group have access to (e.g. a campus for testing)?
  • What is the length of time it would take to build and run the game?
    • Is there a deadline? Or can this project be delayed?
  • Is there a method for tracking progress regularly to ensure meeting deadlines?
  • Is there previous or comparable work, either ours or another group’s, in this area?
    • How does our work compare to other work?
  • How long should the project be able to last?
  • Is there a buffer for potential changes?
    • Time
    • Tools
    • Group
    • Tools
    • Partnerships
    • Capital
    • Ethical conditions
    • Demands from stakeholders
    • Other
  • Are any outside stakeholders responsible for providing content/information/materials/funding/etc.?
  • Are we using outside intellectual property?
    • Who does it belong to?
      • What sort of license does it use?
  • Who is responsible for maintaining the project?

Design and Execution

  • What design process will work best for this project?
    • How will you assess the design and development as it is happening?
    • Who will assess the design and development? How will they report back to stakeholders?
  • Does the game (at various stages) work? Does it meet the goals?
    • What doesn't work?
      • Is the problem technical, conceptual, or both?
  • Are there ways to improve the game or the platform based on the results of this attempt?
  • Should the game be more intuitive or instructional?
    • How quickly will the target audience be able to learn the game?
  • If the project is repeatable, will we learn new things or benefit from running the game again?
  • How will we conclude this project (what will the end-state look like?)

Impact and Feedback

  • What feedback are we testing for?
  • Who did the game work for (or not work for)?
    • How did the stakeholders react to the game?
  • Who and how do we want to give or receive feedback? (I think this needs to be broken down into several questions - SL)
    • How will we present findings to our stakeholders?
    • Who will we solicit feedback from?
      • What type of feedback is required? (qualitative? quantitative? game metrics?)
  • What would be the most efficient method - time and resource wise - of gathering assessment data?
  • Do the chosen assessment techniques require ethics clearance?
    • Do we need new ethics or can this fall under a previous project?
  • What tools will give us the most useful data?
  • What questions should the assessment tools pose?
    • Should there be multiple feedback tools available?
  • What is the criteria for acquiring and updating information about stakeholders?
  • How well does this project address the topic of '_____'?
  • Does the game provide anything different or better from other resources/games?

(I think this section needs to be much more detailed since this was the original focus of the framework - the assessment process) - SL

Misc. categories (fun, education, technology, etc...)

  • What are measurable variables that can be defined as '____'?
    • Can this game teach something that can be gained through other resources in a way that the targeted audience finds preferable? ( I think this is outside of the scope of our group, we are not really studying how best to teach a topic or curriculum, we are studying games.)
  • Do we need to advertise?
  • How will we launch the game and attract players?
    • Do we have a captive player group or is the game released in the wild?
  • Can we tweak the game during deployment? Is this a part of the plan?

Other things to put in

I've tried incorporating these parts into the framework as much as possible. They've mainly been incorporated into the resources sections-DG

  • Intellectual Property: What sort of license does it use? Who owns the work? Who published it? What is the intellectual property?
  • Time and Money: How long did it take to make? How much did it cost to develop? What sort of organization developed it?
  • Comparison and Competition: What other games are similar? Who is the competition? How does it compare to other games?
Personal tools