Assessment Framework
From CIRCA
VTracker |
---|
Content inserted. (6 Occurances) |
Content style of a font changed. (2 Occurances) |
Contents |
(Tentative) Assessment Framework Questions
Use these question categories in the process of answering your own questions relevant to a specific project.Fill in category sub-questions as best you can, add your own or skip questions as needed.
Stakeholders
- Who are the stakeholders?
- Who is the targeted audience for the game?
- What will the audience take away from the game?
- Is there a market or test group available, already existing or in demand?
- Does working with these stakeholders require REB ethics clearance?
Expectations
- What is the main purpose of the project?
- What are the stakeholders??? main goals?
- Can one stakeholder???s expectations be met while meeting
another???s?
- What would be the requirements of success?
- Can one stakeholder???s expectations be met while meeting
another???s?
- What deliverables are due to each stakeholder (what are they getting out of the project)?
- What are the stakeholders' responsibilities to the group?
- Do we need/have a project contract?
- What is the project timeline?
- What are our deliverables' timelines
- How will we conclude this project (what will the end-state look like?)
Resources
- What are the deliverables?
- What is the budget?
- Who is responsible for all aspects of the budget?
- What technology or tools are required to build, maintain, and play the game?
- What is the length of time it would take to build and run the
game?
- Is there a deadline? Or can this project be delayed?
- Is there previous work, either ours or another group???s, in this area?
- How long should the project be able to last?
- Are any outside stakeholders responsible for providing content/information/materials/funding/etc.?
- Who is responsible for maintaining the project?
- What does the end-state of the project look like?
Execution
- Does the game work?
- What doesn't work?
- Is the problem technical, conceptual, or both?
- Can the game be fixed or is this a future cautionary tale?
- What doesn't work?
- Who did the game work for (or not work for)?
- How did the stakeholders react to the game?
- Does the game advance our research goals?
- Is this a successful research project?
- Is this a successful game?
- Are there ways to improve the game or the platform based on the results of this attempt?
- Should the game be more intuitive or instructional?
- How quickly will the target audience be able to learn the game?
- If the project is repeatable, will we learn new things or benefit from running the game again?
Feedback
- Who and how do we want to give or receive feedback? (I think
this needs to be broken down into several questions - SL)
- How will we present findings to our stakeholders?
- Who will we solicit feedback from?
- What type of feedback is required? (qualitative? quantitative? game metrics?)
- What would be the most efficient method - time and resource wise - of gathering assessment data?
- Do the chosen assessment techniques require ethics clearance?
- Do we need new ethics or can this fall under a previous project?
- What tools will give us the most useful data?
- What questions should the assessment tools pose?
- Should there be multiple feedback tools available?
(I think this section needs to be much more detailed since this was
the original focus of the framework - the assessment process) -
SL
Misc. categories (fun, education, technology, etc...)
- What are measurable variables that can be defined as '____'?
- Can the game teach anything different than a textbook, class,
or other resources? (Not all of our games are designed to be
serious games - this is a better question for the assessment
section for specific games, will not apply to all projects)
- Can this game teach something that can be gained through other resources in a way that the targeted audience finds preferable? ( I think this is outside of the scope of our group, we are not really studying how best to teach a topic or curriculum, we are studying games.)
- Is there technology involved? Or theory? (This question is very broad, I'm not sure what it means and how it is different from resources section - needs to be defined better or broken up into sub questions)
- Do we need to advertise?
- How will we launch the game and attract players?
- Do we have a captive player group or is the game released in the wild?
- Can we tweak the game during deployment? Is this a part of the plan?
Other Frameworks
External Links
has a long list of items - have a feeling that these are at different levels of importance so we should read through and sort.
Bits of advice that could be part of a framework content
- assessment using pros and cons, example is pros and
cons of using a wiki use for collaborative work
(I think this document is supposed to be less a 'how to' guide and more of a check list/framework for doing the theoretical and technical research and implementation. Perhaps we can start a page of solid design 'how to' resources elsewhere on the wiki)';this.style.color = '#ff0000';" onMouseOut = "this.innerHTML = '(I think this document is supposed to be less a 'how to' guide and more of a check list/framework for doing the theoretical and technical research and implementation. Perhaps we can start a page of solid design 'how to' resources elsewhere on the wiki)';this.style.color = '#000000';">(I think this document is supposed to be less a 'how to' guide and more of a check list/framework for doing the theoretical and technical research and implementation. Perhaps we can start a page of solid design 'how to' resources elsewhere on the wiki)
- flow in games
(This is an awesome paper but please describe how it fits in with the design framework. I'm not sure why this is here)';this.style.color = '#ff0000';" onMouseOut = "this.innerHTML = '(This is an awesome paper but please describe how it fits in with the design framework. I'm not sure why this is here)';this.style.color = '#000000';">(This is an awesome paper but please describe how it fits in with the design framework. I'm not sure why this is here)