• Home
  • 2017
  • 2016
  • 2015
  • 2014
  • 2013
  • 2012
  • 2011

PDI Studio 5

Design to make a difference

Feed on
Posts
comments

Evaluation & Assessment

Nov 29th, 2015 by abduln6

Our game is designed to help students learn fractions and math in a fun environment. We designed our game to have levels so that we can evaluate the students according to their comprehension and mathematical ability and use that data to further improve our project. The levels also ensure that the students understand the material of fractions and basic math so they can grow upon math ideas. In order to evaluate our game and improve on it, we decided on a few ‘instruments’ to help us assess the game and the students: 1) the time they take to complete a level, 2) the number of errors they made in the calculations/answer selection as well as 3) their reactions throughout the game. We would also add a survey at the end of the game so the students can give us feedback and reviews. 

Instruments:

  1. Time Taking
  2. Error Tallying
  3. Reactions/Language
  4. Survey

It is important to point out that it is hard to accurately evaluate the game solely based on our limited visit. The interaction between the children and the game will differ according to the current environment, whether or not they are partnered with other kids and if they are comfortable with the subject and simulation. Since it is hard for us to integrate the timing and error-tallying mechanism into the game, our evaluation would also depend on our ability to focus on each child’s time, ability and reaction as they are playing the game.

 


 

First Prototype evaluation

 The first game went fairly well and the kids were very engaged and cooperative. They unsurprisingly liked doing an activity with food and a lot of them showed interest in nutrition and food. One positive observation we got from the game was that the kids were interested to try new things and showed interest in exploring new flavors. They also tend to ask questions about the nutrition values and seemed interested to understand how food and nutrition works.

However, one drawback was the kids seemed to pick ingredients for their food based on what’s closest to them. We had to encourage them to stand up and look at the food at the other side of the table because most of the food they chose were the ones that they can easily access and see. The activity was also not very feasible to be incorporated into the curriculum, since the food are quite pricey and has a short shelf life.

Second Prototype evaluation

reciperatio

(click on the picture)

 The second prototype was coded and programmed on Scratch. We designed a game based off of fractions and officially named it ‘Recipe Ratio’. Basically, the players have to complete the worksheet given, measure the ingredients of the given recipes (in this first prototype, the recipe given is a recipe for sugar cookies) in fractions, and bake and decorate their cookies.

From the language and reactions from the kids, the game pretty much went well. However, there were a few drawbacks. The first one is the drag-and-drop mechanism we installed for the ‘scooping’ of the ingredient and ‘pouring’ it into the mixing bowl (pictured above). Apparently, it was quite hard for the kids to do and it was not intuitive. Another problem was that the way the game was programmed sometimes caused glitches in the clicking mechanism, which resulted to the kids miscounting the amount of ‘scoops’ they have poured in the bowl. Since there was no failure mechanism integrated into the game, the kids weren’t aware when they miscalculated the amount of scoops.

Third Prototype evaluation

Picture1

The different options

Picture3

The hint question

Picture2

The stirring interaction

 

The third prototype the game was similar to our first game but we tried to make it more interactive so that the students didn’t get bored. We also wanted to incorporate the worksheet we had the first time so that everything was built into the game. We changed the way students chose their answers. Instead of scooping each ingredient so many times, we had two or three options for them to choose from. This was more user friendly; however the students did not realize that the outlined boxes were a choice. Another flaw with the new choice selection is that the students could guess at the game instead of taking the time to work through the problem. This was something we anticipated so we created a fail mechanism each time a wrong answer was chosen. We included a hint question for the water since it was the hardest measurement to determine. However, very few students chose to use the question, opting for just failing and starting over from the beginning.  The stirring and pizza tossing were interactive and the students that said they wanted it to be more “hands-on” were more satisfied with these components. The last question that they had to answer was how many pieces the pizza had to be cut into. Many of the students realized that the answer was 8 as they included the Scratch cat as a person they accounted for. Others either guessed a random number and some even decided that each person should get two slices so they multiplied the answer, getting 16 as the answer. (In multiplication case, it was wrong based on the way we programmed it but the reasoning and math were correct)

Overall, this game got much better feedback from the students but the math we wished to include was lost. We made the game too much like a multiple choice game instead of a game where the students had to work through different problems.

Comments Off on Evaluation & Assessment



Comments are closed.

  • Projects

    • 2017
      • Artistic Prosthetic
      • Cell Protobox Activity
        • Background
        • Overview and Lesson Plan
        • Pictures from the Activity
        • Final Prototypes from the Activity
        • Recount of the Activity
        • Demo Day with PDI Students
        • Final Protobox
        • Next Steps
        • Vision
      • Hue Harmony
        • Project Scope
          • HueHarmony2.ino
          • Sampler_12bit.ino
        • Future Development
        • User Feedback
        • Research
      • infinish.ed
        • Proposed Solution – Unfini-shed
        • Proposed Solution – infinish.ed
        • User Experience Mapping
        • Design Justification
        • Roadblocks/Challenges
        • User Feedback
        • Conclusion
      • Pop-Up Symphony
      • Saltwater Greenhouse
      • Smart Protection Brace
        • Background Research
        • Initial Prototype
        • Iterations and Second Prototype
        • Next Steps
        • Potential Methods
        • User Group
    • 2016
      • Creation Station: An Interactive Kiosk
        • User Group
        • Feedback #1: Oakwood Community Dinner-November 14th, 2016
        • Feedback #2: Uncle Sam’s Bus Stop-November 15th, 2016
        • Feedback #3: Farmer’s Market- November 19th, 2016
        • Prototype and Final Build of the Kiosk
        • Final Testing and Final Thoughts
      • ElektroTone
      • Furnäture
      • Media Sanctuary Mobile Experience
        • Prototype 1
        • Prototype 2
        • Prototype 3
        • Next Steps
        • Presentation Slides
      • ObservaStory
        • Background Research
        • First Iteration
        • Second Iteration
        • Evaluation & Dissemination
      • People Library
        • Target User Group
        • Primary Iteration: The Event
        • Secondary Iteration: The System
          • The Website
          • The App
        • User Feedback: The Process
        • The Final Product
      • Physics Plank
        • Physics Plank 1.0
          • Design
          • User Feedback
        • Physics Plank 2.0
          • Design
          • User Feedback
        • Next Steps
          • Ideal Code and Construction
      • Portable Foundation Finder (PFF)
        • Background Research
        • Customer Discovery
          • Personas
          • Survey Responses
        • Prototype
        • User Testing
        • Working Demo
    • 2015
      • Alien Adaptation
        • Target User Group
        • First School Visit (September 28, 2015) – Prototype #1
        • Second School Visit (October 15, 2015) – Prototype #2
        • Third School Visit (November 9, 2015) – Prototype #3
        • Fourth School Visit (December 10th, 2015) – Prototype #4
        • Background Research
        • Alien Cards
        • Methods of Organization
        • Other Resources
      • Zoe the Green Monkey
        • Background Research
        • Evaluation & Dissemination
        • Sources for Further Teaching
      • Recipe Ratios
        • School 2 Visits
        • Background Research and Information
        • Context
        • Evaluation & Assessment
      • Space Race
        • Background Research
        • Evaluation and Assessment
        • Field Work : 1st Visit to School 2
        • Field Work : 2nd Visit to School 2
        • Field Work : 3rd Visit to School 2
        • Field Work : Final Visit to School 2
      • Rhythmatic
        • Overview/Background Research
        • User Research & Design Specifications
        • Lesson Plan
        • User Testing
        • Ethnographic Observations
        • Final Interface Design
    • 2014
      • Ghanaian Solar Heat Collection
        • Solar Production of Adinkra Ink
          • Adinkra Ink Background Information
            • Interview with Mae-Ling Lokko
            • Production of Adinkra Ink
        • Solar Production of Biochar
          • Biochar Information
          • Heliostat Development
            • Codes and Hardware
            • Phase 1: Small setup
            • Phase 2: Medium Setup
            • Phase 3: Future Design Considerations
          • Interviews with Marianne Nyman and Alex Allen
          • Planning the process
          • Prototype Design Process Images
        • Prototype Iterations
        • Testing
        • Future Prospects
      • Cheap Sensors for Quality Education
        • Building the Sensor
        • CSnap Integration for Data Visualization
        • Future Work
        • Hardware
        • Previous Iterations
        • Professional Development Integration
          • Compost Computing PD Outline
        • Transferring Data from Arduino to CSnap
        • Code (Integration with SD card data collection)
          • SD Card Readout Example
        • Code (Temperature and Humidity sensors only)
      • Condom Vending Machine
        • Cultural Background
        • Why Open Source?
        • Screen Printing Vs. Stickers
          • Hints for stickers!
        • Intitial Design Ideas
          • Initial Designs
        • Prototypes and feedback
        • Final Design
        • Feedback
        • Future Plans
      • Music & Sound: Earthquake Simulator
        • Prototyping & Iterations
          • Rounds 1 & 2
          • Round 3: Final Prototype
        • Field-Testing: User Feedback
        • How-To/DIY Projects
        • Future Testing
        • Dissemination
    • 2013
      • Edu-Ponics
        • The Community Garden
        • The Tower
        • The Monitoring Unit
          • Code
          • Prototype
        • Dissemination
        • User Feedback
        • About
      • Fraction Bot
        • Future Iterations
        • Primary Market Research
        • Prototyping/Testing
        • Source Code–Please Use
      • Ghana Outreach Solar Reflector
        • Cultural Background
        • Partnership with KNUST
        • Prototyping
          • Initial Mock-up
          • Lamination
          • Plywood Model
          • Reaction Chamber
          • Stainless Steel Ribs
        • Testing
        • Future Iterations
      • iQube
      • Lean Green Clean Machine
        • Background
        • Redesign Proposal
      • Music Factory
        • Prototype
        • Field Testing
        • Dissemination
      • Nutrition Kitchen
        • The Game
        • Learning About Nutrition
        • Children’s Reactions and Results
      • Solar Tracker
    • 2012
      • 2 Fast, 2 Curious
        • Learning Objectives
        • Make It Yourself!
          • Hardware
          • The Code
        • Responses
        • The Game
        • Downloads
      • Apollo 2 1/4
        • Children’s Reactions
        • Final Trip Notes
        • Fraction Practice
        • Materials & Software Used
        • Source Code
      • Coordinate Kinection
        • The Game
          • How to Play
          • Screenshots
        • Student Reactions
        • Do It Yourself
          • main.cpp
          • Instructions
          • Download
      • Discover The Universe
      • Power Up!
        • Make Your Own
        • Platform Theory
          • Software Theory
        • Research and Development
        • Student Reaction
      • Squid Learn
        • Building the Lesson Plan
        • How It’s Made
        • Research and Iterations
          • 1st Visit
          • 2nd Visit
          • 3rd Visit
        • Student Reactions
    • 2011
      • Alien Frontier
        • Downloads
        • The Process
          • Ethnographic Description
          • Ethnographic Description 1
          • Ethnographic Description 2
      • Cookie Creations
        • Cookie Creation Game
        • Classroom Process
        • Assessments and Surveys Used
        • Research
      • Fast Track
        • DIY
        • Learning Objectives
        • Materials
        • Response
        • Components
      • Make ’em Fresh
        • Make ’em Fresh: How It’s Made
          • Team Contributions
        • Make ’em Fresh: Research and Iterations
          • Early Concepts
          • Images: First and Second Visits
          • Future Iterations
        • Make ’em Fresh: Student Response
          • Pre- and Post-Testing
      • Rap Star
        • The Game
          • What?
          • When & Where?
          • Who?
          • Why?
        • Field Testing and Iterations
          • First Visit
          • Second Visit
          • Final Visit
          • Ethnographic Descriptions
        • What Now?
          • Conclusion
          • Future Iterations
          • Additional Images
      • Rush More
      • School House of Pop
        • Educational Goals
        • Student Response
        • Design Evolution
        • Future Design Aspirations
        • Culture and Society
        • Pictures at School

Theme: MistyLook by Sadish. WPMU Theme pack by WPMU-DEV.