private webpage: 
Interventions to support individuals with autism to provide step-by-step guidance often involve the use visual supports (i.e., those things we see that enhance the communication process) that sometimes use words, images, or tangible objects to represent activities that will take place (or have taken place) arranged in temporal order. A special type of visual supports that provide children with autism step-by-step guidance for accomplishing their daily tasks are “cookbooks,” like a chef uses a cookbook to create a meal. Cookbooks use visual aids including the exchange or display of a variety of images, drawings or photographs to represent tasks, needs, goals and rewards. Each step is represented with a visual image and text annotation.

CleanBook, an activity-aware cookbook that guides children with autism during the activity of “washing hands”. When the user approaches to the mirror located above the sink, the system shows the cookbook for washing hands. A multimedia projector mounted behind the sink is used to display the cookbook in the mirror . Unlike traditional static cookbooks, CleanBook displays a video for each step of the process, and recognizes some user interactions gestures to “zoom in/out” or “move left/right” the cookbook. The metaphor of a puzzle is used to demonstrate that several steps must be completed to finish the activity. Additionally, CleanBook is context-aware, meaning that it displays the appropriate step based on sensing when various activities are being performed. Thus, as CleanBook senses that a step has been completed, a new piece of the puzzle appears as a reward. The system provides also audible aids to prompt students to “stay on task” when they get “stuck” in a step. The system uses the kinnect 3D camera to recognize steps and interactions gestures.

Project participants

 
Claudia Rangel, Master Student (see more about claudia …)
e: claudia[dot]rangel[at]gmail[dot …

Monica Tentori, Ph.D., Assistant Professor (see more about monica …)
e: mten …

Related publications to the project

  • Rangel, C. and Tentori, M., (2011) “Self-configurable Activities in Activity-Aware Computing: The Case of Autism”, UCAMI, Riviera, Maya, Mexico, Diciembre 5-9, 2011 (Note)