
CleanBook, an activity-aware cookbook that guides children with autism during the activity of “washing hands”. When the user approaches to the mirror located above the sink, the system shows the cookbook for washing hands. A multimedia projector mounted behind the sink is used to display the cookbook in the mirror . Unlike traditional static cookbooks, CleanBook displays a video for each step of the process, and recognizes some user interactions gestures to “zoom in/out” or “move left/right” the cookbook. The metaphor of a puzzle is used to demonstrate that several steps must be completed to finish the activity. Additionally, CleanBook is context-aware, meaning that it displays the appropriate step based on sensing when various activities are being performed. Thus, as CleanBook senses that a step has been completed, a new piece of the puzzle appears as a reward. The system provides also audible aids to prompt students to “stay on task” when they get “stuck” in a step. The system uses the kinnect 3D camera to recognize steps and interactions gestures.
Project participants
Related publications to the project
- Rangel, C. and Tentori, M., (2011) “Self-configurable Activities in Activity-Aware Computing: The Case of Autism”, UCAMI, Riviera, Maya, Mexico, Diciembre 5-9, 2011 (Note)