TakeTwo: Using Google Glass for Augmented Memory

CHI 2015 Video Showcase


Recent developments in the field of Wearable technology allow us to participate in seamless interactions that would otherwise be limited with handheld devices, such as cameras and cellphones. Now, we can think realistically about capturing data without disrupting the continuity of ongoing activities. People subjected to long streams of information are prone to miss or forget essential data. TakeTwo seeks to build on the advantages wearable devices confer to provide a virtual extension of memory, i.e. augmented memory, to aid users in acts of learning and recalling. Taking advantage of Google Glass’s ability to capture ongoing events through audio and video, we explored methods to actively index streams of vital information that users could quickly later access on demand. We paired Thalmic Labs Myo with Google Glass to grant TakeTwo users the ability to bookmark relevant events with discrete hand gestures. We are exploring the possibility of integrating data obtained from electrodermal, electroencephalograph, and orientation sensors with TakeTwo’s indexing features to automatically generate bookmarks based on emotional arousal that could be indicative of confusion or attention loss. This would grant our system the ability to categorize events, thus helping users review relevant footage more effectively using a desktop client.