motivation

Recording a Large Scale Dataset During UbiComp

In this tutorial we present the Smart Eyewear toolchain consisting of smart glasses prototypes and a software platform for cognitive and social interaction assessments in the wild. We will present a series of, with several application cases and give a demonstration of activity recognition in real-time using eyewear. The platform is designed to work with J!NS MEME, smart EOG (electrooculography) enabled glasses. The user software is capable of data logging, posture tracking and recognition of several activities, such as talking, reading and blinking. In this tutorial organizers will walk through several applications and studies that the platform has been used for. Participants are able to reproduce results from these studies and are invited tocan design their own experimental setups. We will, furthermore, record a dataset during UbiComp actively involvingincluding the tutorial participants.

Details
We will record a large scale dataset using smart eyewear during UbiComp 11th-13th September 2019. The participants are asked to wear a J!NS MEME during the conference together with a smart phone we provide as well, recording their head and eye movements. Participants should also log which sessions they attend and a rating of the talks. Everybody participating in the recordings (and at least recording 2 days of usable data: over 8 hours throughout the day, and a couple of talk sessions), will get access to the full dataset together with ground truth label data and our toolchain to analyse EOG and movement data (includes advanced wavelet synchrony code, blink detection and an alertness-detection model based on EOG).
Schedule
Sept. 10th 13:00 -17:00 preparations. If participants want to take part in the date recording, they should not be wearing any glasses (contact lenses ok) as they will be asked to wear J!NS MEME during the 3 days of the conference.
Organizers

George Chernyshov, Keio Media Design
Shoya Ishimaru, DFKI, Kaiserslautern
Kai Kunze, Keio Media Design
Benjamin Tag, Melbourne University
Jamie Ward, Goldsmith University
Yuji Uema, J!NS Co.
Philipp Scholl, University Freiburg.