CaptureMyEmotion: Helping Autistic Children Understand their Emotions Using Facial Expression Recognition and Mobile Technologies

Authors

Valerie Gay, Faculty of Engineering and Information Technology, AustraliaFollow
Peter Leijdekkers, Faculty of Engineering and Information Technology, AustraliaFollow
Johann Agcanas, Faculty of Engineering and Information Technology, AustraliaFollow
Frederick Wong, Faculty of Engineering and Information Technology, AustraliaFollow
Qiang Wu, Faculty of Engineering and Information Technology, AustraliaFollow

Abstract

One of the main challenges for autistic children is to identify and express emotions. Many emotion-learning apps are available for smartphones and tablets to assist autistic children and their carers. However, they do not use the full potential offered by mobile technology, such as using facial expression recognition and wireless biosensors to recognise and sense emotions. To fill this gap we developed CaptureMyEmotion, an Android App that uses wireless sensors to capture physiological data together with facial expression recognition to provide a very personalised way to help autistic children learn about their emotions. The App enables children to capture photos, videos or sounds, and simultaneously attach emotion data and a self-portrait photo. The material can then be reviewed and discussed together with a carer at a later stage. CaptureMyEmotion has the potential to help autistic children integrate better in the society by providing a new way for them to understand their emotions.

Recommended Citation

Gay, Valerie; Leijdekkers, Peter; Agcanas, Johann; Wong, Frederick; and Wu, Qiang, "CaptureMyEmotion: Helping Autistic Children Understand their Emotions Using Facial Expression Recognition and Mobile Technologies" (2013). BLED 2013 Proceedings. 10.
https://aisel.aisnet.org/bled2013/10