25/04/2020

Mirror Ritual: An Affective Interface for Emotional Self-Reflection

Nina Rajcic, Jon McCormack

Keywords: affective computing, affective interface, theory of constructed emotion, computational creativity, emotion, poetry, generative networks

Abstract: This paper introduces a new form of real-time affective interface that engages the user in a process of conceptualisation of their emotional state. Inspired by Barrett’s Theory of Constructed Emotion, ’Mirror Ritual’ aims to expand upon the user’s accessible emotion concepts, and to ultimately provoke emotional reflection and regulation. The interface uses classified emotions – obtained through facial expression recognition – as a basis for dynamically generating poetry. The perceived emotion is used to seed a poetry generation system based on OpenAI’s GPT-2 model, fine-tuned on a specially curated corpus. We evaluate the device’s ability to foster a personalised, meaningful experience for individual users over a sustained period. A qualitative analysis revealed that participants were able to affectively engage with the mirror, with each participant developing a unique interpretation of its poetry in the context of their own emotional landscape.

The video of this talk cannot be embedded. You can watch it here:
https://www.youtube.com/watch?v=YMAe33IJFVc
(Link will open in new window)
 0
 0
 0
 0
This is an embedded video. Talk and the respective paper are published at CHI 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd

Similar Papers