Interaction designer
Unity 2018.2.15f1 Personal (64bit) - SampleScene.unity - AnitaFinal - PC, Mac & Linux Standalone_ _DX11_ 12_11_2018 12_10_00 AM.png


A Collaborative VR Painting Tool For Interpersonal Emotion Expression



A Collaborative VR Painting Tool For Interpersonal Emotion Expression 

What if the emotion can be drew and shared with your intimate ?


EmotiBrush a collaborative Virtual Reality (VR) painting tool, that arises emotional awareness and strengthen the interpersonal relationship. With this tool, the user can create a three-dimensional painting while the control of the brush is decoupled from their own expression to another person's feeling. We monitor muscle, heart rate, brainwave, and body temperature to create an emotion map. These parameters are mapped to brush strokes. It's a pair only painting tool which allows the user to paint with others emotion. This paper also describes the composition of the brush by analyzing the relationship between each element of brush and inner emotion with the database.




The development of Technology makes people apart and negatively reshapes interpersonal relationships [7]. People stop expressing emotion to others like we use to. Emotion is a feeling expressed physiologically and verbally, and it can be understood as "an impulse that induces the action" causing automatic reaction behaviors to the environmental stimulus [9]. Understanding emotion is a way to identify and learn about oneself and others [3]. Meanwhile, human's emotion has an inseparable connection with a human body which includes bio-signal, gesture, body temperature and other related aspects. Physiological signals which controlled by the autonomic nervous system are spontaneous and won't be intervened [10].

Meanwhile, affective computing plays an important role in developing the system for recognizing emotions. By affective computing, the invisible and nonverbal expression will be decoded and deduce corresponding emotion which helps people learn about others. In this project, we collect real-time electroencephalogram (EEG), muscle tension, heart rate and body temperature data from the body. We then use the data as a control parameter to manipulate the elements of a brush.

We proposed the EmotiBrush in the VR environment which is a powerful tool to offer the user a feeling of existing in the real world. The user will immerse in a space which isolated from the external world with the powerful head-mounted display. Additionally, some works show that emotional content increases the sense of presence in an Immersive Virtual Environment(IVE) and that, faced with the same content, the self-reported intensity of emotion is significantly greater in immersive than in non-immersive [4]. Therefore, by collaborating using VR, the painter will have deeper interpretation and feeling of another user's emotion.


Design and Implementation

It is important to consider the composition of the brush itself that includes color, size, texture, value etc. We currently chose four variables that are automatically changed with the alteration of the data collected from the user. We decided to monitor muscle, heart rate, brainwave and body temperature to create an emotion map because these four parameters are relatively easier to detect, and all of them are supported by a huge amount of research. Research results that reliable measurement of muscle tension of individual differences in incidental facial responses and to emotional expressions is feasible [1].