Smart Scarf: An IOT-based Solution for Emotion Recognition
Received: 12 April 2023 | Revised: 24 April 2023 | Accepted: 26 April 2023 | Online: 2 June 2023
Corresponding author: Wafa Almukadi
Abstract
This paper presents the design rationale of a color-changing scarf depending on the emotional state it detects. The goal of the design is to associate people to show up their emotional state especially those who have difficulties in expressing their feelings, such as elderly people, children, people with special needs, and people who have to wear a face mask, which covers their facial expression, as it is common during the COVID-19 pandemic period. Wearing a smart emotional scarf provides a context of the individual's emotional state that might help surrounding people in dealing with them. Our design uses a heart rate sensor and a skin sensor to detect and recognize emotional information. The scarf will change its color based on the emotional state it detects (neutral, angry, happy, and sad). An interface allows the provision of emotional data and displays emotional statistics and daily history. We went through a user-centered design process adopting wearable technology guidelines. A proposed prototype of the smart scarf is presented called Scarfy. A user evaluation is conducted showing that wearing the scarf with changing colors based on emotional status is a good solution to express feelings with comfort and wearing it might enhance social engagement.
Keywords:
wearable technology, design process, emotion recognition, Internet of Things (IOT)Downloads
References
D. Schnelle-Walka et al., "Proceedings of the 1st Joint Workshop on Smart Connected and Wearable Things 2016," IOWIT, 2016.
R. Rakshit, V. R. Reddy, and P. Deshpande, "Emotion detection and recognition using HRV features derived from photoplethysmogram signals," in Proceedings of the 2nd workshop on Emotion Representations and Modelling for Companion Systems, New York, NY, USA, Aug. 2016, Art. no. 2. DOI: https://doi.org/10.1145/3009960.3009962
F. John Dian, R. Vahidnia, and A. Rahmati, "Wearables and the Internet of Things (IoT), Applications, Opportunities, and Challenges: A Survey," IEEE Access, vol. 8, pp. 69200–69211, 2020. DOI: https://doi.org/10.1109/ACCESS.2020.2986329
S. Javed, S. Ghazala, and U. Faseeha, "Perspectives of Heat Stroke Shield: An IoT based Solution for the Detection and Preliminary Treatment of Heat Stroke," Engineering, Technology & Applied Science Research, vol. 10, no. 2, pp. 5576–5580, Apr. 2020. DOI: https://doi.org/10.48084/etasr.3274
B. M. Appelhans and L. J. Luecken, "Heart Rate Variability as an Index of Regulated Emotional Responding," Review of General Psychology, vol. 10, no. 3, pp. 229–240, Sep. 2006. DOI: https://doi.org/10.1037/1089-2680.10.3.229
A. Dzedzickis, A. Kaklauskas, and V. Bucinskas, "Human Emotion Recognition: Review of Sensors and Methods," Sensors, vol. 20, no. 3, Jan. 2020, Art. no. 592. DOI: https://doi.org/10.3390/s20030592
R. L. Peiris, M. J. Tharakan, N. Fernando, and A. D. Chrok, "AmbiKraf: A Nonemissive Fabric Display for Fast Changing Textile Animation," in 2011 IFIP 9th International Conference on Embedded and Ubiquitous Computing, Melbourne, VIC, Australia, Jul. 2011, pp. 221–228. DOI: https://doi.org/10.1109/EUC.2011.13
Y.-J. Lee and J. Lee, "The development of an emotion model based on colour combinations," International Journal of Consumer Studies, vol. 30, no. 2, pp. 122–136, 2006. DOI: https://doi.org/10.1111/j.1470-6431.2005.00457.x
S. Kobayashi, A book of colors: Matching colors, combining colors, color designing, color decorating. Kodansha, 1987.
J. Maeda, The Laws of Simplicity. Cambridge, MA, USA: MIT Press, 2020.
V. G. Motti and K. Caine, "Human Factors Considerations in the Design of Wearable Devices," Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 58, no. 1, pp. 1820–1824, Sep. 2014. DOI: https://doi.org/10.1177/1541931214581381
M. T. Quazi, "Human emotion recognition using smart sensors," M.S. thesis, Massey University, Palmerston North, New Zealand, 2012.
S. Xefteris, N. Doulamis, V. Andronikou, T. Varvarigou, and G. Cambourakis, "Behavioral Biometrics in Assisted Living: A Methodology for Emotion Recognition," Engineering, Technology & Applied Science Research, vol. 6, no. 4, pp. 1035–1044, Aug. 2016. DOI: https://doi.org/10.48084/etasr.634
G. Kaur and P. S. Pandey, "Emotion Recognition System using IOT and Machine Learning - A Healthcare Application," in Proceedings of the 23rd Conference of Open Innovations Association FRUCT, Helsinki, Uusimaa, FIN, Aug. 2018, pp. 465–470.
S. Zafar, G. Miraj, R. Baloch, D. Murtaza, and K. Arshad, "An IoT Based Real-Time Environmental Monitoring System Using Arduino and Cloud Service," Engineering, Technology & Applied Science Research, vol. 8, no. 4, pp. 3238–3242, Aug. 2018. DOI: https://doi.org/10.48084/etasr.2144
Downloads
How to Cite
License
Copyright (c) 2023 Wafa Almukadi
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
