Deep Learning-Based Sentiment Detection for mHealth Platforms Using Facial and Textual Cues

Prof. Madhu Kalyan

Abstract


We introduce a hybrid deep learning model that integrates facial emotion recognition with text-based sentiment analysis for mHealth platforms. By processing both visual and textual data, the system enhances the emotional understanding of the patient’s state. The study evaluates model accuracy and real-world applicability in mobile health scenarios.

References


Calvo, R. A., D'Mello, S., Gratch, J., & Kappas, A. (2015). The Oxford handbook of affective computing. Oxford University Press.

Corcoran, P., & Carr, D. (2019). AI in the detection of emotion in facial expressions. IEEE Transactions on Consumer Electronics, 65(1), 75-83. https://doi.org/10.1109/TCE.2019.2892218

Pillai, S. E. V. S., ElSaid, A. A., & Hu, W. C. (2022, May). A Self-Reconfigurable System for Mobile Health Text Misinformation Detection. In 2022 IEEE International Conference on Electro Information Technology (eIT) (pp. 242-247). IEEE.

Kalla, D., Smith, N., Samaah, F., & Polimetla, K. (2021). Facial Emotion and Sentiment Detection Using Convolutional Neural Network. Indian Journal of Artificial Intelligence Research (INDJAIR), 1(1), 1-13.

Ekman, P., & Friesen, W. V. (2003). Unmasking the face: A guide to recognizing emotions from facial expressions. Malor Books.

Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep learning. MIT Press.

Hinton, G., & Salakhutdinov, R. (2006). Reducing the dimensionality of data with neural networks. Science, 313(5786), 504-507. https://doi.org/10.1126/science.1127647

Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9(8), 1735-1780. https://doi.org/10.1162/neco.1997.9.8.1735

Ko, B. C. (2018). A brief review of facial emotion recognition based on visual information. Sensors, 18(2), 401. https://doi.org/10.3390/s18020401

LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436-444. https://doi.org/10.1038/nature14539

Liu, B., & Zhang, L. (2012). A survey of opinion mining and sentiment analysis. Mining Text Data, 415-463. https://doi.org/10.1007/978-1-4614-3223-4_13

McDuff, D., & El Kaliouby, R. (2015). Applications of automatic facial coding in media measurement. IEEE Transactions on Affective Computing, 6(2), 190-202. https://doi.org/10.1109/TAFFC.2015.2445334

Mehrabian, A. (1971). Silent messages: Implicit communication of emotions and attitudes. Wadsworth Publishing Company.


Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 International Journal of Sustainable Development in Computing Science

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

A Double-Blind Peer Reviewed Journal