An Affective Multi-modal Conversational Agent for Non Intrusive Data Collection from Patients with Brain Diseases

Chloe Chira; Evangelos Mathioudis; Christina Michailidou; Pantelis Agathangelou; Georgia Christodoulou; Ioannis Katakis; Efstratios Kontopoulos; Konstantinos Avgerinakis

doi:10.1007/978-3-031-25581-6_9

An Affective Multi-modal Conversational Agent for Non Intrusive Data Collection from Patients with Brain Diseases

Chloe Chira, Evangelos Mathioudis, Christina Michailidou, Pantelis Agathangelou, Georgia Christodoulou, Ioannis Katakis, Efstratios Kontopoulos, Konstantinos Avgerinakis

Department of Computer Science

CATALINK LIMITED

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

This paper presents Zenon, an affective, multi-modal conversational agent (chatbot) specifically designed for treatment of brain diseases like multiple sclerosis and stroke. Zenon collects information from patients in a non-intrusive way and records user sentiment using two different modalities: text and video. A user-friendly interface is designed to meet users’ needs and achieve an efficient conversation flow. What makes Zenon unique is the support of multiple languages, the combination of two information sources for tracking sentiment, and the deployment of a semantic knowledge graph that ensures machine-interpretable information exchange.

Original language	English
Title of host publication	Chatbot Research and Design - 6th International Workshop, CONVERSATIONS 2022, Revised Selected Papers
Editors	Asbjørn Følstad, Theo Araujo, Symeon Papadopoulos, Effie L.-C. Law, Ewa Luger, Morten Goodwin, Petter Bae Brandtzaeg
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	134-149
Number of pages	16
ISBN (Print)	9783031255809
DOIs	https://doi.org/10.1007/978-3-031-25581-6_9
Publication status	Published - 2023
Event	6th International Workshop on Chatbot Research and Design, CONVERSATIONS 2022 - Amsterdam, Netherlands Duration: 22 Nov 2022 → 23 Nov 2022

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	13815 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	6th International Workshop on Chatbot Research and Design, CONVERSATIONS 2022
Country/Territory	Netherlands
City	Amsterdam
Period	22/11/22 → 23/11/22

Keywords

Brain diseases
Chatbot
Conversational agents
e-Health
Knowledge graph
Sentiment analysis

Access to Document

10.1007/978-3-031-25581-6_9

Cite this

Chira, C., Mathioudis, E., Michailidou, C., Agathangelou, P., Christodoulou, G., Katakis, I., Kontopoulos, E., & Avgerinakis, K. (2023). An Affective Multi-modal Conversational Agent for Non Intrusive Data Collection from Patients with Brain Diseases. In A. Følstad, T. Araujo, S. Papadopoulos, E. L.-C. Law, E. Luger, M. Goodwin, & P. B. Brandtzaeg (Eds.), Chatbot Research and Design - 6th International Workshop, CONVERSATIONS 2022, Revised Selected Papers (pp. 134-149). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13815 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-25581-6_9

Chira, Chloe ; Mathioudis, Evangelos ; Michailidou, Christina et al. / An Affective Multi-modal Conversational Agent for Non Intrusive Data Collection from Patients with Brain Diseases. Chatbot Research and Design - 6th International Workshop, CONVERSATIONS 2022, Revised Selected Papers. editor / Asbjørn Følstad ; Theo Araujo ; Symeon Papadopoulos ; Effie L.-C. Law ; Ewa Luger ; Morten Goodwin ; Petter Bae Brandtzaeg. Springer Science and Business Media Deutschland GmbH, 2023. pp. 134-149 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{7327898c95b9449ba802a90b6af6be6d,

title = "An Affective Multi-modal Conversational Agent for Non Intrusive Data Collection from Patients with Brain Diseases",

abstract = "This paper presents Zenon, an affective, multi-modal conversational agent (chatbot) specifically designed for treatment of brain diseases like multiple sclerosis and stroke. Zenon collects information from patients in a non-intrusive way and records user sentiment using two different modalities: text and video. A user-friendly interface is designed to meet users{\textquoteright} needs and achieve an efficient conversation flow. What makes Zenon unique is the support of multiple languages, the combination of two information sources for tracking sentiment, and the deployment of a semantic knowledge graph that ensures machine-interpretable information exchange.",

keywords = "Brain diseases, Chatbot, Conversational agents, e-Health, Knowledge graph, Sentiment analysis",

author = "Chloe Chira and Evangelos Mathioudis and Christina Michailidou and Pantelis Agathangelou and Georgia Christodoulou and Ioannis Katakis and Efstratios Kontopoulos and Konstantinos Avgerinakis",

note = "Publisher Copyright: {\textcopyright} 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.; 6th International Workshop on Chatbot Research and Design, CONVERSATIONS 2022 ; Conference date: 22-11-2022 Through 23-11-2022",

year = "2023",

doi = "10.1007/978-3-031-25581-6_9",

language = "English",

isbn = "9783031255809",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "134--149",

editor = "Asbj{\o}rn F{\o}lstad and Theo Araujo and Symeon Papadopoulos and Law, {Effie L.-C.} and Ewa Luger and Morten Goodwin and Brandtzaeg, {Petter Bae}",

booktitle = "Chatbot Research and Design - 6th International Workshop, CONVERSATIONS 2022, Revised Selected Papers",

address = "Germany",

}

Chira, C, Mathioudis, E, Michailidou, C, Agathangelou, P, Christodoulou, G, Katakis, I, Kontopoulos, E & Avgerinakis, K 2023, An Affective Multi-modal Conversational Agent for Non Intrusive Data Collection from Patients with Brain Diseases. in A Følstad, T Araujo, S Papadopoulos, EL-C Law, E Luger, M Goodwin & PB Brandtzaeg (eds), Chatbot Research and Design - 6th International Workshop, CONVERSATIONS 2022, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 13815 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 134-149, 6th International Workshop on Chatbot Research and Design, CONVERSATIONS 2022, Amsterdam, Netherlands, 22/11/22. https://doi.org/10.1007/978-3-031-25581-6_9

An Affective Multi-modal Conversational Agent for Non Intrusive Data Collection from Patients with Brain Diseases. / Chira, Chloe; Mathioudis, Evangelos; Michailidou, Christina et al.
Chatbot Research and Design - 6th International Workshop, CONVERSATIONS 2022, Revised Selected Papers. ed. / Asbjørn Følstad; Theo Araujo; Symeon Papadopoulos; Effie L.-C. Law; Ewa Luger; Morten Goodwin; Petter Bae Brandtzaeg. Springer Science and Business Media Deutschland GmbH, 2023. p. 134-149 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13815 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - An Affective Multi-modal Conversational Agent for Non Intrusive Data Collection from Patients with Brain Diseases

AU - Chira, Chloe

AU - Mathioudis, Evangelos

AU - Michailidou, Christina

AU - Agathangelou, Pantelis

AU - Christodoulou, Georgia

AU - Katakis, Ioannis

AU - Kontopoulos, Efstratios

AU - Avgerinakis, Konstantinos

PY - 2023

Y1 - 2023

N2 - This paper presents Zenon, an affective, multi-modal conversational agent (chatbot) specifically designed for treatment of brain diseases like multiple sclerosis and stroke. Zenon collects information from patients in a non-intrusive way and records user sentiment using two different modalities: text and video. A user-friendly interface is designed to meet users’ needs and achieve an efficient conversation flow. What makes Zenon unique is the support of multiple languages, the combination of two information sources for tracking sentiment, and the deployment of a semantic knowledge graph that ensures machine-interpretable information exchange.

AB - This paper presents Zenon, an affective, multi-modal conversational agent (chatbot) specifically designed for treatment of brain diseases like multiple sclerosis and stroke. Zenon collects information from patients in a non-intrusive way and records user sentiment using two different modalities: text and video. A user-friendly interface is designed to meet users’ needs and achieve an efficient conversation flow. What makes Zenon unique is the support of multiple languages, the combination of two information sources for tracking sentiment, and the deployment of a semantic knowledge graph that ensures machine-interpretable information exchange.

KW - Brain diseases

KW - Chatbot

KW - Conversational agents

KW - e-Health

KW - Knowledge graph

KW - Sentiment analysis

UR - http://www.scopus.com/inward/record.url?scp=85148688442&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-25581-6_9

DO - 10.1007/978-3-031-25581-6_9

M3 - Conference contribution

AN - SCOPUS:85148688442

SN - 9783031255809

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 134

EP - 149

BT - Chatbot Research and Design - 6th International Workshop, CONVERSATIONS 2022, Revised Selected Papers

A2 - Følstad, Asbjørn

A2 - Araujo, Theo

A2 - Papadopoulos, Symeon

A2 - Law, Effie L.-C.

A2 - Luger, Ewa

A2 - Goodwin, Morten

A2 - Brandtzaeg, Petter Bae

PB - Springer Science and Business Media Deutschland GmbH

T2 - 6th International Workshop on Chatbot Research and Design, CONVERSATIONS 2022

Y2 - 22 November 2022 through 23 November 2022

ER -

Chira C, Mathioudis E, Michailidou C, Agathangelou P, Christodoulou G, Katakis I et al. An Affective Multi-modal Conversational Agent for Non Intrusive Data Collection from Patients with Brain Diseases. In Følstad A, Araujo T, Papadopoulos S, Law ELC, Luger E, Goodwin M, Brandtzaeg PB, editors, Chatbot Research and Design - 6th International Workshop, CONVERSATIONS 2022, Revised Selected Papers. Springer Science and Business Media Deutschland GmbH. 2023. p. 134-149. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-25581-6_9