VEO-engine: Interfacing and reasoning with an emotion ontology for device visual expression

Muhammad Amith, Rebecca Lin, Chen Liang, Yang Gong, Cui Tao

Research output: Chapter in Book/Report/Conference proceedingConference contribution


In order for machines to understand or express emotion to users, the specific emotions must be formally defined and the software coded to how those emotions are to be expressed. This is particularly important if devices or computer-based tools are utilized in clinical settings, which may be stressful for patients and where emotions can dominate their decision making. We have reported our development and feasibility results of an ontology, Visualized Emotion Ontology (VEO), that links abstract visualizations that express specific emotions. Here, we used VEO with the VEO-Engine, a software API package that interfaces with the VEO. The VEO-Engine was developed in Java using Apache Jena and OWL-API. The software package was tested on a Raspberry Pi machine with a small touchscreen display that linked each visualization to an emotion. The VEO-Engine stores input parameters of emotional situations and valences to reason and interpret users’ emotions using the ontology-based reasoner. With this software, devices can interfaced wirelessly, so smart devices with visual displays can interact with the ontology. By means of the VEO-Engine, we show the portability and usability of the VEO in human-computer interaction.

Original languageEnglish (US)
Title of host publicationHCI International 2018 – Posters’ Extended Abstracts - 20th International Conference, HCI International 2018, Proceedings
EditorsConstantine Stephanidis
PublisherSpringer Verlag
Number of pages7
ISBN (Print)9783319922782
StatePublished - 2018
Externally publishedYes
Event20th International Conference on HCI, HCI International 2018 - Las Vegas, United States
Duration: Jul 15 2018Jul 20 2018

Publication series

NameCommunications in Computer and Information Science
ISSN (Print)1865-0929


Conference20th International Conference on HCI, HCI International 2018
Country/TerritoryUnited States
CityLas Vegas


  • Affective computing
  • Emotions
  • Ontology
  • Semantic web
  • mHealth

ASJC Scopus subject areas

  • General Computer Science
  • General Mathematics


Dive into the research topics of 'VEO-engine: Interfacing and reasoning with an emotion ontology for device visual expression'. Together they form a unique fingerprint.

Cite this