Assessing Mulsemedia Authoring Application Based on Events With STEVE 2.0

Abstract

The concept of Multiple Sensorial Media (mulsemedia) has been explored to enhance user experiences by engaging different senses beyond sight and hearing. The growing demand for developing such applications has led to various studies focusing on the mulsemedia authoring process. However, there remains a significant gap in accessible methods for developing these applications. This article addresses this issue by assessing an event-based approach to mulsemedia creation. We implemented this approach in the graphical authoring tool STEVE 2.0, which enables users to develop mulsemedia applications by defining event-based temporal relationships that synchronize traditional media with sensory effects. Additionally, STEVE 2.0 allows for the configuration of media presentation and sensory effect rendering properties. To assess the usability, features, and user experience of the tool, we conducted experiments with 44 participants. The results show that STEVE 2.0 effectively empowers users to create mulsemedia applications. Furthermore, we discuss the integration of STEVE 2.0 with other multimedia technologies used for interactive digital TV, underscoring the importance of comprehensive platforms that support the entire life cycle of these applications, from production to distribution and rendering.