Cyril Crocquesel on the Diamond touch table.

Article by Émile Verdurand (PhD student), Gilles Coppin (professor), d’Olivier Grisvard (research engineer) Lussi and Franck Poirier. During the “Rencontres des jeunes chercheurs en intelligence artificielle” May 2009, several articles were presented. This article was selected for publication as an extended version in “Revue d’intelligence artificielle”. Research was carried out in the Atol laboratory in Brest.

Summary : This work is situated in the field of human-computer interaction (HCI). It largely concerns evaluation of the functional adequacy and performance of HCI multi-modals in an interaction situation. Namely, a task to be accomplished, a user and a context or environmental constraints (space available, luminosity, noise, vibrations…). This means defining a modeling framework for all the parameters to be taken into account in order to evaluate the usability (software ergonomy) of a multi-modal HCI (associating gesture on a tactile surface and voice command, for example) and to define measuring methods founded on the modelisation proposed, which will permit the performance of the users of such HCI to be evaluated. The aim is to be able to formally compare interaction modalities or combinations of modalities in relation to their use and the operating task, so as to predict the usability of a multi-modal HCI choice and to demonstrate the pertinence of this choice. One of the interests of such an evaluation is to look into the causes of bad modality adequacy and not its consequences (time of operation, number of errors, for example)./–/ Experimentation with users was carried out with an airborne maritime surveillance application developed by Thales. A field in which the operational evaluation of HCI, even in the sphere of rapid prototyping, remains expensive and is very complex. Various interfaces were developed for this, using among other things a touch table, an eye-tracking device, an infra red gesture detection system (wiimote), and voice recognition

Keywords : multimodal interaction, modeling, evaluation, modality, interaction language, adequacy for task.

Reference : Émile Verdurand, Gilles Coppin, Franck Poirier, Olivier Grisvard. Modélisation ét évaluation de l’interaction dans les systèmes multimodaux. Revue d’intelligence artificielle. April 2010. Vol. 24, n°2. Pages 227-255.

See the reference in base des publications de l’École or on Hal