The Multi-Modal Human-Computer Interaction will refer to the interaction of the virtual and the physical environment by making use of the natural modes of communication. These modes will involve the 5 human senses and will imply that the multi-model interaction will enable a more free and natural communication.
Multi-Modal Human-Computer Interaction will refer to the virtual and physical environment by making use of the natural modes of communication.
This will enable the users to interface with the automated systems in both the input and output. These multi-modal systems will specifically offer a flexible, efficient and usable environment that will allow for the users to interact through certain input modalities like speech, handwriting, gestures and gaze. This information will then be received by the …show more content…
While a well-designed multi-modal application can be used by people with a wide variety of impairments, the visually impaired users might have to rely on the voice modality in order to use the application.
2.4. Input Flow
The user’s actions and commands will produce multimodal inputs that will have to be interpreted by the system. This multimodal messages would act as the medium that would enable the communication to exist between the users and the system. This will be obtained by merging the information that are conveyed via several modalities by considering the different types of co-operation between the different modalities. The time relationship that exist between the modalities and the relationships that exist between the chunks of information connected would have to be taken into consideration.
The natural mapping that exist between the multimodal inputs will be provided by several interaction modalities. The information and tasks imply would manage the typical problems of human-human communications that could exist.
2.5. Mode