In May 2017, the research project ‘M³S – Modern Human-Machine Interface’, funded by the European Regional Development Fund (ERDF), will commence at Rhine-Waal University of Applied Sciences.
As part of the research project ‘M3S – Modern Human-Machine Interface’, work is to be carried out on new, innovative communication technologies based on existing brain-computer interface (BCI) technologies. Brain activity is measured using an electroencephalogram (EEG) and converted into commands in real time with the aid of a brain-machine interface (BMI). This enables even people with physical disabilities to operate a computer using a standard BCI.
BMIs have the potential to become established in various sectors as assistive or even entertainment technologies. To make such systems even more robust, simplify their operation and reduce the training required, the research project ‘M³S – Modern Human-Machine Interface’ aims to combine BMIs with other technologies, such as eye tracking, and to develop a display specifically designed for the BMI system. The aim is to bring this technology to market maturity across various sectors, ranging from the gaming industry to the healthcare market. The team led by Prof. Dr Ivan Volosyak, Professor of Biomedicine and Engineering at Rhine-Waal University of Applied Sciences, specialises in BCIs and BMIs that utilise the normal activities of the human brain.
On conventional screens, several visual stimuli – such as boxes flashing at different constant frequencies – are displayed simultaneously and independently of one another. By simply looking at a specific box, the user can select the desired command; this is because, when looking at it, the brainwaves are modulated at this frequency and the selection is classified in real time as the corresponding command using the recorded EEG.
The University of Bielefeld, as a partner in this research project, is focusing on resource-efficient signal processing to reduce latency whilst ensuring the highest possible precision in calculations. The aim here is to increase user acceptance and usability. In addition, Bielefeld University is working on an intuitive graphical user interface and the integration of the system into a smart home.
Polyoptics GmbH will draw up a requirements profile for the display based on the signal processing requirements as well as medical and legal specifications. This profile will then be implemented in concrete terms as the project progresses to ensure optimal presentation of the content. At the same time, it must be possible to display any frequency with stable frequency to provide the highest possible signal quality for the processing software.
Mediablix-IIT GmbH is responsible for implementing synchronised recording between stationary and mobile EEG and eye-tracking systems within the project, and will provide appropriate classification and analysis methods for the recorded data. The results can be used not only for the real-time conversion of the measured data – taking aspects of attention into account – into commands for controlling various devices (e.g. the volume of a radio), but also to determine which information is relevant or difficult to process for individual test subjects in the respective application scenarios. A further focus lies on system optimisation for different user groups, based on the experience gained in the respective areas of use.
helectronics GmbH will take the lead in the electronic development and construction of demonstrators and prototypes for the smart panel. This task places high demands on interdisciplinary expertise, as the project partners’ products must be successfully networked, whilst the quality of the panel – as the system’s sole actuator – is also of paramount importance for the successful functioning of the overall system. The aim of the development is to control the LED array developed by Polyoptics, which can comprise up to 200 different zones.
The development of these modern human-machine interfaces for various industrial sectors is of great interest. The entertainment and gaming industries in particular, but also the automotive industry and organisations in the healthcare sector, can benefit from such innovative technologies. In addition to hands-free operation of video games, other conceivable application scenarios – such as technical assistance with domestic tasks – are possible.
By the end of the project, the aim is to develop a hybrid control system that can be used with the latest wearable technologies, such as Google Glass, Microsoft HoloLens or Oculus Rift. By combining these with other, already established and market-ready innovations – such as an eye-tracking system and improved signal-processing algorithms – the M³S project aims to resolve the key outstanding issues in BMI technology.
