Evaluating ANN efficiency in recognizing EEG and eye-tracking evoked potentials in visual-game-events

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

EEG and Eye-tracking signals have customarily been analyzed and inspected visually in order to be correlated to the controlled stimuli. This process has proven to yield valid results as long as the stimuli of the experiment are under complete control (e.g.: the order of presentation). In this study, we have recorded the subject’s electroencephalogram and eye-tracking data while they were exposed to a 2D platform game. In the game we had control over the design of each level by choosing the diversity of actions (i.e. events) afforded to the player. However we had no control over the order in which these actions were undertaken. The psychophysiological signals were synchronized to these game events and used to train and test an artificial neural network in order to evaluate how efficiently such a tool can help us in establishing the correlation, and therefore differentiating among the different categories of events. The highest average accuracies were between 60.25%–72.07%, hinting that it is feasible to recognize reactions to complex uncontrolled stimuli, like game events, using artificial neural networks.
Original languageEnglish
Title of host publicationAdvances in Neuroergonomics and Cognitive Engineering : Proceedings of the AHFE 2017 International Conference on Neuroergonomics and Cognitive Engineering, July 17–21, 2017, The Westin Bonaventure Hotel, Los Angeles, California, USA
EditorsCarryl Baldwin
Number of pages13
Place of PublicationCham
PublisherSpringer
Publication date2018
Pages262-274
ISBN (Print)978-3-319-60641-5
ISBN (Electronic) 978-3-319-60642-2
DOIs
Publication statusPublished - 2018
Externally publishedYes

    Research areas

  • Faculty of Science - Artificial neural network, Machine learning, Electroencephalogram, Eye-tracking, Games, Pupillometry, Game events, Psychophysiology

Links

ID: 315572724