It’s easy to imagine that emotion gets in the way of the most difficult decisions. Get rid of this cumbersome human artefact and surely people would be able to make cold, calculating choices in the most exacting of situations.
Not so. Decision-making turns out to be more complex than this. Neuroscientists have long studied people with brain injuries that prevent them experiencing emotions. But instead of being precise, ruthless killers, these people are paralysed by indecision.
The truth is that when it comes to everyday choices—deciding between cheese or ham in your sandwich, for example--it doesn’t matter how much cold hard logic you bring to bear; these decisions are ultimately emotional.
But what of more detailed calculations like those involved in mathematics or chess? Surely, they can’t be governed by famously fickle human emotion?
Actually they can, say Thomas Guntz at the University of Grenoble in France and a few colleagues. . These guys have measured the changes in emotional state experienced by chess players as they tackle increasingly difficult problems. And they say that emotions play a key role in helping players solve complex problems.
The ability to automatically measure changes in human emotional states has advanced in leaps in bounds in recent years. Changes in pupil size are an indicator of concentration levels. Heart rate is a measure of arousal and can be monitored by looking for changes in facial skin colour.
Body posture and gestures are also an indicator of emotional changes and these too are straightforward to monitor with 3D cameras such as the Kinect. All this can be correlated with the object of a person’s attention as measured by head orientation and eye gaze.
Together, these indicators provide a comprehensive overview of an individual’s emotional state and how it changes from moment to moment.
Guntz and co have turned this powerful gaze onto the emotion state of 30 expert and intermediate chess players as they solve increasingly challenging chess puzzles. Each puzzle required the player to check mate an opponent. Puzzles that can be solved in 1-3 moves are considered easy while those that require 4-6 moves considered challenging.
As the players tackled each problem, the team recorded changes in gaze, body posture, cardiac rhythm, facial expression and so on. They then used this data to infer how each player’s emotional state changed during the task.
For example, the player’s basic emotional state--happiness, sadness, anger, fear, disgust and surprise--can be judged from his or her microexpressions; changes in cardiac rhythm suggest changes in arousal; and the rate of self-touching is a measure of stress.
It’s easy to imagine that these problem-solving tasks are largely devoid of emotion. But Guntz and co found otherwise. “[Our results] revealed an unexpected observation of rapid changes in emotion as players attempt to solve challenging problems,” they say.
For this reason, the team think emotions must play a role in the decision-making process. “Our current hypothesis is that the rapid changes in emotion are an involuntary display in reaction to recognition of previously encountered situations during exploration of the game state,” they say.
This must play a crucial role in pruning the decision tree of potential moves, think Guntz and co. The way advanced chess players do this pruning is very different from beginners. Over time, expert players learn to recognise certain patterns of play or positions of strength and weakness.
This pattern recognition significantly simplifies the process of deciding on the next move. Instead of considering all the pieces separately, the top players consider them in groups called chunks. Top players are thought to store up to 100,000 of these chunks in their long-term memories. When playing a game, they transfer these chunks into their short-term memory, where the reasoning takes place.
And that’s where players ought to run into trouble. There is a well known limit on the amount of information that humans can store in their short term memory. Back in the 1960s, the American psychologist George Miller showed that we can store between 5 and 9 chunks in our short term memory. Beyond that, we are overwhelmed.
So how do chess players manage 100,000 chunks when they can only hold a handful in their working memory at any one time?
They use emotion, say Guntz and co. When a player spots a chunk he or she has seen before, the valence associated with it causes it to be brought to the fore for further analysis or rejected as a bad option.
In this way, top players use emotion to move relevant chunks from long term memory to the short term and back again. And it is this change in emotional state that the team are able to record.
That’s a fascinating result that has huge implications for our understanding of human decision-making and for machine intelligence in general. Guntz and co are careful to temper their result with the suggestion that their work is still in its early stages and more needs to be done.
But it provides a curious new way to think about the problem of decision-making and how machines could do it more effectively. Until now, machines have mainly used increasingly powerful computational resources to make decisions. That effectively strangles the mystery out of problems like chequers, chess and more recently Go.
But ask them to choose between ham and cheese in a sandwich and they’re stumped.
Emotions clearly provide some kind of indexing system that allows us to access certain memories more quickly. Understanding how that works and how it can be applied to machines is an important goal.
Ref: arxiv.org/abs/1810.11094 : The Role of Emotion in Problem Solving: First Results from Observing Chess
