Risk, Unexpected Uncertainty, and Estimation Uncertainty: Bayesian Learning in Unstable Settings Learning In Restless Bandits
2011

Understanding How Humans Learn in Uncertain Environments

Sample size: 62 publication Evidence: high

Author Information

Author(s): Payzan-LeNestour Elise, Bossaerts Peter

Primary Institution: University of New South Wales

Hypothesis

What are the implications of Bayesian learning for human appreciation of uncertainty in changing reward settings?

Conclusion

The study shows that humans can distinguish between different levels of uncertainty and adjust their learning rates accordingly.

Supporting Evidence

  • Humans approach learning using Bayesian updating rather than model-free reinforcement algorithms.
  • Participants were unaware of unexpected uncertainty and failed to acquire the right model for Bayesian updating.
  • Neural evidence suggests that humans can distinguish between different types of uncertainty.

Takeaway

This study is about how people learn when things change unexpectedly, and it shows that we can tell when things are uncertain and adjust how we learn.

Methodology

Participants engaged in a six-arm restless bandit task where they had to choose between options with varying levels of risk and uncertainty.

Potential Biases

Participants' mental models may have excluded nonstationarity, leading to misattributions of outcomes.

Limitations

Participants often failed to recognize the presence of unexpected uncertainty, which may have affected their learning strategies.

Participant Demographics

Undergraduates from Ecole Polytechnique Fédérale Lausanne.

Statistical Information

P-Value

p<0.05

Statistical Significance

p<0.05

Digital Object Identifier (DOI)

10.1371/journal.pcbi.1001048

Want to read the original?

Access the complete publication on the publisher's website

View Original Publication