Understanding How Humans Learn in Uncertain Environments
Author Information
Author(s): Payzan-LeNestour Elise, Bossaerts Peter
Primary Institution: University of New South Wales
Hypothesis
What are the implications of Bayesian learning for human appreciation of uncertainty in changing reward settings?
Conclusion
The study shows that humans can distinguish between different levels of uncertainty and adjust their learning rates accordingly.
Supporting Evidence
- Humans approach learning using Bayesian updating rather than model-free reinforcement algorithms.
- Participants were unaware of unexpected uncertainty and failed to acquire the right model for Bayesian updating.
- Neural evidence suggests that humans can distinguish between different types of uncertainty.
Takeaway
This study is about how people learn when things change unexpectedly, and it shows that we can tell when things are uncertain and adjust how we learn.
Methodology
Participants engaged in a six-arm restless bandit task where they had to choose between options with varying levels of risk and uncertainty.
Potential Biases
Participants' mental models may have excluded nonstationarity, leading to misattributions of outcomes.
Limitations
Participants often failed to recognize the presence of unexpected uncertainty, which may have affected their learning strategies.
Participant Demographics
Undergraduates from Ecole Polytechnique Fédérale Lausanne.
Statistical Information
P-Value
p<0.05
Statistical Significance
p<0.05
Digital Object Identifier (DOI)
Want to read the original?
Access the complete publication on the publisher's website