The Influence of Markov Decision Process Structure on Memory Systems
Author Information
Author(s): Eric A. Zilli, Michael E. Hasselmo
Primary Institution: Center for Memory and Brain, Boston University
Hypothesis
How does the structure of Markov decision processes affect the strategic use of working memory and episodic memory?
Conclusion
The analysis provides a quantitative description of memory states that can inform decision-making in behavioral tasks.
Supporting Evidence
- The analysis provides a framework for understanding memory mechanisms in decision-making.
- Results align with previous quantitative simulations of memory tasks.
- Mathematical procedures can evaluate memory demands in various behavioral tasks.
Takeaway
This study looks at how different types of memory help us make decisions in tasks, using math to explain it.
Methodology
The study uses mathematical analysis of partially-observable Markov decision processes to evaluate memory demands in behavioral tasks.
Limitations
The results are primarily theoretical and may not directly apply to agents performing tasks in real-world scenarios.
Digital Object Identifier (DOI)
Want to read the original?
Access the complete publication on the publisher's website