Citation

Lamba A, Frank MJ, FeldmanHall O. Biol. Psychiatry Cogn. Neurosci. Neuroimaging 2024; ePub(ePub): ePub.

Copyright

(Copyright © 2024, Society of Biological Psychiatry, Publisher Elsevier Publishing)

DOI

10.1016/j.bpsc.2024.07.015

PMID

39069235

Abstract

BACKGROUND: Human learning unfolds under uncertainty. Uncertainty is heterogeneous with different forms exerting distinct influences on learning. While one can be uncertain about what to do to maximize rewarding outcomes, known as policy uncertainty, one can also be uncertain about general world knowledge, known as epistemic uncertainty. In complex and naturalistic environments such as the social world, adaptive learning may hinge on striking a balance between attending to and resolving each type of uncertainty. Prior work illustrates that people with anxiety-those with increased threat and uncertainty sensitivity-learn less from aversive outcomes, particularly as outcomes become more uncertain. How does a learner adaptively trade-off between attending to these distinct sources of uncertainty to successfully learn about their social environment? METHODS: We developed a novel eye-tracking method to capture highly granular estimates of policy and epistemic uncertainty based on gaze patterns and pupil diameter (a physiological estimate of arousal) RESULTS: These empirically derived uncertainty measures reveal that humans (N = 94) flexibly switch between resolving policy and epistemic uncertainty to adaptively learn about which individuals can be trusted and which should be avoided. However, those with increased anxiety (N = 49) do not flexibly switch between resolving policy and epistemic uncertainty, and instead express less uncertainty overall CONCLUSIONS: Combining modeling and eye-tracking techniques, we show that altered learning in people with anxiety emerges from an insensitivity to policy uncertainty and rigid choice policies, leading to maladaptive behaviors with untrustworthy people.

Language: en

Keywords

Bayesian Reinforcement Learning; epistemic uncertainty; generalized anxiety; policy uncertainty; social learning; trust game