Kevin O’Neill @kevingoneill.github.io · May 1 1 / 2
Following a signal detection theoretic model of confidence ratings, we designed a new measure based on how much more evidence people need to make a response with high (vs low) confidence. It's easy to compute in an already standard workflow for metacognition research and has none of the confounds!
1 likes 1 replies
?
Replies
We then wanted to validate the measure in two ways. First, we found that under model misspecification, our measure is just as confounded as mean confidence. This is not ideal, but reflects similar findings that other measures of metacognitive performance are sensitive to modeling assumptions