Episode 296: The Other CRT

David and Tamler share a few brief thoughts on the election and then raise some questions about Tucker Carlson being attacked by a demon as he slept in the woods with his wife and four dogs (still don’t believe in ghosts, people?). In the main segment we talk about one of the most popular measures in social psychology – the cognitive reflection test (CRT). Originally designed to identify differences in people’s ability to employ reflection (system 2) to override their initial intuition (system 1), this three-item measure has mushroomed into its own industry with researchers linking CRT scores to job performance, religious belief, conspiracy theorizing and more. But what psychological attribute is this test supposed to measure exactly, and how can we determine its validity? And has the dual process system 1/system 2 framework outlived its usefulness? 

Tucker Carlson was totally mauled by a demon and not scratched by his dogs [youtube.com]

Frederick, S. (2005). Cognitive reflection and decision making. Journal of Economic Perspectives, 19(4), 25-42.

Blacksmith, N., Yang, Y., Ruark, G., & Behrend, T. (2018, July). A Validity Analysis of the Cognitive Reflection Test Using an Item-Response-Tree Model. In Academy of Management Proceedings (Vol. 2018, No. 1, p. 18090). Briarcliff Manor, NY 10510: Academy of Management.

Erceg, N., Galić, Z., & Ružojčić, M. (2020). A reflection on cognitive reflection–testing convergent/divergent validity of two measures of cognitive reflection. Judgment and Decision making, 15(5), 741-755.

Meyer, A., & Frederick, S. (2023). The formation and revision of intuitions. Cognition, 240, 105380.