{"id":6383,"date":"2022-04-25T16:16:19","date_gmt":"2022-04-25T20:16:19","guid":{"rendered":"https:\/\/web.colby.edu\/cogblog\/?p=6383"},"modified":"2022-04-27T20:50:34","modified_gmt":"2022-04-28T00:50:34","slug":"the-dunning-kruger-effect-you-probably-dont-know-what-you-dont-know","status":"publish","type":"post","link":"https:\/\/web.colby.edu\/cogblog\/2022\/04\/25\/the-dunning-kruger-effect-you-probably-dont-know-what-you-dont-know\/","title":{"rendered":"The Dunning-Kruger Effect: You (Probably) Don&#8217;t Know What You Don&#8217;t Know"},"content":{"rendered":"\n<figure class=\"wp-block-embed is-type-rich is-provider-twitter wp-block-embed-twitter\"><div class=\"wp-block-embed__wrapper\">\n<blockquote class=\"twitter-tweet\" data-width=\"500\" data-dnt=\"true\"><p lang=\"en\" dir=\"ltr\">One in eight men (12%) say they could win a point in a game of tennis against 23 time grand slam winner Serena Williams <a href=\"https:\/\/t.co\/q0eNBjn7Vu\">https:\/\/t.co\/q0eNBjn7Vu<\/a> <a href=\"https:\/\/t.co\/3InBOWdYwh\">pic.twitter.com\/3InBOWdYwh<\/a><\/p>&mdash; YouGov (@YouGov) <a href=\"https:\/\/twitter.com\/YouGov\/status\/1149699495002853376?ref_src=twsrc%5Etfw\">July 12, 2019<\/a><\/blockquote><script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script>\n<\/div><figcaption>This YouGov survey set off a flurry of surprise on Twitter last fall. 1 in 8 men seem to think that they could score a point against Serena Williams!<\/figcaption><\/figure>\n\n\n\n<p>If you spend any time on Twitter, you may have seen a tweet last fall reacting to a YouGov survey. The survey, conducted by the British market research firm YouGov, asked people about their tennis abilities and how they thought they\u2019d perform in a match against Serena Williams. 12% of men surveyed said that if they were playing their very best tennis, they think they\u2019d be able to win a point off of Serena Williams. 12%!!! That\u2019s 1 in 8!! These are average, everyday British men, talking about scoring a point against the tennis player with the most <a href=\"https:\/\/www.statista.com\/statistics\/280390\/female-tennis-players-with-the-most-victories-at-grand-slam-tournaments\/\">Grand<\/a> <a href=\"https:\/\/www.statista.com\/statistics\/263034\/male-tennis-players-with-the-most-victories-at-grand-slam-tournaments\/\">Slam<\/a> titles in their career. In reality, these people would be lucky to even touch one of the balls hit at them by Serena Williams. So why do they have this overinflated sense of their tennis abilities? This is only one example of the Dunning-Kruger effect, a metacognitive idea that influences many aspects of our everyday lives, from wine-tasting to practicing medicine.<\/p>\n\n\n\n<!--more-->\n\n\n\n<p>In 1999, two psychology researchers at Cornell, Justin Kruger and David Dunning, published a paper outlining their recent study. Their research was investigating peoples\u2019 abilities to accurately assess their performance in various tasks, driven by the observed phenomenon that people tend to hold \u201coverly favorable views\u201d of their abilities. This is an example of the \u201c<a href=\"https:\/\/blogs.scientificamerican.com\/scicurious-brain\/the-superiority-illusion-where-everyone-is-above-average\/\">above-average effect<\/a>,\u201d in which people tend to believe that they are <a href=\"https:\/\/www.spring.org.uk\/2021\/07\/above-average-effect.php\">above average<\/a> in their skills. Statistically, this is impossible &#8211; only half of a given population can actually be above average. Participants were evaluated in tasks regarding humor, logical reasoning, and grammar; these evaluations were performed by the participants themselves (self-assessment) and by objective experts.&nbsp;<\/p>\n\n\n\n<p>So, how did people perform in their self-assessment? Were they able to accurately rate their own abilities? Yes, sometimes. It appeared that people who performed in the bottom 25% (according to objective judges\u2019 evaluations) were the ones responsible for most of the above-average self-assessments. In other words, those who performed the worst were most likely to think they did better than average.&nbsp;<\/p>\n\n\n\n<p>WHAT?<\/p>\n\n\n\n<p>This seems like a cruel twist of fate (and metacognition) &#8211; if you\u2019re bad at something, you\u2019re more likely to think you\u2019re good at it. I bet anyone reading this post can think of a time when they encountered someone like this (or maybe, you <em>were <\/em>someone like this). How often have you been in a conversation where the person speaking up the most and appearing the most confident actually has no idea what they\u2019re talking about?&nbsp;<\/p>\n\n\n\n<p>The cause of this miscalculation is not always clear, but Dunning and Kruger argued that people with low competence don\u2019t know enough about the task or skill they\u2019re performing to know that they\u2019re bad at it. In this sense, they don\u2019t even know what they don\u2019t know. Once lower-performing participants were taught how to complete a task correctly and were able to do so, they also showed an increased ability to accurately assess their performance. One way to make people recognize their incompetence was to make them competent (of course, this is a bit of a paradox as they were no longer incompetent).&nbsp;<\/p>\n\n\n\n<p>Since 1999, the Dunning-Kruger effect has been cited in studies on various topics, ranging from wine consumption to financial literacy. Claudio Aqueveque\u2019s recent article, <em>Ignorant Experts and Erudite Novices: Exploring the Dunning-Kruger Effect in Wine Consumers,<\/em> illustrated just how prevalent this cognitive bias is among people buying wine, which has important implications for the wine industry. This study found significant overestimation of one\u2019s wine knowledge in the \u201clowest objective knowledge\u201d group, and, conversely, significant underestimation of wine knowledge in the group with the \u201chighest objective knowledge.\u201d Those with the lowest knowledge were likely to overestimate their knowledge, while those with the most knowledge were likely to underestimate it.&nbsp;<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/lh3.googleusercontent.com\/kBf5E8GwnJZlGvsD5d4NSv7aobiLPvV4QtHzd1qLZnJxMNsziWo7E8Jyn1jNE6nGoD0bezX-PlZ4RUJQcDNAkIJNsZTo7zj10p3OoLV6Cfy7lMvwdeRNo2urbre65K6jyVc77cm7\" alt=\"\" \/><figcaption>Michael Scott really thought he knew a lot about wine, but got &#8220;aftertaste&#8221; and &#8220;afterbirth&#8221; mixed up. Kinda gross! Source: <a href=\"https:\/\/www.pinterest.com\/elowinsilver\/the-office\/\">https:\/\/www.pinterest.com\/elowinsilver\/the-office\/<\/a><\/figcaption><\/figure><\/div>\n\n\n\n<p>So what does this mean for us? Should we assume that no one has any idea what they\u2019re talking about when they mention things like tannins and bouquets? Not necessarily. There are definitely people who can accurately assess their knowledge, though this study suggests that these folks are in the minority. This is more relevant to businesses conducting market research, who need to be aware of consumers\u2019 bias and emphasize objective measures of wine knowledge instead.<\/p>\n\n\n\n<p>Ok, fine. I guess people don\u2019t always understand how much they know about wine. Why should you care?<\/p>\n\n\n\n<p>The Dunning-Kruger effect is not limited to people\u2019s wine knowledge. Students learning chemistry also demonstrated the Dunning-Kruger effect, as outlined by Samuel Pazicni and Christopher F. Bauer in their 2014 study, <em>Characterizing Illusions of Competence in Introductory Chemistry Students. <\/em>Their findings confirm and extend observations of the Dunning-Kruger effect to the college classroom environment, as students with low performance substantially overestimated their knowledge, while those with high performance underestimated their abilities, though to a lesser extent. This may be familiar to you if, like me, you\u2019ve procrastinated studying something because you feel like you already know it pretty well. In reality, you may not know it well at all, so you\u2019re unable to recognize your lack of understanding. Moral of the story: study more than you think you need to!<\/p>\n\n\n\n<p>Pazicni and Bauer found, in addition to the general Dunning-Kruger effect, an interesting gender dynamic in self-assessments. Female students had less inflated self-perceptions than male students did. This gender gap is not specific to introductory chemistry. Vajapey et al reported significant gender differences across students, residents, and faculty in medicine at colleges and hospitals around the world. On average, 75% of men had higher self-confidence than their female peers, even though there was no difference in clinical abilities between men and women. This confidence gap could have further implications for what medical specialties physicians choose. Female doctors, feeling less confident in their abilities, may be less likely to go into \u201charder\u201d specialties like surgery.&nbsp;<\/p>\n\n\n\n<p>Gender differences aside, Davis et al (2006) conducted a systematic review of physicians\u2019 self-assessments, and found that physicians that were the least skilled showed the highest levels of self-confidence, while being the worst at self-assessment. Just like the wine consumers, physicians are vulnerable to falling into the Dunning-Kruger trap. This could have more serious consequences for doctors than wine connoisseurs, though. If you\u2019re undergoing a complicated surgery or facing a difficult disease, you want the most skilled doctors on your care team. However, the people who are likely to speak up and volunteer their opinions may be the ones with the least skills, but the most confidence. Yikes! I\u2019ve known some people like this, who think that watching <em>Grey\u2019s Anatomy <\/em>makes them qualified to give their medical opinion. Yet I trust what they say, because they are confident that they are right. I\u2019m not the only one who does this; <a href=\"https:\/\/www.hrzone.com\/lead\/future\/our-brains-developed-to-be-influenced-by-confident-people#:~:text=It%20seems%20we%20place%20more,of%20others%20when%20making%20decisions.\">people tend to place more value on the opinions of confident people<\/a>. Pairing this cognitive bias with the Dunning-Kruger effect, we end up in a situation where we are trusting the opinions of the people least qualified to give them!<\/p>\n\n\n\n<p>That all sounds like a recipe for disaster. Indeed, lots of dangerous misinformation, <a href=\"https:\/\/web.colby.edu\/cogblog\/2020\/12\/07\/are-you-smarter-than-a-doctor-the-dunning-kruger-effect-and-vaccine-misinformation\/#more-6011\">especially about vaccines<\/a>, has been spread by people with very little knowledge about the things they share. Yet there has been recent evidence suggesting that the Dunning-Kruger effect is not as significant as originally thought.&nbsp;<\/p>\n\n\n\n<p>Oh, so does this mean that people are actually better at self-assessment than Dunning and Kruger proposed?<\/p>\n\n\n\n<p>Unfortunately, no. In fact, it\u2019s sort of the opposite. While Dunning and Kruger theorized that those with low competence at tasks are also the worst at evaluating their performance on these tasks, recent studies have shown that people tend to be equally bad at self-assessing their abilities. The best performers are just as likely to misjudge their competence as the worst performers. In their 2006 paper, Burson, Larrick, and Klayman illustrated that the \u201cskilled and unskilled\u201d are similarly unable to judge their performance relative to others with accuracy. The direction of the miscalibration is actually related to the difficulty of the task being performed, not just the person\u2019s abilities. When asked to perform tasks that appear easy, poor performers are more likely to overestimate their abilities, while good performers can assess their skills more accurately. The converse is also true; with a difficult task, good performers are more likely to underestimate their performance, while poor performers are more perceptive of their skills.&nbsp;<\/p>\n\n\n\n<p>Ok, this makes sense. When facing a hard task, we\u2019re able to recognize our shortcomings. But when easily completing a simpler task, our perceptions of our skills are overinflated. If something comes to us easily, we are likely to think that it\u2019s because we are better than others, not because the task is inherently easier.&nbsp;<\/p>\n\n\n\n<p>Not gonna lie, this is a bit disappointing. We\u2019re not as good at things as we think we are. Bummer. However, if you look at it another way, we\u2019re all equally misled about our performance. If I\u2019m really bad at something, I\u2019m just as likely to misjudge my abilities as someone who\u2019s really good at it. In general, people don\u2019t really have a good idea of their own <a href=\"https:\/\/blog.hubspot.com\/marketing\/dunning-kruger\">abilities<\/a>, regardless of their skill level.&nbsp;<\/p>\n\n\n\n<p>So what does this mean for everyday life? Should we assume that no one has an accurate idea of their skills? Yes, sometimes. A safer approach would be to question what people tell you, and seek input from multiple sources. Don\u2019t just believe someone because they seem confident in their information. People who are more confident may just be more misinformed!&nbsp;<\/p>\n\n\n\n<p>Even if the Dunning-Kruger effect is not as dramatic as originally thought, we should approach new information with a healthy degree of skepticism. People tend to believe that the information they receive is true, even though the people reporting it are as equally susceptible to misinformation as the rest of us. Being aware of this bias is <a href=\"https:\/\/web.colby.edu\/cogblog\/2019\/11\/26\/if-youre-reading-this-youre-still-biased\/\">a good first step towards counteracting it<\/a>.&nbsp;<\/p>\n\n\n\n<p>What\u2019s the takeaway here? Good question! I hope that reading this has helped you learn more about the Dunning-Kruger effect and its impact on everyday life, as well as the limitations of Dunning and Kruger\u2019s work. Don\u2019t worry too much about your self-assessment skills if you\u2019re bad at something &#8211; chances are everyone is equally bad at introspection and self-evaluation! However, this means that everyone is susceptible to overestimating their skills or knowledge, and may confidently report things that really aren\u2019t true.&nbsp;<\/p>\n\n\n\n<p><br>In the Serena Williams survey, men were more likely to think they could score a point. This demonstrates an interesting intersection of the Dunning-Kruger effect and gender biases. As outlined above, in many situations women are more likely to underestimate their abilities while men overestimate theirs, leading to <a href=\"https:\/\/www.forbes.com\/sites\/kathycaprino\/2020\/10\/22\/impostor-syndrome-prevalence-in-professional-women-face-and-how-to-overcome-it\/?sh=59828d0a73cb\">imposter<\/a> <a href=\"https:\/\/www.bbc.com\/worklife\/article\/20200724-why-imposter-syndrome-hits-women-and-women-of-colour-harder\">syndrome<\/a> and decreased confidence. Misjudged self-assessments can lead to misplaced <a href=\"https:\/\/web.colby.edu\/cogblog\/2019\/11\/26\/i-totally-nailed-it-and-i-am-pretty-sure-i-did-better-than-most-people-the-pitfall-of-overconfidence\/\">overconfidence<\/a>, or an underestimation of your abilities. The Dunning-Kruger effect may not be limited to only the worst performers, as everyone is likely to misjudge their skills. However, I can confidently say that Serena Williams is unlikely to give up any points against amateur tennis players, so you may need to reassess if you were thinking you could take her on.<\/p>\n\n\n\n<p class=\"has-text-align-center\">References<\/p>\n\n\n\n<p>Aqueveque, C. (2018). Ignorant Experts and Erudite Novices: Exploring the Dunning-Kruger Effect in Wine Consumers. <em>Food Quality and Preference, <\/em>65: 181-184. <a href=\"https:\/\/doi.org\/10.1016\/j.foodqual.2017.12.007\">https:\/\/doi.org\/10.1016\/j.foodqual.2017.12.007<\/a>&nbsp;<\/p>\n\n\n\n<p>Burson, K.A., Larrick, R.P., &amp; Klayman, J. (2006). Skilled or Unskilled, but Still Unaware of It: How Perceptions of Difficulty Drive Miscalibration in Relative Conceptions. <em>Journal of Personality and Social Psychology, <\/em>90(1): 60-77. <a href=\"http:\/\/dx.doi.org\/10.1037\/0022-3514.90.1.60\">http:\/\/dx.doi.org\/10.1037\/0022-3514.90.1.60<\/a>&nbsp;<\/p>\n\n\n\n<p>Davis, D.A., Mazmanian, P.E., Fordis, M., Van Harrison, R., Thorpe, K.E., &amp; Perrier, L. (2006). Accuracy of Physician Self-Assessment Compared With Observed Measures of Competence: A Systematic Review. <em>JAMA, <\/em>296(9): 1094-1102.<\/p>\n\n\n\n<p>Kruger, J., &amp; Dunning, D. (1999). Unskilled and Unaware of It: How Difficulties in Recognizing One\u2019s Incompetence Lead to Inflated Self-Assessments. <em>Journal of Personality and Social Psychology, <\/em>77(6): 1121-1134.&nbsp;<\/p>\n\n\n\n<p>Pazicni, S., &amp; Bauer, C.F. (2014). Characterizing Illusions of Competence in Introductory Chemistry Students. <em>Chemistry Education Research and Practice, <\/em>15(24): 24-34. <\/p>\n\n\n\n<p>Vajapey, S.P., Weber, K.L., &amp; Balch Samora, J. (2020). Confidence Gap Between Men and Women in Medicine: A Systematic Review. <em>Current Orthopaedic Practice, <\/em>31(5), 494-502.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>If you spend any time on Twitter, you may have seen a tweet last fall reacting to a YouGov survey. The survey, conducted by the British market research firm YouGov, asked people about their tennis abilities and how they thought they\u2019d perform in a match against Serena Williams. 12% of men surveyed said that if [&hellip;]<\/p>\n","protected":false},"author":9918,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"ngg_post_thumbnail":0,"footnotes":""},"categories":[266316,370833],"tags":[266316,266372],"_links":{"self":[{"href":"https:\/\/web.colby.edu\/cogblog\/wp-json\/wp\/v2\/posts\/6383"}],"collection":[{"href":"https:\/\/web.colby.edu\/cogblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/web.colby.edu\/cogblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/web.colby.edu\/cogblog\/wp-json\/wp\/v2\/users\/9918"}],"replies":[{"embeddable":true,"href":"https:\/\/web.colby.edu\/cogblog\/wp-json\/wp\/v2\/comments?post=6383"}],"version-history":[{"count":4,"href":"https:\/\/web.colby.edu\/cogblog\/wp-json\/wp\/v2\/posts\/6383\/revisions"}],"predecessor-version":[{"id":6395,"href":"https:\/\/web.colby.edu\/cogblog\/wp-json\/wp\/v2\/posts\/6383\/revisions\/6395"}],"wp:attachment":[{"href":"https:\/\/web.colby.edu\/cogblog\/wp-json\/wp\/v2\/media?parent=6383"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/web.colby.edu\/cogblog\/wp-json\/wp\/v2\/categories?post=6383"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/web.colby.edu\/cogblog\/wp-json\/wp\/v2\/tags?post=6383"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}