{"id":708,"date":"2022-08-26T16:26:59","date_gmt":"2022-08-26T23:26:59","guid":{"rendered":"https:\/\/blogs.reed.edu\/compbio\/?p=708"},"modified":"2022-08-26T16:26:59","modified_gmt":"2022-08-26T23:26:59","slug":"gendered-evaluations","status":"publish","type":"post","link":"https:\/\/blogs.reed.edu\/compbio\/2022\/08\/26\/gendered-evaluations\/","title":{"rendered":"Gendered Evaluations"},"content":{"rendered":"\n<p>Hi, my name is Alex Richter (she\/her). I am a recent graduate from Reed College and post bac researcher with Anna Ritz. This is my second summer doing research with Anna Ritz. The project of this summer dealt with letters of recommendation and the role of gendered words\/phrases. <\/p>\n\n\n\n<p><strong>The Problem<\/strong><\/p>\n\n\n\n<p>There are certain words and ways of describing people that appear in letters of recommendation that are gendered. These issues are implicit and occur regardless of the race, gender, or ethnicity of the writer. This issues leads to a disparity of women in specific fields due to the importance of letters of recommendation in graduate school acceptances and hiring.<\/p>\n\n\n\n<p>A very easy example is that women are more likely to be praised in letters of recommendation for their communication or being nice. Men on the other hand are likely to be praised on their ability to do a task or a skill that is relevant to the position. It should also be noted that most of the research in this topic deals with a gender binary of just men and women. Our work tries to avoid the binary by focusing on pronouns, but it should be noted that in discussing this topic phrases such as \u201cMale vs Female\u201d or &#8220;Man vs Woman&#8221; are common place.<\/p>\n\n\n\n<p><strong>Why does it matter?<\/strong><\/p>\n\n\n\n<p>Letters of recommendation are important as they allow a better insight into a persons\u2019 character. It is an important factor in hiring a candidate or accepting a candidate into any program. It shows more than just the accomplishments but speaks to who the individual is and how they are perceived by someone who knows them.<\/p>\n\n\n\n<p>This work matters especially at Reed because of the emphasis we put on letters of recommendation. Notoriously, Reed does not give out grades unless requested and while transcripts with letter grades exist the letter grade concept is de-emphasized here. Reed focuses on quality and understanding as opposed to emphasizing grades. As stated in the<a href=\"https:\/\/www.reed.edu\/registrar\/pdfs\/grades-at-reed.pdf\"> letter that accompanies<\/a> all transcripts, \u201cSince its founding, Reed College has adhered to a distinctive educational philosophy, a critical component of which is the evaluation and grading of student academic work.\u201d<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"935\" src=\"https:\/\/blogs.reed.edu\/compbio\/files\/2022\/08\/image-2-1024x935.png\" alt=\"\" class=\"wp-image-709\" srcset=\"https:\/\/blogs.reed.edu\/compbio\/files\/2022\/08\/image-2-1024x935.png 1024w, https:\/\/blogs.reed.edu\/compbio\/files\/2022\/08\/image-2-300x274.png 300w, https:\/\/blogs.reed.edu\/compbio\/files\/2022\/08\/image-2-768x701.png 768w, https:\/\/blogs.reed.edu\/compbio\/files\/2022\/08\/image-2-1200x1095.png 1200w, https:\/\/blogs.reed.edu\/compbio\/files\/2022\/08\/image-2.png 1332w\" sizes=\"auto, (max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><figcaption>Screenshot of PDF included with Reed transcripts to highlight grading policy <\/figcaption><\/figure><\/div>\n\n\n<p><strong>The Pre-Existing Work<\/strong><\/p>\n\n\n\n<p>In 2018, there was a project done by a graduate student named Mollie Marr and  other collaborators. The repository for this project can be found <a href=\"https:\/\/github.com\/gender-bias\/gender-bias\">here<\/a>. This work entailed writing detectors that could be run in order to see if specific words were present in letters of recommendation. There were many detectors that were written by multiple developers. Each detector had been extensively researched and was backed by various publications.<\/p>\n\n\n\n<p>The preexisting detectors that were implemented or suggested:<br>&#8211; <mark style=\"background-color:#e5e5e5\" class=\"has-inline-color has-dark-gray-color\">Female Detector \/ Male Detector:<\/mark><mark style=\"background-color:#fff\" class=\"has-inline-color has-dark-gray-color\"> <\/mark>Identifies gendered female or male terms respectively.<br>&#8211; <mark style=\"background-color:#e5e5e5\" class=\"has-inline-color has-dark-gray-color\">Gendered Words Detector:<\/mark> Identifies whether the gender of the candidate is being brought to attention unnecessarily.<br>&#8211; <mark style=\"background-color:#e5e5e5\" class=\"has-inline-color has-dark-gray-color\">Personal Life Detector:<\/mark> Letters of recommendation for women are more likely to mention facts about their personal life.<br>&#8211; <mark style=\"background-color:#e5e5e5\" class=\"has-inline-color has-dark-gray-color\">Publication Detector:<\/mark> Letters of recommendation for women are less likely to mention publications and projects.<br>&#8211; <mark style=\"background-color:#e5e5e5\" class=\"has-inline-color has-dark-gray-color\">Effort (vs Accomplishment) Detector:<\/mark> This one is from a very impactful paper in this topic by Trix and Psenka. Women are more likely to be described using effort words while men are more likely to be described as accomplished or having an innate ability to do the task required.<br>&#8211; <mark style=\"background-color:#e5e5e5\" class=\"has-inline-color has-dark-gray-color\">Superlative Detector:<\/mark> Letters for women are less likely to contain superlatives. If they do, they usually describe women in the context of emotional terms.<br>&#8211; <mark style=\"background-color:#e5e5e5\" class=\"has-inline-color has-dark-gray-color\">Conditional Superlative Detector:<\/mark> This deals with superlatives that are \u201chedged\u201d by restricting the population to only women.<\/p>\n\n\n\n<p>The summer work for this project is dealing primarily with implementing more detectors and making this into an easily accessible resource for people. Future work would deal with creating a google docs or Microsoft word plug in or website. A major issue in this work has been dealing with the lack of a cohesive data set of letters of recommendation. This is due to the difficulty in anonymizing letters of recommendation.<\/p>\n\n\n\n<p>Below is a list of citations that was included in the genderbias repository for any desired future inquiry into this problem.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><em><strong>Publications, Projects, and Research<\/strong><\/em><br>Trix, F. &amp; Psenka, C., &#8220;Exploring the color of glass: Letters of recommendation for female and male medical faculty,&#8221; Discourse &amp; Society 14(2003): 191-220. <\/p>\n\n\n\n<div class=\"wp-block-group is-vertical is-layout-flex wp-container-core-group-is-layout-8cf370e7 wp-block-group-is-layout-flex\">\n<p><\/p>\n\n\n\n<p><strong><em>Superlatives<\/em><\/strong><br>Dutt, K., Pfaff, D. L., Bernstein, A. F., Dillard, J. S., &amp; Block, C. J. (2016). Gender differences in recommendation letters for postdoctoral fellowships in geoscience. Nature Geoscience, 9(11), 805. <\/p>\n\n\n\n<p><br>Schmader, T., Whitehead, J., &amp; Wysocki, V. H. (2007). A linguistic comparison of letters of recommendation for male and female chemistry and biochemistry job applicants. Sex Roles, 57(7-8), 509-514. <\/p>\n<\/div>\n\n\n\n<p><\/p>\n\n\n\n<p><strong><em>Nouns<\/em><\/strong><br>Trix, F. &amp; Psenka, C., &#8220;Exploring the color of glass: Letters of recommendation for female and male medical faculty,&#8221; Discourse &amp; Society 14(2003): 191-220. <\/p>\n\n\n\n<div class=\"wp-block-group is-vertical is-layout-flex wp-container-core-group-is-layout-8cf370e7 wp-block-group-is-layout-flex\">\n<p><\/p>\n\n\n\n<p><strong><em>Minimal Assurance<\/em><\/strong><br>Isaac, C., Chertoff, J., Lee, B., &amp; Carnes, M. (2011). Do students\u2019 and authors\u2019 genders affect evaluations? A linguistic analysis of medical student performance evaluations. Academic Medicine, 86(1), 59. <\/p>\n\n\n\n<p><br>Trix, F. &amp; Psenka, C., &#8220;Exploring the color of glass: Letters of recommendation for female and male medical faculty,&#8221; Discourse &amp; Society 14(2003): 191-220. <\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-group is-vertical is-layout-flex wp-container-core-group-is-layout-8cf370e7 wp-block-group-is-layout-flex\">\n<p><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><strong><em>Effort<\/em><\/strong><br>Deaux, K. &amp; Emswiller, T., &#8220;Explanations of successful performance on sex-linked tasks: What is skill for the male is luck for the female,&#8221; Journal of Personality and Social Psychology 29(1974): 80-85 <\/p>\n\n\n\n<p><br>Isaac, C., Chertoff, J., Lee, B., &amp; Carnes, M. (2011). Do students\u2019 and authors\u2019 genders affect evaluations? A linguistic analysis of medical student performance evaluations. Academic Medicine, 86(1), 59.<\/p>\n\n\n\n<p><br>Steinpreis, R., Anders, K.A., &amp; Ritzke, D., &#8220;The impact of gender on the review of the curricula vitae of job applicants and tenure candidates: A national empirical study,&#8221; Sex Roles 41(1999): 509-528 <\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-group is-vertical is-layout-flex wp-container-core-group-is-layout-8cf370e7 wp-block-group-is-layout-flex\">\n<p><\/p>\n\n\n\n<p><strong><em>Personal Life<\/em><\/strong><br>Isaac, C., Chertoff, J., Lee, B., &amp; Carnes, M. (2011). Do students\u2019 and authors\u2019 genders affect evaluations? A linguistic analysis of medical student performance evaluations. Academic Medicine, 86(1), 59. <\/p>\n\n\n\n<p><br>Madera, J. M., Hebl, M. R., &amp; Martin, R. C. (2009). Gender and letters of recommendation for academia: Agentic and communal differences. Journal of Applied Psychology, 94(6), 1591. <\/p>\n\n\n\n<p><br>Trix, F. &amp; Psenka, C., &#8220;Exploring the color of glass: Letters of recommendation for female and male medical faculty,&#8221; Discourse &amp; Society 14(2003): 191-220. <\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-group is-vertical is-layout-flex wp-container-core-group-is-layout-8cf370e7 wp-block-group-is-layout-flex\">\n<p><\/p>\n\n\n\n<p><strong><em>Gender Stereotypes<\/em><\/strong><br>Axelson RD, Solow CM, Ferguson KJ, Cohen MB. Assessing implicit gender bias in Medical Student Performance Evaluations. Eval Health Prof. 2010 Sep;33(3):365-85. <\/p>\n\n\n\n<p><br>Eagly, A.H.; Karau, S.J., &#8220;Role congruity theory of prejudice toward female leaders,&#8221; Psychological Review 109, no. 3 (July 2002): 573-597.; Ridgeway, 2002. <\/p>\n\n\n\n<p><br>Foschi M. Double standards for competence: theory and research. Ann Rev Soc. 2000;26:21\u201342. <\/p>\n\n\n\n<p><br>Gaucher, D., Friesen, J., &amp; Kay, A. C. (2011, March 7). Evidence That Gendered Wording in Job Advertisements Exists and Sustains Gender Inequality. Journal of Personality and Social Psychology. <\/p>\n\n\n\n<p><br>Hirshfield LE. \u2018\u2018She\u2019s not good with crying\u2019\u2019: the effect of gender expectations on graduate students\u2019 assessments of their principal investigators. Gender Educ. 2014;26(6):601\u2013617. <\/p>\n\n\n\n<p><br>Madera, J. M., Hebl, M. R., &amp; Martin, R. C. (2009). Gender and letters of recommendation for academia: Agentic and communal differences. Journal of Applied Psychology, 94(6), 1591. <\/p>\n\n\n\n<p><br>Ross DA, Boatright D, Nunez-Smith M, Jordan A, Chekroud A, Moore EZ (2017) Differences in words used to describe racial and gender groups in Medical Student Performance Evaluations. PLoS ONE 12(8): e0181659.<\/p>\n\n\n\n<p><br>Sprague J, Massoni K. Student evaluations and gendered expectations: what we can\u2019t count can hurt us. Sex Roles. 2005;53(11):779\u2013793.<\/p>\n\n\n\n<p><br>Steinpreis RE, Anders KA, Ritzke D. The impact of gender on the review of the curricula vitae of job applicants and tenure candidates: a national empirical study. Sex Roles. 1999;41(7):509\u2013528. <\/p>\n\n\n\n<p><br>Trix, F. &amp; Psenka, C., &#8220;Exploring the color of glass: Letters of recommendation for female and male medical faculty,&#8221; Discourse &amp; Society 14(2003): 191-220. <\/p>\n\n\n\n<p><br>Wenneras C, Wold A. Nepotism and sexism in peer review. Nature. 1997;387(6631):341\u2013343. <\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-group is-vertical is-layout-flex wp-container-core-group-is-layout-8cf370e7 wp-block-group-is-layout-flex\">\n<p><\/p>\n\n\n\n<p><strong><em>Raise Doubt<\/em><\/strong><br>Trix, F. &amp; Psenka, C., &#8220;Exploring the color of glass: Letters of recommendation for female and male medical faculty,&#8221; Discourse &amp; Society 14(2003): 191-220. <\/p>\n\n\n\n<p><br>Madera, J. M., Hebl, M. R., Dial, H., Martin, R., &amp; Valian, V. (2019). Raising doubt in letters of recommendation for academia: gender differences and their impact. Journal of Business and Psychology, 34(3), 287-303. <\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-group is-vertical is-layout-flex wp-container-core-group-is-layout-8cf370e7 wp-block-group-is-layout-flex\">\n<p><\/p>\n\n\n\n<p><strong><em>Shorter<\/em><\/strong> <strong><em>Length of Letters<\/em><\/strong><br>Dutt, K., Pfaff, D. L., Bernstein, A. F., Dillard, J. S., &amp; Block, C. J. (2016). Gender differences in recommendation letters for postdoctoral fellowships in geoscience. Nature Geoscience, 9(11), 805. <\/p>\n\n\n\n<p><br>Trix, F. &amp; Psenka, C., &#8220;Exploring the color of glass: Letters of recommendation for female and male medical faculty,&#8221; Discourse &amp; Society 14(2003): 191-220. <\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Hi, my name is Alex Richter (she\/her). I am a recent graduate from Reed College and post bac researcher with Anna Ritz. This is my second summer doing research with Anna Ritz. The project of this summer dealt with letters of recommendation and the role of gendered words\/phrases. The Problem There are certain words and &hellip; <a href=\"https:\/\/blogs.reed.edu\/compbio\/2022\/08\/26\/gendered-evaluations\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Gendered Evaluations&#8221;<\/span><\/a><\/p>\n","protected":false},"author":2294,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-708","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/blogs.reed.edu\/compbio\/wp-json\/wp\/v2\/posts\/708","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.reed.edu\/compbio\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.reed.edu\/compbio\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.reed.edu\/compbio\/wp-json\/wp\/v2\/users\/2294"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.reed.edu\/compbio\/wp-json\/wp\/v2\/comments?post=708"}],"version-history":[{"count":6,"href":"https:\/\/blogs.reed.edu\/compbio\/wp-json\/wp\/v2\/posts\/708\/revisions"}],"predecessor-version":[{"id":730,"href":"https:\/\/blogs.reed.edu\/compbio\/wp-json\/wp\/v2\/posts\/708\/revisions\/730"}],"wp:attachment":[{"href":"https:\/\/blogs.reed.edu\/compbio\/wp-json\/wp\/v2\/media?parent=708"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.reed.edu\/compbio\/wp-json\/wp\/v2\/categories?post=708"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.reed.edu\/compbio\/wp-json\/wp\/v2\/tags?post=708"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}