Online students give instructors higher marks if they think instructors are men

[Wheretonow]

A new study shows that college students in online courses give better evaluations to instructors they think are men – even when the instructor is actually a woman.

“The ratings that students give instructors are really important, because they’re used to guide higher education decisions related to hiring, promotions and tenure,” says Lillian MacNell, lead author of a paper on the work and a Ph.D. student in sociology at NC State. “And if the results of these evaluations are inherently biased against women, we need to find ways to address that problem.”

To address whether students judge female instructors differently than male instructors, the researchers evaluated a group of 43 students in an online course. The students were divided into four discussion groups of 8 to 12 students each. A female instructor led two of the groups, while a male instructor led the other two.

However, the female instructor told one of her online discussion groups that she was male, while the male instructor told one of his online groups that he was female. Because of the format of the online groups, students never saw or heard their instructor.

At the end of the course, students were asked to rate the discussion group instructors on 12 different traits, covering characteristics related to their effectiveness and interpersonal skills.

“We found that the instructor whom students thought was male received higher ratings on all 12 traits, regardless of whether the instructor was actually male or female,” MacNell says. “There was no difference between the ratings of the actual male and female instructors.”

In other words, students who thought they were being taught by women gave lower evaluation scores than students who thought they were being taught by men. It didn’t matter who was actually teaching them.

The instructor that students thought was a man received markedly higher ratings on professionalism, fairness, respectfulness, giving praise, enthusiasm and promptness.

“The difference in the promptness rating is a good example for discussion,” MacNell says. “Classwork was graded and returned to students at the same time by both instructors. But the instructor students thought was male was given a 4.35 rating out of 5. The instructor students thought was female got a 3.55 rating.”

The researchers view this study as a pilot, and plan to do additional research using online courses as a “natural laboratory.”

“We’re hoping to expand this approach to additional courses, and different types of courses, to determine the size of this effect and whether it varies across disciplines,” MacNell says.

The paper, “What’s in a Name: Exposing Gender Bias in Student Ratings of Teaching,” was published online Dec. 5 in the journal Innovative Higher Education. Co-authors are Dr. Adam Driscoll of the University of Wisconsin-La Crosse and Dr. Andrea Hunt of the University of North Alabama. Driscoll and Hunt received their doctoral degrees from NC State.

[TexTushHog]

I wonder if the degree of bias varied by the gender of the student.

[Wheretonow]

Originally Posted by TexTushHog

I wonder if the degree of bias varied by the gender of the student.

Interesting question. There were a total of 72 students who started the study. Although I haven't found the data, I believe it was 36/36. Not all of the participants finished the course and completed the questionnaire, so it's possible the gender makeup was schewed. The study has been attacked for a number of reasons, small sample size being one. Here's one example rated to your question:

• Student gender. Readers are given no information about the breakdown of student gender within each of the class sections. Existing research has suggested that student gender may have a modest but significant effect on the ratings of male and female instructors (Centra & Gaubatz, 2000). While MacNell et al. claim to have collected information about student gender, they did not report it and thus the gender composition of the subjects remains unknown to readers. Therefore, the observed differences in ratings cannot be fully attributed to gender bias if the effects of student gender were not controlled.