They love me, they hate me?

HeartEach semester I dread and welcome the day I receive the email with the subject line ”Teaching Evaluations”.  In the email, I get access to two things, my quantitative scores and my open-ended student comments.

Like many colleagues, I love the comments – the good and the bad.  I welcome the sarcastic remarks about why the assignments have to be so complicated, the compliments regarding my choice of readings, and even the somewhat odd personal observations such as, “do you know you wear black pants every Thursday.”  I learn so much about what students believe to be fair and good about my course.  I take most of these comments to heart, even the odd observations. In general, I feel nothing but love from the students when I read these comments, even the critical ones.

On the other hand, I dread opening the quantitative scores that always accompany the comments.  As a quantitative researcher, I know how to make sense of the distributions and the possible random errors.  As a heavy user of survey research, I place a lot of value on scaled responses.  As a member of a large university faculty, I know that my relative overall ranking from these scores matter and that professional careers can hinge on good and bad teaching evaluations.  With all the possible limitations and consequences in mind, I also take these averages and individual scores selected by my students to heart.

To be honest, my quantitative scores are rarely that low, but they are far from excellent which is what I aspire to.  What I have come to accept is that only a small proportion of students will choose the highest rank on all questions asked.  For example, some might believe I manage class time well others disagree.  When colleagues question the utility of standardized teaching evaluations I often disagree.  In my experience, my students are as intentional in their response choices using these measures as they were in writing their comments.  If I am honest with myself, the majority of students are often right with respect to where they find me lacking and where they see my strengths.  So I now use both my comments and my standardized scores to improve my courses.

I know many of us are concerned with the heavy reliance on standardized evaluations and the lack of attention paid to the comments portion of teaching evaluations, the peer observations, and the critical assessment of syllabi.  I completely agree.  I know that we worry about students using these evaluations as a tool to exact revenge for their poor performance.  However, as standardized teaching evaluation questions have improved, I increasingly see value in the responses generated from these questions. Universities are increasingly paying attention to the questions asked and to the data received.  Over the last two years, Dedman College examined the content of questions, revised and added new ones, and finally found a way to link class characteristics to the data.  As a result, the standardized scores from my fall evaluations were some of the most helpful I have received while at SMU.

While changing standardized evaluations are certainly a step in the right direction, I would suggest that universities also find a way to use the open-ended comments as well.  All they need to accomplish this is software that analyzes qualitative data to identify patterns.  Using these software packages, we can quickly and reliably identify positive versus negative adjectives, identify consistent problems, generate super cool WORD CLOUDS to see what words dominate student comments.  In other words, there are ways to not rely so heavily on a single number or a rank when determining how good of a teacher someone is.

I would love to hear other ideas for how we might continue to improve how we personally use our teaching evaluations and how our institutions use these evaluations (both quantitative and qualitative) to evaluate our performance.

About Sheri Kunovich

AA-Dedman(Sociology)
This entry was posted in Teaching Evaluations. Bookmark the permalink.

4 Responses to They love me, they hate me?

  1. Meghan Ryan says:

    Thanks for your thoughtful post, Sheri. My concerns with student evaluations relate to possible biases against minorities and/or women and the evaluations’ relationship to a view of the student as a consumer. I’ve recently heard stories of students arguing with professors’ policies about using laptops or cell phones in the classroom, or professors’ attendance policies; supposedly, the argument is that the student has paid good money to take the class and should therefore be able to do what he or she wants in class. Certainly, students’ opinions should matter, but I don’t view this “business” as one in which a student just hands us money and we provide him or her with a degree. I agree with Beth that additional evidence of teaching effectiveness is a must.

  2. Barb Morganfield says:

    Great post. I agree that we need to look at what types of evidence can provide us better insight into how effective we are.

  3. Love the Wordle (http://www.wordle.net/) idea! I’m going to try it. And as institutions, we not only should we be using better student evaluation tools, we should be encouraging additional kinds of evidence of teaching quality like peer observations, teaching philosophy statements, student assignments, participation in faculty development programs, and more. Thanks for your post.

  4. Barbara Whitehead says:

    Excellent post! I often hear faculty fret about student evaluations. This is the first time I’ve come across the idea of Word Clouds as a tool for making sense of evaluations. That could be very interesting.

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>