Contaminating Student Assessment with Class Participation and Attendance “Bumps”

Professor Jay Silver (St. Thomas Law [FL]) has an interesting essay on Inside Higher Ed, The Contamination of Student Assessment.  In it, he argues that we undermine our efforts to utilize reliable summative assessment mechanisms when we provide “bumps” for class participation, attendance, and going to outside events. Here’s an excerpt:

In the era of outcomes assessment, testing serves to measure, more than ever, whether students have assimilated particular knowledge and developed certain skills. A student’s mere exposure to information and instruction in skills does not, in today’s assessment regime, reflect a successful outcome. The assessments crowd wants proof that it sank in, and grades are the unit of measurement.

Accordingly, extra credit for attendance at, say, even the most erudite and inspiring guest lecture outside class corrupts grades as a pure measurement of performance.

Sure, the lecture can be of value, whether demonstrable or not, in the intellectual development of the student, and giving credit for going to it is an effective incentive to attend. Nonetheless, that type of extra credit contaminates grades as a measure of performance, as it can allow the grades of students who attend extra-credit events to leapfrog over the grades of those who outperformed them on the exam but did not attend.

The next contaminant of grades as measurements of performance is the upgrade for stellar attendance. There is, of course, no guarantee that the ubiquitous attendee wasn’t an accomplished daydreamer or a back-row socialite. And if they were present and genuinely plugged in to each class, their diligence should show up in their exam performance, so extra credit merely gilds the lily.

Using the stick as well as the carrot, some professors do the opposite: they downgrade students for disruptive behavior or chronically poor preparation or attendance. Like a doctor using a hammer to anesthetize a patient, downgrades aimed at controlling behavior produce collateral damage. Colleges have better tools — like meetings with the dean of students — to address conduct-related problems.

Finally, we come to what may well be the most common nonperformance variable incorporated into grades: the class participation upgrade that so many of us rely on to break the deafening silence we’d otherwise encounter in casting pearls of wisdom upon the class. Class participation upgrades that recognize and reward the volume, rather than quality, of a student’s classroom contributions pollute performance-based assessment.

Participation upgrades for remarks that consistently advance the class discussion is a more complex issue. …

I definitely encourage readers to check out the full article.  It raises some interesting points. The article has caused me to rethink whether to give “bumps” for class participation. (I’ve never given bumps for attending outside events, and class attendance for our students is compulsory.)  A broader point: although those of us in the “assessment crowd” think and write a lot about formative assessment, we should also recognize the importance of utilizing reliable and effective methods for summative assessment—a point that Professor Silver notes throughout the article.

 

Off topic: WaPo op-ed on access-to-justice

Not directly assessment-related, but I thought I would share that Jennifer Bard (Cincinnati) and I have an op-ed in the Washington Post about access-to-justice. Drawing on an analogy to medicine, we argue:

Professionals must first acknowledge that not every legal task must be performed by a licensed lawyer. Instead, we need to adopt a tiered system of legal-services delivery that allows for lower barriers to entry. Just as a pharmacist can administer vaccines and a nurse practitioner can be on the front line of diagnosing and treating ailments, we should have legal practitioners who can also exercise independent judgment within the scope of their training. Such a change would expand the preparation and independence of the existing network of paralegals, secretaries and investigators already assisting lawyers.

This creates greater, not fewer, opportunities for law schools, which should provide a range of educational opportunities, from short programs for limited license holders to Ph.D.’s for those interested in academic research.

Enjoy the article!

Standardized Tests in Universities?

An interesting paper by Fredrik deBoer, a lecturer at Purdue, writing for the think tank, New America, examines the rise of assessment in K-12 and higher education.  He notes that K-12 education is populated with a plethora of standardized tests, while universities and colleges tend to operate as independent silos.  He argues that higher education’s use of standardized tests, developed by outside testing firms, should be approached with caution.  At the very least, the tests should be subjected to external validation.  He writes, “Researchers must vet these instruments to determine how well they work, and what the potential unforeseen consequences are of these types of assessments, for the good of all involved.”  More from InsideHigherEd.