Bridging the Rubric Gap

By: Elanor Chlan, Ph.D.

Using rubrics in your course is a great way to improve the quality of your teaching experience. It improves the learning experience for your students since it will help them understand your expectations and, more importantly, it makes grading easier for you. If you are like me, then you enjoy interacting with students, but grading – not so much. That is where rubrics come in. They are a useful tool that, along with an investment in your time up front, will make the grading experience easier, faster, and smoother. Rubrics can help assign partial credit more equitably and be more consistent and objective across all the students in your course(s). Using rubrics can also increase the detail and specificity of the feedback you provide. Quality feedback is one of those items that many of us take a hit on in course evaluations. We try, but it is hard to do well. You may have already attended seminars and workshops and believe in the value of rubrics. Putting them into practice, however, is another matter.

What is a Rubric?

A rubric is a guide listing specific criteria for grading academic papers, projects, activities, or tests. The overall goal of a rubric is to clarify for students the quantity and quality of elements required in their work. The criteria for grading need to be coherent and each one needs to include descriptions of the different levels of performance. This is the upfront investment you need to make. The genius of rubrics is that they are descriptive and not evaluative. They can be used to evaluate, but the operating principle is that you match the performance to the description, rather than “judge” it. Thus, rubrics are only as good as the criteria selected and the descriptions of the performance levels under each.

…rubrics are only as good as the criteria selected and the descriptions of the performance levels under each.

The rubric shown above is an analytic rubric, distinguished from a holistic rubric, because it has multiple, separate, and distinct evaluation criteria for the product being graded. For most classroom purposes, analytic rubrics are best. Focusing on specific, separate criteria in relation to the quality of a product is better for instruction and assessment because students can see what aspects of their work need attention. In addition, focusing on a specified criteria helps for decisions about the future – for example, how to follow up on a unit or teach something next year.

Implementing Rubrics

Even if you have not been using rubrics, there is a very good chance you have been doing so informally. When you grade something, you have mental criteria in your head that you are using. So, start by writing it down.

In practice, there are two levels of rubrics in terms of what students will actually see. The first is the high-level course requirement you publish in the syllabus. The second is the more detailed and specific rubric that explains the grading criteria for the assignment. We can think of the example that follows as the implementation of the high-level course requirement.

Let’s suppose a course requires weekly discussions for 10% of the grade. In the syllabus you state: “Each week students are required to participate in a Muddy Point Discussion. The purpose of the Muddy Point Discussion forums is for you to explain the content that was most challenging or hard to understand. You are encouraged to explain how you resolved the issue or to express that you are still having difficulty in this area. The goal of the forum is to bring to light areas where students are struggling so guidance and support can be provided.”

This syllabus statement provides general information about a course requirement. So how does this translate into a rubric you can use to grade? Figure 2 shows how this might translate into the Rubrics tool in Blackboard. It has checkboxes for easy selection of the scored items and a place for general feedback. It is also possible to add custom feedback on the specific item checked. The feedback box appears when the checkbox is clicked. Notice how the tool acts as a de facto list of criteria you want to remember to check.

It is also possible to deduct points for minimum standards that are not met. Here we are deducting for lateness and not responding to every group member, but you can use it for many purposes. For example, you could assume a standard of excellent grammar and spelling in written submissions and deduct on papers that do not meet that standard. A student may meet the requirements in terms of content but not get a perfect score due to substandard grammar and spelling.

By using the check boxes to manage the routine, repetitive feedback, you can focus on the content of the posts and provide encouragement and specific individual remarks as needed.

Creating Rubrics

While we have already looked at implementing rubrics using the built-in Rubric tool in Blackboard, Table 1 provides a larger summary of different tools/methods to create rubrics, as well as the pros and cons based on my extensive experience.

Table 1: Rubric Implementations – Pros and Cons

Pros

Cons

Built-In Rubric Tool for LMS

Easy to duplicate for similar assignments

Wide range of features, e.g., scoring with percentages or ranges rather than absolute point values.

Allows specific detailed feedback to students

Easy to make additional comments when needed

May not be able to update or correct once used to grade a student.

An overly large rubric will not fit on the screen, requiring scrolling.

Learning curve for the tool

Free Rubric Tool

Free
Example tools available at: http://rubistar.4teachers.org/index.php

Gives a structured rubric similar to the one provided by the built-in tool. Save result as file and use one of the next two options.

Not integrated into LMS.

An overly large rubric will not fit on the screen, requiring scrolling.

Learning curve for the tool

Electronic document based rubric – copy per student

Allows specific detailed feedback to students

Easy to make additional comments

Easy to attach file in LMS gradebook

Works well for complex rubrics

Not integrated into LMS

Physical document based rubric – copy per student

Allows specific detailed feedback to students

Easy to make additional comments.

Most effective if kept to a single page

Not integrated into LMS

Not suitable for online courses

Fillable PDF forms

Allows detailed feedback to students

Can be structured with common comments

Can add up scores.

Easy to attach file in LMS gradebook.

Most effective if kept to a single page

Significant learning curve

Not integrated into LMS

Very detailed to set up

Difficult to alter

Copy to keep in front of you as you grade

Easy to make notes for yourself regarding pervasive issues

Works well for a holistic rubric

Works well if issues are very different from one student to the next

Can work online or onsite

Repetitive comments for common errors become tedious

Consistency is difficult

Requires more writing

A document-based implementation is a great choice for a larger, more complex deliverable with several components. With this style you create a document listing the high-level criteria descriptions and then a second one that makes grading practical.Table 2 shows several work products related to my rubric process for a Hashing Analysis assignment used in Algorithms for Bioinformatics.The students are provided with a complete Style Guide that provides more information related to documentation, style, and I/O requirements.

Table 2:
High-Level Criteria with Descriptions

Correctness

55% points

In problem solution and results

Style/Proper Coding

15% points

Following a reasonable, consistent style with reasonable documentation, appropriate use of structures, modularity, error checking.

  • Input/Output: Labeled, formatted, correct use of prompts, correctly handles specified inputs and outputs as well as additional cases, is user friendly.
  • Submission Completeness: all source code and compiled code – all required cases.

Analysis

30% points

The analysis should discuss the following points:

  • Description and justification of your data structures, implementation choices, and design decisions.
  • Efficiency with respect to both time and space.
  • A table and a graph summarizing your observations with respect to asymptotic efficiency.

Common Problems and Point Penalties

10
5
5
10
5
2
5
2
5
1
1
2
10

No documentation
Minimal documentation
Very poor modularity
Error checking
Unfriendly output format – Hard to read/find what you need to see
Unfriendly output format – Hard to find the empty slots for some of the schemes
Hardcoded output, not written to a file
Hardcoded output file name
No relevant stats in output
Not submitted as a zip
Not submitted with student name in file name
No README file
The compiled code is not included

The detailed listing has the specifics that I evaluate during the grading process. This level of detail provides me with guidance when I write feedback to students. It is also helpful when you are using graders and provides consistency and validity across the grading process. In addition, if many students are doing poorly in a specific area, it informs me of areas where I may need to adjust my instruction.

Hopefully, these examples have given you some ideas on how you can implement rubrics in your course in a way that works for you, your content, and your students, while simplifying the grading process. The benefits rubrics provide to both you and your students outweigh the initial effort required to set them up and will prove useful as the course progresses.


Keywords: Course Design, Rubrics