Contributor to the following abstract, submitted for the AADR Annual Meeting (March 3-6, 2010) in Washington, DC Title: Use of a Grading Rubric to Evaluate Research Abstracts ( 9/2009 - 3/2010 )
Objectives: The grading rubric has become popular in recent years to evaluate the writing skills of students in higher education. The purpose of this study was to assess the use of a grading rubric designed to evaluate a scientific abstract written by dental hygiene students enrolled in the senior year of a four year program. Methods: Four dental hygiene faculty with similar education and years of experience were recruited to grade the abstracts. The faculty was blinded to the specific author of each abstract. Two graded the abstracts using a grading rubric and two graded using a simple check list. An intraclass correlation coefficient (ICC) was determined for each pair of graders. Results: The two faculty who graded the abstracts without the rubric demonstrated an ICC of 0.562 (CI = 0.303-0.743) while the two faculty using the grading rubric achieved an ICC of 0.440 (CI = 0.259-0.743). Conclusion: The development of a grading rubric did not improve grading consistency in this study. Although the rubric was popular with the faculty using it, training with the rubric appears to be needed to improve desired outcomes.