It is critical to hold individual students accountable for their learning in collaborative, cooperative or team-based learning. Though all group learning is not equal, peer evaluation is the accountability method used in team-based learning. However, the peer assessment process can be cumbersome for student and faculty alike.
After using paper-based student peer evaluation forms for over fifteen years, the paper process has become increasingly unwieldy as class sizes have increased. Time constraints limit the ability to record and analyze student peer evaluations and communicate results to individuals in an efficient and timely manner. Yet, the need for peer evaluation is critical in maintaining the integrity of the team-based learning process. Consequently, we searched for alternative means to improve process efficiency and hopefully, process effectiveness. Using Google Drive™ programs, a readily available and inexpensive platform, an electronic survey (Google Form™) was developed based on our original paper-based peer evaluation form.
Students access the survey from a secure on-line platform to maintain peer-to-peer anonymity and to meet FERPA guidelines. Students are expected to rank each peer's performance in eight categories using a 1-5 Likert scale. Students provide written comments and an overall performance grade for each peer on a scale of 1-10. Data is downloaded as an Excel file eliminating transcription errors. Data is analyzed and an individual report is returned to each student via Blackboard.
A time and motion study comparing the paper and electronic-based evaluation tools was conducted in AGRI 2317- Principles of Agricultural Economics in the Fall 2013 semester. Time involved in data analysis and responding to 70 students was reduced by 72% using the electronic-based tool. This facilitated more timely feedback to students. Students reported a preference for the electronic format over the paper instrument at a rate of 96%. Adjustments and redeployment of the instrument for the same course in spring 2014 took less than 5% of the time required to develop the original electronic instrument.
By implementing an electronic-based student peer evaluation instrument, instructors using team-based learning can more efficiently provide quantitative and qualitative feedback to students. More specifically:
Data output from the electronic peer evaluation format provides a much more manageable data set for analysis.
After the initial Google Form™ was developed, subsequent forms are easily developed to accommodate future and/or other classes.
Efficiencies gained through the electronic peer evaluation process allow for a much more effective turnaround time for students to receive feedback.
Student feedback indicates a preference for this type of private assessment of their peers.
We continue to fine-tune the instrument to increase user-friendliness. If you are interested in gaining access to the instrument and general instructions on how to use the electronic-based peer evaluation tool, please contact Kyle Ferrell (kwf@shsu.edu) or Foy Mills (foymills@shsu.edu).
Kyle Ferrell, Foy Mills Jr.
Sam Houston State University
A way in which the information from this kind of data can be maximized is by applying the Kano method of analysis to it. The Kano Model under the Six Sigma methodology is one that works to classify customer responses. data analysis for survey research
ReplyDelete