Hello members of TBLC –
We would like to announce that our fall newsletter will focus on research! The decision to do so is the result of our TBLC survey taken at the 14th annual TBLC conference held in Florida. Our Survey informed us of two important points:
1.) a large percentage of members are interested in learning about articles and research studies being completed in our collaborative and
2.) Members want to consult among other members for partnership in research. We are hoping the fall newsletter will provide information on both of these areas.
One section in the newsletter will be called ‘Research Roundup’ and will consist of articles about TBL written in the last 2 years by members of the TBLC community. We are asking you to send us any article(s) utilizing TBL in which you have been an author. Please send the citation (authors, year, title, journal, volume, and pages) and a one to three sentence long explanation of the project. The deadline for submission is September 18, 2015. This will be a wonderful opportunity to disseminate your article to others who are interested in learning about what you are doing with TBL, as well as publicize your findings to those are outside of your field of expertise!
Please send all submissions to support@tblcadmin.org with the subject heading “Research Roundup”
Additionally, if you have found a particularly good article on TBL that you are not an author of, we are planning on putting a bibliography page on our website with these articles. Please feel free to send us the citation (authors, year, title, journal, volume, and pages).
Our second section in the newsletter will be called ‘Interest in Collaboration.’ If you are interested in collaborating with others, we will need you to send us your name, email address, the topic you are interested in collaborating with others on, a draft research question if you have one (not critical), your discipline, the design (qualitative or quantitative), and who you would like to collaborate with (e.g. another discipline, someone with expertise in a specific design) and any other information you feel is pertinent.
The deadline for this will also be no later than September 18, 2015.
Please send all submissions to support@tblcadmin.org with the subject heading “Interest in Collaboration”
We look forward to hearing about what research our members have been involved in and identifying members who are interested in collaborating to increase the presence of TBL in the literature!
Thursday, July 30, 2015
Wednesday, July 29, 2015
TBLC 2015 Regional Workshop - TBL 101 & Creating Modules
Please join us in October for TBLC Regional Workshop!
TBL 101 and Creating Modules.
Where HILTON SEATTLE AIRPORT & CONFERENCE CENTER
17620 INTERNATIONAL BLVD,
Seattle, Washington 98188-4001, USA
Session details can be found here: View Event Summary
TBL 101 and Creating Modules.
Where HILTON SEATTLE AIRPORT & CONFERENCE CENTER
17620 INTERNATIONAL BLVD,
Seattle, Washington 98188-4001, USA
Session details can be found here: View Event Summary
Wednesday, May 13, 2015
TBLC Regional Workshop Opportunities
Dear Colleagues,
There is limited space remaining for the TBL 101 and Creating an Effective TBL Module workshops, which will be offered at the 19th Annual IAMSE (International Association of Medical Science Educators) Meeting this summer on Saturday, June 13th, 2015 from 8:30 am to 3:15 pm Eastern Time. These workshops will be co-presented by Sandy Cook and Kevin Krane. These workshops can be registered for independently of the normal conference registration. For more information, please visit http://www.iamseconference.org.
In case you can’t make it, the TBLC is hosting a regional workshop on Saturday, October 10th, 2015 in Seattle at the Hilton Hotel. The workshops will be co-presented by Michele Clark and Chris Burns. Registration will be open by June 1st, 2015. More details to follow soon!
Thank you,
TBLC Admin Team
There is limited space remaining for the TBL 101 and Creating an Effective TBL Module workshops, which will be offered at the 19th Annual IAMSE (International Association of Medical Science Educators) Meeting this summer on Saturday, June 13th, 2015 from 8:30 am to 3:15 pm Eastern Time. These workshops will be co-presented by Sandy Cook and Kevin Krane. These workshops can be registered for independently of the normal conference registration. For more information, please visit http://www.iamseconference.org.
In case you can’t make it, the TBLC is hosting a regional workshop on Saturday, October 10th, 2015 in Seattle at the Hilton Hotel. The workshops will be co-presented by Michele Clark and Chris Burns. Registration will be open by June 1st, 2015. More details to follow soon!
Thank you,
TBLC Admin Team
Thursday, May 7, 2015
"Giving faculty feedback about TBL modules to ensure delivery quality"
At the University of Illinois College of Medicine at Chicago, we first introduced Team-based learning (TBL) into the preclinical curriculum in academic year 2011-2012. We started with two modules generously provided by Wright State University Boonshoft School of Medicine. As course directors and faculty became more familiar with and willing to try TBL, the number of modules delivered markedly increased to 22 in academic year 2013-14. Some modules were homegrown, and others, adapted from existing modules. As novice practitioners of TBL, the quality of our modules was variable, so we developed a process for providing feedback to faculty about module quality.
Method: In AY2013-14, all TBL modules in the preclinical curriculum were submitted for peer review to two individuals at least three weeks prior to the scheduled TBL date. Reviewers provided narrative feedback using track changes about: quality of learning objectives, readiness assurance test (RAT) questions, and application exercises; nature of the preparatory material; and alignment of all components with one another. Reviewers had one week to complete their review, giving faculty one week to respond and make changes, so the module could be finalized for printing one week prior to the scheduled date.
Lessons learned:
When starting TBL in your program, one should have a process for providing feedback to faculty about module quality. A skilled facilitator cannot make up for a poorly constructed module. The feedback process provides a means for faculty development not only in TBL construction, but also for writing learning objectives and multiple-choice items, and constructing independent learning assignments.
It takes a team of people to complete the task of providing feedback because the workload is significant. It took us an average of 6-10 hours to complete one review, so having two individuals each reviewing 22 modules was not sustainable.
Hold faculty accountable for review submission deadlines or consider a longer time frame to review. When faculty were told to submit three weeks prior to the scheduled TBL date, they actually submitted their modules 1-2 weeks in advance, which was insufficient time for an adequate review.
Having the entire module in one document with explanatory notes is helpful for reviewers. We developed a template for faculty to fill in that includes a lesson plan, advance assignment, learning objectives, RAT, and application exercises. In addition, we provide spaces for faculty to indicate the linked learning objective(s) and explain key concepts for each RAT question and application exercise.
Future directions: We continue to modify our process for providing feedback on module quality, and are currently working with the Educational Development Committee (EDC) and other members of the TBLC to develop a rubric for assessing module quality. Another major pitfall in TBL implementation is poor facilitation. We are developing a process for providing feedback to faculty on facilitation of the session, which also involves working with the EDC and other TBLC members to develop a rubric for facilitation.
Amy Lin, MD
Abbas Hyderi, MD, MPH
Janet Riddle, MD
Method: In AY2013-14, all TBL modules in the preclinical curriculum were submitted for peer review to two individuals at least three weeks prior to the scheduled TBL date. Reviewers provided narrative feedback using track changes about: quality of learning objectives, readiness assurance test (RAT) questions, and application exercises; nature of the preparatory material; and alignment of all components with one another. Reviewers had one week to complete their review, giving faculty one week to respond and make changes, so the module could be finalized for printing one week prior to the scheduled date.
Lessons learned:
When starting TBL in your program, one should have a process for providing feedback to faculty about module quality. A skilled facilitator cannot make up for a poorly constructed module. The feedback process provides a means for faculty development not only in TBL construction, but also for writing learning objectives and multiple-choice items, and constructing independent learning assignments.
It takes a team of people to complete the task of providing feedback because the workload is significant. It took us an average of 6-10 hours to complete one review, so having two individuals each reviewing 22 modules was not sustainable.
Hold faculty accountable for review submission deadlines or consider a longer time frame to review. When faculty were told to submit three weeks prior to the scheduled TBL date, they actually submitted their modules 1-2 weeks in advance, which was insufficient time for an adequate review.
Having the entire module in one document with explanatory notes is helpful for reviewers. We developed a template for faculty to fill in that includes a lesson plan, advance assignment, learning objectives, RAT, and application exercises. In addition, we provide spaces for faculty to indicate the linked learning objective(s) and explain key concepts for each RAT question and application exercise.
Future directions: We continue to modify our process for providing feedback on module quality, and are currently working with the Educational Development Committee (EDC) and other members of the TBLC to develop a rubric for assessing module quality. Another major pitfall in TBL implementation is poor facilitation. We are developing a process for providing feedback to faculty on facilitation of the session, which also involves working with the EDC and other TBLC members to develop a rubric for facilitation.
Amy Lin, MD
Abbas Hyderi, MD, MPH
Janet Riddle, MD
Thursday, April 30, 2015
"TBLC Growing Around the World"
TBL is growing worldwide at a rate that is quite remarkable. Educators and administrators are realising the tremendous benefits that TBL offers in terms of student engagement and proven learning outcomes. As a result, since I officially retired last May, I have been travelling very widely delivering TBL workshops around the world. In just the last 6 months I've worked with faculty in the US, Chile, Colombia, Netherlands, Denmark, Norway, Singapore, UK and Australia. During these visits, I have delivered workshops to mixed-discipline faculty groups as well as specific faculties including engineering, pharmacy, medicine and education and even to the national training staff of the Boy Scouts of America, and to primary and secondary teachers at the Singapore Ministry for Education.
One of the memorable experiences from my visits to all these countries was to observe the implementation of TBL in a Singapore normal school seventh grade math class. What struck me in particular was to see a student with ADHD in that TBL class who became engaged with math to the point where he was able to tutor other students. Another example of the power of the TBL process was the observation by Bradford University (UK) that after the school-wide introduction of TBL, student requests for two different kinds of support had been dramatically reduced. One was that requests for support from the disability office for special accommodations (e.g. extra time for exams, a quiet test-taking environment, etc.) had almost completely disappeared; students with disabilities didn't need extra help. The other was that student requests for individual tutoring support in relation to their coursework had almost vanished altogether.
Another very interesting project that I have been working on is the introduction of TBL across the University of South Alabama. This is being done as a very well-planned and well-implemented change process that started in 2011, and is progressing well in meeting the objectives of improving student retention and improved learning. This process and the outcomes are being well documented in a paper that will soon be available. For example, dropout rates in the over 150 classes taught with TBL were less than half of the rates in comparable non-TBL courses and there were 38% fewer D's and F's and higher critical thinking scores. I think that the experience documented in the paper will provide a very good model for other institutions that want to address the very universal challenges in improving student learning and classroom experience.
-Larry Michaelsen, PhD
One of the memorable experiences from my visits to all these countries was to observe the implementation of TBL in a Singapore normal school seventh grade math class. What struck me in particular was to see a student with ADHD in that TBL class who became engaged with math to the point where he was able to tutor other students. Another example of the power of the TBL process was the observation by Bradford University (UK) that after the school-wide introduction of TBL, student requests for two different kinds of support had been dramatically reduced. One was that requests for support from the disability office for special accommodations (e.g. extra time for exams, a quiet test-taking environment, etc.) had almost completely disappeared; students with disabilities didn't need extra help. The other was that student requests for individual tutoring support in relation to their coursework had almost vanished altogether.
Another very interesting project that I have been working on is the introduction of TBL across the University of South Alabama. This is being done as a very well-planned and well-implemented change process that started in 2011, and is progressing well in meeting the objectives of improving student retention and improved learning. This process and the outcomes are being well documented in a paper that will soon be available. For example, dropout rates in the over 150 classes taught with TBL were less than half of the rates in comparable non-TBL courses and there were 38% fewer D's and F's and higher critical thinking scores. I think that the experience documented in the paper will provide a very good model for other institutions that want to address the very universal challenges in improving student learning and classroom experience.
-Larry Michaelsen, PhD
Wednesday, April 29, 2015
2015 TBLC Research Grant Award Recipients
Dear TBLC Members,
The TBLC supports and encourages research and scholarship in
Team-Based Learning. To help its members participate in opportunities that
provide educational scholarship, the TBLC will provide funding to initiate new
educational research or evaluation proposals in 2015-2016. This year there were
several applicants who applied for the research grant, and we would like to
recognize the winners for this year’s grant.
David Rodenbaugh
Oakland University William Beaumont School of Medicine
“A structured faculty review process within Team-Based Learning Peer Feedback/Evaluation: Impact on student team dynamics and quality of narrative feedback”
Oakland University William Beaumont School of Medicine
“A structured faculty review process within Team-Based Learning Peer Feedback/Evaluation: Impact on student team dynamics and quality of narrative feedback”
Wei-Hsin Lu
Stony Brook University Medical Center
“A Hybrid Approach: Effectiveness of an Interprofessional Patient Safety/Quality Care Team-Based Learning Simulation Experience on In-Training Healthcare Professionals”
Stony Brook University Medical Center
“A Hybrid Approach: Effectiveness of an Interprofessional Patient Safety/Quality Care Team-Based Learning Simulation Experience on In-Training Healthcare Professionals”
Preman Rajalingam
Lee Kong Chian School of Medicine
“Impact of Teamwork Skills Training on Teamwork Quality in Team-Based Learning (TBL) Setting”
Lee Kong Chian School of Medicine
“Impact of Teamwork Skills Training on Teamwork Quality in Team-Based Learning (TBL) Setting”
Each applicant and their research team will receive funding to
carry out the project
We congratulate all the teams and look forward to hearing
their findings at our TBLC conference in years to come.
Thank you,
Dr Judy Currey
Chair, TBLC Scholarship Committee
Dr Judy Currey
Chair, TBLC Scholarship Committee
Thursday, April 23, 2015
Peer Evaluation: Development of an Efficient Tool for Effective Feedback
It is critical to hold individual students accountable for their learning in collaborative, cooperative or team-based learning. Though all group learning is not equal, peer evaluation is the accountability method used in team-based learning. However, the peer assessment process can be cumbersome for student and faculty alike.
After using paper-based student peer evaluation forms for over fifteen years, the paper process has become increasingly unwieldy as class sizes have increased. Time constraints limit the ability to record and analyze student peer evaluations and communicate results to individuals in an efficient and timely manner. Yet, the need for peer evaluation is critical in maintaining the integrity of the team-based learning process. Consequently, we searched for alternative means to improve process efficiency and hopefully, process effectiveness. Using Google Drive™ programs, a readily available and inexpensive platform, an electronic survey (Google Form™) was developed based on our original paper-based peer evaluation form.
Students access the survey from a secure on-line platform to maintain peer-to-peer anonymity and to meet FERPA guidelines. Students are expected to rank each peer's performance in eight categories using a 1-5 Likert scale. Students provide written comments and an overall performance grade for each peer on a scale of 1-10. Data is downloaded as an Excel file eliminating transcription errors. Data is analyzed and an individual report is returned to each student via Blackboard.
A time and motion study comparing the paper and electronic-based evaluation tools was conducted in AGRI 2317- Principles of Agricultural Economics in the Fall 2013 semester. Time involved in data analysis and responding to 70 students was reduced by 72% using the electronic-based tool. This facilitated more timely feedback to students. Students reported a preference for the electronic format over the paper instrument at a rate of 96%. Adjustments and redeployment of the instrument for the same course in spring 2014 took less than 5% of the time required to develop the original electronic instrument.
By implementing an electronic-based student peer evaluation instrument, instructors using team-based learning can more efficiently provide quantitative and qualitative feedback to students. More specifically:
Data output from the electronic peer evaluation format provides a much more manageable data set for analysis.
After the initial Google Form™ was developed, subsequent forms are easily developed to accommodate future and/or other classes.
Efficiencies gained through the electronic peer evaluation process allow for a much more effective turnaround time for students to receive feedback.
Student feedback indicates a preference for this type of private assessment of their peers.
We continue to fine-tune the instrument to increase user-friendliness. If you are interested in gaining access to the instrument and general instructions on how to use the electronic-based peer evaluation tool, please contact Kyle Ferrell (kwf@shsu.edu) or Foy Mills (foymills@shsu.edu).
Kyle Ferrell, Foy Mills Jr.
Sam Houston State University
Subscribe to:
Posts (Atom)