Paper No. 7-12
Presentation Time: 10:45 AM-11:00 AM
WEBWORK ASSESSMENT OF PHYSICAL GEOLOGY LABS: A CASE STUDY
SCHMITT, Mark W.1, HANLAN, Patricia C.1, VAN HEES, Edmond H.2, and LOWRIE, David J.2, (1) Detroit Country Day School, 22305 West 13 Mile Rd, Beverly Hills, MI 48025, MSchmitt@dcds.edu, (2) Geology, Wayne State Univ, 0224 Old Main Bldg, Detroit, MI 48202

WeBWorK software has been modified and utilized successfully at Wayne State University to produce a cutting-edge Laboratory testing system for >1,000 students who enroll annually in Physical Geology to earn credit for a required science course with a lab. The computerized testing system was conceived and implemented to: (1) eliminate the need to manually enter ~15,000 test scores into spreadsheets; (2) provide each student with a unique test selected from a bank of questions with varying difficulties; (3) enhance the type of questions asked; (4) enhance lab accessibility for special needs students; (5) provide information to reinforce physical samples in some test sets; (6) reduce the opportunity for cheating; (7) provide immediate feedback to answers submitted; (8) eliminate the need to handle large items like topographic maps; and (9) eliminate the need to purchase scantrons.

More than 400 students were tested on a weekly basis during the 2002 Fall semester. Results of a questionnaire answered by >95% of all students indicate that: (1) 54% of all students prefer the WeBWorK system over other testing methods (rated most favorably by freshman and sophomores); (2) immediate feed-back during tests was very unpopular (>70% of students want to eliminate this feature); (3) 75% of all students were happy with images presented on a computer; and (4) the incidence of technology failure or user error was low (<10% and <15% of students indicated any problems during semester).

Implementing the WeBWorK system during the Fall 2002 semester resulted in a 10% reduction in laboratory marks (compared to those obtained in previous years) and a reduction of documented cheating. The decrease in marks was probably caused by both the new WeBWorK testing system providing each student with a unique test (making it more difficult to transfer knowledge about the test) as well as complete revision of all laboratory questions to make them more rigorous. Comparison of assigned (by a panel of instructors and lab assistants) and actual question difficulty indicates that difficulty rankings for some questions need to be recalibrated. The Fall 2002 semester results will be used to redefine the difficulty of questions and thereby modify the question selection process in order to achieve a target average mark of 75% in future labs.

North-Central Section - 37th Annual Meeting (March 24–25, 2003)
General Information for this Meeting
Session No. 7
Innovative Teaching Strategies for Engaging K-16 Geoscience Students
Kansas City Airport Hilton: Kansa B
8:00 AM-12:00 PM, Monday, March 24, 2003
 

© Copyright 2003 The Geological Society of America (GSA), all rights reserved. Permission is hereby granted to the author(s) of this abstract to reproduce and distribute it freely, for noncommercial purposes. Permission is hereby granted to any individual scientist to download a single copy of this electronic file and reproduce up to 20 paper copies for noncommercial purposes advancing science and education, including classroom use, providing all reproductions include the complete content shown here, including the author information. All other forms of reproduction and/or transmittal are prohibited without written permission from GSA Copyright Permissions.