MEASURING STUDENT OUTCOMES: EVALUATING THE PROGRAM AND BENEFICIAL TO THE STUDENT AND MENTOR

An evaluation methodology for measuring student learning and related outcomes was developed for Buffalo State's Undergraduate Summer Research Fellowship (USRF) program. The evaluation instruments and methodology are not discipline-specific and can be used by students and faculty mentors in all academic areas. A guiding principle was the desire to obtain reliable independent assessments of program impact without creating an undue measurement burden, while at the same time provide information to participating students that could help them gain new insights into their academic strengths and weaknesses. We also were interested in obtaining information from faculty mentors on how the program influenced their teaching. To accomplish this, 11 outcome categories, each defined by a number of specific components, were identified by a group of faculty representing a range of disciplines. Mentors and students can add more outcomes as appropriate to their projects. An assessment procedure includes applying a five-point scale linked to an explanatory rubric to denote that a student always, usually, often, seldom, or never displays a given outcome for each component in the 11 outcome categories. Faculty mentors rate students on each component and students evaluate their own progress using an identical instrument. Following this, the mentor and student meet to discuss how each scored the assessment. Seven years of data confirm that participating in this student research and evaluation processes fostered meaningful reflection by both students and mentors and encouraged frequent constructive student-mentor dialogues. While the students were the primary beneficiaries of these activities, our data confirm that mentors also gained from the experience. This presentation summarizes our evaluation program and highlights findings with special consideration for the needs of pre-service teachers.