“Broken Promises? Examining the Effectiveness of Promising Practices in STEM Lectures by Student Subgroups”

Fourth-year doctoral student Gabe Avakian Orona (right) is sole author of an article in Innovative Higher Education investigating the effect of promising practices on student learning.

The title of the article is “Broken Promises? Examining the Effectiveness of Promising Practices in STEM Lectures by Student Subgroups.”
 
Orona, who is specializing in Educational Policy and Social Context (EPSC), studies measurement and assessment in higher education. He is interested in conceptualizing and constructing, designing and analyzing, assessments consonant with the aims of higher education, and using these to evaluate student learning outcomes. Much of his work centers on issues of validity, and the appropriate use and interpretation of test scores. ​Professor and Dean Richard Arum serves as his advisor. 

​Abstract

​Traditional approaches to teaching and learning in large undergraduate STEM lectures has not kept pace with the massification and diversification of higher education. Efforts to alleviate learning obstacles call for improved instruction, stipulating the utility of specific pedagogical techniques delineated as “promising practices”; however, little evidence supports their effectiveness. In this study, a quasi-experimental method is applied to a large panel dataset containing course observations and institutional records to investigate the effect of promising practices on student learning. Additionally, differential effects are examined across several important nontraditional and historically under-served populations, such as Hispanic, first-generation, low-income and lower prior ability students. Results suggest that two information relaying techniques—the use of prior content and reviewing exam content—were positively and significantly associated with student outcomes, and estimates were found to be stable across subgroups. Implications for higher education teaching and learning, as well as empirical research in these areas, are discussed.