Resources for:
  • Current Students
  • Faculty & Staff
  • Alumni
  • Directory
  • News
  • Events
UCI School of Education
  • About Us
    • Dean's Welcome
    • Our Mission & Vision
    • Facts & Information
    • Climate Council
    • Maps & Directions
  • Academics
    • Ph.D. in Education
    • MAT + Credential
    • Undergraduate
  • Community Engagement
    • Overview
    • Teacher Academy >
      • California Reading & Literature Project
      • UCI CalTeach
      • UCI History Project
      • UCI Math Project
      • UCI Science Project
      • UCI Writing Project
    • Orange County Educational Advancement Network
    • Center for Educational Partnerships >
      • SAGE Scholars Program
      • COSMOS
      • California Alliance for Minority Participation
    • Center for Research on Teacher Development and Professional Practice
  • Faculty
    • Our Faculty
    • Faculty Interviews
    • Centers
    • publications
  • Giving

"Towards Accurate and Fair Prediction of College Success: Evaluating Different Sources of Student Data"

7/7/2020

 
Fourth-year Ph.D. student Renzhe Yu is first author of an article on predictive analytics in Proceedings of the 13th International Conference on Educational Data Mining (EDM ’20). The title of the article is “Towards Accurate and Fair Prediction of College Success: Evaluating Different Sources of Student Data.”
​
Co-authors are Alumna Qiujie Li (Ph.D. ’19), Dr. Christian Fischer, Assistant Professor Shayan Doroudi, and Associate Professor Di Xu.

Yu is specializing in Language, Literacy, and Technology. His research interests include learning analytics, learning sciences, instructional design, and computational modeling. He is focusing on advanced computational methods to model and decipher student learning processes from the rich data available in various digital learning environments, with the goal of improving instructional design based on such empirical evidence. Yu is advised by Professor Mark Warschauer.
Picture
Renzhe Yu
 Qiujie Li is a postdoctoral researcher in the Learning Analytics Research Network (LEARN) at New York University. For her doctoral work at UCI, Li specialized in Learning, Teaching, Cognition, and Development. During her doctoral studies, she was advised by Professor Mark Warschauer and Assistant Professor Rachel Baker.

​Fischer is an assistant professor of Educational Effectiveness at the Hector Research Institute of Education Sciences and Psychology at the University of Tübingen in Germany and a Research Affiliate with the UCI School of Education. Previously, he was a distinguished postdoctoral scholar at UCI Irvine working under the mentorship of Warschauer and Dean Richard Arum.

Xu 
researches labor market returns to different degree programs and major areas in higher education and conducts research to explore the impacts of educational programs, interventions, and instructional practice on student course performance, persistence, and degree completion. Xu is co-director of UCI's Online Learning Research Center (OIRC).

Doroudi studies e
ducational data sciences, educational technology, and learning sciences. He is particularly interested in studying the prospects and limitations of data-driven algorithms in learning technologies, including lessons that can be drawn from the rich history of educational technology

​Abstract

In higher education, predictive analytics can provide actionable insights to diverse stakeholders such as administrators, instructors, and students. Separate feature sets are typically used for different prediction tasks, e.g., student activity logs for predicting in-course performance and registrar data for predicting long-term college success. However, little is known about the overall utility of different data sources across prediction tasks and the fairness of their predictions with respect to different subpopulations. Using data from over 2,000 college students at a large public university, we examined the utility of institutional data, learning management system (LMS) data, and survey data for accurately and fairly predicting short-term and long-term student success. We found that institutional data and LMS data both have decent predictive power, but survey data shows very little predictive utility Combining institutional data with LMS data leads to even higher accuracy than using either alone. In terms of fairness, using institutional data consistently underestimates historically disadvantaged student subpopulations more than their peers, whereas LMS data tend to overestimate some of these groups more often. Combining the two data sources does not fully neutralize the biases and still leads to high rates of underestimation among disadvantaged groups. Moreover, algorithmic biases affect not only demographic minorities but also students with acquired disadvantages. These analyses serve to inform more cost-effective and equitable use of student data for predictive analytics applications in higher education.


Comments are closed.
Quick Links:

Fall 2021 Magazine
​Faculty & Research
Faculty Interviews
Directory
Admissions
​Giving
​News Center
Employment
Programs:
​
PhD in Education
MAT
Major in Edu Science
Minor in Edu Studies
CalTeach
CASE
Resources for:
​

​Current Students​
Faculty & Staff
University of California, Irvine
School of Education
401 E. Peltason Drive
Suite 3200
Irvine, CA  92617
(949) 824-8073

Picture
© ​2022 UC Regents 
  • About Us
    • Dean's Welcome
    • Our Mission & Vision
    • Facts & Information
    • Climate Council
    • Maps & Directions
  • Academics
    • Ph.D. in Education
    • MAT + Credential
    • Undergraduate
  • Community Engagement
    • Overview
    • Teacher Academy >
      • California Reading & Literature Project
      • UCI CalTeach
      • UCI History Project
      • UCI Math Project
      • UCI Science Project
      • UCI Writing Project
    • Orange County Educational Advancement Network
    • Center for Educational Partnerships >
      • SAGE Scholars Program
      • COSMOS
      • California Alliance for Minority Participation
    • Center for Research on Teacher Development and Professional Practice
  • Faculty
    • Our Faculty
    • Faculty Interviews
    • Centers
    • publications
  • Giving
  • Resources For:
  • Future Students
  • Current Students
  • Faculty & Staff

  • Search This Site
  • Directory
  • News
  • Events