Analysis of AI Models for Student Admissions: A Case Study

Abstract

This research uses machine learning-based AI models to predict admissions decisions at a large urban research university. Admissions data spanning five years was used to create an AI model to determine whether a given student would be directly admitted into the School of Science under various scenarios. During this time, submission of standardized test scores as part of a student's application became optional which led to interesting questions about the impact of standardized test scores on admission decisions. We first developed AI models and analyzed these models to understand which variables are important in admissions decisions, and how the decision to exclude test scores affects the demographics of the students who are admitted. We then evaluated the predictive models to detect and analyze biases these models may carry with respect to three variables chosen to represent sensitive populations: gender, race, and whether a student was the first in his family to attend college.