Generating Descriptive Explanations of Machine Learning Models Using LLM

Abstract

Machine learning algorithms play a pivotal role in a wide range of Artificial Intelligence (AI) applications. Explaining the results and behavior of a machine learning model, however, remains a challenge. In this paper, we present a new approach to the explanation of machine learning models using a large language model (LLM). In this work, we seek natural language descriptions of the behavioral patterns of a machine learning model by a combination of prompting and model sampling. A subspace sampling technique is developed to generate ML model outputs using partial features in a user defined space. A projective visualization method is employed to guide the sampling process, including user-directed interactive sampling and feature-based sampling, so that an optimal amount of information can be provided to the LLM to ensure accurate and concise natural language explanations. Two public datasets, a student performance dataset and a weather dataset, were used to test our approach under various conditions.