ORCID
https://orcid.org/0009-0006-7603-0793
Date of Award
Spring 5-2023
Degree Name
Master of Science (MS)
Degree Type
Thesis
Abstract
As Large language models (LLMs) become increasingly pervasive in various domains, it is crucial to ensure that their outputs adhere to societal values and ethical considerations. In this thesis, we investigate the alignment of ChatGPT, a recent state-of-the-art large language model developed by OpenAI, with societal values. Specifically, we define the problem of societal values of LLMs and assemble a representative collection of 7 datasets covering 4 topics related to societal values. In-context learning techniques are applied and appropriate prompts are designed. The performance of each dataset is measured using a standardized evaluation system focused on accuracy. We then display the results and provide an analysis of ChatGPT's alignment with societal values. We contribute to the development of a framework for evaluating the alignment of language models with societal values, providing insights into the ability of ChatGPT to align with societal values.
Language
English (en)
Chair
Chenguang Wang, Computer Science & Engineering
Committee Members
Ning Zhang, William Yeoh