to mix the racist comments into its dialogue . 
 
This project aims to unify many principals to achieve fairness and social welfare, towards building safe 
and trustworthy assistive AI agents that avoid bias and manipulation like Tay Chatbot. The human 
preference can be explicitly stated as ‘like’ or ‘dislike’ of the agent’s performance, or implicitly stated 
through the demonstrations. Two popular learning paradigms can be considered, Reinforcement 
Learning (RL) from specified preference [1] and Apprenticeship Learning (AL) [2] with human’s 
value implicitly expressed by their demonstrations.  By reinforcement learning, agents learn to 
perform given tasks based on preference. By apprenticeship learning, agents observe human 
demonstrations (historical trajectories) that reveal human’s interest, and learn to perform tasks to align 
with human values.  
 
Example questions that can be explored:
informatics-phd-projects-2022-23