LLM Role-Playing/Persona Papers and Resources

Awesome-llm-role-playing-with-persona: a curated list of resources for large language models for role-playing with assigned personas.

---

Here are some other paper lists you might be interested in:

💡 Persona Paper: A list of papers related to persona-based dialogue systems and personalized response generation.

🔬 LLM and Society: Recent papers on (1) Psychology of LLMs; (2) Biases in LLMs.

🤖 LLM Agent Papers: Must-read Papers on Large Language Model Agents.

🔔 News

• 2024-04-30 We are super excited to announce our survey paper: "From Persona to Personalization:A Survey on Role-Playing Language Agents"[arxiv]

• 2024-04-17 We are looking for collaborators interested in research on this topic. Contact us via email: xtwang21@m.fudan.edu.cn

• 2023-10-30 We create this repository to maintain a paper list on LLMs Role-Playing with Assigned Personas .

📜Content

• LLM Role-Playing/Persona Papers and Resources
  • 🔔 News
  • 📜Content
    • 📚 Survey
    • 🧙 Role-Playing
      • 🧙 Role-Playing Agents / Fictional Characters
      • 👨‍👩‍👧‍👦 Demographics/Stereotype
      • 🤖 Personalized AI
    • 👥 Multi Agents
    • 🎭 Personality Traits
    • 🧠 Other Psychological Topics
    • 🌐 Others
  • 💡 Contribution
    • Contributing to this repo
    • Contributors

📚 Survey Paper

• From Persona to Personalization: A Survey on Role-Playing Language Agents.

  Jiangjie Chen, Xintao Wang, Rui Xu, Siyu Yuan, Yikai Zhang, Wei Shi, Jian Xie, Shuang Li, Ruihan Yang, Tinghui Zhu, Aili Chen, Nianqi Li, Lida Chen, Caiyu Hu, Siye Wu, Scott Ren, Ziquan Fu, Yanghua Xiao. [abs], 2024.4

🧙 Role-Playing

🧙 Role-Playing Agents / Fictional Characters

• ChatHaruhi: Reviving Anime Character in Reality via Large Language Model.

  Cheng Li, Ziang Leng, Chenxi Yan, Junyi Shen, Hao Wang, Weishi MI, Yaying Fei, Xiaoyang Feng, Song Yan, HaoSheng Wang, Linkang Zhan, Yaokai Jia, Pingyu Wu, Haozhen Sun. [abs], 2023.8

• InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviews. (Previously: Do Role-Playing Chatbots Capture the Character Personalities? Assessing Personality Traits for Role-Playing Chatbots)

  Xintao Wang, Yunze Xiao, Jen-tse Huang, Siyu Yuan, Rui Xu, Haoran Guo, Quan Tu, Yaying Fei, Ziang Leng, Wei Wang, Jiangjie Chen, Cheng Li, Yanghua Xiao. [abs], 2023.10

• RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models.

  Zekun Moore Wang, Zhongyuan Peng, Haoran Que, Jiaheng Liu, Wangchunshu Zhou, Yuhan Wu, Hongcheng Guo, Ruitong Gan, Zehao Ni, Man Zhang, Zhaoxiang Zhang, Wanli Ouyang, Ke Xu, Wenhu Chen, Jie Fu, Junran Peng., [abs], 2023.10

• Character-LLM: A Trainable Agent for Role-Playing.

  Yunfan Shao, Linyang Li, Junqi Dai, Xipeng Qiu., [abs], 2023.10

• SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents

  Xuhui Zhou, Hao Zhu, Leena Mathur, Ruohong Zhang, Haofei Yu, Zhengyang Qi, Louis-Philippe Morency, Yonatan Bisk, Daniel Fried, Graham Neubig, Maarten Sap. [abs], 2023.10

• SOTOPIA-π: Interactive Learning of Socially Intelligent Language Agents

  Ruiyi Wang, Haofei Yu, Wenxin Zhang, Zhengyang Qi, Maarten Sap, Graham Neubig, Yonatan Bisk, Hao Zhu. [[abs](https://arxiv.org/abs/2403.08715], 2024.03

• Thespian: Multi-Character Text Role-Playing Game Agents.

  Christopher Cui, Xiangyu Peng, Mark Riedl., [abs], 2023.8

• NarrativePlay: Interactive Narrative Understanding. Runcong Zhao, Wenjia Zhang, Jiazheng Li, Lixing Zhu, Yanran Li, Yulan He, Lin Gui., [abs], 2023.10

• Meet Your Favorite Character: Open-domain Chatbot Mimicking Fictional Characters with only a Few Utterances.

  Seungju Han, Beomsu Kim, Jin Yong Yoo, Seokjun Seo, Sangbum Kim, Enkhbayar Erdenee, Buru Chang., [abs], NAACL 2022

• Large Language Models Meet Harry Potter: A Bilingual Dataset for Aligning Dialogue Agents with Characters.

  Nuo Chen, Yan Wang, Haiyun Jiang, Deng Cai, Yuhan Li, Ziyang Chen, Longyue Wang, Jia Li., [abs], 2022.11

• “Let Your Characters Tell Their Story”: A Dataset for Character-Centric Narrative Understanding Faeze Brahman, Meng Huang, Oyvind Tafjord, Chao Zhao, Mrinmaya Sachan, Snigdha Chaturvedi., [abs], EMNLP findings 2021

• CharacterGLM: Customizing Chinese Conversational AI Characters with Large Language Models. Jinfeng Zhou, Zhuang Chen, Dazhen Wan, Bosi Wen, Yi Song, Jifan Yu, Yongkang Huang, Libiao Peng, Jiaming Yang, Xiyao Xiao, Sahand Sabour, Xiaohan Zhang, Wenjing Hou, Yijia Zhang, Yuxiao Dong, Jie Tang, Minlie Huang., [abs], 2023.11

• CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluation. Quan Tu, Shilong Fan, Zihang Tian, Rui Yan., [abs], 2024.1

• Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignment Keming Lu, Bowen Yu, Chang Zhou, Jingren Zhou., [abs], 2024.1

• Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agent Xiaoyan Yu, Tongxu Luo, Yifan Wei, Fangyu Lei, Yiming Huang, Hao Peng, Liehuang Zhu., [abs], 2024.2

• RoleEval: A Bilingual Role Evaluation Benchmark for Large Language Models Tianhao Shen, Sun Li, Quan Tu, Deyi Xiong. [abs], 2023.12

• Enhancing Role-playing Systems through Aggressive Queries: Evaluation and Improvement Yihong Tang, Jiao Ou, Che Liu, Fuzheng Zhang, Di Zhang, Kun Gai. [abs], 2024.02

• RoleInteract: Evaluating the Social Interaction of Role-Playing Agents Yihong Tang, Jiao Ou, Che Liu, Fuzheng Zhang, Di Zhang, Kun Gai. [abs], 2024.03

• PIPPA: A Partially Synthetic Conversational Dataset Tear Gosling, Alpin Dale, Yinhe Zheng. [abs], 2023.08

• Towards Objectively Benchmarking Social Intelligence for Language Agents at Action Level Chenxu Wang, Bin Dai, Huaping Liu, Baoyuan Wang. [abs], 2024.04

#️⃣ Demographics/Stereotype

• Expertprompting: Instructing large language models to be distinguished experts

  Benfeng Xu , An Yang , Junyang Lin , Quan Wang , Chang Zhou, Yongdong Zhang and Zhendong Mao. [abs], 2023.5

• Toxicity in ChatGPT: Analyzing Persona-assigned Language Models

  Ameet Deshpande, Vishvak Murahari, Tanmay Rajpurohit, Ashwin Kalyan, Karthik Narasimhan. [abs], 2023.4

• Better Zero-Shot Reasoning with Role-Play Prompting Aobo Kong, Shiwan Zhao, Hao Chen, Qicheng Li, Yong Qin, Ruiqi Sun, Xin Zhou. [abs], 2023.8

• Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMs Shashank Gupta, Vaishnavi Shrivastava, Ameet Deshpande, Ashwin Kalyan, Peter Clark, Ashish Sabharwal, Tushar Khot [abs], 2023.11

• Is "A Helpful Assistant" the Best Role for Large Language Models? A Systematic Evaluation of Social Roles in System Prompts. Mingqian Zheng, Jiaxin Pei, David Jurgens [abs], 2023.11

• CoMPosT: Characterizing and Evaluating Caricature in LLM Simulations Myra Cheng, Tiziano Piccardi, Diyi Yang. [abs], 2023.10

• Deciphering Stereotypes in Pre-Trained Language Models Weicheng Ma, Henry Scheible, Brian Wang, Goutham Veeramachaneni, Pratim Chowdhary, Alan Sun, Andrew Koulogeorge, Lili Wang, Diyi Yang, Soroush Vosoughi. [abs], EMNLP Findings 2023

• CultureLLM: Incorporating Cultural Differences into Large Language Models Cheng Li, Mengzhou Chen, Jindong Wang, Sunayana Sitaram, Xing Xie. [abs], 2024.2

🤖 Personalized AI

• MPCHAT: Towards Multimodal Persona-Grounded Conversation

  Jaewoo Ahn, Yeda Song, Sangdoo Yun, Gunhee Kim. [abs], 2023.5. Tags: multimodal persona.

• LiveChat: A Large-Scale Personalized Dialogue Dataset Automatically Constructed from Live Streaming

  Jingsheng Gao, Yixin Lian, Ziyi Zhou, Yuzhuo Fu, Baoyuan Wang. [abs], 2023.6. Tags: streamer persona.

• COSPLAY: Concept Set Guided Personalized Dialogue Generation Across Both Party Personas Jingsheng Gao, Yixin Lian, Ziyi Zhou, Yuzhuo Fu, Baoyuan Wang. [abs], SIGIR 2022.

• Personalizing Dialogue Agents: I have a dog, do you have pets too? Saizheng Zhang, Emily Dinan, Jack Urbanek, Arthur Szlam, Douwe Kiela, Jason Weston. [abs], ACL 2018.

• On the steerability of large language models toward data-driven personas Junyi Li, Ninareh Mehrabi, Charith Peris, Palash Goyal, Kai-Wei Chang, Aram Galstyan, Richard Zemel, Rahul Gupta [abs], 2023.11.

• LaMP: When Large Language Models Meet Personalization Alireza Salemi, Sheshera Mysore, Michael Bendersky, Hamed Zamani [abs], 2023.04.

• Personalized Reward Learning with Interaction-Grounded Learning (IGL) Jessica Maghakian, Paul Mineiro, Kishan Panaganti, Mark Rucker, Akanksha Saran, Cheng Tan [abs], 2022.11.

• When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunities Jin Chen, Zheng Liu, Xu Huang, Chenwang Wu, Qi Liu, Gangwei Jiang, Yuanhao Pu, Yuxuan Lei, Xiaolong Chen, Xingmei Wang, Defu Lian, Enhong Chen [abs], 2023.07.

• Beyond ChatBots: ExploreLLM for Structured Thoughts and Personalized Model Responses Xiao Ma, Swaroop Mishra, Ariel Liu, Sophie Su, Jilin Chen, Chinmay Kulkarni, Heng-Tze Cheng, Quoc Le, Ed Chi [abs], 2023.12.

• PersonalityChat: Conversation Distillation for Personalized Dialog Modeling with Facts and Traits Ehsan Lotfi, Maxime De Bruyn, Jeska Buhmann, Walter Daelemans. [abs], 2024.1.

👥 Multi Agents

• Generative Agents: Interactive Simulacra of Human Behavior Joon Sung Park, Joseph C. O'Brien, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, Michael S. Bernstein. [abs], 2023.04.

• Communicative Agents for Software Development Chen Qian, Xin Cong, Wei Liu, Cheng Yang, Weize Chen, Yusheng Su, Yufan Dang, Jiahao Li, Juyuan Xu, Dahai Li, Zhiyuan Liu, Maosong Sun. [abs], 2023.07.

• Corex: Pushing the Boundaries of Complex Reasoning through Multi-Model Collaboration. Qiushi Sun, Zhangyue Yin, Xiang Li, Zhiyong Wu, Xipeng Qiu, Lingpeng Kong. [abs], 2023.09.

• AVALONBENCH: Evaluating LLMs Playing the Game of Avalon. Jonathan Light, Min Cai, Sheng Shen, Ziniu Hu. [abs], 2023.10.

• War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Wars. Wenyue Hua, Lizhou Fan, Lingyao Li, Kai Mei, Jianchao Ji, Yingqiang Ge, Libby Hemphill, Yongfeng Zhang. [abs], 2023.11.

• Leveraging Word Guessing Games to Assess the Intelligence of Large Language Models. Tian Liang, Zhiwei He, Jen-tse Huang, Wenxuan Wang, Wenxiang Jiao, Rui Wang, Yujiu Yang, Zhaopeng Tu, Shuming Shi, Xing Wang. [abs], 2023.10.

• AntEval: Quantitatively Evaluating Informativeness and Expressiveness of Agent Social Interactions. Yuanzhi Liang, Linchao Zhu, Yi Yang. [abs], 2024.1.

• Exchange-of-Thought: Enhancing Large Language Model Capabilities through Cross-Model Communication Zhangyue Yin, Qiushi Sun, Cheng Chang, Qipeng Guo, Junqi Dai, Xuanjing Huang, Xipeng Qiu. [abs], 2024.1.

• Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View Jintian Zhang, Xin Xu, Ningyu Zhang, Ruibo Liu, Bryan Hooi, Shumin Deng. [abs], 2023.10

• Training socially aligned language models on simulated social interactions Ruibo Liu, Ruixin Yang, Chenyan Jia, Ge Zhang, Diyi Yang, Soroush Vosoughi. [abs], ICLR 2024

• How Far Are We on the Decision-Making of LLMs? Evaluating LLMs' Gaming Ability in Multi-Agent Environments Jen-tse Huang, Eric John Li, Man Ho Lam, Tian Liang, Wenxuan Wang, Youliang Yuan, Wenxiang Jiao, Xing Wang, Zhaopeng Tu, Michael R. Lyu. [abs], 2024.03

• AgentGroupChat: An Interactive Group Chat Simulacra For Better Eliciting Collective Emergent Behavior Zhouhong Gu, Xiaoxuan Zhu, Haoran Guo, Lin Zhang, Yin Cai, Hao Shen, Jiangjie Chen, Zheyu Ye, Yifei Dai, Yan Gao, Yao Hu, Hongwei Feng, Yanghua Xiao [abs], 2024.03

• Is this the real life? Is this just fantasy? The Misleading Success of Simulating Social Interactions With LLMs Xuhui Zhou, Zhe Su, Tiwalayo Eisape, Hyunwoo Kim, Maarten Sap [abs], 2024.03

🎭 Personality Traits

• Personality Traits in Large Language Models

  Mustafa Safdari, Greg Serapio-García, Clément Crepy, Stephen Fitz, Peter Romero, Luning Sun, Marwa Abdulhai, Aleksandra Faust, Maja Matarić. [abs], 2023.7

• Estimating the Personality of White-Box Language Models.

  Saketh Reddy Karra, Son The Nguyen, Theja Tulabandhula. [abs], 2022.4

• PersonaLLM: Investigating the Ability of GPT-3.5 to Express Personality Traits and Gender Differences.

  Hang Jiang, Xiajie Zhang, Xubo Cao, Jad Kabbara., [abs], 2023.5

• Does GPT-3 Demonstrate Psychopathy? Evaluating Large Language Models from a Psychological Perspective.

  Xingxuan Li, Yutong Li, Shafiq Joty, Linlin Liu, Fei Huang, Lin Qiu, Lidong Bing. [abs], 2022.12

• Evaluating and Inducing Personality in Pre-trained Language Models. Guangyuan Jiang, Manjie Xu, Song-Chun Zhu, Wenjuan Han, Chi Zhang, Yixin Zhu. [abs], 2022.6

• Revisiting the Reliability of Psychological Scales on Large Language Models (Previously: ChatGPT an ENFJ, Bard an ISTJ:Empirical Study on Personalities of Large Language Models.) Jen-tse Huang, Wenxuan Wang, Man Ho Lam, Eric John Li, Wenxiang Jiao, Michael R. Lyu. [abs], 2023.5

• Do llms possess a personality? making the mbti test an amazing evaluation for large language models.

  Keyu Pan, Yawen Zeng. [abs], 2023.7

• Can chatgpt assess human personalities? a general evaluation framework.

  Haocong Rao, Cyril Leung, Chunyan Miao. [abs], 2023.3

• Who is GPT-3? An Exploration of Personality, Values and Demographics.

  Marilù Miotto, Nicola Rossberg, Bennett Kleinberg., [abs], 2022.9

• Editing Personality for LLMs

  Shengyu Mao, Ningyu Zhang, Xiaohan Wang, Mengru Wang, Yunzhi Yao, Yong Jiang, Pengjun Xie, Fei Huang, Huajun Chen., [abs], 2023.10

• MBTI Personality Prediction for Fictional Characters Using Movie Scripts

  Yisi Sang, Xiangyang Mou, Mo Yu, Dakuo Wang, Jing Li, Jeffrey Stanton., [abs], EMNLP 2022

• Unleashing Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration

  Zhenhailong Wang, Shaoguang Mao, Wenshan Wu, Tao Ge, Furu Wei, Heng Ji., [abs], 2023.7

• Open Models, Closed Minds? On Agents Capabilities in Mimicking Human Personalities through Open Large Language Models

  Lucio La Cava, Davide Costa, Andrea Tagarelli., [abs], 2024.1

🧠 Other Psychological Topics

• Theory of Mind May Have Spontaneously Emerged in Large Language Models

  Michal Kosinski. [abs], 2023.2

• Role-Play with Large Language Models Murray Shanahan, Kyle McDonell, and Laria Reynolds.[abs], 2023.5

• Consciousness in artificial intelligence: Insights from the science of consciousness. Patrick Butlin, Robert Long, Eric Elmoznino, Yoshua Bengio, Jonathan Birch, Axel Constant, George Deane, Stephen M. Fleming, Chris Frith, Xu Ji, Ryota Kanai, Colin Klein, Grace Lindsay, Matthias Michel, Liad Mudrik, Megan A. K. Peters, Eric Schwitzgebel, Jonathan Simon, Rufin VanRullen.[abs], 2023.8

• The Self-Perception and Political Biases of ChatGPT.

  Jérôme Rutinowski, Sven Franke, Jan Endendyk, Ina Dormuth, Markus Pauly., 2023.4. Tags: personality traits, political biases, dark personality traits.

• The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientation.

  Jochen Hartmann, Jasper Schwenzow, Maximilian Witte., 2023.1. Tags: political biases.

• Inducing anxiety in large language models increases exploration and bias.

  Julian Coda-Forno, Kristin Witte, Akshay K. Jagadish, Marcel Binz, Zeynep Akata, Eric Schulz., 2023.4. Tags: anxiety.

• Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View.

  Jintian Zhang, Xin Xu, Shumin Deng., 2023.10. Tags: social psychology.

• OpenToM: A Comprehensive Benchmark for Evaluating Theory-of-Mind Reasoning Capabilities of Large Language Models. Hainiu Xu, Runcong Zhao, Lixing Zhu, Jinhua Du, Yulan He. [abs], 2024.2. Tags: ToM.

🌐 Others

---

💡 Contribution

Contributing to this repo

🤲" Join us in improving this repository! Spotted any notable works we might have missed? We welcome your additions. Every contribution counts! "

Contributors