Awesome LLM Self-Reflection

Inspired by the awesome-embodied-vision

Contributing

When sending PRs, please put the new paper at the correct chronological position as the following format:

* **Paper Title** <br>
*Author(s)* <br>
Conference, Year. [[Paper]](link) [[Code]](link) [[Website]](link)

Papers

• Automatically Correcting Large Language Models: Surveying the landscape of diverse self-correction strategies
  Liangming Pan, Michael Saxon, Wenda Xu, Deepak Nathani, Xinyi Wang, William Yang Wang
  arxiv, 2023. [Paper]

• Reflexion: Language Agents with Verbal Reinforcement Learning
  Shinn, Noah and Cassano, Federico and Labash, Beck and Gopinath, Ashwin and Narasimhan, Karthik and Yao, Shunyu
  arxiv, 2023. [Paper]

• SELF-REFINE: ITERATIVE REFINEMENT WITH SELF-FEEDBACK
  Madaan, Aman and Tandon, Niket and Gupta, Prakhar and Hallinan, Skyler and Gao, Luyu and Wiegreffe, Sarah and Alon, Uri and Dziri, Nouha and Prabhumoye, Shrimai and Yang, Yiming and et al.
  arxiv, 2023. [Paper]

• Large Language Models Can Self-Improve
  Huang, Jiaxin and Gu, ShixiangShane and Hou, Le and Wu, Yuexin and Wang, Xuezhi and Yu, Hongkun and Han, Jiawei
  arxiv, 2022. [Paper]

• Teaching Large Language Models to Self-Debug
  Huang, Jiaxin and Gu, ShixiangShane and Hou, Le and Wu, Yuexin and Wang, Xuezhi and Yu, Hongkun and Han, Jiawei
  arxiv, 2023. [Paper]

• SELFCHECK: USING LLMS TO ZERO-SHOT CHECK THEIR OWN STEP-BY-STEP REASONING
  Miao, Ning and Teh, YeeWhye and Rainforth, Tom
  arxiv, 2023. [Paper]

• ReAct: Synergizing Reasoning and Acting in Language Models
  Yao, Shunyu and Zhao, Jeffrey and Yu, Dian and Du, Nan and Shafran, Izhak and Narasimhan, Karthik and Cao, Yuan
  arxiv, 2022. [Paper]

• Self-Verification Improves Few-Shot Clinical Information Extraction
  Gero, Zelalem and Singh, Chandan and Cheng, Hao and Naumann, Tristan and Galley, Michel and Gao, Jianfeng and Poon, Hoifung
  arxiv, 2023. [Paper]

• Solving Challenging Math Word Problems Using GPT-4 Code Interpreter with Code-based Self-Verification
  Aojun Zhou, Ke Wang, Zimu Lu, Weikang Shi, Sichun Luo, Zipeng Qin, Shaoqing Lu, Anya Jia, Linqi Song, Mingjie Zhan, Hongsheng Li
  arxiv, 2023. [Paper]

• Shepherd: A Critic for Language Model Generation
  Tianlu Wang, Ping Yu, Xiaoqing Ellen Tan, Sean O'Brien, Ramakanth Pasunuru, Jane Dwivedi-Yu, Olga Golovneva, Luke Zettlemoyer, Maryam Fazel-Zarandi, Asli Celikyilmaz
  arxiv, 2023. [Paper]

• Reinforced Self-Training (ReST) for Language Modeling
  Caglar Gulcehre, Tom Le Paine, Srivatsan Srinivasan, Ksenia Konyushkova, Lotte Weerts, Abhishek Sharma, Aditya Siddhant, Alex Ahern, Miaosen Wang, Chenjie Gu, Wolfgang Macherey, Arnaud Doucet, Orhan Firat, Nando de Freitas
  arxiv, 2023. [Paper]

• Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection
  Asai, Akari and Wu, Zeqiu and Wang, Yizhong and Sil, Avirup and Hajishirzi, Hannaneh
  arxiv, 2023. [Paper]

• RRAML: Reinforced Retrieval Augmented Machine Learning
  Bacciu, Andrea and Cocunasu, Florin and Siciliano, Federico and Silvestri, Fabrizio and Tonellotto, Nicola and Trappolini, Giovanni
  arxiv, 2023. [Paper]

• Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution
  Fernando, Chrisantha and Banarse, Dylan and Michalewski, Henryk and Osindero, Simon and Rockt\“aschel, Tim
  arxiv, 2023. [Paper]

• Large Language Models Cannot Self-Correct Reasoning Yet
  Jie Huang, Xinyun Chen, Swaroop Mishra, Huaixiu Steven Zheng, Adams Wei Yu, Xinying Song, Denny Zhou
  arxiv, 2023. [Paper]