✨ Hi everyone! I’m a PostDoc (01.2024-) at King’s college London, NLP Group, School of Informatics. I passed my PhD viva with no corrections after a great time in University of Warwick (10.2020-04.2024), advised by Prof. Yulan He and Dr. Lin Gui. I finished my M.S. at Peking University(09.2017-07.2020) and my B.E. at Beihang University(09.2013-06.2017).

During Ph.D., I started my Causality Journey(10.2022-02.2023) in visiting Prof. Kun Zhang affiliated with Causal Learning and Reasoning Group@CMU. Before Ph.D., I started my NLP journey(07.2019-10.2019) in visiting Prof. Wenjie Li affiliated NLP Group @PolyU Hong Kong.

I’ve been incredibly lucky to have a number of amazing collaborators and mentors across KCL and a range of other institutions, including Carnegie Mellon University, MIT, Peking University, MBZUAI, Hong Kong Polytechnic University, University College London,University of Warwick. None of the research so far—would be possible without their kind help and support.

🔍 Research Summary

My research interests lie in the intersection of Machine Learning and Natural Language Processing, i.e., incorporating fundamental representation learning to enhance the interpretability and reliability of different NLP models.

• Mechanistic interpretability (neuron-level) in language models and multi-modal models [EMNLP24,NeurIPS24-RBMF]; self-explainable models with a conceptualised layer linking the input and decision layer [CL22,TKDE24].
• Empirical and principled methods to enhance model robustness over various test inputs, e.g., position bias [ACL24-findings,ACL21-oral], distribution shifts [NeurIPS23] and representation inefficiency in transformer-based models [EMNLP24,EACL-findings,UAI22-spotlight].
• Understanding and enhancing LM’s reasoning capabilities via injecting external commonsense knowledge[ACL21-oral], weak supervision [EMNLP24], appling self-refinement mechanism for factual knowledge reasoning [ACL24]. More recently focus in the two directions:
  • 🔥 Science literture understanding, such as code generation for scientific paper replication on our own SciReplicate-Bench and novelty assessment.
  • 🔥 Reasoning in latent space, such as a position paper about meta-reasoning, CODI in implicit CoT, EmbQA in retrieved-based QA, Embsearch – navigating search in latent space and FPO with sparse feature for preference optimisation.

🔥 News

👩‍🏫 Professional Service

• Co-Chair of Asian Chapter of the Association for Computational Linguistics (Student Research Workshop) 2022
• Reviewers for Computational linguistics:
  
  • AACL23’24, NAACL24’, EACL23’, EMNLP22’23’24’, ACL23’24’25’
• Reviewers for Machine Learning/Artificial Intelligence:
  
  • UAI23’, AISTATS24’25’,NEURIPS24’25’, ICLR25’, ICML25’, NeuroComputing, TOIS, TMLR, Transactions on Big Data

💬 Invited Talks

• Huawei, LLM research team (Singapore). Controllable generation and Causality in LLMs.
• Amazon, Artificial Generative Intelligence team (London& Cambridge). Robust and Interpretable NLP via Representation Learning and applications in LLMs.
• Fudan University, NLP Group, 07/2024. Representation Learning and Mechanistic Interpretability
• UC San Diego, NLP Group, 02/2024. Robust and Interpretable NLP via representation learning and Path Ahead
• Yale University, NLP Group 01/2024. Robust and Interpretable NLP via representation learning and Path Ahead
• Turing AI Fellowship Event, London, 03/2023, Distinguishability Calibration to In-Context Learning
• UKRI Fellows Workshop, University of Edinburgh, 04/2022. Interpreting Long Documents and Recommendation Systems via Latent Variable Models

🚀 I am always open to new collaborations and engaging discussions. Feel free to reach out if you are interested in working together or just want to chat!

📝 Publications

(* indicates equal contribution)

📝 Notes

o1-technical report (notes for video)
Machine Unlearning via CausalLens and in NLP tasks
Reading List For Large Language Model
Identifiability101 in Causality (3rd PhD)
Induction Head_ contribute to In-context Learning (3rd PhD)
Recommendation with Causality (2nd PhD)
Causality101 (Feb 2022, 2nd PhD)
Explaining Neural Networks (Oct 2020 1st PhD)