About me
I am a Master student at University of Science and Technology of China. I am fortunately advised by Prof. Xun Yang and also work closely with Prof. Yixin Cao. Previously, I received my B.S. in Artificial Intelligence and Data Science from University of Science and Technology of China in 2023.
My research interest lies in natural language processing, multi-modal information processing and model interpretability. The research directions I am fascinated in and working on include:
- Understanding (Multi-modal) Large Lanaguge Models (Mechanistic Interpretability, etc.)
- How to understand the inner workings of large language models and how can the findings fundamentally help improve large language models in downstream tasks.
- Projects: Multi-modal Neurons, Neuron-level Knowledge Editing
Publications
- Haowen Pan, Xiaozhi Wang, Yixin Cao, Zenglin Shi, Xun Yang, Juanzi Li, Meng Wang. Precise Localization of Memories: A Fine-grained Neuron-level Knowledge Editing Technique for LLMs. ICLR 2025 [pdf] [code]
- Haowen Pan, Yixin Cao, Xiaozhi Wang, Xun Yang, Meng Wang. Finding and Editing Multi-Modal Neurons in Pre-Trained Transformers. Findings of ACL 2024 [pdf] [code]