March 2024 - nlp_reading_group

Reading Discussion on Mar 28
by Liu, Minqian 28 Mar '24

28 Mar '24

Hi Everyone, In the reading discussion this week, we will discuss: Evaluating Large Language Models at Evaluating Instruction Following (ICLR 2024) (https://arxiv.org/abs/2310.07641) The reading discussion is at 4-5 pm on Mar 28 this Friday. You may attend the reading discussion in Room 366 in the Data & Decision Building, or on Zoom (https://virginiatech.zoom.us/j/5961845863<https://www.google.com/url?q=https%3A%2F%2Fvirginiatech.zoom.us%2Fj%2F59618…>). Enjoy reading! Best, Minqian Liu

1 0

Reading Discussion, Mar 21
by Qi, Jingyuan 21 Mar '24

21 Mar '24

Hi Everyone, In the reading discussion this week, we will discuss: RAFT: Adapting Language Model to Domain Specific RAG<https://arxiv.org/abs/2403.10131> This paper proposes a training recipe that improves the model’s ability to answer questions by ignoring those documents that don’t help in an "open-book" in-domain setting. The reading discussion is at 4-5 pm on Mar 1st this Friday. You may attend the reading discussion in Room 366 in the Data & Decision Building, or on Zoom (https://virginiatech.zoom.us/j/5961845863<https://www.google.com/url?q=https%3A%2F%2Fvirginiatech.zoom.us%2Fj%2F59618…>). Enjoy reading! Best, ======================================== Jingyuan Qi Ph.D. student, Department of Computer Science Natural Language Processing Lab Virginia Tech (0710) Blacksburg, VA 24061

1 0

Reading Discussion Mar 15
by Mishra, Indrajeet Kumar 14 Mar '24

14 Mar '24

Hi Everyone, In the reading discussion this week, we will discuss: Denoising diffusion probabilistic models : https://arxiv.org/pdf/2006.11239.pdf This paper proposes a generative image modeling approach that learns the underlying distribution and generates high fidelity images. I will also discuss the idea of how this led to the development of Latent diffusion Models. The reading discussion is at 4-5 pm on Mar 15th this Friday. You may attend the reading discussion in Room 366 in the Data & Decision Building, or on Zoom (https://virginiatech.zoom.us/j/5961845863). Enjoy reading! Thank you Indrajeet Kumar Mishra

1 1

Reading Discussion, Mar 1st
by Xu, Zhiyang 01 Mar '24

01 Mar '24

Hi Everyone, In the reading discussion this week, we will discuss: LLaMA Pro: Progressive LLaMA with Block Expansion<https://arxiv.org/abs/2401.02415> This paper proposes a new post-pretraining method for LLMs with an expansion of Transformer blocks. By tuning the expanded blocks using only new corpus, their method efficiently and effectively improves the model's knowledge without catastrophic forgetting. The reading discussion is at 4-5 pm on Mar 1st this Friday. You may attend the reading discussion in Room 366 in the Data & Decision Building, or on Zoom (https://virginiatech.zoom.us/j/5961845863). Enjoy reading! Best, Zhiyang Xu

1 1