December 2023 - nlplab - mailman.cs.vt.edu

Next week meeting schedule
by Lifu Huang 31 Dec '23

31 Dec '23

Monday: 9:30-10am: Zhiyang, Ying, Zihao 10-10:30am: Ying, Zhiyang 10:30-11am: Zihao 11-11:30pm: Minqian 1:30-2pm: Barry 2-2:30pm: Jingyuan, Zhiyang 2:30-3pm: Mohammad, Jingyuan, Zhiyang, Minqian, Ying 3-3:30pm: Zoe, Sijia 3:30-4pm: Tong, Sijia 4-4:30pm: Sijia 4:30-5pm: Jeet Tuesday: 3-4pm: Trevor, Jingyuan, Minqian, meet with Amazon Thursday: 1-1:30pm: Barry, Jingyuan, meet with STR Friday: 10-10:30am: Zhiyang, Ying, Jingyuan 10:30-10:45am: Zihao 10:45-11am: Barry 11-11:15am: Sijia 11:15-11:45am: Mohammad 4-5pm: reading discussion, Jingyuan lead --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0

[nlp_reading_group] Reading Discussion on Friday Dec 29
by Zhiyang Xu 27 Dec '23

27 Dec '23

Hi Everyone, In the reading discussion this week, we will discuss: Kosmos-G: Generating Images in Context with Multimodal Large Language Models <https://arxiv.org/abs/2310.02992> This paper develops a training framework to efficiently bootstrap pretraining from LLMs and diffusion models for image editing. It effectively tackles the challenge of interleaved multimodal inputs involving multiple images and text pieces. The results demonstrate the high quality of generated images and their fidelity towards source images. The reading discussion is at *4-5 pm on Dec 29 *this Friday. You may attend the reading discussion in Room 366 in the Data & Decision Building, or on Zoom *(https://virginiatech.zoom.us/j/8297378667 <https://virginiatech.zoom.us/j/8297378667>)*. Enjoy reading! Best wishes, Zhiyang Xu _______________________________________________ nlp_reading_group mailing list nlp_reading_group(a)cs.vt.edu https://mailman.cs.vt.edu/mailman/listinfo/nlp_reading_group

1 0

next week meeting schedule
by Lifu Huang 24 Dec '23

24 Dec '23

Wish everyone a Merry Christmas! I will schedule all the one-on-one meetings on Tuesday, and have a catch up meeting with PhDs on Friday. Tuesday: 9:30-10am: Zhiyang, Ying 10-10:30am: Ying, Zhiyang 10:30-11am: Zihao 11-11:30pm: Tong, Sijia 1:30-2pm: Barry 2-2:45pm: Jingyuan, Zhiyang 2:45-3:15pm: Zoe, Sijia 3:15-4pm: Mohammad, Jingyuan, Zhiyang, Minqian, Ying 4-4:30pm: Sijia 4:30-5pm: Mian Thursday: 1-1:30pm: Barry, Jingyuan, meet with STR Friday: 10-10:20am: Zhiyang, Ying, Jingyuan 10:20-10:30am: Mohammad 10:30-10:40am: Zihao 10:40-10:50am: Barry 10:50-11am: Mian 11-11:10am: Sijia 11:10-11:30am: Trevor, Jingyuan 4-5pm: reading discussion, Zhiyang lead --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0

[nlp_reading_group] Reading Discussion on Friday Dec 22
by Zihao Lin 20 Dec '23

20 Dec '23

Hi Everyone, In the reading discussion this week, we will discuss two papers: 1. Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning (*EMNLP'23 Best Paper*) 2. In-Context Learning Creates Task Vectors (*EMNLP'23*) These two papers mainly provide explanations of how LLM works in In-Context Learning. The reading discussion is at *4-5 pm on Dec 22* this Friday. You may attend the reading discussion in Room 336 in the Data & Decision Building, or on Zoom (*https://virginiatech.zoom.us/j/7048491561 <https://virginiatech.zoom.us/j/7048491561>*). Enjoy reading! Best wishes, Zihao Lin

1 0

this week meeting schedule
by Lifu Huang 18 Dec '23

18 Dec '23

Monday: 1:30-2pm: Zihao 3:30-4pm: Tong 4-4:30pm: Sijia Tuesday: 9-9:30am: Minqian 9:30-10:00am: Jingyuan 10-10:30am: Barry 10:30-11am: Zoe 11-11:30am: Mian 1:30-2:15pm: Mohammad, Jingyuan, Zhiyang, Minqian, Ying 3-4pm: Trevor, Jingyuan, Minqian, with Amazon (Trevor pls prepare slides for the experimental results) Thursday: 1-1:30pm: Barry, Jingyuan, meet with STR Friday: 4-5pm: reading discussion, Zihao lead --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0

[nlp_reading_group] Reading Discussion on Friday Dec 15
by Minqian Liu 12 Dec '23

12 Dec '23

Hi Everyone, In the reading discussion this week, we will discuss: Counterfactual Memorization in Neural Language Models <https://arxiv.org/abs/2112.12938> (*NeurIPS'23 Spotlight*) This paper thoroughly analyzed how documents in the training set influence the model's predictions. You may think about the following questions during reading: 1. What are the implications of the findings in this paper, especially in topics such as factual checking and alignment? 2. What are the limitations of this work? The reading discussion is at *4-5 pm on Dec 15 *this Friday. You may attend the reading discussion in Room 366 in the Data & Decision Building, or on Zoom *(https://virginiatech.zoom.us/j/8297378667 <https://virginiatech.zoom.us/j/8297378667>)*. Enjoy reading! Best wishes, Minqian Liu

1 0

[nlp_reading_group] Reading Discussion on Friday Dec 8
by Barry Yao 05 Dec '23

05 Dec '23

Hello everyone, In this week's reading discussion, we will talk about: Skill-it! A Data-Driven Skills Framework for Understanding and Training Language Models <https://openreview.net/forum?id=IoizwO1NLf> (*NeurIPS 2023 spotlight*) This paper proposes a novel data selection approach to train language models efficiently. I highly recommend you read the paper in advance and think about: *1. Could we extend this approach to train a large multimodal model?* *2. The current data selection approach is in a static manner, a.k.a., the skill associated with each data point is predefined. Could we extend the approach to a dynamic manner? For example, could we leverage an LMM to generate feedback or analyze student model errors to select data in a dynamic manner?* You could attend the meeting in the Data & Decision Building, Room 366, or on Zoom ( https://virginiatech.zoom.us/j/4506040955?pwd=TGFtTUVWR2tuYmVlS3JraTQzbjgrU…) at 4-5 pm on Friday. Happy reading! Best regards, Barry Menglong Yao Ph.D. student in Computer Science Virginia Tech Homepage <https://barry-yao.netlify.app/>

1 0

meeting schedules for the following two weeks
by Lifu Huang 03 Dec '23

03 Dec '23

I will be traveling to EMNLP and NeurIPS in the following two weeks. Everyone please send me your weekly updates on Slack and ensure that you are making good progress towards the goals/deadlines we discussed. I will schedule a meeting if necessary. Zhiyang and Minqian, please also help me organize the reading discussion meeting when I’m not here. Thanks, --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0