February 2024 - nlplab - mailman.cs.vt.edu

Next week meeting schedule
by Lifu Huang 25 Feb '24

25 Feb '24

Monday: 9:30-10AM: Zhiyang 10-10:30AM: Ying 10:30-11AM: Zihao, Jingyuan, Zhiyang 11-11:30AM: Minqian, Zhiyang 4-4:30PM: Sijia 4:30-5PM: Tong, Sijia 5-5:30PM: Jeet 5:30-6PM: Zoe, Sijia Tuesday: 9:30-10AM: Barry 10-10:45AM: Mohammad, Ying, Jingyuan, Zhiyang, Minqian 3-4PM: Trevor, Jingyuan, Minqian, meet with Amazon 4-5PM: Zhiyang, Zihao, Ying, meet with Intuit Thursday: 2-2:30PM: Barry, Jingyuan, meet with STR Friday: 10-11AM: Zihao, Jingyuan, Zhiyang, meet with WaPost 4-5pm: reading discussion, Zhiyang lead --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0

Reading Discussion, Feb 23rd: How to Train Data-Efficient LLMs
by Yao, Barry 23 Feb '24

23 Feb '24

Hi Everyone, In the reading discussion this week, we will discuss: How to Train Data-Efficient LLMs<https://arxiv.org/abs/2402.09668> This paper is from Google DeepMind and investigates data-efficient approaches for pre-training LLMs, i.e., techniques that aim to optimize the Pareto frontier of model quality and training resource/data consumption. Their proposed Coverage sampling can recover the performance of the full data, while models trained on their ASK-LLM data consistently outperform full-data training — even when they reject 90% of the original dataset, while converging up to 70% faster. The reading discussion is at 4-5 pm on Feb 23 this Friday. You may attend the reading discussion in Room 366 in the Data & Decision Building, or on Zoom (https://virginiatech.zoom.us/j/4506040955?pwd=TGFtTUVWR2tuYmVlS3JraTQzbjgrU…). Enjoy reading! Best regards, Barry Menglong Yao Ph.D. student in Computer Science Virginia Tech Homepage<https://barry-yao.netlify.app/>

1 1

Next week meeting schedule
by Lifu Huang 18 Feb '24

18 Feb '24

I will be traveling most of the time next week. Everyone please send me your updates with detailed slides on Slack by next Thursday. I will schedule a few one-on-one meetings next Friday or weekend. Tuesday: 4-5PM: Zhiyang, Ying, Zihao, meet with Intuit (Please send me a summary after the meeting) Thursday: 2-2:30PM: Barry and Jingyuan, meet with STR (I will be on a flight so cannot join the meeting. Pls make notes for me) Friday: 10-11AM: Zihao, Jingyuan, Zhiyang, VT internal meeting for WaPost project (Zihao, pls make slides for your progress) 4-5pm: reading discussion, Barry lead --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0

Next week meeting schedule
by Lifu Huang 11 Feb '24

11 Feb '24

I will be traveling for most of the time in the following two weeks, so I will just meet a few of you for the paper submissions: Monday: 9:30-10AM: Zhiyang, Jingyuan 10-10:30AM: Zihao, Jingyuan, Zhiyang 10:30-11AM: Minqian, Zhiyang 11-11:30AM: Ying 11:30-12PM: Sijia Thursday: 2-2:30PM: Barry, Jingyuan, meet with STR Friday: 10-11AM: Zihao, Jingyuan, Zhiyang, meet with Washington Post 4-5pm: reading discussion, Mohammad lead --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0

Next week meeting schedule
by Lifu Huang 04 Feb '24

04 Feb '24

Monday: 9:30-10AM: Zhiyang 10-10:30AM: Jingyuan, Zhiyang 10:30-11AM: Zihao, Jingyuan, Zhiyang 11-11:30AM: Minqian, Zhiyang 11:30-12PM: Ying 4-4:30PM: Sijia 4:30-5PM: Tong, Sijia 5-5:30PM: Jeet Tuesday: 9:30-10AM: Barry 10-10:30AM: Mohammad, Ying, Jingyuan, Zhiyang, Minqian 2-2:30PM: Zoe, Sijia 3-3:30PM: Trevor, Jingyuan 4-5PM: Zhiyang, Zihao, Ying, meet with Intuit Thursday: 2-2:30PM: Barry, Jingyuan, meet with STR Friday: 10-11AM: Zihao, Jingyuan, Zhiyang, VT internal meeting for Washington Post project 4-5pm: reading discussion, Nikita lead --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0