- nlplab - mailman.cs.vt.edu

Next week meeting schedule
by Lifu Huang 25 Feb '24

25 Feb '24

Monday: 9:30-10AM: Zhiyang 10-10:30AM: Ying 10:30-11AM: Zihao, Jingyuan, Zhiyang 11-11:30AM: Minqian, Zhiyang 4-4:30PM: Sijia 4:30-5PM: Tong, Sijia 5-5:30PM: Jeet 5:30-6PM: Zoe, Sijia Tuesday: 9:30-10AM: Barry 10-10:45AM: Mohammad, Ying, Jingyuan, Zhiyang, Minqian 3-4PM: Trevor, Jingyuan, Minqian, meet with Amazon 4-5PM: Zhiyang, Zihao, Ying, meet with Intuit Thursday: 2-2:30PM: Barry, Jingyuan, meet with STR Friday: 10-11AM: Zihao, Jingyuan, Zhiyang, meet with WaPost 4-5pm: reading discussion, Zhiyang lead --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0

Reading Discussion, Feb 23rd: How to Train Data-Efficient LLMs
by Yao, Barry 23 Feb '24

23 Feb '24

Hi Everyone, In the reading discussion this week, we will discuss: How to Train Data-Efficient LLMs<https://arxiv.org/abs/2402.09668> This paper is from Google DeepMind and investigates data-efficient approaches for pre-training LLMs, i.e., techniques that aim to optimize the Pareto frontier of model quality and training resource/data consumption. Their proposed Coverage sampling can recover the performance of the full data, while models trained on their ASK-LLM data consistently outperform full-data training — even when they reject 90% of the original dataset, while converging up to 70% faster. The reading discussion is at 4-5 pm on Feb 23 this Friday. You may attend the reading discussion in Room 366 in the Data & Decision Building, or on Zoom (https://virginiatech.zoom.us/j/4506040955?pwd=TGFtTUVWR2tuYmVlS3JraTQzbjgrU…). Enjoy reading! Best regards, Barry Menglong Yao Ph.D. student in Computer Science Virginia Tech Homepage<https://barry-yao.netlify.app/>

1 1

Next week meeting schedule
by Lifu Huang 18 Feb '24

18 Feb '24

I will be traveling most of the time next week. Everyone please send me your updates with detailed slides on Slack by next Thursday. I will schedule a few one-on-one meetings next Friday or weekend. Tuesday: 4-5PM: Zhiyang, Ying, Zihao, meet with Intuit (Please send me a summary after the meeting) Thursday: 2-2:30PM: Barry and Jingyuan, meet with STR (I will be on a flight so cannot join the meeting. Pls make notes for me) Friday: 10-11AM: Zihao, Jingyuan, Zhiyang, VT internal meeting for WaPost project (Zihao, pls make slides for your progress) 4-5pm: reading discussion, Barry lead --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0

Next week meeting schedule
by Lifu Huang 11 Feb '24

11 Feb '24

I will be traveling for most of the time in the following two weeks, so I will just meet a few of you for the paper submissions: Monday: 9:30-10AM: Zhiyang, Jingyuan 10-10:30AM: Zihao, Jingyuan, Zhiyang 10:30-11AM: Minqian, Zhiyang 11-11:30AM: Ying 11:30-12PM: Sijia Thursday: 2-2:30PM: Barry, Jingyuan, meet with STR Friday: 10-11AM: Zihao, Jingyuan, Zhiyang, meet with Washington Post 4-5pm: reading discussion, Mohammad lead --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0

Next week meeting schedule
by Lifu Huang 04 Feb '24

04 Feb '24

Monday: 9:30-10AM: Zhiyang 10-10:30AM: Jingyuan, Zhiyang 10:30-11AM: Zihao, Jingyuan, Zhiyang 11-11:30AM: Minqian, Zhiyang 11:30-12PM: Ying 4-4:30PM: Sijia 4:30-5PM: Tong, Sijia 5-5:30PM: Jeet Tuesday: 9:30-10AM: Barry 10-10:30AM: Mohammad, Ying, Jingyuan, Zhiyang, Minqian 2-2:30PM: Zoe, Sijia 3-3:30PM: Trevor, Jingyuan 4-5PM: Zhiyang, Zihao, Ying, meet with Intuit Thursday: 2-2:30PM: Barry, Jingyuan, meet with STR Friday: 10-11AM: Zihao, Jingyuan, Zhiyang, VT internal meeting for Washington Post project 4-5pm: reading discussion, Nikita lead --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0

Next week meeting schedule
by Lifu Huang 28 Jan '24

28 Jan '24

Monday: 9:30-10AM: Zhiyang 10-10:30AM: Ying 10:30-11AM: Minqian 11-11:30PM: Jingyuan, Zhiyang 11:30-12AM: Zihao, Jingyuan, Zhiyang 2-2:30PM: Zoe, Sijia 2:30-3PM: Tong, Sijia 3-4:30PM: Sijia preliminary exam Tuesday: 9:30-10AM: Barry 10-10:30AM: Mohammad, , Jingyuan, Zhiyang, Minqian, Ying 3-4PM: Trevor, Jingyuan, Minqian, meet with Amazon 4-4:30PM: Jeet Friday: 10-11AM: Zihao and Jingyuan, meet with Washington Post 5-6pm: reading discussion, Zihao lead --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0

Consider to submit your work to SouthNLP and COLM
by Lifu Huang 27 Jan '24

27 Jan '24

Everyone please try your best to make a submission to the following two venues: https://southnlp.github.io/southnlp2024/cfp.html https://colmweb.org/cfp.html --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0

Meetings next week
by Lifu Huang 20 Jan '24

20 Jan '24

I will be traveling from tomorrow to next Tuesday and attend the DARPA PI meeting on Wednesday, so I won’t have time to meet everyone. I will mainly work on the paper submissions from Zhiyang, Ying and Zihao and meet some of you on Thursday/Friday. We will still have the reading discussion next Friday, led by Mo. --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0

next week meeting schedule
by Lifu Huang 14 Jan '24

14 Jan '24

Monday: 9:30-10AM: Zhiyang 10-10:30AM: Ying 10:30-11AM: Zihao 11-11:30AM: Minqian 11:30-12PM: Jingyuan, Zhiyang 3-3:30PM: Zoe, Sijia 3:30-4PM: Tong, Sijia 4-4:30PM: Sijia Tuesday: 9:30-10AM: Barry 10-10:30AM: Mohammad, , Jingyuan, Zhiyang, Minqian, Ying 3-4PM: Trevor, Jingyuan, Minqian, meet with Amazon 4-4:40PM: Jeet Friday: 10-12AM: Jingyuan, meet with Washington Post 4-5pm: reading discussion --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0

Fwd: Reminder and correction: ARC Winter Maintenance next week
by Lifu Huang 11 Jan '24

11 Jan '24

--------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech ---------- Forwarded message ---------- From: Advanced Research Computing <arc(a)vt.edu> Date: Jan 10, 2024 at 4:40 PM -0500 To: arc.users <arc.users(a)groups.vt.edu> Subject: Reminder and correction: ARC Winter Maintenance next week > As a reminder, all ARC systems including the clusters Tinkercliffs and Infer, their attached storage systems, and the OnDemand web interface will be offline Tuesday through Thursday next week for regular maintenance. > > Please note that the previous notification had provided dates that were overlapping, but incorrect. The message should have read: > > Winter Maintenance: > > ARC systems will be offline for maintenance Tuesday - Thursday January 16-18, 2024. A major focus during this maintenance will be the recurring Tinkercliffs issue noted above and also regular maintenance activities for ARC storage, clusters, and services. > > > If you submit a job and find that it is queued with a message like "(ReqNodeNotAvail, Reserved for maintenance)", this means that the job's time limit extends into the maintenance period. Since the job cannot be started, it will be held in queue until the cluster is released from maintenance. Jobs whose time limits allow them to complete prior to the 8:00am on Tuesday will still run, subject to resource availability. > > Please terminate any running processes on login nodes and disconnect any connections prior to the start of maintenance at 8:00am on Tuesday. > > Thank you for your understanding. > > Best regards, > > Advanced Research Computing > Virginia Tech

1 0