- nlplab - mailman.cs.vt.edu

Reading Discussion on Monday Oct 24
by Ying Shen 21 Oct '22

21 Oct '22

Hello everyone, In next week's reading discussion, we will talk about: Composable Text Controls in Latent Space with ODEs <https://arxiv.org/abs/2208.00638> This paper proposes a new efficient approach for composable text controls in the compact latent space of the text. We will hold the discussion on Monday 4-5 pm in Torgersen 3160A. You may also join via Zoom https://virginiatech.zoom.us/j/5961845863. Hope everyone has a great weekend. Happy reading! Best, Ying

1 0

Reading Discussion on Monday Oct 17th
by Zhiyang Xu 17 Oct '22

17 Oct '22

Hi guys, In the next week's reading discussion, I will talk about LARGE LANGUAGE MODELS ARE HUMAN-LEVEL PROMPT ENGINEERS <https://openreview.net/pdf?id=92gvk82DE-> which addresses the problem of automatic instruction generation and selection. Zoom discussion is available at https://virginiatech.zoom.us/j/5961845863. Best, Zhiyang Xu

1 1

next week meeting schedule
by Lifu Huang 16 Oct '22

16 Oct '22

Monday: 1:30-2pm: Jingyuan 4-5pm: reading discussion, Zhiyang lead (I need to meet with two other professors, so Zhiyang pls lead the discussion) Tuesday: 3:30-4pm: Zhiyang 4-3:30pm: Minqian 4:30-5pm: Xiaochu, Zhiyang, Minqian. (Xiaochu, pls make progress on both writing and experiments) 5-5:30pm: Jeet Wednesday: 10-10:30am: Yuxuan 10:30-11am: Mingchen 11-12pm: Simbot, Minqian, Ying, Zhiyang, Sijia, Menglong, Jingyuan pls attend 1:30-2:30pm: Menglong (pls send me the slides for the progress by Tuesday) 2:30-3pm: Ting-Chih, Ying, Minqian 3-3:30pm: Ying 4-4:30pm: Zoe Thursday: 4-5pm: Group meeting, Zhiyang and Ying pls present your progress 5:30-6:30pm: Kmass-UCSB, Zhiyang, Minqian, Ying and Jingyuan pls attend --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0

next week meeting schedule
by Lifu Huang 09 Oct '22

09 Oct '22

Monday: 10-11am: Jingyuan 11-11:30am: Pritika, Sijia 3-4pm: SimBot Pre-Skill Certification, Minqian, Ying, Zhiyang, Sijia, Menglong, Jingyuan pls attend 4-5pm: reading discussion, Sijia lead Tuesday: 1:30-2:30pm: Zhiyang 2:30-3:30pm: Minqian 4:30-5pm: Xiaochu, Zhiyang, Minqian 5-5:30pm: Jeet Wednesday: 9:30-10am: Zoe 10-10:30am: Yuxuan 10:30-11am: Mingchen 11-12pm: Simbot, Minqian, Ying, Zhiyang, Sijia, Menglong, Jingyuan pls attend 1:30-2:15pm: Menglong 2:15-3pm: Ting-Chih, Ying, Minqian Thursday: (no group meeting given a conflict with another schedule) 5:30-6:30pm: Kmass-UCSB, Zhiyang, Minqian, Ying and Jingyuan pls attend Friday: 3-4pm: VT-Intuit, Sijia pls attend --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0

Reading Discussion on Monday Oct 10
by Sijia Wang 08 Oct '22

08 Oct '22

Hi guys, Next week's reading discussion will be on the following paper Few-Shot Diffusion Models <https://arxiv.org/abs/2205.15463>. I may also cover some discussions from the survey paper on diffusion models A Survey on Generative Diffusion Model. Several questions might help you go through these work are: 1. What are the challenges for few-shot diffusion compared with general diffusion approaches? 2. What makes the proposed method work? 3. How can we extend this work to few-shot language generation? We will hold the discussion meeting in Torgersen 3160A, 4-5 pm on Oct 10. In case the room will be occupied, please get there by 4pm so that you can be informed of the new meeting location. Zoom discussion is available at https://virginiatech.zoom.us/j/5961845863. Enjoy reading! -- Sijia Wang Graduate Student, Department of Computer Science, Virginia Tech, Blacksburg, VA 24061 Phone: +1 (314) 665 8146

1 0

next week meeting schedule
by Lifu Huang 02 Oct '22

02 Oct '22

Monday: 10-11am: Jingyuan 11-11:30am: Pritika 4-5pm: reading discussion, Minqian lead Tuesday: 1:30-2:30pm: Zhiyang 2:30-3:30pm: Minqian 3:30-4pm: Sijia 4:30-5pm: Xiaochu, Zhiyang, Minqian 5-5:30pm: Jeet Wednesday: 9:30-10am: Zoe 10-10:30am: Yuxuan 10:30-11am: Mingchen 11-12pm: Simbot, Minqian, Ying, Zhiyang, Sijia, Menglong, Jingyuan pls attend 1:30-2:30pm: Menglong 2:30-3pm: Ting-Chih, Ying, Minqian 3-4pm: Ying Thursday: 4-5pm: Group meeting, Minqian pls present your progress on continual learning 5:30-6:30pm: Kmass-UCSB, Zhiyang, Minqian, Ying and Jingyuan pls attend --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0

Reading Discussion on Monday Oct 3
by Minqian Liu 30 Sep '22

30 Sep '22

Hi all, In next week's reading discussion I will talk about: Neuro-Symbolic Causal Language Planning with Commonsense Prompting <https://arxiv.org/pdf/2206.02928.pdf> This paper aims to resolve spurious correlations between tasks and action plans learned in LLMs, and proposes to elicit procedural knowledge from the LLMs with commonsense-infused prompting. I highly recommend you read the paper in advance and think about: 1. What's the motivation, novelty, and contribution of this work? 2. What we can learn from this work? Any interesting idea we can derive from this work? 3. What are the limitations and remaining challenges of this work? 4. Any idea to address the remaining challenges? We will hold the discussion on Monday 4-5 pm in Torgersen 3160A. You may also join via Zoom https://virginiatech.zoom.us/j/5961845863. Hope everyone has a great weekend. Happy reading! Best regards, Minqian Liu

1 0

internships of summer’2023
by Lifu Huang 25 Sep '22

25 Sep '22

If you are interested in doing a **research** internship for summer’2023, pls send me your updated resume. I will try my best to pass it to my industry friends. --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0

Reading Discussion on Monday Sep 26th
by Barry Yao 25 Sep '22

25 Sep '22

Hello everyone, In next week's reading discussion, we will talk about: Generative Cooperative Networks for Natural Language Generation <https://arxiv.org/abs/2201.12320> *Abstract:* Generative Adversarial Networks (GANs) have known tremendous success for many continuous generation tasks, especially in the field of image generation. However, for discrete outputs such as language, optimizing GANs remains an open problem with many instabilities, as no gradient can be properly back-propagated from the discriminator output to the generator parameters. An alternative is to learn the generator network via reinforcement learning, using the discriminator signal as a reward, but such a technique suffers from moving rewards and vanishing gradient problems. Finally, it often falls short compared to direct maximum-likelihood approaches. In this paper, we introduce Generative Cooperative Networks, in which the discriminator architecture is cooperatively used along with the generation policy to output samples of realistic texts for the task at hand. We give theoretical guarantees of convergence for our approach and study various efficient decoding schemes to achieve state-of-the-art results in two main NLG tasks empirically. I recommend you read the paper in advance and think about: 1. Why does their method work? 2. How to apply their method to other tasks? We will hold the discussion on Monday 4-5 pm in Torgersen 3160A. You may also join via Zoom <https://virginiatech.zoom.us/j/4506040955?pwd=TGFtTUVWR2tuYmVlS3JraTQzbjgrU…> . Sorry for the short notice. Best regards, Barry Menglong Yao Ph.D. student in Computer Science Virginia Tech Homepage <https://barry-yao.netlify.app/>

1 0

next week meeting schedule
by Lifu Huang 25 Sep '22

25 Sep '22

Monday: 10-11am: Jingyuan 11-11:30am: Pritika 4-5pm: reading discussion, Menglong lead Tuesday: 1:30-2:30pm: Zhiyang 2:30-3:30pm: Minqian 3:30-4pm: Sijia 4:30-5pm: Xiaochu, Zhiyang, Minqian 5-5:30pm: Jeet Wednesday: 9:30-10am: Zoe 10-10:30am: Yuxuan 10:30-11am: Mingchen 11-12pm: Simbot, Minqian, Ying, Zhiyang, Sijia, Menglong, Jingyuan pls attend 1:30-2:30pm: Menglong 2:30-3pm: Ting-Chih, Ying, Minqian 3-4pm: Ying Thursday: 4-5pm: Group meeting, Menglong pls prepare slides to talk about your current work, focusing more on the challenges of dataset construction and proposed models. 5:30-6:30pm: Kmass-UCSB, Zhiyang, Minqian, Ying and Jingyuan pls attend --------------------------------- Lifu Huang Assistant Professor Department of Computer Science Virginia Tech

1 0