November 2023 - Boeing-kcg-vt - mailman.cs.vt.edu

Slides for 11-29-23 Boeing LLM Sustainability meeting
by Patrick Butler 29 Nov '23

29 Nov '23

Please find attached the slides for today's meeting. Just FYI we'll likely spend most of our time demoing the web interface for prompt selection. Thanks, Patrick -- Patrick Butler, PhD Sanghani Center for AI and Data Analytics <https://sanghani.cs.vt.edu/>, Virginia Tech pabutler(a)vt.edu | 540-585-4287

1 0

Re: [Boeing-kcg-vt] Generative AI Project Core Team Meeting
by Sadrpour (US), Amir 16 Nov '23

16 Nov '23

Thank you for the code walk-through, a few areas that I think would have original contributions beyond RAG are as follows. The list is just a suggestion and I hope this group find them useful in some way 1. Using LLMs for parsing heterogeneous data such as pdfs that contain text and tables 2. Constructions of knowledge graphs KGs with LLM from unstructured text 3. Retrieval from KGs using LLMs and GNNs from natural questions 4. Improving the performance of Retrieval * Fine tuning sentence transformers * Enhance user queries with LLM 5. Comparative performance (time and relevancy) analyses of RAG architectures across the following dimensions * LLMs: i. Fine-tuned vs Pre-trained ii. Model size and type iii. Various other hyper-parameters * Indexing i. Pretrained vs fine tuned transformers for text embedding generation ii. Context size impact on performance 1. End to end fine tuning of RAG with synthetic question answers. See this: https://www.youtube.com/watch?v=0QaUqoICNBo Amir Sadrpour, Ph.D. Principal Data Scientist Associate Technical Fellow -----Original Appointment----- From: Grace (US), Miriam <miriam.grace(a)boeing.com> Sent: Thursday, August 17, 2023 7:18 AM To: Grace (US), Miriam; naren(a)cs.vt.edu; Sadrpour (US), Amir; boeing-kcg-vt(a)cs.vt.edu; May (US), Richard; naren.ramakrishnan(a)gmail.com; Hubbard (US), William E; O'Brien (US), Matthew J; Patrick Butler; French (US), David E; Mojtahedzadeh (US), Mohammad; Bhaskara (US), Dolly; shal(a)vt.edu; Russell (US), London G; David Townsend; Chopra, Seema; Tran (US), Lam T; Hassan Keni, Vivek; Laughlin (US), Brian D; Verma, Silky; Nelson (US), David; Meza (US), Katherine I; Paramba, Neena S; Kuntz (US), Emma R; Nath, Manoj; Konda, Mythili Reddy; Kommireddi, Prasanna Sai Chandra; Rastogi, Dhawal; Ngwenya (US), Clara; Nawaz, Shah; Lunger (US), Christopher D; mrichey(a)cs.vt.edu; Guymon (US), Karrie R; Ellstrand (US), Lauren L Subject: Generative AI Project Core Team Meeting When: Wednesday, November 1, 2023 9:00 AM-10:00 AM (UTC-08:00) Pacific Time (US & Canada). Where: The Host Key is 549 012 -- Do not delete or change any of the following text. -- When it's time, join your Webex meeting here. Meeting number (access code): 2533 155 9143 Meeting password: yXYRA9FG6P3 Join meeting<https://boeing.webex.com/boeing/j.php?MTID=ma7300ad0d8a3f37c8ad92b1e2f9306e7> Tap to join from a mobile device (attendees only) +1-425-943-7320,,25331559143##<tel:%2B1-425-943-7320,,*01*25331559143%23%23*01*> U.S. Northwest - Local (free to Boeing) 1-888-787-5387,,25331559143##<tel:1-888-787-5387,,*01*25331559143%23%23*01*> U.S. - Toll-free (highest cost to Boeing) Join by phone +1-425-943-7320 U.S. Northwest - Local (free to Boeing) 1-888-787-5387 U.S. - Toll-free (highest cost to Boeing) Global call-in numbers<https://boeing.webex.com/boeing/globalcallin.php?MTID=m8d784edf0d4bc29cb0fe…> | Toll-free calling restrictions<https://boeing.webex.com/boeing/customer_tollfree_restrictions.pdf> Join from a video system or application Dial 25331559143(a)boeing.webex.com<sip:25331559143@boeing.webex.com> You can also dial 173.243.2.68 and enter your meeting number. If you are a host, click here<https://boeing.webex.com/boeing/j.php?MTID=m47dd4492551814efdccdd8cce0159983> to view host information. Need help? Go to http://help.webex.com

1 0

December 13th Gen AI Meeting
by Grace (US), Miriam 15 Nov '23

15 Nov '23

Hi all - just a reminder that our December 13th Core Team meeting will also be when our Virginia Tech team has the latest report out to our Sustainability Team members, who will be joining us at that meeting. I'm attaching the report out from November 3rd with our Sustainability Team partners just as a reminder on the agreement on the next set of deliverables. At that meeting we will also be discussing next steps as we transition to 2024. Miriam Grace, Ph.D. Senior Technical Fellow 425-306-1606

1 0

Generative AI Project Core Team Meeting
by Grace (US), Miriam 15 Nov '23

15 Nov '23

The Host Key is 549 012 -- Do not delete or change any of the following text. -- When it's time, join your Webex meeting here. Meeting number (access code): 2539 358 1438 Meeting password: yXYRA9FG6P3 Join meeting<https://boeing.webex.com/boeing/j.php?MTID=md40c0da3ac2f4cb8c47e18192a59453e> Tap to join from a mobile device (attendees only) +1-425-943-7320,,25393581438##<tel:%2B1-425-943-7320,,*01*25393581438%23%23*01*> U.S. Northwest - Local (free to Boeing) 1-888-787-5387,,25393581438##<tel:1-888-787-5387,,*01*25393581438%23%23*01*> U.S. - Toll-free (highest cost to Boeing) Join by phone +1-425-943-7320 U.S. Northwest - Local (free to Boeing) 1-888-787-5387 U.S. - Toll-free (highest cost to Boeing) Global call-in numbers<https://boeing.webex.com/boeing/globalcallin.php?MTID=me0d3d9ff7f7bc72ddc33…> | Toll-free calling restrictions<https://boeing.webex.com/boeing/customer_tollfree_restrictions.pdf> Join from a video system or application Dial 25393581438(a)boeing.webex.com<sip:25393581438@boeing.webex.com> You can also dial 173.243.2.68 and enter your meeting number. If you are a host, click here<https://boeing.webex.com/boeing/j.php?MTID=md44d9f86d4cfb1cc810cbb91eefc158d> to view host information. Need help? Go to http://help.webex.com

1 0

Generative AI Project Core Team Meeting
by Grace (US), Miriam 14 Nov '23

14 Nov '23

Hi all - The professor and his graduate team members are in a conference tomorrow, so they won't be able to attend our Core Team meeting. I am not cancelling the meeting as David wants to go over the training roster and feedback we have gotten and I want to be sure if anyone has any questions from the report out last Friday, this would be a good time to surface it - as we will have time to discuss. For those of you on the publication meeting tomorrow, I am also not cancelling that but the Professor will not be able to attend that meeting either. Miriam Grace, Ph.D. Senior Technical Fellow 425-306-1606

1 0

Canceled: Generative AI Project Core Team Meeting
by Grace (US), Miriam 08 Nov '23

08 Nov '23

The Host Key is 549 012

1 0

Report out to Sustainability on Accomplishments to date and Go-Forward Plan
by Grace (US), Miriam 06 Nov '23

06 Nov '23

Hi all - attached is the presentation that documents the great meeting we had with our Sustainability Team partners where we reported out our progress since the last meeting, and provided a go-forward plan that satisfies their emergent requirements as they begin to understand the capabilities that this Gen AI technology can bring to their work. I have invited them to join us at the December 13th meeting, where we will do another report out on the requirements we received from them last Friday when we met w/them to report on our progress. So our Dec 13th meeting will be dedicated to our report out and we will hear feedback on our work and discuss the work we will do between January and April, when our contract with Virginia Tech concludes. The Sustainability Team and its leaders are very excited and encouraged that this technology can make a real improvement in their current practices and they are beginning to imagine the possibilities that will come as they learn more. Please do plan to be at the December 13th meeting to see the results of the work experienced by our clients in this engagement. And remember, this work is in service of one of the most important initiatives of the Boeing Company - and that is being a global champions of sustainable operations, products, & services and being a model for others in our industry to emulate. We thank our Virginia Tech partners for their outstanding performance and for the many "teaching moments" that they have given us over the last 6 months and we look forward to the next 6 months, which will allow us to learn even more, giving us a jump-start on this Gen AI journey, Miriam Grace, Ph.D. Senior Technical Fellow 425-306-1606

1 0

Slides for 11-01-23 Boeing LLM Sustainability meeting
by Patrick Butler 01 Nov '23

01 Nov '23

Please find attached the slides for today's meeting. Patrick -- Patrick Butler, PhD Sanghani Center for AI and Data Analytics <https://sanghani.cs.vt.edu/>, Virginia Tech pabutler(a)vt.edu | 540-585-4287

1 0