[행사/세미나] Designing and Evaluating Language Models for Human Interaction세미나 안내(23. 5. 31. 10:30)
- 인공지능융합학과(일반대학원)
- 조회수1733
- 2023-05-30
안녕하세요 대학원 인공지능융합학과 사무실입니다.
아래와 같이 세미나가 진행될 예정이오니, 관심있는 학생들의 많은 참여 바랍니다.
Title:
Designing and Evaluating Language Models for Human Interaction
Speaker:
Dr. Mina Lee @ Stanford University
Time :
2023 May 31th 10:30 ~ 11:30
Location: Online
https://us02web.zoom.us/j/81557052496?pwd=akoyVTdRVm55YjM0K2tjemZ2YUFZQT09
(Passcode: 0531)
Language:
English speech & English slides
Abstract:
Despite the recent advancements in language models (LMs), most LMs are not optimized for, nor are they evaluated on, real-world usage with human interaction. In this talk, I will present my research on designing and evaluating LMs for human-LM interaction. Concretely, I will first describe how we can support human editing needs by enabling any LM to perform text infilling at any position in a document (i.e., “fill in the blanks”). I will then introduce CoAuthor, a platform for capturing human-LM interaction in collaborative writing as rich, replayable, keystroke-level interaction traces. With the platform, I demonstrate how collecting a large interaction dataset and analyzing the traces provide unique insights into LM capabilities regarding language, ideation, and collaboration. Lastly, I will propose a new framework, HALIE (Human-AI Language-based Interaction Evaluation), that defines the components of interactive systems and evaluation metrics for human-LM interaction beyond writing. I will conclude by discussing open challenges and future directions in this field.
Bio:
Mina Lee is a final-year Ph.D. candidate at Stanford University, advised by Professor Percy Liang. Her research goal is to design and evaluate language models to enhance our productivity and creativity and understand how these models change the way we write. She has built various writing assistants, including an autocomplete system, a contextual thesaurus system, and a creative story writing system, as well as evaluated language models based on their ability to interact with humans and augment human capabilities. She was named one of MIT Technology Review’s Korean Innovators under 35 in 2022, and her work has been published in top-tier venues in natural language processing (e.g., ACL and NAACL), machine learning (e.g., NeurIPS), and human-computer interaction (e.g., CHI). Her recent work on human-AI collaborative writing received an Honorable Mention Award at CHI 2022 and was featured in various media outlets including The Economist.
감사합니다.
대학원 인공지능융합학과 사무실 드림