[행사/세미나] 인공지능대학원 전문가 초청 세미나(Dr. Ilia Kulikov, Research Scientist @ Meta AI, 4/12 화 10:00~12:00)
- 인공지능학과
- 조회수22528
- 2022-03-31
Title: Oversmoothing problem in neural models and recent advances in direct speech to speech translation
Speaker: Dr. Ilia Kulikov, Research Scientist @ Meta AI
Time : 2022 April 12th 10:00 ~ 12:00
Location:
https://us02web.zoom.us/j/81903892471?pwd=RGtINExpTmMxdVVlN0FOSFJ6SW01QT09
After the talk, we have an informal Q&A session with Dr. Ilia. Please leave any questions about your research or career. You can listen to answers from Dr. Ilia.
Abstract:
In the first part of the talk I will discuss the problem of premature translation being assigned a high probability under the model distribution. We define the oversmoothing rate to quantify this issue. After confirming the high degree of oversmoothing in neural machine translation, we propose to explicitly minimize the oversmoothing rate during training. The proposed notion of oversmoothing explains some of the degeneracies reported earlier, and the proposed mitigation protocol alleviates these degeneracies. In the second part of the talk I will tell about recent approaches to solve direct speech to speech translation tasks, where the goal is to produce a spoken translation without relying on the intermediate text sequences.
Bio:
Dr. Ilia Kulikov is a research scientist at Meta AI where I work on speech translation. He obtained his PhD from New York University in 2022, where he was supervised by Kyunghyun Cho and Jason Weston.