Global-Leading Research and Education in Brain and Cognitive engineering KOREA UNIVERSITY our department is trying to foster professional human resources who are to be equipped with creative thinking,
adaptation to new technology and practical application.

Seminar

Board
Colloquium Announcement on Nov. 26, 2018
W-Name Admin (IP: *.152.74.116) W-Date 2018-10-30 11:26 Hit 497


Title: 
AI Sportscaster using Deep Learning and Ontology

Speaker: Prof. Yong-suk Choi (Dept. of Computer Science and Engineering, Hanyang University)

Date: Nov. 26, (Mon.), 2018

Time: 05:00 PM 

Location: Woo Jung Information & Communication bldg., Room 601

Hosted by Dept. of Brain & Cognitive Engineering, Korea University / Institute of Brain and Cognitive Engineering, Korea University / BK21+ Global Leader Development Division in Brain Engineering, Korea University / Interdisciplinary Major in Brain and Cognitive Science

Abstract:

There have been many studies to generate captions or explanations about images or videos using machine learning techniques. A combination of well-known CNN and RNN is often used to generate natural language captions from the features of image frames. Recently, many attention models are also used to understand more detailed and accurate visual contexts. Therefore, deep learning can be a good option to automatically make a caption on a variety of images and videos. However, when considering AI sportscaster like baseball-caster, AI has to create natural language narrations not only from shallow contextual information about who plays what, but also by deeper understanding and reasoning using player/team information, domain knowledge, and a variety of game statistics.

This talk first describes three vision models (scene classifier, player detection, motion recognition) to obtain contextual information from sport-video frames and then presents the usage of ontology to make sportscasting in baseball games. Our AI sportscaster also incorporates on-line text web data related to the target game into the ontology that is built in real-time. We finally illustrate our early version of AI sportscaster for a KBO baseball game by using game statistics and learning motion pictures from September 2017 to April 2018



File 최용석.pdf(118.8K)


Board
No Subject Name W-Date Hit
194 BK21 PLUS Seminar Announcement on Oct. 28, 2019 Admin 19-10-04 32
193 BK21 PLUS Seminar Announcement on Sept. 27, 2019 Admin 19-09-16 48
192 BK21 PLUS Seminar Announcement June 12, 2019 Admin 19-05-17 147
191 BK21 PLUS Seminar Announcement May 2, 2019 Admin 19-04-26 277
190 Colloquium Announcement on May 27, 2019 Admin 19-03-27 712
189 Colloquium Announcement on May 20, 2019 Admin 19-03-27 509
188 Colloquium Announcement on May 13, 2019 Admin 19-03-27 291
187 Colloquium Announcement on Apr. 29, 2019 Admin 19-03-27 246
186 Colloquium Announcement on Apr. 22, 2019 Admin 19-03-27 709
185 Colloquium Announcement on Apr. 15, 2019 Admin 19-03-27 114
1 2 3 4 5 6 7 8 9 10