論文 - 馬場口　登

Meeting Recording System via Multimodal Sensing

S. Tokunaga, Y. Ito, N. Nitta, N. Babaguchi

Proc. of Japanese Society for Artificial Inteligence 2005, Workshop on Conversational Informatics   19 - 24   2005年6月

[Panel Discussion] Mobile Multimedia Services 査読

Behzad Shahraray, Wei-Ying Ma, Avideh Zakhor, Noboru Babaguchi

Proc. of WWW2005 Special Interest Tracks and Posters   795   2005年5月

　詳細を見る

14th International World Wide Web Conference (WWW2005), Proc. WWW2005 Special Interest Tracks and Posters

［招待講演］長時間映像メディアのセマンティック処理 招待

馬場口登

2005年3月

　詳細を見る

電子情報通信学会総合大会情報システムソサエティチュートリアル講演，「DT-3. 長時間メディア処理のためのパターン認識・メディア理解の基盤技術」，DT-3-4，SS-8-9

［解説］［招待講演］映像メディアのセマンティック処理について

馬場口登

VIRI Activity Report 2004   3   61 - 67   2005年3月

　詳細を見る

大阪電気通信大学・視覚情報基礎研究施設定例研究会、視覚情報基礎研究施設

Generating semantic descriptions of broadcasted sports videos based on structures of sports games and TV programs 査読

N Nitta, N Babaguchi, T Kitahashi

MULTIMEDIA TOOLS AND APPLICATIONS   25 ( 1 )   59 - 83   2005年1月

　詳細を見る

This paper presents a model to represent a broadcasted sports video in a semantic way and proposes a method of automatically generating semantic descriptions of significant scenes. Representation of a video should clarify the semantic content of the video as accurately as possible. Our model structurizes the video and specifies suitable semantic descriptions for video segments paying attention to the structure of both a sports game and a sports TV program. As the elements of these semantic descriptions, the proposed method tries to obtain the information about the plays and their related players from the closed-caption stream by searching key phrases. Finding the corresponding segments of the video by means of template matching for the image stream attaches these textual descriptions to the proper portion of the video. In this paper, we discuss some experimental results of our method and the potentiality for integrating these results into the standardized MPEG-7 description tools.

［解説］映像要約とメタデータ・ハイディング

馬場口登

生産と技術   57 ( 1 )   52 - 55   2005年1月

Automatic parsing of American football videos by intermodal collaboration based on transition rules 査読

Naoko Nitta, Noboru Babaguchi

IEEE International Conference on Multimedia and Expo, ICME 2005   2005   1114 - 1117   2005年

　詳細を見る

This paper proposes an automatic American football video parsing method based on transition rules of an American football game. Combining the results of live scene extraction and superimposed text detection based on image features enables us to segment the video into play units of a game. Temporally associating the segmented play units with the detected superimposed texts and the closed-caption text attaches possible semantic content information to the play units. Finallly, selecting only the play units which comform to transition rules of the sports game from the obtained play unit sequence, while discarding or complementing unnecessary or insufficient play units and attached semantic content information, realizes the semantic video parsing. © 2005 IEEE.

Interactive clustering of video segments formedia structuring 査読

Y. Kinoshita, N. Nitta, N. Babaguchi

IEEE International Conference on Multimedia and Expo, ICME 2005   2005   630 - 633   2005年

　詳細を見る

Structuring video data is necessary for its effective retrieval and summarization. In particular, collecting similar scenes from semantic aspects highly contributes to the structuring. In this paper, we propose a method of clustering the scenes with relevance feedback, which may be able to bridge the gap between the video data and its semantics. First, spatio-temporal video segments of a fixed length are clustered according to image features of each segment. Then, a user performs feedback to the results of clustering, whether each segment is relevant to the cluster it belongs to. The clustering accuracy can be improved through the interaction based on the feedback information. For diverse kinds of video streams, we investigated how the feedback should be given and demonstrated the effectiveness of the interactive clustering. © 2005 IEEE.

Playwatch: Chart-style video playback interface

Kiyoshi Tanaka, Tsutomu Sasaki, Yoshinobu Tonomura, Tadashi Nakanishi, Noboru Babaguchi

IEEE International Conference on Multimedia and Expo, ICME 2005   2005   731 - 734   2005年

　詳細を見る

This paper proposes the chart-style video playback interface Play Watch
it displays a chart of semantic indices for locating video scenes. The main features of Play Watch are: 1) the user understands the distribution of the scenes because PlayWatch shows the indices in order. 2) The user can access a desired scene directly through the indices since they also act as link buttons. This paper also describes the evaluation of PlayWatch. Experiments on scene searching show that PlayWatch is effective in accessing precisely indexed scenes. ©2005 IEEE.

Video summarization for large sports video archives 査読

Yoshimasa Takahashi, Naoko Nitta, Noboru Babaguchi

IEEE International Conference on Multimedia and Expo, ICME 2005   2005   1170 - 1173   2005年

　詳細を見る

Video summarization is defined as creating a shorter video clip or a video poster which includes only the important scenes in the original video streams. In this paper, we propose two methods of generating a summary of arbitrary length for large sports video archives. One is to create a concise video clip by temporally compressing the amount of the video data. The other is to provide a video poster by spatially presenting the image keyframes which together represent the whole video content. Our methods deal with the metadata which has semantic descriptions of video content. Summaries are created according to the significance of each video segment which is normalized in order to handle large sports video archives. We experimentally verified the effectiveness of our methods by comparing the results with man-made video summaries. © 2005 IEEE.

Automatic Video Summarization of Sports Videos Using Metadata 査読

Y.Takahashi, N.Nitta, N.Babaguchi

Proc. of Fifth IEEE Pacific-Rim Conference on Multimedia (PCM2004)   272 - 280   2004年12月

Clustering of Video Packets Using Interactive Refinement by Relevance Feedback

Y.Kinoshita, N.Nitta, N. Babaguchi

Proc. of Fifth IEEE Pacific-Rim Conference on Multimedia (PCM2004)   626 - 633   2004年12月

Video Scene Retrieval with Sign Sequence Matching Based on Audio Features 査読

K. Morisawa, N. Nitta, N. Babaguchi

Proc. of Fifth IEEE Pacific-Rim Conference on Multimedia (PCM2004)   121 - 129   2004年12月

Embedding MPEG-7 Description in MPEG Video Data by Focusing on DCT-coefficients and Motion Vectors 査読

S. Taniguchi, N.Nitta, N.Babaguchi

Proc. of Pacific Rim Workshop on Digital Steganography 2004 (STEG'04)   80 - 88   2004年11月

Constructive Inductive Learning based on Meta-Attributes 査読

K. Ohara, Y. Onishi, N. Babaguchi, H. Motoda

Proc. of the 7th International Conference on Discovery Science   2004年10月

Properties of Aliasing Factors in Sensitivity Reduction Problems of Sampled-Data Systems 査読

Yoshimichi Ito, Hiroshi Shirahama, Noboru Babaguchi

Proc. of IFAC Workshop on Periodic Control Systems   141 - 144   2004年9月

［招待講演］インターモーダル協調の薦め−マルチモダリティに着目したメディアのセマンティック解析− 招待

馬場口登

2004年9月

　詳細を見る

平成16年度電気関係学会東海支部連合大会併設シンポジウム，知的メディア統合－基礎と応用－，名古屋工業大学

Personalized abstraction of broadcasted American football video by highlight selection 査読

N Babaguchi, Y Kawai, T Ogura, T Kitahashi

IEEE TRANSACTIONS ON MULTIMEDIA   6 ( 4 )   575 - 586   2004年8月

　詳細を見る

Video abstraction is defined as creating shorter video clips or video posters from an original video stream. In this paper, we propose a method of generating a personalized abstract of broadcasted American football video. We first detect significant events in the video stream by matching textual overlays appearing in an image frame with the descriptions of gamestats in which highlights of the game are described. Then, we select highlight shots which should be included in the video abstract from those detected events reflecting on their significance degree and personal preferences, and generate a video clip by connecting the shots augmented with related audio and text. An hour-length video can be compressed into a minute-length personalized abstract. We experimentally verified the effectiveness of this method by comparing man-made video abstracts.

LMI-based stability condition for 2-D discrete systems described by the Fornasini-Marchesini second model 査読

Y Ito, W Date, N Babaguchi

2004 47TH MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL II, CONFERENCE PROCEEDINGS   557 - 560   2004年

　詳細を見る

This paper presents a stability criterion for 2-D discrete systems described by the Fornasini-Marchesini second model. The method presented in this paper is based on linear matrix inequalities (LMI), and hence, it is computationally tractable. In deriving the method, finite-order Fourier series approximation of the solution for frequency-dependent LMI (FDLMI), and the properties of quadratic form representation of finite-order Fourier series play key roles. From the view point of the proposed method, the existing LMI-based condition can be regarded as the one which is obtained by Fourier series approximation of order zero, and thus, it is expected that the proposed method leads to less conservative results. This is illustrated by a numerical example.

Scene retrieval with sign sequence matching based on video and audio features 査読

N Babaguchi, T Ishida, K Morisawa

2004 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXP (ICME), VOLS 1-3   2   1107 - 1110   2004年

　詳細を見る

This paper presents a method of retrieving similar scenes from video streams with sign sequence matching. The visual and auditory streams are partitioned into fixed-length video/audio packets. Based on feature vectors extracted from these packets, sign sequences are formed. The sign sequence can be viewed as abstraction of video and audio features. DP Matching between the target and query sign sequences allows us to find scenes similar to the query in the video stream. For the purpose of efficient processing, packets, histogram based features, and sign sequences, which are the key ideas in this method, are introduced. The preliminary experimental results show that this method is promising for quick retrieval for similar scenes.