基本情報

通称等の別名

小川 貴弘

所属

• 情報科学研究院　メディアネットワーク部門　情報メディア学分野

職名

• 教授

学位

• 博士(情報科学)（北海道大学）

ホームページURL

http://kaken.nii.ac.jp/d/r/20524028.ja.html

J-Global ID

• 201301083785167523

プロフィール

• 2003年3月 北海道大学工学部情報工学科 卒業
  2005年3月 北海道大学大学院工学研究科電子情報工学専攻修士課程 修了
  2007年9月 北海道大学大学院情報科学研究科メディアネットワーク専攻博士後期課程 修了
  2007年9月～2008年3月 日本学術振興会特別研究員
  2008年3月～2008年6月 北海道大学大学院情報科学研究科博士研究員
  2008年7月～2016年9月 北海道大学大学院情報科学研究科 助教
  2016年10月～2019年3月 北海道大学大学院情報科学研究科 准教授
  2019年4月～現在北海道大学大学院情報科学研究院 准教授
  画像復元及び映像処理に関する研究に従事．博士(情報科学)．
  IEEE，電子情報通信学会，ACM，映像情報メディア学会各会員．

  
  

  業績リストHP：

  
  

  https://www-lmd.ist.hokudai.ac.jp/member/takahiro-ogawa/

研究キーワード

• 画像生成   行動解析   マルチスペクトル解析   機械学習   深層学習   CT   PET   X線画像   SNS   電子顕微鏡   信号処理   画像処理   可視化   NIRS   MRI   マルチメディア処理   スポーツ映像   社会基盤   衛星画像   EEG   医用画像   多変量解析   画像符号化   超解像   Webマイニング   ビッグデータ   IoT   人工知能   画質評価   画像復元   画像再構成   テキスト処理   情報検索   音楽   画像検索   意味理解   

研究分野

• 情報通信 / ヒューマンインタフェース、インタラクション
• 情報通信 / データベース

担当教育組織

•  学士課程　工学部
•  修士課程　情報科学院
•  博士課程　情報科学院

職歴

• 2023年01月 - 現在 北海道大学 大学院情報科学研究院 教授
• 2019年04月 - 2023年01月 北海道大学 大学院情報科学研究院 准教授
• 2016年10月 - 2019年03月 北海道大学 大学院情報科学研究科 准教授
• 2008年07月 - 2016年09月 北海道大学 大学院情報科学研究科 助教
• 2008年04月 - 2008年06月 北海道大学大学院情報科学研究科 博士研究員
• 2005年04月 - 2008年03月 北海道大学大学院情報科学研究科 日本学術振興会特別研究員

学歴

• 2005年04月 - 2007年09月   北海道大学   大学院情報科学研究科メディアネットワーク専攻博士課程
• 2003年04月 - 2005年03月   北海道大学   大学院工学研究科学研究科電子情報工学専攻修士課程
• 1999年04月 - 2003年03月   北海道大学   工学部

所属学協会

• Association for Computing Machinery   IEEE   映像情報メディア学会   電子情報通信学会   

研究活動情報

論文

• Visual Emotion Recognition Through Multimodal Cyclic-Label Dequantized Gaussian Process Latent Variable Model.

  Naoki Saito 0006, Keisuke Maeda, Takahiro Ogawa 0001, Satoshi Asamizu, Miki Haseyama

  Journal of Robotics and Mechatronics 35 5 1321 - 1330 2023年10月
• Self-supervised learning for gastritis detection with gastric X-ray images.

  Guang Li 0008, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  International Journal of Computer Assisted Radiology and Surgery 18 10 1841 - 1848 2023年10月
• Off-Screen Sound Separation Based on Audio-visual Pre-training Using Binaural Audio

  Masaki Yoshida, Ren Togo, Takahiro Ogawa, Miki Haseyama

  SENSORS 23 9 4540 - 4540 2023年05月 

  This study proposes a novel off-screen sound separation method based on audio-visual pre-training. In the field of audio-visual analysis, researchers have leveraged visual information for audio manipulation tasks, such as sound source separation. Although such audio manipulation tasks are based on correspondences between audio and video, these correspondences are not always established. Specifically, sounds coming from outside a screen have no audio-visual correspondences and thus interfere with conventional audio-visual learning. The proposed method separates such off-screen sounds based on their arrival directions using binaural audio, which provides us with three-dimensional sensation. Furthermore, we propose a new pre-training method that can consider the off-screen space and use the obtained representation to improve off-screen sound separation. Consequently, the proposed method can separate off-screen sounds irrespective of the direction from which they arrive. We conducted our evaluation using generated video data to circumvent the problem of difficulty in collecting ground truth for off-screen sounds. We confirmed the effectiveness of our methods through off-screen sound detection and separation tasks.
• Multimodal Natural Language Explanation Generation for Visual Question Answering Based on Multiple Reference Data

  He Zhu, Ren Togo, Takahiro Ogawa, Miki Haseyama

  ELECTRONICS 12 10 2023年05月 

  As deep learning research continues to advance, interpretability is becoming as important as model performance. Conducting interpretability studies to understand the decision-making processes of deep learning models can improve performance and provide valuable insights for humans. The interpretability of visual question answering (VQA), a crucial task for human-computer interaction, has garnered the attention of researchers due to its wide range of applications. The generation of natural language explanations for VQA that humans can better understand has gradually supplanted heatmap representations as the mainstream focus in the field. Humans typically answer questions by first identifying the primary objects in an image and then referring to various information sources, both within and beyond the image, including prior knowledge. However, previous studies have only considered input images, resulting in insufficient information that can lead to incorrect answers and implausible explanations. To address this issue, we introduce multiple references in addition to the input image. Specifically, we propose a multimodal model that generates natural language explanations for VQA. We introduce outside knowledge using the input image and question and incorporate object information into the model through an object detection module. By increasing the information available during the model generation process, we significantly improve VQA accuracy and the reliability of the generated explanations. Moreover, we employ a simple and effective feature fusion joint vector to combine information from multiple modalities while maximizing information preservation. Qualitative and quantitative evaluation experiments demonstrate that the proposed method can generate more reliable explanations than state-of-the-art methods while maintaining answering accuracy.
• Boosting automatic COVID-19 detection performance with self-supervised learning and batch knowledge ensembling.

  Guang Li 0008, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  Comput. Biol. Medicine 158 106877 - 106877 2023年05月
• 画像の感情推定のためのラベル逆量子化を導入した正準相関分析

  斉藤 直輝, 前田 圭介, 小川 貴弘, 浅水 仁, 長谷山 美紀

  電子情報通信学会論文誌D 情報・システム J106-D 5 337 - 348 2023年05月01日 

  本論文では，画像の感情推定のためのラベル逆量子化を導入した正準相関分析であるSupervised Multi-view Canonical Correlation Analysis via Cyclic Label Dequantization (sMVCCA-CLD)を提案する．ラベルから算出される特徴量(ラベル特徴量)の次元数は他の特徴量と比較して小さいため，従来のCCAでは，構築する空間の次元数の低下により特徴量間の相関関係の表現が困難となる問題点が存在する．そこで，sMVCCA-CLDでは，ラベル特徴量の次元数をラベル逆量子化により増加させながら，特徴量間の相関を最大化することで，次元数の制約を受けない共通潜在空間の構築を可能とする．更に，感情が円環状に配置されることを考慮してラベル逆量子化を行うことで，感情推定に適した共通潜在空間の構築を可能とする．以上で構築された空間に射影された新たな特徴量を利用することで，高精度な感情推定が可能となる．
• COVID-19 detection based on self-supervised transfer learning using chest X-ray images.

  Guang Li 0008, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  Int. J. Comput. Assist. Radiol. Surg. 18 4 715 - 722 2023年04月
• Estimation of Degradation Degree in Road Infrastructure Based on Multi-Modal ABN Using Contrastive Learning.

  Takaaki Higashi, Naoki Ogawa, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  Sensors 23 3 1657 - 1657 2023年02月
• Diversity Learning Based on Multi-Latent Space for Medical Image Visual Question Generation.

  He Zhu, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  Sensors 23 3 1057 - 1057 2023年02月
• データ横断型対照学習を用いた道路構造物における変状画像の劣化レベル分類

  東孝明, 小川直輝, 前田圭介, 小川貴弘, 長谷山美紀

  AI・データサイエンス論文集(Web) 4 2 2023年
• Few-Shot Personalized Saliency Prediction Using Tensor Regression for Preserving Structural Global Information.

  Yuya Moroto, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  CoRR abs/2307.02799 2023年
• Personalized Content Recommender System via Non-verbal Interaction Using Face Mesh and Facial Expression.

  Yuya Moroto, Rintaro Yanagi, Naoki Ogawa, Kyohei Kamikawa, Keigo Sakurai, Ren Togo, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  ACM Multimedia 9399 - 9401 2023年
• Gromov-Wasserstein Autoencoders.

  Nao Nakagawa, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  ICLR 2023年
• Proficiency-level Estimation Using Heterogeneous Features via Label Dequantized CCA.

  Tatsuki Seino, Naoki Saito 0006, Takahiro Ogawa 0001, Satoshi Asamizu, Miki Haseyama

  ICCE-Taiwan 813 - 814 2023年
• Parameter-efficient Tuning of a Pre-trained Model via Prompt Learning in Cross-modal Retrieval.

  Huaying Zhang, Rintaro Yanagi, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  ICCE-Taiwan 811 - 812 2023年
• Binaural Audio Generation with Data Augmentation from 360° Videos.

  Masaki Yoshida, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  ICCE-Taiwan 795 - 796 2023年
• Prediction of Shoot Events by Considering Spatio-temporal Relations of Multimodal Features.

  Ryota Goka, Yuya Moroto, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  ICCE-Taiwan 793 - 794 2023年
• Shoot Event Prediction in Soccer Considering Expected Goals Based on Players' Positions.

  Ryota Goka, Yuya Moroto, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  ICCE-Taiwan 449 - 450 2023年
• Estimation of Amyloid-β Positivity Using QSM Images Considering Age Information.

  Tsubasa Kunieda, Ren Togo, Noriko Nishioka, Yukie Shimizu, Shiro Watanabe, Kenji Hirata, Keisuke Maeda, Takahiro Ogawa 0001, Kohsuke Kudo, Miki Haseyama

  ICCE-Taiwan 165 - 166 2023年
• A Medical Domain Visual Question Generation Model via Large Language Model.

  He Zhu, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  ICCE-Taiwan 163 - 164 2023年
• Defense Against Black-Box Adversarial Attacks Via Heterogeneous Fusion Features.

  Jiahuan Zhang, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  ICASSP 1 - 5 2023年
• Binauralization Robust To Camera Rotation Using 360° Videos.

  Masaki Yoshida, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  ICASSP 1 - 5 2023年
• Learning Graph Laplacian from Intrinsic Patterns via Gaussian Process.

  Koshi Watanabe, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  ICASSP 1 - 5 2023年
• Estimation of Visual Contents from Human Brain Signals via VQA Based on Brain-Specific Attention.

  Ryo Shichida, Ren Togo, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  ICASSP 1 - 5 2023年
• Class-Aware Shared Gaussian Process Dynamic Model.

  Ryosuke Sawata, Takahiro Ogawa 0001, Miki Haseyama

  ICASSP 1 - 5 2023年
• Improving Dropout in Graph Convolutional Networks for Recommendation via Contrastive Loss.

  Hiroki Okamura, Keisuke Maeda, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  ICASSP 1 - 5 2023年
• Multi-Label Classification in Anime Illustrations Based on Hierarchical Attribute Relationships.

  Ziwen Lan, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  Sensors 23 10 4798 - 4798 2023年
• Prediction of Shooting Events in Soccer Videos Using Complete Bipartite Graphs and Players' Spatial-Temporal Relations.

  Ryota Goka, Yuya Moroto, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  Sensors 23 9 4506 - 4506 2023年
• Material Compound-Property Retrieval Using Electron Microscope Images for Rubber Material Development.

  Rintaro Yanagi, Ren Togo, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  IEEE Access 11 88258 - 88264 2023年
• Hierarchical Multi-Label Attribute Classification With Graph Convolutional Networks on Anime Illustration.

  Ziwen Lan, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  IEEE Access 11 35447 - 35456 2023年
• SpectralMAP: Approximating Data Manifold With Spectral Decomposition

  Koshi Watanabe, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  IEEE ACCESS 11 31530 - 31540 2023年 

  Dimensionality reduction is widely used to visualize complex high-dimensional data. This study presents a novel method for effective data visualization. Previous methods depend on local distance measurements for data manifold approximation. This leads to unreliable results when a data manifold locally oscillates because of some undesirable effects, such as noise effects. In this study, we overcome this limitation by introducing a dual approximation of a data manifold. We roughly approximate a data manifold with a neighborhood graph and prune it with a global filter. This dual scheme results in local oscillation robustness and yields effective visualization with explicit global preservation. We consider a global filter based on principal component analysis frameworks and derive it with the spectral information of the original high-dimensional data. Finally, we experiment with multiple datasets to verify our method, compare its performance to that of state-of-the-art methods, and confirm the effectiveness of our novelty and results.
• Summarizing Data Structures with Gaussian Process and Robust Neighborhood Preservation

  Koshi Watanabe, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT V 13717 157 - 173 2023年 

  Latent variable models summarize high-dimensional data while preserving its many complex properties. This paper proposes a locality-aware and low-rank approximated Gaussian process latent variable model (LolaGP) that can preserve the global relationship and local geometry in the derivation of the latent variables. We realize the global relationship by imitating the sample similarity non-linearly and the local geometry based on our newly constructed neighborhood graph. Formally, we derive LolaGP from GP-LVM and implement a locality-aware regularization to reflect its adjacency relationship. The neighborhood graph is constructed based on the latent variables, making the local preservation more resistant to noise disruption and the curse of dimensionality than the previous methods that directly construct it from the high-dimensional data. Furthermore, we introduce a new lower bound of a log-posterior distribution based on low-rank matrix approximation, which allows LolaGP to handle larger datasets than the conventional GP-LVM extensions. Our contribution is to preserve both the global and local structures in the derivation of the latent variables using the robust neighborhood graph and introduce the scalable lower bound of the log-posterior distribution. We conducted an experimental analysis using synthetic as well as images with and without highly noise disrupted datasets. From both qualitative and quantitative standpoint, our method produced successful results in all experimental settings.
• Recallable Question Answering-Based Re-Ranking Considering Semantic Region for Cross-Modal Retrieval

  Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama

  IEEE OPEN JOURNAL OF SIGNAL PROCESSING 4 1 - 11 2023年 

  Question answering (QA)-based re-ranking methods for cross-modal retrieval have been recently proposed to further narrow down similar candidate images. The conventional QA-based re-ranking methods provide questions to users by analyzing candidate images, and the initial retrieval results are re-ranked based on the user's feedback. Contrary to these developments, only focusing on performance improvement makes it difficult to efficiently elicit the user's retrieval intention. To realize more useful QA-based re-ranking, considering the user interaction for eliciting the user's retrieval intention is required. In this paper, we propose a QA-based re-ranking method with considering two important factors for eliciting the user's retrieval intention: query-image relevance and recallability. Considering the query-image relevance enables to only focus on the candidate images related to the provided query text, while, focusing on the recallability enables users to easily answer the provided question. With these procedures, our method can efficiently and effectively elicit the user's retrieval intention. Experimental results using Microsoft Common Objects in Context and computationally constructed dataset including similar candidate images show that our method can improve the performance of the cross-modal retrieval methods and the QA-based re-ranking methods.
• Interpretable Visual Question Answering Referring to Outside Knowledge.

  He Zhu, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  CoRR abs/2303.04388 2023年
• Text-Guided Image Manipulation via Generative Adversarial Network With Referring Image Segmentation-Based Guidance.

  Yuto Watanabe, Ren Togo, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  IEEE Access 11 42534 - 42545 2023年
• Cross-Modal Image Retrieval Considering Semantic Relationships With Many-to-Many Correspondence Loss.

  Huaying Zhang, Rintaro Yanagi, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  IEEE Access 11 10675 - 10686 2023年
• Similar interior coordination image retrieval with multi-view features

  Ren Togo, Yuki Honma, Maiku Abe, Takahiro Ogawa, Miki Haseyama

  International Journal of Multimedia Information Retrieval 11 4 731 - 740 2022年08月26日
• Brain Decoding of Multiple Subjects for Estimating Visual Information Based on a Probabilistic Generative Model

  Takaaki Higashi, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  SENSORS 22 16 6148 - 6148 2022年08月 

  Brain decoding is a process of decoding human cognitive contents from brain activities. However, improving the accuracy of brain decoding remains difficult due to the unique characteristics of the brain, such as the small sample size and high dimensionality of brain activities. Therefore, this paper proposes a method that effectively uses multi-subject brain activities to improve brain decoding accuracy. Specifically, we distinguish between the shared information common to multi-subject brain activities and the individual information based on each subject's brain activities, and both types of information are used to decode human visual cognition. Both types of information are extracted as features belonging to a latent space using a probabilistic generative model. In the experiment, an publicly available dataset and five subjects were used, and the estimation accuracy was validated on the basis of a confidence score ranging from 0 to 1, and a large value indicates superiority. The proposed method achieved a confidence score of 0.867 for the best subject and an average of 0.813 for the five subjects, which was the best compared to other methods. The experimental results show that the proposed method can accurately decode visual cognition compared with other existing methods in which the shared information is not distinguished from the individual information.
• Defect Detection of Subway Tunnels Using Advanced U-Net Network

  An Wang, Ren Togo, Takahiro Ogawa, Miki Haseyama

  SENSORS 22 6 2330 - 2330 2022年03月 

  In this paper, we present a novel defect detection model based on an improved U-Net architecture. As a semantic segmentation task, the defect detection task has the problems of background-foreground imbalance, multi-scale targets, and feature similarity between the background and defects in the real-world data. Conventionally, general convolutional neural network (CNN)-based networks mainly focus on natural image tasks, which are insensitive to the problems in our task. The proposed method has a network design for multi-scale segmentation based on the U-Net architecture including an atrous spatial pyramid pooling (ASPP) module and an inception module, and can detect various types of defects compared to conventional simple CNN-based methods. Through the experiments using a real-world subway tunnel image dataset, the proposed method showed a better performance than that of general semantic segmentation including state-of-the-art methods. Additionally, we showed that our method can achieve excellent detection balance among multi-scale defects.
• Microscopy and biomimetics: the NanoSuit® method and image retrieval platform

  Takahiko Hariyama, Yasuharu Takaku, Hideya Kawasaki, Masatsugu Shimomura, Chiyo Senoh, Yumi Yamahama, Atsushi Hozumi, Satoru Ito, Naoto Matsuda, Satoshi Yamada, Toshiya Itoh, Miki Haseyama, Takahiro Ogawa, Naoki Mori, Shuhei So, Hidefumi Mitsuno, Masahiro Ohara, Shuhei Nomura, Masao Hirasaka

  Microscopy 71 1 1 - 12 2022年01月29日 

  Abstract This review aims to clarify a suitable method towards achieving next-generation sustainability. As represented by the term ‘Anthropocene’, the Earth, including humans, is entering a critical era; therefore, science has a great responsibility to solve it. Biomimetics, the emulation of the models, systems and elements of nature, especially biological science, is a powerful tool to approach sustainability problems. Microscopy has made great progress with the technology of observing biological and artificial materials and its techniques have been continuously improved, most recently through the NanoSuit® method. As one of the most important tools across many facets of research and development, microscopy has produced a large amount of accumulated digital data. However, it is difficult to extract useful data for making things as biomimetic ideas despite a large amount of biological data. Here, we would like to find a way to organically connect the indispensable microscopic data with the new biomimetics to solve complex human problems.
• 異種特徴間の相関およびAttention Mapの確信度を考慮可能な変状画像の劣化レベル分類

  小川直輝, 前田圭介, 小川貴弘, 長谷山美紀

  AI・データサイエンス論文集(Web) 3 J2 2022年
• テキストおよび画像情報に基づくFocal Lossを導入した深層学習による冬期路面状態の分類

  諸戸祐哉, 前田圭介, 藤後廉, 小川貴弘, 長谷山美紀

  AI・データサイエンス論文集(Web) 3 J2 2022年
• 地下鉄トンネル点検時の一人称視点映像を用いたVision Transformerに基づく変状検出

  櫻井慶悟, 前田圭介, 藤後廉, 小川貴弘, 長谷山美紀

  AI・データサイエンス論文集(Web) 3 J2 2022年
• インフラ施設の変状の評価を支援する効率的な映像提示に向けた技術者の点検動作分類

  上川恭平, 前田圭介, 藤後廉, 小川貴弘, 長谷山美紀

  AI・データサイエンス論文集(Web) 3 J2 2022年
• Popularity-Aware Graph Social Recommendation for Fully Non-Interaction Users.

  Nozomu Onodera, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  Proceedings of the 4th ACM International Conference on Multimedia in Asia(MMAsia) 30 - 5 2022年
• Affective Embedding Framework with Semantic Representations from Tweets for Zero-Shot Visual Sentiment Prediction.

  Yingrui Ye, Yuya Moroto, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  Proceedings of the 4th ACM International Conference on Multimedia in Asia(MMAsia) 6 - 7 2022年
• Visual Sentiment Prediction Using Cross-Way Few-Shot Learning Based on Knowledge Distillation.

  Yingrui Ye, Yuya Moroto, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  2022 IEEE International Conference on Image Processing(ICIP) 3838 - 3842 2022年
• Human-Centric Image Retrieval with Gaze-Based Image Captioning.

  Yuhu Feng, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  2022 IEEE International Conference on Image Processing(ICIP) 3828 - 3832 2022年
• Few-Shot Personalized Saliency Prediction with Similarity of Gaze Tendency Using Object-Based Structural Information.

  Yuya Moroto, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  2022 IEEE International Conference on Image Processing(ICIP) 3823 - 3827 2022年
• Gaussian Distributed Graph Constrained Multi-Modal Gaussian Process Latent Variable Model for Ordinal Labeled Data.

  Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  2022 IEEE International Conference on Image Processing(ICIP) 3798 - 3802 2022年
• GCN-Based Multi-Modal Multi-Label Attribute Classification in Anime Illustration Using Domain-Specific Semantic Features.

  Ziwen Lan, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  2022 IEEE International Conference on Image Processing(ICIP) 2021 - 2025 2022年
• Trend Prediction of Students' Mock Examination Results Using Matrix Completion.

  Yutaka Yamada, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  11th IEEE Global Conference on Consumer Electronics(GCCE) 891 - 892 2022年
• Shoot Event Prediction from Soccer Videos by Considering Players' Spatio-Temporal Relations.

  Ryota Goka, Yuya Moroto, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  11th IEEE Global Conference on Consumer Electronics(GCCE) 406 - 407 2022年
• Refinement of Gaze-based Image Caption for Image Retrieval.

  Yuhu Feng, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  11th IEEE Global Conference on Consumer Electronics(GCCE) 272 - 273 2022年
• Brain Decoding of Multiple Subjects for Estimating Visual Information Based on a Probabilistic Generative Model.

  Takaaki Higashi, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  Sensors 22 16 6148 - 6148 2022年
• Boosting Automatic COVID-19 Detection Performance with Self-Supervised Learning and Batch Knowledge Ensembling.

  Guang Li 0008, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  CoRR abs/2212.09281 2022年
• COVID-19 Detection Based on Self-Supervised Transfer Learning Using Chest X-Ray Images.

  Guang Li 0008, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  CoRR abs/2212.09276 2022年
• Union-set Multi-source Model Adaptation for Semantic Segmentation.

  Zongyao Li, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  CoRR abs/2212.02785 2022年
• RGMIM: Region-Guided Masked Image Modeling for COVID-19 Detection.

  Guang Li 0008, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  CoRR abs/2211.00313 2022年
• Rubber Material Retrieval System using Electron Microscope Images for Rubber Material Development.

  Rintaro Yanagi, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  MMAsia 44 - 3 2022年
• Disentangled Image Attribute Editing in Latent Space via Mask-Based Retention Loss.

  Shunya Ohaga, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  MMAsia 25 - 7 2022年
• Assessment of Image Manipulation Using Natural Language Description: Quantification of Manipulation Direction.

  Yuto Watanabe, Ren Togo, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  ICIP 1046 - 1050 2022年
• Improving Model Adaptation for Semantic Segmentation by Learning Model-Invariant Features with Multiple Source-Domain Models.

  Zongyao Li, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  ICIP 421 - 425 2022年
• A Multimodal Interpretable Visual Question Answering Model Introducing Image Caption Processor.

  He Zhu, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 777 - 778 2022年
• Cross-modal Image Retrieval Considering Semantic Relationships with Object Information.

  Huaying Zhang, Rintaro Yanagi, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 775 - 776 2022年
• Free-viewpoint Sports Video Generation Based on Dynamic NeRF Considering Time Series.

  Masato Kawai, Rintaro Yanagi, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 408 - 409 2022年
• Content-based Image Retrieval Using Effective Synthesized Images from Different Camera Views via pixelNeRF.

  Yuki Era, Ren Togo, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 404 - 405 2022年
• Analysis of Relationships between Visual Cognitive Contents and Response of Each Brain Region via Visual Question Answering.

  Ryo Shichida, Ren Togo, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 402 - 403 2022年
• GCN-based Collaborative Filtering Considering Personality Bias.

  Hiroki Okamura, Keisuke Maeda, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 278 - 279 2022年
• Prediction of Amyloid-β Positivity Using QSM Images Based on Bootstrap Your Own Latent.

  Tsubasa Kunieda, Ren Togo, Noriko Nishioka, Yukie Shimizu, Shiro Watanabe, Kenji Hirata, Keisuke Maeda, Takahiro Ogawa 0001, Kohsuke Kudo, Miki Haseyama

  GCCE 137 - 138 2022年
• Cross-platform Recommendation Considering Common Users' Preferences Based on Preference Propagation GraphNet.

  Kazuki Yamamoto, Keisuke Maeda, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 135 - 136 2022年
• Union-Set Multi-source Model Adaptation for Semantic Segmentation.

  Zongyao Li, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  ECCV (29) 579 - 595 2022年
• Trial Analysis of the Relationship between Taste and Biological Information Obtained While Eating Strawberries for Sensory Evaluation.

  Keisuke Maeda, Ren Togo, Takahiro Ogawa 0001, Shin-ichi Adachi, Fumiaki Yoshizawa, Miki Haseyama

  Sensors 22 23 9496 - 9496 2022年
• Distress Detection in Subway Tunnel Images via Data Augmentation Based on Selective Image Cropping and Patching.

  Keisuke Maeda, Saya Takada, Tomoki Haruyama, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  Sensors 22 22 8932 - 8932 2022年
• Compressed gastric image generation based on soft-label dataset distillation for medical data sharing.

  Guang Li 0008, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  Comput. Methods Programs Biomed. 227 107189 - 107189 2022年
• Dataset Complexity Assessment Based on Cumulative Maximum Scaled Area Under Laplacian Spectrum.

  Guang Li 0008, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  CoRR abs/2209.14743 2022年
• Compressed Gastric Image Generation Based on Soft-Label Dataset Distillation for Medical Data Sharing.

  Guang Li 0008, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  CoRR abs/2209.14635 2022年
• Dataset Distillation using Parameter Pruning.

  Guang Li 0008, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  CoRR abs/2209.14609 2022年
• Dataset Distillation for Medical Dataset Sharing.

  Guang Li 0008, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  CoRR abs/2209.14603 2022年
• Gromov-Wasserstein Autoencoders.

  Nao Nakagawa, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  CoRR abs/2209.07007 2022年
• TriBYOL: Triplet BYOL for Self-Supervised Representation Learning.

  Guang Li 0008, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  CoRR abs/2206.03012 2022年
• Self-Knowledge Distillation based Self-Supervised Learning for Covid-19 Detection from Chest X-Ray Images.

  Guang Li 0008, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  CoRR abs/2206.03009 2022年
• Generating Captions of Imagined content from Human Brain Activities Applying An Image Captioning Model.

  Saya Takada, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  4th IEEE Global Conference on Life Sciences and Technologies(LifeTech) 614 - 615 2022年
• Knowledge-Guided Sequential Recommendation with Reinforcement Learning Using Empirical Distribution Function.

  Keigo Sakurai, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  4th IEEE Global Conference on Life Sciences and Technologies(LifeTech) 187 - 188 2022年
• Transformer Based Multimodal Scene Recognition in Soccer Videos.

  Yaozong Gan, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  ICME Workshops 1 - 6 2022年
• Scene Retrieval in Soccer Videos by Spatial-temporal Attention with Video Vision Transformer.

  Yaozong Gan, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  ICCE-TW 453 - 454 2022年
• Multi-scale Defect Detection from Subway Tunnel Images with Spatial Attention Mechanism.

  An Wang, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  ICCE-TW 305 - 306 2022年
• 橋梁点検時の技術者の一人称および三人称視点映像を用いた点検動作の分類に関する検討

  増田毅, 前田圭介, 藤後廉, 小川貴弘, 長谷山美紀

  映像情報メディア学会技術報告 46 6(MMS2022 1-37/ME2022 26-62/AIT2022 1-37) 303 - 304 2022年
• TriBYOL: Triplet BYOL for Self-Supervised Representation Learning.

  Guang Li 0008, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  ICASSP 3458 - 3462 2022年
• Divergence-Guided Feature Alignment for Cross-Domain Object Detection.

  Zongyao Li, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  ICASSP 2240 - 2244 2022年
• Self-Knowledge Distillation based Self-Supervised Learning for Covid-19 Detection from Chest X-Ray Images.

  Guang Li 0008, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  ICASSP 1371 - 1375 2022年
• Regularization Meets Enhanced Multi-Stage Fusion Features: Making CNN More Robust against White-Box Adversarial Attacks.

  Jiahuan Zhang, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  Sensors 22 14 5431 - 5431 2022年
• Controllable Music Playlist Generation Based on Knowledge Graph and Reinforcement Learning.

  Keigo Sakurai, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  Sensors 22 10 3722 - 3722 2022年
• Learning intra-domain style-invariant representation for unsupervised domain adaptation of semantic segmentation.

  Zongyao Li, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  Pattern Recognit. 132 108911 - 108911 2022年
• Dataset complexity assessment based on cumulative maximum scaled area under Laplacian spectrum.

  Guang Li 0008, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  Multimedia Tools and Applications 81 22 32287 - 32303 2022年
• User-centric multimodal feature extraction for personalized retrieval of tumblr posts.

  Kazuma Ohtomo, Ryosuke Harakawa, Takahiro Ogawa 0001, Miki Haseyama, Masahiro Iwahashi

  Multimedia Tools and Applications 81 2 2979 - 3003 2022年
• Chain centre loss: A psychology inspired loss function for image sentiment analysis.

  Yun Liang 0014, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  Neurocomputing 495 118 - 128 2022年
• Generative Adversarial Network Including Referring Image Segmentation For Text-Guided Image Manipulation.

  Yuto Watanabe, Ren Togo, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  ICASSP 4818 - 4822 2022年
• Human Emotion Recognition Using Multi-Modal Biological Signals Based On Time Lag-Considered Correlation Maximization.

  Yuya Moroto, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  ICASSP 4683 - 4687 2022年
• Distributed Label Dequantized Gaussian Process Latent Variable Model for Multi-View Data Integration.

  Koshi Watanabe, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  ICASSP 4643 - 4647 2022年
• Variational Bayesian Graph Convolutional Network for Robust Collaborative Filtering.

  Nozomu Onodera, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  ICASSP 3908 - 3912 2022年
• Time-Lag Aware Latent Variable Model for Prediction of Important Scenes Using Baseball Videos and Tweets.

  Kaito Hirasawa, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  Sensors 22 7 2465 - 2465 2022年
• Refining Graph Representation for Cross-Domain Recommendation Based on Edge Pruning in Latent Space.

  Taisei Hirakawa, Keisuke Maeda, Takahiro Ogawa 0001, Satoshi Asamizu, Miki Haseyama

  IEEE Access 10 12503 - 12509 2022年
• Interactive Re-ranking via Object Entropy-Guided Question Answering for Cross-Modal Image Retrieval.

  Rintaro Yanagi, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  ACM Trans. Multim. Comput. Commun. Appl. 18 3 68 - 17 2022年
• Deterioration Level Estimation Based on Convolutional Neural Network Using Confidence-Aware Attention Mechanism for Infrastructure Inspection.

  Naoki Ogawa, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  Sensors 22 1 382 - 382 2022年
• Domain Adaptive Cross-Modal Image Retrieval via Modality and Domain Translations

  Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama

  IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES E104A 6 866 - 875 2021年06月 

  Various cross-modal retrieval methods that can retrieve images related to a query sentence without text annotations have been proposed. Although a high level of retrieval performance is achieved by these methods, they have been developed for a single domain retrieval setting. When retrieval candidate images come from various domains, the retrieval performance of these methods might be decreased. To deal with this problem, we propose a new domain adaptive cross-modal retrieval method. By translating a modality and domains of a query and candidate images, our method can retrieve desired images accurately in a different domain retrieval setting. Experimental results for clipart and painting datasets showed that the proposed method has better retrieval performance than that of other conventional and state-of-the-art methods.
• Database-adaptive Re-ranking for Enhancing Cross-modal Image Retrieval.

  Rintaro Yanagi, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  MM '21: ACM Multimedia Conference 3816 - 3825 2021年
• Interpretable Representation Learning on Natural Image Datasets via Reconstruction in Visual-Semantic Embedding Space.

  Nao Nakagawa, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  2021 IEEE International Conference on Image Processing(ICIP) 2473 - 2477 2021年
• Cross-Domain Recommendation Method Based On Multi-Layer Graph Analysis With Visual Information.

  Taisei Hirakawa, Keisuke Maeda, Takahiro Ogawa 0001, Satoshi Asamizu, Miki Haseyama

  ICIP 2688 - 2692 2021年
• Time-Lag Aware Multi-Modal Variational Autoencoder Using Baseball Videos And Tweets For Prediction Of Important Scenes.

  Kaito Hirasawa, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  ICIP 2678 - 2682 2021年
• Segmentation-Aware Text-Guided Image Manipulation.

  Tomoki Haruyama, Ren Togo, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  ICIP 2433 - 2437 2021年
• Few-Shot Personalized Saliency Prediction using Person Similarity based on Collaborative Multi-Output Gaussian Process Regression.

  Yuya Moroto, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  ICIP 1469 - 1473 2021年
• Interest Level Estimation via Multi-Modal Gaussian Process Latent Variable Factorization.

  Kyohei Kamikawa, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  ICIP 1209 - 1213 2021年
• Deep Metric Network Via Heterogeneous Semantics for Image Sentiment Analysis.

  Yun Liang 0014, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  ICIP 1039 - 1043 2021年
• Correlation-Aware Attention Branch Network Using Multi-Modal Data For Deterioration Level Estimation Of Infrastructures.

  Naoki Ogawa, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  ICIP 1014 - 1018 2021年
• User Background Information-Aware Music Recommendation with Reinforcement Learning-Based Knowledge Graph Exploration.

  Keigo Sakurai, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  IEEE International Conference on Consumer Electronics-Taiwan(ICCE-TW) 1 - 2 2021年
• Degradation Level Estimation of Road Structures via Attention Branch Network with Text Data.

  Naoki Ogawa, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  IEEE International Conference on Consumer Electronics-Taiwan(ICCE-TW) 1 - 2 2021年
• Cross-view Self-supervised Learning via Momentum Statistics in Batch Normalization.

  Guang Li, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  IEEE International Conference on Consumer Electronics-Taiwan(ICCE-TW) 1 - 2 2021年
• Triplet Self-Supervised Learning for Gastritis Detection with Scarce Annotations.

  Guang Li, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 787 - 788 2021年
• Defense Against Image Captioning Attacks via A Robust and Stable Recurrent Neural Network.

  Jiahuan Zhang, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 785 - 786 2021年
• Text-Guided Image Manipulation for Desired Region Using Referring Image Segmentation.

  Yuto Watanabe, Ren Togo, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 661 - 662 2021年
• Captioning特徴を利用したグラフ畳み込みネットワークに基づくアニメイラストのマルチラベル画像分類に関する検討

  LAN Ziwen, 前田圭介, 小川貴弘, 長谷山美紀

  映像情報メディア学会技術報告 46 6(MMS2022 1-37/ME2022 26-62/AIT2022 1-37) 273 - 274 2021年
• A Trial of Fine-grained Classification of Expert-novice Level Using Bio-signals While Inspecting Subway Tunnels.

  Kaito Hirasawa, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 204 - 205 2021年
• Listener Recommendation for Artist Based on Knowledge Graph and Reinforcement Learning.

  Keigo Sakurai, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 202 - 203 2021年
• Movie Rating Estimation Based on Weakly Supervised Multi-modal Latent Variable Model.

  Koshi Watanabe, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 195 - 196 2021年
• Detection of Off-screen Sound Based on Loss Function of Self-supervised Audio-visual Spatialization.

  Masaki Yoshida, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 193 - 194 2021年
• Visual Sentiment Prediction Using Few-shot Learning via Distribution Relations of Visual Features.

  Yingrui Ye, Yuya Moroto, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 191 - 192 2021年
• Multi-class Similar Scene Retrieval in Soccer Videos: A Scene Confusion Reduction Method Based on Combination of Long and Short Frame Sequences.

  Yaozong Gan, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 117 - 118 2021年
• Sports Action Detection Based on Self-Supervised Feature Learning and Object Detection.

  Tsuyoshi Masuda, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 54 - 55 2021年
• Analysis of Social Trends Related to COVID-19 Pandemic Utilizing Social Media Data.

  Taisei Hirakawa, Keisuke Maeda, Takahiro Ogawa 0001, Satoshi Asamizu, Miki Haseyama

  GCCE 43 - 44 2021年
• Estimating Imagined Images from Brain Activities via Visual Question Answering.

  Saya Takada, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 35 - 36 2021年
• Action Classification from Egocentric Videos Using Reinforcement Learning-based Pose Estimation.

  Shunya Ohaga, Ren Togo, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 9 - 10 2021年
• Graph Analysis-based Recommendation via Entity Embeddings Using Wikipedia.

  Nozomu Onodera, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  GCCE 5 - 6 2021年
• Reliable Estimation of Deterioration Levels via Late Fusion Using Multi-View Distress Images for Practical Inspection.

  Keisuke Maeda, Naoki Ogawa, Takahiro Ogawa 0001, Miki Haseyama

  Journal of Imaging 7 12 273 - 273 2021年
• Feature Integration Through Semi-Supervised Multimodal Gaussian Process Latent Variable Model With Pseudo-Labels for Interest Level Estimation.

  Kyohei Kamikawa, Keisuke Maeda, Takahiro Ogawa 0001, Miki Haseyama

  IEEE Access 9 163843 - 163850 2021年
• Preliminary study of AI-assisted diagnosis using FDG-PET/CT for axillary lymph node metastasis in patients with breast cancer

  Zongyao Li, Kazuhiro Kitajima, Kenji Hirata, Ren Togo, Junki Takenaka, Yasuo Miyoshi, Kohsuke Kudo, Takahiro Ogawa, Miki Haseyama

  EJNMMI Research 11 1 2021年 

  Background: To improve the diagnostic accuracy of axillary lymph node (LN) metastasis in breast cancer patients using 2-[18F]FDG-PET/CT, we constructed an artificial intelligence (AI)-assisted diagnosis system that uses deep-learning technologies. Materials and methods: Two clinicians and the new AI system retrospectively analyzed and diagnosed 414 axillae of 407 patients with biopsy-proven breast cancer who had undergone 2-[18F]FDG-PET/CT before a mastectomy or breast-conserving surgery with a sentinel lymph node (LN) biopsy and/or axillary LN dissection. We designed and trained a deep 3D convolutional neural network (CNN) as the AI model. The diagnoses from the clinicians were blended with the diagnoses from the AI model to improve the diagnostic accuracy. Results: Although the AI model did not outperform the clinicians, the diagnostic accuracies of the clinicians were considerably improved by collaborating with the AI model: the two clinicians' sensitivities of 59.8% and 57.4% increased to 68.6% and 64.2%, respectively, whereas the clinicians' specificities of 99.0% and 99.5% remained unchanged. Conclusions: It is expected that AI using deep-learning technologies will be useful in diagnosing axillary LN metastasis using 2-[18F]FDG-PET/CT. Even if the diagnostic performance of AI is not better than that of clinicians, taking AI diagnoses into consideration may positively impact the overall diagnostic accuracy.
• Personalized recommendation of Tumblr posts using graph convolutional networks with preference-aware multimodal features

  Kazuma Ohtomo, Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama, Masahiro Iwahashi

  ITE Transactions on Media Technology and Applications 9 1 54 - 61 2021年 

  Tumblr is a popular micro-blogging service on which users can share posts comprising text and images. This paper presents a method for personalizing post recommendations for each user from a large number of posts. Specifically, we develop a supervised multi-variational auto encoder considering user preference (SMVAE-UP). SMVAE-UP can extract relationships between text and image features by considering class information representing a user’s preference for each post; thus, preference-aware multimodal features can be calculated. Furthermore, for each target user, a network that enables comparison between a user and posts in the same feature space is constructed using the preference-aware multimodal features and metadata on posts. By applying graph convolutional networks (GCNs) to the network constructed for each target user, an accurate recommendation matching each user’s preferred posts becomes feasible. Experimental results for real-world datasets including six users and 99, 844 posts show the effectiveness of our method.
• User-selectable event summarization in unedited raw soccer video via multimodal bidirectional LSTM

  Tomoki Haruyama, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  ITE Transactions on Media Technology and Applications 9 1 42 - 53 2021年 

  A new method that generates user-selectable event summaries from unedited raw soccer videos is presented in this paper. Since there are more unedited raw soccer videos than broadcasted/distributed soccer videos and unedited videos have various viewers, it is necessary to analyze these videos for meeting the demands of various viewers. The proposed method introduces a multimodal CNN-BiLSTM architecture for analyzing unedited raw soccer videos. This architecture extracts candidate scenes for event summarization from unedited soccer videos and classifies these scenes into typical events. Finally, our method generates user-selectable event summaries by simultaneously considering the importance of candidate scenes and the event classification results. Experimental results using real unedited raw soccer videos show the effectiveness of our method.
• Interior coordination image retrieval with object-detection-based and color features

  Ren Togo, Takahiro Ogawa, Miki Haseyama

  Proceedings of SPIE - The International Society for Optical Engineering 11766 2021年 

  This paper presents a new interior coordination image retrieval method using object-detection-based and color features. Interior coordination requires consideration of objects' positional information and the overall atmosphere of the room simultaneously. However, similar image retrieval methods considering the coordination characteristics have not been proposed. In the proposed method, we extract different types of features from interior coordination images and realize the similar interior coordination image retrieval based on our newly derived features.
• Interest estimation method based on 2D pose features on security camera

  Yuki Honma, Ren Togo, Maiku Abe, Takahiro Ogawa, Miki Haseyama

  Proceedings of SPIE - The International Society for Optical Engineering 11766 2021年 

  This paper proposes a customer interest estimation method using security camera to meet the demand of the retail industry. In the field of retail industry, it is considered that the understanding of customers' interests in the real store can be used for various marketing activities such as the product development and the layout of the store. Then, it is important to pay attention to customers' behavior in the real store. Their behavior is often recorded by the cameras installed in the store for security purposes. A method for estimating their interests from the videos of the security camera is presented in this paper. The novelty of our method is three-fold. Firstly, the experimental data of subjects in our group were taken by using the security camera already installed in the real store. Secondly, we used a pre-trained posture estimation model and treated the results as the features to be trained by a two-layer neural network model. Finally, a professional have annotated the subjects' interests. The effectiveness of our method was confirmed by comparing with benchmark supervised machine learning models.
• Cross-domain recommendation based on multilayer graph analysis using subgraph representation

  Taisei Hirakawa, Keisuke Maeda, Takahiro Ogawa, Satoshi Asamizu, Miki Haseyama

  Proceedings of SPIE - The International Society for Optical Engineering 11766 2021年 

  This paper presents cross-domain recommendation based on multilayer graph analysis using subgraph representation. The proposed method constructs two graphs in source and target domains utilizing user-item embedding and trains link relationships between the users' embedding features on each above graph via graph convolutional networks considering subgraph representation. Thus, the proposed method can obtain features with high representation ability, and this is the main contribution of this paper. Then the proposed method can estimate the user's embedding features in the target domain from those in the source domain and recommend items to users by using the estimated features. Experiments on real-world e-commerce datasets verify the effectiveness of the proposed method.
• A note on detection of sports action based on temporal cycle consistency learning

  Tsuyoshi Masuda, Ren Togo, Takahiro Ogawa, Miki Haseyama

  Proceedings of SPIE - The International Society for Optical Engineering 11766 2021年 

  This paper presents a method for action detection based on Temporal Cycle Consistency(TCC) Learning. The proposed method realizes the action detection of flexible length segments based on a frame-level action prediction technique. We enable calculation of similarities for spatio-temporal features based on TCC to detect target actions from input videos. Finally, our method determines temporal segments by smoothing the frame-level action detection result. Experimental results show the validity of the proposed method.
• IR Questioner: QA-based Interactive Retrieval System.

  Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama

  ICMR 2021 - Proceedings of the 2021 International Conference on Multimedia Retrieval 611 - 614 2021年 

  Image retrieval from a given text query (text-to-image retrieval) is one of the most essential systems, and it is effectively utilized for databases (DBs) on the Web. To make them more versatile and familiar, a retrieval system that is adaptive even for personal DBs such as images in smartphones and lifelogging devices should be considered. In this paper, we present a novel text-to-image retrieval system that is specialized for personal DBs. With the cross-modal scheme and the question-answering scheme, the developed system enables users to obtain the desired image effectively even from personal DBs. Our demo is available at https://sites.google.com/view/ir-questioner/.
• Cross-Domain Semi-Supervised Deep Metric Learning for Image Sentiment Analysis.

  Yun Liang 0014, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings 2021-June 4150 - 4154 2021年 

  This paper presents a novel method on image sentiment analysis called cross-domain semi-supervised deep metric learning (CDSS-DML). The proposed method has two contributions. Firstly, since previous researches on image sentiment analysis suffer from the limit of a small amount of well-labeled data, which occurs a decrease in accuracy of classification, CDSS-DML breaks through the limit by training with unlabeled data based on a teacher-student model. Secondly, the proposed method overcomes the difficulty of distribution shift between well-labeled and unlabeled data by jointing three losses. Especially, the proposed method constructs an effective latent space with the joint loss considering the inter-class and the intra-class correlations for image sentiments. From experimental results, the performance improvement with CDSS-DML is confirmed.
• Feature Integration via Semi-Supervised Ordinally Multi-Modal Gaussian Process Latent Variable Model.

  Kyohei Kamikawa, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings 2021-June 4130 - 4134 2021年 

  This paper presents a method of feature integration via semi-supervised ordinally multi-modal Gaussian process latent variable model (Semi-OMGP). The proposed method transforms multimodal features into common latent variables suitable for users’ interest level estimation. For dealing with the multi-modal features, the proposed method newly derives Semi-OMGP. Semi-OMGP has two contributions. First, Semi-OMGP is suitable for integration between heterogeneous modalities with different distributions by assuming that the similarity matrices of these modalities as observations are generated from latent variables. Second, Semi-OMGP can efficiently use label information by introducing an operator considering the ordinal grade into the prior distribution of latent variables when obtained label information is partially given. Semi-OMGP can simultaneously realize the above contributions, and successful multi-modal feature integration becomes feasible. Experimental results show the effectiveness of the proposed method.
• Multi-Modal Label Dequantized Gaussian Process Latent Variable Model for Ordinal Label Estimation.

  Masanao Matsumoto, Keisuke Maeda, Naoki Saito 0006, Takahiro Ogawa, Miki Haseyama

  ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings 2021-June 3985 - 3989 2021年 

  This paper presents multi-modal label dequantized Gaussian process latent variable model (mLDGP) for ordinal label estimation. mLDGP is constructed based on a probabilistic generative model via Gaussian process and realizes accurate calculation of common latent space from multi-view features including low-dimensional ordinal label features. Conventional methods have a problem that the dimension of the common latent space was limited to that of the label feature, and an enough expressive latent space cannot be obtained. mLDGP, which is constructed by introducing our novel label dequantization mechanism into the objective function of multi-modal Gaussian process latent variable model (GPLVM), can increase the dimension of label features. Then mLDGP can calculate the effective latent space. Furthermore, mLDGP can estimate projection transforming unknown features of test samples into the common latent space, which was a problem of the conventional GPLVMs. From experimental results obtained by applying our method to the product rating estimation on the online shopping website, it is confirmed that accuracy improvement using mLDGP becomes feasible compared to various methods.
• Semantic-Aware Unpaired Image-to-Image Translation for Urban Scene Images.

  Zongyao Li, Ren Togo, Takahiro Ogawa, Miki Haseyama

  ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings 2021-June 2150 - 2154 2021年 

  Unpaired image-to-image (I2I) translation methods have been developed for several years. Present methods do not take into consideration semantic information of the original image, which may perform well on simple datasets of uncomplicated scenes, however, fail in complex datasets of scenes involving abundant objects, such as urban scenes. To tackle this problem, in this paper, we reasonably modify the previous problem setting and present a novel semantic-aware method. Specifically, in training, we use additional semantic label maps of training images, while in the test, no labels are required. We originally adopt a semantic knowledge distillation strategy to acquire semantic information from the labels and construct a particular normalization layer to introduce semantic information. Being aware of the pixel-level semantic information, our method can realize better I2I translation than the previous methods. Experiments are conducted on benchmark datasets of urban scenes to validate the effectiveness of our method.
• Classification of Expert-Novice Level Using Eye Tracking And Motion Data via Conditional Multimodal Variational Autoencoder.

  Yusuke Akamatsu, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings 2021-June 1360 - 1364 2021年 

  Sensor data from wearable devices have been utilized to analyze dif- ferences between experts and novices. Previous studies attempted to classify the expert-novice level from sensor data based on super- vised learning methods. However, these approaches need to col- lect enough training data covering various novices' sensor patterns. In this paper, we propose a semi-supervised anomaly detection ap- proach that requires only sensor data of experts for training and iden- tifies those of novices as anomalies. Our proposed anomaly detec- tion model named conditional multimodal variational autoencoder (CMVAE) has the following two technical contributions: (i) con- sidering action information of persons and (ii) utilizing multimodal sensor data, i:e:; eye tracking data and motion data in this case. The proposed method is evaluated on sensor data measured when expert and novice soccer players were shooting, dribbling, and doing soc- cer ball juggling. Experimental results show that CMVAE can more accurately classify the expert-novice level than previous supervised learning methods and anomaly detection methods using other VAEs.
• Estimation of Visual Features of Viewed Image From Individual and Shared Brain Information Based on FMRI Data Using Probabilistic Generative Model.

  Takaaki Higashi, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings 2021-June 1335 - 1339 2021年 

  This paper presents a method for estimation of visual features based on brain responses measured when subjects view images. The proposed method estimates visual features of viewed images by using both individual and shared brain information from functional magnetic resonance imaging (fMRI) data when subjects view images. To extract an effective latent space shared by multiple subjects from high dimensional fMRI data, a probabilistic generative model that can provide a prior distribution to the space is introduced into the proposed method. Also, the extraction of a robust feature space with respect to noise for the individual information becomes feasible via the proposed probabilistic generative model. This is the first contribution of our method. Furthermore, the proposed method constructs a decoder transforming brain information into visual features based on collaborative use of both estimated spaces for individual and shared brain information. This is the second contribution of our method. Experimental results show that the proposed method improves the estimation accuracy of the visual features of viewed images.
• Human-Centered Favorite Music Classification Using EEG-Based Individual Music Preference Via Deep Time-Series CCA.

  Ryosuke Sawata, Takahiro Ogawa, Miki Haseyama

  ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings 2021-June 1320 - 1324 2021年 

  A method to classify a user's like or dislike musical pieces based on the extraction of his or her music preference is proposed in this paper. New scheme of Canonical Correlation Analysis (CCA), called Deep Time-series CCA (DTCCA), which can consider the correlation between two sets of input features with considering the time-series relation lurked in each input data is exploited to realize the aforementioned classification. One of the most difference between DTCCA and existing other CCAs is enabling to consider the above time-series relation, and thus DTCCA make the individual electroencephalogram (EEG)-based favorite music classification more effective than the methods using one of other CCAs instead of DTCCA since EEG and audio signals are respectively time-series data. Experimental results show that DTCCA-based favorite music classification outperformed not only method using original features without CCA but also methods using other existing CCAs including even state-of-the-art CCA.
• Deterioration level estimation via neural network maximizing category-based ordinally supervised multi-view canonical correlation.

  Keisuke Maeda, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  Multim. Tools Appl. 80 15 23091 - 23112 2021年 

  A deterioration level estimation method via neural network maximizing category-based ordinally supervised multi-view canonical correlation is presented in this paper. This paper focuses on real world data such as industrial applications and has two contributions. First, a novel neural network handling multi-modal features transforms original features into features effectively representing deterioration levels in transmission towers, which are one of the infrastructures, with consideration of only correlation maximization. It can be realized by setting projection matrices maximizing correlations between multiple features into weights of hidden layers. That is, since the proposed network has only a few hidden layers, it can be trained from a small amount of training data. Second, since there exist diverse characteristics and an ordinal scale in deterioration levels, the proposed method newly derives category-based ordinally supervised multi-view canonical correlation analysis (Co-sMVCCA). Co-sMVCCA enables estimation of effective projection considering both within-class divergence and the ordinal scale between classes. Experimental results showed that the proposed method realizes accurate deterioration level estimation.
• Disentangled Representation Learning in Real-World Image Datasets via Image Segmentation Prior.

  Nao Nakagawa, Ren Togo, Takahiro Ogawa, Miki Haseyama

  IEEE Access 9 110880 - 110888 2021年 

  We propose a novel method that can learn easy-to-interpret latent representations in real-world image datasets using a VAE-based model by splitting an image into several disjoint regions. Our method performs object-wise disentanglement by exploiting image segmentation and alpha compositing. With remarkable results obtained by unsupervised disentanglement methods for toy datasets, recent studies have tackled challenging disentanglement for real-world image datasets. However, these methods involve deviations from the standard VAE architecture, which has favorable disentanglement properties. Thus, for disentanglement in images of real-world image datasets with preservation of the VAE backbone, we designed an encoder and a decoder that embed an image into disjoint sets of latent variables corresponding to objects. The encoder includes a pre-trained image segmentation network, which allows our model to focus only on representation learning while adopting image segmentation as an inductive bias. Evaluations using real-world image datasets, CelebA and Stanford Cars, showed that our method achieves improved disentanglement and transferability.
• Detection of Important Scenes in Baseball Videos via Bidirectional Time Lag Aware Deep Multiset Canonical Correlation Analysis.

  Kaito Hirasawa, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  IEEE Access 9 84971 - 84981 2021年 

  A novel method for detection of important scenes in baseball videos based on correlation maximization between heterogeneous modalities via bidirectional time lag aware deep multiset canonical correlation analysis (BiTl-dMCCA) is presented in this paper. The proposed method enables detection of important scenes by collaboratively using baseball videos and their corresponding tweets. The technical contributions of this paper are twofold. First, since there are time lags between not only 'tweets and corresponding multiple previous events' but also 'events and corresponding multiple following posted tweets', the proposed method considers these bidirectional time lags. Specifically, the representation of such bidirectional time lags into the derivation of their covariance matrices is newly introduced. Second, the proposed method adopts textual, visual and audio features calculated from tweets and videos as multi-modal time series features. Important scenes are detected as abnormal scenes via anomaly detection based on a generative adversarial network using multi-modal features projected by BiTl-dMCCA. The proposed method does not need any training data with annotation. Experimental results obtained by applying the proposed method to actual baseball matches show the effectiveness of the proposed method.
• Self-Supervised Learning for Gastritis Detection with Gastric X-Ray Images.

  Guang Li, Ren Togo, Takahiro Ogawa, Miki Haseyama

  CoRR abs/2104.02864 2021年
• Soft-Label Anonymous Gastric X-ray Image Distillation.

  Guang Li, Ren Togo, Takahiro Ogawa, Miki Haseyama

  CoRR abs/2104.02857 2021年
• Human Emotion Estimation Using Multi-Modal Variational AutoEncoder with Time Changes.

  Yuya Moroto, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  LifeTech 2021 - 2021 IEEE 3rd Global Conference on Life Sciences and Technologies 67 - 68 2021年 

  A human emotion estimation method via feature integration using multi-modal variational autoencoder (MVAE) with time changes is presented in this paper. To utilize multimodal information such as gaze and brain activity data including some noises, the proposed method newly introduces MVAE into the human emotion estimation. Furthermore, the proposed MVAE can consider the changes in bio-signals with time and reduce the effect of noises caused in bio-signals by using the probabilistic variation. Experimental results with that of some state-of-the-art methods indicate that the proposed method is effective.
• Music Playlist Generation Based on Graph Exploration Using Reinforcement Learning.

  Keigo Sakurai, Ren Togo, Takahiro Ogawa, Miki Haseyama

  LifeTech 2021 - 2021 IEEE 3rd Global Conference on Life Sciences and Technologies 53 - 54 2021年 

  Spreading of music streaming platforms that use playlists to make recommendations, automatic playlist generation has been actively researched. Recently, it has been reported that playlists that have high diversity and smooth track transitions increase user satisfaction. Our previous method that used a two-dimensional space as a reinforcement learning environment has achieved these demands, but there remains the problem that the content of multi-dimensional acoustic features cannot be retained accurately. To solve this problem, in this paper, we present a new method of music playlist generation based on reinforcement learning using a graph structure constructed from multi-dimensional acoustic features directly. The new playlist generation provides greater diversity and smoother track transitions than the previous method. Experimental results are shown for verifying the effectiveness of the proposal method.
• Question Answering from Brain Activity Data via Decoder Based on Neural Networks.

  Saya Takada, Ren Togo, Takahiro Ogawa, Miki Haseyama

  LifeTech 2021 - 2021 IEEE 3rd Global Conference on Life Sciences and Technologies 51 - 52 2021年 

  We build a model that can estimate what subjects recognize from functional magnetic resonance imaging (fMRI) data via a visual question answering (VQA) model. The VQA model can generate an answer to a question about an image. We convert fMRI signals into image features via an fMRI decoder based on the relationship between the fMRI signals and the image features extracted from the gazed image. Then this allows the VQA model to answer a visual question from the fMRI signals measured while the subject is gazing at the image. Though brain decoding, which interprets what humans recognize, has become overwhelmingly popular in neuroscience, they often suffer from the small datasets of brain activity data. To overcome the small size of datasets of fMRI signals, we introduce an fMRI decoder based on neural networks that have a high expressive ability. Even when we do not have enough fMRI signals, the proposed method derives the answer to what a person is looking at from fMRI signals. Experimental results on several datasets show that our method allows us to answer a question about gazed images from fMRI signals.
• Distress Image Retrieval for Infrastructure Maintenance via Self-Trained Deep Metric Learning Using Experts' Knowledge.

  Naoki Ogawa, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  IEEE Access 9 65234 - 65245 2021年 

  Distress image retrieval for infrastructure maintenance via self-trained deep metric learning using experts' knowledge is proposed in this paper. Since engineers take multiple images of a single distress part for inspection of road structures, it is necessary to construct a similar distress image retrieval method considering the input of multiple images to support determination of the level of deterioration. Thus, the construction of an image retrieval method while selecting an effective input from multiple images is described in this paper. The proposed method performs deep metric learning by using a small number of effective images labeled by experts' knowledge with information about their effectiveness and a large number of unlabeled images via a self-training approach. Specifically, an end-to-end learning approach that performs retraining of the model by assigning pseudo-labels to these unlabeled images according to the output confidence of the model is achieved. Thus, the proposed method can select an effective image from multiple images that are input at the retrieval as a query image. This is the main contribution of this paper. As a result, the proposed method realizes highly accurate retrieval of similar distress images considering the actual situation of inspection in which multiple images of a distress part are input.
• Text-Guided Style Transfer-Based Image Manipulation Using Multimodal Generative Models.

  Ren Togo, Megumi Kotera, Takahiro Ogawa, Miki Haseyama

  IEEE Access 9 64860 - 64870 2021年 

  A new style transfer-based image manipulation framework combining generative networks and style transfer networks is presented in this paper. Unlike conventional style transfer tasks, we tackle a new task, text-guided image manipulation. We realize style transfer-based image manipulation that does not require any reference style images and generate a style image from the user's input sentence. In our method, since an initial reference input sentence for a content image can automatically be given by an image-to-text model, the user only needs to update the reference sentence. This scheme can help users when they do not have any images representing the desired style. Although this text-guided image manipulation is a new challenging task, quantitative and qualitative comparisons showed the superiority of our method.
• Rubber Material Property Prediction Using Electron Microscope Images of Internal Structures Taken under Multiple Conditions.

  Ren Togo, Naoki Saito 0006, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  Sensors 21 6 2088 - 2088 2021年 

  A method for prediction of properties of rubber materials utilizing electron microscope images of internal structures taken under multiple conditions is presented in this paper. Electron microscope images of rubber materials are taken under several conditions, and effective conditions for the prediction of properties are different for each rubber material. Novel approaches for the selection and integration of reliable prediction results are used in the proposed method. The proposed method enables selection of reliable results based on prediction intervals that can be derived by the predictors that are each constructed from electron microscope images taken under each condition. By monitoring the relationship between prediction results and prediction intervals derived from the corresponding predictors, it can be determined whether the target prediction results are reliable. Furthermore, the proposed method integrates the selected reliable results based on Dempster–Shafer (DS) evidence theory, and this integration result is regarded as a final prediction result. The DS evidence theory enables integration of multiple prediction results, even if the results are obtained from different imaging conditions. This means that integration can even be realized if electron microscope images of each material are taken under different conditions and even if these conditions are different for target materials. This nonconventional approach is suitable for our application, i.e., property prediction. Experiments on rubber material data showed that the evaluation index mean absolute percent error (MAPE) was under 10% by the proposed method. The performance of the proposed method outperformed conventional comparative property estimation methods. Consequently, the proposed method can realize accurate prediction of the properties with consideration of the characteristic of electron microscope images described above.
• Detection of Important Scenes in Baseball Videos via a Time-Lag-Aware Multimodal Variational Autoencoder.

  Kaito Hirasawa, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  Sensors 21 6 2045 - 2045 2021年 

  A new method for the detection of important scenes in baseball videos via a time-lag-aware multimodal variational autoencoder (Tl-MVAE) is presented in this paper. Tl-MVAE estimates latent features calculated from tweet, video, and audio features extracted from tweets and videos. Then, important scenes are detected by estimating the probability of the scene being important from estimated latent features. It should be noted that there exist time-lags between tweets posted by users and videos. To consider the time-lags between tweet features and other features calculated from corresponding multiple previous events, the feature transformation based on feature correlation considering such time-lags is newly introduced to the encoder in MVAE in the proposed method. This is the biggest contribution of the Tl-MVAE. Experimental results obtained from actual baseball videos and their corresponding tweets show the effectiveness of the proposed method.
• Perceived Image Decoding From Brain Activity Using Shared Information of Multi-Subject fMRI Data.

  Yusuke Akamatsu, Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  IEEE Access 9 26593 - 26606 2021年 

  Decoding a person's cognitive contents from evoked brain activity is becoming important in the field of brain-computer interaction. Previous studies have decoded a perceived image from functional magnetic resonance imaging (fMRI) activity by constructing brain decoding models that were trained with a single subject's fMRI data. However, accurate decoding is still challenging since fMRI data acquired from only a single subject have several disadvantageous characteristics such as small sample size, noisy nature, and high dimensionality. In this article, we propose a method to decode categories of perceived images from fMRI activity using shared information of multi-subject fMRI data. Specifically, by aggregating fMRI data of multiple subjects that contain a large number of samples, we extract a low-dimensional latent representation shared by multi-subject fMRI data. Then the latent representation is nonlinearly transformed into visual features and semantic features of the perceived images to identify categories from various candidate categories. Our approach leverages rich information obtained from multi-subject fMRI data and improves the decoding performance. Experimental results obtained by using two public fMRI datasets showed that the proposed method can more accurately decode categories of perceived images from fMRI activity than previous approaches using a single subject's fMRI data.
• Supervised Fractional-Order Embedding Multiview Canonical Correlation Analysis via Ordinal Label Dequantization for Image Interest Estimation.

  Masanao Matsumoto, Naoki Saito 0006, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  IEEE Access 9 21810 - 21822 2021年 

  Supervised fractional-order embedding multiview canonical correlation analysis via ordinal label dequantization (SFEMCCA-OLD) for image interest estimation is presented in this paper. SFEMCCA-OLD is a CCA method that realizes accurate integration of features including low-dimensional ordinal label features. In general, since information is lost due to a limitation of the number of classes, i.e., the dimension of ordinal label information is smaller than those of other features, derivation of highly accurate integration of features is difficult. In SFEMCCA-OLD, the dimension of the ordinal label information can be increased by estimation of the canonical correlation between multiview features. We call this approach ordinal label dequantization. In addition, by introducing a fractional-order technique, our method can calculate optimal projections for noisy data such as real data. Experimental results show that the accuracy of SFEMCCA-OLD for image interest estimation is better than that of recent CCA-based methods.
• トンネル切羽画像を用いたオンライン学習に基づく穿孔エネルギー推定

  山本健太郎, 藤後廉, 小川貴弘, 長谷山美紀

  土木学会論文集 F3(土木情報学)(Web) 77 1 794 - 795 2021年 [査読有り][通常論文]
  
• Land Use in Habitats Affects Metal Concentrations in Wild Lizards around a Former Lead Mining Site

  Rio Doya, Shouta M.M. Nakayama, Hokuto Nakata, Haruya Toyomaki, John Yabe, Kaampwe Muzandu, Yared B. Yohannes, Andrew Kataba, Golden Zyambo, Takahiro Ogawa, Yoshitaka Uchida, Yoshinori Ikenaka, Mayumi Ishizuka

  Environmental Science and Technology 54 22 14474 - 14481 2020年11月17日 

  We investigated the potential effects of different land use and other environmental factors on animals living in a contaminated environment. The study site in Kabwe, Zambia, is currently undergoing urban expansion, while lead contamination from former mining activities is still prevalent. We focused on a habitat generalist lizards (Trachylepis wahlbergii). The livers, lungs, blood, and stomach contents of 224 lizards were analyzed for their lead, zinc, cadmium, copper, nickel, and arsenic concentrations. Habitat types were categorized based on vegetation data obtained from satellite images. Multiple regression analysis revealed that land use categories of habitats and three other factors significantly affected lead concentrations in the lizards. Further investigation suggested that the lead concentrations in lizards living in bare fields were higher than expected based on the distance from the contaminant source, while those in lizards living in green fields were lower than expected. In addition, the lead concentration of lungs was higher than that of the liver in 19% of the lizards, implying direct exposure to lead via dust inhalation besides digestive exposure. Since vegetation reduces the production of dust from surface soil, it is plausible that dust from the mine is one of the contamination sources and that vegetation can reduce exposure to this.
• Important Scene Detection Based on Anomaly Detection using Long Short-Term Memory for Baseball Highlight Generation

  Kaito Hirasawa, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  2020 IEEE International Conference on Consumer Electronics - Taiwan, ICCE-Taiwan 2020 2020年09月28日 

  This paper presents an important scene detection method based on anomaly detection using a Long Short-Term Memory (LSTM) for baseball highlight generation. In order to deal with multi-view time series features calculated from tweets and videos, we adopt an anomaly detection method using LSTM. LSTM which can maintain a long-term memory is effective for training such features. Introduction of LSTM into important scene detection of baseball videos is the biggest contribution of this paper. Experimental results show high detection performance by our method.
• An Estimation Method of Candidate Region for Superimposing Information Based on Gaze Tracking Data in Soccer Videos

  Genki Suzuki, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  2020 IEEE International Conference on Consumer Electronics - Taiwan, ICCE-Taiwan 2020 2020年09月28日 

  A novel method estimating candidate regions for superimposing information in soccer videos based on gaze tracking data is presented in this paper. The proposed method generates a likelihood map based on visual attention regions based on the gaze tracking data and detection results of objects such as players and soccer goals in soccer videos. Candidate regions for superimposing information are estimated by using the likelihood map. Experimental results show that the proposed method realizes effective candidate region estimation.
• Estimation of Person-Specific Visual Attention via Selection of Similar Persons

  Yuya Moroto, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  2020 IEEE International Conference on Consumer Electronics - Taiwan, ICCE-Taiwan 2020 2020年09月28日 

  This paper presents a method for estimation of person-specific visual attention based on estimated similar persons' visual attention. For improving the estimation performance of person-specific visual attention, the proposed method uses the dataset including the large number of images and corresponding gaze data of many persons not including the target person and trains an estimation model based on deep learning. By using the estimated visual attention of similar persons for the target image, the proposed method estimates the visual attention of the target person with the small amount of gaze data. Experimental results show that the proposed method is effective for estimation of person-specific visual attention.
• Chronic atrophic gastritis detection with a convolutional neural network considering stomach regions

  Misaki Kanai, Ren Togo, Takahiro Ogawa, Miki Haseyama

  World Journal of Gastroenterology 26 25 3650 - 3659 2020年07月07日 

  BACKGROUND The risk of gastric cancer increases in patients with Helicobacter pylori-associated chronic atrophic gastritis (CAG). X-ray examination can evaluate the condition of the stomach, and it can be used for gastric cancer mass screening. However, skilled doctors for interpretation of X-ray examination are decreasing due to the diverse of inspections. AIM To evaluate the effectiveness of stomach regions that are automatically estimated by a deep learning-based model for CAG detection. METHODS We used 815 gastric X-ray images (GXIs) obtained from 815 subjects. The ground truth of this study was the diagnostic results in X-ray and endoscopic examinations. For a part of GXIs for training, the stomach regions are manually annotated. A model for automatic estimation of the stomach regions is trained with the GXIs. For the rest of them, the stomach regions are automatically estimated. Finally, a model for automatic CAG detection is trained with all GXIs for training. RESULTS In the case that the stomach regions were manually annotated for only 10 GXIs and 30 GXIs, the harmonic mean of sensitivity and specificity of CAG detection were 0.955 ± 0.002 and 0.963 ± 0.004, respectively. CONCLUSION By estimating stomach regions automatically, our method contributes to the reduction of the workload of manual annotation and the accurate detection of the CAG.
• 胃X線画像を用いたAIによるH.pylori感染識別と今後の展望

  藤後 廉, 小川 貴弘, 間部 克裕, 加藤 元嗣, 長谷山 美紀

  日本消化器がん検診学会雑誌 58 2 127 - 127 (一社)日本消化器がん検診学会 2020年03月
• Image retrieval based on supervised local regression and global alignment with relevance feedback for insect identification

  Keisuke Maeda, Susumu Genma, Takahiro Ogawa, Miki Haseyama

  ITE Transactions on Media Technology and Applications 8 3 140 - 150 2020年 

  A method for image retrieval based on supervised local regression and global alignment (sLRGA) with relevance feedback for insect identification is presented in this paper. Based on the novel sLRGA, which is an extended version of LRGA, the proposed method estimates ranking scores for image retrieval in such a way that the neighborhood structure of a feature space of the database can be optimally preserved with consideration of class information. This is the main contribution of this paper. By measuring the relevance between all of the images and the query image in the database, sLRGA realizes accurate image retrieval. Furthermore, when positive/negative labels to retrieved images are given by users, the proposed method can improve image retrieval performance considering the query relevance information via use of both relevance feedback and sLRGA. This is the second contribution of this paper. Experimental results show the effectiveness of the proposed method.
• A method for player importance prediction from player network using gaze position estimated by LSTM

  Genki Suzuki, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  ITE Transactions on Media Technology and Applications 8 3 151 - 160 2020年 

  A novel method for player importance prediction from a player network using gaze positions estimated by Long Short-Term Memory (LSTM) in soccer videos is presented in this paper. By newly using an estimation model of gaze positions trained by gaze tracking data of experienced persons, it is expected that the importance of each player can be predicted. First, we generate a player network by utilizing the estimated gaze positions and first-arrival regions representing players' connections, e.g., passes between players. The gaze positions are estimated by LSTM that is newly trained from the gaze tracking data of experienced persons. Second, the proposed method predicts the importance of each player by applying the Hypertext Induced Topic Selection (HITS) algorithm to the constructed network. Consequently, prediction of the importance of each player based on soccer tactic knowledge of experienced persons can be realized without constantly obtaining gaze tracking data.
• Interpretable convolutional neural network including attribute estimation for image classification

  Kazaha Horii, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  ITE Transactions on Media Technology and Applications 8 2 111 - 124 2020年 

  An interpretable convolutional neural network (CNN) including attribute estimation for image classification is presented in this paper. Although CNNs perform highly accurate image classification, the reason for the classification results obtained by the neural networks is not clear. In order to provide interpretation of CNNs, the proposed method estimates attributes, which explain elements of objects, in an intermediate layer of the network. This enables improvement of the interpretability of CNNs, and it is the main contribution of this paper. Furthermore, the proposed method uses the estimated attributes for image classification in order to enhance its accuracy. Consequently, the proposed method not only provides interpretation of CNNs but also realizes improvement in the performance of image classification.
• Multimodal important scene detection in far-view soccer videos based on single deep neural architecture

  Tomoki Haruyama, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  ITE Transactions on Media Technology and Applications 8 2 89 - 99 2020年 

  The details of the matches of soccer can be estimated from visual and audio sequences, and they correspond to the occurrence of important scenes. Therefore, the use of these sequences is suitable for important scene detection. In this paper, a new multimodal method for important scene detection from visual and audio sequences in far-view soccer videos based on a single deep neural architecture is presented. A unique point of our method is that multiple classifiers can be realized by a single deep neural architecture that includes a Convolutional Neural Network-based feature extractor and a Support Vector Machine-based classifier. This approach provides a solution to the problem of not being able to simultaneously optimize different multiple deep neural architectures from a small amount of training data. Then we monitor confidence measures output from this architecture for the multimodal data and enable their integration to obtain the final classification result.
• Image Retrieval with Data Augmentation of Sentence Labels Based on Paraphrasing

  Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama

  2020 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN (ICCE-TAIWAN) 2020年 

  Text-based image retrieval is a fundamental study in the field of information retrieval. Recent text-based image retrieval methods employ deep neural networks (here-inafter referred to as deep neural TBIR) to retrieve a desired image from a sentence query and achieve the state-of-the-art performance in TBIR. To improve the retrieval performance of the deep neural TBIR method further, it is essential to prepare diverse sentence labels in training data. However, it takes a lot of effort to prepare diverse sentence labels in training data. To address this problem, we propose a novel deep neural TBIR method with data augmentation of the sentence labels in training data. Experimental results show the effectiveness of the proposed method.
• Interactive re-ranking for cross-modal retrieval based on object-wise question answering.

  Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama

  Proceedings of the 2nd ACM International Conference on Multimedia in Asia, MMAsia 2020 37 - 7 2020年 

  Cross-modal retrieval methods retrieve desired images from a query text by learning relationships between texts and images. This retrieval approach is one of the most effective ways in the easiness of query preparation. Recent cross-modal retrieval is convenient and accurate when users input a query text that can uniquely identify the desired image. Meanwhile, users frequently input ambiguous query texts, and these ambiguous queries make it difficult to obtain the desired images. To alleviate these difficulties, in this paper, we propose a novel interactive cross-modal retrieval method based on question answering (QA) with users. The proposed method analyses candidate images and asks users about information that can narrow retrieval candidates effectively. By only answering the questions generated by the proposed method, users can reach their desired images even from an ambiguous query text. Experimental results show the effectiveness of the proposed method.
• Similar scene retrieval in soccer videos with weak annotations by multimodal use of bidirectional LSTM.

  Tomoki Haruyama, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  Proceedings of the 2nd ACM International Conference on Multimedia in Asia, MMAsia 2020 27 - 8 2020年 

  This paper presents a novel method to retrieve similar scenes in soccer videos with weak annotations via multimodal use of bidirectional long short-term memory (BiLSTM). The significant increase in the number of different types of soccer videos with the development of technology brings valid assets for effective coaching, but it also increases the work of players and training staff. We tackle this problem with a nontraditional combination of pre-trained models for feature extraction and BiLSTMs for feature transformation. By using the pre-trained models, no training data is required for feature extraction. Then effective feature transformation for similarity calculation is performed by applying BiLSTM trained with weak annotations. This transformation allows for highly accurate capture of soccer video context from less annotation work. In this paper, we achieve an accurate retrieval of similar scenes by multimodal use of this BiLSTM-based transformer trainable with less human effort. The effectiveness of our method was verified by comparative experiments with state-of-the-art using actual soccer video dataset.
• 胃X線画像を用いたAIによるH.pylori感染識別と今後の展望

  藤後廉, 小川貴弘, 間部克裕, 加藤元嗣, 長谷山美紀

  日本消化器がん検診学会雑誌(Web) 58 2 2020年
• 視線データと点検データの正準相関に基づく道路橋点検のための類似点検データ検索

  前田圭介, 斉藤僚汰, 高橋翔, 小川貴弘, 長谷山美紀

  土木学会論文集 F3(土木情報学)(Web) 76 1 2020年
• Quantitative Analysis of Engineer's Skill Using Wearable Sensor Data while Inspecting Highway Bridge.

  Genki Suzuki, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  LifeTech 2020 - 2020 IEEE 2nd Global Conference on Life Sciences and Technologies 111 - 112 2020年 

  This paper presents quantitative analysis of engineer's skill using wearable sensor data while inspecting a highway bridge. This paper analyzes differences of behavior between experienced and inexperienced engineers by using bio-signals obtained from wearable sensor data during inspections. Specifically, by analyzing each engineer's movement distance and the number of steps during inspections, the differences of behavior patterns between experienced and inexperienced engineers can be revealed.
• Estimating Viewed Images with Natural Language Question Answering from fMRI Data.

  Saya Takada, Ren Togo, Takahiro Ogawa, Miki Haseyama

  LifeTech 2020 - 2020 IEEE 2nd Global Conference on Life Sciences and Technologies 99 - 100 2020年 

  We propose a model for free-form visual question answering (VQA) from human brain activity. The task of VQA is leading to an answer given an image and a question about the image. Given brain activity data measured by functional magnetic resonance imaging (fMRI) and a natural language question in terms of the viewed image, the proposed method can provide an accurate natural language answer with the VQA algorithm. Visual questions selectively approach various areas of an image such as objects and backgrounds. As a result, a more detailed understanding of the image and complex reasoning are typically needed than general image captioning models. In this paper, we propose a method of answering a given question about a viewed image from fMRI data based on the VQA algorithm. We estimate the relation between fMRI data and visual features extracted from viewed images. Based on the relationship, we convert fMRI data into visual features. Finally, the proposed method can answer to a visual question from fMRI data measured while subjects are viewing images. Experimental results show that the proposed method enables accurate answering for questions about viewed images.
• Distress Level Classification of Road Infrastructures via CNN Generating Attention Map.

  Naoki Ogawa, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  LifeTech 2020 - 2020 IEEE 2nd Global Conference on Life Sciences and Technologies 97 - 98 2020年 

  This paper proposes distress level classification of road infrastructures via convolutional neural networks (CNNs) generating an attention map. In the proposed method, performance of distress level classification is improved by utilizing an attention map to emphasize locations contributing to classification results. Furthermore, the attention map is also utilized to explain the reasons for the classification results. Thus, the proposed method realizes both performance improvement of distress level classification and provision of the interpretability for the classification results. Finally, experimental results verify the effectiveness of the proposed method.
• Interest Estimation for Images Using Eye Gaze-based Visual and Text Features via DLPCCA.

  Masanao Matsumoto, Naoki Saito 0006, Takahiro Ogawa, Miki Haseyama

  LifeTech 2020 - 2020 IEEE 2nd Global Conference on Life Sciences and Technologies 3 - 4 2020年 

  This paper presents a new method to realize estimation performance improvement of user-specific interests for images. The proposed method computes projections which transform visual and text features to eye gaze-based features that reflect user's interests by utilizing discriminative locality preserving canonical correlation analysis (DLPCCA). DLPCCA can calculate projections suitable for interest estimation by considering the class information and locality of data structure. Experimental results are shown for verifying the effectiveness of our method.
• Mvgan Maximizing Time-Lag Aware Canonical Correlation for Baseball Highlight Generation.

  Kaito Hirasawa, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  2020 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2020 1 - 6 2020年 

  This paper presents multi-view unsupervised generative adversarial network maximizing time-lag aware canonical correlation (Mv-GAN) for baseball highlight generation. MvGAN has the following two contributions. First, MvGAN utilizes textual, visual and audio features calculated from tweets and videos as multi-view features. MvGAN which adopts these multi-view features is the effective work for highlight generation of baseball videos. Second, since there is a temporal difference between posted tweets and the corresponding events, MvGAN introduces a novel feature embedding scheme considering a time-lag between textual features and other features. Specifically, the proposed method newly derives the time-lag aware canonical correlation maximization of these multi-view features. This is the biggest contribution of this paper. Furthermore, since MvGAN is an unsupervised method for highlight generation, a large amount of training data with annotation is not needed. Thus, the proposed method has high applicability to the real world.
• Generation of Viewed Image Captions From Human Brain Activity Via Unsupervised Text Latent Space.

  Saya Takada, Ren Togo, Takahiro Ogawa, Miki Haseyama

  Proceedings - International Conference on Image Processing, ICIP 2020-October 2521 - 2525 2020年 

  Generation of human cognitive contents based on the analysis of functional magnetic resonance imaging (fMRI) data has been actively researched. Cognitive contents such as viewed images can be estimated by analyzing the relationship between fMRI data and semantic information of viewed images. In this paper, we propose a new method generating captions for viewed images from human brain activity via a novel robust regression scheme. Unlike conventional generation methods using image feature representations, the proposed method makes use of more semantic text feature representations, which are more suitable for the caption generation. We construct a text latent space with unlabeled images not used for the training, and the fMRI data are regressed to the text latent space. Besides, we newly make use of unlabeled images not used for the training phase to improve caption generation performance. Finally, the proposed method can generate captions from the fMRI data measured while subjects are viewing images. Experimental results show that the proposed method enables accurate caption generation for viewed images.
• Multimodal Image-to-Image Translation for Generation of Gastritis Images.

  Ren Togo, Takahiro Ogawa, Miki Haseyama

  Proceedings - International Conference on Image Processing, ICIP 2020-October 2466 - 2470 2020年 

  We present a new multimodal image-to-image translation model for the generation of gastritis images using X-ray and blood inspection results. In clinical situations, clinicians estimate the prognosis of the target disease by considering multiple inspection results. Similarly, we take a multimodal approach in the task of gastric cancer risk prediction. Visual characteristics of the gastric X-ray image and blood index values are highly related in the evaluation of gastric cancer risk. If we can generate a prediction image from blood index values, it contributes to the clinicians' sophisticated and integrated diagnosis. Hence, we learn a model that can map non-gastritis images to gastritis images based on the blood index values. Although this is a challenging multimodal task in medical image analysis, experimental results showed the effectiveness of our model.
• Image Retrieval With Lingual And Visual Paraphrasing Via Generative Models.

  Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama

  2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) 2020-October 2431 - 2435 2020年 

  A new approach that improves text-based image retrieval (hereinafter referred to as TBIR) performance is proposed in this paper. TBIR methods aim to retrieve a desired image related to a query text. Especially, recent TBIR methods allow us to retrieve images considering word relationships by using a sentence as a query. In these TBIR methods, it is necessary to uniquely identify a desired image from similar images using a single query sentence. However, the diverse expressive styles for a query sentence make it difficult to uniquely identify a desired image. In this paper, we propose a novel TBIR method with paraphrasing on multiple representation spaces. Specifically, by paraphrasing a query sentence on lingual and visual representation spaces, the proposed method can retrieve a desired image from various perspectives and then it can uniquely identify a desired image from similar images. Comprehensive experimental results show the effectiveness of the proposed method.
• Variational Autoencoder Based Unsupervised Domain Adaptation For Semantic Segmentation.

  Zongyao Li, Ren Togo, Takahiro Ogawa, Miki Haseyama

  Proceedings - International Conference on Image Processing, ICIP 2020-October 2426 - 2430 2020年 

  Unsupervised domain adaptation, which transfers supervised knowledge from a labeled domain to an unlabeled domain, remains a tough problem in the field of computer vision, especially for semantic segmentation. Some methods inspired by adversarial learning and semi-supervised learning have been developed for unsupervised domain adaptation in semantic segmentation and achieved outstanding performances. In this paper, we propose a novel method for this task. Like adversarial learning-based methods using a discriminator to align the feature distributions from different domains, we employ a variational autoencoder to get to the same destination but in a non-adversarial manner. Since the two approaches are compatible, we also integrate an adversarial loss into our method. By further introducing pseudo labels, our method can achieve state-of-the-art performances on two benchmark adaptation scenarios, GTA5-toCITYSCAPES and SYNTHIA-to-CITYSCAPES.
• Important Scene Detection Of Baseball Videos Via Time-Lag Aware Deep Multiset Canonical Correlation Maximization.

  Kaito Hirasawa, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  Proceedings - International Conference on Image Processing, ICIP 2020-October 1236 - 1240 2020年 

  This paper presents a new important scene detection method of baseball videos based on correlation maximization between heterogeneous modalities via time-lag aware deep multiset canonical correlation analysis (Tl-dMCCA). The technical contributions of this paper are twofold. First, textual, visual and audio features calculated from tweets and videos are adopted as multi-view time series features. Since Tl-dMCCA which utilizes these features includes the unsupervised embedding scheme via deep networks, the proposed method can flexibly express the relationship between heterogeneous features. Second, since there is the time-lag between posted tweets and the corresponding multiple previous events, Tl-dMCCA considers the time-lag relationships between them. Specifically, we newly introduce the representation of such time-lags into the derivation of their covariance matrices. By considering time-lags via Tl-dMCCA, the proposed method correctly detects important scenes.
• Soft-Label Anonymous Gastric X-Ray Image Distillation.

  Guang Li, Ren Togo, Takahiro Ogawa, Miki Haseyama

  Proceedings - International Conference on Image Processing, ICIP 2020-October 305 - 309 2020年 

  This paper presents a soft-label anonymous gastric X-ray image distillation method based on a gradient descent approach. The sharing of medical data is demanded to construct high-accuracy computeraided diagnosis (CAD) systems. However, the large size of the medical dataset and privacy protection are remaining problems in medical data sharing, which hindered the research of CAD systems. The idea of our distillation method is to extract the valid information of the medical dataset and generate a tiny distilled dataset that has a different data distribution. Different from model distillation, our method aims to find the optimal distilled images, distilled labels and the optimized learning rate. Experimental results show that the proposed method can not only effectively compress the medical dataset but also anonymize medical images to protect the patient's private information. The proposed approach can improve the efficiency and security of medical data sharing.
• Estimation Of Visual Contents Based On Question Answering From Human Brain Activity.

  Saya Takada, Ren Togo, Takahiro Ogawa, Miki Haseyama

  Proceedings - International Conference on Image Processing, ICIP 2020-October 61 - 65 2020年 

  We propose an estimation method for free-form Visual Question Answering (VQA) from human brain activity, brain decoding VQA. The task of VQA in the field of computer vision is generating an answer given an image and a question about its contents. The proposed method can realize answering arbitrary visual questions about images from brain activity measured by functional Magnetic Resonance Imaging (fMRI) while viewing the same images. We enable estimating various information from brain activity via a unique VQA model, which can realize a more detailed understanding of images and complex reasoning. In addition, we newly make use of un-labeled images not used in the training phase to improve the performance of the transformation, since fMRI datasets are generally small. The proposed method can answer a visual question from a little amount of fMRI data measured while subjects are viewing images.
• Feature Integration Via Geometrical Supervised Multi-View Multi-Label Canonical Correlation For Incomplete Label Assignment.

  Keisuke Maeda, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  Proceedings - International Conference on Image Processing, ICIP 2020-October 46 - 50 2020年 

  This paper presents feature integration via geometrical supervised multi-view multi-label canonical correlation analysis (GSM2CCA) for incomplete label assignment. The problem of incomplete labels is frequently encountered in the multi-label classification problem where the training labels are obtained via crowd-sourcing. In such a situation, consideration of only the label correlation, which is the basic approach, is not suitable for improvement of representation ability of features. For dealing with the incomplete label assignment, GSM2CCA constructs effective feature embedding space providing the discriminant ability by introducing both the multi-label correlation and feature similarity of the original feature space into its objective function. Since novel integrated features with high discriminant ability can be calculated by our GSM2CCA, performance improvement of multi-label classification with the incomplete label assignment is realized. The main contribution of this paper is the realization of the effective feature integration via the adoption of the combination use of label similarity and locality preserving projection of heterogeneous features for solving the problem of the incomplete label assignment. The effectiveness of GSM2CCA by applying GSM2CCA-based feature integration to heterogeneous features calculated from various convolutional neural network models is verified via experimental results.
• Unsupervised Domain Adaptation for Semantic Segmentation with Symmetric Adaptation Consistency.

  Zongyao Li, Ren Togo, Takahiro Ogawa, Miki Haseyama

  ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings 2020-May 2263 - 2267 2020年 

  Unsupervised domain adaptation, which leverages label information from other domains to solve tasks on a domain without any labels, can alleviate the problem of the scarcity of labels and expensive labeling costs faced by supervised semantic segmentation. In this paper, we utilize adversarial learning and semi-supervised learning simultaneously to solve the task of unsupervised domain adaptation in semantic segmentation. We propose a new approach that trains two segmentation models with the adversarial learning symmetrically and further introduces the consistency between the outputs of the two models into the semi-supervised learning to improve the accuracy of pseudo labels which significantly affect the final adaptation performance. We achieve state-of-the-art semantic segmentation performance on the GTA5-to-Cityscapes scenario, a widely used benchmark setting in unsupervised domain adaptation.
• Multi-View Bayesian Generative Model for Multi-Subject FMRI Data on Brain Decoding of Viewed Image Categories.

  Yusuke Akamatsu, Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings 2020-May 1215 - 1219 2020年 

  Brain decoding studies have demonstrated that viewed image categories can be estimated from human functional magnetic resonance imaging (fMRI) activity. However, there are still limitations with the estimation performance because of the characteristics of fMRI data and the employment of only one modality extracted from viewed images. In this paper, we propose a multi-view Bayesian generative model for multi-subject fMRI data to estimate viewed image categories from fMRI activity. The proposed method derives effective representations of fMRI activity by utilizing multi-subject fMRI data. In addition, we associate fMRI activity with multiple modalities, i.e., visual features and semantic features extracted from viewed images. Experimental results show that the proposed method outperforms existing state-of-the-art methods of brain decoding.
• Interest Level Estimation Based on Feature Integration Considering Distribution of Partially Paired User's Behavior, Videos and Posters.

  Kyohei Kamikawa, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020 944 - 945 2020年 

  This paper presents a method for interest level estimation based on feature integration considering distribution of partially paired user's behavior, videos and posters. The proposed method collaboratively uses videos, their corresponding poster images, and user's behavior to estimate the interest levels. For dealing with the multi-view data, the proposed method newly derives semi-supervised divergence-aware multi-set canonical correlation analysis (SDMCCA). SDMCCA has two contributions. First, since the number of viewable videos is limited, consideration of unviewed videos is necessary, and SDMCCA adopts the semi-supervised approach. Second, information which data have is different due to the difference between similarities to other data. SDMCCA can simultaneously realize the above points and realize successful interest level estimation. Experimental results show the effectiveness of the proposed method.
• Music Playlist Generation Based on Reinforcement Learning Using Acoustic Feature Map.

  Keigo Sakurai, Ren Togo, Takahiro Ogawa, Miki Haseyama

  2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020 942 - 943 2020年 

  With the spread of streaming services that make playlist-based recommendation, automatic music playlist generation has been actively researched. Traditionally, most of music playlist generation methods have focused on the sounds and the genres of songs that have been listened by a user. However, users are bored and unsatisfied with the music playlist that fits users' preferences overly. In this paper, we propose a new music playlist generation method based on reinforcement learning using an acoustic feature map. Our reinforcement learning-based music playlist generation can overlook the whole songs since an agent explores all of the features on the map. This new playlist generation can achieve high diversity and smooth track transitions. Experimental results show the effectiveness of the proposed method.
• Estimation of Images Matched with Audio-Induced Brain Activity via Modified DGCCA.

  Yun Liang 0014, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020 940 - 941 2020年 

  This paper presents a method that can match images with audio-induced brain activity via modified deep generalized canonical correlation analysis (modified DGCCA). Modified DGCCA that contains the Pearson correlation coefficient in its loss function is newly derived for embedding not only images and audio but also audio-induced brain activity calculated from functional near-infrared spectroscopy (fNIRS) into the same feature space. By inputting audio and its corresponding brain activity into modified DGCCA, the estimation of their best matched images becomes feasible. The experiment result shows the effectiveness of the proposed method. The main contribution of this paper is the introduction of a new method for matching images with audio-induced brain activity.
• Estimation of User-Specific Visual Attention Considering Individual Tendency toward Gazed Objects.

  Yuya Moroto, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020 745 - 746 2020年 

  An estimation method of user-specific visual attention considering individual tendency toward gazed objects is presented in this paper. For realization the user-specific visual attention for images, it can be effective to use the past gaze tendency of a target user and gaze data obtained from other users. However, the collaborative use of these information is difficult since there may be no gaze data obtained from other users. Then the proposed method focuses on the saliency map and enables the collaborative use of those information for estimation of user-specific visual attention. It is confirmed that the estimation accuracy of the proposed method improved by approximately 20% compared to the state-of-the-art saliency estimation method by performing the experiment.
• Estimation of Viewed Images Using Individual and Shared Brain Responses.

  Takaaki Higashi, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020 716 - 717 2020年 

  This paper presents a method to estimate viewed images by using brain responses measured when persons view images. The proposed method predicts visual features of viewed images from not only individual brain responses but also shared brain responses of multiple subjects. Specifically, the proposed method simultaneously estimates the following two projection matrices: a matrix that converts individual brain responses into visual features and a matrix that converts shared brain responses into visual features. The collaborative use of two types of brain responses is the biggest contribution of this paper. Experimental results show that the proposed method improves the estimation accuracy in comparison with methods considering only individual or shared brain responses.
• Cross-domain Recommendation via Multi-layer Graph Analysis Using User-item Embedding.

  Taisei Hirakawa, Keisuke Maeda, Takahiro Ogawa, Satoshi Asamizu, Miki Haseyama

  2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020 714 - 715 2020年 

  This paper presents cross-domain recommendation via multi-layer graph analysis using user-item embedding. The proposed method constructs two graphs in source and target domains utilizing user-item embedding, respectively. By training relationship between the user's embedding features in these two graphs, the proposed method realizes the cross-domain recommendation via the multi-layer graphs. This is the main contribution of this paper. Then the proposed method can estimate the user's embedding in the target domain from that in the source domain. Finally, our method can recommend items to users via the estimated user's embedding. Experiments on real-world datasets verify the effectiveness of the proposed method.
• Question Answering for Estimation of Seen Image Contents from Multi-subject fMRI Responses.

  Saya Takada, Ren Togo, Takahiro Ogawa, Miki Haseyama

  2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020 712 - 713 2020年 

  Estimating seen image contents based on the analysis of functional magnetic resonance imaging (fMRI) data has been actively researched. So far, it has been necessary to train a model with individual fMRI data and construct models for each task. In this paper, we propose an estimation method via Visual Question Answering (VQA) from fMRI data from multi-subjects. The task of VQA in the field of computer vision is generating answers when given an image and questions about its contents. The proposed method enables generation accurate answers via the VQA model when given fMRI data and questions about the seen images. Besides, we newly introduce training with multi-subject fMRI data since fMRI datasets are generally small due to the burden for subjects. Then we can realize the estimation of the contents of seen images from fMRI data of a subject whose data are not used in the training phase.
• Face Synthesis via User Manipulation of Disentangled Latent Representation.

  Nao Nakagawa, Ren Togo, Takahiro Ogawa, Miki Haseyama

  2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020 692 - 693 2020年 

  In this paper, we propose a novel face synthesis method whose process can be conditioned not only on labels but also on latent variables as 'unknown' labels corresponding to unrevealed factors. We extend Variational Autoencoder (VAE) without any additional networks to introduce conditional generation, disentangled representation, and adversarial learning into one autoencoder. Since previous conditional generative models require the annotation of labels to condition them on, disentanglement, i.e., the unsupervised discovery of generative factors enables users to generate face images more flexibly and more efficiently. Moreover, although generative adversarial networks (GANs) have problems of mode collapse and instability of the learning process, adversarial learning on VAE in an introspective way achieves both the variation of results and the stability of generation. Evaluations on the CelebFaces Attributes Dataset (CelebA) show that our method can generate face images following users' conditioning both on the known and the 'unknown' labels.
• Complexity Evaluation of Medical Image Data for Classification Problem Based on Spectral Clustering.

  Guang Li, Ren Togo, Takahiro Ogawa, Miki Haseyama

  2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020 667 - 669 2020年 

  Deep convolutional neural networks (DCNNs) have been popular with medical image classification problems in recent years. However, training a DCNN model on the sizeable medical dataset requires repeated manipulation to achieve the desired results and hence is time-consuming. Since there is an inevitable link between DCNN training results and the complexity of the medical dataset, it is essential to accurately evaluate the medical dataset's complexity before training the DCNN models. In this paper, we propose an efficient method to assess the medical dataset's complexity based on spectral clustering. The experimental results show that the medical dataset complexity calculated with our approach is not time-consuming and has a high correlation with DCNN test accuracy.
• Important Scene Prediction of Baseball Videos Using Twitter and Video Analysis Based on LSTM.

  Kaito Hirasawa, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020 636 - 637 2020年 

  This paper presents a novel important scene prediction method using baseball videos and tweets on Twitter based on a Long Short-Term Memory (LSTM). For considering baseball videos and tweets, the proposed method utilizes textual, visual and audio features. Introducing these multi-modal features into the important scene prediction of baseball videos is the first work. In order to deal with multi-modal time-series features constructed from textual, visual and audio features, the proposed method adopts LSTM which is effective for training such multimodal time-series features by maintaining a long-term memory. The effectiveness of the proposed method is confirmed by experimental results.
• Brain Decoding of Viewed Image Categories via Semi-Supervised Multi-View Bayesian Generative Model.

  Yusuke Akamatsu, Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  IEEE Trans. Signal Process. 68 5769 - 5781 2020年 

  Brain decoding has shown that viewed image categories can be estimated from evoked functional magnetic resonance imaging (fMRI) activity. Recent studies attempted to estimate viewed image categories that were not used for training previously. Nevertheless, the estimation performance is limited since it is difficult to collect a large amount of fMRI data for training. This paper presents a method to accurately estimate viewed image categories not used for training via a semi-supervised multi-view Bayesian generative model. Our model focuses on the relationship between fMRI activity and multiple modalities, i.e., visual features extracted from viewed images and semantic features obtained from viewed image categories. Furthermore, in order to accurately estimate image categories not used for training, our semi-supervised framework incorporates visual and semantic features obtained from additional image categories in addition to image categories of training data. The estimation performance of the proposed model outperforms existing state-of-the-art models in the brain decoding field and achieves more than 95% identification accuracy. The results also have shown that the incorporation of additional image category information is remarkably effective when the number of training samples is small. Our semi-supervised framework is significant for the brain decoding field where brain activity patterns are insufficient but visual stimuli are sufficient.
• Few-Shot Personalized Saliency Prediction Based on Adaptive Image Selection Considering Object and Visual Attention.

  Yuya Moroto, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  Sensors 20 8 2170 - 2170 2020年 

  A few-shot personalized saliency prediction based on adaptive image selection considering object and visual attention is presented in this paper. Since general methods predicting personalized saliency maps (PSMs) need a large number of training images, the establishment of a theory using a small number of training images is needed. To tackle this problem, although finding persons who have visual attention similar to that of a target person is effective, all persons have to commonly gaze at many images. Thus, it becomes difficult and unrealistic when considering their burden. On the other hand, this paper introduces a novel adaptive image selection (AIS) scheme that focuses on the relationship between human visual attention and objects in images. AIS focuses on both a diversity of objects in images and a variance of PSMs for the objects. Specifically, AIS selects images so that selected images have various kinds of objects to maintain their diversity. Moreover, AIS guarantees the high variance of PSMs for persons since it represents the regions that many persons commonly gaze at or do not gaze at. The proposed method enables selecting similar users from a small number of images by selecting images that have high diversities and variances. This is the technical contribution of this paper. Experimental results show the effectiveness of our personalized saliency prediction including the new image selection scheme.
• Tensor-Based Emotional Category Classification via Visual Attention-Based Heterogeneous CNN Feature Fusion.

  Yuya Moroto, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  Sensors 20 7 2146 - 2146 2020年 

  The paper proposes a method of visual attention-based emotion classification through eye gaze analysis. Concretely, tensor-based emotional category classification via visual attention-based heterogeneous convolutional neural network (CNN) feature fusion is proposed. Based on the relationship between human emotions and changes in visual attention with time, the proposed method performs new gaze-based image representation that is suitable for reflecting the characteristics of the changes in visual attention with time. Furthermore, since emotions evoked in humans are closely related to objects in images, our method uses a CNN model to obtain CNN features that can represent their characteristics. For improving the representation ability to the emotional categories, we extract multiple CNN features from our novel gaze-based image representation and enable their fusion by constructing a novel tensor consisting of these CNN features. Thus, this tensor construction realizes the visual attention-based heterogeneous CNN feature fusion. This is the main contribution of this paper. Finally, by applying logistic tensor regression with general tensor discriminant analysis to the newly constructed tensor, the emotional category classification becomes feasible. Since experimental results show that the proposed method enables the emotional category classification with the F1-measure of approximately 0.6, and about 10% improvement can be realized compared to comparative methods including state-of-the-art methods, the effectiveness of the proposed method is verified.
• Chronic gastritis classification using gastric X-ray images with a semi-supervised learning method based on tri-training.

  Zongyao Li, Ren Togo, Takahiro Ogawa, Miki Haseyama

  Medical Biol. Eng. Comput. 58 6 1239 - 1250 2020年 

  High-quality annotations for medical images are always costly and scarce. Many applications of deep learning in the field of medical image analysis face the problem of insufficient annotated data. In this paper, we present a semi-supervised learning method for chronic gastritis classification using gastric X-ray images. The proposed semi-supervised learning method based on tri-training can leverage unannotated data to boost the performance that is achieved with a small amount of annotated data. We utilize a novel learning method named Between-Class learning (BC learning) that can considerably enhance the performance of our semi-supervised learning method. As a result, our method can effectively learn from unannotated data and achieve high diagnostic accuracy for chronic gastritis. [Figure not available: see fulltext.].
• Multi-Task Convolutional Neural Network Leading to High Performance and Interpretability via Attribute Estimation.

  Keisuke Maeda, Kazaha Horii, Takahiro Ogawa, Miki Haseyama

  IEICE Trans. Fundam. Electron. Commun. Comput. Sci. 103-A 12 1609 - 1612 2020年 

  A multi-task convolutional neural network leading to high performance and interpretability via attribute estimation is presented in this letter. Our method can provide interpretation of the classification results of CNNs by outputting attributes that explain elements of objects as a judgement reason of CNNs in the middle layer. Furthermore, the proposed network uses the estimated attributes for the following prediction of classes. Consequently, construction of a novel multi-task CNN with improvements in both of the interpretability and classification performance is realized.
• Inpainting via Sparse Representation Based on a Phaseless Quality Metric.

  Takahiro Ogawa, Keisuke Maeda, Miki Haseyama

  IEICE Trans. Fundam. Electron. Commun. Comput. Sci. 103-A 12 1541 - 1551 2020年 

  An inpainting method via sparse representation based on a new phaseless quality metric is presented in this paper. Since power spectra, phaseless features, of local regions within images enable more successful representation of their texture characteristics compared to their pixel values, a new quality metric based on these phaseless features is newly derived for image representation. Specifically, the proposed method enables spare representation of target signals, i.e., target patches, including missing intensities by monitoring errors converged by phase retrieval as the novel phaseless quality metric. This is the main contribution of our study. In this approach, the phase retrieval algorithm used in our method has the following two important roles: (1) derivation of the new quality metric that can be derived even for images including missing intensities and (2) conversion of phaseless features, i.e., power spectra, to pixel values, i.e., intensities. Therefore, the above novel approach solves the existing problem of not being able to use better features or better quality metrics for inpainting. Results of experiments showed that the proposed method using sparse representation based on the new phaseless quality metric outperforms previously reported methods that directly use pixel values for inpainting.
• Heterogeneous-Graph-Based Video Search Reranking Using Topic Relevance.

  Soh Yoshida, Mitsuji Muneyasu, Takahiro Ogawa, Miki Haseyama

  IEICE Trans. Fundam. Electron. Commun. Comput. Sci. 103-A 12 1529 - 1540 2020年 

  In this paper, we address the problem of analyzing topics, included in a social video group, to improve the retrieval performance of videos. Unlike previous methods that focused on an individual visual aspect of videos, the proposed method aims to leverage the "mutual reinforcement" of heterogeneous modalities such as tags and users associated with video on the Internet. To represent multiple types of relationships between each heterogeneous modality, the proposed method constructs three subgraphs: user-tag, video-video, and video-tag graphs. We combine the three types of graphs to obtain a heterogeneous graph. Then the extraction of latent features, i.e., topics, becomes feasible by applying graph-based soft clustering to the heterogeneous graph. By estimating the membership of each grouped cluster for each video, the proposed method defines a new video similarity measure. Since the understanding of video content is enhanced by exploiting latent features obtained from different types of data that complement each other, the performance of visual reranking is improved by the proposed method. Results of experiments on a video dataset that consists of YouTube-8M videos show the effectiveness of the proposed method, which achieves a 24.3% improvement in terms of the mean normalized discounted cumulative gain in a search ranking task compared with the baseline method.
• Deep convolutional neural network-based anomaly detection for organ classification in gastric X-ray examination.

  Ren Togo, Haruna Watanabe, Takahiro Ogawa, Miki Haseyama

  Comput. Biol. Medicine 123 103903 - 103903 2020年 

  Aim: The aim of this study was to determine whether our deep convolutional neural network-based anomaly detection model can distinguish differences in esophagus images and stomach images obtained from gastric X-ray examinations. Methods: A total of 6012 subjects were analyzed as our study subjects. Since the number of esophagus X-ray images is much smaller than the number of gastric X-ray images taken in X-ray examinations, we took an anomaly detection approach to realize the task of organ classification. We constructed a deep autoencoding gaussian mixture model (DAGMM) with a convolutional autoencoder architecture. The trained model can produce an anomaly score for a given test X-ray image. For comparison, the original DAGMM, AnoGAN, and a One-Class Support Vector Machine (OCSVM) that were trained with features obtained by a pre-trained Inception-v3 network were used. Results: Sensitivity, specificity, and the calculated harmonic mean of the proposed method were 0.956, 0.980, and 0.968, respectively. Those of the original DAGMM were 0.932, 0.883, and 0.907, respectively. Those of AnoGAN were 0.835, 0.833, and 0.834, respectively, and those of OCSVM were 0.932, 0.935, and 0.934, respectively. Experimental results showed the effectiveness of the proposed method for an organ classification task. Conclusion: Our deep convolutional neural network-based anomaly detection model has shown the potential for clinical use in organ classification.
• Human-Centric Emotion Estimation Based on Correlation Maximization Considering Changes With Time in Visual Attention and Brain Activity.

  Yuya Moroto, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  IEEE Access 8 203358 - 203368 2020年 

  A human-centric emotion estimation method based on correlation maximization with consideration of changes with time in visual attention and brain activity when viewing images is proposed in this paper. Owing to the recent developments of many kinds of biological sensors, many researchers have focused on multimodal emotion estimation using both eye gaze data and brain activity data for improving the quality of emotion estimation. In this paper, a novel method that focuses on the following two points is introduced. First, in order to reduce the burden on users, we obtain brain activity data from users only in the training phase by using a projection matrix calculated by canonical correlation analysis (CCA) between gaze-based visual features and brain activity-based features. Next, for considering the changes with time in both visual attention and brain activity, we obtain novel features based on CCA-based projection in each time unit. In order to include these two points, the proposed method analyzes a fourth-order gaze and image tensor for which modes are pixel location, color channel and the changes with time in visual attention. Moreover, in each time unit, the proposed method performs CCA between gaze-based visual features and brain activity-based features to realize human-centric emotion estimation with a high level of accuracy. Experimental results show that accurate human emotion estimation is achieved by using our new human-centric image representation.
• Estimation of Interest Levels From Behavior Features via Tensor Completion Including Adaptive Similar User Selection.

  Keisuke Maeda, Tetsuya Kushima, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  IEEE Access 8 126109 - 126118 2020年 

  A method for estimating interest levels from behavior features via tensor completion including adaptive similar user selection is presented in this paper. The proposed method focuses on a tensor that is suitable for data containing multiple contexts and constructs a third-order tensor in which three modes are 'products', 'users' and 'user behaviors and interest levels' for these products. By complementing this tensor, unknown interest level estimation of a product for a target user becomes feasible. For further improving the estimation performance, the proposed method adaptively selects similar users for the target user by focusing on converged estimation errors between estimated interest levels and known interest levels in the tensor completion. Furthermore, the proposed method can adaptively estimate the unknown interest from the similar users. This is the main contribution of this paper. Therefore, the influence of users having different interests is reduced, and accurate interest level estimation can be realized. In order to verify the effectiveness of the proposed method, we show experimental results obtained by estimating interest levels of users holding books.
• Supervised Fractional-Order Embedding Geometrical Multi-View CCA (SFGMCCA) for Multiple Feature Integration.

  Keisuke Maeda, Yoshiki Ito, Takahiro Ogawa, Miki Haseyama

  IEEE Access 8 114340 - 114353 2020年 

  Techniques for integrating different types of multiple features effectively have been actively studied in recent years. Multiset canonical correlation analysis (MCCA), which maximizes the sum of pairwise correlations of inter-view (i.e., between different features), is one of the powerful methods for integrating different types of multiple features, and various MCCA-based methods have been proposed. This work focuses on a supervised MCCA variant in order to construct a novel effective feature integration framework. In this paper, we newly propose supervised fractional-order embedding geometrical multi-view CCA (SFGMCCA). This method constructs not only the correlation structure but also two types of geometrical structures of intra-view (i.e., within each feature) and inter-view simultaneously, thereby realizing more precise feature integration. This method also supports the integration of small sample and high-dimensional data by using the fractional-order technique. We conducted experiments using four types of image datasets, i.e., MNIST, COIL-20, ETH-80 and CIFAR-10. Furthermore, we also performed an fMRI dataset containing brain signals to verify the robustness. As a result, it was confirmed that accuracy improvements using SFGMCCA were statistically significant at the significance level of 0.05 compared to those using conventional representative MCCA-based methods.
• Enhancing Cross-Modal Retrieval Based on Modality-Specific and Embedding Spaces.

  Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama

  IEEE Access 8 96777 - 96786 2020年 

  A new approach that drastically improves cross-modal retrieval performance in vision and language (hereinafter referred to as & x201C;vision and language retrieval & x201D;) is proposed in this paper. Vision and language retrieval takes data of one modality as a query to retrieve relevant data of another modality, and it enables flexible retrieval across different modalities. Most of the existing methods learn optimal embeddings of visual and lingual information to a single common representation space. However, we argue that the forced embedding optimization results in loss of key information for sentences and images. In this paper, we propose an effective utilization of representation spaces in a simple but robust vision and language retrieval method. The proposed method makes use of multiple individual representation spaces through text-to-image and image-to-text models. Experimental results showed that the proposed approach enhances the performance of existing methods that embed visual and lingual information to a single common representation space.
• Context-Aware Network Analysis of Music Streaming Services for Popularity Estimation of Artists.

  Yui Matsumoto, Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  IEEE Access 8 48673 - 48685 2020年 [査読有り][通常論文]
   

  A novel trial for estimating popularity of artists in music streaming services (MSS) is presented in this paper. The main contribution of this paper is to improve extensibility for using multi-modal features to accurately analyze latent relationships between artists. In the proposed method, a novel framework to construct a network is derived by collaboratively using social metadata and multi-modal features via canonical correlation analysis. Different from conventional methods that do not use multi-modal features, the proposed method can construct a network that can capture social metadata and multi-modal features, i.e., a context-aware network. For effectively analyzing the context-aware network, a novel framework to realize popularity estimation of artists is developed based on network analysis. The proposed method enables effective utilization of the network structure by extracting node features via a node embedding algorithm. By constructing an estimator that can distinguish differences between the node features, the proposed method can archive accurate popularity estimation of artists. Experimental results using multiple real-world datasets that contain artists in various genres in Spotify, one of the largest MSS, are presented. Quantitative and qualitative evaluations show that our method is effective for both classifying and regressing the popularity.
• Retrieval of similar scenes based on multimodal distance metric learning in soccer videos

  Tomoki Haruyama, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  MMSports 2019 - Proceedings of the 2nd International Workshop on Multimedia Content Analysis in Sports, co-located with MM 2019 10 - 15 2019年10月15日 [査読有り][通常論文]
   

  © 2019 Association for Computing Machinery. This paper presents a new method for retrieval of similar scenes based on multimodal distance metric learning in far-view soccer videos that broadly capture soccer fields and are not edited. We extract visual features and audio features from soccer video clips, and we extract text features from text data corresponding to these soccer video clips. In addition, distance metric learning based on Laplacian Regularized Metric Learning is performed to calculate the distances for each kind of features. Finally, by determining the final rank by integrating these distances, we realize successful multimodal retrieval of similar scenes from query scenes of soccer video clips. Experimental results show the effectiveness of our retrieval method.
• Semantic Shot Classification in Baseball Videos Based on Similarities of Visual Features

  K. Hirasawa, K. Maeda, T. Ogawa, M. Haseyama

  IEEE Global Conference on Consumer Electronics (GCCE) 663 - 664 2019年10月 [査読有り][通常論文]
   

  This paper presents a method of semantic shot classification in baseball videos based on similarities of visual features. Since it is difficult to prepare a large amount of training data with annotation, accurate event detection methods constructed from a small amount of training data are needed. In broadcast baseball video, since view angles of cameras are different for each event, shot change and event change have a close relationship. When visual features from shots are similar, events corresponding to shots are also similar, and a simple distance-based approach only focusing on training data is effective. Therefore, semantic shot classification based on visual features from a small amount of training data can be realized.
• Region-based Distress Classification of Road Infrastructures via CNN Without Region Annotation

  N. Ogawa, K. Maeda, T. Ogawa, M. Haseyama

  IEEE Global Conference on Consumer Electronics (GCCE) 764 - 765 2019年10月 [査読有り][通常論文]
   

  This paper presents region-based distress classification of road infrastructures via convolutional neural networks (CNN) without region annotation. Although CNNs are often used for classification tasks recently, CNNs trained from images which contain unnecessary regions cannot perform precise classification. Distress images of road infrastructures contain various unnecessary objects other than the target distress. Although target regions should be provided in order to achieve high performance, it is a time-confusing task for engineers. This paper focuses on removing unnecessary objects in the images without region annotation via an object detection method. Especially, by using a pre-trained object detection model with distress images of road infrastructures, distress regions in the images are detected automatically. Our proposed CNN trained from the obtained distress regions realizes precise distress classification.
• Aesthetic style transfer through text-to-image synthesis and image-to-image translation

  Megumi Kotera, Ren Togo, Takahiro Ogawa, Miki Haseyama

  IEEE Global Conference on Consumer Electronics (GCCE) 492 - 493 2019年10月 [査読有り][通常論文]
   

  This paper presents a style transfer method combining generative adversarial networks and style transfer networks. In the previous style transfer methods, transformation from one image to another has been proposed. On the other hand, our method enables style transfer from a text to an image. This will be helpful when there are no images that represent the desired style. Experimental results show the effectiveness of our method.
• Voice-input multimedia information retrieval system based on text-to-image GAN

  Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama

  IEEE Global Conference on Consumer Electronics (GCCE) 943 - 944 2019年10月 [査読有り][通常論文]
   

  In this paper, we develop an integrated multimedia information retrieval system. By utilizing text-to-image Generative Adversarial Network and image-to-text model, the developed system enables users to retrieve an objective content utilizing voice as an input with high accuracy. Experimental results show the effectiveness of the developed system.
• Detection of distress region from subway tunnel images via U-net-based deep semantic segmentation

  An Wang, Ren Togo, Takahiro Ogawa, Miki Haseyama

  IEEE Global Conference on Consumer Electronics (GCCE) 766 - 767 2019年10月 [査読有り][通常論文]
   

  The maintenance and management of old infrastructures has become an urgent issue nowadays, as an important part of transportation infrastructures, the subway tunnels are facing the same problem as other infrastructures. In this paper, we present a distress detection method in subway tunnels using U-net. As one of the semantic segmentation neural networks, U-net shows promising performance in remote sensing image segmentation and medical image segmentation. We apply this network to a subway tunnel dataset and compare it with other three semantic segmentation methods. From our experiment, it is shown that the proposed approach achieves promising results in our task.
• Estimation of Emotion Labels via Tensor-Based Spatiotemporal Visual Attention Analysis

  Yuya Moroto, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  Proceedings - International Conference on Image Processing, ICIP 2019-September 4105 - 4109 2019年09月 [査読有り][通常論文]
   

  © 2019 IEEE. This paper presents emotion label estimation via tensor-based spatiotemporal visual attention analysis. It has been reported in the fields of psychology and neuroscience that human emotions are related to two elements, their visual attention change and objects included in a target image. Therefore, the proposed method focuses on the spatiotemporal change of visual attention of human gazing at objects in the target image and constructs two neural networks which enable the emotion label estimation considering both of the above two elements. Specifically, the proposed method newly constructs a fourth-order tensor, gaze and image tensor (GIT) whose modes correspond to the width, the height and the color channel of the target image and the time axis of visual attention which is used for representing the time change. Then the first network, which consists of general tensor discriminant analysis (GTDA) and extreme learning machine (ELM), estimates the emotion label from the fourth-order GIT with concerning their visual attention change. Furthermore, the second network, which consists of pre-trained convolutoinal neural network-based feature extraction, GTDA and ELM, enables the estimation from the second-order GIT including visual features obtained from objects focused at each time. Finally, the proposed method estimates emotion labels based on decision fusion of the outputs from the two networks. Experimental results show the effectiveness of the proposed method.
• Scene Retrieval for Video Summarization Based on Text-to-Image gan

  Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama

  Proceedings - International Conference on Image Processing, ICIP 2019-September 1825 - 1829 2019年09月 [査読有り][通常論文]
   

  © 2019 IEEE. We present a new scene retrieval method based on text-to-image Generative Adversarial Network (GAN) and its application to query-based video summarization. Text-to-image GAN is a deep learning method that can generate images from their corresponding sentences. In this paper, we reveal a characteristic that deep learning-based visual features extracted from images generated by text-to-image GAN include semantic information sufficiently. By utilizing the generated images as queries, the proposed method achieves higher scene retrieval performance than those of the stateof-the-art methods. In addition, we introduce a novel architecture that can consider order relationship of the input sentences to our method for realizing a target video summarization. Specifically, the proposed method generates multiple images thorough text-to-image GAN from multiple sentences summarizing target videos. Their summarized video can be obtained by performing the retrieval of corresponding scenes from the target videos according to the generated images with considering the order relationship. Experimental results show the effectiveness of the proposed method in the retrieval and summarization performance.
• Gastritis Detection from Gastric X-Ray Images Via Fine-Tuning of Patch-Based Deep Convolutional Neural Network

  Misaki Kanai, Ren Togo, Takahiro Ogawa, Miki Haseyama

  Proceedings - International Conference on Image Processing, ICIP 2019-September 1371 - 1375 2019年09月 [査読有り][通常論文]
   

  © 2019 IEEE. This paper presents a method for gastritis detection from gastric X-ray images via fine-tuning techniques using a deep convolutional neural network (DCNN). DCNNs can learn parameters to capture high-dimensional features which express semantic contents of images by training on a large number of labeled images. However, lack of gastric X-ray images for training often occurs. To realize accurate detection with a small number of gastric X-ray images, the proposed method adopts fine-tuning techniques and newly introduces simple annotation of stomach regions to gastric X-ray images used for training. The proposed method fine-tunes a pre-trained DCNN with patches and three kinds of patch-level class labels considering not only the image-level ground truth ('gastritis'/'non-gastritis') but also the regions of a stomach since the outside of the stomach is not related to the image-level ground truth. In the test phase, by estimating the patch-level class labels with the fine-tuned DCNN, the proposed method enables the image-level class label estimation which excludes the effect of the unnecessary regions. Experimental results show the effectiveness of the proposed method.
• Neural Network Maximizing Ordinally Supervised Multi-View Canonical Correlation for Deterioration Level Estimation

  Keisuke Maeda, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  Proceedings - International Conference on Image Processing, ICIP 2019-September 919 - 923 2019年09月 [査読有り][通常論文]
   

  © 2019 IEEE. This paper presents a neural network maximizing ordinally supervised multi-view canonical correlation for deterioration level estimation. The contributions of this paper are twofold. First, in order to calculate features representing deterioration levels on transmission towers, which is one of the infrastructures, a novel neural network handling multi-modal features is constructed from a small amount of training data. Specifically, in our method, effective transformation to features with high discriminant ability without using many hidden layers is realized by setting projection matrices maximizing correlation between multiple features into hidden layer's weights. Second, since there exists ordinal scale in deterioration levels, the proposed method newly derives ordinally supervised multi-view canonical correlation analysis (OsMVCCA). OsMVCCA enables estimation of the effective projection considering not only label information but also their ordinal scales. Experimental results show that the proposed method realizes accurate deterioration level estimation.
• Bilingual Lexicon Learning Using Tagged Images via Graph Trilateral Filter-based Feature Refinement

  Yui Matsumoto, Shota Hamano, Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  2019 IEEE International Conference on Consumer Electronics - Taiwan, ICCE-TW 2019 2019年05月 

  A novel method to realize bilingual lexicon learning (BLL) using tagged images is presented in this paper. Different from existing methods that require parallel corpora, the proposed method enables extraction of semantically similar words by utilizing not such corpora but tagged images on image sharing services. The main contribution of this paper is derivation of a novel framework to refine visual features of tagged images based on graph trilateral filter-based smoothing. This enables reduction of the influence of noisy tags that are irrelevant to contents of images. As a result, accurate BLL becomes feasible by nearest neighbor search using the refined visual features.
• Convolutional Sparse Coding-based Anomalous Event Detection in Surveillance Videos

  Masanao Matsumoto, Naoki Saito, Takahiro Ogawa, Miki Haseyama

  2019 IEEE International Conference on Consumer Electronics - Taiwan, ICCE-TW 2019 2019年05月 

  This paper presents a Convolutional Sparse Coding (CSC)-based anomalous event detection method in surveillance videos. The proposed method derives new features from reconstruction errors and sparse coefficient maps obtained by CSC, and the anomalous events are detected by a multi-layer network whose inputs are the above new features. Since such events, i.e., anomalous objects, have different characteristics in the sparse coefficient maps and their corresponding reconstruction errors, successful detection can be expected. Experimental results show high detection performance of own method.
• User-Specific Visual Attention Estimation Based on Visual Similarity and Spatial Information in Images

  Y. Moroto, K. Maeda, T. Ogawa, M. Haseyama

  IEEE International Conference on Consumer Electronics – Taiwan (ICCE-TW) 479 - 480 2019年05月 [査読有り][通常論文]
   

  This paper presents a method for user-specific visual attention estimation based on visual similarities and spatial information in images. In order to estimate the user-specific visual attention, the proposed method calculates two kinds of saliency maps. One is constructed as a visual similarity-based saliency map, and the other is constructed by considering spatial information of objects in images. The proposed method performs a fusion of these two maps for considering visual similarities and spatial information. This is the biggest contribution of this paper. Therefore, improvement of the estimation performance of the user-specific visual attention is realized.
• Estimating Viewed Image Categories from Human Brain Activity via Semi-supervised Fuzzy Discriminative Canonical Correlation Analysis.

  Yusuke Akamatsu, Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2019, Brighton, United Kingdom, May 12-17, 2019 2019-May 1105 - 1109 IEEE 2019年05月 [査読有り][通常論文]
   

  © 2019 IEEE. This paper presents a method to estimate viewed image categories from human brain activity via newly derived semi-supervised fuzzy discriminative canonical correlation analysis (Semi-FDCCA). The proposed method can estimate image categories from functional magnetic resonance imaging (fMRI) activity measured while subjects view images by making fMRI activity and visual features obtained from images comparable through Semi-FDCCA. To realize Semi-FDCCA, we first derive a new supervised CCA called FDCCA that can consider fuzzy class information based on image category similarities obtained from WordNet ontology. Second, we adopt SemiCCA that can utilize additional unpaired visual features in addition to pairs of fMRI activity and visual features in order to prevent overfitting to the limited pairs. Furthermore, Semi-FDCCA can be derived by combining FDCCA with SemiCCA. Experimental results show that Semi-FDCCA enables accurate estimation of viewed image categories.
• Detection of gastritis by a deep convolutional neural network from double-contrast upper gastrointestinal barium X-ray radiography

  Ren Togo, Nobutake Yamamichi, Katsuhiro Mabe, Yu Takahashi, Chihiro Takeuchi, Mototsugu Kato, Naoya Sakamoto, Kenta Ishihara, Takahiro Ogawa, Miki Haseyama

  Journal of Gastroenterology 54 4 321 - 329 2019年04月 [査読有り][通常論文]
   

  © 2018, Japanese Society of Gastroenterology. Background: Deep learning has become a new trend of image recognition tasks in the field of medicine. We developed an automated gastritis detection system using double-contrast upper gastrointestinal barium X-ray radiography. Methods: A total of 6520 gastric X-ray images obtained from 815 subjects were analyzed. We designed a deep convolutional neural network (DCNN)-based gastritis detection scheme and evaluated the effectiveness of our method. The detection performance of our method was compared with that of ABC (D) stratification. Results: Sensitivity, specificity, and harmonic mean of sensitivity and specificity of our method were 0.962, 0.983, and 0.972, respectively, and those of ABC (D) stratification were 0.925, 0.998, and 0.960, respectively. Although there were 18 false negative cases in ABC (D) stratification, 14 of those 18 cases were correctly classified into the positive group by our method. Conclusions: Deep learning techniques may be effective for evaluation of gastritis/non-gastritis. Collaborative use of DCNN-based gastritis detection systems and ABC (D) stratification will provide more reliable gastric cancer risk information.
• The friction properties of firebrat scales

  Yuji Hirai, Naoto Okuda, Naoki Saito, Takahiro Ogawa, Ryuichiro Machida, Shûhei Nomura, Masahiro Ôhara, Miki Haseyama, Masatsugu Shimomura

  Biomimetics 4 1 2019年03月01日 

  Friction is an important subject for sustainability due to problems that are associated with energy loss. In recent years, micro- and nanostructured surfaces have attracted much attention to reduce friction; however, suitable structures are still under consideration. Many functional surfaces are present in nature, such as the friction reduction surfaces of snake skins. In this study, we focused on firebrats, Thermobia domestica, which temporary live in narrow spaces, such as piled papers, so their body surface (integument) is frequently in contact with surrounding substrates. We speculate that, in addition to optical, cleaning effects, protection against desiccation and enemies, their body surface may be also adapted to reduce friction. To investigate the functional effects of the firebrat scales, firebrat surfaces were observed using a field-emission scanning electron microscope (FE-SEM) and a colloidal probe atomic force microscope (AFM). Results of surface observations by FE-SEM revealed that adult firebrats are entirely covered with scales, whose surfaces have microgroove structures. Scale groove wavelengths around the firebrat's head are almost uniform within a scale but they vary between scales. At the level of single scales, AFM friction force measurements revealed that the firebrat scale reduces friction by decreasing the contact area between scales and a colloidal probe. The heterogeneity of the scales' groove wavelengths suggests that it is difficult to fix the whole body on critical rough surfaces and may result in a "fail-safe" mechanism.
• Extraction of regions related to cardiac sarcoidosis in polar map images

  Ren Togo, Takahiro Ogawa, Osamu Manabe, Kenji Hirata, Tohru Shiga, Miki Haseyama

  2019 IEEE 1st Global Conference on Life Sciences and Technologies, LifeTech 2019 237 - 238 2019年03月 [査読有り][通常論文]
   

  © 2019 IEEE. This paper presents a method for extracting important regions for deep learning models in the identification of cardiac sarcoidosis using polar map images. Although deep learning-based detection methods have widely studied, they are still often called black boxes. Since high reliability for provided results from computer-aided diagnosis systems is important toward clinical applications, this problem should be solved. In this paper, we try to visualize important regions for deep learning-based models for improvement of understanding to clinicians. We monitor the variance of confidence of a model constructed with a deep learning-based feature and define it as a contribution value toward the estimated label. We visualize important regions for models based on the contribution value.
• Estimation of emotions evoked by images based on multiple gaze-based CNN features

  Taiga Matsui, Naoki Saito, Takahiro Ogawa, Satoshi Asamizu, Miki Haseyama

  2019 IEEE 1st Global Conference on Life Sciences and Technologies, LifeTech 2019 194 - 195 2019年03月 [査読有り][通常論文]
   

  © 2019 IEEE. This paper presents a method for estimating emotions evoked by watching images based on multiple visual features considering relationship with gaze information. The proposed method obtains multiple visual features from multiple middle layers of a Convolutional Neural Network. Then the proposed method newly derives their gaze-based visual features maximizing correlation with gaze information by using Discriminative Locality Preserving Canonical Correlation Analysis. The final estimation result is calculated by integrating multiple estimation results obtained from these gaze-based visual features. Consequently, successful emotion estimation becomes feasible by using such multiple estimation results which correspond to different semantic levels of target images.
• Estimation of users' interest levels using tensor completion with SemiCCA

  Tetsuya Kushima, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  2019 IEEE 1st Global Conference on Life Sciences and Technologies, LifeTech 2019 239 - 240 2019年03月 [査読有り][通常論文]
   

  © 2019 IEEE. This paper presents a new method for estimation of users' interest levels using tensor completion with SemiCCA. The proposed method extracts new features maximizing correlation between features calculated from partially paired users' behavior and contents with semi-supervised canonical correlation analysis (SemiCCA). By this approach, we can successfully use the contents that users have not viewed for the interest level estimation. Moreover, our method utilizes the tensor completion to estimate unknown interest levels. Consequently, in the proposed method, accurate estimation of interest levels using SemiCCA and the tensor completion is realized. Experimental results are shown to verify the effectiveness of the proposed method by using actual data.
• Classification of subcellular protein patterns in human cells with transfer learning

  Zongyao Li, Ren Togo, Takahiro Ogawa, Miki Haseyama

  2019 IEEE 1st Global Conference on Life Sciences and Technologies, LifeTech 2019 273 - 274 2019年03月 [査読有り][通常論文]
   

  © 2019 IEEE. In this paper, we present a deep learning method for classifying subcellular protein patterns in human cells. Our method is mainly based on transfer learning and utilizes a newly proposed loss function named focal loss to deal with the problem of severe class imbalance existing in the task. The performance of our method is evaluated by a MacroF1 score of total 28 classes, and the final MacroF1 score of our method is 0.706.
• Estimation of visual attention via canonical correlation between visual and gaze-based features

  Yuya Moroto, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  2019 IEEE 1st Global Conference on Life Sciences and Technologies, LifeTech 2019 229 - 230 2019年03月 [査読有り][通常論文]
   

  © 2019 IEEE. This paper presents a method for estimating visual attention via canonical correlation between visual and gaze-based features. The proposed method estimates user-specific visual attention by comparing a test image with training images including their corresponding individual eye gaze data in a common space. Specifically, canonical correlation analysis can derive projections which enable comparison between visual and gaze-based features in the common space. Therefore, given the new test image, our method projects its visual features to the common space and can estimate visual attention. Experimental results show the effectiveness of the proposed method.
• Chronic gastritis detection from gastric X-ray images via deep autoencoding Gaussian mixture models

  Masanao Matsumoto, Naoki Saito, Takahiro Ogawa, Miki Haseyama

  2019 IEEE 1st Global Conference on Life Sciences and Technologies, LifeTech 2019 231 - 232 2019年03月 [査読有り][通常論文]
   

  © 2019 IEEE. This paper presents a detection method of chronic gastritis from gastric X-ray images. The conventional method cannot detect chronic gastritis accurately since the number of non-gastritis images is overwhelmingly larger than the number of gastritis images. To deal with this problem, the proposed method performs the detection of chronic gastritis by using Deep Autoencoding Gaussian Mixture Models (DAGMM) which is an anomaly detection approach. DAGMM enables construction of chronic gastritis detection model using only non-gastritis images. In addition, DAGMM is superior to conventional anomaly detection methods since the models of dimensionality reduction and density estimation can be learned simultaneously. Therefore, the proposed method realizes accurate detection of chronic gastritis by utilizing DAGMM.
• Fine-tuning of pre-trained DCNN for gastritis detection from gastric X-ray images

  Misaki Kanai, Ren Togo, Takahiro Ogawa, Miki Haseyama

  2019 IEEE 1st Global Conference on Life Sciences and Technologies, LifeTech 2019 196 - 197 2019年03月 [査読有り][通常論文]
   

  © 2019 IEEE. This paper presents a detection method of gastritis from gastric X-ray images using fine-tuning techniques. With the development of deep convolutional neural networks (DCNNs), DCNN-based methods have achieved more accurate performance than conventional machine learning methods using hand-crafted features in the field of medical image analysis. However, lack of training images often occurs in clinical situations even though DCNNs require a large amount of training images to avoid overfitting. Therefore, the proposed method aims to consider the clinical situations that a limited amount of the training images are available. By fine-tuning a DCNN pre-trained with a large amount of annotated natural images, we avoid overfitting and realize accurate detection of the gastritis with a small amount of the training images.
• Bone metastatic tumor detection based on AnoGAN using CT images

  Haruna Watanabe, Ren Togo, Takahiro Ogawa, Miki Haseyama

  2019 IEEE 1st Global Conference on Life Sciences and Technologies, LifeTech 2019 235 - 236 2019年03月 [査読有り][通常論文]
   

  © 2019 IEEE. In this paper, we propose a method to detect bone metastatic tumors using computed tomography (CT) images. Bone metastatic tumors spread from primary cancer to other organs, and they can cause severe pain. Therefore, it is important to detect metastatic tumors earlier in addition to primary cancer. However, since metastatic tumors are very small, and they emerge from unpredictable regions in the body, collecting metastatic tumor images is difficult compared to primary cancer. In such a case, it can be considered that the idea of anomaly detection is suitable. The proposed method based on a generative adversarial network model trains with only non-metastatic bone tumor images and detects bone metastatic tumor in an unsupervised manner. Then the anomaly score is defined for each test CT image. Experimental results show the anomaly scores between non-metastatic bone tumor images and metastatic bone tumor images are clearly different. The anomaly detection approach may be effective for the detection of bone metastatic tumors in CT images.
• Semi-supervised discriminative CCA for estimating viewed image categories from fMRI data

  Yusuke Akamatsu, Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  2019 IEEE 1st Global Conference on Life Sciences and Technologies, LifeTech 2019 233 - 234 2019年03月 [査読有り][通常論文]
   

  © 2019 IEEE. This paper presents a method that estimates viewed image categories from functional magnetic resonance imaging (fMRI) data via semi-supervised discriminative canonical correlation analysis (Semi-DCCA). We newly derive Semi-DCCA that enables direct comparison of fMRI data and visual features extracted from viewed images while taking into account the class information and additional visual features to avoid overfitting. The proposed method enables estimation of image categories from fMRI data measured when subjects view images by comparing fMRI data with visual features through Semi-DCCA. Experimental results show that Semi-DCCA can improve estimation performance of the viewed image categories.
• Video classification based on user preferences with soft-bag multiple instance learning

  Akira Toyoda, Takahiro Ogawa, Miki Haseyama

  2019 IEEE 1st Global Conference on Life Sciences and Technologies, LifeTech 2019 198 - 199 2019年03月 [査読有り][通常論文]
   

  © 2019 IEEE. This paper presents a method to classify videos based on user preferences with soft-bag multiple instance learning (MIL). Our method classifies videos that a user has watched into two classes (preferred and not-preferred) with two-modal features extracted from the videos and brain signals measured while the user is watching the videos. Our method splits videos and brain signals into fixed-length segments and computes features used for classification from only a fixed-number of segments selected based on the idea of soft-bag MIL. By using the features computed from the selected segments, our method makes it possible to classify videos in the case that some videos that a user prefers contain some scenes the user does not prefer, and vice versa. Our main contribution allows methods classifying videos based on user preferences to treat such a case unlike conventional methods.
• Estimation of Drilling Energy from Tunnel Cutting Face Image Based on Online Learning.

  Kentaro Yamamoto, Ren Togo, Takahiro Ogawa, Miki Haseyama

  2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019 768 - 769 2019年 

  To realize the effective tunnel construction, it is important to grasp the characteristics of ground conditions. This paper presents an estimation method of drilling energy based on online learning from tunnel cutting face images. The proposed method realizes the estimation from a small amount of data by learning the image taken immediately before the target image using online learning since consecutive tunnel cutting faces are related to each other. The experimental results show the effectiveness of the proposed method.
• Multimodal Retrieval of Similar Soccer Videos Based on Optimal Combination of Multiple Distance Measures.

  Tomoki Haruyama, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019 665 - 666 2019年 

  This paper presents a new multimodal method for retrieval of similar soccer videos based on optimal combination of multiple distance measures. Our method first extracts three types of Convolutional Neural Network-based features focusing the players' actions, the audience's cheers and prompt reports. Then, by applying the optimal distance measure to each feature, we calculate the similarities between a query video and videos in a database. Finally, we realize accurate retrieval of similar soccer videos by integrating these similarities. Experiments on actual soccer videos demonstrate encouraging results.
• Interest Estimation for Images Based on Eye Gaze-based Visual and Text Features.

  Masanao Matsumoto, Naoki Saito 0006, Takahiro Ogawa, Miki Haseyama

  2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019 481 - 482 2019年 

  This paper presents an estimation method of user-specific interests for images. The proposed method computes a projection which maximizes the correlation between 'eye gaze data which are collected while watching images' and 'visual and text features' by utilizing Canonical Correlation Analysis (CCA). Since eye gaze data reflect user's interests, new visual and text features calculated by using obtained projections can be also expected to reflect user's interests. Then accurate estimation of user-specific interests for images via Support Vector Machine (SVM) becomes feasible from these features. Experimental results show the effectiveness of our method.
• Estimation of User-Specific Visual Attention Based on Gaze Information of Similar Users.

  Yuya Moroto, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019 477 - 478 2019年 [査読有り][通常論文]
   

  This paper proposes an estimation of user-specific visual attention based on gaze information of similar users. The proposed method estimates the user-specific visual attention by using the eye gaze data of other similar users. Then the similar users are selected based on the past eye gaze data of the target user. Although introducing the eye gaze data of the similar users into the estimation of user-specific visual attention is a simple approach, it can break the limitation of estimation performance. This approach is the main contribution of this paper. Experimental results show the effectiveness.
• Performance Prediction Method of Examinees Based on Matrix Completion.

  Yutaka Yamada, Takahiro Ogawa, Miki Haseyama

  2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019 229 - 230 2019年 [査読有り][通常論文]
   

  This paper presents a novel performance prediction method of examinees based on matrix completion. The proposed method newly introduces the matrix completion for predicting the performance of the entrance examination from the results of a mock exams. This approach using the matrix completion provides a solution to the problem that there is unknown information on the explanatory variable side. Specifically, we adopt singular value decomposition for solving the problem. Therefore, accurate prediction can be expected by the proposed method. This work is the first trial to realize predicting performance of examinees and this is the main contribution of this paper. Experimental results are shown for verifying the effectiveness of the proposed method.
• Estimating Viewed Image Categories from fMRI Activity via Multi-view Bayesian Generative Model.

  Yusuke Akamatsu, Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019 127 - 128 2019年 [査読有り][通常論文]
   

  Researches for estimating what people view from their brain activity have attracted wide attention. Many existing methods focus on only relationship between brain activity and visual features extracted from viewed images. In this paper, we propose a multi-view Bayesian generative model (MVBGM), which adopts a new view, i.e., category features obtained from viewed images. MVBGM based on automatic feature selection under the Bayesian approach can also avoid overfitting caused by high dimensional features. Experimental results show that MVBGM can estimate viewed image categories from brain activity more accurately than existing methods.
• The Extraction of Individual Music Preference Based on Deep Time-series CCA.

  Ryosuke Sawata, Takahiro Ogawa, Miki Haseyama

  2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019 15 - 16 2019年 [査読有り][通常論文]
   

  This paper presents a novel method to extract individual music preference. The novel CCA, named Deep Time-series Canonical Correlation Analysis (DTCCA), is proposed to realize the aforementioned extraction. In contrast with standard CCA, our novel DTCCA can deal with not only the correlation between the input features but also the time-series relation in each input those simultaneously. A DTCCA-based latent space of projected features effectively reflects relationship between his/her EEG features and corresponding audio features rather than standard CCA's one since the audio and EEG signals have time-series relation respectively.
• Effectiveness Evaluation of Deep Features for Image Reconstruction from fMRI Signals.

  Saya Takada, Ren Togo, Takahiro Ogawa, Miki Haseyama

  IEEE Global Conference on Consumer Electronics (GCCE) 479 - 480 2019年 [査読有り][通常論文]
   

  Reconstruction of human cognitive contents based on analyzing of functional Magnetic Resonance Imaging (fMRI) signals has been actively researched. Cognitive contents such as seen images can be reconstructed by estimating the relation between fMRI signals and deep neural network (DNN) features extracted from seen images. In order to reconstruct seen images with high accuracy, translation fMRI signals into meaningful features is an important task. In this paper, we validate the reconstruction accuracy of seen images by using visual features with some DNN feature extraction models. Recent works for image reconstruction used VGG19 to extract visual features. However, newer models such as Inception-v3 and ResNet50 have been proposed and these models perform general object recognition with higher accuracy. Thus it is expected the accuracy of image reconstruction is improved when using features extracted by these newer models. Experimental results for images of five categories show the effectiveness of the use of visual features from newer DNN models.
• Scene Retrieval Using Text-to-image GAN-based Visual Similarities and Image-to-text Model-based Textual Similarities.

  Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama

  IEEE Global Conference on Consumer Electronics (GCCE) 13 - 14 2019年 [査読有り][通常論文]
   

  Scene retrieval from a video database is a fundamental study in computer vision. Traditionally, content based retrieval methods can retrieve objective scenes with high accuracy by utilizing visual features. However, users cannot utilize content based retrieval methods when they cannot prepare query contents. To solve this problem, in this paper, we propose a novel content based scene retrieval method focusing on text-to-image Generative Adversarial Network and image-to-text model. By utilizing the proposed method, we can retrieve objective scenes in visual feature space with high accuracy even though it only utilizes a sentence as an input. Experimental results show the effectiveness of the proposed method.
• Multi-classifier Decision: Integration of Multiple Brain Activity-based Classifications

  Takahiro Ogawa, Kento Sugata, Ren Togo, Miki Haseyama

  ITE Transactions on Media Technology and Applications 7 1 36 - 44 2019年 [査読有り][通常論文]
   

  A novel method that integrates brain activity-based classifications obtained from multiple users is presented in this paper. The proposed method performs decision-level fusion (DLF) of the classifications using a kernelized version of extended supervised learning from multiple experts (KESLME), which is newly derived in this paper. In this approach, feature-level fusion of multiuser electroencephalogram (EEG) features is performed by multiset supervised locality preserving canonical correlation analysis (MSLPCCA). In the proposed method, the multiple classification results are obtained by classifiers separately constructed for the multiuser EEG features. Then DLF of these classification results becomes feasible based on KESLME, which can provide the final decision with consideration of the relationship between the MSLPCCA-based integrated EEG features and each classifier’s performance. In this way, a new multi-classifier decision technique, which depends only on users’ brain activities, is realized, and the performance in an image classification task becomes comparable to that of Inception-v3, one of the state-of-the-art deep convolutional neural networks.
• Text-to-Image GAN-Based Scene Retrieval and Re-Ranking Considering Word Importance.

  Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama

  IEEE Access 7 169920 - 169930 2019年 [査読有り][通常論文]
   

  In this paper, we propose a novel scene retrieval and re-ranking method based on a text-to-image Generative Adversarial Network (GAN). The proposed method generates an image from an input query sentence based on the text-to-image GAN and then retrieves a scene that is the most similar to the generated image. By utilizing the image generated from the input query sentence as a query, we can control semantic information of the query image at the text level. Furthermore, we introduce a novel interactive re-ranking scheme to our retrieval method. Specifically, users can consider the importance of each word within the first input query sentence. Then the proposed method re-generates the query image that reflects the word importance provided by users. By updating the generated query image based on the word importance, it becomes feasible for users to revise retrieval results through this re-ranking process. In experiments, we showed that our retrieval method including the re-ranking scheme outperforms recently proposed retrieval methods.
• Estimating Regions of Deterioration in Electron Microscope Images of Rubber Materials via a Transfer Learning-Based Anomaly Detection Model.

  Ren Togo, Naoki Saito 0006, Takahiro Ogawa, Miki Haseyama

  IEEE Access 7 162395 - 162404 2019年 [査読有り][通常論文]
   

  A method for estimating regions of deterioration in electron microscope images of rubber materials is presented in this paper. Deterioration of rubber materials is caused by molecular cleavage, external force, and heat. An understanding of these characteristics is essential in the field of material science for the development of durable rubber materials. Rubber material deterioration can be observed by using on electron microscope but it requires much effort and specialized knowledge to find regions of deterioration. In this paper, we propose an automated deterioration region estimation method based on deep learning and anomaly detection techniques to support such material development. Our anomaly detection model, called Transfer Learning-based Deep Autoencoding Gaussian Mixture Model (TL-DAGMM), uses only normal regions for training since obtaining training data for regions of deterioration is difficult. TL-DAGMM makes use of extracted high representation features from a pre-trained deep learning model and can automatically learn the characteristics of normal rubber material regions. Regions of deterioration are estimated at the pixel level by calculated anomaly scores. Experiments on real rubber material electron microscope images demonstrated the effectiveness of our model.
• Team Tactics Estimation in Soccer Videos Based on a Deep Extreme Learning Machine and Characteristics of the Tactics.

  Genki Suzuki, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  IEEE Access 7 153238 - 153248 2019年 [査読有り][通常論文]
   

  A novel method for estimating team tactics in soccer videos based on a Deep Extreme Learning Machine (DELM) and unique characteristics of tactics is presented in this paper. The proposed method estimates the tactics of each team from players' formations and enables successful training from a limited amount of training data. Specifically, the estimation of tactics consists of two stages. First, by utilizing two DELMs corresponding to the two teams, the proposed method estimates the provisional tactics of each team. Second, the proposed method updates the team tactics based on unique characteristics of soccer tactics, the relationship between tactics of the two teams and information on ball possession. Consequently, since the proposed method estimates the team tactics that satisfy these characteristics, accurate estimation results can be obtained. In an experiment, the proposed method is applied to actual soccer videos to verify its effectiveness.
• Query is GAN: Scene Retrieval With Attentional Text-to-Image Generative Adversarial Network.

  Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama

  IEEE Access 7 153183 - 153193 2019年 [査読有り][通常論文]
   

  Scene retrieval from input descriptions has been one of the most important applications with the increasing number of videos on the Web. However, this is still a challenging task since semantic gaps between features of texts and videos exist. In this paper, we try to solve this problem by utilizing a text-to-image Generative Adversarial Network (GAN), which has become one of the most attractive research topics in recent years. The text-to-image GAN is a deep learning model that can generate images from their corresponding descriptions. We propose a new retrieval framework, Query is GAN, based on the text-to-image GAN that drastically improves scene retrieval performance by simple procedures. Our novel idea makes use of images generated by the text-to-image GAN as queries for the scene retrieval task. In addition, unlike many studies on text-to-image GANs that mainly focused on the generation of high-quality images, we reveal that the generated images have reasonable visual features suitable for the queries even though they are not visually pleasant. We show the effectiveness of the proposed framework through experimental evaluation in which scene retrieval is performed from real video datasets.
• Interest Level Estimation Based on Tensor Completion via Feature Integration for Partially Paired User's Behavior and Videos.

  Tetsuya Kushima, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  IEEE Access 7 148576 - 148585 2019年 [査読有り][通常論文]
   

  A novel method for interest level estimation based on tensor completion via feature integration for partially paired users' behavior and videos is presented in this paper. The proposed method defines a novel canonical correlation analysis (CCA) framework that is suitable for interest level estimation, which is a hybrid version of semi-supervised CCA (SemiCCA) and supervised locality preserving CCA (SLPCCA) called semi-supervised locality preserving CCA (S2LPCCA). For partially paired users' behavior and videos in actual shops and on the Internet, new integrated features that maximize the correlation between partially paired samples by the principal component analysis (PCA)-mixed CCA framework are calculated. Then videos that users have not watched can be used for the estimation of users' interest levels. Furthermore, local structures of partially paired samples in the same class are preserved for accurate estimation of interest levels. Tensor completion, which can be applied to three contexts, videos, users and 'canonical features and interest levels,' is used for estimation of interest levels. Consequently, the proposed method realizes accurate estimation of users' interest levels based on S2LPCCA and the tensor completion from partially paired training features of users' behavior and videos. Experimental results obtained by applying the proposed method to actual data show the effectiveness of the proposed method.
• Scene Retrieval from Multiple Resolution Generated Images Based on Text-to-image GAN

  Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama

  2019 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS) 2019-May 1 - 5 2019年 [査読有り][通常論文]
   

  Text-to-image Generative Adversarial Network (GAN) is a deep learning model that generates an image from an input sentence. It is expressly attracting attentions because of its applicability of the generated images. However, many existing studies have still focused on generation of high-quality images, and there are few studies focusing on application of the generated images since text-to-image GANs still cannot produce visually pleasing images in the complicated tasks. In this paper, we apply a text-to-image GAN as a generator of query images for a scene retrieval task to show availability of the visually non-pleasant images. The proposed method utilizes a low-resolution generated image that focuses on a sentence and a high-resolution generated image that focuses on each word of the sentence to retrieve a desired scene. With this mechanism, the proposed method realizes a high-accuracy scene retrieval from a sentence input. Experimental results show the effectiveness of our method.
• Semi-Supervised Learning Based on Tri-Training for Gastritis Classification using Gastric X-ray Images.

  Zongyao Li, Ren Togo, Takahiro Ogawa, Miki Haseyama

  IEEE International Symposium on Circuits and Systems, ISCAS 2019, Sapporo, Japan, May 26-29, 2019 2019-May 1 - 5 IEEE 2019年 [査読有り][通常論文]
   

  This paper presents a method of semi-supervised learning based on tri-training for gastritis classification using gastric X-ray images. The proposed method is constructed based on the tri-training architecture, and the strategies of label smoothing regularization and random erasing augmentation are utilized in the method to enhance the performance. Although the task of gastritis classification is challenging, we report that the proposed semi-supervised learning method using only a small number of labeled data achieves 0.888 harmonic mean of sensitivity and specificity on test data composed of 615 patients.
• Synthetic Image Generation for Gastritis Detection Based on Auxiliary Classifier Generative Adversarial Network.

  Misaki Kanai, Ren Togo, Takahiro Ogawa, Miki Haseyama

  IEEE International Symposium on Circuits and Systems, ISCAS 2019, Sapporo, Japan, May 26-29, 2019 2019-May 1 - 5 IEEE 2019年 [査読有り][通常論文]
   

  With the development of convolutional neural networks (CNNs), CNN-based methods for medical image analysis have achieved more accurate performance than conventional machine learning methods using hand-crafted features. Although these methods utilize a large number of training images and realize high performance, lack of the training images often occurs in medical image analysis due to several reasons. This paper presents a novel image generation method to construct a dataset for gastritis detection from gastric X-ray images. The proposed method effectively utilizes two kinds of training images (gastritis and non-gastritis images) to generate images of each domain by introducing label conditioning into a generative model. Experimental results using real-world gastric X-ray images show the effectiveness of the proposed method.
• Multi-feature Fusion Based on Supervised Multi-view Multi-label Canonical Correlation Projection.

  Keisuke Maeda, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2019, Brighton, United Kingdom, May 12-17, 2019 2019-May 3936 - 3940 IEEE 2019年 [査読有り][通常論文]
   

  This paper presents multi-feature fusion based on supervised multi-view multi-label canonical correlation projection (sM2CP). The proposed method applies sM2CP-based feature fusion to multiple features obtained from various convolutional neural networks (CNNs) whose characteristics are different. Since new fused features with high representation ability can be obtained, performance improvement of multi-label classification is realized. Specifically, in order to tackle the multi-label problem, sM2CP introduces a label similarity information of label vectors into the objective function of supervised multi-view canonical correlation analysis. Thus, sM2CP can deal with complex label information such as multi-label annotation. The main contribution of this paper is the realization of feature fusion of multiple CNN features for the multi-label problem by introducing multi-label similarity information into the canonical correlation analysis-based feature fusion approach. Experimental results show the effectiveness of sM2CP, which enables effective fusion of multiple CNN features.
• Novel Audio Feature Projection Using KDLPCCA-Based Correlation with EEG Features for Favorite Music Classification.

  Ryosuke Sawata, Takahiro Ogawa, Miki Haseyama

  IEEE Trans. Affect. Comput. 10 3 430 - 444 2019年 [査読有り][通常論文]
   

  A novel audio feature projection using Kernel Discriminative Locality Preserving Canonical Correlation Analysis (KDLPCCA)-based correlation with electroencephalogram (EEG) features for favorite music classification is presented in this paper. The projected audio features reflect individual music preference adaptively since they are calculated by considering correlations with the user’s EEG signals during listening to musical pieces that the user likes/dislikes via a novel CCA proposed in this paper. The novel CCA, called KDLPCCA, can consider not only a non-linear correlation but also local properties and discriminative information of each class sample, namely, music likes/dislikes. Specifically, local properties reflect intrinsic data structures of the original audio features, and discriminative information enhances the power of the final classification. Hence, the projected audio features have an optimal correlation with individual music preference reflected in the user’s EEG signals, adaptively. If the KDLPCCA-based projection that can transform original audio features into novel audio features is calculated once, our method can extract projected audio features from a new musical piece without newly observing individual EEG signals. Our method therefore has a high level of practicability. Consequently, effective classification of user’s favorite musical pieces via a Support Vector Machine (SVM) classifier using the new projected audio features becomes feasible. Experimental results show that our method for favorite music classification using projected audio features via the novel CCA outperforms methods using original audio features, EEG features and even audio features projected by other state-of-the-art CCAs.
• Young Professionals Activities at GCCE 2018 [Society News].

  Takahiro Ogawa, Shingo Yamaguchi

  IEEE Consumer Electron. Mag. 8 3 6 - 7 2019年 [査読有り][通常論文]
  
• Cardiac sarcoidosis classification with deep convolutional neural network-based features using polar maps.

  Ren Togo, Kenji Hirata, Osamu Manabe, Hiroshi Ohira, Ichizo Tsujino, Keiichi Magota, Takahiro Ogawa, Miki Haseyama, Tohru Shiga

  Comput. Biol. Medicine 104 81 - 86 2019年 [査読有り][通常論文]
   

  Aims: The aim of this study was to determine whether deep convolutional neural network (DCNN)-based features can represent the difference between cardiac sarcoidosis (CS) and non-CS using polar maps. Methods: A total of 85 patients (33 CS patients and 52 non-CS patients) were analyzed as our study subjects. One radiologist reviewed PET/CT images and defined the left ventricle region for the construction of polar maps. We extracted high-level features from the polar maps through the Inception-v3 network and evaluated their effectiveness by applying them to a CS classification task. Then we introduced the ReliefF algorithm in our method. The standardized uptake value (SUV)-based classification method and the coefficient of variance (CoV)-based classification method were used as comparative methods. Results: Sensitivity, specificity and the harmonic mean of sensitivity and specificity of our method with the ReliefF algorithm were 0.839, 0.870 and 0.854, respectively. Those of the SUVmax-based classification method were 0.468, 0.710 and 0.564, respectively, and those of the CoV-based classification method were 0.655, 0.750 and 0.699, respectively. Conclusion: The DCNN-based high-level features may be more effective than low-level features used in conventional quantitative analysis methods for CS classification.
• Convolutional sparse coding-based deep random vector functional link network for distress classification of road structures.

  Keisuke Maeda, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  Comput. Aided Civ. Infrastructure Eng. 34 8 654 - 676 2019年 [査読有り][通常論文]
   

  © 2019 Computer-Aided Civil and Infrastructure Engineering This paper presents a convolutional sparse coding (CSC)-based deep random vector functional link network (CSDRN) for distress classification of road structures. The main contribution of this paper is the introduction of CSC into a feature extraction scheme in the distress classification. CSC can extract visual features representing characteristics of target images because it can successfully estimate optimal convolutional dictionary filters and sparse features as visual features by training from a small number of distress images. The optimal dictionaries trained from distress images have basic components of visual characteristics such as edge and line information of distress images. Furthermore, sparse feature maps estimated on the basis of the dictionaries represent both strength of the basic components and location information of regions having their components, and these maps can represent distress images. That is, sparse feature maps can extract key components from distress images that have diverse visual characteristics. Therefore, CSC-based feature extraction is effective for training from a limited number of distress images that have diverse visual characteristics. The construction of a novel neural network, CSDRN, by the use of a combination of CSC-based feature extraction and the DRN classifier, which can also be trained from a small dataset, is shown in this paper. Accurate distress classification is realized via the CSDRN.
• Consensus Clustering of Tweet Networks via Semantic and Sentiment Similarity Estimation.

  Ryosuke Harakawa, Shoji Takimura, Takahiro Ogawa, Miki Haseyama, Masahiro Iwahashi

  IEEE Access 7 116207 - 116217 2019年 [査読有り][通常論文]
   

  Although Twitter has become an important source of information, the number of accessible tweets is too large for users to easily find their desired information. To overcome this difficulty, a method for tweet clustering is proposed in this paper. Inspired by the reports that network representation is useful for multimedia content analysis including clustering, a network-based approach is employed. Specifically, a consensus clustering method for tweet networks that represent relationships among the tweets' semantics and sentiment are newly derived. The proposed method integrates multiple clustering results obtained by applying successful clustering methods to the tweet networks. By integrating complementary clustering results obtained based on semantic and sentiment features, the accurate clustering of tweets becomes feasible. The contribution of this work can be found in the utilization of the features, which differs from existing network-based consensus clustering methods that target only the network structure. Experimental results for a real-world Twitter dataset, which includes 65 553 tweets of 25 datasets, verify the effectiveness of the proposed method.
• Music Video Recommendation Based on Link Prediction Considering Local and Global Structures of a Network.

  Yui Matsumoto, Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  IEEE Access 7 104155 - 104167 2019年 [査読有り][通常論文]
   

  A novel method for music video recommendation is presented in this paper. The contributions of this paper are two-fold. (i) The proposed method constructs a network, which not only represents relationships between music videos and users but also captures multi-modal features of music videos. This enables collaborative use of multi-modal features such as audio, visual, and textual features, and multiple social metadata that can represent relationships between music videos and users on video hosting services. (ii) A novel scheme for link prediction considering local and global structures of the network (LP-LGSN) is newly derived by fusing multiple link prediction scores based on both local and global structures. By using the LP-LGSN to predict the degrees to which users desire music videos, the proposed method can recommend users' desired music videos. The experimental results for a real-world dataset constructed from YouTube-8M show the effectiveness of the proposed method.
• Synthetic Gastritis Image Generation via Loss Function-Based Conditional PGGAN.

  Ren Togo, Takahiro Ogawa, Miki Haseyama

  IEEE Access 7 87448 - 87457 2019年 [査読有り][通常論文]
   

  © 2013 IEEE. In this paper, a novel synthetic gastritis image generation method based on a generative adversarial network (GAN) model is presented. Sharing medical image data is a crucial issue for realizing diagnostic supporting systems. However, it is still difficult for researchers to obtain medical image data since the data include individual information. Recently proposed GAN models can learn the distribution of training images without seeing real image data, and individual information can be completely anonymized by generated images. If generated images can be used as training images in medical image classification, promoting medical image analysis will become feasible. In this paper, we targeted gastritis, which is a risk factor for gastric cancer and can be diagnosed by gastric X-ray images. Instead of collecting a large amount of gastric X-ray image data, an image generation approach was adopted in our method. We newly propose loss function-based conditional progressive growing generative adversarial network (LC-PGGAN), a gastritis image generation method that can be used for a gastritis classification problem. The LC-PGGAN gradually learns the characteristics of gastritis in gastric X-ray images by adding new layers during the training step. Moreover, the LC-PGGAN employs loss function-based conditional adversarial learning so that generated images can be used as the gastritis classification task. We show that images generated by the LC-PGGAN are effective for gastritis classification using gastric X-ray images and have clinical characteristics of the target symptom.
• Distress classification of class-imbalanced inspection data via correlation-maximizing weighted extreme learning machine

  Keisuke Maeda, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  Advanced Engineering Informatics 37 79 - 87 2018年08月01日 [査読有り][通常論文]
   

  This paper presents distress classification of class-imbalanced inspection data via correlation-maximizing weighted extreme learning machine (CMWELM). For distress classification, it is necessary to extract semantic features that can effectively distinguish multiple kinds of distress from a small amount of class-imbalanced data. In recent machine learning techniques such as general deep learning methods, since effective feature transformation from visual features to semantic features can be realized by using multiple hidden layers, a large amount of training data are required. However, since the amount of training data of civil structures becomes small, it becomes difficult to perform successful transformation by using these multiple hidden layers. On the other hand, CMWELM consists of two hidden layers. The first hidden layer performs feature transformation, which can directly extract the semantic features from visual features, and the second hidden layer performs classification with solving the class-imbalanced problem. Specifically, in the first hidden layer, the feature transformation is realized by using projections obtained by maximizing the canonical correlation between visual and text features as weight parameters of the hidden layer without designing multiple hidden layers. Furthermore, the second hidden layer enables successful training of our classifier by using weighting factors concerning the class-imbalanced problem. Consequently, CMWELM realizes accurate distress classification from a small amount of class-imbalanced data.
• Strategy to develop convolutional neural network-based classifier for diagnosis of whole-body FDG PET images

  Keisuke Kawauchi, Kenji Hirata, Seiya Ichikawa, Osamu Manabe, Kentaro Kobayashi, Shiro Watanabe, Miki Haseyama, Takahiro Ogawa, Ren Togo, Tohru Shiga, Chietsugu Katoh

  Society of Nuclear Medicine and Molecular Imaging Annual Meeting (SNMMI) 2018年06月 [査読有り][通常論文]
  
• Use of deep convolutional neural network-based features for detection of cardiac sarcoidosis from polar map

  Ren Togo, Kenji Hirata, Osamu Manabe, Hiroshi Ohira, Ichizo Tsujino, Takahiro Ogawa, Miki Haseyama, Tohru Shiga

  Society of Nuclear Medicine and Molecular Imaging Annual Meeting (SNMMI) 2018年06月 [査読有り][通常論文]
  
• Graph-Based Video Search Reranking with Local and Global Consistency Analysis

  Soh Yoshida, Takahiro Ogawa, Miki Haseyama, Mitsuji Muneyasu

  IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS E101D 5 1430 - 1440 2018年05月 [査読有り][通常論文]
   

  Video reranking is an effective way for improving the retrieval performance of text-based video search engines. This paper proposes a graph-based Web video search reranking method with local and global consistency analysis. Generally, the graph-based reranking approach constructs a graph whose nodes and edges respectively correspond to videos and their pairwise similarities. A lot of reranking methods are built based on a scheme which regularizes the smoothness of pairwise relevance scores between adjacent nodes with regard to a user's query. However, since the overall consistency is measured by aggregating only the local consistency over each pair, errors in score estimation increase when noisy samples are included within query-relevant videos' neighbors. To deal with the noisy samples, the proposed method leverages the global consistency of the graph structure, which is different from the conventional methods. Specifically, in order to detect this consistency, the propose method introduces a spectral clustering algorithm which can detect video groups, in which videos have strong semantic correlation, on the graph. Furthermore, a new regularization term, which smooths ranking scores within the same group, is introduced to the reranking framework. Since the score regularization is performed by both local and global aspects simultaneously, the accurate score estimation becomes feasible. Experimental results obtained by applying the proposed method to a real-world video collection show its effectiveness.
• Anonymous Image Data Generation from Gastric X-ray Images for Improving Gastritis Recognition Performance

  Ren Togo, Kenta Ishihara, Takahiro Ogawa, Miki Haseyama

  IEEE International Conference on Consumer Electronics – Taiwan (ICCE-TW) 2018年05月 [査読有り][通常論文]
   

  This paper presents an anonymous gastritis image generation method for improving gastritis recognition performance. We realize the generation of realistic gastritis images by considering label information. Experimental results showed that anonymous images generated by our method had a potential for a gastritis recognition task. Concretely, the recognition performance of a classifier constructed with the anonymous images outperformed the performance of the conventional image generation method-based classifier.
• Sentiment-aware personalized tweet recommendation through multimodal FFM

  Ryosuke Harakawa, Daichi Takehara, Takahiro Ogawa, Miki Haseyama

  Multimedia Tools and Applications 77 14 1 - 19 2018年03月29日 [査読有り][通常論文]
   

  For realizing quick and accurate access to desired information and effective advertisements or election campaigns, personalized tweet recommendation is highly demanded. Since multimedia contents including tweets are tools for users to convey their sentiment, users’ interest in tweets is strongly influenced by sentiment factors. Therefore, successful personalized tweet recommendation can be realized if sentiment in tweets can be estimated. However, sentiment factors were not taken into account in previous works and the performance of previous methods may be limited. To overcome the limitation, a method for sentiment-aware personalized tweet recommendation through multimodal Field-aware Factorization Machines (FFM) is newly proposed in this paper. Successful personalized tweet recommendation becomes feasible through the following three contributions: (i) sentiment factors are newly introduced into personalized tweet recommendation, (ii) users’ interest is modeled by deriving multimodal FFM that enables collaborative use of multiple factors in a tweet, i.e., publisher, topic and sentiment factors, and (iii) the effectiveness of using sentiment factors as well as publisher and topic factors is clarified from results of experiments using real-world datasets related to worldwide hot topics, “#trump”, “#hillaryclinton” and “#ladygaga”. In addition to showing the effectiveness of the proposed method, the applicability of the proposed method to other tasks such as advertisement and social analysis is discussed as a conclusion and future work of this paper.
• Image retrieval based on LRGA algorithm and relevance feedback for insect identification

  Susumu Gerund, Takahiro Ogawa, Miki Haseyama

  Proceedings - International Conference on Image Processing, ICIP 2017- 3978 - 3982 2018年02月20日 [査読有り][通常論文]
   

  This paper presents an image retrieval method based on local regression and global alignment (LRGA) algorithm and relevance feedback for insect identification. Based on LRGA algorithm, the proposed method enables estimation of ranking scores for image retrieval in such a way that the neighborhood structure of the database can be optimally preserved. This is the biggest contribution of this paper. Then our method measures relevance between the query image and all the images in the database and realizes retrieval of images based on the measured relevance. Furthermore, if positively labeled images obtained by a user are available, they are used as the query relevance information for the relevance feedback to improve the retrieval results. Experimental results show the effectiveness of our method.
• Automatic estimation of deterioration level on transmission towers via deep extreme learning machine based on local receptive field

  Keisuke Maeda, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  Proceedings - International Conference on Image Processing, ICIP 2017- 2379 - 2383 2018年02月20日 [査読有り][通常論文]
   

  This paper presents an automatic estimation method of deterioration levels on transmission towers via Deep Extreme Learning Machine based on Local Receptive Field (DELM-LRF). Although Convolutional Neural Network (CNN) requires a large number of training images, it is difficult to prepare a sufficient number of training images of transmission towers. Thus, we generate a novel estimation method which enables training from a small number of training images. Specifically, we automatically extract image features based on Local Receptive Field (LRF) which combines convolution and pooling without using hand-craft features and estimate deterioration levels via Deep Extreme Learning Machine (DELM), which is a part of efficient deep learning methods. The derivation of DELM-LRF is the biggest contribution of this paper, and it can be trained from less training images compared to CNN. Experimental results show the effectiveness of DELM-LRF for the estimation of deterioration levels on transmission towers. Consequently, the proposed method makes it possible to approach challenging tasks with high expertise having difficulty in preparing enough images.
• Detection of gastric cancer risk from X-ray images via patch-based convolutional neural network

  Kenta Ishihara, Takahiro Ogawa, Miki Haseyama

  Proceedings - International Conference on Image Processing, ICIP 2017- 2055 - 2059 2018年02月20日 [査読有り][通常論文]
   

  This paper presents a novel detection method of gastric cancer risk from X-ray images using the patch-based Convolutional Neural Network (CNN). Our method enables the training of the patch-based CNN which can accurately detect gastric cancer risk even though there is only the image-level ground truth. Furthermore, the proposed method can extract a feature vector that can represent the whole of symptoms associated with the presence or absence of the risk. Specifically, the proposed method selects the patches related to their true risk via the CNN, and it is the most innovative contribution of our method. Moreover, we extract the feature vector by applying the Bag-of-Feature representation to the output values from the CNN's intermediate layer obtained from the selected patches. Finally, the detection of gastric cancer risk is performed by inputting the extracted feature vector into Support Vector Machine. Experimental results confirm that the proposed method outperforms a previously reported method that combines the detection results obtained from X-ray images taken from multiple angles even though the proposed method only uses an X-ray image taken from a single angle, and we can achieve a higher performance than that of doctors.
• Tag refinement based on multilingual tag hierarchies extracted from image folksonomy

  Shota Hamano, Takahiro Ogawa, Miki Haseyama

  Proceedings - International Conference on Image Processing, ICIP 2017- 1327 - 1331 2018年02月20日 [査読有り][通常論文]
   

  This paper presents a novel method for tag refinement using multilingual sources of tagged images in an image folksonomy. The proposed method enables accurate tag refinement by effectively leveraging multilingual sources of tags and considering the hierarchical structure of tags in the following way. First, synonymous tags across different languages are detected based on similarities between tagged images. In this stage, the proposed method utilizes visual similarities to effectively detect synonymous tags since the visual features extracted from images should be similar if they are assigned tags with the same meaning in different languages. Then hierarchical structure of the tags are extracted based on the similarity between the detected synonymous tags. The hierarchical structure provides hypernymous and hyponymous tags of the target tags, which are important for considering the relevance between tags and images. Consulting the hierarchical structure enables removal of irrelevant tags from the images and assignment of relevant tags to the images. The proposed method effectively utilizes tags in various languages in an image folksonomy. Experimental results show the effectiveness of introducing multilingual sources of tagged images for accuracy improvement in tag refinement.
• MvLFDA-based video preference estimation using complementary properties of features

  Akira Toyoda, Takahiro Ogawa, Miki Haseyama

  Proceedings - International Conference on Image Processing, ICIP 2017- 635 - 639 2018年02月20日 [査読有り][通常論文]
   

  This paper presents a new method to estimate users' video preferences using complementary properties of features via Multiview Local Fisher Discriminant Analysis (MvLFDA). The proposed method first extracts multiple visual features from video frames and electroencephalogram (EEG) features from users' EEG signals recorded during watching video. Then we calculate EEG-based visual features by applying Locality Preserving Canonical Correlation Analysis (LPCCA) to each visual feature and EEG features. The EEG-based visual features reflect users' preferences since the correlation between visual features and EEG features which reflect users' preferences is maximized. Next, MvLFDA, which is newly derived in this paper, integrates multiple EEG-based visual features. Since MvLFDA explores complementary properties of different features, it can be expected that the features obtained by integrating multiple EEG-based visual features are more effective for users' preference estimation than each EEG-based visual feature. The biggest contribution of this paper is the new derivation of MvLFDA. Then successful estimation of users' video preferences becomes feasible using features obtained by MvLFDA.
• Automatic martian dust storm detection via decision level fusion basedondeep extreme learning machine

  Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  Proceedings - International Conference on Image Processing, ICIP 2017- 435 - 439 2018年02月20日 [査読有り][通常論文]
   

  This paper presents an automatic Martian dust storm detection via decision level fusion (DLF) based on deep extreme learning machine (DELM). Since Martian images are taken in multi-wavelength bands, DLF techniques which output a final classification result by integrating multiple classification results are necessary. Furthermore, since the number of Martian images taken by satellites is different for each region, the number of the classification results to be integrated is different. Thus, we present a new DLF framework based on confidence values of the classification results. Specifically, we generate multiple extreme learning machines with kernel classifiers to obtain their classification results. Moreover, we monitor the classification results as confidence values and select the same number of the classification results with high confidence for each region. Finally, these selected results can be integrated by using a DLF based on DELM, which is a multilayered ELM. This integration framework is the biggest contribution of our method. Experimental results show the effectiveness of the DLF based on DELM.
• Preliminary study of automatic gastric cancer risk classification from photofluorography

  Ren Togo, Kenta Ishihara, Katsuhiro Mabe, Harufumi Oizumi, Takahiro Ogawa, Mototsugu Kato, Naoya Sakamoto, Shigemi Nakajima, Masahiro Asaka, Miki Haseyama

  World Journal of Gastrointestinal Oncology 10 2 62 - 70 2018年02月15日 [査読有り][通常論文]
   

  AIM To perform automatic gastric cancer risk classification using photofluorography for realizing effective mass screening as a preliminary study. METHODS We used data for 2100 subjects including X-ray images, pepsinogen ? and ? levels, PG?/PG? ratio, Helicobacter pylori (H. pylori ) antibody, H. pylori eradication history and interview sheets. We performed two-stage classification with our system. In the first stage, H. pylori infection status classification was performed, and H. pylori -infected subjects were automatically detected. In the second stage, we performed atrophic level classification to validate the effectiveness of our system. RESULTS Sensitivity, specificity and Youden index (YI) of H. pylori infection status classification were 0.884, 0.895 and 0.779, respectively, in the first stage. In the second stage, sensitivity, specificity and YI of atrophic level classification for H. pylori -infected subjects were 0.777, 0.824 and 0.601, respectively. CONCLUSION Although further improvements of the system are needed, experimental results indicated the effectiveness of machine learning techniques for estimation of gastric cancer risk.
• A Novel Framework for Estimating Viewer Interest by Unsupervised Multimodal Anomaly Detection

  Yuma Sasaka, Takahiro Ogawa, Miki Haseyama

  IEEE Access 6 8340 - 8350 2018年02月09日 [査読有り][通常論文]
   

  A reliable method to estimate viewer interest is highly sought after for human-centered video information retrieval. A method that estimates viewer interest while users are watching Web videos is presented in this paper. The method uses a framework for anomaly detection based on collaborative use of facial expression and biological signals such as electroencephalogram (EEG) signals. To the best of our knowledge, there have been no studies that have taken into account two actual mechanisms of the behavior of users while they are watching Web videos. First, whereas most Web videos garner very little attention, a small number attract millions of views. Therefore, a framework for anomaly detection is newly applied to facial expression and EEG in order to model the imbalanced distribution of popularity. Second, since the number of Web videos that are labeled by users as interesting/not interesting is generally too small to estimate viewer interest by a supervised approach, the proposed method utilizes parametric techniques for anomaly detection, which estimates viewer interest in an unsupervised way. Unlike some related studies for estimating viewer interest, our method takes into account actual mechanisms of the behavior of users while they are watching Web videos by utilizing parametric techniques for anomaly detection. Then viewer interest can be estimated on the basis of an anomaly score calculated from our proposed method. Consequently, successful estimation of viewer interest based on a framework for anomaly detection, via collaborative use of facial expression and biological signals, becomes feasible.
• Accurate estimation of personalized video preference using multiple users' viewing behavior

  Yoshiki Ito, Takahiro Ogawa, Miki Haseyama

  IEICE Transactions on Information and Systems E101D 2 481 - 490 2018年02月01日 [査読有り][通常論文]
   

  A method for accurate estimation of personalized video preference using multiple users' viewing behavior is presented in this paper. The proposed method uses three kinds of features: a video, user's viewing behavior and evaluation scores for the video given by a target user. First, the proposed method applies Supervised Multiview Spectral Embedding (SMSE) to obtain lower-dimensional video features suitable for the following correlation analysis. Next, supervised Multi-View Canonical Correlation Analysis (sMVCCA) is applied to integrate the three kinds of features. Then we can get optimal projections to obtain new visual features, "canonical video features" reflecting the target user's individual preference for a video based on sMVCCA. Furthermore, in our method, we use not only the target user's viewing behavior but also other users' viewing behavior for obtaining the optimal canonical video features of the target user. This unique approach is the biggest contribution of this paper. Finally, by integrating these canonical video features, Support Vector Ordinal Regression with Implicit Constraints (SVORIM) is trained in our method. Consequently, the target user's preference for a video can be estimated by using the trained SVORIM. Experimental results show the effectiveness of our method.
• Tourism Category Classification on Image Sharing Services Through Estimation of Existence of Reliable Results.

  Naoki Saito, Takahiro Ogawa, Satoshi Asamizu, Miki Haseyama

  Proceedings of the 2018 ACM on International Conference on Multimedia Retrieval, ICMR 2018, Yokohama, Japan, June 11-14, 2018 493 - 496 ACM 2018年 [査読有り][通常論文]
   

  A new tourism category classification method through estimation of existence of reliable classification results is presented in this paper. The proposed method obtains two kinds of classification results by applying a convolutional neural network to tourism images and applying a Fuzzy K-nearest neighbor algorithm to geotags attached to the tourism images. Then the proposed method estimates existence of reliable classification results in the above two results. If the reliable result is included, the result is selected as the final classification result. If any reliable result is not included, the final result is obtained by another approach based on a multiple annotator logistic regression model. Consequently, the proposed method enables accurate classification based on the new estimation scheme.
• A Human-Centered Neural Network Model with Discriminative Locality Preserving Canonical Correlation Analysis for Image Classification.

  Kazaha Horii, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  2018 IEEE International Conference on Image Processing, ICIP 2018, Athens, Greece, October 7-10, 2018 2366 - 2370 IEEE 2018年 [査読有り][通常論文]
   

  This paper presents a human-centered neural network model with discriminative locality preserving canonical correlation analysis (DLPCCA) for image classification. Although construction of multiple hidden layers adopted in recent deep learning methods is effective for extracting semantic features, a large amount of training images is required. In order to extract effective features for image classification successfully from a small amount of training images, the proposed method transforms visual features by using biological information obtained from image viewers as auxiliary information. The proposed method consists of two hidden layers. By constructing the first hidden layer, which can maximize canonical correlation between visual features and features based on biological information, the effective feature transformation can be realized. Specifically, the proposed method uses DLPCCA, which considers label information and preserves local structures. The second hidden layer constructed based on Extreme Learning Machine (ELM) enables classification. Consequently, since the first hidden layer performs the effective feature transformation, the proposed neural network model realizes accurate image classification from a quite small amount of training images.
• Anonymous Gastritis Image Generation via Adversarial Learning from Gastric X-Ray Images.

  Ren Togo, Kenta Ishihara, Takahiro Ogawa, Miki Haseyama

  2018 IEEE International Conference on Image Processing, ICIP 2018, Athens, Greece, October 7-10, 2018 2082 - 2086 IEEE 2018年 [査読有り][通常論文]
   

  This paper presents an anonymous gastritis image generation method based on a generative adversarial network approach. Since clinical individual data include highly confidential information, they must be handled carefully. Although data sharing is demanded to construct large-scale medical image datasets for deep learning-based recognition tasks, managing and annotating these data have been conducted manually. The proposed method enables the generation of anonymous images by an adversarial learning approach. Experimental results show that generated images by our method contribute to a gastritis recognition task. This will be helpful for constructing large-scale medical image datasets effectively.
• Tracking topic evolution via salient keyword matching with consideration of semantic broadness for Web video discovery.

  Array,Takahiro Ogawa, Miki Haseyama

  Multimedia Tools Appl. 77 16 20297 - 20324 2018年 [査読有り][通常論文]
   

  A method to track topic evolution via salient keyword matching with consideration of semantic broadness for Web video discovery is presented in this paper. The proposed method enables users to understand the evolution of topics over time for discovering Web videos in which they are interested. A framework that enables extraction and tracking of the hierarchical structure, which contains Web video groups with various degrees of semantic broadness, is newly derived as follows: Based on network analysis using multimodal features, i.e., features of video contents and metadata, our method extracts the hierarchical structure and salient keywords that represent contents of each Web video group. Moreover, salient keyword matching, which is newly developed by considering salient keyword distribution, semantic broadness of each Web video group and initial topic relevance, is applied to each hierarchical structure obtained in different time stamps. Unlike methods in previous works, by considering the semantic broadness as well as the salient keyword distribution, our method can overcome the problem of the desired semantic broadness of topics being different depending on each user. Also, the initial topic relevance enables correction of the gap from an initial topic at the start of tracking. Consequently, it becomes feasible to track the evolution of topics over time for finding Web videos in which the users are interested. Experimental results for real-world datasets containing YouTube videos verify the effectiveness of the proposed method.
• Estimation of Deterioration Levels of Transmission Towers via Deep Learning Maximizing Canonical Correlation Between Heterogeneous Features.

  Array,Sho Takahashi, Array,Array

  J. Sel. Topics Signal Processing 12 4 633 - 644 2018年 [査読有り][通常論文]
   

  This paper presents estimation of deterioration levels of transmission towers via deep learning maximizing the canonical correlation between heterogeneous features. In the proposed method, we newly construct a correlation-maximizing deep extreme learning machine (CMDELM) based on a local receptive field (LRF). For accurate deterioration level estimation, it is necessary to obtain semantic information that effectively represents deterioration levels. However, since the amount of training data for transmission towers is small, it is difficult to perform feature transformation by using many hidden layers such as general deep learning methods. In CMDELM-LRF, one hidden layer, which maximizes the canonical correlation between visual features and text features obtained from inspection text data, is newly inserted. Specifically, by using projections obtained by maximizing the canonical correlation as weight parameters of the hidden layer, feature transformation for extracting semantic information is realized without designing many hidden layers. This is the main contribution of this paper. Consequently, CMDELM-LRF realizes accurate deterioration level estimation from a small amount of training data.
• Estimating the Quality of Fractal Compressed Images Using Lacunarity.

  Megumi Takezawa, Hirofumi Sanada, Takahiro Ogawa, Miki Haseyama

  IEICE Transactions 101-A 6 900 - 903 2018年 [査読有り][通常論文]
   

  In this paper, we propose a highly accurate method for estimating the quality of images compressed using fractal image compression. Using an iterated function system, fractal image compression compresses images by exploiting their self-similarity, thereby achieving high levels of performance; however, we cannot always use fractal image compression as a standard compression technique because some compressed images are of low quality. Generally, sufficient time is required for encoding and decoding an image before it can be determined whether the compressed image is of low quality or not. Therefore, in our previous study, we proposed a method to estimate the quality of images compressed using fractal image compression. Our previous method estimated the quality using image features of a given image without actually encoding and decoding the image, thereby providing an estimate rather quickly; however, estimation accuracy was not entirely sufficient. Therefore, in this paper, we extend our previously proposed method for improving estimation accuracy. Our improved method adopts a new image feature, namely lacunarity. Results of simulation showed that the proposed method achieves higher levels of accuracy than those of our previous method.
• Selection of Significant Brain Regions Based on MvGTDA and TS-DLF for Emotion Estimation.

  Array,Array,Miki Haseyama

  IEEE Access 6 32481 - 32492 2018年 [査読有り][通常論文]
   

  In this paper, we propose a novel method for estimating human emotion using functional brain images. The final goal of our study is contribution to affective brain computer interfaces (aBCIs), which use neuropsychological signals. In the proposed method, we newly derive multiview general tensor discriminant analysis (MvGTDA) in order to reveal significant brain regions and accurately estimate human emotion evoked by visual stimuli. This is because it is important to find activation of multiple brain regions for estimating emotional states. Since we regard a 'Brodmann area' as a 'view' and introduce $L-{1}$-norm regularization for these views, MvGTDA can eliminate non-crucial Brodmann areas and select significant ones. Moreover, in general studies on functional brain images based on machine learning methodologies, there is an overfitting problem caused by a small sample size. Therefore, revealing significant Brodmann areas based on MvGTDA has another important role, i.e., solving the overfitting problem. By inputting estimation results respectively obtained from the significant areas and the MvGTDA-based feature, tensor-based supervised decision-level fusion (TS-DLF) integrates them and outputs the final estimation result of the user's emotion. In experiments, we showed the effectiveness of our method by using actual functional brain images and we revealed the significant brain regions in emotional states.
• Simultaneous Realization of Multiple Music Video Applications Based on Heterogeneous Network Analysis Via Latent Link Estimation.

  Yui Matsumoto, Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  2018 IEEE International Conference on Multimedia and Expo, ICME 2018, San Diego, CA, USA, July 23-27, 2018 2018-July 1 - 6 IEEE Computer Society 2018年 [査読有り][通常論文]
   

  To help users seek desired music videos and create attractive music videos, many methods that realize applications such as music video recommendation, captioning and generation have been proposed. In this paper, a novel method that realizes these applications simultaneously on the basis of heterogeneous network analysis via latent link estimation is proposed. To the best of our knowledge, this work is the first attempt to realize music video recommendation, captioning and generation simultaneously. The proposed method enables latent link estimation with consideration of multimodal information and multiple social metadata obtained from music videos via Laplacian multiset canonical correlation analysis. Thus, it becomes feasible to construct a heterogeneous network that enables direct comparison of audio, visual and textual information of music videos and user information on the same feature space. Furthermore, link prediction on the obtained heterogeneous network enables association with (i) user information and their desired audio information; (ii) audio information and textual information that describes contents of musical pieces; and (iii) audio information and visual information that represents contents of musical pieces visually. As a result, support for (i) music video recommendation; (ii) captioning; and (iii) generation becomes feasible, respectively. Experimental results for a real-world dataset constructed by using YouTube-8M show the effectiveness of the proposed method.
• Interest Level Estimation of Items via Matrix Completion Based on Adaptive User Matrix Construction.

  Tetsuya Kushima, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  2018 IEEE International Conference on Multimedia and Expo, ICME 2018, San Diego, CA, USA, July 23-27, 2018 2018-July 1 - 6 IEEE Computer Society 2018年 [査読有り][通常論文]
   

  This paper presents a novel method for interest level estimation of items via matrix completion based on adaptive user matrix construction. The proposed method introduces a new criterion for adaptively constructing a user matrix that consists of user behavior features and interest levels, which are evaluated by target users and similar users. In the estimation, the matrix completion via rank minimization using the truncated nuclear norm is applied to the constructed matrix. The proposed method enables both of the interest level estimation of the target users and the selection of the similar users suitable for the estimation by monitoring errors caused in the matrix completion algorithm. The caused errors indicate the minimum differences between the estimated interest levels and true ones, and they can be regarded as the criterion for both of the optimal estimation and the adaptive selection. Furthermore, the proposed method uses weight matrices for decreasing an influence of missing data on the estimation. Consequently, accurate estimation of the interest levels becomes feasible by using the adaptively constructed matrix. Experimental results obtained by applying the proposed method to users' behavior and interest data show the effectiveness of the proposed method.
• Sfemcca: Supervised Fractional-Order Embedding Multiview Canonical Correlation Analysis for Video Preference Estimation.

  Yoshiki Ito, Takahiro Ogawa, Miki Haseyama

  2018 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2018, Calgary, AB, Canada, April 15-20, 2018 2018-April 3086 - 3090 IEEE 2018年 [査読有り][通常論文]
   

  In this paper, we present supervised fractional-order embedding multiview canonical correlation analysis (SFEMCCA). SFEMCCA is a CCA method realizing the following three points: (1) learning noisy data with small number of samples and large number of dimensions, (2) multiview learning that can integrate three or more kinds of features, and (3) supervised learning using labels corresponding to the samples. In real data, it is necessary to deal with high dimensional noisy data with limited number of samples, and there are many cases where three or more kinds of multimodal and supervised data are treated in order to calculate more accurate projections. Therefore, SFEMCCA, which takes the above advantages (1)-(3) into account, is effective for data obtained from real environments. From experimental results, it was confirmed that accuracy improvements using SFEMCCA were statistically significant compared to the several conventional methods of supervised multiview CCA.
• Semi-Supervised Multiple Feature Fusion for Video Preference Estimation.

  Akira Toyoda, Takahiro Ogawa, Miki Haseyama

  2018 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2018, Calgary, AB, Canada, April 15-20, 2018 2018-April 891 - 895 IEEE 2018年 [査読有り][通常論文]
   

  This paper presents a new method to estimate user preferences for videos based on multiple feature fusion via semi-supervised Multiview Local Fisher Discriminant Analysis (sMvLFDA). The proposed method first extracts multiple visual features from videos and functional near-infrared spectroscopy (fNIRS) features from fNIRS signals recorded during watching videos. Next, we apply Locality Preserving Canonical Correlation Analysis (LPCCA) to each visual feature and fNIRS features and project each visual feature to the new feature spaces (fNIRS-based visual feature spaces). Consequently, since the correlation between each visual feature and fNIRS features which reflect user preferences is maximized, we can transform visual features into features which also reflect user preferences. In addition, we newly introduce sMvLFDA and fuse multiple fNIRS-based visual features via sMvLFDA. sMvLFDA fuses features while using labeled samples and unlabeled samples simultaneously to reduce overfitting to the labeled samples. Furthermore, sMvLFDA adequately uses complementary properties in multiple features. Therefore, it can be expected that the fused features are more effective for estimation of user preferences than each fNIRS-based visual feature. The main contribution of this paper is the new derivation of sMvLFDA. Consequently, by using the fused features, it becomes feasible to estimate user preferences for videos successfully.
• Binary Sparse Representation Based on Arbitrary Quality Metrics and Its Applications.

  Takahiro Ogawa, Sho Takahashi, Naofumi Wada, Akira Tanaka, Miki Haseyama

  IEICE Transactions 101-A 11 1776 - 1785 2018年 [査読有り][通常論文]
   

  Binary sparse representation based on arbitrary quality metrics and its applications are presented in this paper. The novelties of the proposed method are twofold. First, the proposed method newly derives sparse representation for which representation coefficients are binary values, and this enables selection of arbitrary image quality metrics. This new sparse representation can generate quality metric-independent subspaces with simplification of the calculation procedures. Second, visual saliency is used in the proposed method for pooling the quality values obtained for all of the parts within target images. This approach enables visually pleasant approximation of the target images more successfully. By introducing the above two novel approaches, successful image approximation considering human perception becomes feasible. Since the proposed method can provide lower-dimensional subspaces that are obtained by better image quality metrics, realization of several image reconstruction tasks can be expected. Experimental results showed high performance of the proposed method in terms of two image reconstruction tasks, image inpainting and super-resolution.
• Favorite Video Estimation Based on Multiview Feature Integration via KMvLFDA.

  Array,Array,Miki Haseyama

  IEEE Access 6 63833 - 63842 2018年 [査読有り][通常論文]
   

  This paper presents a novel method for favorite video estimation based on multiview feature integration via kernel multiview local fisher discriminant analysis (KMvLFDA). The proposed method first extracts electroencephalogram (EEG) features from users' EEG signals recorded while watching videos and multiple visual features from videos. Then, multiple EEG-based visual features are obtained by applying locality preserving canonical correlation analysis to EEG features and each visual feature. Next, KMvLFDA, which is newly derived in this paper, explores the complementary properties of different features and integrates the multiple EEG-based visual features. In addition, by using KMvLFDA, between-class scatter is maximized and within-class scatter is minimized in the integrated feature space. Consequently, it can be expected that the new features that are obtained by the above integration are more effective than each of the EEG-based visual features for the estimation of users' favorite videos. The main contribution of this paper is the new derivation of KMvLFDA. Successful estimation of users' favorite videos becomes feasible by using the new features obtained via KMvLFDA.
• Favorite Video Classification Based on Multimodal Bidirectional LSTM.

  Array,Array, Keisuke Maeda, Miki Haseyama

  IEEE Access 6 61401 - 61409 2018年 [査読有り][通常論文]
   

  Video classification based on the user's preference (information of what a user likes: WUL) is important for realizing human-centered video retrieval. A better understanding of the rationale of WUL would greatly contribute to the support for successful video retrieval. However, a few studies have shown the relationship between information of what a user watches and WUL. A new method that classifies videos on the basis of WUL using video features and electroencephalogram (EEG) signals collaboratively with a multimodal bidirectional Long Short-Term Memory (Bi-LSTM) network is presented in this paper. To the best of our knowledge, there has been no study on WUL-based video classification using video features and EEG signals collaboratively with LSTM. First, we newly apply transfer learning to the WUL-based video classification since the number of labels (liked or not liked) attached to videos by users is small, and it is difficult to classify videos based on WUL. Furthermore, we conduct a user study for showing that the representation of psychophysiological signals calculated from Bi-LSTM is effective for the WUL-based video classification. Experimental results showed that our deep neural network feature representations can distinguish WUL for each subject.
• Estimation of Important Scenes in Soccer Videos Based on Collaborative Use of Audio-Visual CNN Features.

  Tomoki Haruyama, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  IEEE 7th Global Conference on Consumer Electronics, GCCE 2018, Nara, Japan, October 9-12, 2018 710 - 711 IEEE 2018年 [査読有り][通常論文]
   

  This paper presents a novel method for estimating important scenes in soccer videos based on collaborative use of audio-visual Convolutional Neural Network (CNN) features. In soccer games, since game situations influence not only players' movements but also audiences' cheers, analyses of their audio and visual sequences are useful for the estimation of important scenes. In our method, such scenes are estimated from audio and visual CNN features via support vector machine (SVM) in each feature. Furthermore, by applying weighted majority voting based on confidences defined from the SVM-based estimation results, accurate estimation of important scenes becomes feasible. Experimental results show the effectiveness of our method.
• Twitter Followee Recommendation Based on Multimodal FFM Considering Social Relations.

  Shoji Takimura, Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  IEEE 7th Global Conference on Consumer Electronics, GCCE 2018, Nara, Japan, October 9-12, 2018 204 - 205 IEEE 2018年 [査読有り][通常論文]
   

  A method for Twitter followee recommendation based on multimodal field-aware factorization machines considering social relations (MFFM-SR) is presented. MFFM-SR enables collaborative use of textual and visual features and social relations unlike conventional methods. Specifically, for distinguishing users' interest, visual features are extracted from images in their tweets and icons as well as textual features and social relations. Furthermore, to construct a model that accurately represents users' interest, MFFM-SR that enables calculation of high-level features via estimation of latent relationships among the obtained features and social relations is derived. By using the constructed model, successful followee recommendation becomes feasible.
• Estimation of Viewed Image Categories via CCA Using Human Brain Activity.

  Yusuke Akamatsu, Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  IEEE 7th Global Conference on Consumer Electronics, GCCE 2018, Nara, Japan, October 9-12, 2018 202 - 203 IEEE 2018年 [査読有り][通常論文]
   

  This paper presents a method to estimate viewed image categories via canonical correlation analysis (CCA) using human brain activity measured by functional magnetic resonance imaging (fMRI). The proposed method enables estimation of image categories that a subject viewed by using only the subject's brain activity. Specifically, the proposed method calculates the projection matrices that enable direct comparison between human brain activity and images that subjects viewed through CCA. After projecting the human brain activity and the viewed images on the same latent space, k-Nearest Neighbor (k-NN) is performed to estimate the viewed image categories from only human brain activity. Through the projection matrices, the proposed method can increase training data for k-NN even if a large number of pairs of human brain activity and images cannot be prepared. Experimental results for ten subjects show the effectiveness of the proposed method.
• Missing Image Data Estimation via Iterative Convolutional Sparse Coding.

  Masanao Matsumoto, Naoki Saito, Takahiro Ogawa, Miki Haseyama

  IEEE 7th Global Conference on Consumer Electronics, GCCE 2018, Nara, Japan, October 9-12, 2018 200 - 201 IEEE 2018年 [査読有り][通常論文]
   

  A novel method for missing image data estimation is presented in this paper. The proposed method realizes accurate estimation of missing image data by iterating dictionary learning and Convolutional Sparse Coding (CSC). Specifically, our method iterates estimation of missing image data via CSC by using a dictionary that is constructed from a target image, and reconstruction of the dictionary by using the obtained estimation results. As the main contribution of our paper, the proposed method enables the missing image data estimation by using more suitable dictionaries obtained by this iterative scheme. Experimental results show high missing image data estimation performance by the proposed method.
• Image Retrieval from Vague Description Based on AttnGAN

  Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama

  2018 IEEE 7TH GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE 2018) 198 - 199 2018年 [査読有り][通常論文]
   

  Image retrieval plays an important role in the information society. Many studies have been conducted to improve accuracy of the image retrieval. However, there exists a major limitation in their input methods. For example, if users only have a vague description that does not include detailed information such as its name and do not have an appropriate input image, it is difficult to retrieve their desired images. To solve this problem, we propose a novel image retrieval method that enables retrieval of a desired image from a vague description. In the proposed method, we generate a query image from a vague description through an Attentional Generative Adversarial Network. By using the generated query image, the proposed method enables users to retrieve images even if they do not have a clear retrieval description as an input. Experimental results show the effectiveness of our method.
• Detection of Deformed PPG Waveforms Based on a Ratio of Their Average Accelerations.

  Ken Kawakami, Takahiro Ogawa, Miki Haseyama

  IEEE 7th Global Conference on Consumer Electronics, GCCE 2018, Nara, Japan, October 9-12, 2018 196 - 197 IEEE 2018年 [査読有り][通常論文]
   

  This paper presents a new method to detect deformed Photoplethysmogram (PPG) waveforms for sufficient accuracy of signal processing. The PPG waveforms have been applied in many health indicators, such as blood pressure, blood viscosity and blood vessel elasticity. Usually, the measurements using a sensitive signals require user awareness so that all the PPG waveforms are kept accurate. Namely, accuracy of the calculated indicators becomes lower when the PPG waveform is deformed due to motion artifacts. In particular, detection methods of deformed PPG waveforms are important for incorporating the health indicators into general fitness trackers to find the correct waveform or to remove deformed PPG waveforms from the measurement. Therefore, we propose a new method which detects a badly formed PPG waveform by monitoring a ratio of average accelerations. Experimental results show the effectiveness of the method for detecting a deformed PPG waveform.
• Blood Circulation Based on PPG Signals for Thermal Comfort Evaluation.

  Ken Kawakami, Takahiro Ogawa, Miki Haseyama

  IEEE 7th Global Conference on Consumer Electronics, GCCE 2018, Nara, Japan, October 9-12, 2018 194 - 195 IEEE 2018年 [査読有り][通常論文]
   

  This paper presents a new index for monitoring transition of blood circulation from Photoplethysmogram (PPG) signals for thermal comfort evaluation of users. Heat dissipation reaction through the dilation of blood vessels is person's intrinsic ability to control the thermal comfort. When body temperature is higher than normal temperature, blood circulation changes according to the dilation of blood vessels in distal end of the extremities. Blood circulation is often evaluated by an index of peripheral resistance corresponding to changes in blood flow velocity such as systolic/diastolic ratio S/D of flow velocities, resistance index and the pulsatility index. Unfortunately, such an index cannot be utilized in daily life for healthcare with using fitness trackers since the blood flow velocity is measured by either an ultrasonic Doppler blood flowmeter (UDF) or a Laser-Doppler flowmeter. Therefore, we propose a new index which is easily acquirable from PPG signals. First, a couple of variables correlating to the blood flow velocity is calculated from a rate of volumetric strain of Photoplethysmogram signals. Then the new index can be obtained as difference of these variables. Experimental results show the effectiveness of this index by confirming high correlation with S/D of UDF.
• Team Tactics Estimation in Soccer Videos via Deep Extreme Learning Machine Based on Players Formation.

  Genki Suzuki, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  IEEE 7th Global Conference on Consumer Electronics, GCCE 2018, Nara, Japan, October 9-12, 2018 116 - 117 IEEE 2018年 [査読有り][通常論文]
   

  A method of team tactics estimation in soccer videos is presented in this paper. Our method enables estimation of basic tactics in each team on the basis of the Deep-Extreme Learning Machine (DELM) by using features of players formation. In the soccer games, team tactics relate to each other team. Therefore, the proposed method obtains final estimation results by utilizing two DELMs of each team and their relationship. Since the proposed method takes into consideration the relevance of the estimated tactics in each team, we realize accurate tactics estibimation. Experimental results using actual soccer videos showed the effectiveness of our method.
• User-centric Visual Attention Estimation Based on Relationship between Image and Eye Gaze Data.

  Yuya Moroto, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  IEEE 7th Global Conference on Consumer Electronics, GCCE 2018, Nara, Japan, October 9-12, 2018 73 - 74 IEEE 2018年 [査読有り][通常論文]
   

  This paper presents a method for estimating user-centric visual attention based on the relationship between image and eye gaze data. The proposed method focuses on relationship between visual features calculated from images and saliency values calculated from eye gaze data. Specifically, our method calculates the saliency map of each training image by using individual eye gaze data obtained from only these images. Furthermore, from the pairs of visual features and the gaze-based saliency, the estimation of user-centric saliency from a new test image becomes feasible. Our contribution is the construction of a simple but successful estimation model which can train the relationship from limited amount of individual eye gaze data. Experimental results show the effectiveness of the proposed method.
• A Language-Independent Ontology Construction Method Using Tagged Images in Folksonomy

  Shota Hamano, Takahiro Ogawa, Miki Haseyama

  IEEE Access 6 2930 - 2942 2017年12月21日 [査読有り][通常論文]
   

  This paper presents a language-independent ontology (LION) construction method that uses tagged images in an image folksonomy. Existing multilingual frameworks that construct an ontology deal with concepts translated on the basis of parallel corpora, which are not always available however, the proposed method enables LION construction without parallel corpora by using visual features extracted from tagged images as the alternative. In the proposed method, visual similarities in tagged images are leveraged to aggregate synonymous concepts across languages. The aggregated concepts take on intrinsic semantics of themselves, while they also hold distinct characteristics in different languages. Then relationships between concepts are extracted on the basis of visual and textual features. The proposed method constructs a LION whose nodes and edges correspond to the aggregated concepts and relationships between them, respectively. The LION enables successful image retrieval across languages since each of the aggregated concepts can be referred to in different languages. Consequently, the proposed method removes the language barriers by providing an easy way to access a broader range of tagged images for users in the folksonomy, regardless of the language they use.
• Video preference estimation using fNIRS signals

  Akira Toyoda, Takahiro Ogawa, Miki Haseyama

  2017 IEEE 6th Global Conference on Consumer Electronics, GCCE 2017 2017- 1 - 2 2017年12月19日 [査読有り][通常論文]
   

  This paper presents a new method for video preference estimation using functional near-infrared spectroscopy signals (fNIRS signals). The proposed method first computes fNIRS features from fNIRS signals recorded while users are watching videos and multiple visual features from these videos. Next, by applying Locality Preserving Canonical Correlation Analysis to fNIRS features and each visual feature, we can obtain multiple new visual features. In addition, Multiview Local Fisher Discriminant Analysis fuses multiple new visual features and optimizes within and between class scatter in the fused feature space while using complementary properties in these features. Consequently, we can realize video preference estimation by using the fused features.
• Personalized tweet recommendation based on field-aware factorization machines with adaptive field organization

  Shoji Takimura, Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  2017 IEEE 6th Global Conference on Consumer Electronics, GCCE 2017 2017- 1 - 2 2017年12月19日 [査読有り][通常論文]
   

  A novel method for personalized tweet recommendation based on Field-aware Factorization Machines (FFMs) with adaptive field organization is presented in this paper. The proposed method realizes accurate recommendation of tweets in which users are interested by the following two contributions. First, sentiment factors such as opinions, thoughts and feelings included in tweets are newly introduced into FFMs in addition to their publisher and topic factors. Second, the proposed method newly enables adaptive organization of fields via canonical correlation analysis for multiple features extracted from each tweet. Experimental results for real-world datasets confirm the performance improvement of personalized tweet recommendation through the two contributions.
• Construction of network using heterogeneous social metadata for music video recommendation

  Yui Matsumoto, Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  2017 IEEE 6th Global Conference on Consumer Electronics, GCCE 2017 2017- 1 - 2 2017年12月19日 [査読有り][通常論文]
   

  A novel method to construct a network based on heterogeneous features obtained from music videos and social metadata for music video recommendation is presented in this paper. The proposed method enables construction of the network that can accurately associate users with music videos corresponding to their preference by the collaborative use of audio and textual features obtained from music videos and social metadata 'related videos', 'tags', and 'keywords' through sub-sampled canonical correlation analysis. By performing link prediction on the obtained network, our method enables users to obtain desired music videos that are not linked to each other in the network but corresponding to users' preference, that is, music video recommendation becomes feasible. Experimental results for real-world datasets show the effectiveness of our method.
• Interest level estimation based on matrix completion via rank minimization

  Tetsuya Kushima, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  2017 IEEE 6th Global Conference on Consumer Electronics, GCCE 2017 2017- 1 - 2 2017年12月19日 [査読有り][通常論文]
   

  This paper presents a novel method for interest level estimation based on matrix completion via rank minimization. The proposed method estimates interest levels of target objects from human behavior features which are extracted during selecting these objects. Specifically, by adopting matrix completion via rank minimization, unknown interest levels can be estimated. Furthermore, the proposed method can also estimate unknown interest levels with some missing behavior features which are not correctly extracted by sensors. Experimental results show the effectiveness of the proposed method.
• Aesthetic quality assessment of images via Supervised Locality Preserving CCA

  Misaki Kanai, Ren Togo, Takahiro Ogawa, Miki Haseyama

  2017 IEEE 6th Global Conference on Consumer Electronics, GCCE 2017 2017- 1 - 2 2017年12月19日 [査読有り][通常論文]
   

  Aesthetic quality assessment plays an important role in how people organize large image collections. Many studies on aesthetic quality assessment are based on design of hand-crafted features without considering whether attributes conveyed by images can actually affect image aesthetics. This paper presents an aesthetic quality assessment method which uses new visual features. The proposed method utilizes Supervised Locality Preserving Canonical Correlation Analysis (SLPCCA) to derive the new features which maximize correlation between attributes and visual features. Finally, by applying ridge regression to the SLPCCA-based features, successful aesthetic quality assessment is realized.
• Preference estimation for video recommendation using DCNN features and viewing behavior

  Yoshiki Ito, Takahiro Ogawa, Miki Haseyama

  2017 IEEE 6th Global Conference on Consumer Electronics, GCCE 2017 2017- 1 - 2 2017年12月19日 [査読有り][通常論文]
   

  This paper presents a personalized preference estimation method for video recommendation. Our method not only uses deep convolutional neural network (DCNN)-based video features but also transforms them based on user's viewing behavior in order to improve accuracy of preference estimation for a video. Specifically, we adopt supervised multi-view canonical correlation analysis (sMVCCA) in order to calculate 'canonical video features', which have a maximal correlation between the following three kinds of features: a video, user's viewing behavior and user's evaluation scores for the video. By using the canonical video features, our method can estimate the user's personalized preference for a video more accurately than using only the DCNN-based video features. Experimental results show the effectiveness of our method.
• Image classification for trend prediction based on integration of fNIRS and visual features

  Kazaha Horii, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  2017 IEEE 6th Global Conference on Consumer Electronics, GCCE 2017 2017- 1 - 2 2017年12月19日 [査読有り][通常論文]
   

  This paper presents a novel method of image classification for trend prediction based on integration of visual and fNIRS features. It is expected that classification of images in the same object category in terms of generation enables trend prediction. However, since images in the same object category have similar visual features, a limit of accuracy exists for image classification by using only visual features. To overcome this problem, we utilize fNIRS features which represent brain activity in addition to visual features. Specifically, we apply Discriminative Locality Preserving Canonical Correlation Analysis (DLPCCA) to fNIRS and visual features for utilizing them collaboratively. The main contribution of this paper is the improvement of classification performance of images in the same object category for trend prediction by using the visual features projected to the DLPCCA-based space.
• Wiener-Based Inpainting Quality Prediction

  Takahiro Ogawa, Akira Tanaka, Miki Haseyama

  IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS E100D 10 2614 - 2626 2017年10月 [査読有り][通常論文]
   

  A Wiener-based inpainting quality prediction method is presented in this paper. The proposed method is the first method that can predict inpainting quality both before and after the intensities have become missing even if their inpainting methods are unknown. Thus, when the target image does not include any missing areas, the proposed method estimates the importance of intensities for all pixels, and then we can know which areas should not be removed. Interestingly, since this measure can be also derived in the same manner for its corrupted image already including missing areas, the expected difficulty in reconstruction of these missing pixels is predicted, i.e., we can know which missing areas can be successfully reconstructed. The proposed method focuses on expected errors derived from the Wiener filter, which enables least-squares reconstruction, to predict the inpainting quality. The greatest advantage of the proposed method is that the same inpainting quality prediction scheme can be used in the above two different situations, and their results have common trends. Experimental results show that the inpainting quality predicted by the proposed method can be successfully used as a universal quality measure.
• Extracting hierarchical structure of content groups from different social media platforms using multiple social metadata

  Daichi Takehara, Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  MULTIMEDIA TOOLS AND APPLICATIONS 76 19 20249 - 20272 2017年10月 [査読有り][通常論文]
   

  A novel scheme for retrieving users' desired contents, i.e., contents with topics in which users are interested, from multiple social media platforms is presented in this paper. In existing retrieval schemes, users first select a particular platform and then input a query into the search engine. If users do not specify suitable platforms for their information needs and do not input suitable queries corresponding to the desired contents, it becomes difficult for users to retrieve the desired contents. The proposed scheme extracts the hierarchical structure of content groups (sets of contents with similar topics) from different social media platforms, and it thus becomes feasible to retrieve desired contents even if users do not specify suitable platforms and do not input suitable queries. This paper has two contributions: (1) A new feature extraction method, Locality Preserving Canonical Correlation Analysis with multiple social metadata (LPCCA-MSM) that can detect content groups without the boundaries of different social media platforms is presented in this paper. LPCCA-MSM uses multiple social metadata as auxiliary information unlike conventional methods that only use content-based information such as textual or visual features. (2) The proposed novel retrieval scheme can realize hierarchical content structuralization from different social media platforms. The extracted hierarchical structure shows various abstraction levels of content groups and their hierarchical relationships, which can help users select topics related to the input query. To the best of our knowledge, an intensive study on such an application has not been conducted; therefore, this paper has strong novelty. To verify the effectiveness of the above contributions, extensive experiments for real-world datasets containing YouTube videos and Wikipedia articles were conducted.
• Visualizing Web Images Using Fisher Discriminant Locality Preserving Canonical Correlation Analysis

  Kohei Tateno, Takahiro Ogawa, Miki Haseyama

  IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS E100D 9 2005 - 2016 2017年09月 [査読有り][通常論文]
   

  A novel dimensionality reduction method, Fisher Discriminant Locality Preserving Canonical Correlation Analysis (FDLPCCA), for visualizing Web images is presented in this paper. FDLP-CCA can integrate two modalities and discriminate target items in terms of their semantics by considering unique characteristics of the two modalities. In this paper, we focus onWeb images with text uploaded on Social Networking Services for these two modalities. Specifically, text features have high discriminate power in terms of semantics. On the other hand, visual features of images give their perceptual relationships. In order to consider both of the above unique characteristics of these two modalities, FDLPCCA estimates the correlation between the text and visual features with consideration of the cluster structure based on the text features and the local structures based on the visual features. Thus, FDLP-CCA can integrate the different modalities and provide separated manifolds to organize enhanced compactness within each natural cluster.
• Biomimetics Image Retrieval Platform

  Miki Haseyama, Takahiro Ogawa, Sho Takahashi, Shuhei Nomura, Masatsugu Shimomura

  IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS E100D 8 1563 - 1573 2017年08月 [査読有り][通常論文]
   

  Biomimetics is a new research field that creates innovation through the collaboration of different existing research fields. However, the collaboration, i.e., the exchange of deep knowledge between different research fields, is difficult for several reasons such as differences in technical terms used in different fields. In order to overcome this problem, we have developed a new retrieval platform, "Biomimetics image retrieval platform," using a visualization-based image retrieval technique. A biological database contains a large volume of image data, and by taking advantage of these image data, we are able to overcome limitations of text-only information retrieval. By realizing such a retrieval platform that does not depend on technical terms, individual biological databases of various species can be integrated. This will allow not only the use of data for the study of various species by researchers in different biological fields but also access for a wide range of researchers in fields ranging from materials science, mechanical engineering and manufacturing. Therefore, our platform provides a new path bridging different fields and will contribute to the development of biomimetics since it can overcome the limitation of the traditional retrieval platform.
• Deterioration Level Estimation on Transmission Towers via Extreme Learning Machine based on Combination Use of Local Receptive Field and Principal Component Analysis

  K. Maeda, S. Takahashi, T. Ogawa, M. Haseyama

  International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC) 457 - 458 2017年07月 [査読有り][通常論文]
  
• Effectiveness Evaluation of Imaging Direction for Estimation of Gastritis Regions on Gastric X-ray Images

  Ren Togo, Kenta Ishihara, Takahiro Ogawa, Miki Haseyama

  International Technical Conference on Circuits, Systems, Computers, and Communications (ITC-CSCC) 459 - 460 2017年05月 [査読有り][通常論文]
  
• Helicobacter Pylori infection detection from gastric X-ray images based on feature fusion and decision fusion

  Kenta Ishihara, Takahiro Ogawa, Miki Haseyama

  COMPUTERS IN BIOLOGY AND MEDICINE 84 69 - 78 2017年05月 [査読有り][通常論文]
   

  In this paper, a fully automatic method for detection of Helicobacter pylori (H. pylori) infection is presented with the aim of constructing a computer-aided diagnosis (CAD) system. In order to realize a CAD system with good performance for detection of H. pylori infection, we focus on the following characteristic of stomach X-ray examination. The accuracy of X-ray examination differs depending on the symptom of H. pylori infection that is focused on and the position from which X-ray images are taken. Therefore, doctors have to comprehensively assess the symptoms and positions. In order to introduce the idea of doctors' assessment into the CAD system, we newly propose a method for detection of H. pylori infection based on the combined use of feature fusion and decision fusion. As a feature fusion scheme, we adopt Multiple Kernel Learning (MKL). Since MKL can combine several features with determination of their weights, it can represent the differences in symptoms. By constructing an MKL classifier for each position, we can obtain several detection results. Furthermore, we introduce confidence-based decision fusion, which can consider the relationship between the classifier's performance and the detection results. Consequently, accurate detection of H. pylori infection becomes possible by the proposed method. Experimental results obtained by applying the proposed method to real X-ray images show that our method has good performance, close to the results of detection by specialists, and indicate that the realization of a CAD system for determining the risk of H. pylori infection is possible.
• Tracking hierarchical structure of web video groups based on salient keyword matching including semantic broadness estimation

  Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  2016 IEEE Global Conference on Signal and Information Processing, GlobalSIP 2016 - Proceedings 1238 - 1242 2017年04月19日 [査読有り][通常論文]
   

  This paper presents a novel method to track the hierarchical structure of Web video groups on the basis of salient keyword matching including semantic broadness estimation. To the best of our knowledge, this paper is the first work to perform extraction and tracking of the hierarchical structure simultaneously. Specifically, the proposed method first extracts the hierarchical structure of Web video groups and salient keywords of them on the basis of an improved scheme of our previously reported method. Moreover, to calculate similarities between Web video groups obtained in different time stamps, salient keyword matching is newly developed by considering both co-occurrences of the salient keywords and semantic broadness of each Web video group. Consequently, tracking of the hierarchical structure over time becomes feasible to easily understand popularity trends of many Web videos for realizing effective retrieval.
• Distress Classification of Class Imbalanced Data for Maintenance Inspection of Road Structures in Express Way

  K. Maeda, S. Takahashi, T. Ogawa, M. Haseyama

  International Conference on Civil and Building Engineering Informatics in conjunction with Conference on Computer Applications in Civil and Hydraulic Engineering (ICCBEI & CCACHE) 182 - 185 2017年04月 [査読有り][通常論文]
  
• Human-Centered Video Feature Selection via mRMR-SCMMCCA for Preference Extraction

  Takahiro Ogawa, Yoshiaki Yamaguchi, Satoshi Asamizu, Miki Haseyama

  IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS E100D 2 409 - 412 2017年02月 [査読有り][通常論文]
   

  This paper presents human-centered video feature selection via mRMR-SCMMCCA (minimum Redundancy and Maximum Relevance-Specific Correlation Maximization Multiset Canonical Correlation Analysis) algorithm for preference extraction. The proposed method derives SCMMCCA, which simultaneously maximizes two kinds of correlations, correlation between video features and users' viewing behavior features and correlation between video features and their corresponding rating scores. By monitoring the derived correlations, the selection of the optimal video features that represent users' individual preference becomes feasible.
• Human-Centered Video Feature Selection via mRMR-SCMMCCA for Preference Extraction

  OGAWA Takahiro, YAMAGUCHI Yoshiaki, ASAMIZU Satoshi, HASEYAMA Miki

  IEICE Transactions on Information and Systems E100.D 2 409 - 412 2017年 [査読無し]
   

  This paper presents human-centered video feature selection via mRMR-SCMMCCA (minimum Redundancy and Maximum Relevance-Specific Correlation Maximization Multiset Canonical Correlation Analysis) algorithm for preference extraction. The proposed method derives SCMMCCA, which simultaneously maximizes two kinds of correlations, correlation between video features and users' viewing behavior features and correlation between video features and their corresponding rating scores. By monitoring the derived correlations, the selection of the optimal video features that represent users' individual preference becomes feasible.
• Extracting Hierarchical Structure of Web Video Groups Based on Sentiment-Aware Signed Network Analysis

  Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  IEEE ACCESS 5 16963 - 16973 2017年 [査読有り][通常論文]
   

  Sentiment in multimedia contents has an influence on their topics, since multimedia contents are tools for social media users to convey their sentiment. Performance of applications such as retrieval and recommendation will be improved if sentiment in multimedia contents can be estimated; however, there have been few works in which such applications were realized by utilizing sentiment analysis. In this paper, a novel method for extracting the hierarchical structure of Web video groups based on sentiment-aware signed network analysis is presented to realize Web video retrieval. First, the proposed method estimates latent links between Web videos by using multimodalfeatures of contents and sentiment features obtained from texts attached to Web videos. Thus, our method enables construction of a signed network that reflects not only similarities but also positive and negative relations between topics of Web videos. Moreover, an algorithm to optimize a modularity-based measure, which can adaptively adjust the balance between positive and negative edges, was newly developed. This algorithm detects Web video groups with similar topics at multiple abstraction levels; thus, successful extraction of the hierarchical structure becomes feasible. By providing the hierarchical structure, users can obtain an overview of many Web videos and it becomes feasible to successfully retrieve the desired Web videos. Results of experiments using a new benchmark dataset, YouTube-8M, validate the contributions of this paper, i.e., 1) the first attempt to utilize sentiment analysis for Web video grouping and 2) a novel algorithm for analyzing a weighted signed network derived from sentiment and multimodal features.
• PERSONALIZED VIDEO PREFERENCE ESTIMATION BASED ON EARLY FUSION USING MULTIPLE USERS'VIEWING BEHAVIOR

  Yoshiki Ito, Takahiro Ogawa, Miki Haseyama

  2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) 3006 - 3010 2017年 [査読有り][通常論文]
   

  This paper presents a novel method for personalized video preference estimation based on early fusion using multiple users' viewing behavior. The proposed method adopts supervised Multi-View Canonical Correlation Analysis (sMVCCA) to estimate correlation between different types of features. Specifically, we estimate optimal projections maximizing the correlation between three features of video, target user's viewing behavior and evaluation scores for video. Then novel video features (canonical video features), which reflect the target user's individual preference, are obtained by the estimated projections. Furthermore, our method computes sMVCCA-based canonical video features by using multiple users' viewing behavior and a target user's evaluation scores. This non-conventional approach using the multiple users' viewing behavior for the preference estimation of the target user is the biggest contribution of our method, and it enables early fusion of the canonical video features. Consequently, successful video recommendation that reflects the users' individual preference can be expected via the evaluation score prediction from the integrated canonical video features. Experimental results show the effectiveness of our method.
• EXEMPLAR-BASED IMAGE COMPLETION VIA NEW QUALITY MEASURE BASED ON PHASELESS TEXTURE FEATURES

  Takahiro Ogawa, Miki Haseyama

  2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) 1827 - 1831 2017年 [査読有り][通常論文]
   

  This paper presents an exemplar-based image completion via a new quality measure based on phaseless texture features. The proposed method derives a new quality measure obtained by monitoring errors caused in power spectra, i.e., errors of phaseless texture features, converged through phase retrieval. Even if a target patch includes missing pixels, this measure enables selection of the best matched patch including the most similar texture features for realizing the exemplar-based image completion. Furthermore, since the phaseless texture features are robust to various changes such as spatial gaps and luminance changes, the new quality measure successfully provides the best matched patch from few training examples. Then, by solving an optimization problem that retrieves the phase of the target patch from the phaseless texture features of the best matched patch, its missing areas can be reconstructed. Consequently, accurate image completion using the new quality measure becomes feasible. Subjective and quantitative experimental results are shown to verify the effectiveness of our method using the new quality measure.
• EMOTION ESTIMATION VIA TENSOR-BASED SUPERVISED DECISION-LEVEL FUSION FROM MULTIPLE BRODMANN AREAS

  Kento Sugata, Takahiro Ogawa, Miki Haseyama

  2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) 999 - 1003 2017年 [査読有り][通常論文]
   

  This paper presents a novel method that estimates human emotion based on tensor-based supervised decision-level fusion (TS-DLF) from multiple Brodmann areas (BAs). From multiple brain data corresponding to these BAs captured by functional magnetic resonance imaging (fMRI), our method performs general tensor discriminant analysis (GTDA) to obtain features which can reflect the user's emotion. Furthermore, since the dimension of the obtained features becomes lower, this can avoid overfitting in the following training procedure of estimators. Next, by separately using the transformed BA data obtained after GTDA, we obtain multiple estimation results of the user's emotion based on logistic tensor regression (LTR). Then our method realizes the decision of the final result based on TS-DLF from the multiple estimation results. This approach, i.e., the integration of the multiple BAs' results for the whole-brain data, is the biggest contribution of this paper. TS-DLF successfully integrates the multiple estimation results with considering the performance of the LTR-based estimator constructed for each BA. Experimental results show that our method outperforms state-of-the-art approaches, and the effectiveness of our method can be confirmed.
• Adaptive Subspace-Based Inverse Projections via Division Into Multiple Sub-Problems for Missing Image Data Restoration

  Takahiro Ogawa, Miki Haseyama

  IEEE TRANSACTIONS ON IMAGE PROCESSING 25 12 5971 - 5986 2016年12月 [査読有り][通常論文]
   

  This paper presents adaptive subspace-based inverse projections via division into multiple sub-problems (ASIP-DIMSs) for missing image data restoration. In the proposed method, a target problem for estimating missing image data is divided into multiple sub-problems, and each sub-problem is iteratively solved with the constraints of other known image data. By projection into a subspace model of image patches, the solution of each sub-problem is calculated, where we call this procedure "subspace-based inverse projection" for simplicity. The proposed method can use higher dimensional subspaces for finding unique solutions in each sub-problem, and successful restoration becomes feasible, since a high level of image representation performance can be preserved. This is the biggest contribution of this paper. Furthermore, the proposed method generates several subspaces from known training examples and enables derivation of a new criterion in the above framework to adaptively select the optimal subspace for each target patch. In this way, the proposed method realizes missing image data restoration using ASIP-DIMS. Since our method can estimate any kind of missing image data, its potential in two image restoration tasks, image inpainting and super-resolution, based on several methods for multivariate analysis is also shown in this paper.
• A Web video retrieval method using hierarchical structure of Web video groups

  Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  MULTIMEDIA TOOLS AND APPLICATIONS 75 24 17059 - 17079 2016年12月 [査読有り][通常論文]
   

  In this paper, we propose a Web video retrieval method that uses hierarchical structure of Web video groups. Existing retrieval systems require users to input suitable queries that identify the desired contents in order to accurately retrieve Web videos; however, the proposed method enables retrieval of the desired Web videos even if users cannot input the suitable queries. Specifically, we first select representative Web videos from a target video dataset by using link relationships between Web videos obtained via metadata "related videos" and heterogeneous video features. Furthermore, by using the representative Web videos, we construct a network whose nodes and edges respectively correspond to Web videos and links between these Web videos. Then Web video groups, i.e., Web video sets with similar topics are hierarchically extracted based on strongly connected components, edge betweenness and modularity. By exhibiting the obtained hierarchical structure of Web video groups, users can easily grasp the overview of many Web videos. Consequently, even if users cannot write suitable queries that identify the desired contents, it becomes feasible to accurately retrieve the desired Web videos by selecting Web video groups according to the hierarchical structure. Experimental results on actual Web videos verify the effectiveness of our method.
• Classifying Insects from SEM Images Based on Optimal Classifier Selection and D-S Evidence Theory

  Takahiro Ogawa, Akihiro Takahashi, Miki Haseyama

  IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES E99A 11 1971 - 1980 2016年11月 [査読有り][通常論文]
   

  In this paper, an insect classification method using scanning electron microphotographs is presented. Images taken by a scanning electron microscope (SEM) have a unique problem for classification in that visual features differ from each other by magnifications. Therefore, direct use of conventional methods results in inaccurate classification results. In order to successfully classify these images, the proposed method generates an optimal training dataset for constructing a classifier for each magnification. Then our method classifies images using the classifiers constructed by the optimal training dataset. In addition, several images are generally taken by an SEM with different magnifications from the same insect. Therefore, more accurate classification can be expected by integrating the results from the same insect based on Dempster-Shafer evidence theory. In this way, accurate insect classification can be realized by our method. At the end of this paper, we show experimental results to confirm the effectiveness of the proposed method.
• Estimation of salient regions related to chronic gastritis using gastric X-ray images

  Ren Togo, Kenta Ishihara, Takahiro Ogawa, Miki Haseyama

  COMPUTERS IN BIOLOGY AND MEDICINE 77 9 - 15 2016年10月 [査読有り][通常論文]
   

  Since technical knowledge and a high degree of experience are necessary for diagnosis of chronic gastritis, computer-aided diagnosis (CAD) systems that analyze gastric X-ray images are desirable in the field of medicine. Therefore, a new method that estimates salient regions related to chronic gastritis/non-gastritis for supporting diagnosis is presented in this paper. In order to estimate salient regions related to chronic gastritis/non-gastritis, the proposed method monitors the distance between a target image feature and Support Vector Machine (SVM)-based hyperplane for its classification. Furthermore, our method realizes removal of the influence of regions outside the stomach by using positional relationships between the stomach and other organs. Consequently, since the proposed method successfully estimates salient regions of gastric X-ray images for which chronic gastritis and non-gastritis are unknown, visual support for inexperienced clinicians becomes feasible. (C) 2016 Elsevier Ltd. All rights reserved.
• 画像共有サービスに投稿される画像の観光名所に関するカテゴリー分類

  斉藤 直輝, 小川 貴弘, 浅水 仁, 長谷山 美紀

  電子情報通信学会論文誌D 情報・システム J99-D 9 848 - 860 2016年09月01日 [査読有り]
   

  本論文では，画像共有サービスに投稿される画像の観光名所に関するカテゴリー（観光カテゴリー）の分類手法を提案する．提案手法では，画像共有サービスにおいて画像とともに投稿される様々なデータの中で，位置座標が観光カテゴリーの分類に最も効果的であることに注目する．更に，このデータに基づいた分類において誤りが発生する場合を，分類結果から導出される確信度に基づいて判定する．誤分類と判定された場合，提案手法では，画像及びタグの特徴に基づいた分類結果を求め，それらを各々の分類精度に注目して統合することで，最終的な分類結果を高精度に推定可能とする．このとき，位置座標による分類結果に基づいて分類候補の観光カテゴリーを限定することで，多クラス分類問題におけるクラス数を減少させ，より正確な分類を可能とする．以上の提案手法によって，異なる種類のデータの分類精度が互いに大きく異なる場合に従来手法では困難であった高精度な最終分類結果の取得が可能となる．
• NMF-Based Spectral Reflectance Estimation From Image Pairs Including Near-Infrared Components

  Takahiro Ogawa, Yuta Igarashi, Miki Haseyama

  IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY 26 5 855 - 867 2016年05月 [査読有り][通常論文]
   

  In this paper, a novel spectral reflectance estimation method from image pairs including near-infrared (NIR) components based on nonnegative matrix factorization (NMF) is presented. The proposed method enables estimation of spectral reflectance from only two kinds of input images: 1) an image including both visible light components and NIR components and 2) an image including only NIR components. These two images can be easily obtained using a general digital camera without an infrared-cut filter and one with a visible light-cut filter, respectively. Since RGB values of these images are obtained according to spectral sensitivity of the image sensor, the spectrum power distribution of the light source and the spectral reflectance, we have to solve the inverse problem for estimating the spectral reflectance. Therefore, our method approximates spectral reflectance by a linear combination of several bases obtained by applying NMF to a known spectral reflectance data set. Then estimation of the optimal solution to the above problem becomes feasible based on this approximation. In the proposed method, NMF is used for obtaining the bases used in this approximation from a characteristic that the spectral reflectance is a nonnegative component. Furthermore, the proposed method realizes simple approximation of the spectrum power distribution of the light source with direct and scattered light components. Therefore, estimation of spectral reflectance becomes feasible using the spectrum power distribution of the light source in our method. In the last part of this paper, we show some simulation results to verify the performance of the proposed method. The effectiveness of the proposed method is also shown using the method for several applications that are closely related to spectral reflectance estimation. Although our method is based on a simple scheme, it is the first method that realizes the estimation of the spectral reflectance and the spectrum power distribution of the light source from the above two kinds of images taken by general digital cameras and provides breakthroughs to several fundamental applications.
• A Most Resource-Consuming Disease Estimation Method from Electronic Claim Data Based on Labeled LDA

  Yasutaka Hatakeyama, Takahiro Ogawa, Hironori Ikeda, Miki Haseyama

  IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS E99D 3 763 - 768 2016年03月 [査読有り][通常論文]
   

  In this paper, we propose a method to estimate the most resource-consuming disease from electronic claim data based on Labeled Latent Dirichlet Allocation (Labeled LDA). The proposed method models each electronic claim from its medical procedures as a mixture of resource-consuming diseases. Thus, the most resource-consuming disease can be automatically estimated by applying Labeled LDA to the electronic claim data. Although our method is composed of a simple scheme, this is the first trial for realizing estimation of the most resource-consuming disease.
• Distress Classification of Road Structures via Multiple Classifier-based Bayesian Network

  K. Maeda, S. Takahashi, T. Ogawa, M. Haseyama

  International Workshop on Advanced Image Technology (IWAIT) 1 - 4 2016年 [査読有り][通常論文]
  
• Decision Level Fusion-based Team Tactics Estimation in Soccer Videos

  Genki Suzuki, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  2016 IEEE 5TH GLOBAL CONFERENCE ON CONSUMER ELECTRONICS 1 - 2 2016年 [査読有り][通常論文]
   

  A decision-level fusion (DLF)-based team tactics estimation method in soccer videos is newly presented. In our method, tactics estimation based on audio-visual and formation features is newly adopted since the tactics of the soccer game are closely related to the audio-visual sequences and player positions. Therefore, by using these features, we classify the tactics via Support. Vector Machine (SVM). Furthermore, by applying DIA' to the SVM-based classification results, the two modalities are integrated to obtain more accurate tactics estimation results. Some results of experiments verify the superiority of our method.
• Estimating Human Emotion Evoked by Visual Stimuli Using fMRI Data

  Kento Sugata, Takahiro Ogawa, Miki Haseyama

  2016 IEEE 5TH GLOBAL CONFERENCE ON CONSUMER ELECTRONICS 1 - 2 2016年 [査読有り][通常論文]
   

  This paper presents a method that estimates human emotion evoked by visual stimuli using functional magnetic resonance imaging (fMRI) data. First, in our method, preprocessing and masking procedures are applied to the fMRI data. These procedures provide the multiple brain data corresponding to Brodmann areas (BA). In most cases, the dimensionality of fMRI data and the BA data is larger than the number of observations, and this results in overfilling. Thus, in order to reduce the dimensionality, we apply general tensor discriminant analysis (GTDA), which can take into account the information related to the users' emotion. Then multiple estimation results of the users' emotion are obtained from support vector machine by separately using the multiple BA data obtained after the dimensionality reduction via GTDA. Furthermore, our method obtains the final estimation result from effective supervised decision-level fusion of the above estimation results.
• Retrieval of Similar Inspection Records Based on Metric Learning Using Fixperienced Inspectors' Evaluation

  Ryota Saito, Sho Takahashi, Takahiro Ogawa, Miki Hasayama

  2016 IEEE 5TH GLOBAL CONFERENCE ON CONSUMER ELECTRONICS 1 - 2 2016年 [査読有り][通常論文]
   

  This paper presents a retrieval method of similar inspection records in road structures based on metric learning using experienced inspectors' evaluation. Inspection records of road structures include images and text-based information such as category of distress, damaged parts and degree of damage. The proposed method calculates distances from query inspection records, and rank lists of retrieval results are obtained for each feature. In this approach, the distance quantification are updated on the basis of experienced inspectors' evaluation. Finally, the proposed method obtains retrieval results by integrating the multiple rank lists. The experimental results show the effectiveness of the proposed method.
• A Touism Category Classification Method Based on Estimation of Reliable Decision

  Naoki Saito, Takahiro Ogawa, Satoshi Asamizu, Miki Haseyama

  2016 IEEE 5TH GLOBAL CONFERENCE ON CONSUMER ELECTRONICS 1 - 2 2016年 [査読有り][通常論文]
   

  In this paper, we propose a tourism category classification method based on estimation of reliable decision. The proposed method performs tourism category classification using location, visual, and textual tag features obtained from tourism images in image sharing services. As the biggest contribution of this paper, the proposed method performs successful classification based on two classification results obtained from a fuzzy K-nearest neighbor algorithm using the location features and a decision level fusion approach using the visual and textual tag features. The proposed method enables estimation of reliable decision from above two classifiers.
• Novel Video Feature-based Favorite Video Estimation Using Users' Viewing Behavior and Evaluation

  Yoshiki Ito, Takahiro Ogawa, Miki Haseyama

  2016 IEEE 5TH GLOBAL CONFERENCE ON CONSUMER ELECTRONICS 1 - 2 2016年 [査読有り][通常論文]
   

  This paper presents novel video feature-based favorite video estimation method. In the proposed method, we use three features, videos, users' viewing behavior and users' evaluation scores for these videos. In order to calculate the novel video features, Multiset Canonical Correlations Analysis (MCCA) is applied to these features to integrate the different types of features. Specifically, MCCA maximizes the sum of three kinds of correlations between three pairs of these features. Then the novel video features that represent the users' individual preference can be obtained by using the projection maximizing the three correlations. Finally, Supported Vector Ordinal Regression (SVOR) is trained by using the novel video features to estimate favorite videos. Experimental results show the effectiveness of our method.
• Different Language Association Using Mutual Information Between Tags and Visual Features

  Shota Hamano, Takahiro Ogawa, Mild Haseyama

  2016 IEEE 5TH GLOBAL CONFERENCE ON CONSUMER ELECTRONICS 1 - 2 2016年 [査読有り][通常論文]
   

  This paper presents a method for associating tags in one language with the tags representing the same meaning in another language. Since recent image search and sharing services highly rely on annotations like tags with images for obtaining the desired images, the proposed method utilizes the visual features extracted from images with tags. In the proposed method, mutual information between tags and visual features are calculated. Tag similarity is then calculated based on the mutual information. Mutual information takes into consideration the relevance between tags and visual features. Therefore, the similarity based on the mutual information represents tag-to-tag relationships more effectively than direct use of the visual features. Experimental results show the effectiveness of the proposed method in associating English tags with Japanese tags representing the same meanings.
• Image Retrieval for Identification of Insects Based on Saliency Map and Distance Metric Learning

  Susumu Genma, Takahiro Ogawa, Miki Haseyama

  2016 IEEE 5TH GLOBAL CONFERENCE ON CONSUMER ELECTRONICS 1 - 2 2016年 [査読有り][通常論文]
   

  This paper presents an image retrieval method for insect identification based on saliency map and distance metric learning. First, the proposed method extracts regions of insects from target images by using saliency map and calculates visual features from the extracted insect regions. Next, in order to realize accurate retrieval of insects based on the calculated features, distance metric learning is newly adopted. Consequently, through users' evaluation in the retrieval, optimal distance can be obtained for the calculated visual features to obtain successful retrieval results, and the identification of insects becomes feasible. Experimental results show the effectiveness of our method.
• Distress Classification of Road Structures via Decision Level Fusion

  Keisuke Maeda, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  2016 IEEE INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP) 2016 DSP 589 - 593 2016年 [査読有り][通常論文]
   

  A distress classification method of road structures via decision level fusion is presented in this paper. In order to classify various kinds of distresses accurately, the proposed method integrates multiple classification results with considering their performance, and this is the biggest contribution of this paper. By introducing this approach, it becomes feasible to adaptively integrate the multiple classification results based on the accuracy of each classifier for a target sample. Consequently, realization of the accurate distress classification can be expected. Experimental results show that our method outperforms existing methods.
• Multimodal Interest Level Estimation via Variational Bayesian Mixture of Robust CCA

  Yuma Sasaka, Takhiro Ogawa, Miki Haseyama

  MM'16: PROCEEDINGS OF THE 2016 ACM MULTIMEDIA CONFERENCE 387 - 391 2016年 [査読有り][通常論文]
   

  This paper presents a method which estimates interest level while watching videos, based on collaborative use of facial expression and biological signals such as electroencephalogram (EEG) and electrocardiogram (ECG). To the best of our knowledge, no studies have been carried out on the collaborative use of facial expression and biological signals for estimating interest level. Since training data, which is used for estimating interest level, is generally small and imbalanced, Variational Bayesian Mixture of Robust Canonical Correlation Analysis (VBMRCCA) is newly applied to facial expression and biological signals, which are obtained from users while they are watching the videos. Unlike some related works, VBMRCCA is used to obtain the posterior distributions which represent the latent correlation between facial expression and biological signals in our method. Then, the users' interest level can be estimated by comparing the posterior distributions of the positive class data with those of the negative. Consequently, successful interest level estimation, via collaborative use of facial expression and biological signals, becomes feasible.
• An Accurate Mortality Prediction Method Based on Decision-level Fusion of Existing ICU Scoring Systems

  Yasutaka Hatakeyama, Takahiro Ogawa, Hirokazu Tanaka, Miki Haseyama

  PROCEEDINGS OF 2016 INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY AND ITS APPLICATIONS (ISITA 2016) 126 - 130 2016年 [査読有り][通常論文]
   

  In this paper, we propose a mortality prediction method based on decision-level fusion (DLF) of existing intensive unit care (ICU) scoring systems. First, the proposed method obtains severity scores from the existing ICU scoring systems. Furthermore, we construct classifiers that categorize patients into survivors or non-survivors. Next, patient feature vectors are extracted based on the mortality rates that are estimated from the obtained severity scores by using a non-linear least squares method to obtain other types of classification results. In order to obtain the final severity score for each patient, we integrate the obtained multiple classification results based on DLF that can estimate the final severity scores. Finally, we performed the proposed method to actual ICU patient data and verified the effectiveness of the proposed method. Thus, the proposed method can realize accurate mortality prediction without any additional work by using the existing ICU scoring systems.
• GRAPH-BASED WEB VIDEO SEARCH RERANKING THROUGH CONSISTENCY ANALYSIS USING SPECTRAL CLUSTERING

  Soh Yoshida, Takahiro Ogawa, Miki Haseyaina

  2016 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO (ICME) 2016-August 1 - 6 2016年 [査読有り][通常論文]
   

  This paper proposes a graph-based Web video search reranking method through consistency analysis using spectral clustering. Graph-based reranking is effective for refining text-based video search results. Generally, this approach constructs a graph where the vertices are videos and the edges reflect their pairwise similarities. A lot of reranking methods are built based on a scheme which regularizes the smoothness of pairwise ranking scores between adjacent nodes. However, since the overall consistency is measured by aggregating the individual consistency over each pair, errors in score estimation increase when noisy samples are included within their neighbors. To deal with the noisy samples, different from the conventional methods, the proposed method models the global consistency of the graph structure. Specifically, in order to detect this consistency, the propose method introduces a spectral clustering algorithm which can detect video groups, whose videos have strong semantic correlation, on the graph. Furthermore, a new regularization term, which smooths ranking scores within the same group, is introduced to the reranking framework. Since score regularization is performed by both local and global aspect simultaneously, the accurate score estimation becomes feasible. Experimental results obtained by applying the proposed method to a real-world video collection show its effectiveness.
• HIERARCHICAL CONTENT GROUP DETECTION FROM DIFFERENT SOCIAL MEDIA PLATFORMS USING WEB LINK STRUCTURE

  Daichi Takehara, Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) 2016-August 479 - 483 2016年 [査読有り][通常論文]
   

  This paper presents a method for hierarchical content group detection from different social media platforms, which can reveal hierarchical structure of content groups. In this paper, content groups are defined as sets of contents with similar topics. Based on the revealed hierarchical structure, our method enables users to efficiently find the desired contents from large amount of contents placed in diversified social media platforms. The main contributions of this paper are twofold. First, effective latent features for comparing the contents placed in different social media platforms can be extracted by the combination use of the correlation between features obtained from different social media platform and the Web link structure. Second, the hierarchical structure of the content groups, which captures their various abstraction levels, can be revealed by hierarchically detecting their content groups. Experimental results on the real-world dataset containing YouTube videos and Wikipedia articles show the effectiveness of our method.
• NOVEL FAVORITE MUSIC CLASSIFICATION USING EEG-BASED OPTIMAL AUDIO FEATURES SELECTED VIA KDLPCCA

  Ryosuke Sawata, Takahiro Ogawa, Miki Haseyama

  2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS 2016 ICASSP 759 - 763 2016年 [査読有り][通常論文]
   

  This paper presents a novel method of favorite music classification using EEG-based optimal audio features. To select audio features related to user's music preference, our method utilizes a relationship between EEG features obtained from the user's EEG signals during listening to music and their corresponding audio features since EEG signals of human reflect his/her music preference. Specifically, cross-loadings, whose components denote the degree of the relationship, are calculated based on Kernel Discriminative Locality Preserving Canonical Correlation Analysis (KDLPCCA) which is newly derived in the proposed method. In contrast with standard CCA, KDLPCCA can consider (1) non-linear correlation, (2) class information and (3) local structures of input EEG and audio features, simultaneously. Therefore, KDLPCCA-based cross-loadings can reflect best correlation between the user's EEG and corresponding audio signals. Then an optimal set of audio features related to his/her music preference can be obtained by employing the cross-loadings as novel criteria for feature selection. Consequently, our method realizes favorite music classification successfully by using the EEG-based optimal audio features.
• Improvement of video coding efficiency based on sparse contractive mapping approach

  Zaixing He, Takahiro Ogawa, Sho Takahashi, Miki Haseyama, Xinyue Zhao

  NEUROCOMPUTING 173 P3 1898 - 1907 2016年01月 [査読有り][通常論文]
   

  This paper presents a new method for improving video coding efficiency based on a sparse contractive mapping approach. The proposed method introduces a new sparse contractive mapping approach to replace the traditional intra prediction in the video coding standards such as H.264/AVC. Specifically, the intra- and its following inter-frame are respectively approximated by the sparse representation, satisfying contractive mapping. Then these two frames can be reconstructed from an arbitraryinitial image by utilizing a few representation coefficients. With this advantage, the proposed method reduces the total amount of bits by removing MBs in the target I frame, whose approximation performance is higher than the others in the encoder. Furthermore, by transmitting the representation coefficients of the removed MBs, these MBs can be accurately reconstructed in the decoder. Since the reconstruction performance is better than that of the conventional approach, the proposed method can remove more MBs from the target video sequences, and reduction of total amount of bits can be feasible. Therefore, the proposed method realizes the improvement of the video coding efficiency. Some experimental results are shown to verify the superior performance of the proposed method to that of H.264/AVC. The results also demonstrate that the bit-saving performance of the proposed method is comparable to that of H.2651 HEVC. (C) 2015 Elsevier B.V. All rights reserved.
• Bregman pooling: Feature-space local pooling for image classification

  Alameen Najjar, Takahiro Ogawa, Miki Haseyama

  International Journal of Multimedia Information Retrieval 4 4 247 - 259 2015年12月01日 [査読有り][通常論文]
   

  In this paper, we propose a novel feature-space local pooling method for the commonly adopted architecture of image classification. While existingmethods partition the feature space based on visual appearance to obtain pooling bins, learning more accurate space partitioning that takes semantics into account boosts performance even for a smaller number of bins. To this end, we propose partitioning the feature space over clusters of visual prototypes common to semantically similar images (i.e., images belonging to the same category). The clusters are obtained by Bregman co-clustering applied offline on a subset of training data. Therefore, being aware of the semantic context of the input image, our features have higher discriminative power than do those pooled from appearance-based partitioning. Testing on four datasets (Caltech-101, Caltech-256, 15 Scenes, and 17 Flowers) belonging to three different classification tasks showed that the proposed method outperforms methods in previous works on local pooling in he feature space for less feature dimensionality. Moreover, when implemented within a spatial pyramid, our method achieves comparable results on three of the datasets used.
• Perceptually Optimized Missing Texture Reconstruction via Neighboring Embedding

  Takahiro Ogawa, Miki Haseyama

  IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES E98A 8 1709 - 1717 2015年08月 [査読有り][通常論文]
   

  Perceptually optimized missing texture reconstruction via neighboring embedding (NE) is presented in this paper. The proposed method adopts the structural similarity (SSIM) index as a measure for representing texture reconstruction performance of missing areas. This provides a solution to the problem of previously reported methods not being able to perform perceptually optimized reconstruction. Furthermore, in the proposed method, a new scheme for selection of the known nearest neighbor patches for reconstruction of target patches including missing areas is introduced. Specifically, by monitoring the SSIM index observed by the proposed NE-based reconstruction algorithm, selection of known patches optimal for the reconstruction becomes feasible even if target patches include missing pixels. The above novel approaches enable successful reconstruction of missing areas. Experimental results show improvement of the proposed method over previously reported methods.
• NOVEL IMAGE CLASSIFICATION BASED ON INTEGRATION OF EEG AND VISUAL FEATURES VIA MSLPCCA

  Takuya Kawakami, Takahiro Ogawa, Miki Haseyama

  2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP) 957 - 961 2015年 

  This paper presents a novel image classification method based on integration of EEG and visual features. In the proposed method, we obtain classification results by separately using EEG and visual features. Furthermore, we merge the above classification results based on a kernelized version of Supervised learning from multiple experts and obtain the final classification result. In order to generate feature vectors used for the final image classification, we apply Multiset supervised locality preserving canonical correlation analysis (MSLPCCA), which is newly derived in the proposed method, to EEG and visual features. Our method realizes successful multimodal classification of images by the object categories that they contain based on MSLPCCA-based feature integration.
• MISSING INTENSITY RESTORATION VIA ADAPTIVE SELECTION OF PERCEPTUALLY OPTIMIZED SUBSPACES

  Takahiro Ogawa, Miki Haseyama

  2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP) 1628 - 1632 2015年 

  A missing intensity restoration method via adaptive selection of perceptually optimized subspaces is presented in this paper. In order to realize adaptive and perceptually optimized restoration, the proposed method generates several subspaces of known textures optimized in terms of the structural similarity (SSIM) index. Furthermore, the SSIM-based missing intensity restoration is performed by a projection onto convex sets (POCS) algorithm whose constraints are the obtained subspace and known intensities within the target image. In this approach, a non-convex maximization problem for calculating the projection onto the subspace is reformulated as a quasi-convex problem, and the restoration of the missing intensities becomes feasible. Furthermore, the selection of the optimal subspace is realized by monitoring the SSIM index converged in the POCS algorithm, and the adaptive restoration becomes feasible. Experimental results show that our method outperforms existing methods.
• Automatic Martian Dust Storm Detection from Multiple Wavelength Data Based on Decision Level Fusion

  Maeda Keisuke, Ogawa Takahiro, Haseyama Miki

  Information and Media Technologies 10 3 473 - 477 Information and Media Technologies Editorial Board 2015年 

  This paper presents automatic Martian dust storm detection from multiple wavelength data based on decision level fusion. In our proposed method, visual features are first extracted from multiple wavelength data, and optimal features are selected for Martian dust storm detection based on the minimal-Redundancy-Maximal-Relevance algorithm. Second, the selected visual features are used to train the Support Vector Machine classifiers that are constructed on each data. Furthermore, as a main contribution of this paper, the proposed method integrates the multiple detection results obtained from heterogeneous data based on decision level fusion, while considering each classifiers detection performance to obtain accurate final detection results. Consequently, the proposed method realizes successful Martian dust storm detection.
• Image Classification Based on Integration of EEG and Visual Features Via LFDA-MSLPCCA

  Kento Sugata, Takahiro Ogawa, Miki Haseyama

  2015 IEEE 4TH GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE) 513 - 514 2015年 [査読有り][通常論文]
   

  This paper presents a novel image classification based on the integration of EEG and visual features. In the proposed method, we first obtain classification results by separately using EEG and visual features. Then we merge the above classification results based on kernelized version of Supervised Learning from Multiple Experts (KSLME) via Multiset Supervised Locality Preserving Canonical Correlation Analysis (MSLPCCA) to obtain final classification results. It should be noted that when the number of samples is fewer than the dimension of a sample data used in MSLPCCA, we have to reduce the dimension. Therefore, we propose MSLPCCA based on Local Fisher Discriminant Analysis (LFDA) which can take class information into account. Then the integration of all of the classifications results becomes feasible by MSLPCCA based on LFDA.
• Web Image Visualization Considering Image Content Based on Visual and Tag Features

  Kouhei Tateno, Takahiro Ogawa, Miki Haseyama

  2015 IEEE 4TH GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE) 254 - 255 2015年 [査読有り][通常論文]
   

  This paper presents a Web image visualization considering image content based on visual and tag features. In this paper, we focus on tagged images on social media websites. Since these tags represent the image content according to the subjectivity of the user, using these tags is efficient for the image visualization. Thus, by using visual and tag features, the proposed method can take account of the semantic contents. Specifically, the proposed method applies Locality Preserving Canonical Correlation Analysis (LPCCA) to these two features to obtain the dimensionality reduction results, i.e., the visualization result.
• Video Genre Estimation from Relationship between Motion and Facial Features using SLPCCA

  Yuma Sasaka, Takahiro Ogawa, Miki Haseyama

  2015 IEEE 4TH GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE) 250 - 251 2015年 [査読有り][通常論文]
   

  In this paper, we propose an efficient video genre estimation method based on the relationship between facial features and motion features. In the proposed method, we utilize supervised locality preserving canonical correlation analysis (SLPCCA), which is derived in the proposed method, to maximize the correlation between facial features and motion features. Moreover, by using SLPCCA, we can consider not only the correlation but also class information. Finally, by applying Support Vector Machine (SVM) to the SLPCCA-based feature vectors, we realize a successful video genre estimation. Experimental results show the effectiveness of our method.
• Missing Texture Reconstruction via Power Spectrum-based Sparse Representation

  Yuma Tanaka, Takahiro Ogawa, Miki Haseyama

  2015 IEEE 4TH GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE) 221 - 222 2015年 [査読有り][通常論文]
   

  This paper presents a method for missing texture reconstruction via power spectrum-based sparse representation. We reconstruct missing areas based on minimizing the mean square error between power spectra (P-MSE). In our method, missing areas are reconstructed by embedding some known patches. Mathematically, we obtain the optimal linear combination of measurement patches by P-MSE minimization. The optimization can be solved as a combinatorial problem based on sparse representaion. In this way, the optimal approximation which minimizes the P-MSE is obtained and we embed it in the missing area. Experimental results show effectiveness of our method for reconstructing texture images.
• LDA-based Music Recommendation with CF-based Similar User Selection

  Shohei Kinoshita, Takahiro Ogawa, Miki Haseyama

  2015 IEEE 4TH GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE) 215 - 216 2015年 [査読有り][通常論文]
   

  This paper presents a Latent Dirichlet Allocation (LDA)-based music recommendation method with collaborative filtering (CF)-based similar user selection. By applying LDA to music, we can estimate latent topics of music. However, we have to effectively reduce the size of the target dataset applied to LDA in order to recommend music from a large dataset. Hence, we use CF techniques, which recommend items using evaluation information of users who have similar tastes to a target user. Therefore, the proposed method limits the size of the dataset by using information of similar users and enables the recommendation of music considering latent topics of music. By using the idea of CF, our method can use LDA for music recommendation. Experimental results show the effectiveness of our method.
• Helicobacter Pylori Infection Detection From Gastric X-ray Images Using KLFDA-based Decision Fusion

  Kenta Ishihara, Takahiro Ogawa, Miki Haseyama

  2015 IEEE 4TH GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE) 204 - 205 2015年 [査読有り][通常論文]
   

  This paper presents the performance improvement of Helicobacter pylori (H.pylori) infection detection using Kernel Local Fisher Discriminant Analysis (KLFDA)-based decision fusion. As the biggest contribution of this paper, the proposed method extracts more discriminative features based on KLFDA for the decision fusion. Since the decision fusion employed in this paper can consider not only the detection results but also the visual features, by calculating more discriminative features via KLFDA, more accurate decision fusion becomes feasible. Furthermore, experimental results show the effectiveness of the proposed method.
• Automatic martian dust storm detection from multiple wavelength data based on decision level fusion

  Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  IPSJ Transactions on Computer Vision and Applications 7 79 - 83 2015年 [査読有り][通常論文]
   

  This paper presents automatic Martian dust storm detection from multiple wavelength data based on decision level fusion. In our proposed method, visual features are first extracted from multiple wavelength data, and optimal features are selected for Martian dust storm detection based on the minimal-Redundancy-Maximal-Relevance algorithm. Second, the selected visual features are used to train the Support Vector Machine classifiers that are constructed on each data. Furthermore, as a main contribution of this paper, the proposed method integrates the multiple detection results obtained from heterogeneous data based on decision level fusion, while considering each classifier's detection performance to obtain accurate final detection results. Consequently, the proposed method realizes successful Martian dust storm detection.
• Investigation of flow and sink initiation process in mold shapes in injection molding

  Tetsushi Kaburagi, Masashi Kurose, Takahiro Ogawa, Hiroki Kuroiwa, Tomoyuki Iwasawa

  International Journal of Automation Technology 9 1 10 - 18 2015年 [査読有り][通常論文]
   

  Injection molding has faults, or sinks, caused by the shrinkage ofmaterials. Sinks should be inhibited since they greatly affect the dimensions of moldings. In this study, a mold that allows visual observation is employed, and the sink initiation process is analyzed and predicted based on the results of that analysis. This mold has two sections, one flat and one curved. The difference between the deformations in the flat and curved sections is investigated. Methods of inhibiting sinks are considered from the results of the analysis and injection molding experiments. Packing pressure is found to have a great effect on sinks.
• Heterogeneous Graph-based Video Search Reranking using Web Knowledge via Social Media Network

  Soh Yoshida, Takahiro Ogawa, Miki Haseyama

  MM'15: PROCEEDINGS OF THE 2015 ACM MULTIMEDIA CONFERENCE 871 - 874 2015年 [査読有り][通常論文]
   

  Graph-based reranking is effective for refining text-based video search results by making use of the social network structure. Unlike previous works which only focus on an individual video graph, the proposed method leverages the mutual reinforcement of heterogeneous graphs, such as videos and their associated tags obtained by social influence mining. Specifically, propagation of information relevancy across different modalities is performed by exchanging information of inter- and intra-relations among heterogeneous graphs. The proposed method then formulates the video search reranking as an optimization problem from the perspective of Bayesian framework. Furthermore, in order to model the consistency over the modified video graph topology, a local learning regularization with a social community detection scheme is introduced to the framework. Since videos within the same social community have strong semantic correlation, the consistency score estimation becomes feasible. Experimental results obtained by applying the proposed method to a real-world video collection show its effectiveness.
• HELICOBACTER PYLORI INFECTION DETECTION FROM MULTIPLE X-RAY IMAGES BASED ON COMBINATION USE OF SUPPORT VECTOR MACHINE AND MULTIPLE KERNEL LEARNING

  Kenta Ishihara, Takahiro Ogawa, Miki Haseyama

  2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) 2015-December 4728 - 4732 2015年 [査読有り][通常論文]
   

  This paper presents a detection method of Helicobacter pylori (H. pylori) infection from multiple gastric X-ray images based on combination use of Support Vector Machine (SVM) and Multiple Kernel Learning (MKL). The proposed method firstly computes some types of visual features from multiple gastric X-ray images taken in several specific directions in order to represent the characteristics of X-ray images with H. pylori infection. Second, based on the minimal-Redundancy-Maximal-Relevance algorithm, we select the effective features for H. pylori infection detection from each type of visual feature and all visual features. The selected features are used to train the SVM classifier and the MKL classifier for each direction of gastric X-ray images. Finally, the proposed method integrates multiple detection results based on a late fusion scheme considering the detection performance of each classifier. Experimental results obtained by applying the proposed method to real X-ray images prove its effectiveness.
• AUTOMATIC DETECTION OF MARTIAN DUST STORMS FROM HETEROGENEOUS DATA BASED ON DECISION LEVEL FUSION

  Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

  2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) 2015-December 2246 - 2250 2015年 [査読有り][通常論文]
   

  This paper presents automatic detection of Martian dust storms from heterogeneous data (raw data, reflectance data and background subtraction data of the reflectance data) based on decision level fusion. Specifically, the proposed method first extracts image features from these data and selects optimal features for dust storm detection based on the minimal-Redundancy-Maximal-Relevance algorithm. Second, the selected image features are used to train the Support Vector Machine classifier that is constructed on each data. Furthermore, as a main contribution of this paper, the proposed method combines the multiple detection results obtained from the heterogeneous data based on decision level fusion with considering each classifier's detection performance to obtain accurate final detection results. Consequently, the proposed method realizes automatic and accurate detection of Martian dust storms.
• EXTRACTION OF HIERARCHICAL STRUCTURE OF WEB COMMUNITIES INCLUDING SALIENT KEYWORD ESTIMATION FOR WEB VIDEO RETRIEVAL

  Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama

  2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) 2015-December 1021 - 1025 2015年 [査読有り][通常論文]
   

  In this paper, we present a method for extraction of hierarchical structure of Web communities including salient keyword estimation for Web video retrieval. The following two contributions of the proposed method enable retrieval of the desired Web videos even if users cannot input suitable queries that identify the desired contents. First, our method realizes the extraction of hierarchical structure of Web communities, i.e., Web video sets with similar topics by using heterogeneous features of Web videos and link relationships between Web videos obtained via metadata "related videos". Second, we can estimate salient keywords to identify the contents of each obtained Web community at a glance based on text attached to Web videos such as title, the heterogeneous features of Web videos and the link relationships between Web videos. Experimental results on actual Web videos verify that our method can realize accurate retrieval of the desired Web videos via the hierarchical structure of Web communities with their salient keywords.
• Human-centered Favorite Music Estimation: EEG-based Extraction of Audio Features Reflecting Individual Preference

  Ryosuke Sawata, Takahiro Ogawa, Miki Haseyama

  2015 IEEE INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP) 2015-September 818 - 822 2015年 [査読有り][通常論文]
   

  This paper presents a human-centered method for favorite music estimation using EEG-based audio features. In order to estimate user's favorite musical pieces, our method utilizes his/her EEG signals for calculating new audio features suitable for representing the user's music preference. Specifically, projection, which transforms original audio features into the features reflecting the preference, is calculated by applying kernel Canonical Correlation Analysis (CCA) to the audio features and the EEG features which are extracted from the user's EEG signals during listening to favorite musical pieces. By using the obtained projection, the new EEG-based audio features can be derived since this projection provides the best correlation between the user's EEG signals and their corresponding audio signals. Thus, successful estimation of user's favorite musical pieces via a Support Vector Machine (SVM) classifier using the new audio features becomes feasible. Since our method does not need acquisition of EEG signals for obtaining new audio features from new musical pieces after calculating the projection, this indicates the high practicability of our method. Experimental results show that our method outperforms methods using original audio features or EEG features.
• Algorithm for Sparse Representation Minimizing Mean Square Error of Power Spectrograms

  Yuma Tanaka, Takahiro Ogawa, Miki Haseyama

  2015 IEEE INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP) 2015-September 618 - 622 2015年 [査読有り][通常論文]
   

  Sparse representation is an idea to approximate a target signal by a linear combination of a small number of sample signals, and it is utilized in various research fields. In this paper, we evaluate the approximation error of signals by the mean square error of power spectrograms (P-MSE). Specifically, we propose a P-MSE minimization algorithm for sparse representation. Our method minimizes the P-MSE by an iterative approach. Specifically, in each iteration, we find the optimal sample signal and optimize the corresponding coefficients by a gradient-based method. In this approach, our method can utilize the result of the previous iteration for fast and stable convergence in the optimization of the coefficients. Based on this algorithm, the sparse representation which minimizes the P-MSE becomes feasible. Experimental results show the effectiveness of our method in terms of the P-MSE minimization.
• MISSING INTENSITY RESTORATION VIA ADAPTIVE SELECTION OF PERCEPTUALLY OPTIMIZED SUBSPACES

  Takahiro Ogawa, Miki Haseyama

  2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP) 2015-August 1628 - 1632 2015年 [査読有り][通常論文]
   

  A missing intensity restoration method via adaptive selection of perceptually optimized subspaces is presented in this paper. In order to realize adaptive and perceptually optimized restoration, the proposed method generates several subspaces of known textures optimized in terms of the structural similarity (SSIM) index. Furthermore, the SSIM-based missing intensity restoration is performed by a projection onto convex sets (POCS) algorithm whose constraints are the obtained subspace and known intensities within the target image. In this approach, a non-convex maximization problem for calculating the projection onto the subspace is reformulated as a quasi-convex problem, and the restoration of the missing intensities becomes feasible. Furthermore, the selection of the optimal subspace is realized by monitoring the SSIM index converged in the POCS algorithm, and the adaptive restoration becomes feasible. Experimental results show that our method outperforms existing methods.
• NOVEL IMAGE CLASSIFICATION BASED ON INTEGRATION OF EEG AND VISUAL FEATURES VIA MSLPCCA

  Takuya Kawakami, Takahiro Ogawa, Miki Haseyama

  2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP) 2015-August 957 - 961 2015年 [査読有り][通常論文]
   

  This paper presents a novel image classification method based on integration of EEG and visual features. In the proposed method, we obtain classification results by separately using EEG and visual features. Furthermore, we merge the above classification results based on a kernelized version of Supervised learning from multiple experts and obtain the final classification result. In order to generate feature vectors used for the final image classification, we apply Multiset supervised locality preserving canonical correlation analysis (MSLPCCA), which is newly derived in the proposed method, to EEG and visual features. Our method realizes successful multimodal classification of images by the object categories that they contain based on MSLPCCA-based feature integration.
• Random combination for information extraction in compressed sensing and sparse representation-based pattern recognition

  Zaixing He, Xinyue Zhao, Shuyou Zhang, Takahiro Ogawa, Miki Haseyama

  NEUROCOMPUTING 145 160 - 173 2014年12月 [査読有り][通常論文]
   

  In compressed sensing and sparse representation-based pattern recognition, random projection with a dense random transform matrix is widely used for information extraction. However, the complicated structure makes dense random matrices computationally expensive and difficult in hardware implementation. This paper considers the simplification of the random projection method. First, we propose a simple random method, random combination, for information extraction to address the issues of dense random methods. The theoretical analysis and the experimental results show that it can provide comparable performance to those of dense random methods. Second, we analyze another simple random method, random choosing, and give its applicable occasions. The comparative analysis and the experimental results show that it works well in dense cases but worse in sparse cases. Third, we propose a practical method for measuring the effectiveness of the feature transform matrix in sparse representation-based pattern recognition. A matrix satisfying the Representation Residual Restricted Isometry Property can provide good recognition results. (C) 2014 Elsevier B.V. All rights reserved.
• Adaptive missing texture reconstruction method based on kernel cross-modal factor analysis with a new evaluation criterion

  Takahiro Ogawa, Mild Haseyama

  SIGNAL PROCESSING 103 69 - 83 2014年10月 [査読有り][通常論文]
   

  This paper presents an adaptive missing texture reconstruction method based on kernel cross-modal factor analysis (KCFA) with a new evaluation criterion. The proposed method estimates the latent relationship between two areas, which correspond to a missing area and its neighboring area, respectively, from known parts within the target image and realizes reconstruction of the missing textures. In order to obtain this relationship, KCFA is applied to each cluster containing similar known textures, and the optimal cluster is used for reconstructing each target missing area. Specifically, a new criterion obtained by monitoring errors caused in the latent space enables selection of the optimal cluster. Then each missing texture is adaptively estimated by the optimal cluster's latent relationship, which enables accurate reconstruction of similar textures. In our method, the above criterion is also used for estimating patch priority, which determines the reconstruction order of missing areas within the target image. Since patches, whose textures are accurately modeled by our KCFA-based method, can be selected by using the new criterion, it becomes feasible to perform successful reconstruction of the missing areas. Experimental results show improvements of our KCFA-based reconstruction method over previously reported methods. (C) 2013 Elsevier B.V. All rights reserved.
• Player Tracking in Far-View Soccer Videos Based on Composite Energy Function

  Kazuya Iwai, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS E97D 7 1885 - 1892 2014年07月 [査読有り][通常論文]
   

  In this paper, an accurate player tracking method in far-view soccer videos based on a composite energy function is presented. In far-view soccer videos, player tracking methods that perform processing based only on visual features cannot accurately track players since each player region becomes small, and video coding causes color bleeding between player regions and the soccer field. In order to solve this problem, the proposed method performs player tracking on the basis of the following three elements. First, we utilize visual features based on uniform colors and player shapes. Second, since soccer players play in such a way as to maintain a formation, which is a positional pattern of players, we use this characteristic for player tracking. Third, since the movement direction of each player tends to change smoothly in successive frames of soccer videos, we also focus on this characteristic. Then we adopt three energies: a potential energy based on visual features, an elastic energy based on formations and a movement direction-based energy. Finally, we define a composite energy function that consists of the above three energies and track players by minimizing this energy function. Consequently, the proposed method achieves accurate player tracking in far-view soccer videos.
• A new method for error degree estimation in numerical weather prediction via MKDA-based ordinal regression

  Takahiro Ogawa, Shintaro Takahashi, Sho Takahashi, Miki Haseyama

  EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING 2014 1 115 - 115 2014年07月 [査読有り][通常論文]
   

  This paper presents a new method for estimating error degrees in numerical weather prediction via multiple kernel discriminant analysis (MKDA)-based ordinal regression. The proposed method tries to estimate how large prediction errors will occur in each area from known observed data. Therefore, ordinal regression based on KDA is used for estimating the prediction error degrees. Furthermore, the following points are introduced into the proposed approach. Since several meteorological elements are related to each other based on atmospheric movements, the proposed method merges such heterogeneous features in the target and neighboring areas based on a multiple kernel algorithm. This approach is based on the characteristics of actual meteorological data. Then, MKDA-based ordinal regression for estimating the prediction error degree of a target meteorological element in each area becomes feasible. Since the amount of training data obtained from known observed data becomes very large in the training stage of MKDA, the proposed method performs simple sampling of those training data to reduce the number of samples. We effectively use the remaining training data for determining the parameters of MKDA to realize successful estimation of the prediction error degree.
• A Cross-Modal Approach for Extracting Semantic Relationships Between Concepts Using Tagged Images

  Marie Katsurai, Takahiro Ogawa, Miki Haseyama

  IEEE TRANSACTIONS ON MULTIMEDIA 16 4 1059 - 1074 2014年06月 [査読有り][通常論文]
   

  This paper presents a cross-modal approach for extracting semantic relationships between concepts using tagged images. In the proposed method, we first project both text and visual features of the tagged images to a latent space using canonical correlation analysis (CCA). Then, under the probabilistic interpretation of CCA, we calculate a representative distribution of the latent variables for each concept. Based on the representative distributions of the concepts, we derive two types of measures: the semantic relatedness between the concepts and the abstraction level of each concept. Because these measures are derived from a cross-modal scheme that enables the collaborative use of both text and visual features, the semantic relationships can successfully reflect semantic and visual contexts. Experiments conducted on tagged images collected from Flickr show that our measures are more coherent to human cognition than the conventional measures that use either text or visual features, or the WordNet-based measures. In particular, a new measure of semantic relatedness, which satisfies the triangle inequality, obtains the best results among different distance measures in our framework. The applicability of our measures to multimedia-related tasks such as concept clustering, image annotation and tag recommendation is also shown in the experiments.
• Effective Multiple Feature Fusion Using Topic Model for Social Image Visualization

  Kouhei Tateno, Takahiro Ogawa, Miki Haseyama

  2014 IEEE 3RD GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE) 182 - 183 2014年 [査読有り][通常論文]
   

  This paper presents a multiple feature fusion method using topic model for social image visualization. Images in social media are represented from several aspects such as their visual information and tags. The proposed method extracts low-level features from social images and their tags and calculates their integrated high-level features. Specifically, the proposed method applies multilayer multimodal probabilistic Latent Semantic Analysis (mm-pLSA) to the low-level visual and tag features to obtain the high-level features. Then, by applying dimensionality reduction techniques to the obtained features, successful visualization becomes feasible.
• Bayesian Network-based Distress Estimation Using Image Features in Road Structure Assessment

  Keisuke Maeda, Sho Takahashi, Takahiro Ogawa, Miki Haseyama

  2014 IEEE 3RD GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE) 169 - 170 2014年 [査読有り][通常論文]
   

  This paper presents a Bayesian network-based method for estimating a distress of road structures from inspection data. The distress is represented by a damage of road structures and its degree. In the previous work, the distress was estimated by utilizing Bayesian network based on categories of road structures, details of road structures and damaged parts. However, inspection data include not only the above items but also images of the distress. Therefore, by introducing the use of the images to the previous work, improvement of the distress estimation accuracy can be expected. The proposed method calculates Bayesian network from inspection items and their corresponding images to perform the distress estimation. Experimental results show the effectiveness of the proposed method.
• Popular Music Estimation Based on Topic Model Using Time Information and Audio Features

  Shohei Kinoshita, Takahiro Ogawa, Miki Haseyama

  2014 IEEE 3RD GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE) 102 - 103 2014年 [査読有り][通常論文]
   

  This paper presents popular music estimation based on a topic model using time information and audio features. The proposed method calculates latent topic distribution using Latent Dirichlet Allocation to obtain more accurate music features. In this approach, we also use release date information of each music as time information for concerning the relationship between music trends and each age. Then, by using the obtained latent topic distribution features, the estimation of the popular music becomes feasible based on a Support Vector Machine classifier. Experimental results show the effectiveness of our method.
• Missing Audio Segment Reconstruction Based on Sparse Representation with Power Spectrogram

  Yuma Tanaka, Takahiro Ogawa, Miki Haseyama

  2014 IEEE 3RD GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE) 86 - 87 2014年 [査読有り][通常論文]
   

  This paper presents a method for reconstructing missing audio segments based on sparse representation with power spectrogram. In the proposed method, an error of power spectrograms is utilized as a quality measure representing reconstruction performance. Then the proposed method estimates missing segments based on sparse representation optimized with respect to the error of power spectrograms. This error minimization problem can be solved with a greedy algorithm by limitting the solution to only sparse one. By using our method, perceptually optimized reconstruction becomes feasible since missing segments are estimated by using the quality measure which represens auditory properties. Experimental results obtained by applying the proposed method to actual music signals from RWC Music Database show its effectiveness.
• HELICOBACTER PYLORI INFECTION DETECTION FROM MULTIPLE X-RAY IMAGES BASED ON DECISION LEVEL FUSION

  Kenta Ishihara, Takahiro Ogawa, Miki Haseyama

  2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) 2769 - 2773 2014年 [査読有り][通常論文]
   

  This paper presents an automatic detection method of Helicobacter pylori (H. pylori) infection from multiple gastric X-ray images. As the biggest contribution of this paper, we combine multiple detection results based on a decision level fusion. In order to obtain multiple detection results, the proposed method first focuses on characteristics of gastric X-ray images with H. pylori infection and computes several visual features from multiple X-ray images taken in several specific directions. Second, we select effective features for H. pylori infection detection from all features based on the minimal-Redundancy-Maximal-Relevance algorithm, and the selected features are used to train the Support Vector Machine (SVM) classifiers that are constructed for each direction of gastric radiography. Therefore, the detection of H. pylori infection becomes feasible, and we can obtain multiple detection results from the SVM classifiers. Furthermore, we combine multiple detection results based on the decision level fusion scheme considering the detection performance of each SVM classifier. Experimental results obtained by applying the proposed method to real X-ray images prove the effectiveness of the proposed method.
• 2D SEMI-SUPERVISED CCA-BASED INPAINTING INCLUDING NEW PRIORITY ESTIMATION

  Takahiro Ogawa, Miki Haseyama

  2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) 1837 - 1841 2014年 [査読有り][通常論文]
   

  This paper presents an inpainting method based on 2D semi-supervised canonical correlation analysis (2D semi-CCA) including new priority estimation. The proposed method estimates relationship, i.e., the optimal correlation, between missing area and its neighboring area from known parts within the target image by using 2D CCA. In this approach, we newly introduce a semi-supervised scheme into the 2D CCA for deriving the 2D semi-CCA which corresponds to a hybrid version of 2D CCA and 2D principle component analysis (2D PCA). This enables successful relationship estimation even if sufficient number of training pairs cannot be provided. Then, by using the obtained relationship, accurate estimation of the missing intensities can be realized. Furthermore, in the proposed method, errors caused in the new variate space obtained by the 2D semi-CCA are effectively used for deriving patch priority determining inpainting order of missing areas. Experimental results show our inpainting method can outperform previously reported methods.
• NOVEL IMAGE CLASSIFICATION BASED ON DECISION-LEVEL FUSION OF EEG AND VISUAL FEATURES

  Takuya Kawakami, Takahiro Ogawa, Miki Haseyama

  2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) 2014 Vol.8 5874 - 5878 2014年 [査読有り][通常論文]
   

  This paper presents a novel image classification based on decision-level fusion of EEG and visual features. In the proposed method, we extract the EEG features from EEG signals recorded while users stare at images, and the visual features are computed from these images. Then the classification of images is performed based on Support Vector Machine (SVM) by separately using the EEG and visual features. Furthermore, we merge the above classification results based on Supervised Learning from Multiple Experts to obtain the final classification result. This method focuses on the classification accuracy calculated from each classification result. Therefore, although classification accuracy based on EEG and visual features are different from each other, our method realizes effective integration of these classification results. In addition, we newly derive a kernelized version of the method in order to realize more accurate integration of the classification results. Consequently, our method realizes successful multimodal classification of images by the object categories that they contain.
• MISSING INTENSITY RESTORATION VIA PERCEPTUALLY OPTIMIZED SUBSPACE PROJECTION BASED ON ENTROPY COMPONENT ANALYSIS

  Takahiro Ogawa, Miki Haseyama

  2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) 2014 Vol.1 175 - 179 2014年 [査読有り][通常論文]
   

  A missing intensity restoration method via perceptually optimized subspace projection based on entropy component analysis (ECA) is presented in this paper. The proposed method calculates the optimal subspace of known patches within a target image based on structural similarity (SSIM) index, and the optimal bases are determined based on ECA. Then missing intensity estimation whose results maximize the SSIM index is realized by using a projection onto convex sets (POCS) algorithm whose constraints are the obtained subspace and known intensities within the target image. In this approach, a non-convex maximization problem for calculating the projection onto the subspace is reformulated as a quasi-convex problem, and the restoration of the missing intensities becomes feasible. Experimental results show that our restoration method outperforms previously reported methods.
• Image inpainting based on sparse representations with a perceptual metric

  Takahiro Ogawa, Miki Haseyama

  EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING 2013 179 - 179 2013年12月 [査読有り][通常論文]
   

  This paper presents an image inpainting method based on sparse representations optimized with respect to a perceptual metric. In the proposed method, the structural similarity (SSIM) index is utilized as a criterion to optimize the representation performance of image data. Specifically, the proposed method enables the formulation of two important procedures in the sparse representation problem, 'estimation of sparse representation coefficients' and 'update of the dictionary', based on the SSIM index. Then, using the generated dictionary, approximation of target patches including missing areas via the SSIM-based sparse representation becomes feasible. Consequently, image inpainting for which procedures are totally derived from the SSIM index is realized. Experimental results show that the proposed method enables successful inpainting of missing areas.
• Vocal segment estimation in music pieces based on collaborative use of EEG and audio features

  Takuya Kawakami, Takahiro Ogawa, Miki Haseyama

  ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings 2013 Vol.2 1197 - 1201 2013年10月18日 [査読有り][通常論文]
   

  This paper presents a novel estimation method of segments including vocals in music pieces based on collaborative use of features extracted from electroencephalogram (EEG) signals recorded while users are listening to music pieces and features extracted from these audio signals. From extracted EEG features and audio features, we estimate segments including vocals based on Support Vector Machine (SVM) by separately utilizing these two features. Furthermore, the final classification results are obtained by integrating these estimation results based on supervised learning from multiple experts. Therefore, our method realizes multimodal estimation of segments including vocals in music pieces. Experimental results show the improvement of our method over the methods utilizing only EEG or audio features. © 2013 IEEE.
• Missing Texture Reconstruction Method Based on Error Reduction Algorithm Using Fourier Transform Magnitude Estimation Scheme

  Takahiro Ogawa, Miki Haseyama

  IEEE TRANSACTIONS ON IMAGE PROCESSING 22 3 1252 - 1257 2013年03月 [査読有り][通常論文]
   

  A missing texture reconstruction method based on an error reduction (ER) algorithm, including a novel estimation scheme of Fourier transform magnitudes is presented in this brief. In our method, Fourier transform magnitude is estimated for a target patch including missing areas, and the missing intensities are estimated by retrieving its phase based on the ER algorithm. Specifically, by monitoring errors converged in the ER algorithm, known patches whose Fourier transform magnitudes are similar to that of the target patch are selected from the target image. In the second approach, the Fourier transform magnitude of the target patch is estimated from those of the selected known patches and their corresponding errors. Consequently, by using the ER algorithm, we can estimate both the Fourier transform magnitudes and phases to reconstruct the missing areas.
• Super-resolution for simultaneous realization of resolution enhancement and motion blur removal based on adaptive prior settings

  Takahiro Ogawa, Daisuke Izumi, Akane Yoshizaki, Miki Haseyama

  EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING 2013 1 - 17 2013年02月 [査読有り][通常論文]
   

  A super-resolution method for simultaneously realizing resolution enhancement and motion blur removal based on adaptive prior settings are presented in this article. In order to obtain high-resolution (HR) video sequences from motion-blurred low-resolution video sequences, both of the resolution enhancement and the motion blur removal have to be performed. However, if one is performed after the other, errors in the first process may cause performance deterioration of the subsequent process. Therefore, in the proposed method, a new problem, which simultaneously performs the resolution enhancement and the motion blur removal, is derived. Specifically, a maximum a posterior estimation problem which estimates original HR frames with motion blur kernels is introduced into our method. Furthermore, in order to obtain the posterior probability based on Bayes' rule, a prior probability of the original HR frame, whose distribution can adaptively be set for each area, is newly defined. By adaptively setting the distribution of the prior probability, preservation of the sharpness in edge regions and suppression of the ringing artifacts in smooth regions are realized. Consequently, based on these novel approaches, the proposed method can perform successful reconstruction of the HR frames. Experimental results show impressive improvements of the proposed method over previously reported methods.
• AN EXTRACTION METHOD OF HIERARCHICAL WEB COMMUNITIES FOR WEB VIDEO RETRIEVAL

  Ryosuke Harakawa, Yasutaka Hatakeyama, Takahiro Ogawa, Miki Haseyama

  2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013) 4397 - 4401 2013年 [査読有り][通常論文]
   

  This paper presents an extraction method of hierarchical Web communities for Web video retrieval. In the proposed method, Web communities containing Web videos whose topics are similar to each other are extracted by using hyperlinks between Web pages including Web videos and their video features. Furthermore, we focus on graph structure of hyperlinks between Web pages including Web videos which belong to the Web communities. Then, by using strongly connected components and betweenness centrality of the graph, hierarchical structure of the Web communities can be estimated. Consequently, users can easily find Web videos including related topics in each hierarchy, and desired Web videos can be effectively retrieved.
• Insect classification using Scanning Electron Microphotographs considering magnifications

  Akihiro Takahashi, Takahiro Ogawa, Miki Haseyama

  2013 IEEE International Conference on Image Processing, ICIP 2013 - Proceedings 3269 - 3273 2013年 [査読有り][通常論文]
   

  This paper presents a method of insect classification using images taken by Scanning Electron Microscope (SEM) considering magnifications. Generally, when images of the same insects are taken by SEM with different magnifications, visual features of these images are different from each other. Thus, the proposed method adopts a new scheme which groups images of different magnifications in such a way that the classification performance becomes the highest. Then a classifier is constructed for each group, and the insect classification becomes feasible based on a target image magnification. In addition, by integrating the classification results of several images obtained from the same sample, i.e., the same insect, performance improvement of the insect classification considering magnifications can be realized. Experimental results show the effectiveness of the proposed method. © 2013 IEEE.
• SPECTRAL REFLECTANCE ESTIMATION FROM VISIBLE LIGHT COMPONENTS AND NEAR-INFRARED COMPONENTS

  Yuta Igarashi, Takahiro Ogawa, Miki Haseyama

  2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013) 2388 - 2392 2013年 [査読有り][通常論文]
   

  This paper presents a novel method for estimating a spectral reflectance from two kinds of input images: an image including both visible light components and near-infrared (NIR) components, and an image including only NIR components. From these input images, we estimate the spectral reflectance based on the Non-negative Matrix Factorization algorithm using spectral sensitivities of a digital camera. The estimated spectral reflectance enables several important applications. In this paper, the e ff ectiveness of the proposed method is verified by using the estimated spectral reflectance in the two image processing applications.
• KCFA-BASED MISSING AREA RESTORATION INCLUDING NEW PRIORITY ESTIMATION

  Takahiro Ogawa, Miki Haseyama

  2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013) 704 - 708 2013年 [査読有り][通常論文]
   

  A kernel cross-modal factor analysis (KCFA) based missing area restoration method including a new priority estimation scheme is presented in this paper. The proposed method estimates latent relationship between missing areas and their neighboring areas by deriving projection matrices minimizing their errors in the latent space based on KCFA. This latent relationship represented by the derived projection matrices is optimal for accurately restoring missing areas within the target image. Furthermore, the proposed method adopts a new priority estimation scheme which determines the restoration order of missing areas. Specifically, this priority is estimated based on the criterion representing the restoration performance derived from KCFA, and it enables adaptive selection of missing areas successfully restored by our method. Consequently, it becomes feasible to accurately perform the restoration of missing areas by using the proposed KCFA-based method. Experimental results show subjective and quantitative improvements of the proposed method over previously reported restoration methods.
• Trial Realization of Human-Centered Multimedia Navigation for Video Retrieval

  Miki Haseyama, Takahiro Ogawa

  INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION 29 2 96 - 109 2013年01月 [査読有り][通常論文]
   

  A trial realization of human-centered navigation for video retrieval is presented in this article. This system consists of the following functions: (a) multimodal analysis for collaborative use of multimedia data, (b) preference extraction for the system to adapt to users' individual demands, and (c) adaptive visualization for users to be guided to their desired contents. By using these functions, users can find their desired video contents more quickly and accurately than with the conventional retrieval schemes since our system can provide new pathways to the desired contents. Experimental results verify the effectiveness of the proposed system.
• A Review of Video Retrieval Based on Image and Video Semantic Understanding

  Miki Haseyama, Takahiro Ogawa, Nobuyuki Yagi

  ITE Transactions on Media Technology and Applications 1 1 2 - 9 2013年 [査読有り][通常論文]
   

  Research trends in new video retrieval based on image and video semantic understanding are presented in this paper. First, recent studies related to image and video semantic analysis are introduced to understand leading-edge multimedia retrieval technologies. Several works related to visualization interfaces for multimedia retrieval are also presented. Finally, trends in state-of-the-art studies and the future outlook are described.
• A Method for Improving SVM-based Image Classification Performance Based on a Target Object Detection Scheme

  Soh Yoshida, Hiroshi Okada, Takahiro Ogawa, Miki Haseyama

  ITE Transactions on Media Technology and Applications 1 3 237 - 243 2013年 [査読有り][通常論文]
   

  This paper presents a new method to improve performance of SVM-based classification, which contains a target object detection scheme. The proposed method tries to detect target objects from training images and improve the performance of the image classification by calculating the hyperplane from the detection results. Specifically, the proposed method calculates a Support Vector Machine (SVM) hyperplane, and detects rectangular areas surrounding the target objects based on the distances between their feature vectors and the separating hyperplane in the feature space. Then modification of feature vectors becomes feasible by removing features that exist only in background areas. Furthermore, a new hyperplane is calculated by using the modified feature vectors. Since the removed features are not part of the target object, they are not relevant to the learning process. Therefore, their removal can improve the performance of the image classification. Experimental results obtained by applying the proposed methods to several existing SVM-based classification method show its effectiveness.
• A Compressed Sensing-Based Low-Density Parity-Check Real-Number Code

  Zaixing He, Takahiro Ogawa, Miki Haseyama, Xinyue Zhao, Shuyou Zhang

  Radioengineering 22 3 851 - 860 2013年 [査読有り][通常論文]
   

  In this paper, we propose a novel low-density parity-check real-number code, based on compressed sensing. A real-valued message is encoded by a coding matrix (with more rows than columns) and transmitted over an erroneous channel, where sparse errors (impulsive noise) corrupt the codeword. In the decoding procedure, we apply a structured sparse (low-density) parity-check matrix, the Permuted Block Diagonal matrix, to the corrupted output, and the errors can be corrected by solving a compressed sensing problem. A compressed sensing algorithm, Cross Low-dimensional Pursuit, is used to decode the code by solving this compressed sensing problem. The proposed code has high error correction performance and decoding efficiency. The comparative experimental results demonstrate both advantages of our code. We also apply our code to cryptography.
• Novel Evaluation Criterion for Visualization of Image Search Results Based on Feature Integration Theory

  Katsuki Kobayashi, Takahiro Ogawa, Miki Haseyama

  ITE Transactions on Media Technology and Applications 1 4 333 - 342 2013年 [査読有り][通常論文]
   

  This paper presents a new evaluation criterion for visualization of image search results based on the feature integration theory. This criterion is derived by combining two elements, visual saliency on visualization and grouping degree of similar images. Visual saliency, which is calculated from the feature integration theory, on visualization of image search results enables representation of users' attention, which is closely related to the effectiveness of finding images. Furthermore, since users perceive similar images that are close to each other as one group, grouping degree of similar images enables evaluation of the effectiveness when users find images similar to a desired image. Therefore, by combining visual saliency on visualization and grouping degree of similar images, we can derive the novel criterion and evaluate the effectiveness of visualization of image search results.
• Performance of Spatial and Temporal Error Concealment Method for 3D DWT Video Coding in Packet Loss Channel

  Hirokazu Tanaka, Sunmi Kim, Takahiro Ogawa, Miki Haseyama

  IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES E95A 11 2015 - 2022 2012年11月 [査読有り][通常論文]
   

  A new spatial and temporal error concealment method for three-dimensional discrete wavelet transform (3D DWT) video coding is analyzed. 3D DWT video coding employing dispersive grouping (DG) and two-step error concealment is an efficient method in a packet loss channel [20], [21]. In the two-step error concealment method, the interpolations are only spatially applied however, higher efficiency of the interpolation can be expected by utilizing spatial and temporal similarities. In this paper, we propose an enhanced spatial and temporal error concealment method in order to achieve higher error concealment (EC) performance in packet loss networks. In the temporal error concealment method, structural similarity (SSIM) index is employed for inter group of pictures (GOP) EC and minimum mean square error (MMSE) is used for intra GOP EC. Experimental results show that the proposed method can obtain remarkable performance compared with the conventional methods.
• Optical Fast Circuit Switching Networks Employing Dynamic Waveband Tunnel

  Takahiro Ogawa, Hiroshi Hasegawa, Ken-ichi Sato

  IEICE TRANSACTIONS ON COMMUNICATIONS E95B 10 3139 - 3148 2012年10月 [査読有り][通常論文]
   

  We propose a novel dynamic hierarchical optical path network architecture that achieves efficient optical fast circuit switching. In order to complete wavelength path setup/teardown efficiently, the proposed network adaptively manages waveband paths and bundles of optical paths, which provide virtual mesh connectivity between node pairs for wavelength paths. Numerical experiments show that operational and facility costs are significantly reduced by employing the adaptive virtual waveband connections.
• A Novel Framework for Extracting Visual Feature-Based Keyword Relationships from an Image Database

  Marie Katsurai, Takahiro Ogawa, Miki Haseyama

  IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES E95A 5 927 - 937 2012年05月 [査読有り][通常論文]
   

  In this paper, a novel framework for extracting visual feature-based keyword relationships from an image database is proposed. From the characteristic that a set of relevant keywords tends to have common visual features, the keyword relationships in a target image database are extracted by using the following two steps. First, the relationship between each keyword and its corresponding visual features is modeled by using a classifier. This step enables detection of visual features related to each keyword. In the second step, the keyword relationships are extracted from the obtained results. Specifically, in order to measure the relevance between two keywords, the proposed method removes visual features related to one keyword from training images and monitors the performance of the classifier obtained for the other keyword. This measurement is the biggest difference from other conventional methods that focus on only keyword co-occurrences or visual similarities. Results of experiments conducted using an image database showed the effectiveness of the proposed method.
• A CROSS-MODAL APPROACH FOR EXTRACTING SEMANTIC RELATIONSHIPS OF CONCEPTS FROM AN IMAGE DATABASE

  Marie Katsurai, Takahiro Ogawa, Miki Haseyama

  2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) 2012 Vol.4 2373 - 2376 2012年 [査読有り][通常論文]
   

  This paper presents a cross-modal approach for extracting semantic relationships of concepts from an image database. First, canonical correlation analysis (CCA) is used to capture the cross-modal correlations between visual features and tag features in the database. Then, in order to measure inter-concept relationships and estimate semantic levels, the proposed method focuses on the distributions of images under the probabilistic interpretation of CCA. Results of experiments conducted by using an image database showed the improvement of the proposed method over existing methods.
• PERCEPTUALLY OPTIMIZED SUBSPACE ESTIMATION FOR MISSING TEXTURE RECONSTRUCTION

  Takahiro Ogawa, Miki Haseyama

  2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) 2012 Vol.2 1141 - 1144 2012年 [査読有り][通常論文]
   

  This paper presents a perceptually optimized subspace estimation method for missing texture reconstruction. The proposed method calculates the optimal subspace of known patches within a target image based on structural similarity (SSIM) index instead of calculating mean square error (MSE)-based eigenspace. Furthermore, from the obtained subspace, missing texture reconstruction whose results maximize the SSIM index is performed. In this approach, the non-convex maximization problem is reformulated as a quasi convex problem, and the reconstruction of the missing textures becomes feasible. Experimental results show that our method overcomes previously reported MSE-based reconstruction methods.
• SVDD を用いた顕微鏡画像からの新種深海底生物の検出及び分類体系上の位置の推定法

  長谷川尭史, 小川貴弘, 渡邉日出海, 長谷山美紀

  映像情報メディア学会誌(Web) 66 7 2012年 [査読有り][通常論文]
  
• Image Inpainting by Block-Based Linear Regression with Optimal Block Selection

  Akira Tanaka, Takahiro Ogawa, Miki Haseyama

  2012 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC) 1 - 4 2012年 [査読有り][通常論文]
   

  Estimation of missing entries in a multivariate data is one of classical problems in the field of statistical science. One of most popular approaches for this problem is linear regression based on the EM algorithm. When we consider to apply this approach to block-based image inpainting problems, we have additional information, that is, a target lost pixel could be included in multiple blocks, which implies that we have multiple candidates of estimates for the pixel. In such cases, we have to choose a good estimate among the multiple candidates. In this paper, we propose a novel image inpainting method incorporating optimal block selection in terms of the expected squared errors among multiple candidates of the estimate for the target pixel. Results of numerical examples are also shown to verify the efficacy of the proposed method.
• Missing Image Data Reconstruction Based on Adaptive Inverse Projection via Sparse Representation

  Takahiro Ogawa, Miki Haseyama

  IEEE TRANSACTIONS ON MULTIMEDIA 13 5 974 - 992 2011年10月 [査読有り][通常論文]
   

  In this paper, a missing image data reconstruction method based on an adaptive inverse projection via sparse representation is proposed. The proposed method utilizes sparse representation for obtaining low-dimensional subspaces that approximate target textures including missing areas. Then, by using the obtained low-dimensional subspaces, inverse projection for reconstructing missing areas can be derived to solve the problem of not being able to directly estimate missing intensities. Furthermore, in this approach, the proposed method monitors errors caused by the derived inverse projection, and the low-dimensional subspaces optimal for target textures are adaptively selected. Therefore, we can apply adaptive inverse projection via sparse representation to target missing textures, i.e., their adaptive reconstruction becomes feasible. The proposed method also introduces some schemes for color processing into the calculation of subspaces on the basis of sparse representation and attempts to avoid spurious color caused in the reconstruction results. Consequently, successful reconstruction of missing areas by the proposed method can be expected. Experimental results show impressive improvement of our reconstruction method over previously reported reconstruction methods.
• Cross Low-Dimension Pursuit for Sparse Signal Recovery from Incomplete Measurements Based on Permuted Block Diagonal Matrix

  Zaixing He, Takahiro Ogawa, Miki Haseyama

  IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES E94A 9 1793 - 1803 2011年09月 [査読有り][通常論文]
   

  In this paper, a novel algorithm, Cross Low-dimension Pursuit, based on a new structured sparse matrix, Permuted Block Diagonal (PBD) matrix, is proposed in order to recover sparse signals from incomplete linear measurements. The main idea of the proposed method is using the PBD matrix to convert a high-dimension sparse recovery problem into two (or more) groups of highly low-dimension problems and crossly recover the entries of the original signal from them in an iterative way. By sampling a sufficiently sparse signal with a PBD matrix, the proposed algorithm can recover it efficiently. It has the following advantages over conventional algorithms: (1) low complexity, i.e., the algorithm has linear complexity, which is much lower than that of existing algorithms including greedy algorithms such as Orthogonal Matching Pursuit and (2) high recovery ability, i.e., the proposed algorithm can recover much less sparse signals than even l(1)-norm minimization algorithms. Moreover, we demonstrate both theoretically and empirically that the proposed algorithm can reliably recover a sparse signal from highly incomplete measurements.
• Missing Intensity Interpolation Using a Kernel PCA-Based POCS Algorithm and its Applications

  Takahiro Ogawa, Miki Haseyama

  IEEE TRANSACTIONS ON IMAGE PROCESSING 20 2 417 - 432 2011年02月 [査読有り][通常論文]
   

  A missing intensity interpolation method using a kernel principal component analysis (PCA)-based projection onto convex sets (POCS) algorithm and its applications are presented in this paper. In order to interpolate missing intensities within a target image, the proposed method reconstructs local textures containing the missing pixels by using the POCS algorithm. In this reconstruction process, a nonlinear eigenspace is constructed from each kind of texture, and the optimal subspace for the target local texture is introduced into the constraint of the POCS algorithm. In the proposed method, the optimal subspace can be selected by monitoring errors converged in the reconstruction process. This approach provides a solution to the problem in conventional methods of not being able to effectively perform adaptive reconstruction of the target textures due to missing intensities, and successful interpolation of the missing intensities by the proposed method can be realized. Furthermore, since our method can restore any images including arbitrary-shaped missing areas, its potential in two image reconstruction tasks, image enlargement and missing area restoration, is also shown in this paper.
• ADAPTIVE KPCA-BASED MISSING TEXTURE RECONSTRUCTION APPROACH INCLUDING CLASSIFICATION SCHEME VIA DIFFERENCE SUBSPACES

  Takahiro Ogawa, Miki Haseyama

  2011 18TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) 1133 - 1136 2011年 [査読有り][通常論文]
   

  This paper presents an adaptive kernel principal component analysis (KPCA) based missing texture reconstruction approach including a classification scheme via difference subspaces. The proposed method utilizes a KPCA-based nonlinear eigenspace, which is obtained from each kind of known texture within a target image, as a constraint for reconstructing missing textures with a constraint of known neighboring areas. Then since these two constraints are convex, we can estimate missing textures based on a projection onto convex sets (POCS) algorithm. Furthermore, in this approach, the proposed method derives a new criterion for selecting the optimal eigenspace by monitoring errors caused in the projection via a difference subspace of each kind of known texture. This provides a solution to conventional problems of not being able to perform accurate texture classification, and the adaptive reconstruction of missing textures can be realized by the proposed method. Experimental results show subjective and quantitative improvement of the proposed method over previously reported reconstruction methods.
• LINEAR TIME DECODING OF REAL-FIELD CODES OVER HIGH ERROR RATE CHANNELS

  Zaixing He, Takahiro Ogawa, Miki Haseyama

  2011 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING 3172 - 3175 2011年 [査読有り][通常論文]
   

  This paper proposes a novel algorithm for decoding real-field codes over erroneous channels, where the encoded message is corrupted by sparse errors, i.e., impulsive noise. The main problem of decoding such a corrupted encoded message is to reconstruct the error vector; recently, a common way to reconstruct it is to find the sparsest solution to an underdetermined system that is constructed using a parity-check matrix. Unlike the conventional approaches reconstructing the high-dimensional error vector directly, the proposed method crossly recovers the elements of error vector from two (or several) groups of low-dimensional equations. Compared with the traditional algorithms, the proposed method can decode an encoded message with a much higher corruption rate. Furthermore, the complexity of our method is linear, which is much lower than those of the traditional methods. The experimental results verified the high error correction ability and speed of the proposed method.
• ADAPTIVE RECONSTRUCTION METHOD OF MISSING TEXTURES BASED ON PERCEPTUALLY OPTIMIZED ALGORITHM

  Takahiro Ogawa, Miki Haseyama

  2011 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING 2011 Vol.2 1157 - 1160 2011年 [査読有り][通常論文]
   

  This paper presents an adaptive reconstruction method of missing textures based on structural similarity (SSIM) index. The proposed method firstly performs SSIM-based selection of the optimal known local textures to adaptively obtain subspaces for reconstructing missing textures. Furthermore, from the selected known textures, the missing texture reconstruction maximizing the SSIM index is performed. In this approach, the non-convex maximization problem is reformulated as a quasi convex problem, and the adaptive reconstruction of the missing textures becomes feasible. Experimental results show impressive improvement of the proposed method over previously reported reconstruction methods.
• Adaptive example-based super-resolution using kernel PCA with a novel classification approach

  Takahiro Ogawa, Miki Haseyama

  EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING 2011 1 - 29 2011年 [査読有り][通常論文]
   

  An adaptive example-based super-resolution (SR) using kernel principal component analysis (PCA) with a novel classification approach is presented in this paper. In order to enable estimation of missing high-frequency components for each kind of texture in target low-resolution (LR) images, the proposed method performs clustering of high-resolution (HR) patches clipped from training HR images in advance. Based on two nonlinear eigenspaces, respectively, generated from HR patches and their corresponding low-frequency components in each cluster, an inverse map, which can estimate missing high-frequency components from only the known low-frequency components, is derived. Furthermore, by monitoring errors caused in the above estimation process, the proposed method enables adaptive selection of the optimal cluster for each target local patch, and this corresponds to the novel classification approach in our method. Then, by combining the above two approaches, the proposed method can adaptively estimate the missing high-frequency components, and successful reconstruction of the HR image is realized.
• Music recommendation according to human motion based on kernel CCA-based relationship

  Hiroyuki Ohkushi, Takahiro Ogawa, Miki Haseyama

  EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING 2011 121 - 121 2011年 [査読有り][通常論文]
   

  In this article, a method for recommendation of music pieces according to human motions based on their kernel canonical correlation analysis (CCA)-based relationship is proposed. In order to perform the recommendation between different types of multimedia data, i.e., recommendation of music pieces from human motions, the proposed method tries to estimate their relationship. Specifically, the correlation based on kernel CCA is calculated as the relationship in our method. Since human motions and music pieces have various time lengths, it is necessary to calculate the correlation between time series having different lengths. Therefore, new kernel functions for human motions and music pieces, which can provide similarities between data that have different time lengths, are introduced into the calculation of the kernel CCA-based correlation. This approach effectively provides a solution to the conventional problem of not being able to calculate the correlation from multimedia data that have various time lengths. Therefore, the proposed method can perform accurate recommendation of best matched music pieces according to a target human motion from the obtained correlation. Experimental results are shown to verify the performance of the proposed method.
• Adaptive Single Image Superresolution Approach Using Support Vector Data Description

  Takahiro Ogawa, Miki Haseyama

  EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING 2011 2011年 [査読有り][通常論文]
   

  An adaptive single image superresolution (SR) method using a support vector data description (SVDD) is presented. The proposed method represents the prior on high-resolution (HR) images by hyperspheres of the SVDD obtained from training examples and reconstructs HR images from low-resolution (LR) observations based on the following schemes. First, in order to perform accurate reconstruction of HR images containing various kinds of objects, training HR examples are previously clustered based on the distance from a center of a hypersphere obtained for each cluster. Furthermore, missing high-frequency components of the target image are estimated in order that the reconstructed HR image minimizes the above distances. In this approach, the minimized distance obtained for each cluster is utilized as a criterion to select the optimal hypersphere for estimating the high-frequency components. This approach provides a solution to the problem of conventional methods not being able to perform adaptive estimation of the high-frequency components. In addition, local patches in the target low-resolution (LR) image are utilized as the training HR examples from the characteristic of self-similarities between different resolution levels in general images, and our method can perform the SR without utilizing any other HR images.
• 固有空間BPLP法の補間精度に関する解析

  田中章, 小川貴弘, 長谷山美紀, 宮腰政明

  電子情報通信学会論文誌 A J94-A 2 2011年 [査読有り][通常論文]
  
• A Study on Adaptive Spatial-Temporal Error Concealment method for Wavelet based Video Coding in Wireless Networks

  KIM Sunmi, TANAKA Hirokazu, OGAWA Takahiro, HASEYAMA Miki

  映像情報メディア学会技術報告 35 165 - 170 一般社団法人 映像情報メディア学会 2011年 

  In this paper, we present an adaptive spatial-temporal error concealment method for the wavelet based video coding in wireless networks. A three-dimensional discrete wavelet transform (3-D DWT) is performed 2-D spatial DWT coding and temporal DWT coding on a group of pictures (GOP). The transmission of compressed video suffers from errors such as packet losses that not only corrupt frame but also propagate successive frames. The proposed adaptive spatial-temporal error concealment method consists of spatial EC and temporal EC to overcome error propagation problems. The proposed method is concealing erroneous coefficients of the spatiotemporal low-frequency subband by their duplication information, and uses the proposed adaptive spatial-temporal concealment method to recover errors for entire video sequence. The performance of proposed method was evaluated with wireless packet transmission networks. Experimental results show the proposed method can serve robust and stable performance in error-prone environments.
• Error-Resilient 3-D Wavelet Video Coding with Duplicated Lowest Sub-Band Coefficients and Two-Step Error Concealment Method

  Sunmi Kim, Hirokazu Tanaka, Takahiro Ogawa, Miki Haseyama

  IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES E93A 11 2173 - 2183 2010年11月 [査読有り][通常論文]
   

  In this paper we propose a two step error concealment algorithm based on an error resilient three dimensional discrete wavelet transform (3 D DWT) video coding scheme. The proposed scheme consists of an error resilient encoder duplicating the lowest sub band bit streams for dispersive grouped frames and an error concealment decoder. The error concealment method of this decoder is decomposed of two steps the first step is replacement of erroneous coefficients in the lowest sub band by the duplicated coefficients and the second step is interpolation of the missing wavelet coefficients by minimum mean square error (MMSE) estimation. The proposed scheme can achieve robust transmission over unreliable channels. Experimental results provide performance comparisons in terms of peak signal to noise ratio (PSNR) and demonstrate increased performances compared to state of the art error concealment schemes.
• ADAPTIVE RECONSTRUCTION METHOD OF MISSING TEXTURES BASED ON INVERSE PROJECTION VIA SPARSE REPRESENTATION

  Takahiro Ogawa, Miki Haseyama

  2010 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME 2010) 352 - 357 2010年 [査読有り][通常論文]
   

  This paper presents an adaptive reconstruction method of missing textures based on an inverse projection via sparse representation. The proposed method approximates original and corrupted textures in lower-dimensional subspaces by using the sparse representation technique. Then, this approach effectively solves problems of not being able to directly estimate an inverse projection for reconstructing missing textures. Furthermore, even if target textures contain missing areas, the proposed method enables adaptive generation of the subspaces by monitoring errors caused in their known neighboring textures by the estimated inverse projection. Consequently, since the optimal inverse projection is adaptively estimated for each texture, successful reconstruction of the missing areas can be expected. Experimental results show impressive improvement of the proposed reconstruction technique over previously reported reconstruction techniques.
• THE SIMPLEST MEASUREMENT MATRIX FOR COMPRESSED SENSING OF NATURAL IMAGES

  Zaixing He, Takahiro Ogawa, Miki Haseyama

  2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING 4301 - 4304 2010年 [査読有り][通常論文]
   

  There exist two main problems in currently existing measurement matrices for compressed sensing of natural images, the difficulty of hardware implementation and low sensing efficiency. In this paper, we present a novel simple and efficient measurement matrix, Binary Permuted Block Diagonal (BPBD) matrix. The BPBD matrix is binary and highly sparse (all but one or several "1"s in each column are "0"s). Therefore, it can simplify the compressed sensing procedure dramatically. The proposed measurement matrix has the following advantages, which cannot be entirely satisfied by existing measurement matrices. (1) It has easy hardware implementation because of the binary elements; (2) It has high sensing efficiency because of the highly sparse structure; (3) It is incoherent with different popular sparsity basis' like wavelet basis and gradient basis; (4) It provides fast and nearly optimal reconstructions. Moreover, the simulation results demonstrate the advantages of the proposed measurement matrix.
• Missing Texture Reconstruction Method Based on Perceptually Optimized Algorithm

  Takahiro Ogawa, Miki Haseyama

  EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING 2010 2010年 [査読有り][通常論文]
   

  This paper presents a simple and effective missing texture reconstruction method based on a perceptually optimized algorithm. The proposed method utilizes the structural similarity (SSIM) index as a new visual quality measure for reconstructing missing areas. Furthermore, in order to adaptively reconstruct target images containing several kinds of textures, the following two novel approaches are introduced into the SSIM-based reconstruction algorithm. First, the proposed method performs SSIM-based selection of the optimal known local textures to adaptively obtain subspaces for reconstructing missing textures. Secondly, missing texture reconstruction that maximizes the SSIM index in the known neighboring areas is performed. In this approach, the nonconvex maximization problem is reformulated as a quasi convex problem, and adaptive reconstruction of the missing textures based on the perceptually optimized algorithm becomes feasible. Experimental results show impressive improvements of the proposed method over previously reported reconstruction methods.
• Erratum: Error-Resilient 3-D Wavelet Video Coding with Duplicated Lowest Sub-Band Coefficients and Two-Step Error Concealment Method [IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences E93.A (2010) , No. 11 pp.2173-2183]

  KIM Sunmi, TANAKA Hirokazu, OGAWA Takahiro, HASEYAMA Miki

  IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences 93 12 2763_e1 - 2763_e1 The Institute of Electronics, Information and Communication Engineers 2010年
• A Novel Video Retrieval Method Based on Web Community Extraction Using Features of Video Materials

  Yasutaka Hatakeyama, Takahiro Ogawa, Satoshi Asamizu, Miki Haseyama

  IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES E92A 8 1961 - 1969 2009年08月 [査読有り][通常論文]
   

  A novel video retrieval method based on Web community extraction using audio and visual features and textual features of video materials is proposed in this paper. In this proposed method, canonical correlation analysis is applied to these three features calculated from video materials and their Web pages, and transformation of each feature into the same variate space is possible. The transformed variates are based on the relationships between visual, audio and textual features of video materials, and the similarity between video materials in the same feature space for each feature can be calculated. Next, the proposed method introduces the obtained similarities of video materials into the link relationship between their Web pages. Furthermore, by performing link analysis of the obtained weighted link relationship, this approach extracts Web communities including similar topics and provides the degree of attribution of video materials in each Web community for each feature. Therefore, by calculating similarities of the degrees of attribution between the Web communities extracted from the three kinds of features, the desired ones are automatically selected. Consequently, by monitoring the degrees of attribution of the obtained Web communities, the proposed method can perform effective video retrieval. Some experimental results obtained by applying the proposed method to video materials obtained from actual Web pages are shown to verify the effectiveness of the proposed method.
• Adaptive Missing Texture Reconstruction Method Based on Kernel Canonical Correlation Analysis with a New Clustering Scheme

  Takahiro Ogawa, Miki Haseyama

  IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES E92A 8 1950 - 1960 2009年08月 [査読有り][通常論文]
   

  In this paper, a method for adaptive reconstruction of missing textures based on kernel canonical correlation analysis (CCA) with a new clustering scheme is presented. The proposed method estimates the correlation between two areas, which respectively correspond to a missing area and its neighboring area, from known parts within the target image and realizes reconstruction of the missing texture. In order to obtain this correlation, the kernel CCA is applied to each cluster containing the same kind of textures, and the optimal result is selected for the target missing area. Specifically, a new approach monitoring errors caused in the above kernel CCA-based reconstruction process enables selection of the optimal result. This approach provides a solution to the problem in traditional methods of not being able to perform adaptive reconstruction of the target textures due to missing intensities. Consequently, all of the missing textures are successfully estimated by the optimal cluster's correlation, which provides accurate reconstruction of the same kinds of textures. In addition, the proposed method can obtain the correlation more accurately than our previous works, and more successful reconstruction performance can be expected. Experimental results show impressive improvement of the proposed reconstruction technique over previously reported reconstruction techniques.
• An ER Algorithm-Based Method for Removal of Adherent Water Drops from Images Obtained by a Rear View Camera Mounted on a Vehicle in Rainy Conditions

  Tomoki Hiramatsu, Takahiro Ogawa, Miki Haseyama

  IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES E92A 8 1939 - 1949 2009年08月 [査読有り][通常論文]
   

  In this paper, an ER (Error-Reduction) algorithm-based method for removal of adherent water drops from images obtained by a rear view camera mounted on a vehicle in rainy conditions is proposed. Since Fourier-domain and object-domain constraints are needed for any ER algorithm-based method, the proposed method introduces the following two novel constraints for the removal of adherent water drops. The first one is the Fourier-domain constraint that utilizes the Fourier transform magnitude of the previous frame in the obtained images as that of the target frame. Noting that images obtained by the rear view camera have the unique characteristics of objects moving like ripples because the rear view camera is generally composed of a fish-eye lens for a wide view angle, the proposed method assumes that the Fourier transform magnitudes of the target frame and the previous frame are the same in the polar coordinate system. The second constraint is the object-domain constraint that utilizes intensities in an area of the target frame to which water drops have adhered. Specifically, the proposed method models a deterioration process of intensities that are corrupted by the water drop adhering to the rear view camera lens. By utilizing these novel constraints, the proposed ER algorithm can remove adherent water drops from images obtained by the rear view camera. Experimental results that verify the performance of the proposed method are represented.
• Kalman Filter-Based Error Concealment for Video Transmission

  Shigeki Takahashi, Takahiro Ogawa, Hirokazu Tanaka, Miki Haseyama

  IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES E92A 3 779 - 787 2009年03月 [査読有り][通常論文]
   

  A novel error concealment method using a Kalman filter is presented ill this paper, In order to successfully utilize the Kalman filter, its state transition and observation models that are suitable for the video error concealment are newly defined as follows. The state transition model represents the video decoding process by a notion-compensated prediction. Furthermore, the new observation model that represents all image blurring process is defined. and calculation of the Kalman gain becomes possible. The problem of the traditional methods is solved by using the Kalman filter in the proposed method, and accurate reconstruction of corrupted video frames, is achieved. Consequently. an effective error concealment method using the Kalman filter is realized. Experimental results showed that the proposed method has better performance than that of traditional methods.
• A Kalman Filter-Based Method for Restoration of Images Obtained by an In-Vehicle Camera in Foggy Conditions

  Tomoki Hiramatsu, Takahiro Ogawa, Miki Haseyama

  IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES E92A 2 577 - 584 2009年02月 [査読有り][通常論文]
   

  In this paper, a Kalman filter-based method for restoration of video images acquired by an in-vehicle camera in foggy conditions is proposed. In order to realize Kalman filter-based restoration, the proposed method clips local blocks from the target frame by using a sliding window and regards the intensities in each block as elements of the state variable of the Kalman filter. Furthermore, the proposed method designs the following two models for restoration of foggy images. The first one is an observation model, which represents a fog deterioration model. The proposed method automatically determines all parameters of the fog deterioration model from only the foggy images to design the observation model. The second one is a non-linear state transition model, which represents the target frame in the original video image from its previous frame based on motion vectors. By utilizing the observation and state transition models, the correlation between successive frames can be effectively utilized for restoration, and accurate restoration of images obtained in foggy conditions can be achieved. Experimental results show that the proposed method has better performance than that of the traditional method based on the fog deterioration model.
• A WEB COMMUNITY-BASED VIDEO RETRIEVAL METHOD USING CANONICAL CORRELATION ANALYSIS

  Yasutaka Hatakeyama, Takahiro Ogawa, Satoshi Asamizu, Miki Haseyama

  2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6 805 - + 2009年 [査読有り][通常論文]
   

  This paper presents a Web community-based video retrieval method using canonical correlation analysis (CCA). In the proposed method, two novel approaches are introduced into the retrieval scheme of video materials on the Web. First, the CCA is applied to three kinds of video features, visual and audio features of video materials and textual features obtained from Web pages containing those video materials. This approach provides a solution of problems of traditional methods of not being able to calculate similarities between different kinds of video features. Furthermore, from the obtained similarities and link relationships of Web pages, a new adjacency matrix is defined, and link analysis can be applied to this matrix. Then, the Web communities of the video materials whose topics are similar to each other can be automatically extracted based on their features. Therefore, by ranking the video materials in the obtained Web community, accurate video retrieval can be realized.
• ADAPTIVE RECONSTRUCTION METHOD OF MISSING TEXTURES BASED ON KERNEL CANONICAL CORRELATION ANALYSIS

  Takahiro Ogawa, Miki Haseyama

  2009 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS 1- 8, PROCEEDINGS 1165 - 1168 2009年 [査読有り][通常論文]
   

  This paper presents an adaptive reconstruction method of missing textures based on kernel canonical correlation analysis (CCA). The proposed method calculates the correlation between two areas, which respectively correspond to a missing area and its neighbor area, from known parts within the target image and realizes the estimation of the missing textures. In order to obtain this correlation, the kernel CCA is applied to each set containing the same kind of textures, and the optimal result is selected for the target missing area. Specifically, a new approach monitoring errors caused in the above estimation process enables the selection of the optimal result. This approach provides a solution to the problem in traditional methods of not being able to perform adaptive reconstruction of the target textures due to the missing intensities. Experimental results show subjective and quantitative improvement of the proposed reconstruction technique over previously reported reconstruction techniques.
• AN EFFECTIVE FLOW ESTIMATION METHOD WITH PARTICLE FILTER BASED ON HELMHOLTZ DECOMPOSITION THEOREM

  Norihiro Kakukou, Takahiro Ogawa, Miki Haseyaam

  2009 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS 1- 8, PROCEEDINGS 949 - 952 2009年 [査読有り][通常論文]
   

  This paper proposes a novel flow estimation method with a particle filter based on a Helmholtz decomposition theorem. The proposed method extends a model of the Helmholtz decomposition theorem and enables the decomposition of flows into rotational, divergent, and translational components. From the extended model, the proposed method defines a state transition model and an observation model of the particle filter. Furthermore, the proposed method derives an observation density of the particle filter from an energy function based on the Helmholtz decomposition theorem. By utilizing these novel approaches, the proposed method provides a solution to the problem in the traditional ones of not being able to realize an effective flow estimation with the particle filter based on rotation, divergence, and translation, which are important geometric features. Consequently, the proposed method can accurately estimate the flows.
• エッジの連続性を考慮したIFSによる画像の拡大

  覚幸典弘, 小川貴弘, 長谷山美紀

  電子情報通信学会論文誌 D J92-D 3 2009年 [査読有り][通常論文]
  
• Semantic Image Retrieval Based on POCS Algorithm Using Kernel PCA And Its Performance Verification

  Takahiro Ogawa, Miki Haseyama

  ISCE: 2009 IEEE 13TH INTERNATIONAL SYMPOSIUM ON CONSUMER ELECTRONICS, VOLS 1 AND 2 342 - 343 2009年 [査読有り][通常論文]
   

  This paper presents a projection onto convex sets (POCS)-based semantic image retrieval method and its performance verification. The main contributions of the proposed method are twofold: introduction of nonlinear eigenspace of visual and semantic features into the constraint of the POCS-based semantic image retrieval algorithm and adaptive selection of the annotated images utilized for this algorithm. Then, by combining these two approaches., the semantic features of the query image are successfully estimated, and accurate image retrieval can be expected. Finally, relationship between the performance of the proposed method and the kinds of the kernel functions utilized for the kernel PICA is shown in this paper.
• POCS-based annotation method using kernel PCA for semantic image retrieval

  Takahiro Ogawa, Miki Haseyama

  IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES E91A 8 1915 - 1923 2008年08月 [査読有り][通常論文]
   

  A projection onto convex sets (POCS)-based annotation method for semantic image retrieval is presented in this paper. Utilizing database images previously annotated by keywords, the proposed method estimates unknown semantic features of a query image from its known visual features based on a POCS algorithm, which includes two novel approaches. First, the proposed method semantically assigns database images to some clusters and introduces a nonlinear eigenspace of visual and semantic features in each cluster into the constraint of the POCS algorithm. This approach accurately provides semantic features for each cluster by using its visual features in the least squares sense. Furthermore, the proposed method monitors the error converged by the POCS algorithm in order to select the optimal cluster including the query image. By introducing the above two approaches into the POCS algorithm, the unknown semantic features of the query image are successfully estimated from its known visual features. Consequently, similar images can be easily retrieved from the database based on the obtained semantic features. Experimental results verify the effectiveness of the proposed method for semantic image retrieval.
• A KALMAN FILTER-BASED APPROACH FOR ADAPTIVE RESTORATION OF IN-VEHICLE CAMERA FOGGY IMAGES

  Tomoki Hiramatsu, Takahiro Ogawa, Miki Haseyama

  2008 15TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-5 3160 - 3163 2008年 [査読有り][通常論文]
   

  In this paper, a Kalman filter-based approach for adaptive restoration of video images acquired by an in-vehicle camera in foggy conditions is proposed. In order to realize Kalman filter-based restoration, the proposed method regards the intensities in each frame as elements of the state variable of the Kalman filter and designs the following two models for restoration of foggy images. The first one is an observation model, which represents a fog deterioration model. The second one is a non-linear state transition model, which represents the target frame in the original video image from its previous frame based on motion vectors. By utilizing the observation and state transition models, the correlation between successive frames can be effectively utilized for restoration. Further, the proposed method introduces a new estimation scheme of the parameter, which determines the deterioration characteristic in foggy conditions, into the Kalman filter algorithm. Consequently, since automatic determination of the fog deterioration model, which specifies the observation model, from only the foggy images is realized, the accurate restoration can be achieved. Experimental results show that the proposed method has better performance than that of the traditional method based on the fog deterioration model.
• AN EFFECTIVE DETECTION METHOD OF ROTATIONAL AND DIVERGENT STRUCTURES IN STILL IMAGES BASED ON HELMHOLTZ DECOMPOSITION

  Norihiro Kakukou, Takahiro Ogawa, Miki Haseyama

  2008 15TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-5 2336 - 2339 2008年 [査読有り][通常論文]
   

  This paper proposes a novel detection method of rotational and divergent structures in still images based on Helmholtz decomposition. These structures are mathematical features in vector analysis. Traditionally, some detection methods of these structures in image sequences have been proposed. By using the Helmholtz decomposition, which can decompose flows into rotational and divergent components, the traditional methods can detect these structures in image sequences. However, the rotational and divergent structures in still images cannot be detected with the traditional methods. Therefore, the proposed method introduces a new criterion into the traditional schemes in order to realize the detection of the rotational and divergent structures in still images. This criterion is derived from two properties based on relation between still images and the flows, which are composed of the rotational and divergent components. Consequently, the detection of the rotational and divergent structures in still images can be achieved.
• KERNEL PCA-BASED SEMANTIC FEATURE ESTIMATION APPROACH FOR SIMILAR IMAGE RETRIEVAL

  Takahiro Ogawa, Miki Haseyama

  2008 15TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-5 965 - 968 2008年 [査読有り][通常論文]
   

  A kernel PCA-based semantic feature estimation approach for similar image retrieval is presented in this paper. Utilizing database images previously annotated by keywords, the proposed method estimates unknown semantic features of a query image. First, our method performs semantic clustering of the database images and derives a new map from a nonlinear eigenspace of visual and semantic features in each cluster. This map accurately provides the semantic features for the images belonging to each cluster by using their visual features. Further, in order to select the optimal cluster including the query image, the proposed method monitors errors of the visual features caused by the semantic feature estimation process. Then, even if any semantics of the query image are unknown, its semantic features are successfully estimated by the optimal cluster. Experimental results verify the effectiveness of the proposed method for semantic image retrieval.
• KERNEL PCA-BASED SEMANTIC FEATURE ESTIMATION APPROACH FOR SIMILAR IMAGE RETRIEVAL

  Takahiro Ogawa, Miki Haseyama

  2008 IEEE International Conference on Image Processing, Proceedings 969 - 972 2008年 [査読有り][通常論文]
   

  A kernel PCA-based semantic feature estimation approach for similar image retrieval is presented in this paper. Utilizing database images previously annotated by keywords, tire proposed method estimates unknown semantic features of a query image. First, our method performs semantic clustering of the database images and derives a new map from a nonlinear eigenspace of visual and semantic features in each c aster. This map accurately provides the semantic features for the images belonging to each cluster by using their visual features. Further, in order to select the optional cluster including the query image, the proposed method monitors errors of the visual features caused by the Semantic feature estimation process. Then, even if any semantics of the query image arc unknown, its semantic features are successfully estimated by tire optimal cluster. Experimental results verify the effectiveness of the proposed method for semantic image retrieval.
• Image recognition method using intensity gradient vectors

  Masao Hiramoto, Takahiro Ogawa, Miki Haseyama

  Systems and Computers in Japan 38 13 15 - 27 2007年11月30日 [査読有り][通常論文]
   

  This paper proposes a method for general image recognition based on the progress of increasing the pixels of image sensors and improving image quality. This method can also adapt to images which have undergone geometric transformations such as the rotation and movement of images. The proposed method uses a voting system that utilizes vectors. This method uses vectors which represent intensity gradients and vectors which show position to express images and also defines voting vectors and similarity for the recognition. In addition, the proposed method has characteristics of concentrating voting locations at an origin point if there are identical images such that the voting results do not influence geometric transformations. When we performed experiments on natural images including original images which may have undergone image processing such as Gaussian or median filtering and JPEG compression, we understood that distinct differences appeared in the similarities and that recognition was possible even if an artificial process was added to the images. Even further, when we examined recognition of images using the greatest number of voting points as an application of this method, we were able to show that the recognition capability was high and that a partial image contained in one image could also be recognized. © 2007 Wiley Periodicals, Inc.
• POCS-Based texture reconstruction method using clustering scheme by kernel PCA

  Takahiro Ogawa, Milki Haseyama

  IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES E90A 8 1519 - 1527 2007年08月 [査読有り][通常論文]
   

  A new framework for reconstruction of missing textures in digital images is introduced in this paper. The framework is based on a projection onto convex sets (POCS) algorithm including a novel constraint. In the proposed method, a nonlinear eigenspace of each cluster obtained by classification of known textures within the target image is applied to the constraint. The main advantage of this approach is that the eigenspace can approximate the textures classified into the same cluster in the least-squares sense. Furthermore, by monitoring the errors converged by the POCS algorithm, a selection of the optimal cluster to reconstruct the target texture including missing intensities can be achieved. This POCS-based approach provides a solution to the problem in traditional methods of not being able to perform the selection of the optimal cluster due to the missing intensities within the target texture. Consequently, all of the missing textures are successfully reconstructed by the selected cluster's eigenspaces which correctly approximate the same kinds of textures. Experimental results show subjective and quantitative improvement of the proposed reconstruction technique over previously reported reconstruction techniques.
• POCS-based iterative reconstruction algorithm of missing textures

  Takahiro Ogawa, Miki Haseyama

  2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7 3 1229 - 1232 2007年 [査読有り][通常論文]
   

  In this paper, a new framework for texture reconstruction of missing areas, which exist all over the target image, is presented. The framework is based on a projection onto convex sets (POCS) algorithm including a novel constraint. In the proposed method, a nonlinear eigenspace of each cluster obtained by texture classification is applied to the constraint. Furthermore, by monitoring the errors converged by the POCS algorithm, selection of the optimal cluster for the target texture including missing intensities is realized in order to reconstruct it adaptively. Then, iterating the POCS-based procedures, our method renews the nonlinear eigenspaces and the reconstruction image, and outputs the reliable result. This approach provides a solution to the problem in traditional methods of not being able to perform adaptive reconstruction of the target textures due to the missing intensities. Experimental results show subjective and quantitative improvement of the proposed reconstruction technique over previously reported reconstruction techniques.
• Adaptive reconstruction method of missing texture based on projection onto convex sets

  Takahiro Ogawa, Miki Haseyama

  2007 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL I, PTS 1-3, PROCEEDINGS 1 697 - 700 2007年 [査読有り][通常論文]
   

  This paper presents a missing texture reconstruction method based on projection onto convex sets (POCS). The proposed method classifies textures within the target image into some clusters in a high-dimensional texture feature space. Further, for the target missing texture, our method performs a novel approach, that monitors the errors caused by the POCS algorithm in the feature space, and adaptively selects the optimal cluster including similar textures. Then, the missing texture is restored from these similar textures by a new POCS-based nonlinear subspace projection scheme. Consequently, since the proposed method realizes the nonconventional adaptive technique using the optimal nonlinear subspace, the accurate restoration result can be obtained. Experimental results show that our method achieves higher performance than the traditional method.
• Restoration of missing intensity of still images by using optical flow

  Takahiro Ogawa, Miki Haseyama, Hideo Kitajima

  Systems and Computers in Japan 37 3 49 - 57 2006年03月 [査読有り][通常論文]
   

  This paper proposes an accurate method for the restoration of missing intensities of still images by using the optical flow. It is important in restoration to reconstruct missing edges correctly. Therefore, this paper modifies the optical flow conventionally used for motion analysis in video images and applies it to the restoration of missing intensities. Further, the proposed method introduces a new index expressing the correlation of intensities between two pixels into the scheme for calculation of the optical flow in order to obtain a flow which gives more accurate estimated values. The optical flow calculated by this index provides the pixel from the neighborhood whose intensity is most similar to that of the target pixel, so that the estimated intensity is not affected by pixels whose intensities are quite different. Consequently, even when multiple edges pass through the missing area or the direction of the edge changes significantly inside the area, the proposed method can reconstruct the edges correctly. Some experimental results are presented in order to verify the high performance of the proposed method. © 2006 Wiley Periodicals, Inc.
• An accurate ifs-based image enlargement method using line process

  Norihiro Kakukou, Takahiro Ogawa, Miki Haseyama, Hideo Kitajima

  2006 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP 2006, PROCEEDINGS 2701 - + 2006年 [査読有り][通常論文]
   

  This paper proposes an effective image enlargement method based on an Iterated Function System(IFS), which is traditionally used for image coding. The IFS can reconstruct an image of a different size from the coding target image's. Based on this property, some methods enlarging images have been proposed by using the IFS. However, the images enlarged by the traditional methods suffer from block noise and edge discontinuity in the boundary between neighboring range blocks, which are units of the process in the IFS. The reasons for the problems of the traditional methods are that they use non-overlapping range blocks and do not consider edge continuity in the boundary between the neighboring range blocks. Therefore, the proposed method allows selection of overlapping range blocks in order to avoid the block noise. Further, the proposed method introduces a line process, which is used for edge detection, into the enlargement procedure. The edges obtained by using the line process can retain the edge continuity. Therefore, the images enlarged by the proposed method retain the edge continuity. Consequently, an accurate image enlargement can be achieved.
• Restoration method of missing areas in still images using GMRF model

  T Ogawa, M Haseyama, H Kitajima

  2005 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), VOLS 1-6, CONFERENCE PROCEEDINGS 4931 - 4934 2005年 [査読有り][通常論文]
   

  This paper proposes a GMRF-model based restoration method of missing areas in still images. The GMRF model used in the proposed method is realized by a new assumption that reasonably holds for an image source. This model can express important image features such as edges because of the use of the new assumption. Therefore, the proposed method restores the missing areas using the modified GMRF model and can correctly reconstruct the missing edges. Consequently, the proposed method achieves more accurate restoration than those of the traditional methods on both objective and subjective measures. Extensive experimental results demonstrate the improvement of the proposed method over the previous methods.
• Reconstruction method of missing texture using error reduction algorithm

  T Ogawa, M Haseyama, H Kitajima

  2005 International Conference on Image Processing (ICIP), Vols 1-5 2 1389 - 1392 2005年 [査読有り][通常論文]
   

  This paper presents a novel reconstruction method of missing textures using an error reduction algorithm which is one of phase retrieval methods. The proposed method estimates the Fourier transform magnitude of the missing area from another area whose texture is similar in the obtained image. In order to realize this, a novel approach that monitors the errors caused by the error reduction algorithm is introduced into the selection scheme of the similar texture. Further, the proposed method estimates the phase of the target area by using the error reduction algorithm modified for the texture reconstruction and can restore the missing area accurately. Some experimental results show that the proposed method achieves more accurate restoration than that of the traditional methods.
• Influence of Music Listening on the Cerebral Activity by Analyzing EEG.

  Takahiro Ogawa, Satomi Ota, Shin-Ichi Ito, Yasue Mitsukura, Minoru Fukumi, Norio Akamatsu

  Knowledge-Based Intelligent Information and Engineering Systems 657 - 663 2005年
• Restoration method of missing areas in still images using GMRF model

  Takahiro Ogawa, Miki Haseyama, Hideo Kitajima

  Proceedings - IEEE International Symposium on Circuits and Systems 4931 - 4934 2005年 [査読有り][通常論文]
   

  This paper proposes a GMRF-model based restoration method of missing areas in still images. The GMRF model used in the proposed method is realized by a new assumption that reasonably holds for an image source. This model can express important image features such as edges because of the use of the new assumption. Therefore, the proposed method restores the missing areas using the modified GMRF model and can correctly reconstruct the missing edges. Consequently, the proposed method achieves more accurate restoration than those of the traditional methods on both objective and subjective measures. Extensive experimental results demonstrate the improvement of the proposed method over the previous methods. © 2005 IEEE.
• A novel image recognition method based on feature-extraction vector scheme

  M Hiramoto, T Ogawa, M Haseyama

  ICIP: 2004 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1- 5 2 3049 - 3052 2004年 [査読有り][通常論文]
   

  This paper introduces a method for recognizing images using a new approach to expressing images as vectors. Using this expression method, an image is constructed from 2 types of vectors - vectors indicating positions and vectors denoting intensity gradients for those positions. When investigating the amount of difference between two images, similarities are evaluated by calculating voting densities in the image space, using the vectors making up the sample image in relation to the vectors expressing the reference image. The expression proposed is invariant to image rotation and by changing the resolution hierarchically, recognition using this expression is also adaptable to perspective and detail. Using this method, we carried out experimentation recognizing representative images from various fields and the results show that the method is effective in discriminating between them.
• Kalman Filter-Based Error Concealment for Video Ttansmission

  [査読有り][通常論文]
  
• オプティカルフローを用いた静止画像における失われた輝度値の復元

  [査読有り][通常論文]
  
• 輝度勾配ベクトルを用いた画像識別方法

  [査読有り][通常論文]
  
• GMRFモデルを用いた静止画像における失われた輝度値の復元

  [査読有り][通常論文]
  
• 携帯電話を用いた救急救命のための情報提供システム

  [査読有り][通常論文]
  

その他活動・業績

• 画像の感情推定のためのラベル逆量子化を導入した正準相関分析

  斉藤直輝, 前田圭介, 小川貴弘, 浅水仁, 長谷山美紀 電子情報通信学会論文誌 D(Web) J106-D (5) 2023年
• 属性情報の階層関係を考慮したアニメイラストのマルチラベル分類に関する検討

  LAM Ziwen, 前田圭介, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 47 (6(MMS2023 1-34/ME2023 21-54/AIT2023 1-34)) 2023年
• データベース特化型クロスモーダル画像検索のためのテキストプロンプトチューニングに関する検討

  ZHANG Huaying, 柳凛太郎, 藤後廉, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 47 (6(MMS2023 1-34/ME2023 21-54/AIT2023 1-34)) 2023年
• 360度映像におけるマルチビュー学習に基づくバイノーラル音声生成の高精度化に関する検討

  吉田将規, 藤後廉, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 47 (6(MMS2023 1-34/ME2023 21-54/AIT2023 1-34)) 2023年
• クラス情報を導入したグラフ表現による教師有り潜在変数モデルの高精度化に関する検討

  渡部航史, 前田圭介, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 47 (6(MMS2023 1-34/ME2023 21-54/AIT2023 1-34)) 2023年
• ユーザの視線情報を考慮したコンテンツベースの画像再検索に関する検討

  FENG Yuhu, 前田圭介, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 47 (6(MMS2023 1-34/ME2023 21-54/AIT2023 1-34)) 2023年
• サッカー映像における時空間的関係を考慮したシュート予測の高精度化に関する検討-競技者のチーム情報に基づく完全二部グラフの導入-

  五箇亮太, 諸戸祐哉, 前田圭介, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 47 (6(MMS2023 1-34/ME2023 21-54/AIT2023 1-34)) 2023年
• 物体検出モデルに基づく視覚表現を用いた解釈可能なVisual Question Answeringモデルに関する検討

  ZHU He, 藤後廉, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 47 (6(MMS2023 1-34/ME2023 21-54/AIT2023 1-34)) 2023年
• AI研究の動向と最先端データ駆動型研究~次世代インフラ維持管理・防災・減災に向けた産学官・地域連携による取組~

  小川貴弘 寒地土木技術研究 (842) 2023年
• 知識蒸留を用いたFew-shot Learningに基づく画像の感情ラベル推定に関する検討—A Note on Visual Sentiment Prediction Based on Few-shot Learning Using Knowledge Distillation—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  叶 穎睿, 諸戸 祐哉, 前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 46 (6) 171 -175 2022年02月
• Variational Autoencoderに基づく深層生成モデルを用いた潜在表現のDisentanglementに関する検討 : Disentanglement評価指標を含む正則化損失の導入—A Note on Disentanglement Using Deep Generative Model Based on Variational Autoencoder : Introduction of Regularization Losses Based on Metrics of Disentangled Representation—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  中川 真, 藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 46 (6) 97 -102 2022年02月
• Captioning特徴を利用したグラフ畳み込みネットワークに基づくアニメイラストのマルチラベル画像分類に関する検討—A Note on Multi-label Image Recognition in Anime Illustration Based on Graph Convolutional Networks Using Captioning Features—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  蘭 子文, 前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 46 (6) 161 -165 2022年02月
• ゴム材料開発のためのGenerative Adversarial Networkに基づく配合量および物性からの電子顕微鏡画像の生成に関する一検討—A Note on Electron Microscope Image Generation from Mix Proportion and Material Property via Generative Adversarial Network for Rubber Materials—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  柳 凛太郎, 藤後 廉, 前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 46 (6) 187 -191 2022年02月
• セマンティックセグメンテーションに対するマルチソースモデル適応に関する検討 : 複数のソースモデルからの不変な特徴表現の学習による適応精度の向上—A note on multi-source model adaptation for semantic segmentation : Improving adaptation performance by learning model-invariant representation from multiple source models—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  李 宗曜, 藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 46 (6) 37 -41 2022年02月
• 地下鉄トンネル点検時の技術者から取得される生体信号と技術者の点検行動の関連性分析—Relevance Analysis between Bio-signals of Engineers Inspecting Subway Tunnels and Their Inspection Behaviors—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  平澤 魁人, 前田 圭介, 藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 46 (6) 365 -370 2022年02月
• 高速道路の遮音壁画像を用いた物体検出手法による変状分類の高精度化に関する検討—A note on improvement of distress classification using noise barrier images on highway via object detection method—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  梁 鋆, 前田 圭介, 藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 46 (6) 359 -363 2022年02月
• 道路構造物の維持管理効率化に向けた変状画像分類の高精度化に関する検討 : テキストデータに基づく類似事例の含有率の導入—A Note on Improvement of Accuracy in Classification of Destress Images for Efficient Inspection of Road Structures : Introduction of Ratio of Similar Cases Based on Text Data—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  平川 泰成, 小川 直輝, 前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 46 (6) 43 -48 2022年02月
• 地下鉄トンネルの維持管理支援のためのマルチスケール解析を導入した深層学習に基づく変状検出に関する検討—A Note on Distress Detection Based on Deep Learning with Hierarchical Multi-Scale Attention Mechanism for Supporting Maintenance of Subway Tunnels—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  高田 紗弥, 前田 圭介, 藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 46 (6) 377 -381 2022年02月
• A Note on Automatic Diagnosis of Helicobacter Pylori Infection Based on Self-Supervised Learning and Self-Knowledge Distillation: マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  トウゴ レン, マベ カツヒロ, ニシダ シュンペイ, トモダ ヨシヒロ, オガワ タカヒロ, ハセヤマ ミキ 46 (6) 49 -52 2022年02月
• A Note on Realizing Adversarial Defense Based on Regularization of Multi-stage Squeeze-and-Excitation Features: マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  マエダ ケイスケ, オガワ タカヒロ, ハセヤマ ミキ 46 (6) 87 -90 2022年02月
• ユーザの動作情報を用いたコンテンツの関心度推定に関する検討 : 複数ユーザを導入した特徴統合の有効性検証—A Note on Interest level Estimation Using Users' behavior Information : Validating the Effectiveness of Feature Integration with Multiple Users—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  上川 恭平, 前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 46 (6) 103 -107 2022年02月
• 画像注視時の脳活動信号を用いた圧縮再構成ネットワークに基づく視覚認知内容の推定に関する検討—A Note on Perceived Visual Content Estimation Based on Compressed Reconstruction Network Using Brain Signals While Gazing on Images—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  東 孝明, 前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 46 (6) 349 -353 2022年02月
• Attention mapに対する確信度を考慮可能な深層学習を用いた変状分類の高精度化に関する検討—A Note on Accurate Distress Classification Using Deep Learning Considering Confidence in Attention map—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  小川 直輝, 前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 46 (6) 371 -376 2022年02月
• A Note on Transformer-based Scene Recognition in Soccer Videos Using Different Lengths of Clips: マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  トウゴ レン, オガワ タカヒロ, ハセヤマ ミキ 46 (6) 167 -170 2022年02月
• 画像中の物体情報を考慮したユーザ類似度に基づく個人に特化した注視領域の推定に関する検討—A Note on Personalized Saliency Prediction Based on User Similarity Considering Object Information in Images—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  諸戸 祐哉, 前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 46 (6) 181 -186 2022年02月
• 橋梁点検時の技術者の一人称および三人称視点映像を用いた点検動作の分類に関する検討—A Note on Inspection Action Classification Using First and Third Person Video of Engineers Inspecting Bridges—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  増田 毅, 前田 圭介, 藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 46 (6) 177 -180 2022年02月
• ユーザの嗜好を考慮した強化学習と知識グラフに基づく楽曲プレイリスト生成に関する検討—A Note on User Preference-Aware Music Playlist Generation Based on Reinforcement Learning and Knowledge Graph—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  櫻井 慶悟, 藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 46 (6) 109 -112 2022年02月
• セマンティックセグメンテーションに対するマルチソースモデル適応に関する検討-複数のソースモデルからの不変な特徴表現の学習による適応精度の向上-

  LI Zongyao, 藤後廉, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 46 (6(MMS2022 1-37/ME2022 26-62/AIT2022 1-37)) 2022年
• ユーザの嗜好を考慮した強化学習と知識グラフに基づく楽曲プレイリスト生成に関する検討

  櫻井慶悟, 藤後廉, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 46 (6(MMS2022 1-37/ME2022 26-62/AIT2022 1-37)) 2022年
• Variational Autoencoderに基づく深層生成モデルを用いた潜在表現のDisentanglementに関する検討-Disentanglement評価指標を含む正則化損失の導入-

  中川真, 藤後廉, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 46 (6(MMS2022 1-37/ME2022 26-62/AIT2022 1-37)) 2022年
• 異分野連携によるデータ駆動型のAI研究に関する取組み

  小川貴弘 Imaging Conference Japan論文集 2022 2022年
• 協調フィルタリングにおける潜在因子モデルの埋め込み表現と人気バイアスの関係の検討

  岡村洋希, 前田圭介, 藤後廉, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2022 2022年
• ドメイン共有ネットワークに基づく嗜好のドメイン依存性に頑健な推薦システムに関する検討

  山本一輝, 前田圭介, 藤後廉, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2022 2022年
• pixelNeRFによる生成画像を用いた視点の変化に頑健な画像検索手法に関する検討

  江良勇輝, 藤後廉, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2022 2022年
• フーリエ振幅成分を考慮したNeural Radiance Fieldsのノンリファレンス評価指標に関する検討

  河合雅斗, 柳凛太郎, 藤後廉, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2022 2022年
• サッカー競技のスカウティング映像における選手間の時空間的関係を考慮した不確実性に基づくシュートイベント予測に関する検討

  五箇亮太, 諸戸祐哉, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2022 2022年
• 画像注視時の脳活動データを用いたVQAモデルに基づく認知内容推定に関する検討-fMRIデコーダに用いる回帰モデルによる推定精度に関する検証-

  七田亮, 藤後廉, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2022 2022年
• 眼底画像を用いた教師なしドメイン適応に基づく糖尿病性網膜症の重症度の推定に関する検討

  國枝翼, 藤後廉, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2022 2022年
• ゴム材料開発のためのGenerative Adversarial Networkに基づく配合量および物性からの電子顕微鏡画像の生成に関する一検討

  柳凜太郎, 藤後廉, 前田圭介, 前田圭介, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 46 (6(MMS2022 1-37/ME2022 26-62/AIT2022 1-37)) 2022年
• 道路構造物の維持管理効率化に向けた変状画像分類の高精度化に関する検討-テキストデータに基づく類似事例の含有率の導入-

  平川泰成, 小川直輝, 前田圭介, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 46 (6(MMS2022 1-37/ME2022 26-62/AIT2022 1-37)) 2022年
• 地下鉄トンネルの維持管理支援のためのマルチスケール解析を導入した深層学習に基づく変状検出に関する検討

  高田紗弥, 前田圭介, 藤後廉, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 46 (6(MMS2022 1-37/ME2022 26-62/AIT2022 1-37)) 2022年
• 画像注視時の脳活動信号を用いた圧縮再構成ネットワークに基づく視覚認知内容の推定に関する検討

  東孝明, 前田圭介, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 46 (6(MMS2022 1-37/ME2022 26-62/AIT2022 1-37)) 2022年
• ユーザの動作情報を用いたコンテンツの関心度推定に関する検討-複数ユーザを導入した特徴統合の有効性検証-

  上川恭平, 前田圭介, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 46 (6(MMS2022 1-37/ME2022 26-62/AIT2022 1-37)) 2022年
• 知識蒸留を用いたFew-shot Learningに基づく画像の感情ラベル推定に関する検討

  YE Yingrui, 諸戸祐哉, 前田圭介, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 46 (6(MMS2022 1-37/ME2022 26-62/AIT2022 1-37)) 2022年
• 地下鉄トンネル点検時の技術者から取得される生体信号と技術者の点検行動の関連性分析

  平澤魁人, 前田圭介, 藤後廉, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 46 (6(MMS2022 1-37/ME2022 26-62/AIT2022 1-37)) 2022年
• 画像中の物体情報を考慮したユーザ類似度に基づく個人に特化した注視領域の推定に関する検討

  諸戸祐哉, 前田圭介, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 46 (6(MMS2022 1-37/ME2022 26-62/AIT2022 1-37)) 2022年
• Attention mapに対する確信度を考慮可能な深層学習を用いた変状分類の高精度化に関する検討

  小川直輝, 前田圭介, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 46 (6(MMS2022 1-37/ME2022 26-62/AIT2022 1-37)) 2022年
• 映像情報メディア年報2021シリーズ(第7回)メディア工学の研究動向—Recent Researches on Media Engineering

  新井 啓之, 田良島 周平, 河村 圭, 堀 淳志, 多田 昌裕, 望月 貴裕, 小川 貴弘 映像情報メディア学会誌 = The journal of the Institute of Image Information and Television Engineers 76 (1) 78 -85 2022年01月
• 招待講演 マルチメディアAI技術に基づく異分野融合研究と実社会応用—Invited Talk : Interdisciplinary Research and Real-world Applications Based on Multimedia AI technologies—情報センシング メディア工学 映像・信号の処理・解析・AI技術とその多分野応用

  小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 45 (13) 73 -80 2021年06月
• A Note on Distress Classification of High-resolution Subway Tunnel Images based on HRNet: マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  トウゴ レン, オガワ タカヒロ, ハセヤマ ミキ 45 (4) 13 -16 2021年02月
• 地下鉄トンネルの維持管理支援を目的とした深層学習に基づく変状検出の高精度化に関する検討 : 壁面の施工方法に注目した精度検証—A Note on Improving Performance of Deep Learning-based Distress Detection for Supporting Maintenance of Subway Tunnels : Accuracy Verification Focusing on Tunnel Wall Characteristics—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  春山 知生, 前田 圭介, 藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 45 (4) 1 -6 2021年02月
• 特別講演 実店舗の防犯カメラ映像データを用いた顧客の関心推定に関する検討 : 姿勢推定モデルから得られる特徴量を用いた異常検知モデルの精度検証—A Note on Customer's Interest Estimation Method Using Security Camera Video Data from the Real Store : Validation of the accuracy of an anomaly detection model using features obtained from a posture estimation model—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  本間 勇紀, 藤後 廉, 阿部 真育, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 45 (4) 193 -198 2021年02月
• 地下鉄トンネル点検時の技術者から取得される視線およびモーションデータに基づく熟練度の推定に関する検討—A Note on Estimation of Expert-Novice Level Based on Eye Tracking and Motion Data from Engineers While Inspecting Subway Tunnel—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  赤松 祐亮, 前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 45 (4) 7 -12 2021年02月
• 特別講演 ゴム材料開発のためのConditional StyleGANに基づく配合量からの電子顕微鏡画像の生成に関する一検討—A Note on Electron Microscope Image Generation from Mix Proportion via Conditional Style Generative Adversarial Network for Rubber Materials—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  柳 凜太郎, 藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 45 (4) 171 -175 2021年02月
• 特別講演 路面画像を用いた深層学習に基づく路面状態の分類に関する検討—A Note on Discrimination of Road Surface Conditions Based on Deep Learning Using Road Images—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  諸戸 祐哉, 前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 45 (4) 165 -169 2021年02月
• TCCに基づく自己教師学習による特徴表現を用いた映像中の人物動作の検出に関する検討 : 動作検出パラメータが与える影響に対する考察—A Note on Action Detection Using Feature Representation via Self-Supervised Learning based on TCC : Effectiveness evaluation of parameters for action detection—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  増田 毅, 藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 45 (4) 47 -51 2021年02月
• 電子顕微鏡により撮像されたゴム材料からの異常検知に基づく劣化領域の推定に関する一検討 : 深層学習モデルにより抽出された特徴表現の有効性検証—A Note on Estimation of Deteriorated Regions Based on Anomaly Detection from Rubber Material Electron Microscope Images : Verification of Feature Representations Extracted from Deep Learning Models—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  松本 真直, 藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 45 (4) 43 -46 2021年02月
• サッカー映像における情報の提示位置の推定に関する検討 : 視聴者の注視位置および選手位置に基づいたオブジェクト配置の決定—A Note on Position Estimation of Superimposing Information in Soccer Videos : Decision of Object Placement Based on User's Gaze Position and Players' Positions—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  鈴木 元樹, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 45 (4) 77 -81 2021年02月
• A Note on Automatic Diagnosis of Helicobacter Pylori Infection Based on EfficientNet with Flooding Loss: マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  トウゴ レン, マベ カツヒロ, ニシダ シュンペイ, トモダ ヨシヒロ, シミズ ヒカリ, オガワ タカヒロ, ハセヤマ ミキ 45 (4) 23 -26 2021年02月
• Twitterと映像を用いたMVAEに基づく野球映像の重要シーン予測に関する検討—A Note on Prediction of Important Scenes in Baseball Videos via Multimodal Variational Autoencoder Using Tweets and Videos—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  平澤 魁人, 前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 45 (4) 71 -75 2021年02月
• Detecting axillary lymph node metastasis of breast cancer with FDG-PET/CT images based on attention mechanism: FDG-PET/CT画像を用いたattention mechanismに基づく乳癌の腋窩リンパ節転移の検出: マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  トウゴ レン, ヒラタ ケンジ, キタジマ カズヒロ, タケナカ ジュンキ, ミヨシ ヤスオ, クドウ コウスケ, オガワ タカヒロ, ハセヤマ ミキ 45 (4) 33 -36 2021年02月
• 特別講演 ユーザの嗜好を反映可能なインテリアコーディネート検索技術の構築 : コーディネートを表現可能な特徴の抽出と実データへの適用—A Note on Interior Coordination Retrieval Reflecting User's Preferences : Extraction of Features Representing Coordination and Application to Real Data—マルチメディアストレージ メディア工学 映像表現&コンピュータグラフィックス

  藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 45 (4) 187 -191 2021年02月
• Audio-visual立体化モデルを用いた画面外音声検出に関する検討-自己教師あり学習手法に基づくAudio-visual特徴表現の導入-

  吉田将規, 藤後廉, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2021 2021年
• 画像特徴の表現能力が世界モデルのパフォーマンスに与える影響の検証

  大羽賀駿也, 藤後廉, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2021 2021年
• Shilling attackの状況下におけるグラフ解析に基づく推薦システムの脆弱性の検証

  小野寺望, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2021 2021年
• グラフ畳み込みネットワークに基づくアニメイラストのマルチラベル画像認識に関する検討

  LAN Ziwen, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2021 2021年
• 自己教師あり学習を導入した潜在変数モデルによる低次元特徴の抽出に関する検討

  渡部航史, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2021 2021年
• Few-shot Learningを用いた感情ラベル推定における複数のデータセット利用に関する初期検討

  YE Yingrui, 諸戸祐哉, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2021 2021年
• テキスト入力型画像操作における操作領域に着目した精度評価に関する検討

  渡邉優宇人, 藤後廉, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2021 2021年
• 消化管がんの検診・スクリーニングにおけるトピックス 5 ピロリ菌感染胃炎の胃X線スクリーニングにおけるAIの活用

  竹内千尋, 藤後廉, 小川貴弘, 長谷山美紀, 山道信毅 臨床消化器内科 36 (8) 1062 -1065 2021年
• 光電容積脈波による連続血圧推定における血流の流量と抵抗指標を用いた精度向上方式の提案と評価

  川上健, 住友和弘, 菅野厚博, 小川貴弘, 南重信, 長谷山美紀 電気学会論文誌 E 141 (6) 186 -196 2021年 [査読無し]
   

  This paper presents a new method which achieves accuracy like cuff-based BP (Blood pressure) measurement to improve the conventional cuff-less BP estimation method for a wrist-type single PPG sensor. The conventional method used the modified normalized pulse volume and the pulse rate for resistance and flow rate respectively to express BP. However, it is required to improve the performance in comparison with methods based on pulse wave velocity which involve elasticity rate relating to vascular pressure. The new method incorporates both resistance which is derived from relative velocity and peripheral arterial elasticity based on vascular function to elevate the accuracy of diastolic BP estimation. Systolic BP is also improved by the sum of estimated pulse pressure with resistance and the estimated diastolic BP value. The accuracy comparison between the conventional and proposal method was performed by cross validation for estimated BP values in 5 seconds each by using wrist-type PPG signals. It is found that the estimated SBP and DBP of the conventional method differed from the reference BP by 3.9 (mean absolute error) ±12 (standard deviation) mmHg and 4.7 ± 11 mmHg respectively. In the proposal method, the differences of estimated values are 2.5 ± 7.2 mmHg and 2.7 ± 7.8 mmHg. When compared to the AAMI requirement (5 ± 8 mmHg for both SBP and DBP estimation), the results suggest that the proposed method has great potential for a single PPG sensor device.
• 画像注視時の脳活動データを用いた質問応答生成モデルに基づく意味内容の推定に関する検討-fine-tuningに基づく高精度化-

  高田紗弥, 藤後廉, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 45 (4(MMS2021 1-28/ME2021 1-28/AIT2021 1-28)) 27 -31 2021年
• Image Captioningの導入による画像の感情推定の高精度化に関する検討

  LIANG Yun, 前田圭介, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 45 (4(MMS2021 1-28/ME2021 1-28/AIT2021 1-28)) 65 -69 2021年
• 画像特徴を用いた多層グラフ解析に基づくクロスドメイン推薦に関する検討

  平川泰成, 前田圭介, 小川貴弘, 浅水仁, 長谷山美紀 映像情報メディア学会技術報告 45 (4(MMS2021 1-28/ME2021 1-28/AIT2021 1-28)) 59 -63 2021年
• 地下鉄トンネルの維持管理支援を目的とした深層学習に基づく変状検出の高精度化に関する検討-壁面の施工方法に注目した精度検証-

  春山知生, 前田圭介, 藤後廉, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 45 (4(MMS2021 1-28/ME2021 1-28/AIT2021 1-28)) 2021年
• 実店舗の防犯カメラ映像データを用いた顧客の関心推定に関する検討-姿勢推定モデルから得られる特徴量を用いた異常検知モデルの精度検証-

  本間勇紀, 本間勇紀, 藤後廉, 阿部真育, 小川貴弘, 長谷山美紀, 長谷山美紀 映像情報メディア学会技術報告 45 (4(MMS2021 1-28/ME2021 1-28/AIT2021 1-28)) 2021年
• 電子顕微鏡により撮像されたゴム材料からの異常検知に基づく劣化領域の推定に関する一検討~深層学習モデルにより抽出された特徴表現の有効性検証~

  松本真直, 藤後廉, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 45 (4(MMS2021 1-28/ME2021 1-28/AIT2021 1-28)) 2021年
• 地下鉄トンネル点検時の技術者から取得される視線およびモーションデータに基づく熟練度の推定に関する検討

  赤松祐亮, 前田圭介, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 45 (4(MMS2021 1-28/ME2021 1-28/AIT2021 1-28)) 2021年
• TCCに基づく自己教師学習による特徴表現を用いた映像中の人物動作の検出に関する検討-動作検出パラメータが与える影響に対する考察-

  増田毅, 藤後廉, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 45 (4(MMS2021 1-28/ME2021 1-28/AIT2021 1-28)) 2021年
• 路面画像を用いた深層学習に基づく路面状態の分類に関する検討

  諸戸祐哉, 前田圭介, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 45 (4(MMS2021 1-28/ME2021 1-28/AIT2021 1-28)) 2021年
• サッカー映像における情報の提示位置の推定に関する検討-視聴者の注視位置および選手位置に基づいたオブジェクト配置の決定-

  鈴木元樹, 高橋翔, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 45 (4(MMS2021 1-28/ME2021 1-28/AIT2021 1-28)) 2021年
• Twitterと映像を用いたMVAEに基づく野球映像の重要シーン予測に関する検討

  平澤魁人, 前田圭介, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 45 (4(MMS2021 1-28/ME2021 1-28/AIT2021 1-28)) 2021年
• ユーザの嗜好を反映可能なインテリアコーディネート検索技術の構築-コーディネートを表現可能な特徴の抽出と実データへの適用-

  藤後廉, 小川貴弘, 長谷山美紀, 長谷山美紀 映像情報メディア学会技術報告 45 (4(MMS2021 1-28/ME2021 1-28/AIT2021 1-28)) 2021年
• Attention Mapを用いた道路構造物の変状画像分類におけるテキストデータの導入に基づく高精度化に関する検討

  小川直輝, 前田圭介, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 45 (4(MMS2021 1-28/ME2021 1-28/AIT2021 1-28)) 17 -21 2021年
• ゴム材料開発のためのConditional StyleGANに基づく配合量からの電子顕微鏡画像の生成に関する一検討

  柳凜太郎, 藤後廉, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 45 (4(MMS2021 1-28/ME2021 1-28/AIT2021 1-28)) 2021年
• AIを中心とした医療デジタル技術基盤の構築へ向けた取り組み

  藤後廉, 小川貴弘, 長谷山美紀 日本消化器がん検診学会雑誌(Web) 59 (Supplement 1) 2021年
• マルチメディアAI技術に基づく異分野融合研究と実社会応用

  小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 45 (13(IST2021 22-29/ME2021 53-60)) 2021年
• 《第17回》ヒューマンセントリックAIによる実社会データからの価値創出

  小川 貴弘 計測と制御 59 (5) 295 -296 2020年05月10日
• IEEE GCCE 2019開催報告—IEEE GCCE 2019 Report

  小川 貴弘 映像情報メディア学会誌 = The journal of the Institute of Image Information and Television Engineers 74 (2) 314 -318 2020年03月
• 画像内の物体に着目した画像検索に関する検討 : RetinaNetを用いた物体認識に基づく高精度化—A Note on Image Retrieval Focusing on Objects in Images : Improving Retrieval Performance Based on Object Recognition Using RetinaNet—マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス

  柳 凛太郎, 藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 44 (6) 377 -381 2020年02月
• 画像注視時の視線データを用いた関心度の推定に関する検討 : ラベルの逆量子化を導入したsMVCCAによる推定精度の高精度化—A Note on Eye Gaze Based User-specific Interest Estimation for Images : Estimation Performance Improvement Based on sMVCCA including Ordinal Label Dequantization—ITS : Intelligent Transport Systems Technology

  松本 真直, 斉藤 直輝, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 119 (421) 73 -77 2020年02月
• 画像注視時の視線データを用いた関心度の推定に関する検討 : ラベルの逆量子化を導入したsMVCCAによる推定精度の高精度化—A Note on Eye Gaze Based User-specific Interest Estimation for Images : Estimation Performance Improvement Based on sMVCCA including Ordinal Label Dequantization—マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス

  松本 真直, 斉藤 直輝, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 44 (6) 73 -77 2020年02月
• 地下鉄トンネル点検時の生体信号に基づいた熟練および若手技術者の分類に関する検討—A Note on Classification of Experienced and Novice Inspectors Based on Bio-signals While Inspecting in Subway Tunnels—ITS : Intelligent Transport Systems Technology

  九島 哲哉, 前田 圭介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 119 (421) 101 -105 2020年02月
• 特別講演 社会インフラ維持管理効率化のための最先端AI技術の導入 : 点検データを用いた変状分類の精度向上に向けた取り組み—Introduction of Advanced AI Technology for Efficient Maintenance Inspection of Social Infrastructure : Performance Improvement of Distress Image Classification Utilizing Inspection Data—ITS : Intelligent Transport Systems Technology

  前田 圭介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 119 (421) 359 -362 2020年02月
• 道路構造物の変状評価における技術者の視線データと熟練度の分析に関する一考察—A Note on Analysis of Gaze Data and Skills of Inspectors in Distress Assessment of Road Structures—マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス

  松井 太我, 前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 44 (6) 97 -100 2020年02月
• A note on detection of distress regions in subway tunnels by using U-net based network: ITS : Intelligent Transport Systems Technology

  トウゴ レン, オガワ タカヒロ, ハセヤマ ミキ 119 (421) 69 -72 2020年02月
• 道路構造物の維持管理効率化に向けた変状画像分類における信頼性の向上に関する検討—A Note on Improvement of Reliability of Distress Image Classification for Efficient Maintenance of Road Structures—ITS : Intelligent Transport Systems Technology

  堀井 風葉, 前田 圭介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 119 (421) 51 -56 2020年02月
• 画像内の物体に着目した画像検索に関する検討 : RetinaNetを用いた物体認識に基づく高精度化—A Note on Image Retrieval Focusing on Objects in Images Improving Retrieval Performance Based on Object Recognition Using RetinaNet—ITS : Intelligent Transport Systems Technology

  柳 凜太郎, 藤後 廉, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 119 (421) 377 -381 2020年02月
• 弱異常検知アルゴリズムに基づくCCTV映像を用いた河川利用者の異常行動の検出に関する検討—A Note on Abnormal Motion Detection of River Users on CCTV Videos Based on Weakly Supervised Anomaly Detection Algorithm—マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス

  渡邊 はるな, 藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 44 (6) 367 -370 2020年02月
• A note on retrieval of visually similar distress regions in subway tunnel images : Introduction of deep features extracted by semantic segmentation network: ITS : Intelligent Transport Systems Technology

  トウゴ レン, オガワ タカヒロ, ハセヤマ ミキ 119 (421) 65 -68 2020年02月
• 画像注視時のヒトの感情推定のための視線特徴の推定に関する検討—A Note on Estimation of Gaze Features for Human Emotion Estimation while Viewing Images—マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス

  諸戸 祐哉, 前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 44 (6) 85 -89 2020年02月
• ゴム材料の配合量を用いたAC-GANに基づく電子顕微鏡画像の生成に関する一検討—A Note on Generation of Electron Microscope Images via Auxiliary Classifier Generative Adversarial Network with Mix Proportions—ITS : Intelligent Transport Systems Technology

  金井 美岬, 藤後 廉, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 119 (421) 107 -111 2020年02月
• ゴム材料の配合量を用いたAC-GANに基づく電子顕微鏡画像の生成に関する一検討—A Note on Generation of Electron Microscope Images via Auxiliary Classifier Generative Adversarial Network with Mix Proportions—マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス

  金井 美岬, 藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 44 (6) 107 -111 2020年02月
• 道路構造物の変状評価における技術者の視線データと熟練度の分析に関する一考察—A Note on Analysis of Gaze Data and Skills of Inspectors in Distress Assessment of Road Structures—ITS : Intelligent Transport Systems Technology

  松井 太我, 前田 圭介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 119 (421) 97 -100 2020年02月
• エッジの補完を導入したツイートクラスタリングの高精度化に関する検討—A Note on Tweet Clustering by Complementing Edges among Tweets—ITS : Intelligent Transport Systems Technology

  滝村 祥司, 原川 良介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 119 (421) 61 -64 2020年02月
• 地下鉄トンネル維持管理支援を目的とした類似画像の検索に関する検討 : 技術者の評価を反映可能な距離計量学習の導入—A Note on Retrieval of Similar Images for Supporting Maintenance of Subway Tunnels : Introduction of Distance Metric Learning Reflecting Inspectors' Evaluation—マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス

  松本 有衣, 前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 44 (6) 47 -50 2020年02月
• 特別講演 社会インフラ維持管理効率化のための最先端AI技術の導入 : 点検データを用いた変状分類の精度向上に向けた取り組み—Introduction of Advanced AI Technology for Efficient Maintenance Inspection of Social Infrastructure : Performance Improvement of Distress Image Classification Utilizing Inspection Data—マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス

  前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 44 (6) 359 -362 2020年02月
• 地下鉄トンネル維持管理支援を目的とした類似画像の検索に関する検討 : 技術者の評価を反映可能な距離計量学習の導入—A Note on Retrieval of Similar Images for Supporting Maintenance of Subway Tunnels : Introduction of Distance Metric Learning Reflecting Inspectors' Evaluation—ITS : Intelligent Transport Systems Technology

  松本 有衣, 前田 圭介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 119 (421) 47 -50 2020年02月
• 穿孔データを用いたオンライン学習に基づく岩盤の圧縮強度指数推定に関する検討—A Note on Estimation of rock compressive strength index from drilling data based on online learning—マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス

  山本 健太郎, 藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 44 (6) 57 -60 2020年02月
• 穿孔データを用いたオンライン学習に基づく岩盤の圧縮強度指数推定に関する検討—A Note on Estimation of rock compressive strength index from drilling data based on online learning—ITS : Intelligent Transport Systems Technology

  山本 健太郎, 藤後 廉, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 119 (421) 57 -60 2020年02月
• サッカー映像視聴時の視線データを用いた情報の提示領域の算出に関する検討—Presentation Region Calculation of Information Based on Gaze Tracking Data in Soccer Videos—ITS : Intelligent Transport Systems Technology

  鈴木 元樹, 高橋 翔, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 119 (421) 91 -95 2020年02月
• 地下鉄トンネル点検時の生体信号に基づいた熟練および若手技術者の分類に関する検討—マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス

  九島 哲哉, 前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 44 (6) 101 -105 2020年02月
• Bidirectional LSTMを用いたサッカー映像におけるイベント分類に関する検討—A Note on Event Classification in Soccer Videos Using Bidirectional LSTM—ITS : Intelligent Transport Systems Technology

  春山 知生, 高橋 翔, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 119 (421) 371 -375 2020年02月
• 画像注視時のヒトの感情推定のための視線特徴の推定に関する検討—A Note on Estimation of Gaze Features for Human Emotion Estimation while Viewing Images—ITS : Intelligent Transport Systems Technology

  諸戸 祐哉, 前田 圭介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 119 (421) 85 -89 2020年02月
• 道路構造物の維持管理効率化に向けた変状画像分類における信頼性の向上に関する検討—A Note on Improvement of Reliability of Distress Image Classification for Efficient Maintenance of Road Structures—マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス

  堀井 風葉, 前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 44 (6) 51 -56 2020年02月
• エッジの補完を導入したツイートクラスタリングの高精度化に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  滝村 祥司, 原川 良介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 44 (6) 61 -64 2020年02月
• MVBGM-MSに基づく画像注視時の脳活動データを用いた画像カテゴリの推定に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  赤松 祐亮, 原川 良介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 44 (6) 79 -83 2020年02月
• サッカー映像視聴時の視線データを用いた情報の提示領域の算出に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  鈴木 元樹, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 44 (6) 91 -95 2020年02月
• Bidirectional LSTMを用いたサッカー映像におけるイベント分類に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  春山 知生, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 44 (6) 371 -375 2020年02月
• エッジの補完を導入したツイートクラスタリングの高精度化に関する検討

  滝村祥司, 原川良介, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 119 (421(ITS2019 30-56)) 2020年
• Bidirectional LSTMを用いたサッカー映像におけるイベント分類に関する検討

  春山知生, 高橋翔, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 119 (421(ITS2019 30-56)) 2020年
• 社会インフラ維持管理効率化のための最先端AI技術の導入-点検データを用いた変状分類の精度向上に向けた取り組み-

  前田圭介, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 119 (421(ITS2019 30-56)) 2020年
• サッカー映像視聴時の視線データを用いた情報の提示領域の算出に関する検討

  鈴木元樹, 高橋翔, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 119 (421(ITS2019 30-56)) 2020年
• 道路構造物の維持管理効率化に向けた変状画像分類における信頼性の向上に関する検討

  堀井風葉, 前田圭介, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 119 (421(ITS2019 30-56)) 2020年
• 地下鉄トンネル維持管理支援を目的とした類似画像の検索に関する検討-技術者の評価を反映可能な距離計量学習の導入-

  松本有衣, 前田圭介, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 119 (421(ITS2019 30-56)) 2020年
• 穿孔データを用いたオンライン学習に基づく岩盤の圧縮強度指数推定に関する検討

  山本健太郎, 藤後廉, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 119 (421(ITS2019 30-56)) 2020年
• 地下鉄トンネル点検時の生体信号に基づいた熟練および若手技術者の分類に関する検討

  九島哲哉, 前田圭介, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 119 (421(ITS2019 30-56)) 2020年
• 弱異常検知アルゴリズムに基づくCCTV映像を用いた河川利用者の異常行動の検出に関する検討

  渡邊はるな, 藤後廉, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 119 (421(ITS2019 30-56)) 2020年
• 画像注視時の視線データを用いた関心度の推定に関する検討-ラベルの逆量子化を導入したsMVCCAによる推定精度の高精度化-

  松本真直, 斉藤直輝, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 119 (421(ITS2019 30-56)) 2020年
• ゴム材料の配合量を用いたAC-GANに基づく電子顕微鏡画像の生成に関する一検討

  金井美岬, 藤後廉, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 119 (421(ITS2019 30-56)) 2020年
• 道路構造物の変状評価における技術者の視線データと熟練度の分析に関する一考察

  松井太我, 前田圭介, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 119 (421(ITS2019 30-56)) 2020年
• MVBGM-MSに基づく画像注視時の脳活動データを用いた画像カテゴリの推定に関する検討

  赤松祐亮, 原川良介, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 119 (421(ITS2019 30-56)) 2020年
• 画像内の物体に着目した画像検索に関する検討-RetinaNetを用いた物体認識に基づく高精度化-

  柳凛太郎, 藤後廉, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 119 (421(ITS2019 30-56)) 2020年
• 画像注視時のヒトの感情推定のための視線特徴の推定に関する検討

  諸戸祐哉, 前田圭介, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 119 (421(ITS2019 30-56)) 2020年
• 自己組織化マップを用いた強化学習に基づく楽曲プレイリスト生成に関する検討

  櫻井慶悟, 藤後廉, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2020 2020年
• 路面画像を用いた異常検知に基づく路面状態の識別に関する検討

  諸戸祐哉, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2020 2020年
• 多層グラフ解析に基づくクロスドメイン推薦に関する検討-埋め込み特徴量の次元数の変化による精度検証-

  平川泰成, 前田圭介, 小川貴弘, 浅水仁, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2020 2020年
• Temporal Cycle Consistency Learningに基づく人物動作の検出に関する検討

  増田毅, 藤後廉, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2020 2020年
• m-SimGPを用いた特徴統合に基づくユーザの関心度推定に関する検討

  上川恭平, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2020 2020年
• Multi-level Deep Metric Netに基づく画像の感情推定に関する検討

  LIANG Yun, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2020 2020年
• nAULSに基づくデータセットの複雑性評価に関する検討

  LI Guang, 藤後廉, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2020 2020年
• RICAPに基づくデータ拡張による地下鉄トンネルにおける変状検出精度の向上に関する検討

  春山知生, 前田圭介, 藤後廉, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2020 2020年
• 画像注視時のfMRIデータを用いた注視画像の推定に関する検討-確率的生成モデルに基づく複数被験者の共通応答の導入-

  東孝明, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2020 2020年
• 学習済みセマンティックセグメンテーションモデルを用いたdisentanglementに関する検討

  中川真, 藤後廉, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2020 2020年
• Human-centered image classification via a neural network considering visual and biological features.

  Kazaha Horii, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama Multim. Tools Appl. 79 (7-8) 4395 -4415 2020年 [査読有り][通常論文]
   

  © 2019, Springer Science+Business Media, LLC, part of Springer Nature. In this paper, we propose a human-centered image classification via a neural network considering visual and biological features. The proposed method has two novelties. Firstly, we apply Group-Sparse Local Fisher Discriminant Analysis (GS-LFDA) to biological features. GS-LFDA realizes dimensionality reduction and noise elimination for biological features with consideration of local structures and class information. Secondly, we construct a Canonical Correlation Analysis (CCA)-based hidden layer via Discriminative Locality Preserving CCA (DLPCCA). DLPCCA transforms visual features into effective features by considering the relationships with biological information and class information. The CCA-based hidden layer enables transformation of visual features into effective features for image classification from a small number of training samples. Furthermore, once the projection can be obtained in the training phase, elimination of the need for biological data acquisition in the test phase is realized. This is another merit of our method.
• 胃バリウム検査におけるAIによるHelicobacter pylori診断 (Helicobacter Topics! : 「旬のHelicobacter」を知り,驚き,理解を深め,楽しむ)

  藤後 廉, 間部 克裕, 山道 信毅, 大泉 晴史, 小川 貴弘, 長谷山 美紀, 加藤 元嗣, 坂本 直哉 Helicobacter research : Journal of helicobacter research 23 (2) 92,133 -137 2019年11月 [査読無し][通常論文]
  
• 画像の視覚的および空間的特徴に基づくユーザに特化した注視領域推定の高精度化に関する検討 : 視覚的特徴の類似度と推定精度の関係性に関する一考察 (イメージ・メディア・クオリティ)

  諸戸 祐哉, 前田 圭介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 119 (131) 13 -16 2019年07月19日 [査読無し][通常論文]
  
• 画像注視時の視線データを用いた関心の識別に関する検討 : 推定結果の統合による高精度化 (イメージ・メディア・クオリティ)

  松本 真直, 斉藤 直輝, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 119 (131) 17 -20 2019年07月19日 [査読無し][通常論文]
  
• 敵対的生成ネットワークにより文から生成される画像の意味的評価に関する検討 (イメージ・メディア・クオリティ)

  柳 凜太郎, 藤後 廉, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 119 (131) 21 -24 2019年07月19日 [査読無し][通常論文]
  
• 認識・抽出 センサから得られる視聴行動データを活用したユーザの関心推定の高度化

  長谷山 美紀, 小川 貴弘, 髙橋 翔, 原川 良介 画像ラボ 30 (7) 8 -12 2019年07月 [査読無し][通常論文]
  
• IEEE GCCE2018参加報告 : 新たなイノベーション創出の場

  小川 貴弘 映像情報メディア学会誌 = The journal of the Institute of Image Information and Television Engineers 73 (2) 299 -302 2019年03月 [査読無し][通常論文]
  
• 畳み込みニューラルネットワークを用いた地下鉄トンネルにおける変状検出の高精度化に関する一検討 (ITS)

  王 安, 原川 良介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 121 -124 2019年02月19日 [査読無し][通常論文]
  
• 電子顕微鏡画像および配合量を用いたゴム材料の特性曲線の推定に関する検討 (ITS)

  斉藤 直輝, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 261 -264 2019年02月19日 [査読無し][通常論文]
  
• 電子顕微鏡により撮像されたゴム材料からの異常検知に基づく劣化領域の推定に関する一検討 (ITS)

  藤後 廉, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 265 -268 2019年02月19日 [査読無し][通常論文]
  
• 高性能マルチセンシングバンドを利用したストレス検出の精度検証 (ITS)

  伊藤 良起, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 269 -274 2019年02月19日 [査読無し][通常論文]
  
• 畳み込みニューラルネットワークにおける解釈性向上のための画像の属性分類に関する一検討 (ITS)

  堀井 風葉, 前田 圭介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 275 -279 2019年02月19日 [査読無し][通常論文]
  
• 地下鉄トンネルの変状画像を用いた技術者の注視領域推定のための初期検討 : 深層学習に基づく顕著領域の推定手法の適用 (ITS)

  斉藤 僚汰, 前田 圭介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 281 -285 2019年02月19日 [査読無し][通常論文]
  
• 地下鉄トンネル維持管理支援のための距離計量学習を用いた類似点検データの検索に関する検討 (ITS)

  弦間 奨, 原川 良介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 287 -290 2019年02月19日 [査読無し][通常論文]
  
• トンネル切羽画像を用いた岩盤の穿孔エネルギー推定に関する初期検討 (ITS)

  山本 健太郎, 原川 良介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 291 -294 2019年02月19日 [査読無し][通常論文]
  
• レーザーデータを用いた地下鉄トンネル内の変状検出に関する検討 : 全層畳み込みネットワークを用いた変状領域の可視化 (ITS)

  豊田 陽, 原川 良介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 295 -299 2019年02月19日 [査読無し][通常論文]
  
• 異種特徴を活用したネットワーク解析に基づく音楽配信サービスにおけるアーティストの人気度予測に関する検討 (ITS)

  松本 有衣, 原川 良介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 301 -306 2019年02月19日 [査読無し][通常論文]
  
• 複数の推定結果の統合に基づくTwitterのフォロイー推薦の高精度化に関する一検討 (ITS)

  滝村 祥司, 原川 良介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 307 -310 2019年02月19日 [査読無し][通常論文]
  
• 3D residual networkに基づくFDG-PET/CT画像を用いた悪性腫瘍候補の自動検出

  李 宗曜, 藤後 廉, 小川 貴弘, 平田 健司, 真鍋 治, 志賀 哲, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 311 -314 2019年02月19日 [査読無し][通常論文]
  
• 転移学習を用いた胃X線画像における胃炎識別に関する検討 (ITS)

  金井 美岬, 藤後 廉, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 315 -318 2019年02月19日 [査読無し][通常論文]
  
• Progressive Growing GANに基づく胃炎識別のための画像生成手法に関する一検討 (ITS)

  渡邊 はるな, 藤後 廉, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 319 -322 2019年02月19日 [査読無し][通常論文]
  
• 視線データを用いた画像注視時に誘起される感情の推定に関する検討 : KDLPCCAに基づく特徴変換の導入による高精度化 (ITS)

  松井 太我, 斉藤 直輝, 小川 貴弘, 浅水 仁, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 323 -327 2019年02月19日 [査読無し][通常論文]
  
• OpenPoseに基づくユーザの動作を用いた映像の関心度推定に関する検討 (ITS)

  九島 哲哉, 高橋 翔, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 351 -354 2019年02月19日 [査読無し][通常論文]
  
• サッカー映像視聴時の視線データを用いた攻撃選手の重要度算出に関する検討 (ITS)

  鈴木 元樹, 高橋 翔, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 355 -359 2019年02月19日 [査読無し][通常論文]
  
• 異種特徴を用いた深層学習に基づく送電鉄塔の劣化レベル分類の高精度化に関する検討 (ITS)

  前田 圭介, 高橋 翔, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 361 -364 2019年02月19日 [査読無し][通常論文]
  
• CCTV映像を用いた河川利用者の行動分類に関する検討 (ITS)

  川本 舜, 原川 良介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 365 -369 2019年02月19日 [査読無し][通常論文]
  
• CCTV映像を用いた河川利用者の異常検出に関する検討 (ITS)

  川本 舜, 原川 良介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (449) 371 -374 2019年02月19日 [査読無し][通常論文]
  
• 畳み込みニューラルネットワークを用いた地下鉄トンネルにおける変状検出の高精度化に関する一検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  王 安, 原川 良介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 121 -124 2019年02月 [査読無し][通常論文]
  
• 電子顕微鏡画像および配合量を用いたゴム材料の特性曲線の推定に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  斉藤 直輝, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 261 -264 2019年02月 [査読無し][通常論文]
  
• 電子顕微鏡により撮像されたゴム材料からの異常検知に基づく劣化領域の推定に関する一検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 265 -268 2019年02月 [査読無し][通常論文]
  
• 高性能マルチセンシングバンドを利用したストレス検出の精度検証 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  伊藤 良起, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 269 -274 2019年02月 [査読無し][通常論文]
  
• 畳み込みニューラルネットワークにおける解釈性向上のための画像の属性分類に関する一検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  堀井 風葉, 前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 275 -279 2019年02月 [査読無し][通常論文]
  
• 地下鉄トンネルの変状画像を用いた技術者の注視領域推定のための初期検討 : 深層学習に基づく顕著領域の推定手法の適用 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  斉藤 僚汰, 前田 圭介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 281 -285 2019年02月 [査読無し][通常論文]
  
• 地下鉄トンネル維持管理支援のための距離計量学習を用いた類似点検データの検索に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  弦間 奨, 原川 良介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 287 -290 2019年02月 [査読無し][通常論文]
  
• トンネル切羽画像を用いた岩盤の穿孔エネルギー推定に関する初期検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  山本 健太郎, 原川 良介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 291 -294 2019年02月 [査読無し][通常論文]
  
• レーザーデータを用いた地下鉄トンネル内の変状検出に関する検討 : 全層畳み込みネットワークを用いた変状領域の可視化 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  豊田 陽, 原川 良介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 295 -299 2019年02月 [査読無し][通常論文]
  
• 異種特徴を活用したネットワーク解析に基づく音楽配信サービスにおけるアーティストの人気度予測に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  松本 有衣, 原川 良介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 301 -306 2019年02月 [査読無し][通常論文]
  
• 複数の推定結果の統合に基づくTwitterのフォロイー推薦の高精度化に関する一検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  滝村 祥司, 原川 良介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 307 -310 2019年02月 [査読無し][通常論文]
  
• A Note on Automatic Malignant Tumor Candidate Detection Based on a 3D Deep Residual Network with FDG-PET/CT Images (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  李 宗曜, 藤後 廉, 小川 貴弘, 平田 健司, 真鍋 治, 志賀 哲, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 311 -314 2019年02月 [査読無し][通常論文]
  
• 転移学習を用いた胃X線画像における胃炎識別に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  金井 美岬, 藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 315 -318 2019年02月 [査読無し][通常論文]
  
• Progressive Growing GANに基づく胃炎識別のための画像生成手法に関する一検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  渡邊 はるな, 藤後 廉, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 319 -322 2019年02月 [査読無し][通常論文]
  
• 視線データを用いた画像注視時に誘起される感情の推定に関する検討 : KDLPCCAに基づく特徴変換の導入による高精度化 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  松井 太我, 斉藤 直輝, 小川 貴弘, 浅水 仁, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 323 -327 2019年02月 [査読無し][通常論文]
  
• OpenPoseに基づくユーザの動作を用いた映像の関心度推定に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  九島 哲哉, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 351 -354 2019年02月 [査読無し][通常論文]
  
• サッカー映像視聴時の視線データを用いた攻撃選手の重要度算出に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  鈴木 元樹, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 355 -359 2019年02月 [査読無し][通常論文]
   

  This paper presents a new method for predicting importance of attack players based on multiple gaze tracking data in soccer videos. In order to understand the game situation in the soccer game, experienced soccer players look at the movement, position, and space which are other players more often and faster than inexperienced players. Also, these features are different from each experienced player. For this reason, the gaze tracking data of experienced soccer player is useful for tactical analysis. Therefore, by introducing the gaze tracking data of multiple experienced soccer players into the importance prediction, more robust prediction than a method which use only one player's gaze data can be expected. Since this predicted importance is obtained from gaze data of the experienced soccer players, the obtained one is more useful data for understanding soccer game situation. Therefore, the proposed method can contribute to automatically data generation for developing novel services of video/data distribution that supports to easily understanding of video contents for many viewers. Experimental results using actual soccer videos showed the effectiveness of our method.
• 異種特徴を用いた深層学習に基づく送電鉄塔の劣化レベル分類の高精度化に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  前田 圭介, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 361 -364 2019年02月 [査読無し][通常論文]
  
• CCTV映像を用いた河川利用者の行動分類に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  川本 舜, 原川 良介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 365 -369 2019年02月 [査読無し][通常論文]
  
• CCTV映像を用いた河川利用者の異常検出に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  川本 舜, 原川 良介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 43 (5) 371 -374 2019年02月 [査読無し][通常論文]
  
• 人工知能が医療を変える!医療分野におけるAI研究開発最前線2019 II 領域別・画像診断におけるAI研究開発の最前線 7.その他 3)核医学におけるディープラーニングを用いた画像診断,画像処理

  平田健司, 藤後廉, 小川貴弘, 長谷山美紀, 志賀哲 Innervision 34 (7) 2019年
• ユーザの好みを反映した潜在特徴を用いたGCNに基づくTumblrポストの推薦

  大友一馬, 原川良介, 小川貴弘, 長谷山美紀, 岩橋政宏 信号処理シンポジウム講演論文集(CD-ROM) 34th 2019年
• 変状分類におけるGrad-CAM++に基づいたCNNの注目領域の可視化に関する検討

  小川直輝, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2019 2019年
• サッカー映像視聴時の視線データを用いた周辺視に基づく攻撃選手の重要度算出に関する検討

  鈴木元樹, 高橋翔, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2019 2019年
• 画像注視時の視線データを用いた関心の識別に関する検討-LDCCAに基づく特徴量の射影による高精度化-

  松本真直, 斉藤直輝, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2019 2019年
• Sparse Bayesian Learningに基づく注視領域の時間変化を考慮したヒトの感情推定に関する検討

  諸戸祐哉, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2019 2019年
• 複数の特徴量から得られる類似度の統合に基づくサッカー映像における類似場面検索の高精度化に関する検討

  春山知生, 高橋翔, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2019 2019年
• 複数変量の生成モデルに基づく画像注視時の脳活動データを用いた画像カテゴリの推定に関する検討

  赤松祐亮, 原川良介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2019 2019年
• Text-to-imageGANに基づくスタイル変換に関する検討-Image-to-textモデル導入による高精度化-

  古寺恵, 藤後廉, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2019 2019年
• Semantic Segmentationに基づく地下鉄トンネルにおける変状検出に関する検討

  WANG An, 藤後廉, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2019 2019年
• 脳活動データを用いた注視画像の再構成における用いる視覚野の領域に関する検討

  高田紗弥, 藤後廉, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2019 2019年
• Twitterを用いた異常検知に基づく野球映像の重要シーン検出に関する検討

  平澤魁人, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2019 2019年
• 生体情報解析を導入した次世代AI技術の構築

  長谷山美紀, 小川貴弘 電子情報通信学会大会講演論文集(CD-ROM) 2019 2019年
• Classification of tourism categories based on heterogeneous features considering existence of reliable results

  Naoki Saito, Takahiro Ogawa, Satoshi Asamizu, Miki Haseyama Proceedings of SPIE - The International Society for Optical Engineering 11049 2019年01月01日 [査読無し][通常論文]
   

  © COPYRIGHT SPIE. This paper presents a classification method of tourism categories based on heterogeneous features considering existence of reliable results. The proposed method performs estimation of existence of reliable results based on one-versus-one scheme from three kinds of classification results obtained from tourism images, geotags and textual tags, separately. Then if the reliable result is included in the above results, this result is regarded as a final result. Otherwise, the final result is obtained by the multiple annotator logistic regression. The proposed method realizes accurate classification by estimating the existence of reliable results from more than two kinds of results.
• Field position estimation in soccer videos using convolutional neural network-based image features

  Genki Suzuki, Sho Takahashi, Takahiro Ogawa, Miki Haseyama Proceedings of SPIE - The International Society for Optical Engineering 11049 2019年01月01日 [査読無し][通常論文]
   

  © COPYRIGHT SPIE. This paper presents a novel estimation method of field positions in soccer videos using Convolutional Neural Network (CNN)-based image features. CNN-based features have been well known to be ei€ective for tasks in machine learning. Therefore, the proposed method adopts CNN-based image features. By using these image features, the proposed method enables accurate estimation of soccer field positions than handcrafted features, i.e., Hough transform-based features. We show the ei€ectiveness of our method via experiment results using actual soccer videos.
• Gaze-based visual feature extraction via DLPCCA for visual sentiment estimation

  Taiga Matsui, Naoki Saito, Takahiro Ogawa, Satoshi Asamizu, Miki Haseyama Proceedings of SPIE - The International Society for Optical Engineering 11049 2019年01月01日 [査読無し][通常論文]
   

  © COPYRIGHT SPIE. This paper presents gaze-based visual feature extraction via Discriminative Locality Preserving Canonical Correlation Analysis (DLPCCA) for visual sentiment estimation. The proposed method calculates novel visual features reflecting users' visual sentiment by applying DLPCCA to gaze and original visual features. Consequently, accurate visual sentiment estimation becomes feasible by utilizing the novel visual features derived by the proposed method.
• Automatic Metastatic Bone Tumor Classification with DCNN-based Features Using Treatment-planning CT Images

  Haruna Watanabe, Ren Togo, Takahiro Ogawa, Miki Haseyama, Koichi Yasuda, Khin Khin Tha, Kohsuke Kudo, Hiroki Shirato INTERNATIONAL FORUM ON MEDICAL IMAGING IN ASIA 2019 11050 2019年 [査読無し][通常論文]
   

  In this paper, we propose a method to classify metastatic bone tumors using treatment-planning computed tomography images. The proposed method utilizes pre-trained deep convolutional neural network (DCNN) models as feature extractors and enables the metastatic bone tumor classification by using the obtained features. Performance of several state-of-the-art DCNN-based features was compared and evaluated in our experiment.
• ダイナミック粒子画像解析システムiSpect DIA-10 (特集 マテリアル)

  赤坂 剛, 深井 秋博, 小川 貴弘 島津評論 76 (1) 15 -25 2019年 [査読無し][通常論文]
  
• Automatic detection of fish sounds based on multi-stage classification including logistic regression via adaptive feature weighting

  Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama, Tomonari Akamatsu Journal of the Acoustical Society of America 144 (5) 2709 -2718 2018年11月01日 [査読無し][通常論文]
   

  © 2018 Acoustical Society of America. This paper presents a method for automatic detection of fish sounds in an underwater environment. There exist two difficulties: (i) features and classifiers that provide good detection results differ depending on the underwater environment and (ii) there are cases where a large amount of training data that is necessary for supervised machine learning cannot be prepared. A method presented in this paper (the proposed hybrid method) overcomes these difficulties as follows. First, novel logistic regression (NLR) is derived via adaptive feature weighting by focusing on the accuracy of classification results by multiple classifiers, support vector machine (SVM), and k-nearest neighbors (k-NN). Although there are cases where SVM or k-NN cannot work well due to divergence of useful features, NLR can produce complementary results. Second, the proposed hybrid method performs multi-stage classification with consideration of the accuracy of SVM, k-NN, and NLR. The multi-stage acquisition of reliable results works adaptively according to the underwater environment to reduce performance degradation due to diversity of useful classifiers even if abundant training data cannot be prepared. Experiments on underwater recordings including sounds of Sciaenidae such as silver croakers (Pennahia argentata) and blue drums (Nibea mitsukurii) show the effectiveness of the proposed hybrid method.
• ICMR2018 : 国際会議開催側の視点も交えて

  相澤 清晴, 佐藤 真一, 柳井 啓司, 井手 一郎, 山﨑 俊彦, 入江 豪, 小川 貴弘, 望月 貴裕, 新田 直子, 篠田 浩一, 呉 志鵬, 松井 勇佑, 牛久 祥孝, 内田 祐介 映像情報メディア学会誌 = The journal of the Institute of Image Information and Television Engineers 72 (6) 888 -895 2018年11月 [査読無し][通常論文]
  
• 画像注視時の注視領域の時間変化を考慮したテンソル解析に基づく感情推定に関する検討

  諸戸祐哉, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 ROMBUNNO.92 2018年10月27日 [査読無し][通常論文]
  
• 地下鉄トンネルの点検における視線データを用いた熟練度の分析に関する一考察

  斉藤僚汰, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 ROMBUNNO.11 2018年10月27日 [査読無し][通常論文]
  
• 深層学習に基づく画像特徴量を利用した放射線治療用CT画像における転移性骨腫瘍の検出に関する検討

  渡邊はるな, 藤後廉, 小川貴弘, 長谷山美紀, 安田耕一, THA Khin Khin, 工藤與亮, 白土博樹 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 ROMBUNNO.87 2018年10月27日 [査読無し][通常論文]
  
• AC‐GANに基づく胃炎識別のための画像生成に関する検討

  金井美岬, 藤後廉, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 ROMBUNNO.89 2018年10月27日 [査読無し][通常論文]
  
• Tri‐trainingに基づく胃X線画像を用いた胃炎の識別に関する検討

  LI Zongyao, 藤後廉, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 ROMBUNNO.88 2018年10月27日 [査読無し][通常論文]
  
• AttnGANを用いたシーン検索に関する検討―再検索の導入による高精度化―

  柳凜太郎, 藤後廉, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 ROMBUNNO.10 2018年10月27日 [査読無し][通常論文]
  
• 依頼講演 低次元画像近似に基づいたインペインティングとその工学的応用 (イメージ・メディア・クオリティ)

  小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 118 (147) 1 -4 2018年07月20日 [査読無し][通常論文]
  
• 症例報告 複数の医療施設で起立性調節障害と診断されていたシェーグレン症候群の1例

  岡本 奈央子, 岡本 義久, 石川 琢也, 大貫 裕太, 小川 玲, 児玉 雅彦, 渡邊 常樹, 西岡 貴弘, 池田 裕一, 磯山 恵一 昭和学士会雑誌 = Journal of the Showa University Society 78 (3) 275 -281 2018年06月 [査読無し][通常論文]
   

  原発性シェーグレン症候群（Sj?gren's syndrome, SS）は慢性唾液腺炎と乾燥性角膜炎を主徴とする自己免疫疾患である．小児膠原病疫学調査において若年性特発性関節炎，全身性エリテマトーデスに次ぐ高頻度な疾患であることが明らかにされた．小児では目や口の乾燥を呈する腺症状ではなく，非特異的な症状で受診する例が多い．今回，日常生活に支障をきたすほどの全身倦怠感や発熱の反復などの症状を認めながら，長期間にわたり起立性調節障害（Orthostatic Dysregulation, OD）と診断されていたSSの1例を経験したので報告する．症例は14歳女児．12歳時にめまいと一時的な両下肢の筋力低下を自覚したのを契機にODと診断された．その後も頻回な倦怠感を訴え，複数の診療科・施設でODと診断されていた．14歳時に発熱，嘔吐，腹痛，下腿紫斑を主訴に前医に入院し，アレルギー性紫斑病の疑いでプレドニゾロン（PSL）の投与を開始された．しかし，症状改善せず，多様な所見が加わったため当科に紹介となった．抗核抗体，抗SS-A/Ro抗体，抗SS-B/La抗体が陽性，ガム試験と口唇小唾液腺生検がSSの診断基準を満たし，原発性SSと診断した．PSLは漸減中止しNSAIDsの内服を開始したが，低血圧および全身倦怠感が増悪した．その後，昇圧剤やPSLの内服を再開するも症状のコントロールが困難だったため，免疫抑制剤を投与した．現在はPSL，シクロスポリン，昇圧剤の内服を併用し加療中である．倦怠感や原因不明の発熱や皮疹などの症状を繰り返す症例では，腺症状がなくともSSの可能性を考慮し，精査する必要性があると考えられた．
• 視線データと点検データの正準相関に注目した類似点検データ検索の高精度化に関する検討 (ITS)

  斉藤 僚汰, 高橋 翔, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 117 (431) 195 -200 2018年02月15日 [査読無し][通常論文]
  
• LRGAアルゴリズムを用いた昆虫同定のための類似画像検索に関する検討 : データ拡張による検索精度向上の検証 (ITS)

  弦間 奨, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 117 (431) 167 -171 2018年02月15日 [査読無し][通常論文]
  
• 楽曲聴取時のユーザに誘起される感情の推定に関する検討 : 深層学習の導入による高精度化 (ITS)

  段 博瀟, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 117 (431) 201 -206 2018年02月15日 [査読無し][通常論文]
  
• SFEM-GSによる特徴統合を利用した映像の評価値推定の高精度化 (ITS)

  伊藤 良起, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 117 (431) 315 -318 2018年02月15日 [査読無し][通常論文]
  
• 背景差分法と深層学習による歩行者検出を用いた河川CCTV映像における歩行者追跡に関する検討 (ITS)

  川本 舜, 石原 賢太, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 117 (431) 179 -183 2018年02月15日 [査読無し][通常論文]
  
• 機械学習を用いたMR画像からの転移性脳腫瘍の分類に関する一検討 (ITS)

  菅田 健斗, 小川 貴弘, 長谷山 美紀, タ キンキン, 工藤 與亮, 白土 博樹 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 117 (431) 311 -314 2018年02月15日 [査読無し][通常論文]
  
• 道路構造物に発生する変状の自動分類の高精度化に向けたConvolutional Sparse Codingの導入に関する検討 (ITS)

  前田 圭介, 高橋 翔, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 117 (431) 189 -194 2018年02月15日 [査読無し][通常論文]
  
• 作業員から取得されるセンシングデータを用いた熱中症の予兆検知に向けた検討 : 作業員の体調不良の有無に基づくセンシングデータの傾向分析 (ITS)

  佐坂 勇磨, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 117 (431) 327 -331 2018年02月15日 [査読無し][通常論文]
  
• 再帰型ニューラルネットワークを用いたサッカー映像における基本戦術の推定に関する検討 (ITS)

  鈴木 元樹, 高橋 翔, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 117 (431) 131 -135 2018年02月15日 [査読無し][通常論文]
  
• 胃X線画像を用いた胃炎識別における敵対的生成ネットワークの利用に関する検討 (ITS)

  藤後 廉, 石原 賢太, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 117 (431) 299 -303 2018年02月15日 [査読無し][通常論文]
  
• 深層学習を用いた画像共有サービスに投稿される観光画像のカテゴリ分類の高精度化に関する検討 (ITS)

  斉藤 直輝, 小川 貴弘, 浅水 仁, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 117 (431) 161 -165 2018年02月15日 [査読無し][通常論文]
  
• 映像視聴時のfNIRS信号を利用した映像に対する好みの推定に関する検討 : 複数特徴量の統合と距離計量学習の導入 (ITS)

  豊田 陽, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 117 (431) 173 -177 2018年02月15日 [査読無し][通常論文]
  
• 深層学習を用いた胃X線画像における胃がんリスク検出の高精度化に関する検討 : 複数体位から撮影される画像に対する適用 (ITS)

  石原 賢太, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 117 (431) 305 -309 2018年02月15日 [査読無し][通常論文]
  
• 岩盤の弾性波速度推定に向けたトンネル切羽画像の分類に関する初期検討 (ITS)

  濱野 翔太, 原川 良介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 117 (431) 185 -188 2018年02月15日 [査読無し][通常論文]
  
• 再帰型ニューラルネットワークを用いたサッカー映像における基本戦術の推定に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  鈴木 元樹, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 42 (4) 131 -135 2018年02月 [査読無し][通常論文]
  
• 深層学習を用いた画像共有サービスに投稿される観光画像のカテゴリ分類の高精度化に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  斉藤 直輝, 小川 貴弘, 浅水 仁, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 42 (4) 161 -165 2018年02月 [査読無し][通常論文]
  
• LRGAアルゴリズムを用いた昆虫同定のための類似画像検索に関する検討 : データ拡張による検索精度向上の検証 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  弦間 奨, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 42 (4) 167 -171 2018年02月 [査読無し][通常論文]
  
• 映像視聴時のfNIRS信号を利用した映像に対する好みの推定に関する検討 : 複数特徴量の統合と距離計量学習の導入 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  豊田 陽, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 42 (4) 173 -177 2018年02月 [査読無し][通常論文]
  
• 背景差分法と深層学習による歩行者検出を用いた河川CCTV映像における歩行者追跡に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  川本 舜, 石原 賢太, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 42 (4) 179 -183 2018年02月 [査読無し][通常論文]
  
• 岩盤の弾性波速度推定に向けたトンネル切羽画像の分類に関する初期検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  濱野 翔太, 原川 良介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 42 (4) 185 -188 2018年02月 [査読無し][通常論文]
  
• 道路構造物に発生する変状の自動分類の高精度化に向けたConvolutional Sparse Codingの導入に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  前田 圭介, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 42 (4) 189 -194 2018年02月 [査読無し][通常論文]
  
• 視線データと点検データの正準相関に注目した類似点検データ検索の高精度化に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  斉藤 僚汰, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 42 (4) 195 -200 2018年02月 [査読無し][通常論文]
  
• 楽曲聴取時のユーザに誘起される感情の推定に関する検討 : 深層学習の導入による高精度化 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  段 博瀟, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 42 (4) 201 -206 2018年02月 [査読無し][通常論文]
  
• 胃X線画像を用いた胃炎識別における敵対的生成ネットワークの利用に関する検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  藤後 廉, 石原 賢太, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 42 (4) 299 -303 2018年02月 [査読無し][通常論文]
  
• 深層学習を用いた胃X線画像における胃がんリスク検出の高精度化に関する検討 : 複数体位から撮影される画像に対する適用 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  石原 賢太, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 42 (4) 305 -309 2018年02月 [査読無し][通常論文]
  
• 機械学習を用いたMR画像からの転移性脳腫瘍の分類に関する一検討 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  菅田 健斗, 小川 貴弘, 長谷山 美紀, タ キンキン, 工藤 與亮, 白土 博樹 映像情報メディア学会技術報告 = ITE technical report 42 (4) 311 -314 2018年02月 [査読無し][通常論文]
  
• SFEM-GSによる特徴統合を利用した映像の評価値推定の高精度化 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  伊藤 良起, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 42 (4) 315 -318 2018年02月 [査読無し][通常論文]
  
• 作業員から取得されるセンシングデータを用いた熱中症の予兆検知に向けた検討 : 作業員の体調不良の有無に基づくセンシングデータの傾向分析 (マルチメディアストレージ ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  佐坂 勇磨, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 42 (4) 327 -331 2018年02月 [査読無し][通常論文]
  
• フラクタル画像符号化における復号画質とフラクタル存在量の関係に関する考察

  竹沢恵, 真田博文, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 2018年
• 複数の分類器から得られる確信度に注目したサッカー映像における重要シーンの検出に関する検討

  春山知生, 高橋翔, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 2018年
• SemiCCAに基づくfMRIデータを用いた注視画像のカテゴリ推定の高精度化に関する検討

  赤松祐亮, 原川良介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 2018年
• 複数の識別器から得られる予測値の統合に基づくフォロイー推薦の高精度化に関する検討

  滝村祥司, 原川良介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 2018年
• FCNとCNNを用いた地下鉄トンネルにおける変状検出に関する検討

  WANG An, 原川良介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 2018年
• 視線データを用いた画像注視時の感情推定に関する検討-正準相関分析に基づく画像特徴変換手法の導入-

  松井太我, 斉藤直輝, 小川貴弘, 浅水仁, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 2018年
• 深層学習に基づく特徴量を用いたサッカー映像に撮像されたフィールド位置の推定に関する検討

  鈴木元樹, 高橋翔, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 2018年
• テンソル補完に基づいたユーザの動作からの関心度推定に関する検討

  九島哲哉, 高橋翔, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 2018年
• 地下鉄トンネルにおける変状評価支援のための類似点検データ検索の初期検討

  弦間奨, 原川良介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 2018年
• 河川CCTV映像を用いた利用者の行動分類に関する初期検討

  川本舜, 原川良介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 2018年
• トンネル切羽画像を用いた岩盤の弾性波速度の推定に関する検討

  山本健太郎, 原川良介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 2018年
• 画像共有サービスにおける画像の人気度予測に関する検討-回帰問題のための特徴量変換手法の導入-

  豊田陽, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 2018年
• 反復型のMulti-channel Convolutional Sparse Codingを用いた欠損した画素値の推定に関する検討

  松本真直, 斉藤直輝, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2018 2018年
• 熟練技術者の判定に基づいた道路橋における類似点検データの検索

  斉藤 僚汰, 高橋 翔, 小川 貴弘, 長谷山 美紀 土木学会論文集F3（土木情報学） 74 (1) 67 -77 2018年 [査読無し][通常論文]
  
• 異種特徴の関連性を活用したネットワーク解析に基づく音楽動画コンテンツの推薦に関する一検討―ユーザの好みを反映可能とする特徴変換による高精度化―

  松本有衣, 原川良介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2017 ROMBUNNO.112 2017年10月28日 [査読無し][通常論文]
  
• 画像特徴量とfNIRS特徴量の関連性に注目した画像分類の高精度化に関する検討

  堀井風葉, 前田圭介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2017 ROMBUNNO.114 2017年10月28日 [査読無し][通常論文]
  
• fNIRS信号を利用した好みの映像識別に関する検討―特徴量選択の導入による高精度化―

  豊田陽, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2017 ROMBUNNO.76 2017年10月28日 [査読無し][通常論文]
  
• フラクタル画像符号化における復号画質と空隙性の関係に関する考察

  竹沢恵, 真田博文, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2017 ROMBUNNO.77 2017年10月28日 [査読無し][通常論文]
  
• 敵対的学習により生成された画像が与える審美的印象に関する検討

  金井美岬, 藤後廉, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2017 ROMBUNNO.115 2017年10月28日 [査読無し][通常論文]
  
• 背景差分法と深層学習を用いた河川CCTV映像における歩行者検出の高精度化に関する検討

  川本舜, 石原賢太, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2017 ROMBUNNO.75 2017年10月28日 [査読無し][通常論文]
  
• 適応的フィールド構成を導入したFFMに基づくツイート推薦の高精度化に関する検討

  滝村祥司, 原川良介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2017 ROMBUNNO.111 2017年10月28日 [査読無し][通常論文]
  
• 音響特徴と心拍特徴を用いた楽曲聴取時のユーザに誘起される感情の推定の高精度化に関する検討

  DUAN Boxiao, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2017 ROMBUNNO.74 2017年10月28日 [査読無し][通常論文]
  
• ランク最小化に基づく行列補完を用いた関心度推定の高精度化に関する検討

  九島哲哉, 高橋翔, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2017 ROMBUNNO.113 2017年10月28日 [査読無し][通常論文]
  
• Distress Classification of Road Structures via Adaptive Bayesian Network Model Selection

  K. Maeda, S. Takahashi, T. Ogawa, M. Haseyama JOURNAL OF COMPUTING IN CIVIL ENGINEERING 31 (5) 2017年09月 [査読無し][通常論文]
   

  This paper presents an accurate distress classification method via adaptive Bayesian network model selection for maintenance inspection of road structures. The main contribution of this paper is adaptive selection of two Bayesian network models concerning classification performance. The proposed method trains a tag-based Bayesian network model based on inspection items and estimates its classification performance. Furthermore, for distresses that degrade the classification performance of the tag-based Bayesian network model, the proposed method trains another multifeature Bayesian network model based on inspection items and distress images. Consequently, the proposed method can adaptively select optimal Bayesian network models according to the estimated performance of the tag-based Bayesian network model. In actual maintenance inspection, distresses are generally classified either from inspection items alone or from both inspection items and visual information of distress images-i.e., distress classification has two patterns. Therefore the adaptive model selection approach is suitable for this classification scheme. Experimental results show that the proposed method outperforms several comparative methods and is suitable for actual maintenance inspection due to its low computation costs. (C) 2017 American Society of Civil Engineers.
• 正準相関最大化を導入した深層学習に基づく送電鉄塔の劣化レベル分類に関する検討 (メディア工学) -- (サマーセミナー2017 : 世界に羽ばたくビジョン技術)

  前田 圭介, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 41 (29) 11 -14 2017年09月 [査読無し][通常論文]
  
• Deep Extreme Learning Machineに基づくサッカー映像に撮像されたフィールド位置の推定に関する検討 (メディア工学) -- (サマーセミナー2017 : 世界に羽ばたくビジョン技術)

  鈴木 元樹, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 41 (29) 25 -28 2017年09月 [査読無し][通常論文]
  
• 変状評価支援のための類似点検データ検索の高精度化に関する検討 : 熟練技術者の判定に関する推定に基づいた学習データ生成法の導入 (メディア工学) -- (サマーセミナー2017 : 世界に羽ばたくビジョン技術)

  斉藤 僚汰, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 41 (29) 49 -52 2017年09月 [査読無し][通常論文]
  
• 複数の条件で撮像された走査型電子顕微鏡画像を用いたゴム材料の物性値推定に関する検討 (メディア工学) -- (サマーセミナー2017 : 世界に羽ばたくビジョン技術)

  斉藤 直輝, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 41 (29) 31 -34 2017年09月 [査読無し][通常論文]
  
• Estimation of Regions Related to Helicobacter Pylori Infection from Gastric X-ray Images

  Ren Togo, Kenta Ishihara, Takahiro Ogawa, Miki Haseyama 7 -8 2017年07月 [査読無し][通常論文]
  
• Thiobacillus thioparus THI115の硫化カルボニル加水分解酵素変異体を用いた基質認識機構の検討

  小川貴弘, 野口恵一, 尾高雅文, 養王田正文, 片山葉子 生体分子科学討論会講演要旨集 44th 64‐65 2017年06月23日 [査読無し][通常論文]
  
• Thiobacillus thioparus THI115の硫化カルボニル加水分解酵素の基質認識機構の解明

  小川貴弘, 野口恵一, 尾高雅文, 養王田正文, 片山葉子 日本農芸化学会大会講演要旨集(Web) 2017 ROMBUNNO.3C26p09 (WEB ONLY) 2017年03月05日 [査読無し][通常論文]
  
• 顔器官の動きを用いた映像に対する関心の度合いの推定に関する検討 : 異常検知の枠組みの導入 (ITS)

  佐坂 勇磨, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 116 (463) 77 -80 2017年02月20日 [査読無し][通常論文]
  
• グラフ構造解析を用いたユーザと楽曲の関連性の定量化に関する検討(2)リンク予測を用いた推薦精度の検証 (ITS)

  木下 奨平, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 116 (463) 31 -34 2017年02月20日 [査読無し][通常論文]
  
• 送電鉄塔劣化診断のための見本画像の選択に関する検討 (ITS)

  藤後 廉, 高橋 翔, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 116 (463) 47 -50 2017年02月20日 [査読無し][通常論文]
  
• 画像注視時のfNIRS信号を利用した個人の感情推定に関する検討 (ITS)

  菅田 健斗, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 116 (463) 87 -90 2017年02月20日 [査読無し][通常論文]
  
• 楽曲聴取時のユーザに誘起される感情の推定に関する検討 : 複数の推定結果の統合による高精度化 (ITS)

  段 博瀟, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 116 (463) 349 -353 2017年02月20日 [査読無し][通常論文]
  
• Web映像集合の階層構造を用いた検索法に関する検討 : 可視化インタフェースを通した有効性評価 (ITS)

  竹原 大智, 原川 良介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 116 (463) 63 -66 2017年02月20日 [査読無し][通常論文]
  
• 畳み込みニューラルネットワークを用いた地下鉄トンネルにおける変状検出に関する検討 (ITS)

  石原 賢太, 高橋 翔, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 116 (463) 81 -86 2017年02月20日 [査読無し][通常論文]
  
• 深層学習を用いた道路構造物の維持管理における変状分類の高精度化に関する検討 (ITS)

  前田 圭介, 高橋 翔, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 116 (463) 51 -54 2017年02月20日 [査読無し][通常論文]
  
• 電子顕微鏡画像および配合量を用いたゴム材料の物性値推定に関する検討 (ITS)

  斉藤 直輝, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 116 (463) 41 -45 2017年02月20日 [査読無し][通常論文]
  
• 送電鉄塔の点検時に撮影される鉄塔映像からの被写体領域抽出に関する検討 (ITS)

  館農 浩平, 高橋 翔, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 116 (463) 25 -30 2017年02月20日 [査読無し][通常論文]
  
• 音響特徴量およびfMRI特徴量の協調利用による目的音検出に関する検討 (ITS)

  田中 佑磨, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 116 (463) 59 -62 2017年02月20日 [査読無し][通常論文]
  
• タグ付き画像を用いたコンセプト間の関係抽出の高精度化に関する検討 (ITS)

  濱野 翔太, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 116 (463) 67 -70 2017年02月20日 [査読無し][通常論文]
  
• 送電鉄塔の点検時に撮影される鉄塔映像からの被写体領域抽出に関する検討 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  館農 浩平, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 41 (5) 25 -30 2017年02月 [査読無し][通常論文]
  
• グラフ構造解析を用いたユーザと楽曲の関連性の定量化に関する検討(2)リンク予測を用いた推薦精度の検証 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  木下 奨平, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 41 (5) 31 -34 2017年02月 [査読無し][通常論文]
  
• 電子顕微鏡画像および配合量を用いたゴム材料の物性値推定に関する検討 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  斉藤 直輝, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 41 (5) 41 -45 2017年02月 [査読無し][通常論文]
  
• 送電鉄塔劣化診断のための見本画像の選択に関する検討 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  藤後 廉, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 41 (5) 47 -50 2017年02月 [査読無し][通常論文]
  
• 深層学習を用いた道路構造物の維持管理における変状分類の高精度化に関する検討 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  前田 圭介, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 41 (5) 51 -54 2017年02月 [査読無し][通常論文]
  
• 音響特徴量およびfMRI特徴量の協調利用による目的音検出に関する検討 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  田中 佑磨, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 41 (5) 59 -62 2017年02月 [査読無し][通常論文]
  
• Web映像集合の階層構造を用いた検索法に関する検討 : 可視化インタフェースを通した有効性評価 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  竹原 大智, 原川 良介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 41 (5) 63 -66 2017年02月 [査読無し][通常論文]
  
• タグ付き画像を用いたコンセプト間の関係抽出の高精度化に関する検討 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  濱野 翔太, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 41 (5) 67 -70 2017年02月 [査読無し][通常論文]
  
• 顔器官の動きを用いた映像に対する関心の度合いの推定に関する検討 : 異常検知の枠組みの導入 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  佐坂 勇磨, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 41 (5) 77 -80 2017年02月 [査読無し][通常論文]
  
• 畳み込みニューラルネットワークを用いた地下鉄トンネルにおける変状検出に関する検討 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  石原 賢太, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 41 (5) 81 -86 2017年02月 [査読無し][通常論文]
  
• 画像注視時のfNIRS信号を利用した個人の感情推定に関する検討 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  菅田 健斗, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 41 (5) 87 -90 2017年02月 [査読無し][通常論文]
  
• 楽曲聴取時のユーザに誘起される感情の推定に関する検討 : 複数の推定結果の統合による高精度化 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  段 博瀟, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 41 (5) 349 -353 2017年02月 [査読無し][通常論文]
  
• ICIP 2016参加報告

  小川 貴弘, 山崎 俊彦 映像情報メディア学会誌 71 (3) 202 -206 2017年 [査読無し][通常論文]
  
• 夏秋小ギクの安定生産に向けた電照栽培用品種の選抜

  森 義雄, 永井 永久, 矢野 志野布, 小川 貴弘, 廣瀬 信雄, 小田 篤, 中野 善公, 久松 完, 住友 克彦, 鈴木 安和, 山形 敦子, 村﨑 聡, 高田 真美, 矢吹 隆夫, 横井 直人, 間藤 正美, 田附 博 園芸学研究 16 (1) 27 -39 2017年 [査読無し][通常論文]
   

  本研究では，夏秋小ギクの電照栽培技術の開発・普及を目指し，暗期中断を用いた電照栽培で開花調節できる品種を選抜する手法の開発を試みた．3月から5月にかけて採穂および定植の時期を変えて夏秋小ギク品種の暗期中断条件下での発蕾を経時的に調査したところ， 'すばる' および'精ちぐさ' では長期間にわたって暗期中断条件下での花芽分化は見られなかった．一方， '精しまなみ' では季節変動がみられ，5月に採穂した株では早期に発蕾した．この知見より，夏秋小ギクの需要期を想定した場合，8月の旧盆より9月の秋彼岸に向けた栽培において暗期中断下での早期発蕾の危険性が高いと考えられたので，9月の秋彼岸に向けた作型まで暗期中断で花芽分化を質的に抑制できる品種を選抜することを目指して実験を行った．岡山県の9月開花作型に準じた栽培管理下において暗期中断条件下での発蕾が電照栽培用輪ギク品種'精雲' より遅い品種を暗期中断を用いた電照栽培に適した品種として選抜した．さらに岡山県において選抜された品種のうちいくつかを供試して，福島県，秋田県および茨城県で電照栽培試験を行った．各地で自然開花期は大きく異なったものの，暗期中断によって開花調節が可能であった．従って，本研究での電照栽培に適した品種の選抜手法は有効であると示された．

• Thiobacillus thioparus THI115の硫化カルボニル加水分解酵素によるCOS分解の硫黄同位体分別係数の決定

  小川貴弘, 服部祥平, 亀崎和輝, 加藤広海, 吉田尚弘, 吉田尚弘, 片山葉子 日本生化学会大会(Web) 90th ROMBUNNO.3AT12‐13(3P‐0235) (WEB ONLY) 2017年 [査読無し][通常論文]
  
• 特定集中治療室用の重症度推定に関する一考察~疾病による推定精度の違い~

  畠山泰貴, 小川貴弘, 田中宏和, 長谷山美紀 情報理論とその応用シンポジウム予稿集(CD-ROM) 39th ROMBUNNO.9.3.2 2016年12月06日 [査読無し][通常論文]
  
• 既存水蓄熱槽を利用したダイナミック氷蓄熱システムへのリニューアル「新梅田シティ梅田スカイビル」における導入事例

  小川貴弘 建築設備と配管工事 54 (14) 40‐44 2016年12月05日 [査読無し][通常論文]
  
• 画像注視時における脳機能画像のテンソル解析に基づく感情推定に関する検討

  菅田健斗, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2016 ROMBUNNO.109 2016年11月05日 [査読無し][通常論文]
  
• 深層学習によって得られる画像特徴量を用いた道路構造物の点検データ検索の高精度化に関する検討

  斉藤僚汰, 高橋翔, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2016 ROMBUNNO.114 2016年11月05日 [査読無し][通常論文]
  
• Signedネットワーク解析に基づくWeb映像集合の階層構造抽出に関する一検討

  原川良介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2016 ROMBUNNO.103 2016年11月05日 [査読無し][通常論文]
  
• 音響特徴と心拍特徴を用いた感情推定に基づく楽曲分類に関する検討―Decision‐Level Fusionによる高精度化―

  DUAN Boxiao, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2016 ROMBUNNO.101 2016年11月05日 [査読無し][通常論文]
  
• 画像注視時のユーザの脳波信号を利用した好みの画像の識別に関する検討

  豊田陽, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2016 ROMBUNNO.108 2016年11月05日 [査読無し][通常論文]
  
• 深層学習を用いた胃X線画像におけるHelicobacter pylori感染識別に関する初期検討

  石原賢太, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2016 ROMBUNNO.115 2016年11月05日 [査読無し][通常論文]
  
• タグ付き画像を用いたオントロジー構築におけるコンセプト間の包摂関係の定量化に関する検討

  濱野翔太, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2016 ROMBUNNO.102 2016年11月05日 [査読無し][通常論文]
  
• 昆虫の同定を目的とした類似画像検索の高精度化に関する検討

  弦間奨, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2016 ROMBUNNO.100 2016年11月05日 [査読無し][通常論文]
  
• ユーザの視聴動作を用いた映像の評価値推定の高精度化に関する検討

  伊藤良起, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2016 ROMBUNNO.107 2016年11月05日 [査読無し][通常論文]
  
• ファラデー効果を利用した光ファイバ雨量計について

  小川貴弘 建設電気技術技術集 2016 33‐35 2016年09月15日 [査読無し][通常論文]
  
• Web映像検索を目的としたリランキングの高精度化に関する検討

  吉田壮, 小川貴弘, 長谷山美紀, 棟安実治 電子情報通信学会大会講演論文集(CD-ROM) 2016 ROMBUNNO.A‐15‐5 2016年09月06日 [査読無し][通常論文]
  
• 画像共有サービスに投稿される画像の観光名所に関するカテゴリー分類

  斉藤 直輝, 小川 貴弘, 浅水 仁, 長谷山 美紀 電子情報通信学会論文誌 D 99 (9) 848 -860 2016年09月01日 [査読無し][通常論文]
   

  本論文では，画像共有サービスに投稿される画像の観光名所に関するカテゴリー（観光カテゴリー）の分類手法を提案する．提案手法では，画像共有サービスにおいて画像とともに投稿される様々なデータの中で，位置座標が観光カテゴリーの分類に最も効果的であることに注目する．更に，このデータに基づいた分類において誤りが発生する場合を，分類結果から導出される確信度に基づいて判定する．誤分類と判定された場合，提案手法では，画像及びタグの特徴に基づいた分類結果を求め，それらを各々の分類精度に注目して統合することで，最終的な分類結果を高精度に推定可能とする．このとき，位置座標による分類結果に基づいて分類候補の観光カテゴリーを限定することで，多クラス分類問題におけるクラス数を減少させ，より正確な分類を可能とする．以上の提案手法によって，異なる種類のデータの分類精度が互いに大きく異なる場合に従来手法では困難であった高精度な最終分類結果の取得が可能となる．
• ダイナミック式氷蓄熱システムにおける氷核融解熱量の最少化

  小川貴弘, 田村記秀, 山田育弘 新菱冷熱中央研究所報 23 33‐38 2016年08月25日 [査読無し][通常論文]
  
• マダラシミ鱗粉の摩擦特性

  平井悠司, 奥田直人, 斉藤直樹, 小川貴弘, 町田龍一郎, 野村周平, 大原昌宏, 長谷山美紀, 下村政嗣 高分子学会予稿集(CD-ROM) 65 (2) ROMBUNNO.2U01 2016年08月24日 [査読無し][通常論文]
  
• 音響聴取時の脳活動信号を用いた目的音検出に関する検討

  田中佑磨, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 40 (28(ME2016 88-115)) 81‐82 2016年08月24日 [査読無し][通常論文]
  
• 生物の走査型電子顕微鏡像の撮像部位の分類における特徴選択方法に関する検討

  斉藤直輝, 小川貴弘, 平井悠司, 長谷山美紀 映像情報メディア学会技術報告 40 (28(ME2016 88-115)) 19‐20 2016年08月24日 [査読無し][通常論文]
  
• 個人の画像注視時の脳機能画像を利用した感情推定に関する検討―複数のブロードマン領野から得られる推定結果の統合による高精度化―

  菅田健斗, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 40 (28(ME2016 88-115)) 71‐72 2016年08月24日 [査読無し][通常論文]
  
• 火星に発生するdust stormの自動検出に関する検討―不均衡データを考慮した識別器の構築―

  前田圭介, 小川貴弘, 長谷山美紀 映像情報メディア学会技術報告 40 (28(ME2016 88-115)) 47‐48 2016年08月24日 [査読無し][通常論文]
  
• 高速道路の維持管理における点検記録データ検索に対する技術者の評価を用いた検索精度向上に関する検討

  高橋翔, 小川貴弘, 長谷山美紀 映像情報メディア学会年次大会講演予稿集(CD-ROM) 2016 ROMBUNNO.22B‐1 2016年08月17日 [査読無し][通常論文]
  
• 胃X線画像におけるHelicobacter pylori感染識別に関する検討(3)医療施設における撮像環境と識別精度間の関連性に関する一考察 (バイオメトリクス)

  石原 賢太, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 116 (107) 57 -62 2016年06月20日 [査読無し][通常論文]
  
• 胃X線画像におけるHelicobacter pylori感染識別に関する検討(3)医療施設における撮像環境と識別精度間の関連性に関する一考察 (情報センシング メディア工学)

  石原 賢太, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 40 (18) 57 -62 2016年06月13日 [査読無し][通常論文]
  
• BI-8-7 防災用光ファイバセンサ(BI-8. 光ファイバセンサの現状と将来動向,依頼シンポジウム,ソサイエティ企画)

  小川 雅英, 山下 鉄広, 嘉本 健治, 小川 貴弘, 村上 恵司, 渡部 敬介 電子情報通信学会総合大会講演論文集 2016 (2) "SS -132"-"SS-133" 2016年03月01日 [査読無し][通常論文]
  
• 生物の走査型電子顕微鏡像の撮像部位の分類に関する検討 : カーネル法の導入による複数の分類結果統合の高精度化 (ITS)

  斉藤 直輝, 小川 貴弘, 平井 悠司 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (458) 51 -54 2016年02月22日 [査読無し][通常論文]
  
• 高速道路の維持管理における変状の評価業務を支援するためのデータ分析 : 変状の画像を用いた類似点検記録の検索法の実現 (ITS)

  三改木 裕矢, 高橋 翔, 小川 貴弘 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (458) 169 -172 2016年02月22日 [査読無し][通常論文]
  
• 河川管理業務の堤防点検における技術者の視線データ取得の試み (ITS)

  三改木 裕矢, 高橋 翔, 小川 貴弘 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (458) 173 -176 2016年02月22日 [査読無し][通常論文]
  
• 堤防点検における技術者の視線データと熟練度の分析に関する一考察 (ITS)

  高橋 翔, 三改木 裕矢, 小川 貴弘 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (458) 177 -180 2016年02月22日 [査読無し][通常論文]
  
• 道路構造物の維持管理における高精度な変状分類に関する検討 : タグデータと撮影画像に基づく識別結果の統合 (ITS)

  前田 圭介, 高橋 翔, 小川 貴弘 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (458) 181 -184 2016年02月22日 [査読無し][通常論文]
  
• 異なるソーシャルメディアのコンテンツを用いた階層的トピック検出に関する検討 (ITS)

  竹原 大智, 原川 良介, 小川 貴弘 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (458) 193 -196 2016年02月22日 [査読無し][通常論文]
  
• 胃X線画像を用いたHelicobacter Pylori感染の高精度識別に関する検討(3)識別精度低下の原因となる領域の推定 (ITS)

  藤後 廉, 石原 賢太, 小川 貴弘 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (458) 333 -336 2016年02月22日 [査読無し][通常論文]
  
• グラフ構造に基づくリランキングを利用したWeb映像検索の高精度化に関する検討 (画像工学)

  吉田 壮, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (459) 197 -200 2016年02月22日 [査読無し][通常論文]
  
• Web映像集合の階層構造の時系列変化検出に関する一検討 (画像工学)

  原川 良介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (459) 201 -204 2016年02月22日 [査読無し][通常論文]
  
• グラフ構造解析を用いたユーザと楽曲の関連性の定量化に関する検討 (画像工学)

  木下 奨平, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (459) 209 -212 2016年02月22日 [査読無し][通常論文]
  
• ヒトの楽曲聴取時の脳機能画像における賦活部位の抽出に関する検討 (画像工学)

  澤田 充奨, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (459) 213 -216 2016年02月22日 [査読無し][通常論文]
  
• パワースペクトルに注目した音響信号のスパース表現の定量評価 (画像工学)

  田中 佑磨, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (459) 217 -220 2016年02月22日 [査読無し][通常論文]
  
• 胃X線画像におけるHelicobacter pylori感染識別に関する検討(2)血液検査におけるHp抗体値およびPG値を用いた識別に有効な画像特徴量の導入 (画像工学)

  石原 賢太, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (459) 329 -332 2016年02月22日 [査読無し][通常論文]
  
• Web上に存在する画像データの可視化のための次元削減に関する検討 (画像工学)

  館農 浩平, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (459) 337 -340 2016年02月22日 [査読無し][通常論文]
  
• グラフ構造に基づくリランキングを利用したWeb映像検索の高精度化に関する検討 (ITS)

  吉田 壮, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (458) 197 -200 2016年02月22日 [査読無し][通常論文]
  
• Web映像集合の階層構造の時系列変化検出に関する一検討 (ITS)

  原川 良介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (458) 201 -204 2016年02月22日 [査読無し][通常論文]
  
• グラフ構造解析を用いたユーザと楽曲の関連性の定量化に関する検討 (ITS)

  木下 奨平, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (458) 209 -212 2016年02月22日 [査読無し][通常論文]
  
• ヒトの楽曲聴取時の脳機能画像における賦活部位の抽出に関する検討 (ITS)

  澤田 充奨, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (458) 213 -216 2016年02月22日 [査読無し][通常論文]
  
• パワースペクトルに注目した音響信号のスパース表現の定量評価 (ITS)

  田中 佑磨, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (458) 217 -220 2016年02月22日 [査読無し][通常論文]
  
• 胃X線画像におけるHelicobacter pylori感染識別に関する検討(2)血液検査におけるHp抗体値およびPG値を用いた識別に有効な画像特徴量の導入 (ITS)

  石原 賢太, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (458) 329 -332 2016年02月22日 [査読無し][通常論文]
  
• Web上に存在する画像データの可視化のための次元削減に関する検討 (ITS)

  館農 浩平, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 115 (458) 337 -340 2016年02月22日 [査読無し][通常論文]
  
• 生物の走査型電子顕微鏡像の撮像部位の分類に関する検討 : カーネル法の導入による複数の分類結果統合の高精度化 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  斉藤 直輝, 小川 貴弘, 平井 悠司, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 40 (6) 51 -54 2016年02月 [査読無し][通常論文]
  
• 高速道路の維持管理における変状の評価業務を支援するためのデータ分析 : 変状の画像を用いた類似点検記録の検索法の実現 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  三改木 裕矢, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 40 (6) 169 -172 2016年02月 [査読無し][通常論文]
  
• 河川管理業務の堤防点検における技術者の視線データ取得の試み (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  三改木 裕矢, 高橋 翔, 小川 貴弘, 秋山 泰祐, 巖倉 啓子, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 40 (6) 173 -176 2016年02月 [査読無し][通常論文]
  
• 堤防点検における技術者の視線データと熟練度の分析に関する一考察 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  高橋 翔, 三改木 裕矢, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 40 (6) 177 -180 2016年02月 [査読無し][通常論文]
  
• 道路構造物の維持管理における高精度な変状分類に関する検討 : タグデータと撮影画像に基づく識別結果の統合 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  前田 圭介, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 40 (6) 181 -184 2016年02月 [査読無し][通常論文]
  
• 異なるソーシャルメディアのコンテンツを用いた階層的トピック検出に関する検討 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  竹原 大智, 原川 良介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 40 (6) 193 -196 2016年02月 [査読無し][通常論文]
  
• グラフ構造に基づくリランキングを利用したWeb映像検索の高精度化に関する検討 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  吉田 壮, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 40 (6) 197 -200 2016年02月 [査読無し][通常論文]
  
• Web映像集合の階層構造の時系列変化検出に関する一検討 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  原川 良介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 40 (6) 201 -204 2016年02月 [査読無し][通常論文]
  
• グラフ構造解析を用いたユーザと楽曲の関連性の定量化に関する検討 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  木下 奨平, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 40 (6) 209 -212 2016年02月 [査読無し][通常論文]
  
• ヒトの楽曲聴取時の脳機能画像における賦活部位の抽出に関する検討 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  澤田 充奨, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 40 (6) 213 -216 2016年02月 [査読無し][通常論文]
  
• パワースペクトルに注目した音響信号のスパース表現の定量評価 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  田中 佑磨, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 40 (6) 217 -220 2016年02月 [査読無し][通常論文]
  
• 胃X線画像におけるHelicobacter pylori感染識別に関する検討(2)血液検査におけるHp抗体値およびPG値を用いた識別に有効な画像特徴量の導入 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  石原 賢太, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 40 (6) 329 -332 2016年02月 [査読無し][通常論文]
  
• 胃X線画像を用いたHelicobacter Pylori感染の高精度識別に関する検討(3)識別精度低下の原因となる領域の推定 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  藤後 廉, 石原 賢太, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 40 (6) 333 -336 2016年02月 [査読無し][通常論文]
  
• Web上に存在する画像データの可視化のための次元削減に関する検討 (マルチメディアストレージ コンシューマエレクトロニクス ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  館農 浩平, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 40 (6) 337 -340 2016年02月 [査読無し][通常論文]
  
• DLF-based speech segment detection and its application to audio noise removal for video conferences

  Kazuto Sasaki, Takahiro Ogawa, Sho Takahashi, Miki Haseyama ITE Transactions on Media Technology and Applications 4 (1) 68 -77 2016年 [査読無し][通常論文]
   

  A new decision-level fusion (DLF)-based speech segment detection method and its application to audio noise removal for video conferences are presented in this paper. The proposed method calculates visual and audio features from video sequences and audio signals, respectively, obtained in video conferences. Features extracted from mouth regions of participants and attribution degrees of speech class are used as visual and audio features, respectively, and Support Vector Machine (SVM)-based classification is performed by using each kind of feature. The SVM classifier performs two-class classification of speech and non-speech segments to realize speech segment detection. From the detection results obtained from the visual and audio features, DLF based on Supervised Learning from Multiple Experts is performed to successfully obtain the final detection results with focus on the accuracy of each detection result. Then, from audio signals in the non-speech segments detected by our method, we can extract noise information to realize accurate audio noise removal in the speech segments.
• Accurate and efficient extraction of hierarchical structure ofweb communities for web video retrieval

  Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama ITE Transactions on Media Technology and Applications 4 (1) 49 -59 2016年 [査読無し][通常論文]
   

  This paper presents an accurate and efficient method for extracting hierarchical structure of Web communities, i.e., Web video sets with similar topics for Web video retrieval. First, efficient canonical correlation analysis (CCA), named sub-sampled CCA, is derived to obtain link relationships that represent similarities between latent features of Web videos. Moreover, the obtained link relationships enable application of an algorithm based on recursive modularity optimization to extract hierarchical structure of Web communities. Different from previously reported methods, our method can extract the hierarchical structure for the whole target dataset since the algorithm enables recursive reduction of its processing targets. This means it becomes unnecessary to perform screening of Web videos, and we can avoid performance degradation caused by discarding relevant Web videos in the screening, which occurred in previously reported methods. Consequently, our method enables extraction of the hierarchical structure with high accuracy as well as low computational cost.
• Classification of gastric cancer risk from X-ray images based on efficient image features related to serum Hp antibody level and serum PG levels

  Kenta Ishihara, Takahiro Ogawa, Miki Haseyama ITE Transactions on Media Technology and Applications 4 (4) 337 -348 2016年 [査読無し][通常論文]
   

  In this paper, a fully automatic gastric cancer risk classification method with the aim of constructing a computer-aided diagnosis (CAD) system is presented. Two-stage classification is used in the proposed method for determining gastric cancer risk. In the first stage, the proposed method detects H. pylori-infected patients, i.e., detection of patients who have gastric cancer risk, and the proposed method classifies the level of gastric cancer risk, i.e., high or low, from H. pylori-infected patients in the second stage. In each stage, we derive new image features that are closely related to values of blood examination via kernel canonical correlation analysis. The introduction of these new image features provides classification improvement in each stage, and it is the main contribution of this paper. Consequently, accurate classification becomes feasible by the proposed method. Experimental results obtained by applying the proposed method to real X-ray images show that our method outperforms several comparative methods.
• Web映像検索のためのグラフマイニングを用いたリランキング手法

  吉田壮, 小川貴弘, 長谷山美紀, 棟安実治 信号処理シンポジウム講演論文集(CD-ROM) 31st ROMBUNNO.A6‐5 2016年 [査読無し][通常論文]
  
• 深層学習を用いた胃X線画像におけるHelicobacter pylori感染識別手法の高精度化に関する検討

  石原賢太, 小川貴弘, 長谷山美紀 信号処理シンポジウム講演論文集(CD-ROM) 31st ROMBUNNO.B4‐1 2016年 [査読無し][通常論文]
  
• 胃X線画像を用いたHelicobacter Pylori感染の高精度識別に関する検討(4)

  藤後廉, 石原賢太, 小川貴弘, 長谷山美紀 信号処理シンポジウム講演論文集(CD-ROM) 31st ROMBUNNO.B4‐2 2016年 [査読無し][通常論文]
  
• 画像共有サービスにおける投稿画像の分類結果の信頼度推定に関する検討

  斉藤直輝, 小川貴弘, 浅水仁, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2015 ROMBUNNO.128 2015年11月07日 [査読無し][通常論文]
  
• 道路構造物の変状画像に対する類似検索の高精度化に関する検討

  高橋翔, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2015 ROMBUNNO.134 2015年11月07日 [査読無し][通常論文]
  
• Web映像検索のためWebコミュニティの提示法に関する検討―Webコミュニティに含まれるトピックを考慮した代表キーフレーズ抽出の試み―

  竹原大智, 原川良介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2015 ROMBUNNO.122 2015年11月07日 [査読無し][通常論文]
  
• 個々の道路構造物に関する点検項目の導入による道路構造物の変状推定の高精度化に関する検討

  前田圭介, 高橋翔, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2015 ROMBUNNO.133 2015年11月07日 [査読無し][通常論文]
  
• 胃X線画像を用いたHelicobacter pylori感染の高精度識別に関する検討(2)―撮像方向が識別に有効な画像領域に与える影響に対する考察―

  藤後廉, 石原賢太, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2015 ROMBUNNO.123 2015年11月07日 [査読無し][通常論文]
  
• 楽曲中の歌唱区間推定における簡易脳波計の導入に関する検討

  菅田健斗, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2015 ROMBUNNO.121 2015年11月07日 [査読無し][通常論文]
  
• 顔器官の動きに基づく関心の有無の推定に関する検討

  佐坂勇磨, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2015 ROMBUNNO.120 2015年11月07日 [査読無し][通常論文]
  
• 分類体系に注目した決定木の構築に基づく走査型電子顕微鏡画像を 用いた生物の分類法

  朴 君, 小川 貴弘, 長谷山 美紀 電子情報通信学会論文誌 D, 情報・システム 98 (5) 823 -834 2015年05月01日 [査読無し][通常論文]
   

  本論文では，走査型電子顕微鏡(Scanning Electron Microscop，SEM)で撮像された画像を用いた生物の分類法を提案する．提案手法では，生物学者が構築した分類体系に注目し，各ノードにその下位のノードへの分類を行う分類器を割り当てることで，決定木を構築する．これにより，構築された決定木を用いて生物の分類が可能となる．このように，生物の分類に有用な分類体系の構造を導入することで，画像特徴のみに注目する生物の分類法と比較して，高精度な分類が期待できる．また，提案手法では，更なる精度向上のため，以下の二つの処理も導入する．まず，分類体系において，画像特徴が類似する異なるノードに注目した決定木の変更を行い，誤分類を抑制する．次に，同種の生物の異なる撮像倍率の画像に対し，モーフィングを施すことで学習データの充足を行う．以上によって，提案手法では，SEMで撮像された生物の高精度な分類が可能となる．本論文の最後では，提案手法の有効性を確認するための実験結果を示す．
• 映像特徴とタグ情報を考慮したネットワーク構造解析に基づくWeb 映像検索に関する検討 : ネットワークの局所的構造を考慮した正則化項の導入による高精度化 (ITS)

  吉田 壮, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 114 (459) 77 -82 2015年02月23日 [査読無し][通常論文]
  
• 検索結果の評価を用いた類似画像検索の高精度化に関する検討 : 電子顕微鏡により撮像された生物の表面構造の類似度評価への応用 (ITS)

  高橋 昌弘, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 114 (459) 83 -88 2015年02月23日 [査読無し][通常論文]
  
• Web映像検索のためのWebコミュニティの階層構造提示法に関する一検討 : Webコミュニティを代表するキーワード抽出の試み (ITS)

  原川 良介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 114 (459) 89 -94 2015年02月23日 [査読無し][通常論文]
  
• 顕微鏡による生物の撮像方法に着目した超解像に関する検討 (ITS)

  廣川 真梨子, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 114 (459) 167 -172 2015年02月23日 [査読無し][通常論文]
  
• 走査型電子顕微鏡画像を用いた生物の分類の高精度化 : 顕微鏡画像の取得方法に注目した学習データ選択法の導入 (ITS)

  朴 君, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 114 (459) 173 -178 2015年02月23日 [査読無し][通常論文]
  
• 楽曲聴取時の個人の脳波信号を利用した好みの楽曲の識別に関する検討 : クラス情報を考慮した正準相関分析による高精度化 (ITS)

  澤田 充奨, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 114 (459) 179 -184 2015年02月23日 [査読無し][通常論文]
  
• 画像注視時の脳波特徴量を用いた画像分類に関する検討(4)複数のユーザの脳波を用いた分類精度の検証 (ITS)

  川上 拓也, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 114 (459) 185 -190 2015年02月23日 [査読無し][通常論文]
  
• 胃X線画像におけるHelicobacter pyloriの感染識別に関する検討 : 特徴統合と識別結果統合の識別精度比較 (ITS)

  石原 賢太, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 114 (459) 191 -196 2015年02月23日 [査読無し][通常論文]
  
• Superpixel算出手法の導入による光源および分光反射率推定の高精度化に関する検討 (ITS)

  五十嵐 祐太, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 114 (459) 247 -252 2015年02月23日 [査読無し][通常論文]
  
• 映像特徴とタグ情報を考慮したネットワーク構造解析に基づくWeb 映像検索に関する検討 : ネットワークの局所的構造を考慮した正則化項の導入による高精度化 (画像工学)

  吉田 壮, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 114 (460) 77 -82 2015年02月23日 [査読無し][通常論文]
  
• 検索結果の評価を用いた類似画像検索の高精度化に関する検討 : 電子顕微鏡により撮像された生物の表面構造の類似度評価への応用 (画像工学)

  高橋 昌弘, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 114 (460) 83 -88 2015年02月23日 [査読無し][通常論文]
  
• Web映像検索のためのWebコミュニティの階層構造提示法に関する一検討 : Webコミュニティを代表するキーワード抽出の試み (画像工学)

  原川 良介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 114 (460) 89 -94 2015年02月23日 [査読無し][通常論文]
  
• 顕微鏡による生物の撮像方法に着目した超解像に関する検討 (画像工学)

  廣川 真梨子, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 114 (460) 167 -172 2015年02月23日 [査読無し][通常論文]
  
• 走査型電子顕微鏡画像を用いた生物の分類の高精度化 : 顕微鏡画像の取得方法に注目した学習データ選択法の導入 (画像工学)

  朴 君, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 114 (460) 173 -178 2015年02月23日 [査読無し][通常論文]
  
• 楽曲聴取時の個人の脳波信号を利用した好みの楽曲の識別に関する検討 : クラス情報を考慮した正準相関分析による高精度化 (画像工学)

  澤田 充奨, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 114 (460) 179 -184 2015年02月23日 [査読無し][通常論文]
  
• 画像注視時の脳波特徴量を用いた画像分類に関する検討(4)複数のユーザの脳波を用いた分類精度の検証 (画像工学)

  川上 拓也, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 114 (460) 185 -190 2015年02月23日 [査読無し][通常論文]
  
• 胃X線画像におけるHelicobacter pyloriの感染識別に関する検討 : 特徴統合と識別結果統合の識別精度比較 (画像工学)

  石原 賢太, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 114 (460) 191 -196 2015年02月23日 [査読無し][通常論文]
  
• Superpixel算出手法の導入による光源および分光反射率推定の高精度化に関する検討 (画像工学)

  五十嵐 祐太, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 114 (460) 247 -252 2015年02月23日 [査読無し][通常論文]
  
• 社会インフラの維持管理業務効率化のための点検データ分析に関する検討―撮影画像と点検結果に基づく点検データ間の関連性の定量化―

  三改木裕矢, 高橋翔, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 114 (460(IE2014 67-86)) 257 -262 2015年02月16日 [査読無し][通常論文]
  
• 画像共有サイトの投稿画像の高精度な分類に関する検討

  斉藤直輝, 小川貴弘, 浅水仁, 長谷山美紀 電子情報通信学会技術研究報告 114 (460(IE2014 67-86)) 71 -75 2015年02月16日 [査読無し][通常論文]
  
• 映像と視聴動作の関連性に基づくユーザの嗜好の推定に関する検討―視聴動作データが少数の場合の精度劣化低減手法の実現―

  山口由晃, 小川貴弘, 浅水仁, 長谷山美紀 電子情報通信学会技術研究報告 114 (460(IE2014 67-86)) 253 -256 2015年02月16日 [査読無し][通常論文]
  
• 映像特徴とタグ情報を考慮したネットワーク構造解析に基づくWeb映像検索に関する検討 : ネットワークの局所的構造を考慮した正則化項の導入による高精度化 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス マルチメディアストレージ コンシューマエレクトロニクス)

  吉田 壮, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 39 (7) 77 -82 2015年02月16日 [査読無し][通常論文]
  
• 検索結果の評価を用いた類似画像検索の高精度化に関する検討 : 電子顕微鏡により撮像された生物の表面構造の類似度評価への応用 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス マルチメディアストレージ コンシューマエレクトロニクス)

  高橋 昌弘, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 39 (7) 83 -88 2015年02月16日 [査読無し][通常論文]
  
• Web映像検索のためのWebコミュニティの階層構造提示法に関する一検討 : Webコミュニティを代表するキーワード抽出の試み (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス マルチメディアストレージ コンシューマエレクトロニクス)

  原川 良介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 39 (7) 89 -94 2015年02月16日 [査読無し][通常論文]
  
• 顕微鏡による生物の撮像方法に着目した超解像に関する検討 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス マルチメディアストレージ コンシューマエレクトロニクス)

  廣川 真梨子, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 39 (7) 167 -172 2015年02月16日 [査読無し][通常論文]
  
• 走査型電子顕微鏡画像を用いた生物の分類の高精度化 : 顕微鏡画像の取得方法に注目した学習データ選択法の導入 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス マルチメディアストレージ コンシューマエレクトロニクス)

  朴 君, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 39 (7) 173 -178 2015年02月16日 [査読無し][通常論文]
  
• 楽曲聴取時の個人の脳波信号を利用した好みの楽曲の識別に関する検討 : クラス情報を考慮した正準相関分析による高精度化 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス マルチメディアストレージ コンシューマエレクトロニクス)

  澤田 充奨, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 39 (7) 179 -184 2015年02月16日 [査読無し][通常論文]
  
• 画像注視時の脳波特徴量を用いた画像分類に関する検討(4)複数のユーザの脳波を用いた分類精度の検証 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス マルチメディアストレージ コンシューマエレクトロニクス)

  川上 拓也, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 39 (7) 185 -190 2015年02月16日 [査読無し][通常論文]
  
• 胃X線画像におけるHelicobacter pyloriの感染識別に関する検討 : 特徴統合と識別結果統合の識別精度比較 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス マルチメディアストレージ コンシューマエレクトロニクス)

  石原 賢太, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 39 (7) 191 -196 2015年02月16日 [査読無し][通常論文]
  
• Superpixel算出手法の導入による光源および分光反射率推定の高精度化に関する検討 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス マルチメディアストレージ コンシューマエレクトロニクス)

  五十嵐 祐太, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 39 (7) 247 -252 2015年02月16日 [査読無し][通常論文]
  
• 社会インフラの維持管理業務効率化のための点検データ分析に関する検討 : 撮影画像と点検結果に基づく点検データ間の関連性の定量化 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス マルチメディアストレージ コンシューマエレクトロニクス)

  三改木 裕矢, 高橋 翔, 小川 貴弘 映像情報メディア学会技術報告 = ITE technical report 39 (7) 257 -262 2015年02月 [査読無し][通常論文]
  
• 映像と視聴動作の関連性に基づくユーザの嗜好の推定に関する検討 : 視聴動作データが少数の場合の精度劣化低減手法の実現 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス マルチメディアストレージ コンシューマエレクトロニクス)

  山口 由晃, 小川 貴弘, 浅水 仁 映像情報メディア学会技術報告 = ITE technical report 39 (7) 253 -256 2015年02月 [査読無し][通常論文]
  
• 画像共有サイトの投稿画像の高精度な分類に関する検討 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス マルチメディアストレージ コンシューマエレクトロニクス)

  斉藤 直輝, 小川 貴弘, 浅水 仁 映像情報メディア学会技術報告 = ITE technical report 39 (7) 71 -75 2015年02月 [査読無し][通常論文]
  
• Estimation of video authenticity through collaborative use of available video signals

  Michael Penkov, Takahiro Ogawa, Miki Haseyama ITE Transactions on Media Technology and Applications 3 (3) 214 -225 2015年 [査読無し][通常論文]
   

  This paper proposes a method for identifying the video that retains the most information from its parent video. Since the parent video is often unavailable, the proposed method estimates its content through the collaborative use of the available video signals that are edited copies of the parent video. By reducing the difference between the video signals of the edited videos, the proposed method then enables the use of conventional no-reference video quality assessment algorithms. Since editing a video requires recompressing it, and since quality assessment algorithms can detect signs of recompression, the proposed method can identify the edited video that retains the most information from the parent video. The effectiveness of the proposed method is verified by subjective experiments over artifical and real-world data sets that include a total of over 400 videos.
• 胃X線画像を用いた胃がん発症リスクの推定―リスク推定に用いる分類手法の比較による初期検討―

  石原賢太, 小川貴弘, 長谷山美紀 信号処理シンポジウム講演論文集(CD-ROM) 30th ROMBUNNO.C4‐5 2015年 [査読無し][通常論文]
  
• グラフ構造に基づくリランキングを利用したWeb映像検索に関する検討~初期検索結果の誤りを考慮した最適化に基づく高精度化~

  吉田壮, 小川貴弘, 長谷山美紀 信号処理シンポジウム講演論文集(CD-ROM) 30th ROMBUNNO.A2‐3 2015年 [査読無し][通常論文]
  
• 胃X線画像を用いたHelicobacter pylori感染の高精度識別に関する検討(1)―識別精度向上に有効な画像領域の抽出手法―

  藤後廉, 石原賢太, 小川貴弘, 長谷山美紀 信号処理シンポジウム講演論文集(CD-ROM) 30th ROMBUNNO.C4‐4 2015年 [査読無し][通常論文]
  
• 画像注視時の脳波特徴量を用いた画像分類に関する検討(5)―KESLMEを用いた教師あり分類結果統合に基づく高精度化―

  菅田健斗, 小川貴弘, 長谷山美紀 信号処理シンポジウム講演論文集(CD-ROM) 30th ROMBUNNO.A5‐4 2015年 [査読無し][通常論文]
  
• 視聴動作に基づくユーザの関心対象を考慮した映像に対する関心の有無の識別に関する検討

  山口由晃, 小川貴弘, 浅水仁, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2014 ROMBUNNO.165 2014年10月25日 [査読無し][通常論文]
  
• トピックモデルを用いた複数特徴の統合による画像群の可視化に関する検討

  館農浩平, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2014 ROMBUNNO.136 2014年10月25日 [査読無し][通常論文]
  
• 画像共有サイトへの投稿画像およびそのメタデータに注目したマルチモーダル画像検索手法に関する検討

  斉藤直輝, 小川貴弘, 浅水仁, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2014 ROMBUNNO.141 2014年10月25日 [査読無し][通常論文]
  
• Web映像検索のための意味内容を考慮したWebコミュニティの階層構造抽出に関する一検討

  竹原大智, 原川良介, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2014 ROMBUNNO.164 2014年10月25日 [査読無し][通常論文]
  
• 複数の画像特徴を用いたベイジアンネットワークに基づく構造物の変状の推定の高精度化に関する検討

  前田圭介, 高橋翔, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2014 ROMBUNNO.140 2014年10月25日 [査読無し][通常論文]
  
• パワースペクトログラム誤差最小化に基づく消失音響区間の再構成手法に関する検討

  田中佑磨, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2014 ROMBUNNO.135 2014年10月25日 [査読無し][通常論文]
  
• 維持管理業務の効率化に向けた点検データの類似度算出における特徴選択に関する検討

  三改木裕矢, 高橋翔, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2014 ROMBUNNO.139 2014年10月25日 [査読無し][通常論文]
  
• トピックモデルに基づく音響特徴と時間情報を考慮した流行曲識別に関する検討

  木下奨平, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2014 ROMBUNNO.134 2014年10月25日 [査読無し][通常論文]
  
• 歌謡番組における映像の構造に注目したシーン分割手法

  吉田壮, 小川貴弘, 長谷山美紀 電子情報通信学会論文誌 D(Web) J97-D (7) 1177-1188 (WEB ONLY) 2014年07月01日 [査読無し][通常論文]
  
• A Fan Beam Microwave CT System Which Determines the Straight Transmission Path by Time-Domain Measurement of Demodulated dc Voltage

  Mutsumi Tamura, Takahiro Ogawa, Yuuki Takeuchi, Michio Miyakawa ELECTRONICS AND COMMUNICATIONS IN JAPAN 97 (5) 13 -21 2014年05月 [査読無し][通常論文]
   

  We have developed a demodulated direct current voltage-based microwave CT system (dc-MCT) based on chirp-pulse microwave CT. The dc-MCT utilizes time-domain measurement to determine the shortest propagation path between the transmitting and receiving antennas. By using a standard SG with low phase noise and phase synchronization of the signal source, reconstructed amplitude and phase images can be obtained. In a study of high-speed imaging, the method of measurement and the influence of overshoot characteristics from the low-pass filter were examined, and the images were evaluated using 50 and 72 rotary scans. In addition, for the purpose of improving resolution, an attempt to obtain a time-domain spectrum that gives the maximum value of the amplitude showed the possibility of improving the dynamic range of the receiver. Thus this paper demonstrates the usefulness of the new method of microwave imaging.
• 映像の構造に注目したMCMC法に基づくシーン分割法 (学生論文特集)

  宋 妍, 小川 貴弘, 長谷山 美紀 電子情報通信学会論文誌. D, 情報・システム = The IEICE transactions on information and systems 97 (3) 560 -573 2014年03月 [査読無し][通常論文]
  
• 映像の構造に注目したMCMC法に基づくシーン分割法(画像・映像処理,<特集>学生論文)

  宋 妍, 小川 貴弘, 長谷山 美紀 電子情報通信学会論文誌. D, 情報・システム 97 (3) 560 -573 2014年03月01日 [査読無し][通常論文]
   

  以前,我々は,映像の類似したショットが隣接せずに出現する構造(映像の構造)に注目したシーン分割手法を提案した.しかしながら,映像の構造に注目したシーン分割手法の共通の問題として,映像の構造を取得する際に用いられるシーンの最長時間幅の設定が困難であるという点が存在した.そこで,本論文では,その改良手法として映像の構造に注目したMCMC法に基づくシーン分割手法を提案する.提案手法では,シーンの最長時間幅を変化させて映像の構造に基づき取得された全ての境界をシーン境界候補とし,それらの中からMCMC法に基づいて最適なシーン境界を推定する.これにより,従来の手法を適用する際に設定が困難であったシーンの最長時間幅を一意に決定することなく,MCMC法により最適なシーン境界を求めることが可能となる.本論文の最後では,実際にテレビで放送された映像に対して提案手法を適用し,その有効性を確認する.
• 映像の構造に注目したMCMC法に基づくシーン分割法

  SONG Yan, 小川貴弘, 長谷山美紀 電子情報通信学会論文誌 D J97-D (3) 560 -573 2014年03月01日 [査読無し][通常論文]
   

  以前,我々は,映像の類似したショットが隣接せずに出現する構造(映像の構造)に注目したシーン分割手法を提案した.しかしながら,映像の構造に注目したシーン分割手法の共通の問題として,映像の構造を取得する際に用いられるシーンの最長時間幅の設定が困難であるという点が存在した.そこで,本論文では,その改良手法として映像の構造に注目したMCMC法に基づくシーン分割手法を提案する.提案手法では,シーンの最長時間幅を変化させて映像の構造に基づき取得された全ての境界をシーン境界候補とし,それらの中からMCMC法に基づいて最適なシーン境界を推定する.これにより,従来の手法を適用する際に設定が困難であったシーンの最長時間幅を一意に決定することなく,MCMC法により最適なシーン境界を求めることが可能となる.本論文の最後では,実際にテレビで放送された映像に対して提案手法を適用し,その有効性を確認する.
• A Note on Improving Video Authenticity Degree Estimation through Automatic Speech Recognition (画像工学)

  PENKOV Michael, OGAWA Takahiro, HASEYAMA Miki 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (434) 341 -346 2014年02月17日
• 橋梁の点検画像を用いたベイジアンネットワークによる変状の推定に関する検討 (画像工学)

  小林 克希, 高橋 翔, 小川 貴弘 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (434) 217 -221 2014年02月17日 [査読無し][通常論文]
  
• 画像注視時の脳波特徴量を用いた画像分類に関する検討(2)単一試行の脳波から算出された特徴量の有効性の検証 (画像工学)

  川上 拓也, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (434) 199 -204 2014年02月17日 [査読無し][通常論文]
  
• タグ付き画像を用いた同一意味を表現するタグの選択に関する検討 (画像工学)

  宋 妍, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (434) 211 -216 2014年02月17日 [査読無し][通常論文]
  
• 可視および近赤外領域に感度を有するディジタルカメラを用いた分光反射率推定に関する検討 : 光源スペクトル推定の導入 (画像工学)

  五十嵐 祐太, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (434) 223 -228 2014年02月17日 [査読無し][通常論文]
  
• 昆虫の走査型電子顕微鏡像による科の分類に関する検討 : 画像特徴を用いた階層型クラスタリングによる高精度化 (画像工学)

  高橋 昌弘, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (434) 241 -246 2014年02月17日 [査読無し][通常論文]
  
• 生物の顕微鏡像を用いた科の推定に関する検討 : 分類体系を表す決定木の改良による高精度化 (画像工学)

  朴 君, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (434) 247 -252 2014年02月17日 [査読無し][通常論文]
  
• Web映像コミュニティの階層構造抽出の大規模データ適用に関する一検討 (画像工学)

  原川 良介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (434) 275 -280 2014年02月17日 [査読無し][通常論文]
  
• Hidden Conditional Random Fieldsによる映像の構造解析に基づくシーン分割の高精度化に関する検討 (画像工学)

  吉田 壮, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (434) 285 -290 2014年02月17日 [査読無し][通常論文]
  
• 個人の嗜好を表現可能なトピックモデルの提案とその楽曲推薦への応用に関する検討 (画像工学)

  中西 亮太, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (434) 313 -318 2014年02月17日 [査読無し][通常論文]
  
• カルマンフィルタを用いたエラーコンシールメントの高精度化に関する検討 : 物体の運動を考慮した状態遷移モデルの実現 (画像工学)

  大貫 修平, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (434) 325 -330 2014年02月17日 [査読無し][通常論文]
  
• 動画像の事例ベース超解像のランク最小化に基づく高精度化に関する検討 (画像工学)

  廣川 真梨子, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (434) 347 -350 2014年02月17日 [査読無し][通常論文]
  
• 画像注視時の脳波特徴量を用いた画像分類に関する検討(2)単一試行の脳波から算出された特徴量の有効性の検証 (ITS)

  川上 拓也, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (433) 199 -204 2014年02月17日 [査読無し][通常論文]
  
• タグ付き画像を用いた同一意味を表現するタグの選択に関する検討 (ITS)

  宋 妍, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (433) 211 -216 2014年02月17日 [査読無し][通常論文]
  
• 可視および近赤外領域に感度を有するディジタルカメラを用いた分光反射率推定に関する検討 : 光源スペクトル推定の導入 (ITS)

  五十嵐 祐太, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (433) 223 -228 2014年02月17日 [査読無し][通常論文]
  
• 昆虫の走査型電子顕微鏡像による科の分類に関する検討 : 画像特徴を用いた階層型クラスタリングによる高精度化 (ITS)

  高橋 昌弘, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (433) 241 -246 2014年02月17日 [査読無し][通常論文]
  
• 生物の顕微鏡像を用いた科の推定に関する検討 : 分類体系を表す決定木の改良による高精度化 (ITS)

  朴 君, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (433) 247 -252 2014年02月17日 [査読無し][通常論文]
  
• Web映像コミュニティの階層構造抽出の大規模データ適用に関する一検討 (ITS)

  原川 良介, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (433) 275 -280 2014年02月17日 [査読無し][通常論文]
  
• Hidden Conditional Random Fieldsによる映像の構造解析に基づくシーン分割の高精度化に関する検討 (ITS)

  吉田 壮, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (433) 285 -290 2014年02月17日 [査読無し][通常論文]
  
• 個人の嗜好を表現可能なトピックモデルの提案とその楽曲推薦への応用に関する検討 (ITS)

  中西 亮太, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (433) 313 -318 2014年02月17日 [査読無し][通常論文]
  
• カルマンフィルタを用いたエラーコンシールメントの高精度化に関する検討 : 物体の運動を考慮した状態遷移モデルの実現 (ITS)

  大貫 修平, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (433) 325 -330 2014年02月17日 [査読無し][通常論文]
  
• 動画像の事例ベース超解像のランク最小化に基づく高精度化に関する検討 (ITS)

  廣川 真梨子, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 113 (433) 347 -350 2014年02月17日 [査読無し][通常論文]
  
• カルマンフィルタを用いたエラーコンシールメントの高精度化に関する検討~物体の運動を考慮した状態遷移モデルの実現~

  大貫修平, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 113 (434(IE2013 95-132)) 325 -330 2014年02月10日 [査読無し][通常論文]
  
• 橋梁の点検画像を用いたベイジアンネットワークによる変状の推定に関する検討

  小林克希, 高橋翔, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 113 (434(IE2013 95-132)) 217 -221 2014年02月10日 [査読無し][通常論文]
  
• ネットワーク分析を用いたサッカー選手の特徴定義とその選手間類似度算出への応用

  岩井和也, 高橋翔, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 113 (434(IE2013 95-132)) 319 -324 2014年02月10日 [査読無し][通常論文]
  
• 昆虫の走査型電子顕微鏡像による科の分類に関する検討―画像特徴を用いた階層型クラスタリングによる高精度化―

  高橋昌弘, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 113 (434(IE2013 95-132)) 241 -246 2014年02月10日 [査読無し][通常論文]
  
• 動画像の事例ベース超解像のランク最小化に基づく高精度化に関する検討

  廣川真梨子, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 113 (434(IE2013 95-132)) 347 -350 2014年02月10日 [査読無し][通常論文]
  
• タグ付き画像を用いた同一意味を表現するタグの選択に関する検討

  SONG Yan, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 113 (434(IE2013 95-132)) 211 -216 2014年02月10日 [査読無し][通常論文]
  
• Hidden Conditional Random Fieldsによる映像の構造解析に基づくシーン分割の高精度化に関する検討

  吉田壮, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 113 (434(IE2013 95-132)) 285 -290 2014年02月10日 [査読無し][通常論文]
  
• Web映像コミュニティの階層構造抽出の大規模データ適用に関する一検討

  原川良介, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 113 (434(IE2013 95-132)) 275 -280 2014年02月10日 [査読無し][通常論文]
  
• 生物の顕微鏡像を用いた科の推定に関する検討 分類体系を表す決定木の改良による高精度化

  PIAO Jun, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 113 (434(IE2013 95-132)) 247 -252 2014年02月10日 [査読無し][通常論文]
  
• 個人の嗜好を表現可能なトピックモデルの提案とその楽曲推薦への応用に関する検討

  中西亮太, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 113 (434(IE2013 95-132)) 313 -318 2014年02月10日 [査読無し][通常論文]
  
• 画像注視時の脳波特徴量を用いた画像分類に関する検討(2)―単一試行の脳波から算出された特徴量の有効性の検証―

  川上拓也, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 113 (434(IE2013 95-132)) 199 -204 2014年02月10日 [査読無し][通常論文]
  
• 可視および近赤外領域に感度を有するディジタルカメラを用いた分光反射率推定に関する検討―光源スペクトル推定の導入―

  五十嵐祐太, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 113 (434(IE2013 95-132)) 223 -228 2014年02月10日 [査読無し][通常論文]
  
• 個人の嗜好を表現可能なトピックモデルの提案とその楽曲推薦への応用に関する検討 (メディア工学 映像表現&コンピュータグラフィックス ヒューマンインフォメーション)

  中西 亮太, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 38 (7) 313 -318 2014年02月
• カルマンフィルタを用いたエラーコンシールメントの高精度化に関する検討 : 物体の運動を考慮した状態遷移モデルの実現 (メディア工学 映像表現&コンピュータグラフィックス ヒューマンインフォメーション)

  大貫 修平, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 38 (7) 325 -330 2014年02月
• 動画像の事例ベース超解像のランク最小化に基づく高精度化に関する検討 (メディア工学 映像表現&コンピュータグラフィックス ヒューマンインフォメーション)

  廣川 真梨子, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 38 (7) 347 -350 2014年02月
• A Note on Improving Video Authenticity Degree Estimation through Automatic Speech Recognition (メディア工学 映像表現&コンピュータグラフィックス ヒューマンインフォメーション)

  PENKOV Michael, OGAWA Takahiro, HASEYAMA Miki 映像情報メディア学会技術報告 = ITE technical report 38 (7) 341 -346 2014年02月
• 可視および近赤外領域に感度を有するディジタルカメラを用いた分光反射率推定に関する検討 : 光源スペクトル推定の導入 (メディア工学 映像表現&コンピュータグラフィックス ヒューマンインフォメーション)

  五十嵐 祐太, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 38 (7) 223 -228 2014年02月
• 昆虫の走査型電子顕微鏡像による科の分類に関する検討 : 画像特徴を用いた階層型クラスタリングによる高精度化 (メディア工学 映像表現&コンピュータグラフィックス ヒューマンインフォメーション)

  高橋 昌弘, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 38 (7) 241 -246 2014年02月
• 画像注視時の脳波特徴量を用いた画像分類に関する検討(2)単一試行の脳波から算出された特徴量の有効性の検証 (メディア工学 映像表現&コンピュータグラフィックス ヒューマンインフォメーション)

  川上 拓也, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 38 (7) 199 -204 2014年02月
• タグ付き画像を用いた同一意味を表現するタグの選択に関する検討 (メディア工学 映像表現&コンピュータグラフィックス ヒューマンインフォメーション)

  宋 妍, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 38 (7) 211 -216 2014年02月
• 生物の顕微鏡像を用いた科の推定に関する検討 : 分類体系を表す決定木の改良による高精度化 (メディア工学 映像表現&コンピュータグラフィックス ヒューマンインフォメーション)

  朴 君, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 38 (7) 247 -252 2014年02月
• Hidden Conditional Random Fieldsによる映像の構造解析に基づくシーン分割の高精度化に関する検討 (メディア工学 映像表現&コンピュータグラフィックス ヒューマンインフォメーション)

  吉田 壮, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 38 (7) 285 -290 2014年02月
• Web映像コミュニティの階層構造抽出の大規模データ適用に関する一検討 (メディア工学 映像表現&コンピュータグラフィックス ヒューマンインフォメーション)

  原川 良介, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 38 (7) 275 -280 2014年02月
• 橋梁の点検画像を用いたベイジアンネットワークによる変状の推定に関する検討 (メディア工学 映像表現&コンピュータグラフィックス ヒューマンインフォメーション)

  小林 克希, 高橋 翔, 小川 貴弘 映像情報メディア学会技術報告 = ITE technical report 38 (7) 217 -221 2014年02月 [査読無し][通常論文]
  
• ネットワーク分析を用いたサッカー選手の特徴定義とその選手間類似度算出への応用 (メディア工学 映像表現&コンピュータグラフィックス ヒューマンインフォメーション)

  岩井 和也, 高橋 翔, 小川 貴弘 映像情報メディア学会技術報告 = ITE technical report 38 (7) 319 -324 2014年02月 [査読無し][通常論文]
  
• An efficient extraction method of hierarchical structure of web communities for web video retrieval

  Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama ITE Transactions on Media Technology and Applications 2 (3) 287 -297 2014年 [査読無し][通常論文]
   

  In this paper, we propose a method that enables efficient extraction of hierarchical structure of Web communities containing Web videos that have similar topics in order to retrieve users' desired Web videos. Specifically, the proposed method first calculates Web video features by applying canonical correlation analysis to a small number of Web video samples obtained on the basis of a clustering scheme. Furthermore, we construct a "community graph" of which each node consists of multiple Web videos and each edge corresponds to hyperlinks of Web pages including these videos. Then, based on strongly connected components, edge betweenness and modularity of the community graph, hierarchical structure of Web communities is estimated. In this way, our method can efficiently extract the hierarchical structure of Web communities, and users' desired Web videos can be retrieved by selecting Web communities according to their hierarchical structure.
• Bayesian Network-based Distress Estimation Using Image Features in Road Structure Assessment

  Keisuke Maeda, Sho Takahashi, Takahiro Ogawa, Miki Haseyama 2014 IEEE 3RD GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE) 169 -170 2014年 [査読無し][通常論文]
   

  This paper presents a Bayesian network-based method for estimating a distress of road structures from inspection data. The distress is represented by a damage of road structures and its degree. In the previous work, the distress was estimated by utilizing Bayesian network based on categories of road structures, details of road structures and damaged parts. However, inspection data include not only the above items but also images of the distress. Therefore, by introducing the use of the images to the previous work, improvement of the distress estimation accuracy can be expected. The proposed method calculates Bayesian network from inspection items and their corresponding images to perform the distress estimation. Experimental results show the effectiveness of the proposed method.
• Effective Multiple Feature Fusion Using Topic Model for Social Image Visualization

  Kouhei Tateno, Takahiro Ogawa, Miki Haseyama 2014 IEEE 3RD GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE) 182 -183 2014年 [査読無し][通常論文]
   

  This paper presents a multiple feature fusion method using topic model for social image visualization. Images in social media are represented from several aspects such as their visual information and tags. The proposed method extracts low-level features from social images and their tags and calculates their integrated high-level features. Specifically, the proposed method applies multilayer multimodal probabilistic Latent Semantic Analysis (mm-pLSA) to the low-level visual and tag features to obtain the high-level features. Then, by applying dimensionality reduction techniques to the obtained features, successful visualization becomes feasible.
• Exhibition Method of Hierarchical Structure of Web Communities Using Community Density for Web Video Retrieval

  Ryosuke Harakawa, Takahiro Ogawa, Miki Haseyama 18TH IEEE INTERNATIONAL SYMPOSIUM ON CONSUMER ELECTRONICS (ISCE 2014) 2014年 [査読無し][通常論文]
   

  In this paper, we present an exhibition method of hierarchical structure of Web communities using community density for Web video retrieval. In the proposed method, Web communities that are Web video sets with similar topics is hierarchically extracted by using hyperlinks between Web videos and their video features, and density of each Web community is estimated. Then we exhibit the hierarchical structure of Web communities according to the obtained density to users. Since users can grasp detail degree of topics contained in each Web community, the desired Web community can be easily selected for Web video retrieval.
• Missing Audio Segment Reconstruction Based on Sparse Representation with Power Spectrogram

  Yuma Tanaka, Takahiro Ogawa, Miki Haseyama 2014 IEEE 3RD GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE) 86 -87 2014年 [査読無し][通常論文]
   

  This paper presents a method for reconstructing missing audio segments based on sparse representation with power spectrogram. In the proposed method, an error of power spectrograms is utilized as a quality measure representing reconstruction performance. Then the proposed method estimates missing segments based on sparse representation optimized with respect to the error of power spectrograms. This error minimization problem can be solved with a greedy algorithm by limitting the solution to only sparse one. By using our method, perceptually optimized reconstruction becomes feasible since missing segments are estimated by using the quality measure which represens auditory properties. Experimental results obtained by applying the proposed method to actual music signals from RWC Music Database show its effectiveness.
• Popular Music Estimation Based on Topic Model Using Time Information and Audio Features

  Shohei Kinoshita, Takahiro Ogawa, Miki Haseyama 2014 IEEE 3RD GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE) 102 -103 2014年 [査読無し][通常論文]
   

  This paper presents popular music estimation based on a topic model using time information and audio features. The proposed method calculates latent topic distribution using Latent Dirichlet Allocation to obtain more accurate music features. In this approach, we also use release date information of each music as time information for concerning the relationship between music trends and each age. Then, by using the obtained latent topic distribution features, the estimation of the popular music becomes feasible based on a Support Vector Machine classifier. Experimental results show the effectiveness of our method.
• 脳波特徴に基づく人間の楽曲聴取時における感情推定に関する検討

  澤田充奨, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2013 ROMBUNNO.171 2013年10月19日 [査読無し][通常論文]
  
• 判別分析に基づいた順序回帰の導入による協調フィルタリングでのSparsity Problemの軽減に関する一検討

  川島孝行, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2013 ROMBUNNO.172 2013年10月19日 [査読無し][通常論文]
  
• 胃X線二重造影像を用いたHelicobacter pylori感染の識別の高精度化に関する検討

  石原賢太, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2013 ROMBUNNO.165 2013年10月19日 [査読無し][通常論文]
  
• 重み付きロバストPCAを用いた動画像フレーム補間の高精度化に関する検討

  廣川真梨子, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2013 ROMBUNNO.174 2013年10月19日 [査読無し][通常論文]
  
• 画像検索結果提示法におけるユーザの探索時間と特徴量との関係に関する一考察

  三改木裕矢, 小林克希, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2013 ROMBUNNO.160 2013年10月19日 [査読無し][通常論文]
  
• ベイジアンネットワークを用いた構造物の点検データからの変状の推定

  小林克希, 高橋翔, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2013 ROMBUNNO.173 2013年10月19日 [査読無し][通常論文]
  
• ダイナミック式氷蓄熱システムにおける高効率化

  小川貴弘, 田村記秀, 山田育弘 新菱冷熱中央研究所報 20 81 -86 2013年08月23日 [査読無し][通常論文]
  
• 胃X線検査における胃背景粘膜の自動解析による胃がんリスク評価の検討

  間部克裕, 長谷山美紀, 小川貴弘, 吉澤和哉, 大泉晴史, 中島滋美, 加藤元嗣 日本消化器がん検診学会雑誌 51 (3) 96 -96 2013年05月15日 [査読無し][通常論文]
  
• ベイジアンネットワークを用いた除雪作業データの分析に関する検討 (画像工学)

  高橋 信太郎, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 112 (434) 39 -43 2013年02月18日 [査読無し][通常論文]
  
• 視聴動作から推定される関心度を用いた映像の推薦の高精度化に関する検討 (画像工学)

  白石 哲夫, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 112 (434) 95 -100 2013年02月18日 [査読無し][通常論文]
  
• 歌謡番組における映像の構造に注目したシーン分割手法 : 顔認識のシーン分割精度に与える効果の検証 (画像工学)

  吉田 壮, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 112 (434) 101 -106 2013年02月18日 [査読無し][通常論文]
  
• ポピュラー音楽データベースにおけるトレンド検出に関する検討 (画像工学)

  中西 亮太, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 112 (434) 107 -110 2013年02月18日 [査読無し][通常論文]
  
• 音響特徴量に基づくクラシック音楽の分類に関する一考察 (画像工学)

  松野 恵一, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 112 (434) 111 -115 2013年02月18日 [査読無し][通常論文]
  
• 映像検索結果の定量評価手法の応用に関する試み(1)札幌市における実証実験を通した映像検索システムの評価 (画像工学)

  山之内 豊, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 112 (434) 159 -163 2013年02月18日 [査読無し][通常論文]
  
• 特徴統合理論に基づく画像検索結果の提示法の評価 : 異なる提示法の比較による有効性の検証 (画像工学)

  小林 克希, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 112 (434) 165 -169 2013年02月18日 [査読無し][通常論文]
  
• ベイジアンネットワークを用いた除雪作業データの分析に関する検討 (ITS)

  高橋 信太郎, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 112 (433) 39 -43 2013年02月18日 [査読無し][通常論文]
  
• 視聴動作から推定される関心度を用いた映像の推薦の高精度化に関する検討 (ITS)

  白石 哲夫, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 112 (433) 95 -100 2013年02月18日 [査読無し][通常論文]
  
• 歌謡番組における映像の構造に注目したシーン分割手法 : 顔認識のシーン分割精度に与える効果の検証 (ITS)

  吉田 壮, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 112 (433) 101 -106 2013年02月18日 [査読無し][通常論文]
  
• ポピュラー音楽データベースにおけるトレンド検出に関する検討 (ITS)

  中西 亮太, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 112 (433) 107 -110 2013年02月18日 [査読無し][通常論文]
  
• 音響特徴量に基づくクラシック音楽の分類に関する一考察 (ITS)

  松野 恵一, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 112 (433) 111 -115 2013年02月18日 [査読無し][通常論文]
  
• 映像検索結果の定量評価手法の応用に関する試み(1)札幌市における実証実験を通した映像検索システムの評価 (ITS)

  山之内 豊, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 112 (433) 159 -163 2013年02月18日 [査読無し][通常論文]
  
• 特徴統合理論に基づく画像検索結果の提示法の評価 : 異なる提示法の比較による有効性の検証 (ITS)

  小林 克希, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 112 (433) 165 -169 2013年02月18日 [査読無し][通常論文]
  
• 野球映像における投手のコンディション推定の高精度化に関する検討 投球動作および投球結果を表す特徴量の改良

  久保純貴, 高橋翔, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 112 (434(IE2012 110-137)) 141 -146 2013年02月11日 [査読無し][通常論文]
  
• 胃X線二重造影像を用いたHelicobacter pylori感染の識別に関する検討

  吉崎茜, 桂井麻里衣, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 112 (434(IE2012 110-137)) 25 -28 2013年02月11日 [査読無し][通常論文]
  
• 弾性モデルを用いたサッカーの選手追跡に関する検討~新たなポテンシャルエネルギーの導入による高精度化~

  岩井和也, 高橋翔, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 112 (434(IE2012 110-137)) 135 -139 2013年02月11日 [査読無し][通常論文]
  
• ボール保持チームに注目したサッカー映像分割の高精度化に関する検討

  大貫修平, 高橋翔, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 112 (434(IE2012 110-137)) 147 -151 2013年02月11日 [査読無し][通常論文]
  
• ベイジアンネットワークを用いた除雪作業データの分析に関する検討 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  高橋 信太郎, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 37 (8) 39 -43 2013年02月11日 [査読無し][通常論文]
  
• 視聴動作から推定される関心度を用いた映像の推薦の高精度化に関する検討 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  白石 哲夫, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 37 (8) 95 -100 2013年02月11日 [査読無し][通常論文]
  
• 歌謡番組における映像の構造に注目したシーン分割手法 : 顔認識のシーン分割精度に与える効果の検証 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  吉田 壮, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 37 (8) 101 -106 2013年02月11日 [査読無し][通常論文]
  
• ポピュラー音楽データベースにおけるトレンド検出に関する検討 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  中西 亮太, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 37 (8) 107 -110 2013年02月11日 [査読無し][通常論文]
  
• 音響特徴量に基づくクラシック音楽の分類に関する一考察 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  松野 恵一, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 37 (8) 111 -115 2013年02月11日 [査読無し][通常論文]
  
• 映像検索結果の定量評価手法の応用に関する試み(1)札幌市における実証実験を通した映像検索システムの評価 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  山之内 豊, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 37 (8) 159 -163 2013年02月11日 [査読無し][通常論文]
  
• 特徴統合理論に基づく画像検索結果の提示法の評価 : 異なる提示法の比較による有効性の検証 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  小林 克希, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 = ITE technical report 37 (8) 165 -169 2013年02月11日 [査読無し][通常論文]
  
• 胃X線二重造影像を用いたHelicobacter pylori感染の識別に関する検討 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  吉崎 茜, 桂井 麻里衣, 小川 貴弘 映像情報メディア学会技術報告 = ITE technical report 37 (8) 25 -28 2013年02月
• 弾性モデルを用いたサッカーの選手追跡に関する検討 : 新たなポテンシャルエネルギーの導入による高精度化 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  岩井 和也, 高橋 翔, 小川 貴弘 映像情報メディア学会技術報告 = ITE technical report 37 (8) 135 -139 2013年02月
• 野球映像における投手のコンディション推定の高精度化に関する検討 : 投球動作および投球結果を表す特徴量の改良 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  久保 純貴, 高橋 翔, 小川 貴弘 映像情報メディア学会技術報告 = ITE technical report 37 (8) 141 -146 2013年02月
• ボール保持チームに注目したサッカー映像分割の高精度化に関する検討 (ヒューマンインフォメーション メディア工学 映像表現&コンピュータグラフィックス)

  大貫 修平, 高橋 翔, 小川 貴弘 映像情報メディア学会技術報告 = ITE technical report 37 (8) 147 -151 2013年02月
• Vortex emission from quantum turbulence in superfluid 4He

  Y. Nago, A. Nishijima, H. Kubo, T. Ogawa, K. Obara, H. Yano, O. Ishikawa, T. Hata Physical Review B - Condensed Matter and Materials Physics 87 2013年01月22日 [査読無し][通常論文]
   

  An oscillating object can stretch quantized vortices attached to it in superfluids due to the relative superflow, steadily generating quantum turbulence, even in the zero-temperature limit. We report the emission and propagation of quantized vortices from quantum turbulence generated in superfluid 4He at low temperatures. A vortex-free vibrating wire enables us to detect the first collision of vortex rings and therefore to measure the time-of-flight of a vortex emitted from a generator to a detector. The detection times from the start of turbulence generation exhibit an exponential distribution, suggesting that the detection is a Poisson process. Vortices are emitted continuously, but each vortex has a random flight velocity and direction. We estimated the nondetection time and mean detection period from the distribution for two flight distances. By estimating the flight velocity, we find that only vortices with velocities lower than the detector velocity can be detected, even if the sizes of the emitted vortices are smaller than the wire thickness or the vibration amplitude. The ratio of the detection rate as a function of vortex velocity suggests anisotropic emission of vortices from the quantum turbulence. © 2013 American Physical Society.
• ロボットの内部処理を映像で伝える際のトランジション効果の印象評価

  藤原菜々美, 小川貴弘, 尾関基行, 岡夏樹 電子情報通信学会技術研究報告 112 (412(HCS2012 54-75)) 7 -12 2013年01月17日 [査読無し][通常論文]
  
• A rating prediction method for e-commerce application using ordinal regression based on LDA with multi-modal features

  Takayuki Kawashima, Takahiro Ogawa, Miki Haseyama 2013 IEEE 2nd Global Conference on Consumer Electronics, GCCE 2013 260 -261 2013年 [査読無し][通常論文]
   

  This paper presents a new method for rating prediction in e-commerce, which uses ordinal regression based on linear discriminant analysis (LDA) with multi-modal features. In order to realize accurate recommendation in e-commerce, the proposed method estimates each user's rating for target items. Note that we define the rating as 'the degree of preference for each item by a user.' For estimating the target user's preference of each item from the past ratings of other items, the proposed method performs training from pairs of 'ratings of items' and their feature vectors using ordinal regression based on LDA. Furthermore, in this approach, new features are obtained by applying canonical correlation analysis (CCA) to textual and visual features extracted from review's texts and images on the Web, respectively. Therefore, higher performance of the rating prediction can be realized by our method than that when using single kind of features. Experimental results obtained by applying the proposed method to an actual movie data set, which has been provided by SNAP, show the effectiveness of the proposed method. © 2013 IEEE.
• 変状評価の支援を目的とした点検データの可視化に関する検討

  高橋翔, 小川貴弘, 長谷山美紀 日本道路会議論文集(CD-ROM) 30th ROMBUNNO.2053 2013年 [査読無し][通常論文]
  
• Generation and detection of vortex rings in superfluid 4He at very low temperature

  H. Yano, A. Nishijima, S. Yamamoto, T. Ogawa, Y. Nago, K. Obara, O. Ishikawa, M. Tsubota, T. Hata Journal of Physics: Conference Series 400 2012年12月01日 [査読無し][通常論文]
   

  Motions of vortices are fundamental characteristics of quantum turbulence. These motions are expected to be governed only by quantized circulations in superfluids at the zero temperature limit. In the present paper, we report the motions of vortex rings emitted from a quantum turbulence in superfluid 4He, by detecting vortex rings using a vortex-free vibrating wire as a detector. The time of flights of vortex rings are distributed, because vortex rings are emitted in any direction from a turbulent region and the detector can respond only to a reachable vortex ring. By measuring time-of-flights many times, we find an exponential distribution of time-of-flights with a non-detection period, which corresponds to the fastest time of flights of vortex rings. For a larger generation power of vortex rings, a distribution of time-of-flights still shows a single exponential distribution, but a non-detection period becomes shorter. This result implies that sizes of emitted vortex rings are distributed dependently on the generation power of turbulence. The observed exponential distributions are confirmed by numerical simulations of the dynamics of vortex rings. © Published under licence by IOP Publishing Ltd.
• 半教師あり学習による走査型電子顕微鏡で撮像された昆虫の識別に関する検討

  高橋昌弘, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2012 ROMBUNNO.146 2012年10月20日 [査読無し][通常論文]
  
• モーフィングを用いた新たな学習データの生成による昆虫の自動分類の高精度化

  朴君, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2012 ROMBUNNO.125 2012年10月20日 [査読無し][通常論文]
  
• 弾性モデルを用いたサッカー映像における選手追跡の高精度化に関する検討

  岩井和也, 高橋翔, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2012 ROMBUNNO.149 2012年10月20日 [査読無し][通常論文]
  
• 映像の特徴を用いたWebコミュニティ抽出の高精度化に関する検討―最短リンク経路長の導入による試み―

  原川良介, 畠山泰貴, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2012 ROMBUNNO.150 2012年10月20日 [査読無し][通常論文]
  
• 近赤外光除去フィルタを用いずに取得した画像からの可視光成分の抽出に関する検討

  五十嵐祐太, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2012 ROMBUNNO.162 2012年10月20日 [査読無し][通常論文]
  
• 楽曲中の歌唱区間推定における脳波特徴量の導入に関する検討

  川上拓也, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2012 ROMBUNNO.157 2012年10月20日 [査読無し][通常論文]
  
• サポートベクトル回帰を用いたぶれによる劣化画像の復元に関する一検討

  吉崎茜, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2012 ROMBUNNO.145 2012年10月20日 [査読無し][通常論文]
  
• 物体認識における識別器の高精度化に関する検討 SVMを用いた物体領域の自動選定手法の導入

  吉田壮, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2012 ROMBUNNO.122 2012年10月20日 [査読無し][通常論文]
  
• 映像のシーン分割における複数特徴量の協調利用の有効性に関する評価

  宋妍, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2012 ROMBUNNO.123 2012年10月20日 [査読無し][通常論文]
  
• 連想型映像検索における検索過程の分析に関する一考察

  山之内豊, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2012 ROMBUNNO.153 2012年10月20日 [査読無し][通常論文]
  
• クラシック楽曲信号から算出される特徴量の改良と時代分類の高精度化に関する考察

  松野恵一, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2012 ROMBUNNO.155 2012年10月20日 [査読無し][通常論文]
  
• 順序回帰を用いた数値予報の誤差解析における高精度化に関する検討

  高橋信太郎, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2012 ROMBUNNO.147 2012年10月20日 [査読無し][通常論文]
  
• 視聴動作から推定される関心度を用いた映像の推薦に関する検討

  白石哲夫, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2012 ROMBUNNO.151 2012年10月20日 [査読無し][通常論文]
  
• 画像検索結果の提示方法の有効性評価に関する検討―特徴統合理論に基づく評価指標の実現―

  小林克希, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2012 ROMBUNNO.152 2012年10月20日 [査読無し][通常論文]
  
• 歌詞と音響特徴を用いたファジィ分類による音楽ジャンル帰属度の定義に関する検討

  中西亮太, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2012 ROMBUNNO.156 2012年10月20日 [査読無し][通常論文]
  
• サッカーのチーム戦術推定手法を用いた試合映像の分割に関する検討

  大貫修平, 高橋翔, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2012 ROMBUNNO.148 2012年10月20日 [査読無し][通常論文]
  
• 高速道路の構造物の点検・診断業務の効率化に向けた検討

  紫桃孝一郎, 三石晃, 黒田尚士, 石川雄章, 湧田雄基, 長谷山美紀, 小川貴弘 土木学会年次学術講演会講演概要集(CD-ROM) 67th ROMBUNNO.VI-237 2012年08月01日 [査読無し][通常論文]
  
• Dimensionality Reduction of Sparse Visual Features via Recoverable Projection for Large-Scale Image Retrieval (画像工学)

  何 再興, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 111 (442) 1 -6 2012年02月20日 [査読無し][通常論文]
  
• 数値予報における予報誤差の解析の高精度化に関する検討 (画像工学)

  高橋 信太郎, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 111 (442) 7 -10 2012年02月20日 [査読無し][通常論文]
  
• 可視光成分と近赤外光成分が重畳された画像の色補正 : 自然画像の色成分を用いた色変換の検討 (画像工学)

  和泉 大佑, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 111 (442) 21 -25 2012年02月20日 [査読無し][通常論文]
  
• 移動方向を考慮した道路映像中のシカ検出の高精度化に関する検討 (画像工学)

  桂井 麻里衣, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 111 (442) 67 -71 2012年02月20日 [査読無し][通常論文]
  
• 顕微鏡画像を用いたSVDDによる深海底生物の分類体系の推定法 (画像工学)

  長谷川 尭史, 小川 貴弘, 渡邉 日出海 電子情報通信学会技術研究報告 : 信学技報 111 (442) 73 -78 2012年02月20日 [査読無し][通常論文]
  
• 視聴動作から推定される関心度を用いたユーザクラスタリングに関する検討 (画像工学)

  白石 哲夫, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 111 (442) 189 -193 2012年02月20日 [査読無し][通常論文]
  
• A note on the application of Web information to near-duplicate online video detection (画像工学)

  ペンコフ マイケル, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 111 (442) 201 -205 2012年02月20日 [査読無し][通常論文]
  
• 人間の動きに基づく楽曲推薦手法の実データ適用に関する検討 (画像工学)

  大串 裕幸, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 111 (442) 281 -285 2012年02月20日 [査読無し][通常論文]
  
• Dimensionality Reduction of Sparse Visual Features via Recoverable Projection for Large-Scale Image Retrieval (ITS)

  何 再興, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 111 (441) 1 -6 2012年02月20日 [査読無し][通常論文]
  
• 数値予報における予報誤差の解析の高精度化に関する検討 (ITS)

  高橋 信太郎, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 111 (441) 7 -10 2012年02月20日 [査読無し][通常論文]
  
• 可視光成分と近赤外光成分が重畳された画像の色補正 : 自然画像の色成分を用いた色変換の検討 (ITS)

  和泉 大佑, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 111 (441) 21 -25 2012年02月20日 [査読無し][通常論文]
  
• 移動方向を考慮した道路映像中のシカ検出の高精度化に関する検討 (ITS)

  桂井 麻里衣, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 111 (441) 67 -71 2012年02月20日 [査読無し][通常論文]
  
• 顕微鏡画像を用いたSVDDによる深海底生物の分類体系の推定法 (ITS)

  長谷川 尭史, 小川 貴弘, 渡邉 日出海 電子情報通信学会技術研究報告 : 信学技報 111 (441) 73 -78 2012年02月20日 [査読無し][通常論文]
  
• 視聴動作から推定される関心度を用いたユーザクラスタリングに関する検討 (ITS)

  白石 哲夫, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 111 (441) 189 -193 2012年02月20日 [査読無し][通常論文]
  
• A note on the application of Web information to near-duplicate online video detection (ITS)

  ペンコフ マイケル, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 111 (441) 201 -205 2012年02月20日 [査読無し][通常論文]
  
• 人間の動きに基づく楽曲推薦手法の実データ適用に関する検討 (ITS)

  大串 裕幸, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告 : 信学技報 111 (441) 281 -285 2012年02月20日 [査読無し][通常論文]
  
• 野球映像から取得した投球動作とスコアブックに記載された情報を用いた投手のコンディションの推定に関する検討

  久保純貴, 高橋翔, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 111 (442(IE2011 105-132)) 287 -292 2012年02月13日 [査読無し][通常論文]
  
• ぶれによる劣化画像の高精度な復元に関する検討―エッジ方向を考慮した重み付けパラメータの原画像の事前確率への導入によるリンギングの抑制―

  吉崎茜, 和泉大佑, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 111 (442(IE2011 105-132)) 27 -32 2012年02月13日 [査読無し][通常論文]
  
• 数値予報における予報誤差の解析の高精度化に関する検討 (メディア工学 ヒューマンインフォメーション 映像表現&コンピュータグラフィックス)

  高橋 信太郎, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 36 (9) 7 -10 2012年02月13日 [査読無し][通常論文]
  
• 可視光成分と近赤外光成分が重畳された画像の色補正 : 自然画像の色成分を用いた色変換の検討 (メディア工学 ヒューマンインフォメーション 映像表現&コンピュータグラフィックス)

  和泉 大佑, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 36 (9) 21 -25 2012年02月13日 [査読無し][通常論文]
  
• 移動方向を考慮した道路映像中のシカ検出の高精度化に関する検討 (メディア工学 ヒューマンインフォメーション 映像表現&コンピュータグラフィックス)

  桂井 麻里衣, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 36 (9) 67 -71 2012年02月13日 [査読無し][通常論文]
  
• 顕微鏡画像を用いたSVDDによる深海底生物の分類体系の推定法 (メディア工学 ヒューマンインフォメーション 映像表現&コンピュータグラフィックス)

  長谷川 尭史, 小川 貴弘, 渡邉 日出海 映像情報メディア学会技術報告 36 (9) 73 -78 2012年02月13日 [査読無し][通常論文]
  
• 視聴動作から推定される関心度を用いたユーザクラスタリングに関する検討 (メディア工学 ヒューマンインフォメーション 映像表現&コンピュータグラフィックス)

  白石 哲夫, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 36 (9) 189 -193 2012年02月13日 [査読無し][通常論文]
  
• 人間の動きに基づく楽曲推薦手法の実データ適用に関する検討 (メディア工学 ヒューマンインフォメーション 映像表現&コンピュータグラフィックス)

  大串 裕幸, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 36 (9) 281 -285 2012年02月13日 [査読無し][通常論文]
  
• 電子レセプトからの医療資源を最も投入した傷病の推定の高精度化に関する検討

  池田 啓典, 畠山 泰貴, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. ITS 111 (441) 313 -317 2012年02月13日 [査読無し][通常論文]
  
• 電子レセプトからの医療資源を最も投入した傷病の推定の高精度化に関する検討

  池田 啓典, 畠山 泰貴, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. IE, 画像工学 111 (442) 313 -317 2012年02月13日 [査読無し][通常論文]
  
• 電子レセプトからの医療資源を最も投入した傷病の推定の高精度化に関する検討(ITS画像処理,映像メディア,視覚及び一般)

  池田 啓典, 畠山 泰貴, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. ITS 111 (441) 313 -317 2012年02月13日 [査読無し][通常論文]
   

  本文では,電子レセプトから医療資源を最も投入した傷病を推定する手法を提案する.提案手法では,確率的トピックモデルの一手法であるLabeled LDAにより,傷病に対する診療内容を診療行為,医薬品および特定保険医療材料の確率分布として表し,電子レセプトに記載された複数の傷病に対する診療内容をそれらの混合分布として表すモデルを構築する.この結果を用いることで傷病毎の診療報酬点数の推計を行うことが可能となり,高精度な傷病の推定が実現する.
• 電子レセプトからの医療資源を最も投入した傷病の推定の高精度化に関する検討(ITS画像処理,映像メディア,視覚及び一般)

  池田 啓典, 畠山 泰貴, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. IE, 画像工学 111 (442) 313 -317 2012年02月13日 [査読無し][通常論文]
   

  本文では,電子レセプトから医療資源を最も投入した傷病を推定する手法を提案する.提案手法では,確率的トピックモデルの一手法であるLabeled LDAにより,傷病に対する診療内容を診療行為,医薬品および特定保険医療材料の確率分布として表し,電子レセプトに記載された複数の傷病に対する診療内容をそれらの混合分布として表すモデルを構築する.この結果を用いることで傷病毎の診療報酬点数の推計を行うことが可能となり,高精度な傷病の推定が実現する.
• ぶれによる劣化画像の高精度な復元に関する検討 : エッジ方向を考慮した重み付けパラメータの原画像の事前確率への導入によるリンギングの抑制 (メディア工学 ヒューマンインフォメーション 映像表現&コンピュータグラフィックス)

  吉崎 茜, 和泉 大佑, 小川 貴弘 映像情報メディア学会技術報告 36 (9) 27 -32 2012年02月
• 野球映像から取得した投球動作とスコアブックに記載された情報を用いた投手のコンディションの推定に関する検討 (メディア工学 ヒューマンインフォメーション 映像表現&コンピュータグラフィックス)

  久保 純貴, 高橋 翔, 小川 貴弘 映像情報メディア学会技術報告 36 (9) 287 -292 2012年02月 [査読無し][通常論文]
  
• Dimensionality Reduction of Sparse Visual Features via Recoverable Projection for Large-Scale Image Retrieval (メディア工学 ヒューマンインフォメーション 映像表現&コンピュータグラフィックス)

  何 再興, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 36 (9) 1 -6 2012年02月 [査読無し][通常論文]
  
• A Note on the Application of Web Information to Near-Duplicate Online Video Detection (メディア工学 ヒューマンインフォメーション 映像表現&コンピュータグラフィックス)

  ペンコフ マイケル, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 36 (9) 201 -205 2012年02月 [査読無し][通常論文]
  
• 電子レセプトからの医療資源を最も投入した傷病の推定の高精度化に関する検討 (メディア工学 ヒューマンインフォメーション 映像表現&コンピュータグラフィックス)

  池田 啓典, 畠山 泰貴, 小川 貴弘 映像情報メディア学会技術報告 36 (9) 313 -317 2012年02月 [査読無し][通常論文]
  
• An attempt of fan beam microwave CT system which determines the straight transmission path by time domain measurement of demodulated DC voltage

  Mutsumi Tamura, Takahiro Ogawa, Yuuki Takeuchi, Michio Miyakawa IEEJ Transactions on Electronics, Information and Systems 132 (6) 960 -967 2012年 [査読無し][通常論文]
   

  We have developed demodulated direct current voltage-based microwave CT (DC-MCT) which is composed on the basis of chirp-pulse microwave CT. DC-MCT was used time domain measurement technique to determine the shortest propagation path between the transmitting-and receiving-antennas. By using standard signal generator with the low phase noise and phase synchronization of signal source, the reconstructed amplitude-and phase-images can be obtained. A study of high speed imaging, the method of measurement and the influence of overshoot characteristics from the low pass filter were examined, then these images were evaluated for the number of rotary scanning of 50 and 72. In addition, for the purpose of improvement of resolution, pursuing a time domain spectrum which gives the max value of amplitude was showed the possibility to improve receiver dynamic range. At the result, this paper shows usefulness of new method for microwave imaging. © 2012 The Institute of Electrical Engineers of Japan.
• Image Inpainting by Block-Based Linear Regression with Optimal Block Selection

  Akira Tanaka, Takahiro Ogawa, Miki Haseyama 2012 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC) 2012年 [査読無し][通常論文]
   

  Estimation of missing entries in a multivariate data is one of classical problems in the field of statistical science. One of most popular approaches for this problem is linear regression based on the EM algorithm. When we consider to apply this approach to block-based image inpainting problems, we have additional information, that is, a target lost pixel could be included in multiple blocks, which implies that we have multiple candidates of estimates for the pixel. In such cases, we have to choose a good estimate among the multiple candidates. In this paper, we propose a novel image inpainting method incorporating optimal block selection in terms of the expected squared errors among multiple candidates of the estimate for the target pixel. Results of numerical examples are also shown to verify the efficacy of the proposed method.
• SVDDを用いた顕微鏡画像からの新種深海底生物の検出および分類体系上の位置の推定法

  長谷川 尭史, 小川 貴弘, 渡邉 日出海, 長谷山 美紀 The Journal of The Institute of Image Information and Television Engineers 66 (7) J240 -J250 2012年 [査読無し][通常論文]
   

  This paper presents a support vector data description (SVDD)-based method for finding new benthic species from microscopic images and its application to taxonomy position estimation. First, the proposed method generates hyperspheres that represent taxonomic species taxa of known species and enables automatic species classification. Furthermore, weight estimation of visual features based on multiple kernel learning (MKL) is used in this approach to realize automatic weighting of categorical traits that are traditionally determined by taxonomists. Next, based on the traditional taxonomic clas...
• サッカー映像における選手位置抽出結果を用いたチーム戦術の推定に関する検討

  大貫修平, 高橋翔, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2011 ROMBUNNO.154 2011年10月22日 [査読無し][通常論文]
  
• 楽曲特徴量に基づくクラシック楽曲の時代分類に関する考察

  松野恵一, 大串裕幸, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2011 ROMBUNNO.148 2011年10月22日 [査読無し][通常論文]
  
• 数値予報における予報誤差の解析に関する検討

  高橋信太郎, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2011 ROMBUNNO.151 2011年10月22日 [査読無し][通常論文]
  
• 画像検索結果の提示方法の有効性に関する一検討

  小林克希, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2011 ROMBUNNO.145 2011年10月22日 [査読無し][通常論文]
  
• 視聴行動解析に基づく関心度の推定に関する検討

  白石哲夫, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2011 ROMBUNNO.157 2011年10月22日 [査読無し][通常論文]
  
• 相互部分空間法を用いた音楽番組のインデキシング高精度化に関する検討

  吉田壮, 小川貴弘, 長谷山美紀 電気・情報関係学会北海道支部連合大会講演論文集(CD-ROM) 2011 ROMBUNNO.144 2011年10月22日 [査読無し][通常論文]
  
• 8-4 選手動作と歓声の関係性に注目したサッカー映像における重要場面の検出に関する検討(第8部門メディア処理2)

  久保 純貴, 高橋 翔, 小川 貴弘, 長谷山 美紀 映像情報メディア学会年次大会講演予稿集 2011 (2011) 8 -4-1-"8-4-2" 2011年08月24日 [査読無し][通常論文]
   

  This paper presents a detection method of important events based on relationship between player action and sound on stadium in soccer videos. Generally, since player action and sound on stadium have high correlation in the important events, we realize the detection by using their relationship based on canonical correlation analysis.
• 10-11 ぶれにより劣化した画像の復元に関する一考察 :事前確率分布の適応的なパラメータ設定の導入(第10部門画像処理2)

  吉崎 茜, 和泉 大佑, 小川 貴弘, 長谷山 美紀 映像情報メディア学会年次大会講演予稿集 111 (2011) 10 -11-1-"10-11-2" 2011年08月24日 [査読無し][通常論文]
   

  This paper presents a method for blurred image restoration. The proposed method adopts object matching for PSF estimation and adaptive parameter setting of a prior probability distribution for latent image estimation. Then, accurate blur removal becomes feasible without suffering from ringing artifacts.
• 選手動作と歓声の関係性に注目したサッカー映像における重要場面の検出に関する検討

  久保純貴, 高橋翔, 小川貴弘, 長谷山美紀 映像情報メディア学会年次大会講演予稿集(CD-ROM) 2011 ROMBUNNO.8-4 2011年08月01日 [査読無し][通常論文]
  
• ぶれにより劣化した画像の復元に関する一考察―事前確率分布の適応的なパラメータ設定の導入―

  吉崎茜, 和泉大佑, 小川貴弘, 長谷山美紀 映像情報メディア学会年次大会講演予稿集(CD-ROM) 2011 ROMBUNNO.10-11 2011年08月01日 [査読無し][通常論文]
  
• 映像から取得した人間の動きと楽曲との関係に基づく楽曲推薦手法 自動化と高精度化のための検討

  大串裕幸, 小川貴弘, 長谷山美紀 電子情報通信学会技術研究報告 110 (421(IE2010 104-144)) 83 -87 2011年02月14日 [査読無し][通常論文]
  
• 顕微鏡画像中に含まれる底生生物の自動分類法―SVDDを用いた分類の高精度化に関する検討―

  長谷川尭史, 小川貴弘, 渡邉日出海, 長谷山美紀 電子情報通信学会技術研究報告 110 (421(IE2010 104-144)) 125 -129 2011年02月14日 [査読無し][通常論文]
  
• 画像特徴を用いたキーワードの階層化手法とその画像アノテーションへの応用(ITS画像処理,映像メディア,視覚及び一般)

  桂井 麻里衣, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 35 (9) 69 -72 2011年02月14日 [査読無し][通常論文]
   

  本文では,画像特徴を用いたキーワードの階層化手法を提案し,その画像アノテーションへの応用について検討する.提案手法では,意味的に上位となるキーワードほど,そのキーワードの付与された画像セットにおける画像特徴のばらつきが大きくなることに着目し,以下のアプローチによりキーワードの階層化を行う.まず,あるキーワードに関する画像セットにおいて,画像特徴に基づくクラスタリングを適用する。次に,得られた結果に対し,キーワードの視覚的多様性を表す指標を導入する.具体的に,この指標は,各クラスタにおける画像特徴の分散及びクラスタ間の類似度から算出し,値を降順に並べることで,画像特徴に基づくキーワードの階層化が可能となる.得られた階層性に基づき,まず意味的に下位となるキーワードを画像特徴を用いて推定し,それらのキーワードと強い関係を持つ上位のキーワードを付与することで,画像アノテーションの高精度化が期待される.
• 映像から取得した人間の動きと楽曲との関係に基づく楽曲推薦手法 : 自動化と高精度化のための検討(ITS画像処理,映像メディア,視覚及び一般)

  大串 裕幸, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 35 (9) 83 -87 2011年02月14日 [査読無し][通常論文]
   

  本文では,以前に我々が提案した映像から取得される人間の動きと楽曲の関係に基づく楽曲推薦手法の高精度化と自動化について検討を行う.提案手法では,カーネル正準相関分析に基づく人間の動きと楽曲との関係のモデル化を行う際,人間が含まれる領域を予め与える必要がある.そこで,本文では,映像から得られる動き特徴に基づき,人間が撮像されている領域の自動抽出を可能とし,自動で楽曲を推薦することを可能とする.本文の最後では,映像から取得した人間の動きから楽曲を推薦する実験を行い,その有効性の確認を行う.
• 対象物検出機能を含むSVDDに基づく識別器の高精度化に関する一検討(ITS画像処理,映像メディア,視覚及び一般)

  岡田 周史, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 35 (9) 113 -117 2011年02月14日 [査読無し][通常論文]
   

  本文では,対象物検出機能を含むSVDDに基づく識別器の高精度化手法を提案する.提案手法では,対象物を含む学習画像からSVDDにより算出される超球の中心からの距離に基づいて,対象物を含む領域を自動で選択し,新たな学習画像を生成する.これにより,対象物の位置や向き,大きさ,形状などが多様な学習画像を用いた場合であっても,対象物を含む領域のみを新たに正例として識別器の学習に利用することが可能となる.また,選択された領域を内包する様々なサイズの局所ブロックも同時に新たな正例として利用することで,対象物を含む正例のバリエーションを増やすことが可能となる.以上により,近年の学習に基づく手法や局所特徴に基づく手法において困難であった,対象物を含む領域の自動選択,および得られる領域に基づく新たな学習画像の生成が可能となり,識別精度の向上が実現される.本文の最後では,提案手法の有効性を確認するため,実画像を用いた比較実験により性能の評価を行う.
• 複数の気象データを用いたフロー推定法の高精度化に関する一考察(ITS画像処理,映像メディア,視覚及び一般)

  李 徳智, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 35 (9) 119 -124 2011年02月14日 [査読無し][通常論文]
   

  本文では,複数の気象データを用いたフロー推定の高精度化に関する検討を行う.提案手法では,雲量のデータから三次元空間におけるフローを推定するため,二次元データを処理するための従来手法を三次元へ拡張する.さらに,風速や上昇流のデータからフロー推定の際の制約条件を新たに設定する.これにより,雲量のみを利用したフロー推定法と比較して,より高精度なフローの算出を可能とする.
• 顕微鏡画像中に含まれる底生生物の自動分類法 : SVDDを用いた分類の高精度化に関する検討(ITS画像処理,映像メディア,視覚及び一般)

  長谷川 尭史, 小川 貴弘, 渡邉 日出海, 長谷山 美紀 映像情報メディア学会技術報告 35 (9) 125 -129 2011年02月14日 [査読無し][通常論文]
   

  本文では,Support Vector Data Description(SVDD)を用いた顕微鏡画像中に含まれる生物の自動分類法を提案する.提案手法では,数種類の底生生物の画像を対象としてSVDDを用いた学習を行い,生成された識別器を用いて実際に撮像した顕微鏡画像中に含まれる生物の生物種分類を行う.このとき,SVDDの識別のみでは一度に多くの生物種を高精度に分類することは困難であるため,階層的な分岐処理を導入する.具体的に高精度に識別可能な生物種を順次取り除き生物種を絞り込むことで,複数の生物種を扱った場合でもより高精度な分類を行うことを可能とする.
• 撮像物体の対応を考慮したMCMC法に基づくシーン分割の高精度化に関する検討(ITS画像処理,映像メディア,視覚及び一般)

  宋 妍, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 35 (9) 131 -135 2011年02月14日 [査読無し][通常論文]
   

  本文では,撮像物体の対応を考慮したMarkov Chain Monte Carlo (MCMC)法に基づくシーン分割手法を提案する.提案手法では,映像中に含まれる対象物体の回転,スケール変化及び照明の変化に頑健なSIFT特徴量を用いて,特徴点による物体の対応付けを行い,得られるショット間の類似度に基づいて映像の構造に基づくシーン境界候補の抽出を行う.このとき,SIFTを用いることで,従来の手法で多く用いられる色ヒストグラム特徴量を用いた場合に撮像環境における対象物体の変化が大きいために発生していたシーンの過分割を抑制することが可能となる.さらに,提案手法ではMCMC法に基づいてシーン境界候補から真のシーン境界を推定する.このとき,映像の構造に注目して,シーン分割を行うことにより,従来のMCMC法を用いた手法に比べ,映像の構造を明確に持つ映像コンテンツのシーン分割が可能となる.本文の最後では,実際にテレビで放送された映像に対して提案手法を適用し,その有効性を確認する.さらに,提案手法及び従来手法で用いられる各特徴量がシーン分割に与える影響について考察を行う.
• ぶれにより劣化した低解像度動画像の高解像度化に関する考察 : PSFを用いた事後確率の高精度化に関する検討(ITS画像処理,映像メディア,視覚及び一般)

  和泉 大佑, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 35 (9) 159 -164 2011年02月14日 [査読無し][通常論文]
   

  本文では,ぶれにより劣化した低解像度動画像に対して,ぶれ関数を推定し,ぶれの除去及び高解像度化を同時に行う手法を提案する.提案手法では,高解像度フレームとぶれ関数の事後確率を定義することで,最大事後確率推定を用いて,それらを同時に推定する.このとき,ぶれ関数については,輝度勾配に注目し,フレーム中から自動で選択したエッジを多く含む領域を用いて,その推定を行う.このように,ぶれ関数の推定に適した領域を用いることで,その精度の向上が期待できる.以上により,提案手法では,ぶれ関数の推定誤差により生じる再構成結果の劣化を抑制し,高精度にぶれの除去及び高解像度化を実現する.
• 複数種類の識別器を用いた電子レセプトデータからの傷病名推定に関する検討(ITS画像処理,映像メディア,視覚及び一般)

  池田 啓典, 畠山 泰貴, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 35 (9) 171 -174 2011年02月14日 [査読無し][通常論文]
   

  本文では,電子レセプトデータに記載されている診療情報から医療資源を最も投入した傷病名を推定する手法について提案する.提案手法では,医療資源を最も投入した傷病名が明記されているDiagnosis Procedure Combination(DPC)データを教師データとし,診療情報から算出される特徴ベクトルと医療資源を最も投入した傷病名を表すラベルの組を用いて識別器を構築する.これにより,電子レセプトデータから医療資源を最も投入した傷病名の推定が可能となる.また本文では,複数種類の識別器より得られる推定結果を併用することにより,傷病名推定の高精度化について検討する.
• 簡便な画像処理による交通流計測とその実データへの適用への試み(ITS画像処理,映像メディア,視覚及び一般)

  西野 泰典, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 35 (9) 193 -198 2011年02月14日 [査読無し][通常論文]
   

  本文では,道路監視カメラにより撮像ざれた映像から走行車両の検出を行い,その検出結果より車速計測,車種判別を行う手法を提案する.提案手法では,日照条件によって,車体またはヘッドライトの光に基づいた,車速計測,車種判別を実現する.また,薄暮時など,短時間で日照が変化する環境下での交通流計測の高精度化を行うために,検出に利用される特徴である車体またはヘッドライトの光を対象の映像より自動で選択する処理を導入する.これにより,薄暮時の映像において,輝度ヒストグラムを用いて昼夜の交通流計測手法を切り替えた場合よりも,頑健な交通流計測が期待される.
• 購買履歴データ解析によるユーザの嗜好の可視化に関する検討(ITS画像処理,映像メディア,視覚及び一般)

  高谷 太紹, 小川 貴弘, 長谷山 美紀 映像情報メディア学会技術報告 35 (9) 199 -202 2011年02月14日 [査読無し][通常論文]
   

  本文では,購買履歴データを解析することで,複数のユーザにより構成されるユーザ集合の嗜好を分析し,それを可視化する手法を提案する.提案手法は,同時に購買された商品の組み合わせから特徴ベクトルを定義し,あらかじめユーザをプロフィールにより分類することで求めたユーザ集合を,互いに比較することでユーザ集合間の嗜好の差異を表現する.提案手法は,Bag-of-Wordsに着想を得たデータ解析を行っており,あるユーザの購買履歴データが十分に得られていない場合でも,そのユーザを含むユーザ集合の購買履歴データを利用し,ユーザ集合の嗜好を推定することが可能となる.さらに,算出されたユーザ集合の嗜好を表す特徴ベクトルに対し,多次元尺度構成法を施すことにより,その嗜好の可視化も可能とする.
• 画像特徴を用いたキーワードの階層化手法とその画像アノテーションへの応用(ITS画像処理,映像メディア,視覚及び一般)

  桂井 麻里衣, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. ITS 110 (420) 69 -72 2011年02月14日 [査読無し][通常論文]
   

  本文では,画像特徴を用いたキーワードの階層化手法を提案し,その画像アノテーションへの応用について検討する.提案手法では,意味的に上位となるキーワードほど,そのキーワードの付与された画像セットにおける画像特徴のばらつきが大きくなることに着目し,以下のアプローチによりキーワードの階層化を行う.まず,あるキーワードに関する画像セットにおいて,画像特徴に基づくクラスタリングを適用する。次に,得られた結果に対し,キーワードの視覚的多様性を表す指標を導入する.具体的に,この指標は,各クラスタにおける画像特徴の分散及びクラスタ間の類似度から算出し,値を降順に並べることで,画像特徴に基づくキーワードの階層化が可能となる.得られた階層性に基づき,まず意味的に下位となるキーワードを画像特徴を用いて推定し,それらのキーワードと強い関係を持つ上位のキーワードを付与することで,画像アノテーションの高精度化が期待される.
• 映像から取得した人間の動きと楽曲との関係に基づく楽曲推薦手法 : 自動化と高精度化のための検討(ITS画像処理,映像メディア,視覚及び一般)

  大串 裕幸, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. ITS 110 (420) 83 -87 2011年02月14日 [査読無し][通常論文]
   

  本文では,以前に我々が提案した映像から取得される人間の動きと楽曲の関係に基づく楽曲推薦手法の高精度化と自動化について検討を行う.提案手法では,カーネル正準相関分析に基づく人間の動きと楽曲との関係のモデル化を行う際人間が含まれる領域を予め与える必要がある.そこで,本文では,映像から得られる動き特徴に基づき,人間が撮像されている領域の自動抽出を可能とし,自動で楽曲を推薦することを可能とする.本文の最後では,映像から取得した人間の動きから楽曲を推薦する実験を行い,その有効性の確認を行う.
• 対象物検出機能を含むSVDDに基づく識別器の高精度化に関する一検討(ITS画像処理,映像メディア,視覚及び一般)

  岡田 周史, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. ITS 110 (420) 113 -117 2011年02月14日 [査読無し][通常論文]
   

  本文では,対象物検出機能を含むSVDDに基づく識別器の高精度化手法を提案する.提案手法では,対象物を含む学習画像からSVDDにより算出される超球の中心からの距離に基づいて,対象物を含む領域を自動で選択し,新たな学習画像を生成する.これにより,対象物の位置や向き,大きさ,形状などが多様な学習画像を用いた場合であっても,対象物を含む領域のみを新たに正例として識別器の学習に利用することが可能となる.また,選択された領域を内包する様々なサイズの局所ブロックも同時に新たな正例として利用することで,対象物を含む正例のバリエーションを増やすことが可能となる.以上により,近年の学習に基づく手法や局所特徴に基づく手法において困難であった,対象物を含む領域の自動選択,および得られる領域に基づく新たな学習画像の生成が可能となり,識別精度の向上が実現される.本文の最後では,提案手法の有効性を確認するため,実画像を用いた比較実験により性能の評価を行う.
• 複数の気象データを用いたフロー推定法の高精度化に関する一考察(ITS画像処理,映像メディア,視覚及び一般)

  李 徳智, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. ITS 110 (420) 119 -124 2011年02月14日 [査読無し][通常論文]
   

  本文では,複数の気象データを用いたフロー推定の高精度化に関する検討を行う.提案手法では,雲量のデータから三次元空間におけるフローを推定するため,二次元データを処理するための従来手法を三次元へ拡張する.さらに,風速や上昇流のデータからフロー推定の際の制約条件を新たに設定する.これにより,雲量のみを利用したフロー推定法と比較して,より高精度なフローの算出を可能とする.
• 顕微鏡画像中に含まれる底生生物の自動分類法 : SVDDを用いた分類の高精度化に関する検討(ITS画像処理,映像メディア,視覚及び一般)

  長谷川 尭史, 小川 貴弘, 渡邉 日出海, 長谷山 美紀 電子情報通信学会技術研究報告. ITS 110 (420) 125 -129 2011年02月14日 [査読無し][通常論文]
   

  本文では,Support Vector Data Description(SVDD)を用いた顕微鏡画像中に含まれる生物の自動分類法を提案する.提案手法では,数種類の底生生物の画像を対象としてSVDDを用いた学習を行い,生成された識別器を用いて実際に撮像した顕微鏡画像中に含まれる生物の生物種分類を行う.このとき,SVDDの識別のみでは一度に多くの生物種を高精度に分類することは困難であるため,階層的な分岐処理を導入する.具体的に高精度に識別可能な生物種を順次取り除き生物種を絞り込むことで,複数の生物種を扱った場合でもより高精度な分類を行うことを可能とする.
• 撮像物体の対応を考慮したMCMC法に基づくシーン分割の高精度化に関する検討(ITS画像処理,映像メディア,視覚及び一般)

  宋 妍, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. ITS 110 (420) 131 -135 2011年02月14日 [査読無し][通常論文]
   

  本文では,撮像物体の対応を考慮したMarkov Chain Monte Carlo(MCMC)法に基づくシーン分割手法を提案する.提案手法では,映像中に含まれる対象物体の回転,スケール変化及び照明の変化に頑健なSIFT特徴量を用いて,特徴点による物体の対応付けを行い,得られるショット間の類似度に基づいて映像の構造に基づくシーン境界候補の抽出を行う.このとき,SIFTを用いることで,従来の手法で多く用いられる色ヒストグラム特徴量を用いた場合に撮像環境における対象物体の変化が大きいために発生していたシーンの過分割を抑制することが可能となる.さらに,提案手法ではMCMC法に基づいてシーン境界候補から真のシーン境界を推定する.このとき,映像の構造に注目して,シーン分割を行うことにより,従来のMCMC法を用いた手法に比べ,映像の構造を明確に持つ映像コンテンツのシーン分割が可能となる.本文の最後では,実際にテレビで放送された映像に対して提案手法を適用し,その有効性を確認する.さらに,提案手法及び従来手法で用いられる各特徴量がシーン分割に与える影響について考察を行う.
• ぶれにより劣化した低解像度動画像の高解像度化に関する考察 : PSFを用いた事後確率の高精度化に関する検討(ITS画像処理,映像メディア,視覚及び一般)

  和泉 大佑, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. ITS 110 (420) 159 -164 2011年02月14日 [査読無し][通常論文]
   

  本文では,ぶれにより劣化した低解像度動画像に対して,ぶれ関数を推定し,ぶれの除去及び高解像度化を同時に行う手法を提案する.提案手法では,高解像度フレームとぶれ関数の事後確率を定義することで,最大事後確率推定を用いて,それらを同時に推定する.このとき,ぶれ関数については,輝度勾配に注目し,フレーム中から自動で選択したエッジを多く含む領域を用いて,その推定を行う.このように,ぶれ関数の推定に適した領域を用いることで,その精度の向上が期待できる.以上により,提案手法では,ぶれ関数の推定誤差により生じる再構成結果の劣化を抑制し,高精度にぶれの除去及び高解像度化を実現する.
• 複数種類の識別器を用いた電子レセプトデータからの傷病名推定に関する検討(ITS画像処理,映像メディア,視覚及び一般)

  池田 啓典, 畠山 泰貴, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. ITS 110 (420) 171 -174 2011年02月14日 [査読無し][通常論文]
   

  本文では,電子レセプトデータに記載されている診療情報から医療資源を最も投入した傷病名を推定する手法について提案する.提案手法では,医療資源を最も投入した傷病名が明記されているDiagnosis Procedure Combination(DPC)データを教師データとし,診療情報から算出される特徴ベクトルと医療資源を最も投入した傷病名を表すラベルの組を用いて識別器を構築する.これにより,電子レセプトデータから医療資源を最も投入した傷病名の推定が可能となる.また本文では,複数種類の識別器より得られる推定結果を併用することにより,傷病名推定の高精度化について検討する.
• 簡便な画像処理による交通流計測とその実データへの適用への試み(ITS画像処理,映像メディア,視覚及び一般)

  西野 泰典, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. ITS 110 (420) 193 -198 2011年02月14日 [査読無し][通常論文]
   

  本文では,道路監視カメラにより撮像された映像から走行車両の検出を行い,その検出結果より車速計測,車種判別を行う手法を提案する.提案手法では,日照条件によって,車体またはヘッドライトの光に基づいた,車速計測,車種判別を実現する.また,薄暮時など,短時間で日照が変化する環境下での交通流計測の高精度化を行うために,検出に利用される特徴である車体またはヘッドライトの光を対象の映像より自動で選択する処理を導入する.これにより,薄暮時の映像において,輝度ヒストグラムを用いて昼夜の交通流計測手法を切り替えた場合よりも,頑健な交通流計測が期待される.
• 購買履歴データ解析によるユーザの嗜好の可視化に関する検討(ITS画像処理,映像メディア,視覚及び一般)

  高谷 太紹, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. ITS 110 (420) 199 -202 2011年02月14日 [査読無し][通常論文]
   

  本文では,購買履歴データを解析することで,複数のユーザにより構成されるユーザ集合の嗜好を分析し,それを可視化する手法を提案する.提案手法は,同時に購買された商品の組み合わせから特徴ベクトルを定義し,あらかじめユーザをプロフィールにより分類することで求めたユーザ集合を,互いに比較することでユーザ集合間の嗜好の差異を表現する.提案手法は,Bag-oLWbrdsに着想を得たデータ解析を行っており,あるユーザの購買履歴データが十分に得られていない場合でも,そのユーザを含むユーザ集合の購買履歴データを利用し,ユーザ集合の嗜好を推定することが可能となる.さらに,算出されたユーザ集合の嗜好を表す特徴ベクトルに対し,多次元尺度構成法を施すことにより,その嗜好の可視化も可能とする.
• 画像特徴を用いたキーワードの階層化手法とその画像アノテーションへの応用(ITS画像処理,映像メディア,視覚及び一般)

  桂井 麻里衣, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. IE, 画像工学 110 (421) 69 -72 2011年02月14日 [査読無し][通常論文]
   

  本文では,画像特徴を用いたキーワードの階層化手法を提案し,その画像アノテーションへの応用について検討する.提案手法では,意味的に上位となるキーワードほど,そのキーワードの付与された画像セットにおける画像特徴のばらつきが大きくなることに着目し,以下のアプローチによりキーワードの階層化を行う.まず,あるキーワードに関する画像セットにおいて,画像特徴に基づくクラスタリングを適用する。次に,得られた結果に対し,キーワードの視覚的多様性を表す指標を導入する.具体的に,この指標は,各クラスタにおける画像特徴の分散及びクラスタ間の類似度から算出し,値を降順に並べることで,画像特徴に基づくキーワードの階層化が可能となる.得られた階層性に基づき,まず意味的に下位となるキーワードを画像特徴を用いて推定し,それらのキーワードと強い関係を持つ上位のキーワードを付与することで,画像アノテーションの高精度化が期待される.
• 映像から取得した人間の動きと楽曲との関係に基づく楽曲推薦手法 : 自動化と高精度化のための検討(ITS画像処理,映像メディア,視覚及び一般)

  大串 裕幸, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. IE, 画像工学 110 (421) 83 -87 2011年02月14日 [査読無し][通常論文]
   

  本文では,以前に我々が提案した映像から取得される人間の動きと楽曲の関係に基づく楽曲推薦手法の高精度化と自動化について検討を行う.提案手法では,カーネル正準相関分析に基づく人間の動きと楽曲との関係のモデル化を行う際人間が含まれる領域を予め与える必要がある.そこで,本文では,映像から得られる動き特徴に基づき,人間が撮像されている領域の自動抽出を可能とし,自動で楽曲を推薦することを可能とする.本文の最後では,映像から取得した人間の動きから楽曲を推薦する実験を行い,その有効性の確認を行う.
• 対象物検出機能を含むSVDDに基づく識別器の高精度化に関する一検討(ITS画像処理,映像メディア,視覚及び一般)

  岡田 周史, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. IE, 画像工学 110 (421) 113 -117 2011年02月14日 [査読無し][通常論文]
   

  本文では,対象物検出機能を含むSVDDに基づく識別器の高精度化手法を提案する.提案手法では,対象物を含む学習画像からSVDDにより算出される超球の中心からの距離に基づいて,対象物を含む領域を自動で選択し,新たな学習画像を生成する.これにより,対象物の位置や向き,大きさ,形状などが多様な学習画像を用いた場合であっても,対象物を含む領域のみを新たに正例として識別器の学習に利用することが可能となる.また,選択された領域を内包する様々なサイズの局所ブロックも同時に新たな正例として利用することで,対象物を含む正例のバリエーションを増やすことが可能となる.以上により,近年の学習に基づく手法や局所特徴に基づく手法において困難であった,対象物を含む領域の自動選択,および得られる領域に基づく新たな学習画像の生成が可能となり,識別精度の向上が実現される.本文の最後では,提案手法の有効性を確認するため,実画像を用いた比較実験により性能の評価を行う.
• 複数の気象データを用いたフロー推定法の高精度化に関する一考察(ITS画像処理,映像メディア,視覚及び一般)

  李 徳智, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. IE, 画像工学 110 (421) 119 -124 2011年02月14日 [査読無し][通常論文]
   

  本文では,複数の気象データを用いたフロー推定の高精度化に関する検討を行う.提案手法では,雲量のデータから三次元空間におけるフローを推定するため,二次元データを処理するための従来手法を三次元へ拡張する.さらに,風速や上昇流のデータからフロー推定の際の制約条件を新たに設定する.これにより,雲量のみを利用したフロー推定法と比較して,より高精度なフローの算出を可能とする.
• 顕微鏡画像中に含まれる底生生物の自動分類法 : SVDDを用いた分類の高精度化に関する検討(ITS画像処理,映像メディア,視覚及び一般)

  長谷川 尭史, 小川 貴弘, 渡邉 日出海, 長谷山 美紀 電子情報通信学会技術研究報告. IE, 画像工学 110 (421) 125 -129 2011年02月14日 [査読無し][通常論文]
   

  本文では,Support Vector Data Description(SVDD)を用いた顕微鏡画像中に含まれる生物の自動分類法を提案する.提案手法では,数種類の底生生物の画像を対象としてSVDDを用いた学習を行い,生成された識別器を用いて実際に撮像した顕微鏡画像中に含まれる生物の生物種分類を行う.このとき,SVDDの識別のみでは一度に多くの生物種を高精度に分類することは困難であるため,階層的な分岐処理を導入する.具体的に高精度に識別可能な生物種を順次取り除き生物種を絞り込むことで,複数の生物種を扱った場合でもより高精度な分類を行うことを可能とする.
• 撮像物体の対応を考慮したMCMC法に基づくシーン分割の高精度化に関する検討(ITS画像処理,映像メディア,視覚及び一般)

  宋 妍, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. IE, 画像工学 110 (421) 131 -135 2011年02月14日 [査読無し][通常論文]
   

  本文では,撮像物体の対応を考慮したMarkov Chain Monte Carlo(MCMC)法に基づくシーン分割手法を提案する.提案手法では,映像中に含まれる対象物体の回転,スケール変化及び照明の変化に頑健なSIFT特徴量を用いて,特徴点による物体の対応付けを行い,得られるショット間の類似度に基づいて映像の構造に基づくシーン境界候補の抽出を行う.このとき,SIFTを用いることで,従来の手法で多く用いられる色ヒストグラム特徴量を用いた場合に撮像環境における対象物体の変化が大きいために発生していたシーンの過分割を抑制することが可能となる.さらに,提案手法ではMCMC法に基づいてシーン境界候補から真のシーン境界を推定する.このとき,映像の構造に注目して,シーン分割を行うことにより,従来のMCMC法を用いた手法に比べ,映像の構造を明確に持つ映像コンテンツのシーン分割が可能となる.本文の最後では,実際にテレビで放送された映像に対して提案手法を適用し,その有効性を確認する.さらに,提案手法及び従来手法で用いられる各特徴量がシーン分割に与える影響について考察を行う.
• ぶれにより劣化した低解像度動画像の高解像度化に関する考察 : PSFを用いた事後確率の高精度化に関する検討(ITS画像処理,映像メディア,視覚及び一般)

  和泉 大佑, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. IE, 画像工学 110 (421) 159 -164 2011年02月14日 [査読無し][通常論文]
   

  本文では,ぶれにより劣化した低解像度動画像に対して,ぶれ関数を推定し,ぶれの除去及び高解像度化を同時に行う手法を提案する.提案手法では,高解像度フレームとぶれ関数の事後確率を定義することで,最大事後確率推定を用いて,それらを同時に推定する.このとき,ぶれ関数については,輝度勾配に注目し,フレーム中から自動で選択したエッジを多く含む領域を用いて,その推定を行う.このように,ぶれ関数の推定に適した領域を用いることで,その精度の向上が期待できる.以上により,提案手法では,ぶれ関数の推定誤差により生じる再構成結果の劣化を抑制し,高精度にぶれの除去及び高解像度化を実現する.
• 複数種類の識別器を用いた電子レセプトデータからの傷病名推定に関する検討(ITS画像処理,映像メディア,視覚及び一般)

  池田 啓典, 畠山 泰貴, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. IE, 画像工学 110 (421) 171 -174 2011年02月14日 [査読無し][通常論文]
   

  本文では,電子レセプトデータに記載されている診療情報から医療資源を最も投入した傷病名を推定する手法について提案する.提案手法では,医療資源を最も投入した傷病名が明記されているDiagnosis Procedure Combination(DPC)データを教師データとし,診療情報から算出される特徴ベクトルと医療資源を最も投入した傷病名を表すラベルの組を用いて識別器を構築する.これにより,電子レセプトデータから医療資源を最も投入した傷病名の推定が可能となる.また本文では,複数種類の識別器より得られる推定結果を併用することにより,傷病名推定の高精度化について検討する.
• 簡便な画像処理による交通流計測とその実データへの適用への試み(ITS画像処理,映像メディア,視覚及び一般)

  西野 泰典, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. IE, 画像工学 110 (421) 193 -198 2011年02月14日 [査読無し][通常論文]
   

  本文では,道路監視カメラにより撮像された映像から走行車両の検出を行い,その検出結果より車速計測,車種判別を行う手法を提案する.提案手法では,日照条件によって,車体またはヘッドライトの光に基づいた,車速計測,車種判別を実現する.また,薄暮時など,短時間で日照が変化する環境下での交通流計測の高精度化を行うために,検出に利用される特徴である車体またはヘッドライトの光を対象の映像より自動で選択する処理を導入する.これにより,薄暮時の映像において,輝度ヒストグラムを用いて昼夜の交通流計測手法を切り替えた場合よりも,頑健な交通流計測が期待される.
• 購買履歴データ解析によるユーザの嗜好の可視化に関する検討(ITS画像処理,映像メディア,視覚及び一般)

  高谷 太紹, 小川 貴弘, 長谷山 美紀 電子情報通信学会技術研究報告. IE, 画像工学 110 (421) 199 -202 2011年02月14日 [査読無し][通常論文]
   

  本文では,購買履歴データを解析することで,複数のユーザにより構成されるユーザ集合の嗜好を分析し,それを可視化する手法を提案する.提案手法は,同時に購買された商品の組み合わせから特徴ベクトルを定義し,あらかじめユーザをプロフィールにより分類することで求めたユーザ集合を,互いに比較することでユーザ集合間の嗜好の差異を表現する.提案手法は,Bag-oLWbrdsに着想を得たデータ解析を行っており,あるユーザの購買履歴データが十分に得られていない場合でも,そのユーザを含むユーザ集合の購買履歴データを利用し,ユーザ集合の嗜好を推定することが可能となる.さらに,算出されたユーザ集合の嗜好を表す特徴ベクトルに対し,多次元尺度構成法を施すことにより,その嗜好の可視化も可能とする.
• Time-of-flight experiments of vortex rings propagating from turbulent region of superfluid 4He at high temperature

  Y. Nago, T. Ogawa, K. Obara, H. Yano, O. Ishikawa, T. Hata Journal of Low Temperature Physics 162 (3-4) 322 -328 2011年02月 [査読無し][通常論文]
   

  We report the time-of-flight of quantized vortex rings generated by a vibrating wire in superfluid 4He which contains normal fluid component. A cover box of vibrating wires and slow cooling of superfluid reduce the number of vortices attached to wire surfaces, enabling us to study vortex rings propagating from a turbulent region. Using two vibrating wires as a generator and a detector of vortices, the time-of-flight of vortices propagating a distance of 0.88 mm was measured at 1.25 K. We find that the time-of-flights distribute from 0.06 s to 27.4 s, much larger than the lifetimes of circular vortex rings limited in the size of a generator amplitude. These results imply that large vortex rings with non-circular shape or vortex tangles are created by the generator, propagating slowly and colliding with the detector before complete disappearance. © 2010 Springer Science+Business Media, LLC.
• 固有空間BPLP法の補間精度に関する解析(ディジタル信号処理)

  田中 章, 小川 貴弘, 長谷山 美紀, 宮腰 政明 電子情報通信学会論文誌. A, 基礎・境界 94 (2) 116 -126 2011年02月01日 [査読無し][通常論文]
   

  欠損領域を有する数値データの補間技術として, 固有空間BPLP(Back Projection for Lost Pixels)法, 及び, その改良手法が提案されている.これらの手法は, 所与のデータから切り出したブロックデータの主成分構造を利用して欠損領域を推定する手法であり, 主要な固有空間の次元等を適切に選択することによって, 効果的に欠損部を補間することができる.一方, 重要なパラメータの一つである, 主要な固有空間の次元の選択の指針はこれまで与えられていなかった.本論文では, 主成分分析に用いる分散共分散行列と欠損ブロックに対応する分散共分散行列が等しいという理想的な条件下では, 固有空間BPLP法の改良手法の, 期待二乗誤差最小の意味での最適解が古典的なウィーナーフィルタであることを指摘するとともに, 固有空間として全空間を用いた解が, 上で述べた最適解であるウィーナーフィルタによる解に帰着することを示し, 結果として固有空間の最適な次元がブロックの次元そのものであることを示す.また, 主成分分析に用いる分散共分散行列と欠損ブロックに対応する分散共分散行列が完全に一致しない場合についても考察し, 上記理想的な条件下同様, 固有空間として全空間を採用することが最適となる十分条件を与える.また, 当該十分条件を満たさない場合についても, 数値実験によりウィーナーフィ...
• Human-Centric Navigation System Video Vortex for Video Retrieval

  Miki Haseyama, Takahiro Ogawa IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE 2011) 167 -168 2011年 [査読無し][通常論文]
   

  This paper presents a human-centric navigation system "Video Vortex" for video retrieval. This system is realized by the following functions: (i) Collaborative use of multimedia data for their multi-modal analysis, (ii) Preference extraction for the system to adapt to users' individual demands, and (iii) Adaptive visualization for users to be guided to their desired contents. These functions effectively provide a solution to the conventional problems of not being able to satisfy various users' demands, and successful video retrieval becomes feasible.
• An Attempt of Microwave CT System which discriminates the transmission path by means of time domain measurement

  Mutsumi Tamura, Takahiro Ogawa, Michio Miyakawa 2011 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC) 2011 3938 -3941 2011年 [査読無し][通常論文]
   

  A microwave-based computed tomography system was developed based on a method that uses time domain measurement to determine the shortest path of propagation components between two antennas. The method calculates shortest path of propagation components by examining mixer output DC components, delivering similar precision as chirp-pulse microwave computed tomography. Because post-mixer signal processing need only concerns DC currents, the effects of overshoot characteristics of baseband filters and the like are removed, simplifying measurement. System circuit composition is also simplified, lowering system costs. This paper provides a theoretical framework for the method, an S-parameter verification of the theory, and an experimental verification using a basic hardware construction. Results showed a restored image from the measurement data, indicating the utility of the method for microwave imaging.
• High Fidelity Breast Phantom and Its Microwave Imaging by CP-MCT

  Teruyuki Takahashi, Michio Miyakawa, Mutsumi Tamura, Takahiro Ogawa ASIA-PACIFIC MICROWAVE CONFERENCE 2011 1490 -1493 2011年 [査読無し][通常論文]
   

  Phantom model of breasts whose three-dimensional shape, size, and dielectric properties are very similar to real breasts of a woman has been developed for imaging experiments of Chirp Pulse Microwave Computed Tomography (CP-MCT). The breast model is consisted of four kinds of simulated tissues i.e., skin, muscle, breast fat, and tumor tissue. By using this, feasibility of clinical application of CP-MCT has been investigated. Not only three-dimensional shape of the phantom but also permittivity values of those four simulated tissues agree well with those of real human tissues. Microwave imaging is taken place by immersing the developed breast phantom and antennas in saline solution in order to minimize the diffraction at the skin surface. Chirp pulse microwave from 2 to 3 GHz is radiated from transmitting antenna by keeping the sweep time at 20 milliseconds. Image processing which boosts small signal components of the measured signal makes us possible to visualize the tumor shape in the tomography images of CP-MCT.
• Software-Based Microwave CT System Consisting of Antennas and Vector Network Analyzer

  Takahi