基于視覺推理的視頻理解（26頁）——基于圖神經網絡認知的智能計算專場.pdf

1、?視頻理解典型應用視頻理解典型應用?視頻理解研究目標視頻理解研究目標?視頻理解研究代表性任務視頻理解研究代表性任務?視頻理解的挑戰：復雜場景視頻理解的挑戰：復雜場景Kenneth Marino,Ruslan Salakhutdinov,Abhinav Gupta:The More You Know:Using Knowledge Graphs for Image Classification.CVPR 2017:20-28視頻理解的挑戰：小樣本視頻理解的挑戰：小樣本Junyu Gao,Tianzhu Zhang,Changsheng Xu:I Know the Relationships:Ze

2、ro-Shot Action Recognition via Two-Stream Graph Convolutional Networks and Knowledge Graphs.AAAI 2019:8303-8311視頻理解的挑戰：可解釋性視頻理解的挑戰：可解釋性Will Norcliffe-Brown,Stathis Vafeias,Sarah Parisot:Learning Conditioned Graph Structures for Interpretable Visual Question Answering.NeurIPS 2018:8344-8353視頻理解的挑戰：視頻

3、理解的挑戰：Medhini Narasimhan,Svetlana Lazebnik,Alexander G.Schwing:Out of the Box:Reasoning with Graph Convolution Nets for Factual Visual Question Answering.NeurIPS 2018:2659-2670深度推理學習深度推理學習圖神經網絡基本模型圖神經網絡基本模型Zonghan Wu,Shirui Pan,Fengwen Chen,Guodong Long,Chengqi Zhang,Philip S.Yu:A Comprehensive Surv

4、ey on Graph Neural Networks.CoRR abs/1901.00596(2019)ConvGNN for ClassificationGAE for EmbeddingSTGNN for Spatio-temporal LearningConvGNN with Gconvs圖神經網絡應用圖神經網絡應用Jie Zhou,Ganqu Cui,Zhengyan Zhang,Cheng Yang,Zhiyuan Liu,Maosong Sun:Graph Neural Networks:A Review of Methods and Applications.CoRR abs/

5、1812.08434(2018)深度圖推理學習：基本要素深度圖推理學習：基本要素?(?(?)?(?)?(深度圖推理學習到視覺內容理解深度圖推理學習到視覺內容理解Xinlei Chen,Li-Jia Li,Li Fei-Fei,Abhinav Gupta:Iterative Visual Reasoning Beyond Convolutions.CVPR 2018:7239-7248?Learning+Reasoning基于圖推理學習視覺內容描述基于圖推理學習視覺內容描述Ting Yao,Yingwei Pan,Yehao Li,Tao Mei:Exploring Visual Relatio

6、nship for Image Captioning.ECCV(14)2018:711-727基于圖推理學習視覺內容描述基于圖推理學習視覺內容描述Ting Yao,Yingwei Pan,Yehao Li,Tao Mei:Exploring Visual Relationship for Image Captioning.ECCV(14)2018:711-727基于深度推理學習的視覺問答基于深度推理學習的視覺問答Medhini Narasimhan,Svetlana Lazebnik,Alexander G.Schwing:Out of the Box:Reasoning with Graph

7、 Convolution Nets for Factual Visual Question Answering.NeurIPS 2018:2659-2670基于深度推理學習的視覺問答基于深度推理學習的視覺問答Medhini Narasimhan,Svetlana Lazebnik,Alexander G.Schwing:Out of the Box:Reasoning with Graph Convolution Nets for Factual Visual Question Answering.NeurIPS 2018:2659-2670基于深度推理學習的視頻動作識別基于深度推理學習的視頻

8、動作識別Yunpeng Chen,Marcus Rohrbach,Zhicheng Yan,Shuicheng Yan,Jiashi Feng,Yannis Kalantidis:Graph-Based Global Reasoning Networks?CVPR 2019?基于深度推理學習的視頻動作識別基于深度推理學習的視頻動作識別Yunpeng Chen,Marcus Rohrbach,Zhicheng Yan,Shuicheng Yan,Jiashi Feng,Yannis Kalantidis:Graph-Based Global Reasoning Networks?CVPR 201

9、9?基于深度推理學習的視覺關系識別基于深度推理學習的視覺關系識別Zhouxia Wang,Tianshui Chen,Jimmy S.J.Ren,Weihao Yu,Hui Cheng,Liang Lin:Deep Reasoning with Knowledge Graph for Social Relationship Understanding.IJCAI 2018:1021-1028基于深度推理學習的視覺關系識別基于深度推理學習的視覺關系識別Zhouxia Wang,Tianshui Chen,Jimmy S.J.Ren,Weihao Yu,Hui Cheng,Liang Lin:De

10、ep Reasoning with Knowledge Graph for Social Relationship Understanding.IJCAI 2018:1021-1028基于深度推理學習的組行為識別基于深度推理學習的組行為識別Jianchao Wu,Limin Wang,Li Wang,Jie Guo,Gangshan Wu:Learning Actor Relation Graphs for Group Activity Recognition.CVPR 2019基于深度推理學習的組行為識別基于深度推理學習的組行為識別Jianchao Wu,Limin Wang,Li Wang,Jie Guo,Gangshan Wu:Learning Actor Relation Graphs for Group Activity Recognition.CVPR 2019THANK!THANKS!THANKS!