《计算机应用研究》|Application Research of Computers

视觉—语言—行为:视觉语言融合研究综述

Vision-language-action:survey of integration of vision and language

免费全文下载 (已被下载 次)  
获取PDF全文
作者 李睿,郑顺义,王西旗
机构 武汉大学 遥感信息工程学院,武汉 430079
统计 摘要被查看 次,已被下载
文章编号 1001-3695(2020)11-002-3206-07
DOI 10.19734/j.issn.1001-3695.2019.09.0512
摘要 通过语言给予智能体指示使其完成通用性的任务是人工智能领域的愿景之一。近年来有越多越多的学者试图通过融合计算机视觉与自然语言处理领域的相关技术以期实现此目标。为了及时跟进相关领域的研究,把握视觉与语言融合方向前沿,对于视觉—语言—行为最新进展进行综述。首先简单介绍了融合视觉与语言的弱耦合尝试,之后重点综述了视觉—语言—行为这一最新方向相关的视觉语言导航、具身问答及其相似研究,最后总结了制约此领域发展的关键问题及可能的解决方案。
关键词 计算机视觉; 自然语言处理; 深度学习; 视觉语言导航; 具身问答
基金项目 国家自然科学基金资助项目(41671452)
本文URL http://www.arocmag.com/article/01-2020-11-002.html
英文标题 Vision-language-action:survey of integration of vision and language
作者英文名 Li Rui, Zheng Shunyi, Wang Xiqi
机构英文名 School of Remote Sensing & Information Engineering,Wuhan University,Wuhan 430079,China
英文摘要 The idea that might be able to give general and verbal instructions to a agent and have at least a reasonable probability that it will carry out the required task is one of the long-held visions of robotics and artificial intelligence(AI). It has noticed that more and more scholars in recent years have tried to this target using the latest advances in the field of computer vision and natural language progressing. In order to follow up the research in related fields and grasp the frontier of the fusion of vision and language, this paper reviewed the latest progress of visual-language-behavior. It first introduced the weak coupling experiment of fusion between vision and language, then focused on the vision-and-language navigation, the embodied question answering and their similar research, and finally looked forward to the future development trends in this field.
英文关键词 computer vision; natural language progressing; deep learning; vision and language navigation; embodied question answering
参考文献 查看稿件参考文献
 
收稿日期 2019/9/9
修回日期 2019/11/6
页码 3206-3212
中图分类号 TP181
文献标志码 A