Abstract: The traditional interaction mode of Computer Aided Design (CAD) based on “mouse+keyboard” is not conducive to the natural expression of design thinking.Facing the development demand of intelligent human-computer  interaction technology in product conceptual design,an intelligent interaction mode  was explored based on end-to-end model generation and manipulation,and a multimodal intelligent interaction framework for product conceptual design was constructed.According to the framework,key techniques of multimodal intelligent interaction  were studied including the multimodal signal synchronous acquisition,situation model construction and multimodal signal fusion on the level of feature and decision.On this basis,a multimodal intelligent interaction system based on brain-eye-hand was built and two typical application cases were provided to prove the feasibility of the framework and key technologies proposed in this paper.It provided ideas and technical means for the realization of a new generation of CAD intelligent interactive system.

Key words: product conceptual design, multimodal, intelligent interaction framework, computer aided design

摘要： 针对传统基于“鼠标+键盘”的计算机辅助设计(CAD)交互模式阻碍设计思维自然表达的问题,剖析了产品概念设计过程对智能人机交互技术的发展需求,探索一种以端对端模型生成及操控为特征的产品概念设计智能交互模式。构建了面向产品概念设计的多模态智能交互框架,分析了框架中涉及的多模态信号同步采集、产品概念设计情境模型构建、多模态信号特征层及决策层融合等关键技术;在此基础上,搭建了脑眼手融合的多模态智能交互系统,并通过两个典型应用案例,展示了所提框架和关键技术的可行性,为实现新一代CAD智能交互系统提供了思路和技术途径。

关键词: 产品概念设计, 多模态, 智能交互框架, 计算机辅助设计