Effects of Introducing Speech Interaction Modality on Performance of Special Vehicle Crew Under Various Task Complexity Conditions

Đã lưu trong:
Chi tiết về thư mục
Xuất bản năm:Systems vol. 13, no. 10 (2025), p. 847-863
Tác giả chính: Feng Chuanyan
Tác giả khác: Liu, Shuang, Xiaoru, Wanyan, Qian Chunying, Ji Kun, Xie, Fang, Zhou, Yue
Được phát hành:
MDPI AG
Những chủ đề:
Truy cập trực tuyến:Citation/Abstract
Full Text + Graphics
Full Text - PDF
Các nhãn: Thêm thẻ
Không có thẻ, Là người đầu tiên thẻ bản ghi này!

MARC

LEADER 00000nab a2200000uu 4500
001 3265952920
003 UK-CbPIL
022 |a 2079-8954 
024 7 |a 10.3390/systems13100847  |2 doi 
035 |a 3265952920 
045 2 |b d20250101  |b d20251231 
084 |a 231636  |2 nlm 
100 1 |a Feng Chuanyan  |u School of Aeronautic Science and Engineering, Beihang University, Beijing 100191, China; fengchuanyan@buaa.edu.cn (C.F.); liushuangbh@buaa.edu.cn (S.L.); 18376119@buaa.edu.cn (C.Q.); 19374392@buaa.edu.cn (K.J.) 
245 1 |a Effects of Introducing Speech Interaction Modality on Performance of Special Vehicle Crew Under Various Task Complexity Conditions 
260 |b MDPI AG  |c 2025 
513 |a Journal Article 
520 3 |a An experiment with a two interaction modalities (traditional: touch; novel: touch–speech) × two task complexities (low: visual single task; high: audio–visual dual task) within-subjects design was conducted to observe alterations in crew performance (including task performance, subjective workload, and eye responses) in a typical planning task-based on a high-fidelity special vehicle simulation platform. The results revealed that (1) compared to the traditional interaction modality, the novel interaction modality significantly improved task performance, reduced subjective workload, increased mean peak saccade velocity, and decreased fixation entropy; (2) under high task complexity, subjective workload, mean pupil diameter, and the nearest neighbor index showed significant increases, while no significant decline in task performance was observed; (3) no interaction effect of crew performance was observed between interaction modality and task complexity. The foregoing results imply that (1) the novel interaction modality incorporating speech input exhibits advantages over the traditional touch-based modality in terms of enhancing task performance (over 45% improvement) and reducing cognitive workload; (2) leveraging dual-channel audio–visual information processing facilitates the maintenance of task performance under high task complexity and multi-tasking demands; (3) eye movement characteristics may serve as informative indicators for evaluating the benefits of speech-based interaction and the effectiveness of cognitive resource allocation under high-complexity task conditions. The results can provide a basis for the design of the display and control interface in special vehicles. 
653 |a Visual tasks 
653 |a Speech 
653 |a Eye movements 
653 |a Data processing 
653 |a Smartphones 
653 |a Visual observation 
653 |a Hypotheses 
653 |a Task complexity 
653 |a Resource allocation 
653 |a Multitasking 
653 |a Workload 
653 |a Information processing 
653 |a Displays 
653 |a Audio data 
653 |a Performance evaluation 
653 |a Workloads 
653 |a Efficiency 
653 |a Vehicles 
700 1 |a Liu, Shuang  |u School of Aeronautic Science and Engineering, Beihang University, Beijing 100191, China; fengchuanyan@buaa.edu.cn (C.F.); liushuangbh@buaa.edu.cn (S.L.); 18376119@buaa.edu.cn (C.Q.); 19374392@buaa.edu.cn (K.J.) 
700 1 |a Xiaoru, Wanyan  |u School of Aeronautic Science and Engineering, Beihang University, Beijing 100191, China; fengchuanyan@buaa.edu.cn (C.F.); liushuangbh@buaa.edu.cn (S.L.); 18376119@buaa.edu.cn (C.Q.); 19374392@buaa.edu.cn (K.J.) 
700 1 |a Qian Chunying  |u School of Aeronautic Science and Engineering, Beihang University, Beijing 100191, China; fengchuanyan@buaa.edu.cn (C.F.); liushuangbh@buaa.edu.cn (S.L.); 18376119@buaa.edu.cn (C.Q.); 19374392@buaa.edu.cn (K.J.) 
700 1 |a Ji Kun  |u School of Aeronautic Science and Engineering, Beihang University, Beijing 100191, China; fengchuanyan@buaa.edu.cn (C.F.); liushuangbh@buaa.edu.cn (S.L.); 18376119@buaa.edu.cn (C.Q.); 19374392@buaa.edu.cn (K.J.) 
700 1 |a Xie, Fang  |u China North Vehicle Research Institute, China North Industries Group Corporation Ltd., Beijing 100072, China; christie_xie@163.com (F.X.); yuezhou201@126.com (Y.Z.) 
700 1 |a Zhou, Yue  |u China North Vehicle Research Institute, China North Industries Group Corporation Ltd., Beijing 100072, China; christie_xie@163.com (F.X.); yuezhou201@126.com (Y.Z.) 
773 0 |t Systems  |g vol. 13, no. 10 (2025), p. 847-863 
786 0 |d ProQuest  |t Advanced Technologies & Aerospace Database 
856 4 1 |3 Citation/Abstract  |u https://www.proquest.com/docview/3265952920/abstract/embedded/7BTGNMKEMPT1V9Z2?source=fedsrch 
856 4 0 |3 Full Text + Graphics  |u https://www.proquest.com/docview/3265952920/fulltextwithgraphics/embedded/7BTGNMKEMPT1V9Z2?source=fedsrch 
856 4 0 |3 Full Text - PDF  |u https://www.proquest.com/docview/3265952920/fulltextPDF/embedded/7BTGNMKEMPT1V9Z2?source=fedsrch