TY - JOUR PY - 2019// TI - Walking imagery evaluation in brain computer interfaces via a new deep learning framework JO - IEEE transactions on neural systems and rehabilitation engineering A1 - Lei, Baiying A1 - Liu, Xiaolu A1 - Liang, Shuang A1 - Hang, Wenlong A1 - Wang, Qiong A1 - Choi, Kup-Sze A1 - Qin, Jing SP - 497 EP - 506 VL - 27 IS - 3 N2 - Brain-computer interfaces (BCIs) based on motor imagery (MI) have been widely used to support the rehabilitation of motor functions of upper limbs rather than lower limbs. This is probably because it is more difficult to detect brain activities of lower limb MI. In order to reliably detect the brain activities of lower limbs to restore or improve the walking ability of the disabled, we propose a new paradigm of walking imagery (WI) in a virtual environment (VE) in order to elicit reliable brain activities and achieve a significant training effect. First, we extract and fuse both spatial and time-frequency features as a multi-view feature (MVF) to represent the patterns in the brain activity. Second, we design a multi-view multi-level deep polynomial network (MMDPN) to explore the complementarity among the features so as to improve the detection of walking from an idle state. Our extensive experimental results show that the VE-based paradigm significantly performs better than the traditional text-based paradigm. In addition, the VE-based paradigm can effectively help users to modulate brain activities and improve the quality of electroencephalography signals. We also observe that the MMDPN outperforms other deep learning methods in terms of classification performance.
Language: en
LA - en SN - 1534-4320 UR - http://dx.doi.org/10.1109/TNSRE.2019.2895064 ID - ref1 ER -