Within sEMG-based gesture recognition, a chasm exists in the literature between offline accuracy and real-time usability of a classifier. This gap mainly stems from the four main dynamic factors in sEMG-based gesture recognition: gesture intensity, limb position, electrode shift  and transient changes in the signal . These factors are hard to include within an offline dataset as each of them exponentially augment the number of segments to be recorded. On the other hand , online datasets are biased towards the sEMG-based algorithms providing feedback to the participants, limiting the usability of such datasets as benchmarks. This paper proposes a virtual reality (VR) environment and a real-time experimental protocol from which the four main dynamic factors can more easily be studied. During the online experiment, the gesture recognition feedback is provided through the leap motion camera, enabling the proposed dataset to be re-used to compare future sEMG-based algorithms. 20 able-bodied persons took part in this study, completing three to four sessions over a period spanning between 14 and 21 days. Finally, TADANN, a new transfer learning-based algorithm, is proposed for long term gesture classification and significantly (p<0.05) outperforms  fine-tuning a network .
Within the field of electromyography-based (EMG) gesture recognition, disparities exist between the offline accuracy reported in the literature and the real-time usability of a classifier. This gap mainly stems from two factors: 1) The absence of a controller, making the data collected dissimilar to actual control. 2) The difficulty of including the four main dynamic factors (gesture intensity, limb position, electrode shift , and transient changes in the signal ), as including their permutations drastically increases the amount of data to be recorded. Contrarily , online datasets are limited to the exact EMG-based controller used to record them, necessitating the recording of a new dataset for each control method or variant to be tested. Consequently, this paper proposes a new type of dataset to serve as an intermediate between offline and online datasets, by recording the data using a real-time experimental protocol . The protocol, performed in virtual reality, includes the four main dynamic factors and uses an EMG-independent controller to guide movements. This EMG-independent feedback ensures that the user is in-the-loop during recording, while enabling the resulting dynamic dataset to be used as an EMG-based benchmark. The dataset is comprised of 20 able-bodied participants completing three to four sessions over a period of 14 to 21 days. The ability of the dynamic dataset to serve as a benchmark is leveraged to evaluate the impact of different recalibration techniques for long-term (across-day) gesture recognition, including a novel algorithm, named TADANN. TADANN consistently and significantly (p<0.05) outperforms using fine-tuning as the recalibration technique .
R
sEMG-based
the field of electromyography-based (EMG)
R
a chasm exists in the literature between offline accuracy and
disparities exist between the offline accuracy reported in the literature and the
R
the
two factors: 1) The absence of a controller, making the data collected dissimilar to actual control. 2) The difficulty of including the
R
in sEMG-based gesture recognition: gesture
(gesture
A
,
R
. These factors are hard to include within an offline dataset as each of them exponentially augment the number of segments
), as including their permutations drastically increases the amount of data
R
On the other hand
Contrarily
R
biased towards the sEMG-based algorithms providing feedback to the participants, limiting the usability of such datasets as benchmarks. This
limited to the exact EMG-based controller used to record them, necessitating the recording of a new dataset for each control method or variant to be tested. Consequently, this
R
virtual reality (VR) environment and
new type of dataset to serve as an intermediate between offline and online datasets, by recording the data using
R
from which
. The protocol, performed in virtual reality, includes
R
can more easily be studied. During the online experiment, the gesture recognition feedback is provided through the leap motion camera, enabling the proposed
and uses an EMG-independent controller to guide movements. This EMG-independent feedback ensures that the user is in-the-loop during recording, while enabling the resulting dynamic
R
re-used to compare future sEMG-based algorithms.
used as an EMG-based benchmark. The dataset is comprised of
R
persons took part in this study,
participants
R
spanning between
of
R
and
to
R
Finally, TADANN, a new transfer learning-based algorithm, is proposed for long term gesture classification
The ability of the dynamic dataset to serve as a benchmark is leveraged to evaluate the impact of different recalibration techniques for long-term (across-day) gesture recognition, including a novel algorithm, named TADANN. TADANN consistently
A
using
R
a network
as the recalibration technique