Provided herein in some embodiments is a deep neural network (DNN) system based on a reconfigurable device such as a field programmable gate arrays (FPGA) configured to use lesser computational resources when training a DNN while maintaining its performance and accuracy levels. Said DNN system may further be used to train a DNN in an increased, rapid pace hence providing real-time operation tailored to the various needs of the user. The reconfigurable device of said DNN system may be dynamically reprogrammed before or during training sessions, or, alternatively, may be programed 'on-the-fly' before or during training sessions while adjusting its datapath in response to monitored operational parameters of the DNN system. Such datapath adjustments ensure that multiplications performed during convolution do not include data with under-threshold values, but rather only data with above-threshold value, thereby reducing processing time and computing resources as well as required memory bandwidth.
RECONFIGURABLE DEVICE BASED DEEP NEURAL NETWORK SYSTEM AND METHOD