Hi,
So you would like to extract features from frequency information and not from temporal domain which your data is currently in? I do not see a reason to perform the FFT though, the convolutional layers can behave something like band-pass filters to be sensitive to particular frequencies given the temporal data (of-course only if it helps the classification layers to classify correctly the training data).
Good luck,
Ahmed