Did you normalize your data? Normalization helps especially in training neural networks. If I’m not mistaken, RandomForest classifiers are not really sensitive to different value ranges.
Also, try to overfit a small data sample, e.g. just 10 samples. Once your model predicts these samples (almost) perfectly, try to scale out the training.