What kind of information is in each numpy array or dataframe?  Why You chose RNN for that? If you have classification problem I would recommend to test class ML algorithms like decision trees, forest, gradient boosting over algorithms