Solved by ptrblck in post #2 
              
              
                You might be running into the Accuracy Paradox, which explains that the accuracy might be a misleading metric for imbalanced classification use cases. 
E.g. in case the majority class occurs in 91% of all cases, your model might only predict this single class to achieve the accuracy of 91%. While t…