Inconsistencies across Feature Selection methods; which methods are best? I am new to ML, so please pardon my ignorance.
I have 12 features (left), and the column headers are different feature selection methods. Dark green indicates the a stronger predictor while white indicates a weaker predictor (I think for Fisher scores, a lower index corresponds to a better rank and thus a better predictor?)
My problem is that the 6 different methods are not as consistent as they should be. Is this expected, and if so, which features should be picked?

On a related note, these methods were performed on X_train and y_train. Should it be done on the X and y instead of the training sets?
Many thanks.


You’re using different criteria to select the important features. The whole point of having different criteria is to be able to select features that are important according to what you value. If they gave the same answer, they would be boring.
Further, feature selection is notoriously unstable, as Frank Harrell has discussed many times; I like his presentation here that starts around the 15-minute mark. I suggest that you question why you should do feature selection at all.
