Something might be going on with your PC recognizing yr controller if you have to restart HSR to swap! It automatically picks up whichever one is currently supplying an input for me. This is me using KB/M, then Controller, then KB/M with unplugged controller, then plugging it in and using it.