I have exactly same problem. I kept deleting it with conda uninstall cpuonly etc. But it just installs the cpu version only. My wsl2 sees the cuda without a problem and I have even installed 3Gb of all that crap of nvidia cuda tools inside ubuntu.
Have you solved the problem in the end? It really is a nightmare.