This should usually work. However inside your notebook you should have a menu where you can select different kernels.
I’ve seen Jupyter sometimes select the system Python installation instead of the conda one, so I stick to put everything in a virtual environment.