All you have to do is change the URL visitor targeting rule to be it is viewing a product page and on the FIlters section, change it to use on special filtering rule from Category of the product / category page is viewed.
All you have to do is change the URL visitor targeting rule to be Is Viewing a Product page and on the filters section, change it to use our special filtering rule of Category of the product / category page being viewed.