I did this : https://github.com/alexis-jacq/Pytorch_Policy_Search_Optimizer 15
So it’s possible to explore ARS performance using other kind of policies than linear using Pytorch tools.
But I did this before version 0.4, it’s probably a bit old-fashion now.