What is the best way to specify a learning rate per batch iteration? Let’s say I have (an independently constructed)  list [a1,a2,…,a_k]. What I need is for the first batch to have lr = a1, for the second lr = a2 and so on. Epochs are not that important (i.e. that batch = N is the same as batch = 0 is not important).
Thanks!