One more update here, looks like a clear implementation of this in PyTorch already.

  
      
      GitHub
  
  
    

anandsaha/nips.cocob.pytorch 57

nips.cocob.pytorch - PyTorch implementation of the NIPS'17 paper Training Deep Networks without Learning Rates Through Coin Betting.