title: how can I develop a stochastic gradient descent optimizer for CNNs algorithm in TensorFlow?
body: <p>I use TensorFlow library in CNNs, python.</p>
  
  <p>I would like to develop a stochastic gradient descent optimizer for CNNs optimizer with the following parameters:</p>
  
  <pre><code>learning rate = 0.05,
  decay = 1e-6, 
  Nesterov momentum 0.9
  </code></pre>
  
  <p>I would like to know how I should change my code to achieve that. Here is the code I have so far:</p>
  
  <pre><code>optimizer = tf.train.AdamOptimizer(learning_rate=0.05).minimize(cost)
  </code></pre>
  
  <p>Thanks.</p>