Answers.Body: <p>Higham and Higham's <a href="https://arxiv.org/pdf/1801.05894.pdf" rel="nofollow noreferrer">Deep Learning: An Introduction for Applied
  Mathematicians</a> is a fairly short introduction to neural networks that is written with mathematicians in mind.</p>
  
  <p>Another reference I would recommend is Shalev-Shwartz and Ben-David's <a href="https://www.cs.huji.ac.il/~shais/UnderstandingMachineLearning/understanding-machine-learning-theory-algorithms.pdf" rel="nofollow noreferrer">Understanding Machine Learning: From Theory to Algorithms</a>, particularly chapter 20.</p>
  
  <p>Both of the above approach neural network theory in the more traditional Definition–Theorem–Proof structure. </p>
  
  <p>I think it is worthwhile to build a simple network yourself in order to learn the principles before diving into a framework such as TensorFlow, if you're hoping to gain understanding of the principles rather than treating a neural network as a black box which might work, or not. The recommendation of <a href="http://neuralnetworksanddeeplearning.com/" rel="nofollow noreferrer">Neural Networks and Deep Learning</a> in kaya3's answer is useful for this, as Nielsen does write neural networks from scratch to demonstrate.</p>
  
  <p>For some theoretical background you may also find interest in <a href="https://www.sciencedirect.com/science/article/abs/pii/0893608089900208" rel="nofollow noreferrer">Hornik et al. (1989)</a> and <a href="https://www.nature.com/articles/323533a0" rel="nofollow noreferrer">Rumelhart et al. (1986)</a> if you have access.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-03-24T10:04:09.857Z
Answers.LastActivityDate: 2020-03-24T10:04:09.857Z
Answers.UserDisplayName: Aurora0001
Answers.Body: <p>@kaya3's comment links an excellent e-book, which describes the math in fair detail. </p>
  
  <p>I'll never get tired of recommending 3blue1brown's amazing video series that both motivates the problem and gives basic intuition but doesn't shortchange the math: <a href="https://www.3blue1brown.com/neural-networks" rel="nofollow noreferrer">https://www.3blue1brown.com/neural-networks</a></p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-03-18T21:37:48.630Z
Answers.LastActivityDate: 2020-03-18T21:37:48.630Z
Answers.UserDisplayName: Matthew W.
Answers.Body: <p>The online textbook <a href="http://neuralnetworksanddeeplearning.com/" rel="nofollow noreferrer"><em>Neural Networks and Deep Learning</em></a> by Michael Nielsen is quite good for mathematical content. It assumes the reader understands calculus, but requires no prior knowledge of machine learning. The book's own introduction explains fairly well what the book is about:</p>
  
  <blockquote>
    <p>The purpose of this book is to help you master the core concepts of neural networks, including modern techniques for deep learning. ... One conviction underlying the book is that it's better to obtain a solid understanding of the core principles of neural networks and deep learning, rather than a hazy understanding of a long laundry list of ideas. If you've understood the core ideas well, you can rapidly understand other new material.</p>
  </blockquote>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-03-18T22:58:39.240Z
Answers.LastActivityDate: 2020-03-18T22:58:39.240Z
Answers.UserDisplayName: kaya3
Body: <p>I am a mathematician who has done programming in Python, Java, and R. I would like to learn to make neural networks and artificial intelligence. Are there any good books for self learning AI for a person like me who loves learning theory behind neural networks, and who can learn by proving theorems and thinking the theory behind AI? When I just read Tensorflow's or Keras's documentation, I found that I couldn't understand how the networks work.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-03-18T22:59:56.623Z
Comments.Text: Thank you both - I've converted it to an answer.
Comments.UserDisplayName: kaya3
Tags: <self-learning><resource-request><artificial-intelligence>
Title: Learning suggestions for AI and neural networks for a mathematician
ThreadText: # Learning suggestions for AI and neural networks for a mathematician
  
  (Asked by: username_0 on 2020-02-14)
  
  I am a mathematician who has done programming in Python, Java, and R. I would like to learn to make neural networks and artificial intelligence. Are there any good books for self learning AI for a person like me who loves learning theory behind neural networks, and who can learn by proving theorems and thinking the theory behind AI? When I just read Tensorflow's or Keras's documentation, I found that I couldn't understand how the networks work.
  
  **Tags:** self-learning, resource-request, artificial-intelligence
  
  > **Comments:**
  > **username_1**: Thank you both - I've converted it to an answer.  
  
  ---
  
  ## 3 answers
  
  ### Answer by username_2 on 2020-03-24. Score: 3
  
  Higham and Higham's [Deep Learning: An Introduction for Applied
  Mathematicians](https://arxiv.org/pdf/1801.05894.pdf) is a fairly short introduction to neural networks that is written with mathematicians in mind.
  
  Another reference I would recommend is Shalev-Shwartz and Ben-David's [Understanding Machine Learning: From Theory to Algorithms](https://www.cs.huji.ac.il/~shais/UnderstandingMachineLearning/understanding-machine-learning-theory-algorithms.pdf), particularly chapter 20.
  
  Both of the above approach neural network theory in the more traditional Definition–Theorem–Proof structure.
  
  I think it is worthwhile to build a simple network yourself in order to learn the principles before diving into a framework such as TensorFlow, if you're hoping to gain understanding of the principles rather than treating a neural network as a black box which might work, or not. The recommendation of [Neural Networks and Deep Learning](http://neuralnetworksanddeeplearning.com/) in username_1's answer is useful for this, as Nielsen does write neural networks from scratch to demonstrate.
  
  For some theoretical background you may also find interest in [Hornik et al. (1989)](https://www.sciencedirect.com/science/article/abs/pii/0893608089900208) and [Rumelhart et al. (1986)](https://www.nature.com/articles/323533a0) if you have access.
  
  
  ---
  
  ### Answer by username_3 on 2020-03-18. Score: 2
  
  @username_1's comment links an excellent e-book, which describes the math in fair detail.
  
  I'll never get tired of recommending 3blue1brown's amazing video series that both motivates the problem and gives basic intuition but doesn't shortchange the math: <https://www.3blue1brown.com/neural-networks>
  
  
  ---
  
  ### Answer by username_1 on 2020-03-18. Score: 2
  
  The online textbook [*Neural Networks and Deep Learning*](http://neuralnetworksanddeeplearning.com/) by Michael Nielsen is quite good for mathematical content. It assumes the reader understands calculus, but requires no prior knowledge of machine learning. The book's own introduction explains fairly well what the book is about:
  
  > The purpose of this book is to help you master the core concepts of neural networks, including modern techniques for deep learning. ... One conviction underlying the book is that it's better to obtain a solid understanding of the core principles of neural networks and deep learning, rather than a hazy understanding of a long laundry list of ideas. If you've understood the core ideas well, you can rapidly understand other new material.
  
  
  ---
  
  