Answers.Body: <p>The math that you need to be comfortable with most deep learning (DL) topics (such as neural networks, gradient descent are back-propagation) is already mentioned in your post, but I will list the main subjects here too.</p>
  <ul>
  <li><strong>Linear algebra</strong> (an entire college-level course is necessary; you can start with Khan Academy videos/lessons and you can pick one of Gilbert Strang's books)</li>
  <li><strong>Calculus</strong> (same; Kenneth A. Ross' book is a decent one)</li>
  <li><strong>Numerical analysis/algorithms</strong> (you need be aware of numerical algorithms, like gradient descent, and concepts like convergence, round-off errors, etc; in fact, gradient descent is the widely used in DL)</li>
  <li><strong>Probability theory</strong> (you need to know what a probability distribution, random variable, etc., are)</li>
  <li><strong>Statistics</strong> (you don't need to know everything at the beginning, but the more you know the better)</li>
  </ul>
  <p>I didn't use <a href="https://www.deeplearningbook.org/" rel="nofollow noreferrer">this book</a> when I was studying deep learning, but part 1 of this book covers (at least some of) the most important mathematical prerequisites for deep learning, so you could try to read some of the chapters to understand at what point you are. I  don't have a favourite book for the last 3 topics listed above.</p>
  <p>Check out also the book <a href="https://mml-book.github.io/" rel="nofollow noreferrer">Mathematics for Machine Learning</a>. I never read it, but it looks like part 1 has many chapters on most important math topics for ML and so DL.</p>
  <p>By the way, I don't think that 3 weeks is a lot. You will definitely need more time to learn the mathematical prerequisites for deep learning, but the exact time depends on your specific background.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-06-28T12:54:50.767Z
Answers.Text: Thank you, I was already taking the Khan Academy course :D.
Answers.UserDisplayName: Vexea
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-01-24T15:36:30.850Z
Answers.Text: @Vexea After a long time, I've come across this post again. If my answer answered your question, you should accept it.
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-06-28T10:39:32.367Z
Answers.LastActivityDate: 2023-01-25T13:59:05.830Z
Answers.LastEditDate: 2023-01-25T13:59:05.830Z
Answers.UserDisplayName: nbro
Body: <p>I want to learn deep learning. After researching a little, I came to the conclusion that I need a lot of math. I've started a linear algebra course, and it takes a long time (2-3 weeks). I want to start using and applying deep learning to solve problems in this summer, but I assume I would not have enough time to learn all subjects (linear algebra, statistics and probability and calculus 1).</p>
  <p>So, what math should I learn before and while using and applying deep learning?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-06-28T09:26:25.713Z
Comments.Text: In my opinion the answer to this sort of question is often to do both at once. Assuming you've at least done first year university maths I'd say go for it. Learning for the sake of being able to start learning something else is a surefire way of minimizing engagement and uptake... Get started on DL and it will force you to learn the math required (as long as you're honest with yourself)
Comments.UserDisplayName: Alexander Soare
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-06-28T11:22:38.330Z
Comments.Text: What do you mean by "I want to start participating deep learning"? Do you mean participate in deep learning competitions/challenges? Maybe you can provide an example of such competition (if that's the case).
Comments.UserDisplayName: nbro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-06-28T12:53:43.850Z
Comments.Text: I meant while making neural networks or beefore.
Comments.UserDisplayName: Vexea
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-06-28T13:06:28.787Z
Comments.Text: Ok, I've modified your post to make it more understandable then. Make sure my changes are consistent with what you were asking.
Comments.UserDisplayName: nbro
Tags: <deep-learning><math>
Title: What math should I learn before and while using and applying deep learning?
UserDisplayName: Vexea
ThreadText: # What math should I learn before and while using and applying deep learning?
  
  (Asked by: username_0 on 2021-06-27)
  
  I want to learn deep learning. After researching a little, I came to the conclusion that I need a lot of math. I've started a linear algebra course, and it takes a long time (2-3 weeks). I want to start using and applying deep learning to solve problems in this summer, but I assume I would not have enough time to learn all subjects (linear algebra, statistics and probability and calculus 1).
  
  So, what math should I learn before and while using and applying deep learning?
  
  **Tags:** deep-learning, math
  
  > **Comments:**
  > **username_1**: In my opinion the answer to this sort of question is often to do both at once. Assuming you've at least done first year university maths I'd say go for it. Learning for the sake of being able to start learning something else is a surefire way of minimizing engagement and uptake... Get started on DL and it will force you to learn the math required (as long as you're honest with yourself)  
  > **username_2**: What do you mean by "I want to start participating deep learning"? Do you mean participate in deep learning competitions/challenges? Maybe you can provide an example of such competition (if that's the case).  
  > **username_0**: I meant while making neural networks or beefore.  
  > **username_2**: Ok, I've modified your post to make it more understandable then. Make sure my changes are consistent with what you were asking.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2021-06-28. Score: 3
  
  The math that you need to be comfortable with most deep learning (DL) topics (such as neural networks, gradient descent are back-propagation) is already mentioned in your post, but I will list the main subjects here too.
  
  * **Linear algebra** (an entire college-level course is necessary; you can start with Khan Academy videos/lessons and you can pick one of Gilbert Strang's books)
  * **Calculus** (same; Kenneth A. Ross' book is a decent one)
  * **Numerical analysis/algorithms** (you need be aware of numerical algorithms, like gradient descent, and concepts like convergence, round-off errors, etc; in fact, gradient descent is the widely used in DL)
  * **Probability theory** (you need to know what a probability distribution, random variable, etc., are)
  * **Statistics** (you don't need to know everything at the beginning, but the more you know the better)
  
  I didn't use [this book](https://www.deeplearningbook.org/) when I was studying deep learning, but part 1 of this book covers (at least some of) the most important mathematical prerequisites for deep learning, so you could try to read some of the chapters to understand at what point you are. I don't have a favourite book for the last 3 topics listed above.
  
  Check out also the book [Mathematics for Machine Learning](https://mml-book.github.io/). I never read it, but it looks like part 1 has many chapters on most important math topics for ML and so DL.
  
  By the way, I don't think that 3 weeks is a lot. You will definitely need more time to learn the mathematical prerequisites for deep learning, but the exact time depends on your specific background.
  
  > **Comments:**
  > **username_0**: Thank you, I was already taking the Khan Academy course :D.  
  > **username_2**: @username_0 After a long time, I've come across this post again. If my answer answered your question, you should accept it.  
  
  ---
  
  