Answers.Body: <p>&quot;Deep Learning&quot; by Ian Goodfellow, Yoshua Bengio, and Aaron Courville</p>
  <p>&quot;Neural Network Methods for Natural Language Processing&quot; by Yoav Goldberg</p>
  <p>&quot;Deep Reinforcement Learning&quot; by Pieter Abbeel and John Schulman</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-12-15T13:28:23.297Z
Answers.Text: Thank you for your reply. I will take a look at these books.
Answers.UserDisplayName: Thorsten Schmitz
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-12-28T00:44:33.193Z
Answers.Text: @ThorstenSchmitz This user has used ChatGPT or a similar model to generate this and other answers. I'd not trust him or his answers. In fact, the first book mentioned does not really cover in depth complex neural networks. The others I don't know.
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-12-11T07:16:25.320Z
Answers.LastActivityDate: 2023-12-11T07:16:25.320Z
Answers.UserDisplayName: han
Body: <p>In addition to basic forward networks, many books cover other basic network designs like CNN's and RNN's. However, they don't really go any further than that, explaining things like common approaches to solve complex tasks with more complex systems, e.g. dividing the work/data between networks, chaining different types of networks for different tasks and combining different partial solutions to a final solution.</p>
  <p>For example, I read that it's common to use multiple RNN's in serial and/or parallel for language processing like translating text, dividing the work to something like understanding the intent first, then translating it, avoiding a (probably wrong) literal translation of the plain words without any meaning. Another example I remember reading about is how game AI's, e.g. a chess AI, use different types of networks to analyze moves, weight its options and decide on strategies. Or a robot using a CNN to analyse camera footage and then using other networks to process the input and decide on what action to take.</p>
  <p>I found <a href="https://ai.stackexchange.com/questions/3647/what-are-some-intermediate-or-advanced-books-on-neural-networks">this post</a>, which mentions to books. I know the first one (NNDesign), though I haven't read it yet, but it doesn't seem to cover what I'm looking for. The second one seems to have a chapter on modular networks, which seems to go into the right direction. It's now much, though.</p>
  <p>Does anyone have some good books/resources on this kind of topics?</p>
  
Tags: <neural-networks><deep-learning><ai-design><network-design>
Title: Advanced / Complex Neural Network (System) Design
UserDisplayName: Thorsten Schmitz
ThreadText: # Advanced / Complex Neural Network (System) Design
  
  (Asked by: username_0 on 2023-12-09)
  
  In addition to basic forward networks, many books cover other basic network designs like CNN's and RNN's. However, they don't really go any further than that, explaining things like common approaches to solve complex tasks with more complex systems, e.g. dividing the work/data between networks, chaining different types of networks for different tasks and combining different partial solutions to a final solution.
  
  For example, I read that it's common to use multiple RNN's in serial and/or parallel for language processing like translating text, dividing the work to something like understanding the intent first, then translating it, avoiding a (probably wrong) literal translation of the plain words without any meaning. Another example I remember reading about is how game AI's, e.g. a chess AI, use different types of networks to analyze moves, weight its options and decide on strategies. Or a robot using a CNN to analyse camera footage and then using other networks to process the input and decide on what action to take.
  
  I found [this post](https://ai.stackexchange.com/questions/3647/what-are-some-intermediate-or-advanced-books-on-neural-networks), which mentions to books. I know the first one (NNDesign), though I haven't read it yet, but it doesn't seem to cover what I'm looking for. The second one seems to have a chapter on modular networks, which seems to go into the right direction. It's now much, though.
  
  Does anyone have some good books/resources on this kind of topics?
  
  **Tags:** neural-networks, deep-learning, ai-design, network-design
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2023-12-11. Score: 0
  
  "Deep Learning" by Ian Goodfellow, Yoshua Bengio, and Aaron Courville
  
  "Neural Network Methods for Natural Language Processing" by Yoav Goldberg
  
  "Deep Reinforcement Learning" by Pieter Abbeel and John Schulman
  
  > **Comments:**
  > **username_0**: Thank you for your reply. I will take a look at these books.  
  > **username_2**: @username_0 This user has used ChatGPT or a similar model to generate this and other answers. I'd not trust him or his answers. In fact, the first book mentioned does not really cover in depth complex neural networks. The others I don't know.  
  
  ---
  
  