Answers.Body: <p>The topic is multimodal neural networks.</p>
  
  <p>Here some repositories that i hope will help me a lot </p>
  
  <p><a href="https://docs.google.com/presentation/d/1z8-GeTXvSuVbcez8R6HOG1Tw_F3A-WETahQdTV38_uc/edit#slide=id.g1ea5aac985_0_892" rel="nofollow noreferrer">https://docs.google.com/presentation/d/1z8-GeTXvSuVbcez8R6HOG1Tw_F3A-WETahQdTV38_uc/edit#slide=id.g1ea5aac985_0_892</a></p>
  
  <p><a href="https://github.com/prml615/prml" rel="nofollow noreferrer">https://github.com/prml615/prml</a></p>
  
  <p><a href="https://github.com/husseinmozannar/multimodal-deep-learning-for-disaster-response" rel="nofollow noreferrer">https://github.com/husseinmozannar/multimodal-deep-learning-for-disaster-response</a></p>
  
  <p><a href="https://github.com/guillaume-be/multimodal-avito" rel="nofollow noreferrer">https://github.com/guillaume-be/multimodal-avito</a></p>
  
  <p>Thanks to kbrose, his suggestion led me to this type of architectures.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-09-20T03:23:32.823Z
Answers.LastActivityDate: 2019-09-20T03:23:32.823Z
Answers.UserDisplayName: 0xTochi
Body: <p>I have a dataset of images with 9 different classes. However, there are different categories with the same type of associated image and only can be differentiated with an associated matrix in my specific problem.</p>
  
  <p>I want to train a neural network with the images and the associated matrix as inputs. What type of architecture is good to use? Or where can I find bibliography about it?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-09-15T11:39:31.550Z
Comments.Text: Hi. What do you mean by "different categories with the same type of associated image". What do you mean by "type of an image"? Also, what do you mean by "associated matrix"?
Comments.UserDisplayName: nbro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-09-16T12:04:32.310Z
Comments.Text: i have a physic system with an associated hamiltonian (the matrix), this hamiltonian have information about my problem and can be calculated for any  time and geometry configuration.
  The images are png associated with different geometries. I want to classiffy the configurations but there are configuration with the same image and different hamiltonian.
Comments.UserDisplayName: 0xTochi
Tags: <neural-networks><machine-learning><deep-learning><convolutional-neural-networks><ai-design>
Title: Image classification with an associated matrix
UserDisplayName: 0xTochi
ThreadText: # Image classification with an associated matrix
  
  (Asked by: username_0 on 2019-09-15)
  
  I have a dataset of images with 9 different classes. However, there are different categories with the same type of associated image and only can be differentiated with an associated matrix in my specific problem.
  
  I want to train a neural network with the images and the associated matrix as inputs. What type of architecture is good to use? Or where can I find bibliography about it?
  
  **Tags:** neural-networks, machine-learning, deep-learning, convolutional-neural-networks, ai-design
  
  > **Comments:**
  > **username_1**: Hi. What do you mean by "different categories with the same type of associated image". What do you mean by "type of an image"? Also, what do you mean by "associated matrix"?  
  > **username_0**: i have a physic system with an associated hamiltonian (the matrix), this hamiltonian have information about my problem and can be calculated for any  time and geometry configuration. The images are png associated with different geometries. I want to classiffy the configurations but there are configuration with the same image and different hamiltonian.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_0 on 2019-09-20. Score: 0 | Accepted answer
  
  The topic is multimodal neural networks.
  
  Here some repositories that i hope will help me a lot
  
  <https://docs.google.com/presentation/d/1z8-GeTXvSuVbcez8R6HOG1Tw_F3A-WETahQdTV38_uc/edit#slide=id.g1ea5aac985_0_892>
  
  <https://github.com/prml615/prml>
  
  <https://github.com/husseinmozannar/multimodal-deep-learning-for-disaster-response>
  
  <https://github.com/guillaume-be/multimodal-avito>
  
  Thanks to kbrose, his suggestion led me to this type of architectures.
  
  
  ---
  
  