Body: <p>Is there any recent work on combining clustering approaches (k-means, or gaussian mixture or PGM) with deep learning for computer vision?</p>
  <p>In particular I'm interested in if anyone has used the first few layers of a deep learning network as feature extractors in conjunction with clustering algorithms which have been engineered to induce things like translation and rotation invariance while preserving basic object structure?</p>
  <p>Taking the max value out of the output of each feature and fitting them to a gaussian mixture is the easiest approach but I'm interested in seeing other ways you could structure the clustering algorithm. For example I'm interested in seeing how you might learn structure between features that includes position information.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-07-28T14:43:01.840Z
Comments.Text: My interpretation is that you want to take non-deep learning based clustering algorithms and use deep learning to improve on them in a collective way.  If so, why not just use deep learning on feature data?  There are several deep learning clustering algorithms.
Comments.UserDisplayName: Brian O'Donnell
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-07-28T15:54:01.067Z
Comments.Text: Deep learning can be unreliable for consistent detection and sometimes produces completely wrong results without ability to interpret them.
Comments.UserDisplayName: FourierFlux
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-07-28T16:18:21.243Z
Comments.Text: Is your statement that "deep learning can be unreliable" a general one or is it in regards to results you have seen using DL-based clustering on your data?
Comments.UserDisplayName: Brian O'Donnell
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-07-28T17:43:14.207Z
Comments.Text: My premise, wrong or right is that classic clustering algorithms are less prone to catastrophic failure that sometimes is seen neural networks so I'm interested in seeing how clustering algorithms could be used in conjunction with low level feature extractors.
Comments.UserDisplayName: FourierFlux
Tags: <deep-learning><computer-vision><clustering>
Title: Combining clustering and deep learning for computer vision
UserDisplayName: FourierFlux
ThreadText: # Combining clustering and deep learning for computer vision
  
  (Asked by: username_0 on 2020-07-27)
  
  Is there any recent work on combining clustering approaches (k-means, or gaussian mixture or PGM) with deep learning for computer vision?
  
  In particular I'm interested in if anyone has used the first few layers of a deep learning network as feature extractors in conjunction with clustering algorithms which have been engineered to induce things like translation and rotation invariance while preserving basic object structure?
  
  Taking the max value out of the output of each feature and fitting them to a gaussian mixture is the easiest approach but I'm interested in seeing other ways you could structure the clustering algorithm. For example I'm interested in seeing how you might learn structure between features that includes position information.
  
  **Tags:** deep-learning, computer-vision, clustering
  
  > **Comments:**
  > **username_1**: My interpretation is that you want to take non-deep learning based clustering algorithms and use deep learning to improve on them in a collective way.  If so, why not just use deep learning on feature data?  There are several deep learning clustering algorithms.  
  > **username_0**: Deep learning can be unreliable for consistent detection and sometimes produces completely wrong results without ability to interpret them.  
  > **username_1**: Is your statement that "deep learning can be unreliable" a general one or is it in regards to results you have seen using DL-based clustering on your data?  
  > **username_0**: My premise, wrong or right is that classic clustering algorithms are less prone to catastrophic failure that sometimes is seen neural networks so I'm interested in seeing how clustering algorithms could be used in conjunction with low level feature extractors.  
  
  ---
  
  ## 0 answers
  
  