Body: <p>I'm wondering what the difference between conditional learning and supervised learning is - especially in diffusion models? Am I correct to assume that diffusion models are supervised because in training, each noisy image is &quot;labeled&quot; with the original one but conditional learning would mean that in training, further labels (such as text data) would be included? And what do &quot;self-supervised&quot; and &quot;semi-supervised&quot; refer to in contrast?</p>
  <p>And is it possible to do inference on a conditionally trained model with only lets say an image and no labels?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-04-11T12:34:01.677Z
Comments.Text: well one learns $p(y|x)$ and the other one learns $p(x|y)$
Comments.UserDisplayName: Alberto
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-04-11T12:34:38.990Z
Comments.Text: and you can always swap them with the Bayes rule, though it might be intractable
Comments.UserDisplayName: Alberto
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-04-11T12:36:30.503Z
Comments.Text: Yes that is pretty much correct. Semi-supervised is an instance where you may have labels on for some of the data points (e.g. in node classification, you may only have labels for a subset of the nodes). Self-supervised is where you don't have any labels for your data. I'd say that self-supervised you use your data to learn useful representations, whereas unsupervised learning (where you also don't have labels) is more about looking for patterns and making predictions based on these patterns, such as clustering.
Comments.UserDisplayName: David
Tags: <training><supervised-learning><diffusion-models><data-labelling><self-supervised-learning>
Title: How are conditional models different from supervised models?
UserDisplayName: euleriwt
ThreadText: # How are conditional models different from supervised models?
  
  (Asked by: username_0 on 2024-04-11)
  
  I'm wondering what the difference between conditional learning and supervised learning is - especially in diffusion models? Am I correct to assume that diffusion models are supervised because in training, each noisy image is "labeled" with the original one but conditional learning would mean that in training, further labels (such as text data) would be included? And what do "self-supervised" and "semi-supervised" refer to in contrast?
  
  And is it possible to do inference on a conditionally trained model with only lets say an image and no labels?
  
  **Tags:** training, supervised-learning, diffusion-models, data-labelling, self-supervised-learning
  > **Comments:**
  > **username_1**: well one learns $p(y|x)$ and the other one learns $p(x|y)$  
  > **username_1**: and you can always swap them with the Bayes rule, though it might be intractable  
  > **username_2**: Yes that is pretty much correct. Semi-supervised is an instance where you may have labels on for some of the data points (e.g. in node classification, you may only have labels for a subset of the nodes). Self-supervised is where you don't have any labels for your data. I'd say that self-supervised you use your data to learn useful representations, whereas unsupervised learning (where you also don't have labels) is more about looking for patterns and making predictions based on these patterns, such as clustering.  
  
  ---
  
  ## 0 answers
  
  