Answers.Body: <p>Generative models have in common that they all model the distribution of the training samples. This makes it possible to sample from a distribution that is (hopefully) similar to the training data distribution. Different architecture types such as energy-based models, variational autoencoders, generative adversarial networks, autoregressive models, normalizing flows, and numerous hybrid approaches can all be considered generative. For more information see <a href="https://arxiv.org/pdf/2103.04922.pdf" rel="nofollow noreferrer">this review</a>.</p>
  <p>The same meaning is true for generative classifiers, they are called this way because they model how a particular class would generate its associated data. Discriminative classifiers learn to detect features to distinguish between the various possible classes. This visualization from <a href="https://medium.com/@jordi299/about-generative-and-discriminative-models-d8958b67ad32" rel="nofollow noreferrer">here</a> might be helpful in this regard:</p>
  <p><a href="https://i.sstatic.net/lA9wQ.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/lA9wQ.png" alt="disciminative vs. generative" /></a></p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-01-27T19:57:59.603Z
Answers.LastActivityDate: 2023-01-27T19:57:59.603Z
Answers.UserDisplayName: Mariusmarten
Body: <p>There are lots of explanations on DGM (Deep Generative Model) and generative classifier (most of the explanations on which are about generative classifier vs discriminative classifier)</p>
  <p>But, I can hardly find the common parts between the two concepts. In my understanding, 'generative' from DGM is quite straightforward - it almost goes the same with its literal meaning. In the contrary, 'generative' from the comparisons with the discriminative model is a little bit technical but it's the one that took the word earlier than the former one. (Jordan and Ng, 2002).</p>
  <p>Is it just that these two concepts are not really unrelated? Were they just used just because they do produce some distributions while learning?</p>
  
Tags: <machine-learning><deep-learning><terminology><generative-model>
Title: What is the difference between the term "generative" in classical machine learning and deep learning?
UserDisplayName: Rhee
ThreadText: # What is the difference between the term "generative" in classical machine learning and deep learning?
  
  (Asked by: username_0 on 2023-01-27)
  
  There are lots of explanations on DGM (Deep Generative Model) and generative classifier (most of the explanations on which are about generative classifier vs discriminative classifier)
  
  But, I can hardly find the common parts between the two concepts. In my understanding, 'generative' from DGM is quite straightforward - it almost goes the same with its literal meaning. In the contrary, 'generative' from the comparisons with the discriminative model is a little bit technical but it's the one that took the word earlier than the former one. (Jordan and Ng, 2002).
  
  Is it just that these two concepts are not really unrelated? Were they just used just because they do produce some distributions while learning?
  
  **Tags:** machine-learning, deep-learning, terminology, generative-model
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2023-01-27. Score: 2
  
  Generative models have in common that they all model the distribution of the training samples. This makes it possible to sample from a distribution that is (hopefully) similar to the training data distribution. Different architecture types such as energy-based models, variational autoencoders, generative adversarial networks, autoregressive models, normalizing flows, and numerous hybrid approaches can all be considered generative. For more information see [this review](https://arxiv.org/pdf/2103.04922.pdf).
  
  The same meaning is true for generative classifiers, they are called this way because they model how a particular class would generate its associated data. Discriminative classifiers learn to detect features to distinguish between the various possible classes. This visualization from [here](https://medium.com/@jordi299/about-generative-and-discriminative-models-d8958b67ad32) might be helpful in this regard:
  
  [![disciminative vs. generative](https://i.sstatic.net/lA9wQ.png)](https://i.sstatic.net/lA9wQ.png)
  
  
  ---
  
  