Body: <p>I'm new to deep learning. I was wondering what's the relationship between a deep model complexity (e.g. total number of parameters, or depth) and the dataset size? </p>
  
  <p>Assuming I want to do a binary classification with 10K data for a problem like fire detection. How should I know what complexity I should go for?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-12-11T23:02:45.523Z
Comments.Text: In general, this is may not be an easy question to answer. The branch of artificial intelligence that studies these issues is called _computational_ (and _statistical) learning theory_. See also https://cs.stackexchange.com/q/75327/20691. I will eventually try to answer this question, but I don't know when.
Comments.UserDisplayName: nbro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-12-12T03:23:18.383Z
Comments.Text: Thanks. Yeah try to write something so i can give u some credit.
Comments.UserDisplayName: Mary
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-02-21T17:17:15.063Z
Comments.Text: A recent question (https://ai.stackexchange.com/questions/39176/why-are-neural-networks-so-data-hungry) seems related to this one.
Comments.UserDisplayName: Jaume Oliver Lafont
Tags: <machine-learning><deep-learning><classification><training><deep-neural-networks>
Title: Relationship between model complexity (depth) and dataset size
UserDisplayName: Mary
ThreadText: # Relationship between model complexity (depth) and dataset size
  
  (Asked by: username_0 on 2019-12-11)
  
  I'm new to deep learning. I was wondering what's the relationship between a deep model complexity (e.g. total number of parameters, or depth) and the dataset size?
  
  Assuming I want to do a binary classification with 10K data for a problem like fire detection. How should I know what complexity I should go for?
  
  **Tags:** machine-learning, deep-learning, classification, training, deep-neural-networks
  
  > **Comments:**
  > **username_1**: In general, this is may not be an easy question to answer. The branch of artificial intelligence that studies these issues is called _computational_ (and _statistical) learning theory_. See also https://cs.stackexchange.com/q/75327/20691. I will eventually try to answer this question, but I don't know when.  
  > **username_0**: Thanks. Yeah try to write something so i can give u some credit.  
  > **username_2**: A recent question (https://ai.stackexchange.com/questions/39176/why-are-neural-networks-so-data-hungry) seems related to this one.  
  
  ---
  
  ## 0 answers
  
  