<p>I'm new to deep learning. I was wondering what's the relationship between a deep model complexity (e.g. total number of parameters, or depth) and the dataset size? </p>

<p>Assuming I want to do a binary classification with 10K data for a problem like fire detection. How should I know what complexity I should go for?</p>

CC BY-SA 4.0
2019-12-11T23:02:45.523Z
In general, this is may not be an easy question to answer. The branch of artificial intelligence that studies these issues is called _computational_ (and _statistical) learning theory_. See also https://cs.stackexchange.com/q/75327/20691. I will eventually try to answer this question, but I don't know when.
nbro
CC BY-SA 4.0
2019-12-12T03:23:18.383Z
Thanks. Yeah try to write something so i can give u some credit.
Mary
CC BY-SA 4.0
2023-02-21T17:17:15.063Z
A recent question (https://ai.stackexchange.com/questions/39176/why-are-neural-networks-so-data-hungry) seems related to this one.
Jaume Oliver Lafont
<machine-learning><deep-learning><classification><training><deep-neural-networks>
Relationship between model complexity (depth) and dataset size
Mary
# Relationship between model complexity (depth) and dataset size

(Asked by: username_0 on 2019-12-11)

I'm new to deep learning. I was wondering what's the relationship between a deep model complexity (e.g. total number of parameters, or depth) and the dataset size?

Assuming I want to do a binary classification with 10K data for a problem like fire detection. How should I know what complexity I should go for?

**Tags:** machine-learning, deep-learning, classification, training, deep-neural-networks

> **Comments:**
> **username_1**: In general, this is may not be an easy question to answer. The branch of artificial intelligence that studies these issues is called _computational_ (and _statistical) learning theory_. See also https://cs.stackexchange.com/q/75327/20691. I will eventually try to answer this question, but I don't know when.  
> **username_0**: Thanks. Yeah try to write something so i can give u some credit.  
> **username_2**: A recent question (https://ai.stackexchange.com/questions/39176/why-are-neural-networks-so-data-hungry) seems related to this one.  

---

## 0 answers

