Hi,
I try to rebuild the TFBertForSequenceClassification model from the plain TFBertModel.
TFBertForSequenceClassification uses a dropout and a dense layer on top of the main BERT model. The number of neurons is config.num_labels.
I wonder, where is this values because it seems it has no default value.
And finetuning TFBertForSequenceClassification like here:

  
      
      huggingface.co
  
  
    

Training and fine-tuning — transformers 3.3.0 documentation 10



  
  
    
    
  
  


does not handle a value for num_labels.
So where does the 2 neurons come from in the last layer (by default)?
Look here:

  
      
      huggingface.co
  
  
    

transformers.modeling_tf_bert — transformers 3.3.0 documentation 1



  
  
    
    
  
  


there is
self.num_labels = config.num_labels
but config.num_labels has no default value?
See