a problem occur when I train Chinese distilgpt2 model
### When I was training a new model from zero to one, the following questions appeared, please help me answer them, thank you very much!

![image](https://user-images.githubusercontent.com/36957508/73609835-53573f00-460c-11ea-87dc-dc68e4829212.png)
![image](https://user-images.githubusercontent.com/36957508/73609850-7124a400-460c-11ea-8abc-bff4117484a1.png)
C:\Users\gaochangkuan\Desktop\transformers-master\examples\distillation>python train.py --student_type gpt2 --student_config training_configs/distilgpt2.json --teacher_type gpt2 --teacher_name distilgpt2 --alpha_ce 5.0 --alpha_mlm 2.0 --alpha_cos 1.0 --alpha_clm 0.0 --mlm --freeze_pos_embs  --data_file data/binarized_text.bert-base-chinese.pickle --token_counts data/token_counts.bert-base-chinese.pickle  --dump_path model   --force
02/02/2020 22:26:54 - INFO - transformers.file_utils - PID: 27864 -  PyTorch version 1.4.0+cpu available.
02/02/2020 22:27:02 - INFO - utils - PID: 27864 -  Experiment will be dumped and logged in model
02/02/2020 22:27:02 - INFO - utils - PID: 27864 -  Param: Namespace(adam_epsilon=1e-06, alpha_ce=5.0, alpha_clm=0.0, alpha_cos=1.0, alpha_mlm=2.0, alpha_mse=0.0, batch_size=5, checkpoint_interval=4000, data_file='data/binarized_text.bert-base-chinese.pickle', dump_path='model', force=True, fp16=False, fp16_opt_level='O1', freeze_pos_embs=True, freeze_token_type_embds=False, gradient_accumulation_steps=50, group_by_size=True, initializer_range=0.02, is_master=True, learning_rate=0.0005, local_rank=0, log_interval=500, master_port=-1, max_grad_norm=5.0, mlm=True, mlm_mask_prop=0.15, mlm_smoothing=0.7, multi_gpu=False, n_epoch=3, n_gpu=0, restrict_ce_to_mask=False, seed=56, student_config='training_configs/distilgpt2.json', student_pretrained_weights=None, student_type='gpt2', teacher_name='distilgpt2', teacher_type='gpt2', temperature=2.0, token_counts='data/token_counts.bert-base-chinese.pickle', warmup_prop=0.05, weight_decay=0.0, word_keep=0.1, word_mask=0.8, word_rand=0.1)
Using cache found in C:\Users\gaochangkuan/.cache\torch\hub\huggingface_pytorch-pretrained-BERT_master
02/02/2020 22:27:12 - INFO - transformers.configuration_utils - PID: 27864 -  loading configuration file https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-chinese-config.json from cache at C:\Users\gaochangkuan\.cache\torch\transformers\8a3b1cfe5da58286e12a0f5d7d182b8d6eca88c08e26c332ee3817548cf7e60a.3767c74c8ed285531d04153fe84a0791672aff52f7249b27df341dbce09b8305
02/02/2020 22:27:12 - INFO - transformers.configuration_utils - PID: 27864 -  Model config BertConfig {
  "architectures": [
    "BertForMaskedLM"
  ],
  "attention_probs_dropout_prob": 0.1,
  "bos_token_id": 0,
  "directionality": "bidi",
  "do_sample": false,
  "eos_token_ids": 0,
  "finetuning_task": null,
  "hidden_act": "gelu",
  "hidden_dropout_prob": 0.1,
  "hidden_size": 768,
  "id2label": {
    "0": "LABEL_0",
    "1": "LABEL_1"
  },
  "initializer_range": 0.02,
  "intermediate_size": 3072,
  "is_decoder": false,
  "label2id": {
    "LABEL_0": 0,
    "LABEL_1": 1
  },
  "layer_norm_eps": 1e-12,
  "length_penalty": 1.0,
  "max_length": 20,
  "max_position_embeddings": 512,
  "model_type": "bert",
  "num_attention_heads": 12,
  "num_beams": 1,
  "num_hidden_layers": 12,
  "num_labels": 2,
  "num_return_sequences": 1,
  "output_attentions": false,
  "output_hidden_states": false,
  "output_past": true,
  "pad_token_id": 0,
  "pooler_fc_size": 768,
  "pooler_num_attention_heads": 12,
  "pooler_num_fc_layers": 3,
  "pooler_size_per_head": 128,
  "pooler_type": "first_token_transform",
  "pruned_heads": {},
  "repetition_penalty": 1.0,
  "temperature": 1.0,
  "top_k": 50,
  "top_p": 1.0,
  "torchscript": false,
  "type_vocab_size": 2,
  "use_bfloat16": false,
  "vocab_size": 21128
}

02/02/2020 22:27:22 - INFO - transformers.tokenization_utils - PID: 27864 -  loading file https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-chinese-vocab.txt from cache at C:\Users\gaochangkuan\.cache\torch\transformers\8a0c070123c1f794c42a29c6904beb7c1b8715741e235bee04aca2c7636fc83f.9b42061518a39ca00b8b52059fd2bede8daa613f8a8671500e518a8c29de8c00
02/02/2020 22:27:22 - INFO - utils - PID: 27864 -  Special tokens {'unk_token': 100, 'sep_token': 102, 'pad_token': 0, 'cls_token': 101, 'mask_token': 103}
02/02/2020 22:27:22 - INFO - utils - PID: 27864 -  Loading data from data/binarized_text.bert-base-chinese.pickle
02/02/2020 22:27:22 - INFO - utils - PID: 27864 -  Loading token counts from data/token_counts.bert-base-chinese.pickle (already pre-computed)
02/02/2020 22:27:22 - INFO - utils - PID: 27864 -  Splitting 124 too long sequences.
02/02/2020 22:27:22 - INFO - utils - PID: 27864 -  Remove 2840 too short (<=11 tokens) sequences.
02/02/2020 22:27:22 - INFO - utils - PID: 27864 -  Remove 0 sequences with a high level of unknown tokens (50%).
02/02/2020 22:27:22 - INFO - utils - PID: 27864 -  30807 sequences
02/02/2020 22:27:22 - INFO - utils - PID: 27864 -  Data loader created.
02/02/2020 22:27:22 - INFO - utils - PID: 27864 -  Loading student config from training_configs/distilgpt2.json
02/02/2020 22:27:22 - INFO - transformers.configuration_utils - PID: 27864 -  loading configuration file training_configs/distilgpt2.json
02/02/2020 22:27:22 - INFO - transformers.configuration_utils - PID: 27864 -  Model config GPT2Config {
  "architectures": null,
  "attn_pdrop": 0.1,
  "bos_token_id": 0,
  "do_sample": false,
  "embd_pdrop": 0.1,
  "eos_token_ids": 0,
  "finetuning_task": null,
  "id2label": {
    "0": "LABEL_0",
    "1": "LABEL_1"
  },
  "initializer_range": 0.02,
  "is_decoder": false,
  "label2id": {
    "LABEL_0": 0,
    "LABEL_1": 1
  },
  "layer_norm_epsilon": 1e-05,
  "length_penalty": 1.0,
  "max_length": 20,
  "model_type": "gpt2",
  "n_ctx": 1024,
  "n_embd": 768,
  "n_head": 12,
  "n_layer": 6,
  "n_positions": 1024,
  "num_beams": 1,
  "num_labels": 2,
  "num_return_sequences": 1,
  "output_attentions": false,
  "output_hidden_states": false,
  "output_past": true,
  "pad_token_id": 0,
  "pruned_heads": {},
  "repetition_penalty": 1.0,
  "resid_pdrop": 0.1,
  "summary_activation": null,
  "summary_first_dropout": 0.1,
  "summary_proj_to_labels": true,
  "summary_type": "cls_index",
  "summary_use_proj": true,
  "temperature": 1.0,
  "top_k": 50,
  "top_p": 1.0,
  "torchscript": false,
  "use_bfloat16": false,
  "vocab_size": 21128
}

02/02/2020 22:27:24 - INFO - utils - PID: 27864 -  Student loaded.
02/02/2020 22:27:24 - INFO - transformers.configuration_utils - PID: 27864 -  loading configuration file E:\GPT2_Text_generation\GPT2-Chinese-master\GPT2Model\config.json
02/02/2020 22:27:24 - INFO - transformers.configuration_utils - PID: 27864 -  Model config GPT2Config {
  "architectures": null,
  "attn_pdrop": 0.1,
  "bos_token_id": 0,
  "do_sample": false,
  "embd_pdrop": 0.1,
  "eos_token_ids": 0,
  "finetuning_task": null,
  "id2label": {
    "0": "LABEL_0"
  },
  "initializer_range": 0.02,
  "is_decoder": false,
  "label2id": {
    "LABEL_0": 0
  },
  "layer_norm_epsilon": 1e-05,
  "length_penalty": 1.0,
  "max_length": 20,
  "model_type": "gpt2",
  "n_ctx": 1024,
  "n_embd": 768,
  "n_head": 12,
  "n_layer": 10,
  "n_positions": 1024,
  "num_beams": 1,
  "num_labels": 1,
  "num_return_sequences": 1,
  "output_attentions": false,
  "output_hidden_states": true,
  "output_past": true,
  "pad_token_id": 0,
  "pruned_heads": {},
  "repetition_penalty": 1.0,
  "resid_pdrop": 0.1,
  "summary_activation": null,
  "summary_first_dropout": 0.1,
  "summary_proj_to_labels": true,
  "summary_type": "cls_index",
  "summary_use_proj": true,
  "temperature": 1.0,
  "top_k": 50,
  "top_p": 1.0,
  "torchscript": false,
  "use_bfloat16": false,
  "vocab_size": 21128
}

02/02/2020 22:27:24 - INFO - transformers.modeling_utils - PID: 27864 -  loading weights file E:\GPT2_Text_generation\GPT2-Chinese-master\GPT2Model\pytorch_model.bin
02/02/2020 22:27:27 - INFO - utils - PID: 27864 -  Teacher loaded from distilgpt2.
21128 21128
768 768
1024 1024
02/02/2020 22:27:27 - INFO - utils - PID: 27864 -  Initializing Distiller
02/02/2020 22:27:27 - INFO - utils - PID: 27864 -  Using [0, 3, 7, 11, 15, 19, 23, 27, 31, 35, 39, 43, 47, 51, 55, 59, 63, 67, 71, 75, 79, 83, 87, 91, 95, 99, 103, 107, 111, 115, 119, 123, 127, 131, 135, 139, 143, 147, 151, 155, 159, 163, 167, 171, 175, 179, 183, 187, 191, 195, 199, 203, 207, 211, 215, 219, 223, 227, 231, 235, 239, 243, 247, 251, 255, 259, 263, 267, 271, 275, 279, 283, 287, 291, 295, 299, 303, 307, 311, 315, 319, 323, 327, 331, 335, 339, 343, 347, 351, 355, 359, 363, 367, 371, 375, 379, 383, 387, 391, 395, 399, 403, 407, 411, 415, 419, 423, 427, 431, 435, 439, 443, 447, 451, 455, 459, 463, 467, 471, 475, 479, 483, 487, 491, 495, 499, 503, 507, 511, inf] as bins for aspect lengths quantization
02/02/2020 22:27:27 - INFO - utils - PID: 27864 -  Count of instances per bin: [1267 1907 1866 1702 1584 1483 1380 1237 1205 1101 1047  974  882  854
  758  672  598  583  593  519  492  453  444  414  371  338  352  305
  290  298  260  250  260  214  210  200  189  190  149  153  121  125
  124  106  116  105   87  100   78  103   73   70   74   78   65   70
   52   43   46   51   48   38   49   28   32   41   34   27   29   31
   28   39   28   23   25   26   17   25   23   12   20   17   17   20
    8   12   15   16    8   11   11   10   13   11    3    9    8    5
    9    5    6    6    6    4   10    4    6    3    3    3    2    4
    3    6    4    3    7    2    6    9    1    2    6    2    3  134]
02/02/2020 22:27:27 - INFO - utils - PID: 27864 -  Using MLM loss for LM step.
02/02/2020 22:27:27 - INFO - utils - PID: 27864 -  --- Initializing model optimizer
02/02/2020 22:27:27 - INFO - utils - PID: 27864 -  ------ Number of trainable parameters (student): 58755072
02/02/2020 22:27:27 - INFO - utils - PID: 27864 -  ------ Number of parameters (student): 59541504
02/02/2020 22:27:27 - INFO - utils - PID: 27864 -  --- Initializing Tensorboard
02/02/2020 22:27:27 - INFO - utils - PID: 27864 -  Starting training
02/02/2020 22:27:27 - INFO - utils - PID: 27864 -  --- Starting epoch 0/2
-Iter:   0%|                                                                                                                                            | 0/6162 [00:00<?, ?it/s]Traceback (most recent call last):
  File "train.py", line 329, in <module>
    main()
  File "train.py", line 324, in main
    distiller.train()
  File "C:\Users\gaochangkuan\Desktop\transformers-master\examples\distillation\distiller.py", line 355, in train
    self.step(input_ids=token_ids, attention_mask=attn_mask, lm_labels=lm_labels)
  File "C:\Users\gaochangkuan\Desktop\transformers-master\examples\distillation\distiller.py", line 385, in step
    input_ids=input_ids, attention_mask=attention_mask
**ValueError: too many values to unpack (expected 2)**
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
