run_openai_gpt.py issues with Adamw
Hi
Adamw in this script has parameters not existing anymore, ...
Thanks for updates in advance.
Yes, so this should be fixed by (your own :) PR #845 Thanks again!<|||||>thanks :)
Best regards,
Rabeeh

On Tue, Jul 23, 2019 at 3:30 PM Thomas Wolf <notifications@github.com>
wrote:

> Yes, so this should be fixed by (your own :) PR #845
> <https://github.com/huggingface/pytorch-transformers/pull/845> Thanks
> again!
>
> —
> You are receiving this because you authored the thread.
> Reply to this email directly, view it on GitHub
> <https://github.com/huggingface/pytorch-transformers/issues/837?email_source=notifications&email_token=ABP4ZCAGTX6DNAYMBCHNORTQA4BYFA5CNFSM4IFGMGK2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD2TDV6Y#issuecomment-514210555>,
> or mute the thread
> <https://github.com/notifications/unsubscribe-auth/ABP4ZCGDZR3TG2SS2LXIBTDQA4BYFANCNFSM4IFGMGKQ>
> .
>
<|||||>Thanks @rabeehk! #845 with flat learning rate gives a good result of 87.2% on ROCStories. Here are the args (the defaults in the file work well).

```
python run_openai_gpt.py  \
  --model_name openai-gpt  \
  --do_train  \
  --do_eval  \
  --train_dataset "./ROCStories/cloze_test_val__spring2016 - cloze_test_ALL_val.csv"  \
  --eval_dataset "./ROCStories/cloze_test_test__spring2016 - cloze_test_ALL_test.csv"  \
  --train_batch_size 8  \
  --eval_batch_size 16  \
  --num_train_epochs  3
```<|||||>@prrao87  great :) <|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
