run_tf_glue with AdamW optimizer and distributed training
# ❓ Questions & Help
Can you please update the run_tf_glue example (Tensorflow version) that includes the Adam optimizer with Warm-up and weight decay.  If you can also show how to run the code on multiple GPUs and on TPU. 

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
