MeZo Forward Pass Implementation
### Feature request

https://github.com/princeton-nlp/MeZO/blob/main/large_models/trainer.py

### Motivation

Faster training

### Your contribution

Just a user atm.
cc @sgugger and @pacman100 who know more about `Trainer` and integrations <|||||>Should this be integrated with PEFT instead? https://github.com/huggingface/peft<|||||>Anw the motivation is not faster training; in fact it ought to be slower as far as I understand. Rather, it is lower memory requirement.<|||||>You are correct.  I misread/transcribed that.  I read x12 memory saved as
x12 more context available which leads to faster inference.

On Sun, Jun 18, 2023 at 4:44 AM jon-chuang ***@***.***> wrote:

> Anw the motivation is not faster training; in fact it ought to be slower
> as far as I understand. Rather, it is lower memory requirement.
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/huggingface/transformers/issues/24264#issuecomment-1596114214>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/ABHKKOSM7S3TL3DWEYH67UTXL3S3JANCNFSM6AAAAAAZFUOVYQ>
> .
> You are receiving this because you authored the thread.Message ID:
> ***@***.***>
>
<|||||>Created an issue in peft.  Wasn't aware hf managed both.