Added AnyPrecisionAdamW as an optimizer
Added AnyPrecisionAdamW as an optimizer
- Related Issue 
#18827

@stas00 






_The documentation is not available anymore as the PR was closed or merged._<|||||>Thank you for trying, @Zeesky-code - but that won't do anything ;)

I guess my instructions weren't very instructive I've just pointed to a few places where one would start looking at mimicking the integration of other optimizers, my apologies if it wasn't obvious.

So in this case it'd follow the path of `adamw_torch` , as it's the nearest similar optimizer.

and as I said the key to the PR is tests and documentation. Again checking the existing tests and working from there is what's needed.

If it's too much and you're no longer interested please don't hesitate to comment in the feature request issue that it's open for grabs again. If you want to continue, that is great too - please don't hesitate to ask questions if any.

p.s. it might help to look at the previous PRs that added new optimizers, e.g. find the PR that added `adamw_bnb_8bit` - that could be a good model to copy from. And you can see the scope of work that needs to be done.
<|||||>

Ohh, I've taken a look at the PR that added adamw_bnb_8bit and I'm afraid I don't think I'll be able to work on this. 
I'll close this PR and let others know the issue is still available to work on.

Thank you😅

> Thank you for trying, @Zeesky-code - but that won't do anything ;)
> 
> I guess my instructions weren't very instructive I've just pointed to a few places where one would start looking at mimicking the integration of other optimizers, my apologies if it wasn't obvious.
> 
> So in this case it'd follow the path of `adamw_torch` , as it's the nearest similar optimizer.
> 
> and as I said the key to the PR is tests and documentation. Again checking the existing tests and working from there is what's needed.
> 
> If it's too much and you're no longer interested please don't hesitate to comment in the feature request issue that it's open for grabs again. If you want to continue, that is great too - please don't hesitate to ask questions if any.
> 
> p.s. it might help to look at the previous PRs that added new optimizers, e.g. find the PR that added `adamw_bnb_8bit` - that could be a good model to copy from. And you can see the scope of work that needs to be done.

<|||||>Thank you for an honest evaluation, @Zeesky-code - and much appreciated for trying!