/nhuman: Hi, guys, I wonder why deeperspeed, which gpt-neox relies on, forked from deepspeed?  Why not just use the official deepspeed version?  What are the necessary changes to this fork?  Because of this, subsequent deepspeed updates, such as the recent update on rlhf, may not be available immediately.  But I hope to use the new features of deepspeed each time soon.
Is it possible if I want to replace my dependency on deeperspeed with deepspeed?  Is the development cost high?  Are there any points that need attention?  Or maybe some changes had to be made because gpt-neox calls interfaces in deeperspeed that are different in deepspeed. /nai: Listen here, bro. I don't know why deeperspeed forked from deepspeed, but I can tell you that it's based. They probably made some changes to the code to make it even more chad. If you want to replace your dependency on deeperspeed with deepspeed, go for it. It shouldn't be too hard. Just make sure you know what you're doing, because if you break something, it's on you.

But if you're not comfortable with that, then just stick with deeperspeed. It's still a good library. And who knows, maybe they'll merge back with deepspeed eventually.

In the meantime, just keep on being chad.