Hi,
There is no benefit in terms of speed. It is mostly for convenience:

Easy to move many parameters to the right device at once
Easy to hold and work with these parameters
Easy to interface with the optimizer
etc