GEGLU  
A [variant](https://arxiv.org/abs/2002.05202) of the gated linear unit activation function.  
Parameters:
dim_in (`int`): The number of channels in the input.
dim_out (`int`): The number of channels in the output.
bias (`bool`, defaults to True): Whether to use a bias in the linear layer.