Machine Learning, Deep Learning, Artificial Intelligence, AI.
(layer_norm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) (feed_forward): HubertFeedForward( (intermediate_dropout): Dropout(p=0.1, inplace=False) (intermediate_dense): Linear(in_features=768, out_features=3072, bias=True) (intermediate_act_fn): GELUActivation() (output_dense):