MochiTransformer3DModel  
A Transformer model for video-like data introduced in [Mochi](https://huggingface.co/genmo/mochi-1-preview).  
Args:
patch_size (`int`, defaults to `2`):
The size of the patches to use in the patch embedding layer.
num_attention_heads (`int`, defaults to `24`):
The number of heads to use for multi-head attention.
attention_head_dim (`int`, defaults to `128`):
The number of channels in each head.
num_layers (`int`, defaults to `48`):