content.raw: On the  2nd of October a really cool paper was released called "Were RNNs all we need"   
content.type: text
content.value: On the  2nd of October a really cool paper was released called "Were RNNs all we need"   
content.href: https://arxiv.org/abs/2410.01201
content.raw: https://arxiv.org/abs/2410.01201
content.type: link
content.type: new_line
content.type: new_line
content.raw: This paper introduces the MinGRU model, a simplified version of the traditional Gated Recurrent Unit (GRU) designed to enhance efficiency by removing hidden state dependencies from its gates. This allows for parallel training, making it significantly faster than conventional GRUs. Additionally, MinGRU eliminates non-linear activations like tanh, streamlining computations.
content.type: text
content.value: This paper introduces the MinGRU model, a simplified version of the traditional Gated Recurrent Unit (GRU) designed to enhance efficiency by removing hidden state dependencies from its gates. This allows for parallel training, making it significantly faster than conventional GRUs. Additionally, MinGRU eliminates non-linear activations like tanh, streamlining computations.
content.type: new_line
content.type: new_line
content.raw: So I read the paper and I tried training this model  and it seems to be doing quite well , you could check out the pre-trained model on the huggingface spaces 
content.type: text
content.value: So I read the paper and I tried training this model  and it seems to be doing quite well , you could check out the pre-trained model on the huggingface spaces 
content.type: new_line
content.type: new_line
content.raw: -  
content.type: text
content.value: -  
content.raw: https://huggingface.co/spaces/damerajee/mingru-stories
content.id: damerajee/mingru-stories
content.type: space
content.type: resource
content.url: https://huggingface.co/spaces/damerajee/mingru-stories
content.type: text
content.type: new_line
rawContent: On the  2nd of October a really cool paper was released called "Were RNNs all we need"   https://arxiv.org/abs/2410.01201
  
  This paper introduces the MinGRU model, a simplified version of the traditional Gated Recurrent Unit (GRU) designed to enhance efficiency by removing hidden state dependencies from its gates. This allows for parallel training, making it significantly faster than conventional GRUs. Additionally, MinGRU eliminates non-linear activations like tanh, streamlining computations.
  
  So I read the paper and I tried training this model  and it seems to be doing quite well , you could check out the pre-trained model on the huggingface spaces 
  
  -  https://huggingface.co/spaces/damerajee/mingru-stories 
  
reactions.reaction: 👀
reactions.users: John6666
commentators._id: 670a77bdb01ca59d9b6a4d2a
commentators.avatarUrl: /avatars/7c7860afb1bef5657f006cc75609e7d7.svg
commentators.fullname: Elvis Serge
commentators.name: NSAA
commentators.type: user