content.raw: I gave rectified flow a try, so here is nanoRF - a lightweight implementation of a Rectified Flow Transformer model, ~ 618k parameters, 6 layers deep, dim 64, patch size 4, learning rate 5e-4 trained on my 8bg ram m2 macbookair for 2k epochs. 
content.type: text
content.value: I gave rectified flow a try, so here is nanoRF - a lightweight implementation of a Rectified Flow Transformer model, ~ 618k parameters, 6 layers deep, dim 64, patch size 4, learning rate 5e-4 trained on my 8bg ram m2 macbookair for 2k epochs. 
content.type: new_line
content.raw: Code: 
content.type: text
content.value: Code: 
content.href: https://github.com/Jaykef/ai-algorithms/blob/main/nanoRF.ipynb
content.raw: https://github.com/Jaykef/ai-algorithms/blob/main/nanoRF.ipynb
content.type: link
content.type: new_line
content.raw: See demo: 
content.type: text
content.value: See demo: 
content.href: https://x.com/Jaykef_/status/1923718725578129838
content.raw: https://x.com/Jaykef_/status/1923718725578129838
content.type: link
content.type: new_line
content.raw: Reference Paper: 
content.type: text
content.value: Reference Paper: 
content.href: https://arxiv.org/abs/2403.03206
content.raw: https://arxiv.org/abs/2403.03206
content.type: link
content.raw: .
content.type: text
content.value: .
rawContent: I gave rectified flow a try, so here is nanoRF - a lightweight implementation of a Rectified Flow Transformer model, ~ 618k parameters, 6 layers deep, dim 64, patch size 4, learning rate 5e-4 trained on my 8bg ram m2 macbookair for 2k epochs. 
  Code: https://github.com/Jaykef/ai-algorithms/blob/main/nanoRF.ipynb
  See demo: https://x.com/Jaykef_/status/1923718725578129838
  Reference Paper: https://arxiv.org/abs/2403.03206.
reactions.reaction: 👍
reactions.users: John6666 g-ronimo victor