Article
Efficient LLM Pretraining: Packed Sequences and Masked Attention
By
•
•
40Rasool Fakoor
rasoolfa
AI & ML interests
Building embodied agents.
Recent Activity
updated
a model
about 18 hours ago
FundamentalResearchLabs/g4-4k-only-multi-yes-rel-yes-neg-dm012345-6861505-9b62a7d-s4741
updated
a model
about 18 hours ago
FundamentalResearchLabs/g4-4k-yes-multi-yes-rel-yes-neg-dm012345-6861505-9b62a7d-s5028
updated
a model
about 18 hours ago
FundamentalResearchLabs/g4-4k-only-multi-yes-rel-yes-neg-dm012345-6861505-9b62a7d-s5172
Organizations
