Beren Millidge

BerenMillidge's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

authored 5 papers 11 months ago

BlackMamba: Mixture of Experts for State-Space Models

Paper • 2402.01771 • Published Feb 1, 2024 • 26

A Theoretical Framework for Inference Learning

Paper • 2206.00164 • Published Jun 1, 2022

A Stable, Fast, and Fully Automatic Learning Algorithm for Predictive Coding Networks

Paper • 2212.00720 • Published Nov 16, 2022

Zyda: A 1.3T Dataset for Open Language Modeling

Paper • 2406.01981 • Published Jun 4, 2024 • 4

Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters

Paper • 2408.04093 • Published Aug 7, 2024 • 4

authored a paper about 1 year ago

Zamba: A Compact 7B SSM Hybrid Model

Paper • 2405.16712 • Published May 26, 2024 • 25