Hugging Face's logo
Lukas Galke's picture
4 18

Lukas Galke

lgalke
ยท
https://lgalke.github.io

AI & ML interests

Representation learning; pre-training; quantization; continual learning; probing; multilingual pre-training; knowledge tracing/discovering/inducing

Recent Activity

authored a paper 24 days ago
Continual Quantization-Aware Pre-Training: When to transition from 16-bit to 1.58-bit pre-training for BitNet language models?
authored a paper 24 days ago
What makes a language easy to deep-learn? Deep neural networks and humans similarly benefit from compositional structure
authored a paper 24 days ago
Dynaword: From One-shot to Continuously Developed Datasets
View all activity

Organizations

Danish Foundation Models's profile picture MLX Community's profile picture