In the spirit of "Better late than never", I've finally written a brief overview paper for GEITje 7B Ultra. Initially released 10 months ago (oops), but still reaching around 1300 monthly downloads across the HF ecosystem (not including ollama). 
text
In the spirit of "Better late than never", I've finally written a brief overview paper for GEITje 7B Ultra. Initially released 10 months ago (oops), but still reaching around 1300 monthly downloads across the HF ecosystem (not including ollama). 
new_line
new_line
GEITje 7B Ultra: A Conversational Model for Dutch (2412.04092)
https://huggingface.co/papers/2412.04092
2412.04092
paper
resource
https://huggingface.co/papers/2412.04092
new_line
new_line
While the paper discusses the model a little bit, I especially wanted to write about the datasets, which to this day seem an important asset for Dutch LLM training (SFT and preference tuning). We have a long way to go for Dutch, but publishing transparent and reproducible artefacts seems an important step to me, alongside having open discussions about data, bias, architectures.
text
While the paper discusses the model a little bit, I especially wanted to write about the datasets, which to this day seem an important asset for Dutch LLM training (SFT and preference tuning). We have a long way to go for Dutch, but publishing transparent and reproducible artefacts seems an important step to me, alongside having open discussions about data, bias, architectures.
new_line
new_line
In that spirit, thanks are in order for the creation of GEITje 7B Ultra and all related datasets:
text
In that spirit, thanks are in order for the creation of GEITje 7B Ultra and all related datasets:
new_line
new_line
- Michiel Buisman and UWV for providing the means to create the datasets
text
- Michiel Buisman and UWV for providing the means to create the datasets
new_line
- Flemish Supercomputer Center (VSC) for the compute
text
- Flemish Supercomputer Center (VSC) for the compute
new_line
- The Hugging Face Fellows and rest of the team for their discussions and insights
text
- The Hugging Face Fellows and rest of the team for their discussions and insights
new_line
- The Dutch NLP community, notably 
text
- The Dutch NLP community, notably 
@Rijgersberg
mention
Rijgersberg
  for building the base GEITje model and the fruitful discussions we've had
text
  for building the base GEITje model and the fruitful discussions we've had
new_line
new_line
More to come, step by step!
text
More to come, step by step!
new_line
new_line
https://huggingface.co/collections/BramVanroy/geitje-7b-ultra-65c1ee010ad80fd1f6a8f208
BramVanroy/geitje-7b-ultra-65c1ee010ad80fd1f6a8f208
collection
resource
https://huggingface.co/collections/BramVanroy/geitje-7b-ultra-65c1ee010ad80fd1f6a8f208
In the spirit of "Better late than never", I've finally written a brief overview paper for GEITje 7B Ultra. Initially released 10 months ago (oops), but still reaching around 1300 monthly downloads across the HF ecosystem (not including ollama). 

https://huggingface.co/papers/2412.04092

While the paper discusses the model a little bit, I especially wanted to write about the datasets, which to this day seem an important asset for Dutch LLM training (SFT and preference tuning). We have a long way to go for Dutch, but publishing transparent and reproducible artefacts seems an important step to me, alongside having open discussions about data, bias, architectures.

In that spirit, thanks are in order for the creation of GEITje 7B Ultra and all related datasets:

- Michiel Buisman and UWV for providing the means to create the datasets
- Flemish Supercomputer Center (VSC) for the compute
- The Hugging Face Fellows and rest of the team for their discussions and insights
- The Dutch NLP community, notably @Rijgersberg  for building the base GEITje model and the fruitful discussions we've had

More to come, step by step!

https://huggingface.co/collections/BramVanroy/geitje-7b-ultra-65c1ee010ad80fd1f6a8f208
👀
John6666