AI & ML interests

Deep learning for natural language processing and information retrieval at the University of Waterloo.

Recent Activity

castorini's activity

nthakur 
posted an update 3 days ago
view post
Post
1490
Last year, I curated & generated a few multilingual SFT and DPO datasets by translating English SFT/DPO datasets into 9-10 languages using the mistralai/Mistral-7B-Instruct-v0.2 model.

I hope it helps the community for pretraining/instruction tuning multilingual LLMs! I added a small diagram to briefly describe which datasets are added and their sources.

Happy to collaborate in either using these datasets for instruction FT, or wishes to extend translated versions of newer SFT/DPO english datasets!

nthakur/multilingual-sft-and-dpo-datasets-67eaf56fe3feca5a57cf7d74
crystina-z 
authored 12 papers 25 days ago