Adding new language.

#6
by cyt28 - opened

I am currently working on a project utilizing the CodeBERT model. I would like to expand its capabilities by adding a new language.

Therefore, I would like to know if there are any methods available to expand the model. I've tried fine tuning the model with new dataset, it shows the warning "Some weights of RobertaModel were not initialized from the model checkpoint...... ".

Any guidance or resources would be greatly appreciated.

Hey, what's up, @cyt28 ?! Did you succeed with your task? I'm thinking to do the same and looking for reference :)
Thank you!

Sign up or log in to comment