Yes. Adding a pooling layer and fine tuning sentence transformer for dhivehi.
Yes there is a corpus available. In fact i have been preparing data for this task since last week before I came to know about the event. So i think this will be a wonderful opportunity.