Thank you! So, the easiest way is to add a penalty term on my loss function such as:
loss = loss_function(var1) + w*ortho_penalty(var1)
where w > 0  is the penalty weight.
In this case, should not be “better” to use a Lagrangian multiplier to enforce the constraint?