Hi Jonas, I am also in the process of tuning multiple loss functions. Your approach seems somehow manual tuning.  I suggest you to find a coarse optimization for alpha. After, I suggest you to start from this article https://towardsdatascience.com/self-paced-multitask-learning-76c26e9532d0 12 and try some automatic tuning method.
Best,
Stefano