I would assume it would be helpful.
If you just pass class0 and class1, your model will basically always output the same class, no?
The difference between these classes is just the “difficulty” to recognize the object.
Let me know, if I’m misunderstanding the use case.