I think you can start to take a look at something similar like driver distraction/fatigue datasets/papers as I think you will find more material in the literature on that domain.
In your case, one of the solution you can try to explore, is to unify an adversarial detection network 2 with a distracting/fatigue detector or a action recognition like e.g. MoVinets 1.
Probably if you can combine to train a single network on these two tasks it will be better but I think that you need to collect your own dataset.