The 4 hours per epoch sounds sensible to me.
Roberta has a huge number of parameters to train, almost certainly much more than your CNN with BiLSTM, and it will take a long time.
Have you tried Freezing most of the layers of RoBERTa, so that only the last layer’s parameters are actually being trained.