Good to hear you’ve found a bug!
The loss curves now look like usual loss curves. 
Yes, your model is overfitting, as the training loss decreases while the validation loss hits a plateau.
If you continue training, the validation loss will probably even increase again.
You could counter it with adding some regularization or reduce the model capacity (e.g. using dropout, fewer parameters etc.).