You could use your image processing approach to create the target values (e.g. as pixel locations of the start and end coordinates of the wanted lines or alternatively as a mask image) and start building a CNN to predict these targets.
I don’t know which target format and architecture would work the best, so you would have a lot to experiment with.