Under Energy East, if Irving oil doesn't buy oil from the pipeline, then Irving shipping makes money exporting it.  The Irving family makes money either way.

There is little to no incentive for the Irvings to build heavy oil refining capacity unless Alberta were to agree to a steep discount on dilbit to pay for it, which is not what Alberta wanted from the pipeline.