What do you mean by “in parallel”?
As a side note, CNTK might not get any new releases anymore (based on this GitHub 1 comment):

Today’s 2.7 release will be the last main release of CNTK. We may have some subsequent minor releases for bug fixes, but these will be evaluated on a case-by-case basis. There are no plans for new feature development post this release.