With most implementations, this is not possible. The models combine question and context such that both can attend to each other since the first layer.
There may be some implementation that only performs question/context attention as a last operation but I am not aware of it.