He warned that Israel would try to use the Gaza pullout to justify retaining control over large parts of the West Bank , and said President Bush '' listened to us and said that any change to the borders must be done as a result of an agreement between the two sides . ''