The French were the masters in Cambodia and Vietnam (North Africa too ?) but the British had to be the worse and left long lasting effects of their "colonization". Every place they went they installed a "class system" and considered the Indigenous or Aboriginal people to less then human. Their influence can be seen in United States, Canada, Australia and how to this day, those people were treated like dogs. Look at what the British did in India ! They even had their fingers in the Falklands and Belize.
The Spanish had to be next in line, look at their actions in the New World, North and South America, the Philippines, Cuba, and assorted islands. 
A side note is that the French still have is a tiny island off the coast of the Canadian Maritimes that is considered French !
As for Midway, other then  guano, what treasures were there to plunder ? There were no Natives there for them to enslave or murder either.