I consider that part of the GM's rights to run a fun and enjoyable game that fits everything together. There is always a risk that any or all of us may go beyond a point where something needs to happen and things have to change as a result. I don't have any problem with it.