No "emotion" descriptor on the spell, so no. If you accept the buff now; you won't be able to say you don't accept it in your turn. You'd auto-pass the diplomacy if the charm fails, so feel free to ignore it shy of rolling a 1 and feeling giddy at the idea.