Hard not to control my breathing For the record I'm new to meditation.
I'm trying to observe my breathing without controlling it. That was the guidance from someone I met at a buddhist meeting. 
Though sometimes I just ralize that I do change the frequency and deepness of it. I don't want to do it, just happens.
Is it just me or it will be better with practice?
Don't try to force or control anything, observe and just note it and continue.

It's not that much important how your body reacts to your meditation, but how you deal with these bodily reactions. Yes, there will always be some bodily reactions that will distract you from meditation, but the point is to not get distracted and just remain in the "present moment".

With practice you will be less distracted, until you won't be distracted any more. Practice diligently and you shell rip the rewards soon.