It's probably a sensitivity and definitely the less processed the more it'll affect you. Sometimes I don't notice too much of a result from eating cheese/yogurt because of the way it's processed. The fermentation process uses the milk sugar up mostly but traces remain