Baby acne is small, inflamed bumps on a baby's face, neck, back or chest. It often develops within 2 to 4 weeks of birth.  Many babies also develop tiny, pimple-like bumps on the face. These harmless spots, called milia, disappear on their own within a few weeks.