Because gpus are supposed to be multi-core machines. If you check gpu specifications gpus have thousens of cores rather than 4-10 (like a cpu). They can run dozens of process in parallel. That’s why they speed up machine learning, as ML are basically hundreds of independent operations. Each filter in a convolution is totally independent from others.
It’s easier you to google why gpus speed up ML cos it’s a large explanation