Dairy and breakouts

A lot of people say that dairy is responsible for acne breakouts and claim that once they removed dairy from there diet the breakouts went away for example here: https://www.healthline.com/health/food-nutrition/no-dairy-diet

But is this actually true? I love dairy products of all kind but I am also struggling with acne? What are your experiences? Is it worth a shot?