“I've never really addressed those rumors because I figured, 'Why defend yourself against something that is not offensive'?”