Romney: "Attacking me is not an agenda"