The PM's ethics adviser has quit a day after saying there was a "legitimate question" about whether Boris Johnson broke ministerial rules over Partygate.