He'll always have his small loyal base of supporters. If everyone else but his family turn on him and revile him and ignore him and defy him how good will he be then? He is not the entire universe of authority alone on his own. He is a nothing unless others acknowledge him. A nothing.