The Cabinet cannot do it without him. He is an essential part and so his reluctance stops it dead in its tracks. The Founding Fathers did not count on a spineless wimp who even after HE IS THROWN UNDER THE BUS by the president WILL NOT do anything to hasten his ouster.
Why that is I do not know. Do you? Remaining loyal to a poisonous snake who bit you? This in smart because?