If the Electoral College were eliminated and the winner were whomever got the most votes who would win besides "we the people"?

The large more populace states would control everything.  There is a reason we have EC and it is to force the candidate to appeal to the entire country...not just CA, NY, and TX.  
Clinton's entire popular vote victory came from one state....CA. 

 The reason that the Constitution calls for this extra layer of protection, rather than just providing for the direct election of the president, is that most of the nation’s founders were actually rather afraid of democracy. James Madison worried about what he called “factions,” which he defined as groups of citizens who have a common interest in some proposal that would either violate the rights of other citizens or would harm the nation as a whole.