Classical or secondary conditioned reflex - also known as a fetish.
Probably during pubescence or teenage years buns became linked to an intensely pleasurable experience - such as the mild high of energy felt after eating refined carbs and sugars.
Nothing wrong with it - unless it's so extreme that it ruins the appetite for a healthy diet - which I somehow doubt it would for you.