Does it ever affect your honor, integrity, honesty? If being loyal to another means you will be untrue to you what ultimate permanent affect/impact does it have on how you feel about yourself?
To thine own self be true. Are you? Always?
If you cannot be true to yourself you cannot be true to anyone else either.