The statement feels "crazy" because the concept of "home" is complex and deeply personal. It is more than just a physical address; it is a feeling of belonging, safety, and identity. While you can revisit the physical location, the saying suggests you cannot fully recapture that original feeling because you—and everything around you—have changed.
You can never go home!