The only problem is there's really nothing there to replace it with. Memories and meaning are a product of shared bonds, and virtually all relationships past 25 are too superficial to create bonds, so may as well not even exist beyond practical benefits.
The whole past chasing you down thing never happened to me. My friends moved away and nobody really cared to come back. One dude was close enough to remain a Facebook Messenger.