I've heard something similiar to that. Like you can go into a settlement and help the people out with their troubles and when you return many moons later, it will be a full fledged town. But if you decide to destroy the settlement in it's early stages, when you return to the same spot a few years later, it will still be in ruins.
So yeah...I think that's true...