If one of your relatives got lost, click on any character that’s still around and select the "Gather up" option. The whole family will surround the character you have clicked on.