That actually not Seris mum, she's just the daughter of the dad. The mom just had the two sons. So maybe the dad had an affair and had Seri. That's why she was threated so differently. Also I think Ri and Seri would be able too see each other often, when there is no one of Ris family is left. So he could left north korea without letting them in danger.