Honestly at the end of the day, do what you feel is necessary or beneficial for you and your family. Move into a smaller home that comfortable for the 3 of you and for your daughter to be able to grow up in no need to be fancy as long life is beautiful and you have a place to live. Peoples circumstances change through out the year, nothing is guaranteed for us in the unforeseeable future.