You must do what you feel is right, of course.
Personally, I would have a difficult time faced with the choice you will make and I can't make that choice for you. I had a friend in a similar situation; new house, or TB armour. He made his choice and is totally happy with it. You will find the means to satisfy both choices and this could be at different times. Ask yourself how you can achieve this. You know that you know what the right choice is for you and you have already made it, Brad, you just have to do what you need to do to make peace with it.
HTH!