With all the headlines and talk about housing affordability, it can be tempting to get lost in the financial side of buying a home.