I write this with first hand experience as the first home I ever purchased was a multi family (3 unit) home. In fact the second I purchased, while living in the first, basically rent free, was another 3 unit multi family. In hindsight it was one of the best things I ever did! I no longer was paying rent to a landlord, rather I was collecting rent and gaining home appreciation & equity. I started out living in the smallest apartment of my first. It also gave me a great sense of pride, at a time as a young man that I really needed it, as I set out to improve the value of the home with good old fashion “sweat equity ” a.k.a……………my two God given hands, tools and a basic pick up truck. Yes, you may have to give up living in bougie neighborhood ( I did) staring out. But, I suggest swallowing that pride, helping that neighborhood by improving that house and yourself along the way as the positive gains both financially and mentally far outweigh any negatives.