Speaking of technicalities, technically, you need to get approval from Planning in order to build a house on an R7 lot that is smaller than 7,000sf; if they don't approve, you're SOL. With haughty neighbors, good luck with that.