the cottage , as it was affectionately called by the grant family , consisted of a large sprawling , spanish-style estate that seemed to grow in charm as it agedand it was where wesley spent his time on weekends when he wasnt in his flat downtown .