sometimes both of them would be drunk when he got there and that made things difficult , especially when his grandmother turned spiteful and dropped her hints that things would be better if he had never been born .