I build sets directly from the book, but I make about as many things from just loose bricks. 

I find them very different as experiences though, I’ve built enough that following the instructions for even complicated sets doesn’t really require any active thinking.