We can also look at this from the perspective of the force that is trying to move the book downwards, its weight. The work of the weight on a book being lifted is negative. This is because the downward weight is in the opposite direction to the upward displacement.