Thank you Thomas, multiplying the bounding boxes by a factor of 0.7 works really well. Although I think I will compute the bounding boxes from the polygons as you suggested, It seems to be a better solution in the long term.
Thanks!