Thank you for such a quick response and for the solution indeed!!
It was as simple as that, COCO datset format is: [x, y, w, h]. Where, x, and y are the top left point and not the center point as I thought. I have been working a lot with PASCAL VOC format so somehow I misinterpreted that the COCO format was center point + width and height. My bad.
Than you