Have a look at the Detection tutorial 10, where the target is explained for this kind of task.
In the Defining a Dataset 3 section you can see that multiple boxes are provided for each image. While this tutorial uses another dataset, you might need to adapt this work flow to your dataset.