BOP Challenge 2024 on Model-Based and Model-Free 6D Object Pose
  Estimation
We present the evaluation methodology, datasets and results of the BOP
Challenge 2024, the sixth in a series of public competitions organized to
capture the state of the art in 6D object pose estimation and related tasks. In
2024, our goal was to transition BOP from lab-like setups to real-world
scenarios. First, we introduced new model-free tasks, where no 3D object models
are available and methods need to onboard objects just from provided reference
videos. Second, we defined a new, more practical 6D object detection task where
identities of objects visible in a test image are not provided as input. Third,
we introduced new BOP-H3 datasets recorded with high-resolution sensors and
AR/VR headsets, closely resembling real-world scenarios. BOP-H3 include 3D
models and onboarding videos to support both model-based and model-free tasks.
Participants competed on seven challenge tracks, each defined by a task, object
onboarding setup, and dataset group. Notably, the best 2024 method for
model-based 6D localization of unseen objects (FreeZeV2.1) achieves 22% higher
accuracy on BOP-Classic-Core than the best 2023 method (GenFlow), and is only
4% behind the best 2023 method for seen objects (GPose2023) although being
significantly slower (24.9 vs 2.7s per image). A more practical 2024 method for
this task is Co-op which takes only 0.8s per image and is 25X faster and 13%
more accurate than GenFlow. Methods have a similar ranking on 6D detection as
on 6D localization but higher run time. On model-based 2D detection of unseen
objects, the best 2024 method (MUSE) achieves 21% relative improvement compared
to the best 2023 method (CNOS). However, the 2D detection accuracy for unseen
objects is still noticealy (-53%) behind the accuracy for seen objects
(GDet2023). The online evaluation system stays open and is available at
http://bop.felk.cvut.cz/
67f4b54ddf6757586b52a4eb
Van Nguyen Nguyen
admin_assigned
2025-04-08T10:39:20.915Z
637fb712084fca81acde6e40
/avatars/e328c22a0cab6ff4dbcd86f265d4fb6c.svg
Van Nguyen NGUYEN
user
nv-nguyen
67f4b54ddf6757586b52a4ec
Stephen Tyree
admin_assigned
2025-04-08T10:39:27.341Z
66d9c590947b2e8abcd21368
https://cdn-avatars.huggingface.co/v1/production/uploads/66d9c590947b2e8abcd21368/Kmcrrl7Kbv9Q1_ZsIy5d9.jpeg
Stephen Tyree
user
swtyree
67f4b54ddf6757586b52a4ed
Andrew Guo
67f4b54ddf6757586b52a4ee
Mederic Fourmy
admin_assigned
2025-04-08T10:39:37.711Z
6709036b69a07aa53e338ae4
/avatars/f72ec1c060a00d30c297df4ab5e370ce.svg
Mederic Fourmy
user
mfourmy
67f4b54ddf6757586b52a4ef
Anas Gouda
admin_assigned
2025-04-08T10:39:43.578Z
6698fc06d77a8b28703aaa67
https://cdn-avatars.huggingface.co/v1/production/uploads/6698fc06d77a8b28703aaa67/6G7-7iDXXRxYGMteVgK3y.jpeg
Anas Gouda
user
anas-gouda
67f4b54ddf6757586b52a4f0
Taeyeop Lee
admin_assigned
2025-04-08T10:39:49.136Z
648283e7eb4befee37855c93
/avatars/9e83accbd2410b0bcb5332df2b7f3ced.svg
Taeyeop Lee
user
taeyeop
67f4b54ddf6757586b52a4f1
Sungphill Moon
claimed_verified
2025-04-17T11:10:37.564Z
662308406bab5536e28b3b51
/avatars/0bfe375cc7326f9426cfe994197e80b9.svg
sungphill.moon
user
sp9103
67f4b54ddf6757586b52a4f2
Hyeontae Son
admin_assigned
2025-04-08T10:40:00.645Z
6658572728d5ff8cba3029ff
/avatars/fd8ab0d18c74c59e6e4b706a1e75c955.svg
Hyeontae Son
user
countywest
67f4b54ddf6757586b52a4f3
Lukas Ranftl
67f4b54ddf6757586b52a4f4
Jonathan Tremblay
67f4b54ddf6757586b52a4f5
Eric Brachmann
67f4b54ddf6757586b52a4f6
Bertram Drost
67f4b54ddf6757586b52a4f7
Vincent Lepetit
admin_assigned
2025-04-08T10:40:35.068Z
6353c6045eac2d2efa74a06f
/avatars/b2102600513a08b3f96df4af53dcee98.svg
Vincent Lepetit
user
miettle
67f4b54ddf6757586b52a4f8
Carsten Rother
67f4b54ddf6757586b52a4f9
Stan Birchfield
67f4b54ddf6757586b52a4fa
Jiri Matas
admin_assigned
2025-04-08T10:41:24.478Z
675186797745384ce3554ce0
/avatars/47551db3e37fb0cf9146fa31e608b3ce.svg
Jiri Matas
user
jmatas
67f4b54ddf6757586b52a4fb
Yann Labbe
67f4b54ddf6757586b52a4fc
Martin Sundermeyer
admin_assigned
2025-04-08T10:41:04.956Z
65eb127dff31dbd74e3b02de
/avatars/a11df84718ee4986cb4611d06831825d.svg
Martin Sundermeyer
user
ma-sundermeyer
67f4b54ddf6757586b52a4fd
Tomas Hodan
admin_assigned
2025-04-08T10:40:57.037Z
65eb008f7c2ed9a1c9fb0f56
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/9jMi17PxANZUEe80zbRVp.jpeg
Tomas Hodan
user
tomhodan
BOP Challenge 2024 on Model-Based and Model-Free 6D Object Pose
  Estimation
We present the evaluation methodology, datasets and results of the BOP
Challenge 2024, the sixth in a series of public competitions organized to
capture the state of the art in 6D object pose estimation and related tasks. In
2024, our goal was to transition BOP from lab-like setups to real-world
scenarios. First, we introduced new model-free tasks, where no 3D object models
are available and methods need to onboard objects just from provided reference
videos. Second, we defined a new, more practical 6D object detection task where
identities of objects visible in a test image are not provided as input. Third,
we introduced new BOP-H3 datasets recorded with high-resolution sensors and
AR/VR headsets, closely resembling real-world scenarios. BOP-H3 include 3D
models and onboarding videos to support both model-based and model-free tasks.
Participants competed on seven challenge tracks, each defined by a task, object
onboarding setup, and dataset group. Notably, the best 2024 method for
model-based 6D localization of unseen objects (FreeZeV2.1) achieves 22% higher
accuracy on BOP-Classic-Core than the best 2023 method (GenFlow), and is only
4% behind the best 2023 method for seen objects (GPose2023) although being
significantly slower (24.9 vs 2.7s per image). A more practical 2024 method for
this task is Co-op which takes only 0.8s per image and is 25X faster and 13%
more accurate than GenFlow. Methods have a similar ranking on 6D detection as
on 6D localization but higher run time. On model-based 2D detection of unseen
objects, the best 2024 method (MUSE) achieves 21% relative improvement compared
to the best 2023 method (CNOS). However, the 2D detection accuracy for unseen
objects is still noticealy (-53%) behind the accuracy for seen objects
(GDet2023). The online evaluation system stays open and is available at
http://bop.felk.cvut.cz/
The BOP Challenge 2024 evaluates 6D object pose estimation and detection in real-world scenarios, introducing model-free tasks and high-resolution datasets, with improved methods for unseen object localization and detection.
6D object pose estimation 6D object detection BOP Challenge model-free tasks high-resolution sensors AR/VR headsets BOP-H3 datasets FreeZeV2.1 GenFlow GPose2023 Co-op MUSE CNOS GDet2023