BOP Challenge 2019/2020 – core datasets

This leaderbord shows the overall ranking on the core datasets (LM-O, T-LESS, TUD-L, IC-BIN, ITODD, HB, YCB-V). For each method, the date of the latest considered submission is reported. If more submissions of a method are available for a dataset, the submission with the highest AR score is considered. The performance scores are defined in the challenge description. The reported time is the average image processing time averaged over the core datasets.

Date (UTC) Method Test image ARCore ARLM-O ART-LESS ARTUD-L ARIC-BIN ARITODD ARHB ARYCB-V Time (s)
2019-08-20 09:54 Drost-CVPR10-3D-Only D 0.487 0.527 0.444 0.775 0.388 0.316 0.615 0.344 7.704
2019-10-13 11:22 DPOD (synthetic) RGB 0.161 0.169 0.081 0.242 0.130 0.000 0.286 0.222 0.231
2019-08-21 06:09 Drost-CVPR10-3D-Edges D 0.500 0.469 0.404 0.852 0.373 0.462 0.623 0.316 80.055
2019-08-22 06:12 Drost-CVPR10-Edges RGB-D 0.550 0.515 0.500 0.851 0.368 0.570 0.671 0.375 87.568
2019-10-14 21:44 Pix2Pose-BOP-ICCV19 RGB 0.205 0.077 0.275 0.349 0.215 0.032 0.200 0.290 0.793
2019-10-14 22:29 Pix2Pose-Original-ICCV19 RGB 0.295 1.522
2019-10-16 18:17 gao-cloudpose19 D 0.208 0.588
2019-10-22 06:48 Sundermeyer-IJCV19 RGB 0.270 0.146 0.304 0.401 0.217 0.101 0.346 0.377 0.186
2019-10-22 10:16 Sundermeyer-IJCV19+ICP RGB-D 0.398 0.237 0.487 0.614 0.281 0.158 0.506 0.505 0.865
2019-10-22 05:31 Félix&Neves-ICRA2017-IET2019 RGB-D 0.412 0.394 0.212 0.851 0.323 0.069 0.529 0.510 55.780
2019-10-17 07:05 Drost-CVPR10-3D-Only-Faster D 0.454 0.492 0.405 0.696 0.377 0.274 0.603 0.330 1.383
2019-10-17 09:33 gao-cloudpose19plus D 0.510
2019-10-18 20:38 Pix2Pose-BOP_w/ICP-ICCV19 RGB-D 0.376 0.675 2.222
2019-10-22 07:57 Vidal-Sensors18 D 0.569 0.582 0.538 0.876 0.393 0.435 0.706 0.450 3.220
2019-10-22 04:59 Zhigang-CDPN-ICCV19 RGB 0.353 0.374 0.124 0.757 0.257 0.070 0.470 0.422 0.513
2019-11-28 09:02 Pix2Pose-Resnet-ICCV19 RGB 0.434 1.034
2019-11-28 09:03 Pix2Pose-Resnet w/ICP-ICCV19 RGB-D 0.750 2.894
2020-03-29 18:30 EPOS-CVPR20 RGB 0.443 0.476 0.696 0.745
2020-06-12 11:56 Pix2Pose-BOP19-PBR RGB 0.281 1.157
Latest submissions to this leaderboard: