BOP Challenge 2019/2020 – HomebrewedDB

The performance scores are defined in the challenge description. The reported time is the average estimation time per image.

Date (UTC) Submission Test image AR ARVSD ARMSSD ARMSPD Time (s)
2020-08-18 CosyPose-ECCV20-SYNT+REAL-8VIEWS RGB 0.746 0.691 0.744 0.804 0.427
2020-08-18 CDPNv2_BOP20 (RGB-only) (Zhigang-CDPNv2 (MODE 1, FCOS)) RGB 0.722 0.614 0.708 0.845 0.273
2020-08-19 CDPNv2_BOP20 (PBR-only & RGB-only) (Zhigang-CDPNv2 (MODE 2, FCOS)) RGB 0.722 0.614 0.708 0.845 0.273
2020-08-17 CosyPose-ECCV20-SYNT+REAL-1VIEW-ICP RGB-D 0.712 0.679 0.719 0.737 5.326
2020-08-19 CDPNv2_BOP20 (PBR-only & ICP) (icpv4) RGB-D 0.712 0.629 0.757 0.749 0.713
2020-08-19 CDPNv2_BOP20 (RGB-only & ICP) (icpv4) RGB-D 0.712 0.629 0.757 0.749 0.713
2019-10-22 Vidal-Sensors18 D 0.706 0.707 0.704 0.708 2.608
2020-08-18 CosyPose-ECCV20-SYNT+REAL-4VIEWS RGB 0.696 0.646 0.685 0.756 0.445
2020-08-17 Pix2Pose-BOP20_w/ICP-ICCV19 RGB-D 0.695 0.640 0.721 0.724 3.248
2020-08-17 CDPN_BOP19 (RGB-only) RGB 0.672 0.557 0.642 0.816 0.280
2019-08-12 Drost-CVPR10-Edges RGB-D 0.671 0.677 0.665 0.670 144.029
2020-08-19 leaping from 2D to 6D (hb) RGB 0.658 0.528 0.583 0.863 0.736
2020-08-18 CosyPose-ECCV20-SYNT+REAL-1VIEW RGB 0.656 0.613 0.634 0.721 0.419
2020-08-18 CosyPose-ECCV20-PBR-1VIEW RGB 0.656 0.613 0.634 0.721 0.417
2020-08-19 Koenig-Hybrid-DL-PointPairs RGB-D 0.651 0.660 0.645 0.649 0.274
2019-08-05 Drost-CVPR10-3D-Edges D 0.623 0.618 0.624 0.626 127.372
2020-08-14 DPODv2 (synthetic train data, RGB + D Kabsch) RGB-D 0.619 0.574 0.638 0.644 0.441
2019-07-31 Drost-CVPR10-3D-Only D 0.615 0.593 0.627 0.627 16.136
2019-10-17 Drost-CVPR10-3D-Only-Faster D 0.603 0.585 0.612 0.611 1.659
2020-08-19 EPOS-BOP20-PBR RGB 0.580 0.484 0.527 0.729 0.657
2020-08-19 PointVoteNet2 (HB-PVN2-E6) RGB-D 0.556 0.578 0.545 0.546 -1.000
2019-10-14 Félix&Neves-ICRA2017-IET2019 RGB-D 0.529 0.544 0.520 0.523 58.693
2019-10-22 Sundermeyer-IJCV19+ICP RGB-D 0.506 0.479 0.506 0.533 1.352
2019-10-22 Zhigang-CDPN-ICCV19 (Zhigang-CDPN-ICCV19) RGB 0.470 0.391 0.451 0.569 0.311
2020-08-17 DPODv2 (synthetic train data, RGBD) RGB-D 0.460 0.428 0.475 0.477 0.146
2020-08-14 DPODv2 (synthetic train data, RGB) RGB 0.454 0.371 0.413 0.579 0.288
2020-08-18 Pix2Pose-BOP20-ICCV19 RGB 0.446 0.352 0.394 0.594 0.982
2019-10-22 Sundermeyer-IJCV19 RGB 0.346 0.273 0.306 0.461 0.190
2020-08-11 SingleMultiPathEncoder-CVPR20 (Test) RGB 0.293 0.241 0.250 0.388 0.191
2019-10-10 DPOD (synthetic) RGB 0.286 0.218 0.262 0.379 0.180