Submission: Megapose-GDRNPPDet_PBRReal+MultiHyp_Teaserpp/ITODD

Download submission
Submission name
Submission time (UTC) Sept. 22, 2023, 4:06 p.m.
User agimus-happypose
Task Model-based 6D localization of seen objects
Dataset ITODD
Description Submission prepared by Elliot Maître, Médéric Fourmy, Yann Labbé
Evaluation scores
AR:0.553
AR_MSPD:0.573
AR_MSSD:0.579
AR_VSD:0.506
average_time_per_image:139.049

Method: Megapose-GDRNPPDet_PBRReal+MultiHyp_Teaserpp

User agimus-happypose
Publication Labbé et al.: MegaPose: 6D Pose Estimation of Novel Objects via Render & Compare, CoRL 2022
Implementation https://github.com/agimus-project/happypose
Training image modalities RGB
Test image modalities RGB-D
Description

This submission was prepared by Elliot Maître, Mederic Fourmy, Lucas Manuelli, Yann Labbé

In this submission, GDRNPPDet_PBRReal, [A] detections (default detections for Task 1) are used as input to the MegaPose pose estimation method [B], without fine tuning on the core BOP challenge datasets.

For each detection, we run the MegaPose coarse network with 5 hypotheses. Each of the top-5 hypotheses are refined using the refinement strategy described below. The refined hypotheses are then scored using the coarse network, and the best one is considered the pose estimate for the initial detection.

The refinement strategy is as follows for one hypothesis. We first run 5 iteration of the RGB refinement network. We then render a depth map of the hypothesis and establish 3D-3D correspondences between points of the objects in the rendered depth and in the depth map using pixel-wise alignment. Finally, we run Teaser++ [C] to align the point clouds.

The following improvements have been made over the original MegaPose paper [B]:
- The orientation of the coarse hypotheses are obtained by discretizing SO(3) in 576 values using [C].
- The refinement network is ran on multiple pose hypotheses coming from the coarse network.

[A] Liu et al.: https://github.com/shanice-l/gdrnpp_bop2022
[B] Labbé et al.: MegaPose: 6D Pose Estimation of Novel Objects via Render & Compare, CoRL 2022
[C] Yang et al: TEASER: Fast and Certifiable Point Cloud Registration, Trans. Robotics 2020 [D] Yershova et al.: Generating Uniform Incremental Grids on SO(3) Using the Hopf Fibration, IJRR 2009, reference implementation: http://lavalle.pl/software/so3/so3.html

This work was granted access to the HPC resources of IDRIS under the allocation 011014301 made by GENCI

Computer specifications NVIDIA Tesla V100 32Go