Submission: Co-op (F3DT2D, Coarse, RGBD)/YCB-V/sel rescoring, Intel(R) Core(TM) i9-14900K, RTX4090

Download submission
Submission name sel rescoring, Intel(R) Core(TM) i9-14900K, RTX4090
Submission time (UTC) Nov. 28, 2024, 5 a.m.
User sp9103
Task Model-based 6D detection of unseen objects
Dataset YCB-V
Description
Evaluation scores
AP:0.808
AP_MSPD:0.776
AP_MSSD:0.841
average_time_per_image:0.619

Method: Co-op (F3DT2D, Coarse, RGBD)

User sp9103
Publication Not yet
Implementation -
Training image modalities RGB-D
Test image modalities RGB-D
Description

Submitted to: BOP Challenge 2024

Training data: MegaPose-GSO and MegaPose-ShapeNetCore

Onboarding data: 42 rendered templates

Used 3D models: Default, CAD

Notes:

Our coarse estimator is based on local feature matching between the query image and multiple pre-rendered templates. We model the query and rendered images as aggregation of multiple patches. The coarse network finds the matchings between patch centers of input crop and rendered templates. From the 42 templates, the best template is selected and pose hypothesis is generated by RANSAC-PnP for RGB and MAGSAC++ [A] for RGB-D case.

We use CroCo [B] pretraining for our coarse estimator. Note that the inputs to our neural networks are the rgb images only. The 2D detector used is specified in parentheses in the title.

[A] Barath et al.: MAGSAC++, a fast, reliable and accurate robust estimator, CVPR 2020
[B] Weinzaepfel et al.: CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flow, ICCV 2023

List of contributors: Sungphill Moon (sungphill.moon@naverlabs.com), Hyeontae Son (son.ht@naverlabs.com)

If you have any questions, feel free to contact us.

Computer specifications