This leaderbord shows the ranking for Model-based 2D segmentation of unseen objects on ITODD. The reported time is the average time to generate predictions for all objects in a single image (averaged over the datasets).
Date (UTC) | Submission | Test image | AP | AP50 | AP75 | APS | APM | APL | AR1 | AR10 | AR100 | ARS | ARM | ARL | Time (s) | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2024-11-16 | MUSE (full) | RGB | 0.399 | 0.602 | 0.441 | -1.000 | 0.186 | 0.403 | 0.189 | 0.527 | 0.533 | -1.000 | 0.259 | 0.560 | 0.452 | |
2025-04-25 | NOCTIS | RGB | 0.389 | 0.590 | 0.441 | -1.000 | 0.288 | 0.395 | 0.184 | 0.507 | 0.510 | -1.000 | 0.295 | 0.537 | 0.794 | |
2025-03-07 | anonymity (.) | RGB | 0.376 | 0.582 | 0.416 | -1.000 | 0.286 | 0.377 | 0.181 | 0.513 | 0.520 | -1.000 | 0.319 | 0.546 | 0.442 | |
2025-01-04 | LDSeg | RGB-D | 0.370 | 0.569 | 0.412 | -1.000 | 0.229 | 0.374 | 0.196 | 0.520 | 0.524 | -1.000 | 0.317 | 0.531 | 1.598 | |
2024-11-05 | Prisma-MPG + SG + CW | RGB-D | 0.352 | 0.559 | 0.382 | -1.000 | 0.201 | 0.376 | 0.182 | 0.500 | 0.504 | -1.000 | 0.278 | 0.532 | 0.885 | |
2025-05-10 | Prisma-MPG-Complex | RGB-D | 0.336 | 0.546 | 0.355 | -1.000 | 0.190 | 0.364 | 0.182 | 0.498 | 0.503 | -1.000 | 0.290 | 0.530 | 1.454 | |
2024-11-06 | Prisma-MPG + SG | RGB-D | 0.336 | 0.546 | 0.357 | -1.000 | 0.198 | 0.360 | 0.182 | 0.492 | 0.496 | -1.000 | 0.285 | 0.522 | 0.900 | |
2024-11-06 | Prisma-MPG | RGB-D | 0.334 | 0.545 | 0.352 | -1.000 | 0.183 | 0.361 | 0.181 | 0.496 | 0.501 | -1.000 | 0.279 | 0.527 | 2.168 | |
2023-12-05 | SAM6D | RGB-D | 0.332 | 0.541 | 0.350 | -1.000 | 0.201 | 0.361 | 0.177 | 0.490 | 0.496 | -1.000 | 0.300 | 0.522 | 2.654 | |
2023-12-05 | SAM6D-FastSAM | RGB-D | 0.319 | 0.537 | 0.330 | -1.000 | 0.133 | 0.326 | 0.167 | 0.455 | 0.458 | -1.000 | 0.200 | 0.464 | 0.213 | |
2024-05-27 | NIDS-Net_WA_Sappe | RGB | 0.315 | 0.502 | 0.340 | -1.000 | 0.139 | 0.316 | 0.173 | 0.458 | 0.458 | -1.000 | 0.218 | 0.463 | 0.418 | |
2024-03-22 | SAM6D(RGB) | RGB | 0.300 | 0.478 | 0.327 | -1.000 | 0.132 | 0.325 | 0.174 | 0.473 | 0.479 | -1.000 | 0.298 | 0.505 | 2.335 | |
2024-05-08 | NIDS-Net_WA | RGB | 0.294 | 0.479 | 0.313 | -1.000 | 0.126 | 0.293 | 0.166 | 0.447 | 0.447 | -1.000 | 0.218 | 0.451 | 0.415 | |
2024-03-22 | SAM6D-FastSAM(RGB) | RGB | 0.290 | 0.484 | 0.310 | -1.000 | 0.115 | 0.297 | 0.162 | 0.443 | 0.446 | -1.000 | 0.200 | 0.452 | 0.140 | |
2024-05-07 | NIDS-Net_basic | RGB | 0.288 | 0.471 | 0.305 | -1.000 | 0.131 | 0.287 | 0.169 | 0.445 | 0.445 | -1.000 | 0.234 | 0.449 | 0.419 | |
2023-08-02 | CNOS (SAM) (SAM) | RGB | 0.282 | 0.442 | 0.309 | -1.000 | 0.123 | 0.288 | 0.168 | 0.439 | 0.442 | -1.000 | 0.294 | 0.446 | 2.136 | |
2023-08-02 | CNOS (FastSAM) (FastSAM) | RGB | 0.254 | 0.430 | 0.270 | -1.000 | 0.104 | 0.262 | 0.151 | 0.431 | 0.435 | -1.000 | 0.202 | 0.440 | 0.126 | |
2023-11-21 | ViewInvDet | RGB | 0.252 | 0.447 | 0.255 | -1.000 | 0.114 | 0.258 | 0.149 | 0.446 | 0.453 | -1.000 | 0.256 | 0.458 | 0.729 | |
2023-08-23 | ZeroPose | RGB | 0.210 | 0.326 | 0.233 | -1.000 | 0.025 | 0.222 | 0.152 | 0.408 | 0.413 | -1.000 | 0.105 | 0.440 | 3.356 | |
2023-09-28 | lcc-fastsam (4th. stage) | RGB | 0.041 | 0.076 | 0.042 | -1.000 | 0.017 | 0.044 | 0.025 | 0.073 | 0.081 | -1.000 | 0.059 | 0.080 | 1.244 |
Tip: Hover over the numbers to see more decimal places.