Set of Marks track

Success Rate (SR) ↑ metrics — Precision (SR-P), Recall (SR-R), and F1 Score (SR-F1) — evaluated across non-occluded (No-Occ), Easy, Medium, and Hard levels (higher is better). The Average SR-F1 determines overall ranking.

Scroll table horizontally
Method Name Team No-Occ Easy Medium Hard Average
SR-P SR-P SR-R SR-F1 SR-P SR-R SR-F1 SR-P SR-R SR-F1 SR-F1
dbxvla Dobot 0.9845 0.9278 0.9076 0.9112 0.8990 0.8364 0.8525 0.7512 0.6988 0.7074 0.8639
internVL THU 0.9280 0.8861 0.8664 0.8699 0.8636 0.8037 0.8191 0.7092 0.6658 0.6721 0.8223
bunny_is_best Bunny_fdu 0.9165 0.8705 0.8511 0.8545 0.8554 0.7956 0.8111 0.6943 0.6444 0.6521 0.8085
yy_uuds scu 0.9190 0.8641 0.8454 0.8485 0.8480 0.7880 0.8034 0.7083 0.6535 0.6632 0.8085
noahvl 0.9215 0.8666 0.8471 0.8506 0.8340 0.7752 0.7904 0.7067 0.6568 0.6653 0.8069
zib_ eureka 0.9155 0.8659 0.8467 0.8500 0.8387 0.7788 0.7943 0.7116 0.6576 0.6674 0.8068
sxaidp sxai 0.8950 0.8637 0.8444 0.8478 0.8369 0.7793 0.7939 0.6745 0.6304 0.6361 0.7932
NV NV 0.8900 0.8366 0.8171 0.8208 0.8301 0.7730 0.7873 0.6984 0.6543 0.6605 0.7896
qwenvla qwen_vla 0.8875 0.8372 0.8183 0.8217 0.8181 0.7623 0.7766 0.6795 0.6386 0.6435 0.7823
superbird TongJi University 0.8770 0.8195 0.8011 0.8042 0.8161 0.7585 0.7732 0.6613 0.6122 0.6201 0.7686
wpl wpl_lab 0.8360 0.8162 0.7985 0.8014 0.7811 0.7263 0.7402 0.7158 0.6543 0.6676 0.7613
flow 0.8745 0.8193 0.7996 0.8034 0.7948 0.7376 0.7525 0.6522 0.6048 0.6133 0.7610
flytek ustc 0.8475 0.8003 0.7827 0.7856 0.7820 0.7278 0.7417 0.6366 0.5908 0.5970 0.7429
demo-v1 0.8435 0.7966 0.7792 0.7819 0.7916 0.7372 0.7509 0.6225 0.5792 0.5861 0.7406
UNOGrasp FBK-TeV 0.9555 0.8238 0.8061 0.8086 0.7606 0.6536 0.6833 0.5520 0.4785 0.4950 0.7356
Gemini Robotics ER 2 FBK-TeV 0.9235 0.7218 0.7236 0.7147 0.5484 0.5017 0.5054 0.2063 0.1815 0.1809 0.5811
Gemini Robotics ER 1.5 FBK-TeV 0.5465 0.6878 0.7180 0.6898 0.4246 0.3889 0.3842 0.1559 0.1518 0.1427 0.4408