The bad case input index of each output:
Name/Index    Cosine    MSE    L1    KL    SQNR
------------  --------  -----  ----  ----  ------
bboxes        51        72     79    72    79
scores        58        70     0     70    70
labels        0         80     80    22    0
bboxes        26        33     97    99    39
scores        58        54     85    57    57
labels        0         0      0     43    0
bboxes        73        99     99    99    92
scores        86        85     0     85    85
labels        0         40     40    96    0
bboxes        83        98     98    91    98
scores        80        94     20    97    97
labels        0         20     20    82    0
bboxes        51        51     52    55    57
scores        58        49     0     50    50
labels        0         60     60    42    0
bboxes        73        73     71    79    79
scores        98        94     25    89    97
labels        0         0      0     83    0
bboxes        4         78     78    75    39
scores        6         45     0     49    5
labels        0         0      0     28    0
bboxes        65        99     99    95    92
scores        38        30     65    30    30
labels        0         40     40    22    0
bboxes        91        91     91    92    94
scores        46        89     25    89    97
labels        0         0      0     82    0
bboxes        73        73     73    73    39
scores        6         63     0     59    5
labels        0         40     40    28    0
bboxes        90        79     79    79    79
scores        38        30     40    30    30
labels        0         80     80    22    0
bboxes        73        100    100   99    92
scores        86        85     25    85    85
labels        0         0      0     6     0
bboxes        91        91     91    91    98
scores        98        89     0     90    90
labels        0         0      0     82    0
bboxes        87        96     91    99    59
scores        18        9      20    9     10
labels        0         60     60    3     0
bboxes        26        33     39    33    39
scores        58        54     60    57    57
labels        0         0      0     43    0
bboxes        47        53     51    59    59
scores        78        74     45    9     77
labels        0         20     20    3     0
bboxes        73        73     73    73    39
scores        6         63     0     59    5
labels        0         40     40    28    0
bboxes        41        78     78    78    70
scores        46        75     80    75    46
labels        0         0      0     68    0
bboxes        26        33     39    33    39
scores        78        70     80    70    70
labels        0         0      0     62    0
bboxes        87        96     91    99    59
scores        18        9      20    9     10
labels        0         60     60    3     0
bboxes        73        73     73    73    39
scores        98        94     0     94    97
labels        0         40     40    83    0
bboxes        51        51     52    55    57
scores        58        49     0     50    50
labels        0         60     60    42    0
bboxes        26        33     39    33    39
scores        58        54     60    57    57
labels        0         0      0     43    0
bboxes        12        100    100   100   59
scores        18        9      20    9     10
labels        0         20     20    3     0
bboxes        73        73     71    79    79
scores        98        94     25    89    97
labels        0         0      0     83    0
bboxes        4         78     78    75    39
scores        6         99     0     99    5
labels        0         80     80    28    0

The metric results of each badcase:
Name/Index    Cosine      MSE         L1         KL           SQNR
------------  ----------  ----------  ---------  -----------  --------
bboxes        -0.158391   619.261     13.8352    2.46351      -3.35996
scores        0.292203    0.0103475   0.029907   2.51427e-05  0.125563
labels        0           2.77333     1.1        0.00322794   0
bboxes        -0.112107   729.067     14.8526    2.56158      -4.28209
scores        0.300354    0.00886066  0.0329953  2.08274e-05  0.138221
labels        0           2.77333     1.1        0.00314864   0
bboxes        -0.130031   803.291     15.6911    2.99572      -5.29093
scores        0.294236    0.00590773  0.0332915  1.42358e-05  0.158903
labels        0           2.77333     1.1        0.00313363   0
bboxes        -0.224828   929.791     16.7428    3.31176      -5.23068
scores        0.289961    0.00936944  0.0332915  2.22163e-05  0.128559
labels        0           2.38333     0.95       0.00322769   0
bboxes        -0.187134   919.822     16.3983    3.06219      -5.05339
scores        0.302363    0.00864858  0.0332915  2.09133e-05  0.140881
labels        0           2.77333     1.1        0.00316644   0
bboxes        -0.12115    739.101     15.0407    2.6304       -4.31108
scores        0.300275    0.00885828  0.0327854  2.08138e-05  0.138297
labels        0           2.77333     1.1        0.00314864   0
bboxes        -0.0971904  680.105     14.0184    2.39063      -4.23996
scores        0.311528    0.0050171   0.0332915  1.18931e-05  0.182752
labels        0           2.38333     0.95       0.00310823   0
bboxes        -0.123984   797.848     15.6154    3.02566      -5.28681
scores        0.29235     0.0103052   0.0328909  2.49901e-05  0.126223
labels        0           2.77333     1.1        0.00322794   0
bboxes        -0.204434   1049.34     17.3279    3.42533      -5.668
scores        0.293623    0.00864658  0.0327854  2.11457e-05  0.138951
labels        0           2.77333     1.1        0.00318517   0
bboxes        -0.130031   746.308     14.9328    2.54466      -4.23996
scores        0.311528    0.00578221  0.0332915  1.26236e-05  0.182752
labels        0           2.77333     1.1        0.00310823   0
bboxes        -0.0990654  690.949     14.222     2.45882      -4.32661
scores        0.29235     0.0103052   0.0332915  2.49901e-05  0.126223
labels        0           2.77333     1.1        0.00322794   0
bboxes        -0.12115    808.572     15.6945    3.01324      -5.30079
scores        0.295392    0.00581087  0.0327854  1.39682e-05  0.162076
labels        0           2.77333     1.1        0.00313688   0
bboxes        -0.186581   913.189     16.4177    3.04468      -5.09176
scores        0.301017    0.00869455  0.0332915  2.10039e-05  0.139884
labels        0           2.38333     0.95       0.00313031   0
bboxes        -0.117706   732.007     14.9559    2.53103      -4.23185
scores        0.303846    0.0085614   0.0332915  2.10733e-05  0.138915
labels        0           2.77333     1.1        0.00317018   0
bboxes        -0.112107   729.067     14.7804    2.53654      -4.28209
scores        0.300354    0.00886066  0.0332915  2.08274e-05  0.138221
labels        0           2.77333     1.1        0.00314864   0
bboxes        -0.114614   725.306     14.7905    2.5361       -4.12676
scores        0.30048     0.00885428  0.0325145  2.10733e-05  0.138378
labels        0           2.77333     1.1        0.00317018   0
bboxes        -0.130031   746.308     14.9328    2.54466      -4.23996
scores        0.311528    0.00578221  0.0332915  1.26236e-05  0.182752
labels        0           2.77333     1.1        0.00310823   0
bboxes        -0.126115   938.751     16.6197    3.30685      -5.60132
scores        0.293623    0.00635371  0.0332915  1.52408e-05  0.166614
labels        0           2.77333     1.1        0.00317868   0
bboxes        -0.112107   729.067     14.7804    2.53654      -4.28209
scores        0.291436    0.0102308   0.0332915  2.47813e-05  0.126618
labels        0           2.77333     1.1        0.00325448   0
bboxes        -0.117706   732.007     14.9559    2.53103      -4.23185
scores        0.303846    0.0085614   0.0332915  2.10733e-05  0.138915
labels        0           2.77333     1.1        0.00317018   0
bboxes        -0.130031   746.308     14.9328    2.54466      -4.23996
scores        0.300897    0.00885944  0.0332915  2.08135e-05  0.13809
labels        0           2.77333     1.1        0.00314864   0
bboxes        -0.187134   919.822     16.3983    3.06219      -5.05339
scores        0.302363    0.00864858  0.0332915  2.09133e-05  0.140881
labels        0           2.77333     1.1        0.00316644   0
bboxes        -0.112107   729.067     14.7804    2.53654      -4.28209
scores        0.300354    0.00886066  0.0332915  2.08274e-05  0.138221
labels        0           2.77333     1.1        0.00314864   0
bboxes        -0.0831846  688.768     14.1645    2.40636      -4.23185
scores        0.303846    0.0085614   0.0332915  2.10733e-05  0.138915
labels        0           2.38333     0.95       0.00317018   0
bboxes        -0.12115    739.101     15.0407    2.6304       -4.31108
scores        0.300275    0.00885828  0.0327854  2.08138e-05  0.138297
labels        0           2.77333     1.1        0.00314864   0
bboxes        -0.0971904  680.105     14.0184    2.39063      -4.23996
scores        0.311528    0.00560196  0.0332915  1.26609e-05  0.182752
labels        0           2.77333     1.1        0.00310823   0

The bad case input index of the worst output:
metric    dataloader index
--------  ------------------
Cosine    83
MSE       91
L1        91
KL        92
SQNR      94