Evaluation Prompt Examples

RefCOCO referring expression

The following are Query Image and Sentence (with Retrieval Bounding Box) about RefCOCO testA/testB split.

testA
Query Image: COCO_train2014_000000581282_10.jpg
Query Sentence: 
    'person bottom left'
Retrieval Bounding Box: 
    [3.24, 159.31, 156.4, 312.81]

testB
Query Image: COCO_train2014_000000581563_3.jpg
Query Sentence: 
    'lower left corner darkness'
Retrieval Bounding Box: 
    [0.0, 373.89, 137.59, 126.11]

RefCOCO+ referring expression

The following are Query Image and Sentence (with Retrieval Bounding Box) about RefCOCO+ testA/testB split.

testA
Query Image: COCO_train2014_000000581282_10.jpg
Query Sentence: 
    'guy holding purp umbrella in corner near us'
Retrieval Bounding Box: 
    [3.24, 159.31, 156.4, 312.81]

testB
Query Image: COCO_train2014_000000581563_3.jpg
Query Sentence: 
    'large dark item next to car'
Retrieval Bounding Box: 
    [0.0, 373.89, 137.59, 126.11]

RefCOCOg referring expression

The following are Query Image and Sentence (with Retrieval Bounding Box) about RefCOCOg test split.

test
Query Image: COCO_train2014_000000380440_491042.jpg
Query Sentence: 
    'the man in yellow coat'
Retrieval Bounding Box: 
    [374.31, 65.06, 136.04, 201.94]