Skip to content

Commit 74a8a2e

Browse files
committed
chore: minor changes
1 parent 662b3eb commit 74a8a2e

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

55 files changed

+946197
-12959
lines changed

.gitignore

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,4 +15,7 @@ esc
1515
.cache
1616
jobs
1717
V-WSD
18-
wandb
18+
wandb
19+
gen_data/*/*/*.png
20+
tmp
21+
latest_*

README.txt

Lines changed: 40 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,40 @@
1+
--------------------------------------------------------------------------------------------------
2+
SemEval-2023 Task-1 - V-WSD: Visual Word Sense Disambiguation (V-WSD)
3+
4+
5+
Alessandro Raganato, Iacer Calixto, Jose Camacho-Collados, Asahi Ushio, Mohammad Taher Pilehvar
6+
--------------------------------------------------------------------------------------------------
7+
8+
9+
Task: Given a potentially ambiguous word and some limited textual context, the task is to select among a set of ten candidate images the one which corresponds to the intended meaning of the target word.
10+
11+
12+
This package contains the test data for three languages, English (en), Farsi (fa), and Italian (it).
13+
14+
15+
The test dataset contains a folder named "test_images", and one file (each line corresponds to an instance):
16+
17+
18+
* {en,fa,it}.test.data.txt: This is a tab-separated file containing the following items:
19+
20+
21+
target_word <tab> full_phrase <tab> image_1 <tab> image_2 <tab> ... <tab> image_10
22+
23+
24+
- "target_word": the potentially ambiguous target word.
25+
26+
27+
- "full_phrase": limited textual context containing the target_word.
28+
29+
30+
- "image_i": corresponds to the "i"th image. In this version all images are in the test_images folder.
31+
32+
33+
* {en,fa,it}.test.gold.txt: This file contains the gold labels. Each line contains the name of the gold image for each corresponding data instance.
34+
35+
36+
Following the Codalab link for the evaluation:
37+
https://codalab.lisn.upsaclay.fr/competitions/8190
38+
39+
40+
For further details, please see https://raganato.github.io/vwsd/
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
{"id": "0", "probs": {"lichen%1:26:00::": 0.0005072812782600522, "lichen%1:20:00::": 0.9994926452636719}}

0 commit comments

Comments
 (0)