Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to read SWAG dataset? #4

Open
h56cho opened this issue Nov 19, 2019 · 0 comments
Open

How to read SWAG dataset? #4

h56cho opened this issue Nov 19, 2019 · 0 comments

Comments

@h56cho
Copy link

h56cho commented Nov 19, 2019

Hello,

First of all, thank you for this dataset.
I need more guidance as to how the texts are arranged in the SWAG/HELLASWAG datasets.

I downloaded the datasets, and when I look at the raw SWAG datasets, I can't quite distinguish which part(s) is for the background information for a question, and which part(s) denotes for the multiple choice options, and which part(s) contains the right answer to the question.

For example, below is an excerpt from the first part of the train_swag dataset.

video-id,fold-ind,startphrase,gold-ending,distractor-0,distractor-1,distractor-2,distractor-3,gold-source,gold-type,distractor-0-type,distractor-1-type,distractor-2-type,distractor-3-type,sent1,sent2
anetv_jkn6uvmqwh4,3416,Members of the procession walk down the street holding small horn brass instruments. A drum line,passes by walking down the street playing their instruments.,arrives and they're outside dancing and asleep.,turns the lead singer watches the performance.,has heard approaching them.,is covered in pumping music.,gold0-orig,pos,unl,unl,pos,pos,Members of the procession walk down the street holding small horn brass instruments.,A drum line
anetv_jkn6uvmqwh4,3417,A drum line passes by walking down the street playing their instruments. Members of the procession,"continue to play marching, interspersed.",wait slowly towards the cadets.,continues to play as well along the crowd along with the band being interviewed.,are playing ping pong and celebrating one left each in quick.,,gen-orig,pos,unl,unl,unl,n/a,A drum line passes by walking down the street playing their instruments.,Members of the procession
anetv_jkn6uvmqwh4,3415,A group of members in green uniforms walks waving flags. Members of the procession,walk down the street holding small horn brass instruments.,pay the other coaches to cheer as people this chatter dips in lawn sheets.,are talking a couple of people playing a game of tug of war.,is seen in the background.,holds up signs with numbers in their mouths and arrows before they go.,gold0-orig,pos,unl,unl,pos,pos,A group of members in green uniforms walks waving flags.,Members of the procession
anetv_jkn6uvmqwh4,3417,A drum line passes by walking down the street playing their instruments. Members of the procession,play and go back and forth hitting the drums while the audience claps for them.,are playing ping pong and celebrating one left each in quick.,wait slowly towards the cadets.,makes a square call and ends by jumping down into snowy streets where fans begin to take their positions.,,gen-reannot,pos,unl,unl,unl,n/a,A drum line passes by walking down the street playing their instruments.,Members of the procession

Here, where is the background information for this particular question, where are the options for multiple choices, and where is the correct answer located?

Thank you,

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant