stsb-dev.csv

id,sentence1,sentence2,sentence4ChatGPT,label (0-5),pred_bert-base,pred_bert-large,pred_roberta-base,pred_roberta-large,pred_ChatGPT
1399,At least 38 Morsi supporters die in clashes,Dozens of Morsi supporters killed in Egypt clashes,"Determine the similarity between the following two sentences: ""At least 38 Morsi supporters die in clashes"" and ""Dozens of Morsi supporters killed in Egypt clashes"" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",3.6,3.244968355,3.288885653,3.368962109,3.395780921,4.2
668,Q: What is the reason for people to implicitly trust their peers in extreme (or not) situations?,One human-being reliance on other(s) awareness is defined by the level of trust between the humans.,"Determine the similarity between the following two sentences: ""Q: What is the reason for people to implicitly trust their peers in extreme (or not) situations?"" and ""One human-being reliance on other(s) awareness is defined by the level of trust between the humans."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",2.6,1.959041059,2.00831309,2.442433685,2.022163272,4.7
49,A man is fitting silencer on a pistol.,A man is adding a silencer to a gun.,"Determine the similarity between the following two sentences: ""A man is fitting silencer on a pistol."" and ""A man is adding a silencer to a gun."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",4.5,4.186404049,4.657116532,4.208283424,4.419007003,4.9
903,The important thing I try to remember is just to pay attention.,I have been reading on this topic since I have asked this question.,"Determine the similarity between the following two sentences: ""The important thing I try to remember is just to pay attention."" and ""I have been reading on this topic since I have asked this question."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",0,1.1804571,1.269111186,1.000823379,0.691961646,2.2
1203,Stocks dipped lower Tuesday as investors opted to cash in profits from Monday's big rally despite a trio of reports suggesting modest improvement in the economy.,Wall Street moved tentatively higher Tuesday as investors weighed a trio of reports showing modest economic improvement against an urge to cash in profits from Monday's big rally.,"Determine the similarity between the following two sentences: ""Stocks dipped lower Tuesday as investors opted to cash in profits from Monday's big rally despite a trio of reports suggesting modest improvement in the economy."" and ""Wall Street moved tentatively higher Tuesday as investors weighed a trio of reports showing modest economic improvement against an urge to cash in profits from Monday's big rally."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",2.8,3.029890954,3.638062477,2.861750126,3.331255019,4.3
1322,Remarks by the President at the White House Science Fair,The Presidential Planner - The White House Science Fair,"Determine the similarity between the following two sentences: ""Remarks by the President at the White House Science Fair"" and ""The Presidential Planner - The White House Science Fair"" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",2.8,4.076817334,3.570934832,3.014893532,3.002280295,3.6
122,The man stirred the sauce for the chicken.,The man is stirring oil.,"Determine the similarity between the following two sentences: ""The man stirred the sauce for the chicken."" and ""The man is stirring oil."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",2.4,1.629602313,2.045028359,2.076697946,2.360799164,2.7
834,My guess is that means your cat only marginally likes the food you're feeding him.,Some researchers believe domestic cats never really mentally grow up completely and they always look at you like their mom.,"Determine the similarity between the following two sentences: ""My guess is that means your cat only marginally likes the food you're feeding him."" and ""Some researchers believe domestic cats never really mentally grow up completely and they always look at you like their mom."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",0.6,1.034255624,1.053032726,0.431614593,0.927220434,1.5
942,Yes a team can use the same player for both bowling and batting in a super over.,There's no rule that decides which players can be picked for bowling/batting in the Super Over.,"Determine the similarity between the following two sentences: ""Yes a team can use the same player for both bowling and batting in a super over."" and ""There's no rule that decides which players can be picked for bowling/batting in the Super Over."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",4.2,1.769647747,2.100540102,2.368202507,3.265904486,3.3
1447,Fire in Russian psychiatric hospital kills 38,38 feared dead in Russian psychiatric hospital fire,"Determine the similarity between the following two sentences: ""Fire in Russian psychiatric hospital kills 38"" and ""38 feared dead in Russian psychiatric hospital fire"" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",4.2,3.11483413,3.612492085,3.470819592,3.111338317,4.8
1372,Hospital: 61 killed in Venezuela prison riot,Dozens reported killed in Venezuela prison riot,"Determine the similarity between the following two sentences: ""Hospital: 61 killed in Venezuela prison riot"" and ""Dozens reported killed in Venezuela prison riot"" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",2.6,2.864679098,3.22498858,3.049948812,2.736020088,4
592,A guy and a girl are rock climbing with backpacks on.,Two boys are riding on a toy with a blonde girl running long side of them.,"Determine the similarity between the following two sentences: ""A guy and a girl are rock climbing with backpacks on."" and ""Two boys are riding on a toy with a blonde girl running long side of them."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",0,0.763318315,0.736193806,0.734437257,0.728376061,0
1391,4 dead after boat capsizes off Florida coast,8 dead after heavy rains on island of St Vincent,"Determine the similarity between the following two sentences: ""4 dead after boat capsizes off Florida coast"" and ""8 dead after heavy rains on island of St Vincent"" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",0.8,0.614186525,0.939798504,0.801806822,0.625484586,0
1485,Maldives begins to vote in controversy-ridden presidential poll,Crisis-hit Maldives holds new presidential poll,"Determine the similarity between the following two sentences: ""Maldives begins to vote in controversy-ridden presidential poll"" and ""Crisis-hit Maldives holds new presidential poll"" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",3,3.875561953,4.355659783,4.733147919,4.13233906,4
208,A monkey is karate kicking a person.,A monkey pratices martial arts.,"Determine the similarity between the following two sentences: ""A monkey is karate kicking a person."" and ""A monkey pratices martial arts."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",2.5,3.425750434,3.622828126,3.798140585,3.789401054,2.5
724,"If you're doing a full body workout 6 days a week, you absolutely need the rest week.",There are both physiological and neurological reasons to build in rest.,"Determine the similarity between the following two sentences: ""If you're doing a full body workout 6 days a week, you absolutely need the rest week."" and ""There are both physiological and neurological reasons to build in rest."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",2.6,1.200832725,2.024478018,1.245889217,1.929774582,2
1406,Matt Smith quits BBC’s Doctor Who,Matt Smith quits BBC's Doctor Who,"Determine the similarity between the following two sentences: ""Matt Smith quits BBC’s Doctor Who"" and ""Matt Smith quits BBC's Doctor Who"" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",5,4.517537057,4.913244843,5,4.956411719,5
1468,Thai government says elections Feb. 2,Philippines government says peace talks with communists have failed,"Determine the similarity between the following two sentences: ""Thai government says elections Feb. 2"" and ""Philippines government says peace talks with communists have failed"" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",0,0.528369173,0.518168174,0.408799015,0.389327183,0
1121,"The American Anglican Council, which represents Episcopalian conservatives, said it will seek authorization to create a separate group.","The American Anglican Council, which represents Episcopalian conservatives, said it will seek authorization to create a separate province in North America because of last week's actions.","Determine the similarity between the following two sentences: ""The American Anglican Council, which represents Episcopalian conservatives, said it will seek authorization to create a separate group."" and ""The American Anglican Council, which represents Episcopalian conservatives, said it will seek authorization to create a separate province in North America because of last week's actions."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",3.4,3.717465103,3.974609971,3.855203092,3.782498837,3
104,A woman is chopping onion.,A man is doing a card trick.,"Determine the similarity between the following two sentences: ""A woman is chopping onion."" and ""A man is doing a card trick."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",0,0.281120129,0.290120542,0.321592391,0.241737887,0
134,The man is slicing a potato.,A man is slicing potato.,"Determine the similarity between the following two sentences: ""The man is slicing a potato."" and ""A man is slicing potato."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",5,4.787549376,4.946376681,5,4.945703745,4
1051,The WHO experts didn't say how many cases in Hebei were in rural areas.,"Hebei has reported 191 cases and eight deaths, though the WHO experts did not say how many were in rural areas.","Determine the similarity between the following two sentences: ""The WHO experts didn't say how many cases in Hebei were in rural areas."" and ""Hebei has reported 191 cases and eight deaths, though the WHO experts did not say how many were in rural areas."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",3,3.320482373,3.487967253,3.130223155,3.48292619,4
374,The man and two young boys jump on a trampoline.,A man and two boys jump on a trampoline.,"Determine the similarity between the following two sentences: ""The man and two young boys jump on a trampoline."" and ""A man and two boys jump on a trampoline."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",4.6,4.556536078,4.819946289,5,4.721206725,4
820,"Most doctors do recommend rice cereal as the first food, as there is almost no worry of allergic reaction.",Eating off a spoon has to be an unusual experience for them.,"Determine the similarity between the following two sentences: ""Most doctors do recommend rice cereal as the first food, as there is almost no worry of allergic reaction."" and ""Eating off a spoon has to be an unusual experience for them."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",0.67,1.203212589,0.781694353,0.388535038,0.653607547,0
1074,The WHO says the latest case does not fit its profile of SARS and is not a public health concern.,The WHO has said the Singapore case did not fit its profile of SARS and was "not an international public health concern.","Determine the similarity between the following two sentences: ""The WHO says the latest case does not fit its profile of SARS and is not a public health concern."" and ""The WHO has said the Singapore case did not fit its profile of SARS and was ""not an international public health concern."""" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",3.8,3.898028731,4.123711586,3.72792542,3.832465708,4
517,A man playing the violin in the rain.,A man playing the guitar in the rain.,"Determine the similarity between the following two sentences: ""A man playing the violin in the rain."" and ""A man playing the guitar in the rain."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",3.2,2.666774094,2.416041791,2.488523126,2.635931075,2.5
1073,"Actor Noah Wyle, who has played Dr. John Carter since the shows inception in 1994, extended his contract with the show through the 2004-2005 season.","Noah Wyle, who has played Dr. John Carter since the series launched in 1994, has inked a one-year extension to his deal with producer Warner Bros. TV.","Determine the similarity between the following two sentences: ""Actor Noah Wyle, who has played Dr. John Carter since the shows inception in 1994, extended his contract with the show through the 2004-2005 season."" and ""Noah Wyle, who has played Dr. John Carter since the series launched in 1994, has inked a one-year extension to his deal with producer Warner Bros. TV."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",3.8,3.508327901,3.947880566,3.628317416,3.711532056,4
703,"Pardon the brevity of this answer, but I would say ""named"" is preferred within the context of your example.","Named is preferred in your example, since you are formally giving a name to your method.","Determine the similarity between the following two sentences: ""Pardon the brevity of this answer, but I would say ""named"" is preferred within the context of your example."" and ""Named is preferred in your example, since you are formally giving a name to your method."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",4.4,3.29059571,3.196997344,3.194267452,3.182784021,4
1037,"Calvin Hollins Jr.'s attorney, Thomas Royce, has repeatedly said his client had no link with the company that owned and operated E2.","The lawyer for Hollins Jr., Thomas Royce, has said his client had no link to the company that owned and operated E2.","Determine the similarity between the following two sentences: ""Calvin Hollins Jr.'s attorney, Thomas Royce, has repeatedly said his client had no link with the company that owned and operated E2."" and ""The lawyer for Hollins Jr., Thomas Royce, has said his client had no link to the company that owned and operated E2."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",4.5,4.248593748,4.545928538,4.792961776,4.148997962,4
77,A turtle walks over the ground.,A large turtle crawls in the grass.,"Determine the similarity between the following two sentences: ""A turtle walks over the ground."" and ""A large turtle crawls in the grass."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",3.75,3.010351956,3.349821568,3.292644024,3.197960854,4
371,German Shephard jumping through black hoop while people watch,A dog jumps through a hoop.,"Determine the similarity between the following two sentences: ""German Shephard jumping through black hoop while people watch"" and ""A dog jumps through a hoop."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",3.2,1.193014011,2.763117552,2.770805657,2.758895755,2
728,"First of all, as a general matter of fact you suppose to change your workout routine in every 3-4 weeks.","You can mix those, but in my experience, it will be very difficult at first.","Determine the similarity between the following two sentences: ""First of all, as a general matter of fact you suppose to change your workout routine in every 3-4 weeks."" and ""You can mix those, but in my experience, it will be very difficult at first."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",0,1.418701857,1.143749505,1.036490947,1.384453475,0.6
1482,Chinese lunar rover lands on moon,China lands robot rover on moon,"Determine the similarity between the following two sentences: ""Chinese lunar rover lands on moon"" and ""China lands robot rover on moon"" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",5,4.50530827,4.180357158,4.517689943,4.353100061,4
865,There are many compact cameras with underwater housings available from Canon and Olympus.,"There are waterproof compacts that go to 10 meters, such as some of the Olympus Tough models.","Determine the similarity between the following two sentences: ""There are many compact cameras with underwater housings available from Canon and Olympus."" and ""There are waterproof compacts that go to 10 meters, such as some of the Olympus Tough models."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",3.2,1.438472569,2.521584928,1.522050798,2.501367331,4
155,Three men are dancing.,Women are dancing.,"Determine the similarity between the following two sentences: ""Three men are dancing."" and ""Women are dancing."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",1.3,2.175577432,2.15922609,1.77270323,2.022777796,2
755,To no extent at all is the wars in the middle east caused by trade making the area heterogeneous.,"They had a treaty beginning in 1941, after a few skirmishes along the area in question.","Determine the similarity between the following two sentences: ""To no extent at all is the wars in the middle east caused by trade making the area heterogeneous."" and ""They had a treaty beginning in 1941, after a few skirmishes along the area in question."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",0.6,1.198754758,1.633647084,1.067093611,1.683618724,1
1159,"A search for three missing teenagers uncovered at least two bodies buried beneath freshly poured concrete in the basement of a house, authorities said Wednesday.",Authorities performed an autopsy Thursday on one of three bodies recovered from beneath a layer of freshly poured concrete in the basement of a northwest Indiana home.,"Determine the similarity between the following two sentences: ""A search for three missing teenagers uncovered at least two bodies buried beneath freshly poured concrete in the basement of a house, authorities said Wednesday."" and ""Authorities performed an autopsy Thursday on one of three bodies recovered from beneath a layer of freshly poured concrete in the basement of a northwest Indiana home."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",2.4,3.177610338,2.710928321,2.37159878,2.723508179,4.5
1157,"For the entire season, the average five-day forecast track error was 259 miles, Franklin said.","""The average track error for the five-day (forecast) is 323 nautical miles.","Determine the similarity between the following two sentences: ""For the entire season, the average five-day forecast track error was 259 miles, Franklin said."" and """"The average track error for the five-day (forecast) is 323 nautical miles."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",1.75,2.626694143,3.071941137,2.217102945,2.448909879,4
961,"As per FIFA's ""Equipment Regulations"", Section 22, only the goalkeeper is permitted to wear a cap.","Although headgear is allowed to be worn, it is not advised for anyone other than the goalkeeper.","Determine the similarity between the following two sentences: ""As per FIFA's ""Equipment Regulations"", Section 22, only the goalkeeper is permitted to wear a cap."" and ""Although headgear is allowed to be worn, it is not advised for anyone other than the goalkeeper."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",2.4,2.087559551,1.824523509,2.11495012,2.089977562,4.5
313,A black and white cat playing with a wool basket.,A black and white cat lying on a blanket.,"Determine the similarity between the following two sentences: ""A black and white cat playing with a wool basket."" and ""A black and white cat lying on a blanket."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",1.8,2.467120588,2.566114366,2.761973143,1.990246624,2.5
1362,London Marathon observes silence for Boston bomb victims,London Marathon observes silence for Boston victims,"Determine the similarity between the following two sentences: ""London Marathon observes silence for Boston bomb victims"" and ""London Marathon observes silence for Boston victims"" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",4.6,4.071856141,4.250842333,4.572791755,4.154521227,4.5
115,The man cut up an onion.,A man is dancing.,"Determine the similarity between the following two sentences: ""The man cut up an onion."" and ""A man is dancing."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",0.6,0.255162548,0.449168049,0.403550714,0.557934791,1
100,A woman is riding on a horse.,A man is turning over tables in anger.,"Determine the similarity between the following two sentences: ""A woman is riding on a horse."" and ""A man is turning over tables in anger."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",0,0.339278318,0.311755873,0.157746822,0.067635886,0.5
552,A person is scaling a rock wall.,A person and a horse are above a fence.,"Determine the similarity between the following two sentences: ""A person is scaling a rock wall."" and ""A person and a horse are above a fence."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",0.2,1.314865053,1.946728677,1.033046246,1.007742956,2
1340,Nelson Mandela taken to hospital,Nelson Mandela released from hospital,"Determine the similarity between the following two sentences: ""Nelson Mandela taken to hospital"" and ""Nelson Mandela released from hospital"" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",1.6,3.41263473,2.969437838,2.017571032,2.554941773,4
219,A boy is playing a piano.,A man is singing and playing a guitar.,"Determine the similarity between the following two sentences: ""A boy is playing a piano."" and ""A man is singing and playing a guitar."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",1.25,0.942432657,1.191028878,0.932691023,0.926786065,2.5
1179,"Nine seconds later, it broke the sound barrier and continued its steep powered ascent.","Nine seconds later, SpaceShipOne broke the sound barrier, the company said.","Determine the similarity between the following two sentences: ""Nine seconds later, it broke the sound barrier and continued its steep powered ascent."" and ""Nine seconds later, SpaceShipOne broke the sound barrier, the company said."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",3,3.550934792,3.710674345,3.320854902,3.078361452,4.5
928,"First of all, let me say that there seems to be 3 main traits to casting a spell.",I always thought that Harry seemed to learn from the Half-Blood Prince better than he did from other sources.,"Determine the similarity between the following two sentences: ""First of all, let me say that there seems to be 3 main traits to casting a spell."" and ""I always thought that Harry seemed to learn from the Half-Blood Prince better than he did from other sources."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",0.6,1.108185947,1.03320986,0.553804412,0.686828345,1
62,A slow lori walks around.,A animal is walking around.,"Determine the similarity between the following two sentences: ""A slow lori walks around."" and ""A animal is walking around."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",2.8,2.596602142,3.00891012,2.341940999,2.300493717,2
236,A dog knocks a boy into the water twice.,A dog pushes a toddler into a rain puddle.,"Determine the similarity between the following two sentences: ""A dog knocks a boy into the water twice."" and ""A dog pushes a toddler into a rain puddle."" The score should be ranging from 0.0 to 5.0, and can be a decimal.""",2.692,1.815118194,2.582536936,2.483271956,2.646086812,2.5
,,,,,,,,,
,,,,Pear,0.830418491,0.882603181,0.902163788,0.928471622,0.809138902
,,,,Spea,0.819,0.868,0.891,0.911,0.724