fn_spacy_tokens_for_baseline: Golden Buddha statues in several of Buddha 's aspects adorn the temples , and overlooking them is the 17 - story Flower Pagoda , a slender relic of the Song dynasty ( a.d . 960 - 1279 ) .

source_bert_toks: golden buddha statues in several of buddha ' s aspects ad ##orn the temples , and overlooking them is the 17 - story flower pagoda , a slender relic of the song dynasty ( a . d . 960 - 127 ##9 ) .

reference_raw: The golden Buddha statues in some aspects of Buddha adorn the temples and overlook them are the 17-story Flower Pagoda, the slender relic of the Song Dynasty (a.d. 960 - 1279).

reference_spacy_tokens: The golden Buddha statues in some aspects of Buddha adorn the temples and overlook them are the 17-story Flower Pagoda , the slender relic of the Song Dynasty ( a.d . 960 - 1279 ) .


fn_spacy_tokens_for_baseline: ' Plenty of brandy , and do n't plaster the top with cherries , just one , perhaps on the tip - top , and only a touch of angelica . '

source_bert_toks: ' plenty of brandy , and don ' t plaster the top with cher ##ries , just one , perhaps on the tip - top , and only a touch of angelica . '

reference_raw: "A lot of brandy, and don't put cherries on the top, just one, maybe on the top, and just a touch of angelica."

reference_spacy_tokens: " A lot of brandy , and do n't put cherries on the top , just one , maybe on the top , and just a touch of angelica . "


fn_spacy_tokens_for_baseline: No one claimed responsibility for his killing .

source_bert_toks: no one claimed responsibility for his killing .

reference_raw: No one said he was responsible for his murder.

reference_spacy_tokens: No one said he was responsible for his murder .


fn_spacy_tokens_for_baseline: The major changes were not to daily tasks and routines , but to the political power base , which changed regularly and not necessarily peacefully throughout the ages .

source_bert_toks: the major changes were not to daily tasks and routines , but to the political power base , which changed regularly and not necessarily peacefully throughout the ages .

reference_raw: The major changes were not in the daily tasks and routines, but in the political power base, which changed on a regular basis and not necessarily in peace over the years.

reference_spacy_tokens: The major changes were not in the daily tasks and routines , but in the political power base , which changed on a regular basis and not necessarily in peace over the years .


fn_spacy_tokens_for_baseline: The nadir was reached when at Bannockburn in 1314 the English army was annihilated by the Scots under Robert Bruce .

source_bert_toks: the nad ##ir was reached when at ban ##nock ##burn in 131 ##4 the english army was ann ##ih ##ila ##ted by the scots under robert bruce .

reference_raw: The nadir was reached when the English army was destroyed by the Scots under Robert Bruce in Bannockburn in 1314.

reference_spacy_tokens: The nadir was reached when the English army was destroyed by the Scots under Robert Bruce in Bannockburn in 1314 .


fn_spacy_tokens_for_baseline: When snow many feet deep blankets the land and the lake is covered with ice , the beavers are able to swim out from their lodge beneath the ice , retrieve the green branches and feed on them throughout the winter .

source_bert_toks: when snow many feet deep blankets the land and the lake is covered with ice , the beaver ##s are able to swim out from their lodge beneath the ice , retrieve the green branches and feed on them throughout the winter .

reference_raw: When snow covers the ground many feet deep and the lake is covered with ice, the beavers can swim out of their cabin under the ice, pick up the green branches and feed on them during the winter.

reference_spacy_tokens: When snow covers the ground many feet deep and the lake is covered with ice , the beavers can swim out of their cabin under the ice , pick up the green branches and feed on them during the winter .


fn_spacy_tokens_for_baseline: I went to Godstowe , said a prayer for that poor woman 's soul , gave her Christ 's unction and left .

source_bert_toks: i went to gods ##tow ##e , said a prayer for that poor woman ' s soul , gave her christ ' s un ##ction and left .

reference_raw: I went to Godstow, prayed for the soul of the poor woman, gave her the union of Christ and left.

reference_spacy_tokens: I went to Godstow , prayed for the soul of the poor woman , gave her the union of Christ and left .


fn_spacy_tokens_for_baseline: In the end , she catnapped , shaking herself awake every time she felt herself drifting towards a deeper sleep .

source_bert_toks: in the end , she cat ##na ##pped , shaking herself awake every time she felt herself drifting towards a deeper sleep .

reference_raw: She finally knocked on it, shaking herself awake every time she felt herself drifting into a deeper sleep.

reference_spacy_tokens: She finally knocked on it , shaking herself awake every time she felt herself drifting into a deeper sleep .


fn_spacy_tokens_for_baseline: Bellowing , the thing was trying to reach over the stair - rail with its other encrusted , decomposing claw .

source_bert_toks: bell ##owing , the thing was trying to reach over the stair - rail with its other en ##cr ##ust ##ed , deco ##mp ##osing claw .

reference_raw: The creature bellowed and tried to reach over the stair-rail with its other encrusted, decaying talon.

reference_spacy_tokens: The creature bellowed and tried to reach over the stair - rail with its other encrusted , decaying talon .


fn_spacy_tokens_for_baseline: You can sleep over . '

source_bert_toks: you can sleep over . '

reference_raw: You can stay here.'

reference_spacy_tokens: You can stay here . '


fn_spacy_tokens_for_baseline: The appellant was a South African citizen who had left South Africa to avoid apprehension for a burglary .

source_bert_toks: the app ##ellant was a south african citizen who had left south africa to avoid apprehension for a bu ##rg ##lary .

reference_raw: The applicant was a South African citizen who had left South Africa in order to avoid arrest for a break-in.

reference_spacy_tokens: The applicant was a South African citizen who had left South Africa in order to avoid arrest for a break - in .


fn_spacy_tokens_for_baseline: The night outside was drizzling with rain , and everyone except himself hurried for a cab ; the flower - sellers were disconsolate .

source_bert_toks: the night outside was dr ##iz ##z ##ling with rain , and everyone except himself hurried for a cab ; the flower - sellers were disco ##ns ##olate .

reference_raw: The night outside was drizzly with rain, and everyone but him hurried to the cab; the flower-sellers were dissatisfied.

reference_spacy_tokens: The night outside was drizzly with rain , and everyone but him hurried to the cab ; the flower - sellers were dissatisfied .


fn_spacy_tokens_for_baseline: It seldom had to ring more than once , but every time he dreaded that the peal might have woken Nell .

source_bert_toks: it seldom had to ring more than once , but every time he dread ##ed that the pea ##l might have woken nell .

reference_raw: He rarely had to ring more than once, but each time he feared that the peal might awaken Nell.

reference_spacy_tokens: He rarely had to ring more than once , but each time he feared that the peal might awaken Nell .


fn_spacy_tokens_for_baseline: Iraq has claimed that more than 1.5 million people , mostly children and the elderly , have died of curable diseases due to the decade - long U.N. sanctions .

source_bert_toks: iraq has claimed that more than 1 . 5 million people , mostly children and the elderly , have died of cu ##rable diseases due to the decade - long u . n . sanctions .

reference_raw: Iraq claims that more than 1.5 billion people, mostly children and older people, died of curable diseases as a result of decade-long UN sanctions.

reference_spacy_tokens: Iraq claims that more than 1.5 billion people , mostly children and older people , died of curable diseases as a result of decade - long UN sanctions .


fn_spacy_tokens_for_baseline: Date : We d Dec 8

source_bert_toks: date : wed dec 8

reference_raw: Data: Wed Dec 8

reference_spacy_tokens: Data : We d Dec 8


fn_spacy_tokens_for_baseline: Silber 's Republican opponent in the November election was also selected on Sept. 18 , when William Weld defeated the state House minority leader Steven Pierce , the favourite for the Republican nomination .

source_bert_toks: si ##lb ##er ' s republican opponent in the november election was also selected on sept . 18 , when william we ##ld defeated the state house minority leader steven pierce , the favourite for the republican nomination .

reference_raw: Silber's Republican adversary in the November election was also selected on September 18th, when William Weld beat the State House Minority Leader Steven Pierce, the favorite of the Republican nominations.

reference_spacy_tokens: Silber 's Republican adversary in the November election was also selected on September 18th , when William Weld beat the State House Minority Leader Steven Pierce , the favorite of the Republican nominations .


fn_spacy_tokens_for_baseline: Ducking to put the van between them Maxim ran crouching his soft - soled shoes making the barest patter on the rough but thank God dry paving .

source_bert_toks: duck ##ing to put the van between them maxim ran crouch ##ing his soft - sole ##d shoes making the bare ##st pat ##ter on the rough but thank god dry paving .

reference_raw: Maxim ducked to put the van between them and ran crouching his soft-soled boots, making the barest pat on the rough but thank God the dry pavings.

reference_spacy_tokens: Maxim ducked to put the van between them and ran crouching his soft - soled boots , making the barest pat on the rough but thank God the dry pavings .


fn_spacy_tokens_for_baseline: They filled their pail and container , and started the return journey .

source_bert_toks: they filled their pa ##il and container , and started the return journey .

reference_raw: They filled their buckets and containers and began their return journey.

reference_spacy_tokens: They filled their buckets and containers and began their return journey .


fn_spacy_tokens_for_baseline: As a result , more casinos emerged along the Strip .

source_bert_toks: as a result , more casinos emerged along the strip .

reference_raw: As a result, there were more casinos along the Strip.

reference_spacy_tokens: As a result , there were more casinos along the Strip .


fn_spacy_tokens_for_baseline: Still feeling perturbed , he went back into his house , lay on his pallet bed and stared up at the flaking ceiling .

source_bert_toks: still feeling per ##tur ##bed , he went back into his house , lay on his pal ##let bed and stared up at the fl ##aking ceiling .

reference_raw: Still troubled, he went back to his house, lay down on his pallet bed, and looked up at the flapping ceiling.

reference_spacy_tokens: Still troubled , he went back to his house , lay down on his pallet bed , and looked up at the flapping ceiling .


fn_spacy_tokens_for_baseline: Some , like French , Spanish , Italian , and Portuguese , had more in common with one another than they did with , say , German , English , Swedish , Danish , and Dutch , which , in turn , bore only a remote resemblance to Russian and Polish , on the one hand , and the two extant varieties of , say , Gaelic , on the other .

source_bert_toks: some , like french , spanish , italian , and portuguese , had more in common with one another than they did with , say , german , english , swedish , danish , and dutch , which , in turn , bore only a remote resemblance to russian and polish , on the one hand , and the two extant varieties of , say , gaelic , on the other .

reference_raw: Some of them, such as French, Spanish, Italian, and Portuguese, have more to do with each other than, for example, German, English, Swedish, Danish and Dutch, which, on the one hand, bear only a remote resemblance to Russian and Polish, and, on the other hand, two vast varieties of, say, Gaelic.

reference_spacy_tokens: Some of them , such as French , Spanish , Italian , and Portuguese , have more to do with each other than , for example , German , English , Swedish , Danish and Dutch , which , on the one hand , bear only a remote resemblance to Russian and Polish , and , on the other hand , two vast varieties of , say , Gaelic .


fn_spacy_tokens_for_baseline: His distrust of the power of critics made him ready to jibe at David Sylvester .

source_bert_toks: his distrust of the power of critics made him ready to ji ##be at david sylvester .

reference_raw: His distrust of critics made him ready to jump at David Sylvester.

reference_spacy_tokens: His distrust of critics made him ready to jump at David Sylvester .


fn_spacy_tokens_for_baseline: Their recognition attests the presence of several wealthy individuals disposed to live in the town itself , while yet others occupied nearby villas , including the winged - corridor complex in the rural - urban fringe to the east , and the villa to the west at Bishopstone .

source_bert_toks: their recognition at ##test ##s the presence of several wealthy individuals disposed to live in the town itself , while yet others occupied nearby villas , including the winged - corridor complex in the rural - urban fringe to the east , and the villa to the west at bishops ##tone .

reference_raw: Their recognition confirms the presence of a few rich people who were destined to live in the city itself, while others occupied nearby villas, including the winged corridor complex on the eastern edge of the rural city, and the villa on the west side of Bishopstone.

reference_spacy_tokens: Their recognition confirms the presence of a few rich people who were destined to live in the city itself , while others occupied nearby villas , including the winged corridor complex on the eastern edge of the rural city , and the villa on the west side of Bishopstone .


fn_spacy_tokens_for_baseline: Wires upon wires wove around him , binding him to his amplifiers .

source_bert_toks: wires upon wires wo ##ve around him , binding him to his amplifiers .

reference_raw: The wires on the wires twisted around him, binding him to the amplifiers.

reference_spacy_tokens: The wires on the wires twisted around him , binding him to the amplifiers .


fn_spacy_tokens_for_baseline: The release of nerve gas on the Tokyo subway by a Japanese cult on March 20 , 1995 , the terrorist attacks of September 11 , 2001 , and the sending of anthrax - tainted letters have made policymakers and the general public concerned that terrorists could use chemical or biological weapons ( CBW ) to inflict mass casualties .

source_bert_toks: the release of nerve gas on the tokyo subway by a japanese cult on march 20 , 1995 , the terrorist attacks of september 11 , 2001 , and the sending of ant ##hra ##x - tainted letters have made policy ##makers and the general public concerned that terrorists could use chemical or biological weapons ( cb ##w ) to in ##flict mass casualties .

reference_raw: The release of neural gas on the Tokyo subway by the Japanese cult on March 20, 1995, the terrorist attacks on September 11, 2001, and the sending of anthrax-tainted letters have led politicians and the general public concerned to believe that terrorists could use chemical or biological weapons (CBW) to cause mass casualties.

reference_spacy_tokens: The release of neural gas on the Tokyo subway by the Japanese cult on March 20 , 1995 , the terrorist attacks on September 11 , 2001 , and the sending of anthrax - tainted letters have led politicians and the general public concerned to believe that terrorists could use chemical or biological weapons ( CBW ) to cause mass casualties .


fn_spacy_tokens_for_baseline: Labour Members know that , whatever they may bray and shout in here , the public outside distrust them .

source_bert_toks: labour members know that , whatever they may bray and shout in here , the public outside distrust them .

reference_raw: Workers know that no matter how much they can brawl and scream, outside the public doesn't trust them.

reference_spacy_tokens: Workers know that no matter how much they can brawl and scream , outside the public does n't trust them .


fn_spacy_tokens_for_baseline: Draped in a red feather boa , she playfully cuddled her quintet of dancers , all of whom were dressed in Sailors outfits .

source_bert_toks: draped in a red feather bo ##a , she playfully cu ##ddled her quintet of dancers , all of whom were dressed in sailors outfits .

reference_raw: Dressed in a red feather boa, she playfully cuddled a blanket of dancers, all dressed in sailors' suits.

reference_spacy_tokens: Dressed in a red feather boa , she playfully cuddled a blanket of dancers , all dressed in sailors ' suits .


fn_spacy_tokens_for_baseline: This month sees the birth of a new bi - monthly publication for the hotel and catering industry ; one which more adequately reflects the new image of the HCIMA .

source_bert_toks: this month sees the birth of a new bi - monthly publication for the hotel and catering industry ; one which more adequately reflects the new image of the hc ##ima .

reference_raw: This month sees the birth of a new bimonthly publication for the hotel and catering industry, which better reflects the new image of HCIMA.

reference_spacy_tokens: This month sees the birth of a new bimonthly publication for the hotel and catering industry , which better reflects the new image of HCIMA .


fn_spacy_tokens_for_baseline: Macau , the final bastion of Portugal 's great 16th - century empire , is much more than just a quirk of history .

source_bert_toks: macau , the final bastion of portugal ' s great 16th - century empire , is much more than just a qui ##rk of history .

reference_raw: Macau, the last bastion of Portugal's great empire of the sixteenth-century, is far more than a quirk of history.

reference_spacy_tokens: Macau , the last bastion of Portugal 's great empire of the sixteenth - century , is far more than a quirk of history .


fn_spacy_tokens_for_baseline: If you are only going to take one form of supplement then desiccated liver should be your choice .

source_bert_toks: if you are only going to take one form of supplement then des ##ic ##cated liver should be your choice .

reference_raw: If you only take one form of supplement, then the dry liver should be your choice.

reference_spacy_tokens: If you only take one form of supplement , then the dry liver should be your choice .


fn_spacy_tokens_for_baseline: During the spring and autumn festivals , when people traditionally seek out the hilltops , the throngs are so large you would be better advised to try another time .

source_bert_toks: during the spring and autumn festivals , when people traditionally seek out the hilltop ##s , the th ##rong ##s are so large you would be better advised to try another time .

reference_raw: During the spring and autumn festivals, when people are traditional to look for hilltops, the crowds are so big that you'd be better advised to try again.

reference_spacy_tokens: During the spring and autumn festivals , when people are traditional to look for hilltops , the crowds are so big that you 'd be better advised to try again .


fn_spacy_tokens_for_baseline: The Bush administration has mounted a concerted campaign to get quick Congressional approval for the India - US nuclear deal , with the White House declaring it the president 's " top priority " amid a few contrary voices heard in the legislature .

source_bert_toks: the bush administration has mounted a concert ##ed campaign to get quick congressional approval for the india - us nuclear deal , with the white house declaring it the president ' s " top priority " amid a few contrary voices heard in the legislature .

reference_raw: The Bush administration launched a coordinated campaign to obtain rapid Congressional approval of the India-U.S. nuclear agreement, and the White House declared it the president's "top priority" among several opposite voices heard by the legislator.

reference_spacy_tokens: The Bush administration launched a coordinated campaign to obtain rapid Congressional approval of the India - U.S. nuclear agreement , and the White House declared it the president 's " top priority " among several opposite voices heard by the legislator .


fn_spacy_tokens_for_baseline: It 's still worth having your own cotton pique shirt with soft collar , a good satin bow - tie and even a black or deep red pleated cummerbund as the cost of hiring extras does mount up .

source_bert_toks: it ' s still worth having your own cotton pi ##que shirt with soft collar , a good satin bow - tie and even a black or deep red plea ##ted cum ##mer ##bund as the cost of hiring extras does mount up .

reference_raw: It's still worth having a cotton pique shirt with a soft collar, a good satin bow tie, and even a black or deep red pleated cummerbund as the price of renting extras increases.

reference_spacy_tokens: It 's still worth having a cotton pique shirt with a soft collar , a good satin bow tie , and even a black or deep red pleated cummerbund as the price of renting extras increases .


fn_spacy_tokens_for_baseline: This villain 's policy was to murder , on one pretext or another , every man who showed such promise that he might in time come to be a dangerous rival .

source_bert_toks: this villain ' s policy was to murder , on one pre ##text or another , every man who showed such promise that he might in time come to be a dangerous rival .

reference_raw: The evil man's policy was to kill, under one pretext or another, any man who had made such a promise that he might become a dangerous opponent in time.

reference_spacy_tokens: The evil man 's policy was to kill , under one pretext or another , any man who had made such a promise that he might become a dangerous opponent in time .


fn_spacy_tokens_for_baseline: I just said I 'd try to talk you into accepting what he 's decreed .

source_bert_toks: i just said i ' d try to talk you into accepting what he ' s decreed .

reference_raw: I said I'd try to convince you to accept his decision.

reference_spacy_tokens: I said I 'd try to convince you to accept his decision .


fn_spacy_tokens_for_baseline: Jesus said to the penitent thief , ' Today you will be with me in paradise ' ( Luke 23:43 ) .

source_bert_toks: jesus said to the pen ##ite ##nt thief , ' today you will be with me in paradise ' ( luke 23 : 43 ) .

reference_raw: Jesus told the repentant thief, "Today you'll be in paradise with me" (Luke 23:43).

reference_spacy_tokens: Jesus told the repentant thief , " Today you 'll be in paradise with me " ( Luke 23:43 ) .


fn_spacy_tokens_for_baseline: A key uncertainty is how ongoing military modernization efforts will ultimately reshape China 's strategic nuclear capabilities , but U.S. deployments of missile defenses are likely to be a key variable .

source_bert_toks: a key uncertainty is how ongoing military modernization efforts will ultimately res ##ha ##pe china ' s strategic nuclear capabilities , but u . s . deployment ##s of missile defenses are likely to be a key variable .

reference_raw: The main uncertainty is how the ongoing military modernisation efforts will ultimately transform China's strategic nuclear capabilities, but the US deployment of missile defense is likely to be a key variable.

reference_spacy_tokens: The main uncertainty is how the ongoing military modernisation efforts will ultimately transform China 's strategic nuclear capabilities , but the US deployment of missile defense is likely to be a key variable .


fn_spacy_tokens_for_baseline: According to International Atomic Energy Agency Director General Mohamed ElBaradei , who led a December 2003 inspection team to Libya , Libya 's nuclear weapons program is in the very initial stages , about three to seven years away from producing a nuclear weapon .

source_bert_toks: according to international atomic energy agency director general mohamed el ##bara ##de ##i , who led a december 2003 inspection team to libya , libya ' s nuclear weapons program is in the very initial stages , about three to seven years away from producing a nuclear weapon .

reference_raw: According to the Directorate-General of the International Atomic Energy Agency, Mohamed ElBaradei, who led an inspection team in December 2003 in Libya, the Libyan Nuclear Weapons Programme is in the first phase, which is about three to seven years from the production of a nuclear weapon.

reference_spacy_tokens: According to the Directorate - General of the International Atomic Energy Agency , Mohamed ElBaradei , who led an inspection team in December 2003 in Libya , the Libyan Nuclear Weapons Programme is in the first phase , which is about three to seven years from the production of a nuclear weapon .


fn_spacy_tokens_for_baseline: Isis set her elbows in the fur and rested her head on her hands while I spoke and tried not to stare at her full , hanging breasts .

source_bert_toks: isis set her elbows in the fur and rested her head on her hands while i spoke and tried not to stare at her full , hanging breasts .

reference_raw: Isis rested her elbows in her fur and rested her head on her hands as I spoke, trying not to look at her fully hanging breasts.

reference_spacy_tokens: Isis rested her elbows in her fur and rested her head on her hands as I spoke , trying not to look at her fully hanging breasts .


fn_spacy_tokens_for_baseline: If you can get up early enough , you can attend the pre - dawn auction held at the vast local wholesale fish market ; otherwise , have a look at the street market that goes on later in the day .

source_bert_toks: if you can get up early enough , you can attend the pre - dawn auction held at the vast local wholesale fish market ; otherwise , have a look at the street market that goes on later in the day .

reference_raw: If you can get up early enough, you can take part in a pre-dawn sale on a large local wholesale fish market; otherwise, look at the street market, which will take place later in the day.

reference_spacy_tokens: If you can get up early enough , you can take part in a pre - dawn sale on a large local wholesale fish market ; otherwise , look at the street market , which will take place later in the day .


fn_spacy_tokens_for_baseline: No student should be permitted to be graduated from elementary school without having mastered the 3 R 's at the level that prevailed 20 years ago .

source_bert_toks: no student should be permitted to be graduated from elementary school without having mastered the 3 r ' s at the level that prevailed 20 years ago .

reference_raw: No student should be allowed to graduate from primary school without having completed three R's at the level that prevailed 20 years ago.

reference_spacy_tokens: No student should be allowed to graduate from primary school without having completed three R 's at the level that prevailed 20 years ago .


fn_spacy_tokens_for_baseline: ' Come , come , ' said Baynes cheerily , ' I think better of the law than that .

source_bert_toks: ' come , come , ' said bay ##nes cheer ##ily , ' i think better of the law than that .

reference_raw: "Come on, let's go," Baynes said cheerfully, "I've got a better idea of the law.

reference_spacy_tokens: " Come on , let 's go , " Baynes said cheerfully , " I 've got a better idea of the law .


fn_spacy_tokens_for_baseline: However , sometimes it seems that the city produced artists of this stature by accident , even against its will .

source_bert_toks: however , sometimes it seems that the city produced artists of this stature by accident , even against its will .

reference_raw: Sometimes, however, the city seems to have created artists of this stature by chance, even against its will.

reference_spacy_tokens: Sometimes , however , the city seems to have created artists of this stature by chance , even against its will .


fn_spacy_tokens_for_baseline: Clive was a stupendous captain . '

source_bert_toks: clive was a stu ##pen ##dou ##s captain . '

reference_raw: Clive was a formidable captain.'

reference_spacy_tokens: Clive was a formidable captain . '


fn_spacy_tokens_for_baseline: A large number of Iran 's ballistic missiles and / or long - range artillery rocket systems currently possess the capability to deliver conventional high explosive , submunition , chemical , biological and radiological dispersion warheads .

source_bert_toks: a large number of iran ' s ballistic missiles and / or long - range artillery rocket systems currently possess the capability to deliver conventional high explosive , sub ##mun ##ition , chemical , biological and radio ##logical di ##sper ##sion war ##heads .

reference_raw: Many Iranian ballistic missiles and/or long-range artillery rocket systems currently have the capacity to deliver conventional high-explosive, submunition, chemical, biological and radiological dispersive warheads.

reference_spacy_tokens: Many Iranian ballistic missiles and/or long - range artillery rocket systems currently have the capacity to deliver conventional high - explosive , submunition , chemical , biological and radiological dispersive warheads .


fn_spacy_tokens_for_baseline: It was n't until a.d . 330 , however , when the newly converted Emperor Constantine made Byzantium , renamed Constantinople , capital of his Eastern Empire that Christianity was assured of its dominant role in future Greek life .

source_bert_toks: it wasn ' t until a . d . 330 , however , when the newly converted emperor constantine made by ##zan ##tium , renamed constantinople , capital of his eastern empire that christianity was assured of its dominant role in future greek life .

reference_raw: But it was not until April 330, when the newly converted Emperor Constantine created Byzantium and renamed Constantinople, the capital of the Eastern Empire, that Christianity was assured of its dominance in the future Greek life.

reference_spacy_tokens: But it was not until April 330 , when the newly converted Emperor Constantine created Byzantium and renamed Constantinople , the capital of the Eastern Empire , that Christianity was assured of its dominance in the future Greek life .


fn_spacy_tokens_for_baseline: A third approach might be a regional effort on the part of Arab states to pressure Iran to abandon sensitive technology and questionable activities in favor of a weapons - free zone in the Middle East .

source_bert_toks: a third approach might be a regional effort on the part of arab states to pressure iran to abandon sensitive technology and questionable activities in favor of a weapons - free zone in the middle east .

reference_raw: A third approach could be a regional effort by Arab countries to pressure Iran to abandon sensitive technologies and controversial activities in favour of a weapons-free zone in the Middle East.

reference_spacy_tokens: A third approach could be a regional effort by Arab countries to pressure Iran to abandon sensitive technologies and controversial activities in favour of a weapons - free zone in the Middle East .


fn_spacy_tokens_for_baseline: AKU 's Biomaterials Laboratory is the largest university laboratory fostering research in the area of synthesis , processing , and modification of materials for use in biological environments .

source_bert_toks: ak ##u ' s bio ##mate ##rial ##s laboratory is the largest university laboratory foster ##ing research in the area of synthesis , processing , and modification of materials for use in biological environments .

reference_raw: The AKU Biomaterials Laboratory is the largest university laboratory to support research in the field of synthetic, processing and modification of materials for use in biological environments.

reference_spacy_tokens: The AKU Biomaterials Laboratory is the largest university laboratory to support research in the field of synthetic , processing and modification of materials for use in biological environments .


fn_spacy_tokens_for_baseline: The man lowered his scarf , tucking it below his chin , causing Creed to flinch at the sight of the ravaged face now caught in the shine of the moon .

source_bert_toks: the man lowered his scarf , tucking it below his chin , causing creed to flinch at the sight of the ravaged face now caught in the shine of the moon .

reference_raw: The man dropped his scarf and tucked it under his chin, causing Creed to flinch at the sight of the ravaged face now caught in the moonlight.

reference_spacy_tokens: The man dropped his scarf and tucked it under his chin , causing Creed to flinch at the sight of the ravaged face now caught in the moonlight .


fn_spacy_tokens_for_baseline: She unbuckled the yellowlegs ' gunbelt , and cinched it around her hips .

source_bert_toks: she un ##buck ##led the yellow ##leg ##s ' gun ##belt , and ci ##nched it around her hips .

reference_raw: She unbuttoned the yellow-legged belt and wrapped it around her hips.

reference_spacy_tokens: She unbuttoned the yellow - legged belt and wrapped it around her hips .


fn_spacy_tokens_for_baseline: The next five chapters focus on the technical aspects of biological terrorism , including the biological agents of greatest concern ; the technical hurdles associated with their acquisition , production , and delivery ; historical cases of bioterrorism ; and approaches to the prevention and mitigation of bioterrorist incidents .

source_bert_toks: the next five chapters focus on the technical aspects of biological terrorism , including the biological agents of greatest concern ; the technical hurdles associated with their acquisition , production , and delivery ; historical cases of bio ##ter ##ror ##ism ; and approaches to the prevention and mit ##iga ##tion of bio ##ter ##ror ##ist incidents .

reference_raw: The next five chapters focus on the technical aspects of bio-terrorism, including biological agents of major concern; technical barriers related to their acquisition, production and delivery; historical cases of bio-terrorism; and approaches to the prevention and mitigation of bio-terrorism incidents.

reference_spacy_tokens: The next five chapters focus on the technical aspects of bio - terrorism , including biological agents of major concern ; technical barriers related to their acquisition , production and delivery ; historical cases of bio - terrorism ; and approaches to the prevention and mitigation of bio - terrorism incidents .


fn_spacy_tokens_for_baseline: This new tool has spurred many studies of acidification , and is being applied to other issues such as runaway algal growth and climate change .

source_bert_toks: this new tool has spurred many studies of acid ##ification , and is being applied to other issues such as runaway al ##gal growth and climate change .

reference_raw: This new instrument has prompted a number of studies on acidification and applies to other issues such as runaway algal growth and climate change.

reference_spacy_tokens: This new instrument has prompted a number of studies on acidification and applies to other issues such as runaway algal growth and climate change .


fn_spacy_tokens_for_baseline: i keep hoping to win the lotto for i can do all these things you know

source_bert_toks: i keep hoping to win the lot ##to for i can do all these things you know

reference_raw: I'm still hoping to get the lottery because I can do all the things you know.

reference_spacy_tokens: I 'm still hoping to get the lottery because I can do all the things you know .


fn_spacy_tokens_for_baseline: Despite protests by preservationists , there was little alternative .

source_bert_toks: despite protests by preservation ##ists , there was little alternative .

reference_raw: Despite the protests of the Preservatives, there was little choice.

reference_spacy_tokens: Despite the protests of the Preservatives , there was little choice .


fn_spacy_tokens_for_baseline: The most recent volume records almost 1,600 new research projects sponsored by 145 public and private institutions in thirty countries .

source_bert_toks: the most recent volume records almost 1 , 600 new research projects sponsored by 145 public and private institutions in thirty countries .

reference_raw: The latest volume shows nearly 1600 new research projects sponsored by 145 public and private institutes in 30 countries.

reference_spacy_tokens: The latest volume shows nearly 1600 new research projects sponsored by 145 public and private institutes in 30 countries .


fn_spacy_tokens_for_baseline: I bet my Gran would outdo any King 's Kid anyday !

source_bert_toks: i bet my gran would out ##do any king ' s kid any ##day !

reference_raw: I bet my grandmother could beat any King's Kid any day!

reference_spacy_tokens: I bet my grandmother could beat any King 's Kid any day !


fn_spacy_tokens_for_baseline: Aromatherapy ( massage with fragrant essential oils ) is not only sybaritic experience but can ease tension , improve circulation and release accumulated tensions .

source_bert_toks: aroma ##therapy ( massage with fra ##grant essential oils ) is not only sy ##bari ##tic experience but can ease tension , improve circulation and release accumulated tensions .

reference_raw: Aromatherapy (massage with scented basic oils) is not only a sybaric experience, but can also reduce tensions, improve circulation and release accumulated tensions.

reference_spacy_tokens: Aromatherapy ( massage with scented basic oils ) is not only a sybaric experience , but can also reduce tensions , improve circulation and release accumulated tensions .


fn_spacy_tokens_for_baseline: It covers two continents , concerns two groups of mysterious persons , and is further complicated by the highly respectable presence of our friend , Scott Eccles , whose inclusion shows me that the deceased Garcia had a scheming mind and a well - developed instinct of selfpreservation .

source_bert_toks: it covers two continents , concerns two groups of mysterious persons , and is further complicated by the highly respectable presence of our friend , scott ec ##cles , whose inclusion shows me that the deceased garcia had a sc ##hem ##ing mind and a well - developed instinct of self ##pres ##er ##vation .

reference_raw: It covers two continents, relates to two groups of mysterious people, and is further complicated by the highly respectable presence of our friend, Scott Eccles, whose inclusion shows me that the deceased Garcia had a scheming mind and a well-developed self-preservation instinct.

reference_spacy_tokens: It covers two continents , relates to two groups of mysterious people , and is further complicated by the highly respectable presence of our friend , Scott Eccles , whose inclusion shows me that the deceased Garcia had a scheming mind and a well - developed self - preservation instinct .


fn_spacy_tokens_for_baseline: Those whose fate was to die on some far foreign field could not have wanted a more peaceful , lovely graveyard .

source_bert_toks: those whose fate was to die on some far foreign field could not have wanted a more peaceful , lovely graveyard .

reference_raw: Those whose fate was to die in a distant, alien land couldn't want a more peaceful, beautiful cemetery.

reference_spacy_tokens: Those whose fate was to die in a distant , alien land could n't want a more peaceful , beautiful cemetery .


fn_spacy_tokens_for_baseline: Thus jus in bello turns out to have considerable implications for conduct in peace - time , including in time of crisis .

source_bert_toks: thus ju ##s in bell ##o turns out to have considerable implications for conduct in peace - time , including in time of crisis .

reference_raw: It thus appears that jus in bello has a significant impact on peace-time behaviour, even in times of crisis.

reference_spacy_tokens: It thus appears that jus in bello has a significant impact on peace - time behaviour , even in times of crisis .


fn_spacy_tokens_for_baseline: He had charred a good many slices of bread and sent several up in flames before he discovered this simple device .

source_bert_toks: he had charred a good many slices of bread and sent several up in flames before he discovered this simple device .

reference_raw: He burned a lot of bread and burned a few of it before he found this simple device.

reference_spacy_tokens: He burned a lot of bread and burned a few of it before he found this simple device .


fn_spacy_tokens_for_baseline: The curved and shadowed drive led us to a low , dark house , pitchblack against a slate - coloured sky .

source_bert_toks: the curved and shadowed drive led us to a low , dark house , pitch ##bla ##ck against a slate - coloured sky .

reference_raw: The curved and shadowed drive led us to a low, dark house, black against the slate-colored sky.

reference_spacy_tokens: The curved and shadowed drive led us to a low , dark house , black against the slate - colored sky .


fn_spacy_tokens_for_baseline: As soon as you 've birthed your child -- '

source_bert_toks: as soon as you ' ve birth ##ed your child - - '

reference_raw: Once you have a baby -- '

reference_spacy_tokens: Once you have a baby -- '


fn_spacy_tokens_for_baseline: Evidence to support this argument includes the July 4 North - South Joint Communiqui¿½ of 1972 ; the Agreement on Reconciliation , Nonaggression , and Exchanges and Cooperation between North and South Korea of 1991 ( the so - called " Basic Agreement " ) ; the Joint Declaration on the Denuclearization of the Korean Peninsula of 1991 ; the summit meeting of 2000 ; the Agreed Framework with the United States ; and reunification proposals that would recognize " two systems " for the north and south .

source_bert_toks: evidence to support this argument includes the july 4 north - south joint com ##mun ##iq ##ui ¿ ½ of 1972 ; the agreement on reconciliation , non ##ag ##gre ##ssion , and exchanges and cooperation between north and south korea of 1991 ( the so - called " basic agreement " ) ; the joint declaration on the den ##uc ##lea ##rization of the korean peninsula of 1991 ; the summit meeting of 2000 ; the agreed framework with the united states ; and reunification proposals that would recognize " two systems " for the north and south .

reference_raw: The evidence in support of this argument includes the July 4th North - South Common Communiqué 1/2 of 1972; the Agreement on Reconciliation, Non-aggression and Exchanges and Cooperation between North and South Korea in 1991 (So-called Basic Agreement); the Joint Declaration on Denuclearisation of the Korean Peninsula in 1991; the Summit in 2000; the Agreed Framework with the United States. and a reunification proposal that recognizes "two systems" in the north and south.

reference_spacy_tokens: The evidence in support of this argument includes the July 4th North - South Common Communique 1/2 of 1972 ; the Agreement on Reconciliation , Non - aggression and Exchanges and Cooperation between North and South Korea in 1991 ( So - called Basic Agreement ) ; the Joint Declaration on Denuclearisation of the Korean Peninsula in 1991 ; the Summit in 2000 ; the Agreed Framework with the United States . and a reunification proposal that recognizes " two systems " in the north and south .


fn_spacy_tokens_for_baseline: People would be auctioning off whole police stations under his nose

source_bert_toks: people would be auction ##ing off whole police stations under his nose

reference_raw: People would be bidding off entire police stations under his nose.

reference_spacy_tokens: People would be bidding off entire police stations under his nose .


fn_spacy_tokens_for_baseline: They may believe in apocalyptic prophecy and actively seek to bring about Armageddon , or the end of the world .

source_bert_toks: they may believe in apocalyptic prophecy and actively seek to bring about arm ##aged ##don , or the end of the world .

reference_raw: They may believe in apocalyptic prophecies and actively seek to bring Armageddon or the end of the world.

reference_spacy_tokens: They may believe in apocalyptic prophecies and actively seek to bring Armageddon or the end of the world .


fn_spacy_tokens_for_baseline: They are n't accepted everywhere , however .

source_bert_toks: they aren ' t accepted everywhere , however .

reference_raw: But they're not accepted anywhere.

reference_spacy_tokens: But they 're not accepted anywhere .


fn_spacy_tokens_for_baseline: " He 's been a fantastic ambassador for the game and still is . "

source_bert_toks: " he ' s been a fantastic ambassador for the game and still is . "

reference_raw: "He was the great envoy of the game, and he still is."

reference_spacy_tokens: " He was the great envoy of the game , and he still is . "


fn_spacy_tokens_for_baseline: Well how is she supposed to find out from you what her job is , tarot cards , reading the leaves in your empty tea cups , extra - sensory perception ?

source_bert_toks: well how is she supposed to find out from you what her job is , tar ##ot cards , reading the leaves in your empty tea cups , extra - sensory perception ?

reference_raw: How can she learn from you what she's doing, tarot cards, reading leaves in your empty cups of tea, extra-sensory insight?

reference_spacy_tokens: How can she learn from you what she 's doing , tarot cards , reading leaves in your empty cups of tea , extra - sensory insight ?


fn_spacy_tokens_for_baseline: Many garrisons had surrendered quickly because they knew they could rely on Saladin to keep his word to spare their lives .

source_bert_toks: many garrison ##s had surrendered quickly because they knew they could rely on salad ##in to keep his word to spare their lives .

reference_raw: Many of the crews gave up quickly, knowing that they could count on Saladin to keep his word and save their lives.

reference_spacy_tokens: Many of the crews gave up quickly , knowing that they could count on Saladin to keep his word and save their lives .


fn_spacy_tokens_for_baseline: The boy carved his initial , M , in his 14-year - old victim 's back .

source_bert_toks: the boy carved his initial , m , in his 14 - year - old victim ' s back .

reference_raw: The boy cut his initial, M, on the back of his 14-year-old victim.

reference_spacy_tokens: The boy cut his initial , M , on the back of his 14-year - old victim .


fn_spacy_tokens_for_baseline: A key turned in a lock , and as he passed in there was a curious scuffling noise from within .

source_bert_toks: a key turned in a lock , and as he passed in there was a curious sc ##uf ##fl ##ing noise from within .

reference_raw: The key swung in the lock, and there was a strange scuffling sound from the inside as he passed.

reference_spacy_tokens: The key swung in the lock , and there was a strange scuffling sound from the inside as he passed .


fn_spacy_tokens_for_baseline: Along the Liffey to the west is Temple Bar , center of nightlife and home to many of Dublin 's cutting - edge artists and artistic endeavors .

source_bert_toks: along the li ##ffey to the west is temple bar , center of night ##life and home to many of dublin ' s cutting - edge artists and artistic endeavors .

reference_raw: On the west side of the Liffey is the Temple Bar, the center of the nightlife and home to many of Dublin's top artists and artists.

reference_spacy_tokens: On the west side of the Liffey is the Temple Bar , the center of the nightlife and home to many of Dublin 's top artists and artists .


fn_spacy_tokens_for_baseline: ' The what ? ' shrilled Mary , stopping dead in her tracks .

source_bert_toks: ' the what ? ' shrill ##ed mary , stopping dead in her tracks .

reference_raw: 'What?' cried Mary, stopping dead in her tracks.

reference_spacy_tokens: ' What ? ' cried Mary , stopping dead in her tracks .


fn_spacy_tokens_for_baseline: Unknown My therapist told me the way to achieve true inner peace is to finish what I start .

source_bert_toks: unknown my therapist told me the way to achieve true inner peace is to finish what i start .

reference_raw: I don't know. My therapist told me that the way to achieve real inner peace is to finish what I started.

reference_spacy_tokens: I do n't know . My therapist told me that the way to achieve real inner peace is to finish what I started .


fn_spacy_tokens_for_baseline: Fifth , the theory may provide at least a partial reason for why ticket splitting has been particularly pronounced in the South .

source_bert_toks: fifth , the theory may provide at least a partial reason for why ticket splitting has been particularly pronounced in the south .

reference_raw: Fourthly, the theory may give at least a partial reason why the distribution of tickets is particularly pronounced in the South.

reference_spacy_tokens: Fourthly , the theory may give at least a partial reason why the distribution of tickets is particularly pronounced in the South .


fn_spacy_tokens_for_baseline: Clearing his throat noisily , Price perched a pair of gold - rimmed spectacles on his nose and announced he had received a letter from India .

source_bert_toks: clearing his throat no ##isi ##ly , price perched a pair of gold - rim ##med spectacle ##s on his nose and announced he had received a letter from india .

reference_raw: Price cleared his throat loudly, put a pair of gold-rimmed glasses on his nose, and announced that he had received a letter from India.

reference_spacy_tokens: Price cleared his throat loudly , put a pair of gold - rimmed glasses on his nose , and announced that he had received a letter from India .


fn_spacy_tokens_for_baseline: French marigolds find a place each year and gloriosa daisies make a splendid late display as well as being marvellous for cutting .

source_bert_toks: french mari ##gold ##s find a place each year and g ##lor ##ios ##a dai ##sies make a splendid late display as well as being marvel ##lous for cutting .

reference_raw: The French marigolds find a place every year, and the gloriosa daisies make a wonderfully late display, and they're wonderful for cutting.

reference_spacy_tokens: The French marigolds find a place every year , and the gloriosa daisies make a wonderfully late display , and they 're wonderful for cutting .


fn_spacy_tokens_for_baseline: There was a minute comforting sound in the soft clack as Nannie worried the laces apart like a gentle dog .

source_bert_toks: there was a minute comforting sound in the soft cl ##ack as nan ##nie worried the lace ##s apart like a gentle dog .

reference_raw: There was a small, soothing sound in the soft clatter as Nannie unraveled the laces like a gentle dog.

reference_spacy_tokens: There was a small , soothing sound in the soft clatter as Nannie unraveled the laces like a gentle dog .


fn_spacy_tokens_for_baseline: Dad , Jack and Charlie just wore a black armband each with their Sunday suits , and I was dressed in a white lace dress with a wide black sash of silk ribbon .

source_bert_toks: dad , jack and charlie just wore a black arm ##band each with their sunday suits , and i was dressed in a white lace dress with a wide black sash of silk ribbon .

reference_raw: Dad, Jack and Charlie were wearing a black belt each in Sunday suits, and I was wearing a white lace dress with a wide black sash of silk ribbon.

reference_spacy_tokens: Dad , Jack and Charlie were wearing a black belt each in Sunday suits , and I was wearing a white lace dress with a wide black sash of silk ribbon .


fn_spacy_tokens_for_baseline: She burrowed in her equipment carryall .

source_bert_toks: she burr ##owed in her equipment carry ##all .

reference_raw: She buried herself in her gearbox.

reference_spacy_tokens: She buried herself in her gearbox .


fn_spacy_tokens_for_baseline: While many gambling halls opened Downtown in the 1930s and early 1940s , only two were built on the stretch of old Los Angeles Highway that ultimately became the Strip .

source_bert_toks: while many gambling halls opened downtown in the 1930s and early 1940s , only two were built on the stretch of old los angeles highway that ultimately became the strip .

reference_raw: While many gambling halls opened in the 1930s and early 1940s, only two of them were built on the stretch of the old Los Angeles Highway, which eventually became the Strip.

reference_spacy_tokens: While many gambling halls opened in the 1930s and early 1940s , only two of them were built on the stretch of the old Los Angeles Highway , which eventually became the Strip .


fn_spacy_tokens_for_baseline: As a result of a cease - fire agreement in early June , the first " War of the Cities " came to an end and neither side is reported to have launched any missiles for the remainder of the year .

source_bert_toks: as a result of a cease - fire agreement in early june , the first " war of the cities " came to an end and neither side is reported to have launched any missiles for the remainder of the year .

reference_raw: As a result of the cease-fire agreement at the beginning of June, the first "War of the Cities" came to an end, and neither side is reported to have launched missiles for the rest of the year.

reference_spacy_tokens: As a result of the cease - fire agreement at the beginning of June , the first " War of the Cities " came to an end , and neither side is reported to have launched missiles for the rest of the year .


fn_spacy_tokens_for_baseline: Oban was a different kind of noise and fat bare - armed people wearing far too much white and doing nothing but staring .

source_bert_toks: ob ##an was a different kind of noise and fat bare - armed people wearing far too much white and doing nothing but staring .

reference_raw: Oban was a different kind of noise, and the fat, naked-armed people in too much white, doing nothing but stare.

reference_spacy_tokens: Oban was a different kind of noise , and the fat , naked - armed people in too much white , doing nothing but stare .


fn_spacy_tokens_for_baseline: The Duke did all he could to track down the miscreants , using his great wealth to bribe informers .

source_bert_toks: the duke did all he could to track down the mis ##cre ##ants , using his great wealth to bribe inform ##ers .

reference_raw: The Duke had done his best to find the criminals, using his great wealth to bribe informers.

reference_spacy_tokens: The Duke had done his best to find the criminals , using his great wealth to bribe informers .


fn_spacy_tokens_for_baseline: The earliest name associated with the city , Ur usalim , perhaps meant " city of Shalim " or " founded by Shalim . "

source_bert_toks: the earliest name associated with the city , ur usa ##lim , perhaps meant " city of sha ##lim " or " founded by sha ##lim . "

reference_raw: The first name associated with the city, Ur usalim, may have been "the city of Shalim" or "founded by Shalim."

reference_spacy_tokens: The first name associated with the city , Ur usalim , may have been " the city of Shalim " or " founded by Shalim . "


fn_spacy_tokens_for_baseline: The new dock was 230 metres long , 92 metres broad with an entrance 18.3 metres wide .

source_bert_toks: the new dock was 230 metres long , 92 metres broad with an entrance 18 . 3 metres wide .

reference_raw: The new dock was 230 meters long, 92 meters wide and 18.3 meters wide.

reference_spacy_tokens: The new dock was 230 meters long , 92 meters wide and 18.3 meters wide .


fn_spacy_tokens_for_baseline: There is limited open - source information available concerning Iran 's chemical weapons program .

source_bert_toks: there is limited open - source information available concerning iran ' s chemical weapons program .

reference_raw: There is limited openness - available source information on the chemical weapons programme of Iran.

reference_spacy_tokens: There is limited openness - available source information on the chemical weapons programme of Iran .


fn_spacy_tokens_for_baseline: Perhaps you could hasten a prediction of where this is all going .

source_bert_toks: perhaps you could haste ##n a prediction of where this is all going .

reference_raw: Maybe you can speed up a forecast of where all this is going.

reference_spacy_tokens: Maybe you can speed up a forecast of where all this is going .


fn_spacy_tokens_for_baseline: THE black Democratic candidate for Virginia state governor , Mr Douglas Wilder , was heading for an historic victory last night , writes Simon Tisdall in Richmond , Virginia .

source_bert_toks: the black democratic candidate for virginia state governor , mr douglas wilder , was heading for an historic victory last night , writes simon tis ##dal ##l in richmond , virginia .

reference_raw: The black Democratic candidate for the state governor of Virginia, Mr. Douglas Wilder, was on his way to a historical victory last night, writing Simon Tisdall in Richmond, Virginia.

reference_spacy_tokens: The black Democratic candidate for the state governor of Virginia , Mr. Douglas Wilder , was on his way to a historical victory last night , writing Simon Tisdall in Richmond , Virginia .


fn_spacy_tokens_for_baseline: But he could not forestall a major parliamentary outcry on the news of McGregor 's appointment .

source_bert_toks: but he could not forest ##all a major parliamentary out ##cr ##y on the news of mcgregor ' s appointment .

reference_raw: But on the news of McGregor's appointment, he couldn't predict a major parliamentary outburst.

reference_spacy_tokens: But on the news of McGregor 's appointment , he could n't predict a major parliamentary outburst .


fn_spacy_tokens_for_baseline: Your contribution to Goodwill will mean more than you may know .

source_bert_toks: your contribution to goodwill will mean more than you may know .

reference_raw: Your contribution to Goodwill will be more than you know.

reference_spacy_tokens: Your contribution to Goodwill will be more than you know .


fn_spacy_tokens_for_baseline: it is nice he matter of fact he was here today it was the first really warm weather we 've had and he came out and cut the yard and trimmed the hedges and all that

source_bert_toks: it is nice he matter of fact he was here today it was the first really warm weather we ' ve had and he came out and cut the yard and trimmed the hedges and all that

reference_raw: It's nice that he's actually here today, it's our first really hot weather, and he comes out and cuts the yard and cuts the hedges and everything.

reference_spacy_tokens: It 's nice that he 's actually here today , it 's our first really hot weather , and he comes out and cuts the yard and cuts the hedges and everything .


fn_spacy_tokens_for_baseline: Attachment of HT-29 cells to type IV collagen was increased by treatment with DMJ .

source_bert_toks: attachment of h ##t - 29 cells to type iv col ##lage ##n was increased by treatment with d ##m ##j .

reference_raw: The addition of HT-29 cells to IV collagen was increased with DMJ therapy.

reference_spacy_tokens: The addition of HT-29 cells to IV collagen was increased with DMJ therapy .


fn_spacy_tokens_for_baseline: While it 's no longer the bargain shopping destination it once was , there are still some good buys to be had .

source_bert_toks: while it ' s no longer the bargain shopping destination it once was , there are still some good buys to be had .

reference_raw: Although it is no longer the bargain-shop destination it used to be, there are still some good purchases to be made.

reference_spacy_tokens: Although it is no longer the bargain - shop destination it used to be , there are still some good purchases to be made .


fn_spacy_tokens_for_baseline: Well , better get some shut - eye .

source_bert_toks: well , better get some shut - eye .

reference_raw: Well, you better close your eyes.

reference_spacy_tokens: Well , you better close your eyes .


fn_spacy_tokens_for_baseline: Mr Nellis pulled his friend towards a water supply and doused the fire .

source_bert_toks: mr nell ##is pulled his friend towards a water supply and do ##used the fire .

reference_raw: Mr. Nellis dragged his friend to the water supply and doubled the fire.

reference_spacy_tokens: Mr. Nellis dragged his friend to the water supply and doubled the fire .


fn_spacy_tokens_for_baseline: Then she ran from the cloakroom , down the narrow dark passage and out into the night .

source_bert_toks: then she ran from the cloak ##room , down the narrow dark passage and out into the night .

reference_raw: Then she ran out of the camouflage, down a narrow, dark corridor, and out into the night.

reference_spacy_tokens: Then she ran out of the camouflage , down a narrow , dark corridor , and out into the night .


fn_spacy_tokens_for_baseline: Drop a spot of highly volatile liquid on such a wing and the colours disappear as the liquid occludes the physical structure , only to reappear as it evaporates and the light is splintered once more .

source_bert_toks: drop a spot of highly volatile liquid on such a wing and the colours disappear as the liquid o ##cc ##lu ##des the physical structure , only to re ##app ##ear as it eva ##por ##ates and the light is splinter ##ed once more .

reference_raw: Drop a spot of highly volatile fluid on this wing, and the color disappears as the liquid overtakes the physical structure, only to reappear as it evaporates and the light splits again.

reference_spacy_tokens: Drop a spot of highly volatile fluid on this wing , and the color disappears as the liquid overtakes the physical structure , only to reappear as it evaporates and the light splits again .


fn_spacy_tokens_for_baseline: Gefter and other activists said the Feb. 6 arrest of Alexander Nikitin was just the latest evidence of the government 's growing vexation with dissent .

source_bert_toks: ge ##ft ##er and other activists said the feb . 6 arrest of alexander nik ##iti ##n was just the latest evidence of the government ' s growing ve ##xa ##tion with dissent .

reference_raw: Gefter and other activists said that the arrest of Alexander Nikitin in Feb 6 was only the latest evidence of the government's growing vehemence with dissent.

reference_spacy_tokens: Gefter and other activists said that the arrest of Alexander Nikitin in Feb 6 was only the latest evidence of the government 's growing vehemence with dissent .


fn_spacy_tokens_for_baseline: But her fans -- the primarily female , vaguely cerebral , post - boomer listeners like me who made her band Hole 's album Live Through This go platinum ( that is , sell 1 million copies ) -- admired Courtney in the face of evidence that she was something of a trial .

source_bert_toks: but her fans - - the primarily female , vaguely cerebral , post - boom ##er listeners like me who made her band hole ' s album live through this go platinum ( that is , sell 1 million copies ) - - admired courtney in the face of evidence that she was something of a trial .

reference_raw: But her fans, the most feminine, vaguely brainy, post-boomer listeners like me, who made her band Hole's album Live Through This Go Platinum (i.e., sell a million copies), admired Courtney in the light of the evidence that she was a court of law.

reference_spacy_tokens: But her fans , the most feminine , vaguely brainy , post - boomer listeners like me , who made her band Hole 's album Live Through This Go Platinum ( i.e. , sell a million copies ) , admired Courtney in the light of the evidence that she was a court of law .


fn_spacy_tokens_for_baseline: In Phase Two , air strikes and Special Operations attacks would hit key al Qaeda and Taliban targets .

source_bert_toks: in phase two , air strikes and special operations attacks would hit key al qaeda and taliban targets .

reference_raw: In phase two, the main objectives of Al Qaeda and the Taliban would be affected by air strikes and Special Operations attacks.

reference_spacy_tokens: In phase two , the main objectives of Al Qaeda and the Taliban would be affected by air strikes and Special Operations attacks .


fn_spacy_tokens_for_baseline: Several times Lawrence and colleagues accentuate the damaging effect of treatment on patients with cancer of the prostate .

source_bert_toks: several times lawrence and colleagues accent ##uate the damaging effect of treatment on patients with cancer of the prostate .

reference_raw: Lawrence and his colleagues have repeatedly highlighted the harmful effect of treatment on prostate cancer patients.

reference_spacy_tokens: Lawrence and his colleagues have repeatedly highlighted the harmful effect of treatment on prostate cancer patients .


fn_spacy_tokens_for_baseline: Mr. Barco has refused U.S. troops or advisers but has accepted U.S. military aid .

source_bert_toks: mr . bar ##co has refused u . s . troops or advisers but has accepted u . s . military aid .

reference_raw: Mr. Barco refused U.S. soldiers or advisers, but received US military assistance.

reference_spacy_tokens: Mr. Barco refused U.S. soldiers or advisers , but received US military assistance .


fn_spacy_tokens_for_baseline: Because clients might not have accepted his African name , he worked under the pseudonym of Peter Mackenzie .

source_bert_toks: because clients might not have accepted his african name , he worked under the pseudonym of peter mackenzie .

reference_raw: Since his clients might not accept his African name, he worked under Peter Mackenzie's alias.

reference_spacy_tokens: Since his clients might not accept his African name , he worked under Peter Mackenzie 's alias .


fn_spacy_tokens_for_baseline: ' The b - baby , ' he stuttered , trying to resist .

source_bert_toks: ' the b - baby , ' he stu ##ttered , trying to resist .

reference_raw: "B-Baby," he stammered, trying to resist.

reference_spacy_tokens: " B - Baby , " he stammered , trying to resist .


fn_spacy_tokens_for_baseline: As a result , I have drafted a document which I am hoping to publish and circulate widely .

source_bert_toks: as a result , i have drafted a document which i am hoping to publish and ci ##rc ##ulate widely .

reference_raw: As a result, I have drawn up a document that I hope to publish and circulate widely.

reference_spacy_tokens: As a result , I have drawn up a document that I hope to publish and circulate widely .


fn_spacy_tokens_for_baseline: It appears that the blood - curdling nature of the vows made little impression on them .

source_bert_toks: it appears that the blood - cu ##rd ##ling nature of the vows made little impression on them .

reference_raw: The blood-curling nature of the vows seemed to have little effect on them.

reference_spacy_tokens: The blood - curling nature of the vows seemed to have little effect on them .


fn_spacy_tokens_for_baseline: The German professor was a powerful figure , hiring and firing his assistants and doing his best to place his favourite students , though by the end of the century this was becoming more difficult .

source_bert_toks: the german professor was a powerful figure , hiring and firing his assistants and doing his best to place his favourite students , though by the end of the century this was becoming more difficult .

reference_raw: The German professor was a strong man, hiring and releasing his assistants, and doing his best to place his favorite students, though by the end of the century it had become more difficult.

reference_spacy_tokens: The German professor was a strong man , hiring and releasing his assistants , and doing his best to place his favorite students , though by the end of the century it had become more difficult .


fn_spacy_tokens_for_baseline: Markby cupped his hands round the tumbler of tawny liquid .

source_bert_toks: mark ##by cupped his hands round the tumble ##r of ta ##wny liquid .

reference_raw: Markby wrapped his hands around a tumble of tawny liquid.

reference_spacy_tokens: Markby wrapped his hands around a tumble of tawny liquid .


fn_spacy_tokens_for_baseline: ' Perhaps I am atoning for my misspent youth , ' he replied amiably .

source_bert_toks: ' perhaps i am at ##oning for my miss ##pen ##t youth , ' he replied ami ##ably .

reference_raw: "Maybe I'm apologizing for my lack of youth," he said pleasantly.

reference_spacy_tokens: " Maybe I 'm apologizing for my lack of youth , " he said pleasantly .


fn_spacy_tokens_for_baseline: I was merely surprised to note that someone who professes to take such a high moral stance should be cavorting freely with a married woman .

source_bert_toks: i was merely surprised to note that someone who prof ##esses to take such a high moral stance should be ca ##vor ##ting freely with a married woman .

reference_raw: I was just surprised to notice that someone who says he has such a high moral attitude should be free to engage with a married woman.

reference_spacy_tokens: I was just surprised to notice that someone who says he has such a high moral attitude should be free to engage with a married woman .


fn_spacy_tokens_for_baseline: She quotes three surveys from the USA and Ireland which recorded similar rates of observed shoplifting in male and female shopp ers ( Mayhew , 1977 ) .

source_bert_toks: she quotes three surveys from the usa and ireland which recorded similar rates of observed shop ##lifting in male and female shop ##p er ##s ( may ##he ##w , 1977 ) .

reference_raw: It quotes three surveys from the United States and Ireland, which recorded similar rates of robbery observed in male and female shoppers (Mayhew, 1977).

reference_spacy_tokens: It quotes three surveys from the United States and Ireland , which recorded similar rates of robbery observed in male and female shoppers ( Mayhew , 1977 ) .


fn_spacy_tokens_for_baseline: He had to hunch over the wheel to see anything .

source_bert_toks: he had to hu ##nch over the wheel to see anything .

reference_raw: He must have crouched over the wheel to see something.

reference_spacy_tokens: He must have crouched over the wheel to see something .


fn_spacy_tokens_for_baseline: Sir Thomas was sprawled on his bed , a cup of poison on the table beside him .

source_bert_toks: sir thomas was sprawled on his bed , a cup of poison on the table beside him .

reference_raw: Sir Thomas lay on his bed, a cup of poison on the table beside him.

reference_spacy_tokens: Sir Thomas lay on his bed , a cup of poison on the table beside him .


fn_spacy_tokens_for_baseline: That year was the high point of the concentration of marital fertility on first and second births .

source_bert_toks: that year was the high point of the concentration of marital fertility on first and second births .

reference_raw: This year was the highest concentration of marital fertility in the first and second births.

reference_spacy_tokens: This year was the highest concentration of marital fertility in the first and second births .


fn_spacy_tokens_for_baseline: 2- Disputes related to AL - QAEDA missions between member brethren should be judged by qualified personnel , which is carried out by the immediate commander ( Amir ) of the conflicting parties .

source_bert_toks: 2 - disputes related to al - qaeda missions between member brethren should be judged by qualified personnel , which is carried out by the immediate commander ( amir ) of the conflicting parties .

reference_raw: 2-Disputes concerning AL-QAEDA missions between brothers should be assessed by qualified personnel, carried out by the immediate commander (Amir) of the opposing parties.

reference_spacy_tokens: 2-Disputes concerning AL - QAEDA missions between brothers should be assessed by qualified personnel , carried out by the immediate commander ( Amir ) of the opposing parties .


fn_spacy_tokens_for_baseline: Black Hawk helicopters landed outside Lujan 's camp .

source_bert_toks: black hawk helicopters landed outside lu ##jan ' s camp .

reference_raw: The Black Hawk helicopters arrived in front of Lujan's encampment.

reference_spacy_tokens: The Black Hawk helicopters arrived in front of Lujan 's encampment .


fn_spacy_tokens_for_baseline: The faint moonlight glinted on the barrels of the guns most of them were carrying .

source_bert_toks: the faint moonlight glint ##ed on the barrels of the guns most of them were carrying .

reference_raw: The faint moonlight gleamed on the barrels of the pistols most of them carried.

reference_spacy_tokens: The faint moonlight gleamed on the barrels of the pistols most of them carried .


fn_spacy_tokens_for_baseline: Dublin is an intimate city , physically small but tightly packed , a perfect place for walking .

source_bert_toks: dublin is an intimate city , physically small but tightly packed , a perfect place for walking .

reference_raw: Dublin is a private town, physically small but tightly packed, an ideal place to walk.

reference_spacy_tokens: Dublin is a private town , physically small but tightly packed , an ideal place to walk .


fn_spacy_tokens_for_baseline: Chemical warfare ( CW ) agents are non - living , manufactured chemicals that are highly toxic and can enter the body through the lungs or the skin .

source_bert_toks: chemical warfare ( cw ) agents are non - living , manufactured chemicals that are highly toxic and can enter the body through the lungs or the skin .

reference_raw: Chemical warfare agents are non-life-producing chemicals that are highly toxic and can enter the body through the lungs or the skin.

reference_spacy_tokens: Chemical warfare agents are non - life - producing chemicals that are highly toxic and can enter the body through the lungs or the skin .


fn_spacy_tokens_for_baseline: In terms of property damage , this fire is the worst since the Bel Air fire in 1961 .

source_bert_toks: in terms of property damage , this fire is the worst since the bel air fire in 1961 .

reference_raw: As far as property loss is concerned, this fire has been the worst since the fire in Bel Air in 1961.

reference_spacy_tokens: As far as property loss is concerned , this fire has been the worst since the fire in Bel Air in 1961 .


fn_spacy_tokens_for_baseline: Short of declaring Iran in violation of the NPT , the IAEA Director - General Mohamed ElBaradei stated , " Iran has failed to meet its obligations under its Safeguards Agreement " and criticized Iran for not being transparent with the construction of its nuclear - related facilities and import of nuclear material .

source_bert_toks: short of declaring iran in violation of the np ##t , the ia ##ea director - general mohamed el ##bara ##de ##i stated , " iran has failed to meet its obligations under its safeguard ##s agreement " and criticized iran for not being transparent with the construction of its nuclear - related facilities and import of nuclear material .

reference_raw: Shortly before declaring Iran to be in breach of the NPT, the Director of the International Atomic Energy Agency - General Mohamed ElBaradei said, "Iran has failed to comply with its commitments under the Safeguards Agreement" and criticized Iran for not being transparent about the construction of its nuclear-related equipment and the import of nuclear material.

reference_spacy_tokens: Shortly before declaring Iran to be in breach of the NPT , the Director of the International Atomic Energy Agency - General Mohamed ElBaradei said , " Iran has failed to comply with its commitments under the Safeguards Agreement " and criticized Iran for not being transparent about the construction of its nuclear - related equipment and the import of nuclear material .


fn_spacy_tokens_for_baseline: This makes working at the chemical weapons destruction facility in Anniston one of the safest places in the nation to work , according to statistics from the National Safety Council . ( U.S. Army Chemical Materials Agency , 23Jun06 , Washington Group International ) ( Link )

source_bert_toks: this makes working at the chemical weapons destruction facility in ann ##isto ##n one of the safe ##st places in the nation to work , according to statistics from the national safety council . ( u . s . army chemical materials agency , 23 ##jun ##0 ##6 , washington group international ) ( link )

reference_raw: According to statistics from the National Security Council (U.S. Army Chemical Materials Agency, 23 June 2006, Washington Group International) (Link), working at the Chemical Weapons Destruction Facility in Anniston is one of the safest places in the country to work.

reference_spacy_tokens: According to statistics from the National Security Council ( U.S. Army Chemical Materials Agency , 23 June 2006 , Washington Group International ) ( Link ) , working at the Chemical Weapons Destruction Facility in Anniston is one of the safest places in the country to work .


fn_spacy_tokens_for_baseline: Additionally , a handful of resorts -- such as the South - Seas themed Mandalay Bay , the Mirage , and the new Four Seasons -- are now catering exclusively to the luxury travel market .

source_bert_toks: additionally , a handful of resorts - - such as the south - seas themed mandal ##ay bay , the mirage , and the new four seasons - - are now catering exclusively to the luxury travel market .

reference_raw: Moreover, a few resorts - like the South Seas themed Mandalay Bay, Mirage, and the new Four Seasons - now cater exclusively for the luxury travel market.

reference_spacy_tokens: Moreover , a few resorts - like the South Seas themed Mandalay Bay , Mirage , and the new Four Seasons - now cater exclusively for the luxury travel market .


fn_spacy_tokens_for_baseline: A hog in a headscarf squealed as she cleaved its skull with her axe .

source_bert_toks: a hog in a heads ##car ##f squealed as she cl ##ea ##ved its skull with her axe .

reference_raw: A pig in a scarf squealed as she cut his skull with an axe.

reference_spacy_tokens: A pig in a scarf squealed as she cut his skull with an axe .


fn_spacy_tokens_for_baseline: Now I I 've been selling hairpieces for twenty three years so I 'm probably better in a better position than anybody here to explain the emotions of men who 're losing their hair .

source_bert_toks: now i i ' ve been selling hair ##piece ##s for twenty three years so i ' m probably better in a better position than anybody here to explain the emotions of men who ' re losing their hair .

reference_raw: I've been selling hairdressers for twenty-three years now, so I'm probably in a better position than anyone here to explain the feelings of people who lose their hair.

reference_spacy_tokens: I 've been selling hairdressers for twenty - three years now , so I 'm probably in a better position than anyone here to explain the feelings of people who lose their hair .


fn_spacy_tokens_for_baseline: A London born terrorist has today been jailed for six months in Amsterdam on arms offences .

source_bert_toks: a london born terrorist has today been jailed for six months in amsterdam on arms offences .

reference_raw: A London-born terrorist was arrested for six months in Amsterdam for arms crimes.

reference_spacy_tokens: A London - born terrorist was arrested for six months in Amsterdam for arms crimes .


fn_spacy_tokens_for_baseline: All sea salts are produced in shallow beds where salt is deposited by the ebbing tide and most of the remaining moisture is evaporated by sun and wind .

source_bert_toks: all sea salts are produced in shallow beds where salt is deposited by the e ##bbing tide and most of the remaining moisture is eva ##por ##ated by sun and wind .

reference_raw: All sea salts are produced in shallow beds where the salt is deposited in the ebbing tide and most of the remaining moisture is vaporized by the sun and the wind.

reference_spacy_tokens: All sea salts are produced in shallow beds where the salt is deposited in the ebbing tide and most of the remaining moisture is vaporized by the sun and the wind .


fn_spacy_tokens_for_baseline: The problem with mercury was that the curative dose was much too close to the lethal dose , and it was easy to make the patient worse as a result of treatment .

source_bert_toks: the problem with mercury was that the cu ##rative dose was much too close to the lethal dose , and it was easy to make the patient worse as a result of treatment .

reference_raw: The problem with mercury was that the therapeutic dose was too close to the lethal dose, and it was easy to make the patient worse as a result of treatment.

reference_spacy_tokens: The problem with mercury was that the therapeutic dose was too close to the lethal dose , and it was easy to make the patient worse as a result of treatment .


fn_spacy_tokens_for_baseline: You might be excused for thinking , at first sight , that the lamprey is a true fish .

source_bert_toks: you might be excused for thinking , at first sight , that the lamp ##rey is a true fish .

reference_raw: You may be forgiven for thinking, at first sight, that the lamprey is a real fish.

reference_spacy_tokens: You may be forgiven for thinking , at first sight , that the lamprey is a real fish .


fn_spacy_tokens_for_baseline: Freezing fog shrouded a horrific trail of carnage on Britain 's roads , with hundreds of people maimed .

source_bert_toks: freezing fog sh ##roud ##ed a horrific trail of carnage on britain ' s roads , with hundreds of people mai ##med .

reference_raw: The freezing mist covered a terrible trail of bloodshed on British roads, and hundreds of people were mutilated.

reference_spacy_tokens: The freezing mist covered a terrible trail of bloodshed on British roads , and hundreds of people were mutilated .


fn_spacy_tokens_for_baseline: In three successive general election campaigns , the Conservative party has promised higher standards in education .

source_bert_toks: in three successive general election campaigns , the conservative party has promised higher standards in education .

reference_raw: The Conservative Party has promised higher education standards in three consecutive general election campaigns.

reference_spacy_tokens: The Conservative Party has promised higher education standards in three consecutive general election campaigns .


fn_spacy_tokens_for_baseline: It is always possible to fashion a principle to fit the argument of the moment .

source_bert_toks: it is always possible to fashion a principle to fit the argument of the moment .

reference_raw: It's always possible to create a principle that fits the current argument.

reference_spacy_tokens: It 's always possible to create a principle that fits the current argument .


fn_spacy_tokens_for_baseline: HMS Sheffield , like most of the Royal Navy 's other modern warships , carried a set of equipment code - named Abbey Hill .

source_bert_toks: hms sheffield , like most of the royal navy ' s other modern warships , carried a set of equipment code - named abbey hill .

reference_raw: Like most of the Royal Navy's modern warships, HMS Sheffield had a set of equipment coded as Abbey Hill.

reference_spacy_tokens: Like most of the Royal Navy 's modern warships , HMS Sheffield had a set of equipment coded as Abbey Hill .


fn_spacy_tokens_for_baseline: is the outer husk of the nutmeg and has a strong but fragrant flavour .

source_bert_toks: is the outer hu ##sk of the nut ##me ##g and has a strong but fra ##grant flavour .

reference_raw: is the outer shell of the nutmeg and has a strong but aromatic taste.

reference_spacy_tokens: is the outer shell of the nutmeg and has a strong but aromatic taste .


fn_spacy_tokens_for_baseline: It was the first report of an improvement in Mandela 's condition since he was admitted to a hospital in Pretoria early Saturday after suffering a recurrence of a persistent lung ailment , a legacy of the tuberculosis he contracted during the 27 years he was imprisoned for opposing apartheid .

source_bert_toks: it was the first report of an improvement in mandela ' s condition since he was admitted to a hospital in pretoria early saturday after suffering a rec ##ur ##rence of a persistent lung ai ##lm ##ent , a legacy of the tuberculosis he contracted during the 27 years he was imprisoned for opposing apartheid .

reference_raw: It was the first report of an improvement in Mandela's condition since he had been admitted to a hospital in Pretoria at the beginning of Saturday after he had suffered a recurrence of persistent lung disease, a reference to the tuberculosis he had contracted during the 27 years he had been arrested for opposition to apartheid.

reference_spacy_tokens: It was the first report of an improvement in Mandela 's condition since he had been admitted to a hospital in Pretoria at the beginning of Saturday after he had suffered a recurrence of persistent lung disease , a reference to the tuberculosis he had contracted during the 27 years he had been arrested for opposition to apartheid .


fn_spacy_tokens_for_baseline: After Maureen 's job coach taught her how to do her job in a restaurant , we helped Maureen step out of the shadow sometimes cast over people with physical and mental disabilities and find a fulfilling job smack dab in the middle of society .

source_bert_toks: after maureen ' s job coach taught her how to do her job in a restaurant , we helped maureen step out of the shadow sometimes cast over people with physical and mental disabilities and find a fulfilling job smack da ##b in the middle of society .

reference_raw: After Maureen's job coach taught her how to do her job at the restaurant, we helped Maureen get out of the shadows, sometimes casting people with physical and mental disabilities, and finding a full-fledged job slap in the middle of the company.

reference_spacy_tokens: After Maureen 's job coach taught her how to do her job at the restaurant , we helped Maureen get out of the shadows , sometimes casting people with physical and mental disabilities , and finding a full - fledged job slap in the middle of the company .


fn_spacy_tokens_for_baseline: 4- The married Mujahed and his family qualify for round trip tickets to their country of origin after two years , and one month vacation .

source_bert_toks: 4 - the married mu ##jah ##ed and his family qualify for round trip tickets to their country of origin after two years , and one month vacation .

reference_raw: 4-A married Mujahed and his family are entitled to a round trip to their home country after two years and a month's holiday.

reference_spacy_tokens: 4-A married Mujahed and his family are entitled to a round trip to their home country after two years and a month 's holiday .


fn_spacy_tokens_for_baseline: The attackers were environmental terrorists upset about a new industry coming to town .

source_bert_toks: the attackers were environmental terrorists upset about a new industry coming to town .

reference_raw: The assailants were environmental terrorists who were upset by the arrival of a new industry in the city.

reference_spacy_tokens: The assailants were environmental terrorists who were upset by the arrival of a new industry in the city .


fn_spacy_tokens_for_baseline: Concurrently , the United States along with some other IAEA board members has continued to maintain that Iran is pursuing an underground nuclear weapons program .

source_bert_toks: concurrently , the united states along with some other ia ##ea board members has continued to maintain that iran is pursuing an underground nuclear weapons program .

reference_raw: At the same time, the United States and some other members of the IAEA Council continue to argue that Iran is pursuing an underground nuclear-weapon program.

reference_spacy_tokens: At the same time , the United States and some other members of the IAEA Council continue to argue that Iran is pursuing an underground nuclear - weapon program .


fn_spacy_tokens_for_baseline: By lending credence to the Lewinsky charges , and treating Clinton 's familiar defenses as the lies and half - lies they seem to be , Stephanopoulos shows he 's not a fool .

source_bert_toks: by lending cr ##ede ##nce to the lew ##insky charges , and treating clinton ' s familiar defenses as the lies and half - lies they seem to be , stephan ##op ##oulos shows he ' s not a fool .

reference_raw: By lending credibility to Lewinsky's accusations and treating Clinton's well-known defenses as lies and half-lies, Stephanopoulos proves that he is not a fool.

reference_spacy_tokens: By lending credibility to Lewinsky 's accusations and treating Clinton 's well - known defenses as lies and half - lies , Stephanopoulos proves that he is not a fool .


fn_spacy_tokens_for_baseline: Ace extracted a black cylinder from her backpack .

source_bert_toks: ace extracted a black cylinder from her backpack .

reference_raw: Ace pulled a black cylinder out of her pack.

reference_spacy_tokens: Ace pulled a black cylinder out of her pack .


fn_spacy_tokens_for_baseline: A wry and comical early cynicism rapidly transforms into an overwhelming sense of sourness .

source_bert_toks: a wry and comical early cy ##nic ##ism rapidly transforms into an overwhelming sense of sour ##ness .

reference_raw: The bitter and comical early cynicism is rapidly becoming an overwhelming sense of bitterness.

reference_spacy_tokens: The bitter and comical early cynicism is rapidly becoming an overwhelming sense of bitterness .


fn_spacy_tokens_for_baseline: He did , and we set up a time to talk more .

source_bert_toks: he did , and we set up a time to talk more .

reference_raw: He did, and we've made time for more talk.

reference_spacy_tokens: He did , and we 've made time for more talk .


fn_spacy_tokens_for_baseline: Jay , however , is less forthcoming when it comes to defining exactly what it is he and his colleagues at Talkin ' Loud are looking for .

source_bert_toks: jay , however , is less forthcoming when it comes to defining exactly what it is he and his colleagues at talk ##in ' loud are looking for .

reference_raw: Jay, however, is less accommodating when it comes to defining exactly what he and his colleagues in Talking Loud are looking for.

reference_spacy_tokens: Jay , however , is less accommodating when it comes to defining exactly what he and his colleagues in Talking Loud are looking for .


fn_spacy_tokens_for_baseline: For all his accomplishments , Herod was nevertheless hated by his subjects ; he taxed , he tortured , and he ordered the massacre of male Jewish infants in an attempt to do away with the heralded Messiah .

source_bert_toks: for all his accomplishments , hero ##d was nevertheless hated by his subjects ; he tax ##ed , he tortured , and he ordered the massacre of male jewish infants in an attempt to do away with the herald ##ed messiah .

reference_raw: Despite his success, Herod was still hated by his people; he taxed, tortured, and ordered the slaughter of male Jewish children in an attempt to escape the heralded Messiah.

reference_spacy_tokens: Despite his success , Herod was still hated by his people ; he taxed , tortured , and ordered the slaughter of male Jewish children in an attempt to escape the heralded Messiah .


fn_spacy_tokens_for_baseline: Only two months later , the Korean Workers ' Party Central Committee adopted policies to strengthen the military and to implement import - substitution programs to reduce dependency on arms imports .

source_bert_toks: only two months later , the korean workers ' party central committee adopted policies to strengthen the military and to implement import - substitution programs to reduce dependency on arms imports .

reference_raw: Only two months later, the Central Committee of Korean Workers adopted policies to strengthen the military and implement import-replacement programs to reduce dependence on arms imports.

reference_spacy_tokens: Only two months later , the Central Committee of Korean Workers adopted policies to strengthen the military and implement import - replacement programs to reduce dependence on arms imports .


fn_spacy_tokens_for_baseline: Upon arrival in Macau , be sure to stop by the Macau Government Tourist Office for a map , brochures , and directions .

source_bert_toks: upon arrival in macau , be sure to stop by the macau government tourist office for a map , bro ##chu ##res , and directions .

reference_raw: When you arrive in Macao, make sure you stop at the Macau Government Tourist Office for maps, booklets, and instructions.

reference_spacy_tokens: When you arrive in Macao , make sure you stop at the Macau Government Tourist Office for maps , booklets , and instructions .


fn_spacy_tokens_for_baseline: Approximately 140 persons , including fire - fighters from several fire departments , and personnel from the Civil Defence and the Home Guard are working to curtail the fire .

source_bert_toks: approximately 140 persons , including fire - fighters from several fire departments , and personnel from the civil defence and the home guard are working to curt ##ail the fire .

reference_raw: Around 140 people are working to reduce the fire, including firefighters from several fire departments, as well as civil defense and Home Guard personnel.

reference_spacy_tokens: Around 140 people are working to reduce the fire , including firefighters from several fire departments , as well as civil defense and Home Guard personnel .


fn_spacy_tokens_for_baseline: On top of a hill in the center of the city , it 's approached by a grand staircase .

source_bert_toks: on top of a hill in the center of the city , it ' s approached by a grand staircase .

reference_raw: At the top of a hill in the middle of the city, a large stairway approaches.

reference_spacy_tokens: At the top of a hill in the middle of the city , a large stairway approaches .


fn_spacy_tokens_for_baseline: ' I like to go to confession straight after I 've been to the hairdresser , ' said Lili .

source_bert_toks: ' i like to go to confession straight after i ' ve been to the hair ##dre ##sser , ' said lil ##i .

reference_raw: 'After I'm in the hairdresser, I like to go to confess,' said Lili.

reference_spacy_tokens: ' After I 'm in the hairdresser , I like to go to confess , ' said Lili .


fn_spacy_tokens_for_baseline: It appears that it would n't be until the early 1990s that Iran would advance from assembly to production of the Shehab-1 .

source_bert_toks: it appears that it wouldn ' t be until the early 1990s that iran would advance from assembly to production of the she ##hab - 1 .

reference_raw: In the early 1990s, Iran appears to be moving from gathering to production of Shehab-1.

reference_spacy_tokens: In the early 1990s , Iran appears to be moving from gathering to production of Shehab-1 .


fn_spacy_tokens_for_baseline: There the Ark rested until it was placed in the Temple , built in approximately 960 b.c . on Mt. Moriah , the high point at the northern end of the city .

source_bert_toks: there the ark rested until it was placed in the temple , built in approximately 960 b . c . on mt . mori ##ah , the high point at the northern end of the city .

reference_raw: The Ark lay there until it was placed in a temple, built around 960 B.C. on Mount Moriah, a high place on the north side of the city.

reference_spacy_tokens: The Ark lay there until it was placed in a temple , built around 960 B.C. on Mount Moriah , a high place on the north side of the city .


fn_spacy_tokens_for_baseline: So I forced my Mum to buy me a guitar -- it was just a crappy acoustic , with the strings about an inch away from the frets . '

source_bert_toks: so i forced my mum to buy me a guitar - - it was just a crap ##py acoustic , with the strings about an inch away from the fr ##ets . '

reference_raw: So I made my mom buy me a guitar -- it was just a shitty acoustic with strings about an inch away from the frets.'

reference_spacy_tokens: So I made my mom buy me a guitar -- it was just a shitty acoustic with strings about an inch away from the frets . '


fn_spacy_tokens_for_baseline: It 's not the Islamists or the jihadists , ' said Noman Benotman , a former Libyan militant now with the Quilliam Foundation , a London - based group staffed by former Islamic radicals .

source_bert_toks: it ' s not the islamist ##s or the jihad ##ists , ' said no ##man ben ##ot ##man , a former libyan militant now with the qui ##lli ##am foundation , a london - based group staffed by former islamic radicals .

reference_raw: They are not Islamists or jihadists,' said Noman Benotman, a former Libyan militant now with the Quilliam Foundation, a group based in London, manned by former Islamic radicals.

reference_spacy_tokens: They are not Islamists or jihadists , ' said Noman Benotman , a former Libyan militant now with the Quilliam Foundation , a group based in London , manned by former Islamic radicals .


fn_spacy_tokens_for_baseline: She relates that Lena will even take the trouble to teach customers how to use machines that they have bought elsewhere and go out of her way to make deliveries , both free of charge .

source_bert_toks: she relates that lena will even take the trouble to teach customers how to use machines that they have bought elsewhere and go out of her way to make deliveries , both free of charge .

reference_raw: He claims that Lena will even take the trouble to teach customers how to use machines they've bought elsewhere and get out of the way to make supplies, both free of charge.

reference_spacy_tokens: He claims that Lena will even take the trouble to teach customers how to use machines they 've bought elsewhere and get out of the way to make supplies , both free of charge .


fn_spacy_tokens_for_baseline: Jamaica has always had a second , unofficial language developed from the early days of slavery .

source_bert_toks: jamaica has always had a second , unofficial language developed from the early days of slavery .

reference_raw: From the first days of slavery, Jamaica had always developed a second, unofficial language.

reference_spacy_tokens: From the first days of slavery , Jamaica had always developed a second , unofficial language .


fn_spacy_tokens_for_baseline: Not surprisingly , there was a huge disparity in the number of publications from 1990 until 2000 , with the United States contributing the lion 's share ( 84.2 % ) , followed by Canada ( 10.35 % ) .

source_bert_toks: not surprisingly , there was a huge di ##spar ##ity in the number of publications from 1990 until 2000 , with the united states contributing the lion ' s share ( 84 . 2 % ) , followed by canada ( 10 . 35 % ) .

reference_raw: It is not surprising that the number of publications between 1990 and 2000 was very different, with the United States contributing to the lion's share (84.2%), followed by Canada (10.35%).

reference_spacy_tokens: It is not surprising that the number of publications between 1990 and 2000 was very different , with the United States contributing to the lion 's share ( 84.2 % ) , followed by Canada ( 10.35 % ) .


fn_spacy_tokens_for_baseline: The Bible tells us that the cruelty and impiety of the rulers of both kingdoms aroused the fury of the great Prophets .

source_bert_toks: the bible tells us that the cruelty and imp ##ie ##ty of the rulers of both kingdoms aroused the fury of the great prophets .

reference_raw: The Bible tells us that the cruelty and impudence of the rulers of both kingdoms has provoked the wrath of the great prophets.

reference_spacy_tokens: The Bible tells us that the cruelty and impudence of the rulers of both kingdoms has provoked the wrath of the great prophets .