fn_spacy_tokens_for_baseline: A poor man named John Cordeaux was brazen enough to suggest [ May 27 , 1893 ] that stoat is from the Anglo - Saxon steort , a tail .

source_bert_toks: a poor man named john cord ##eaux was bra ##zen enough to suggest [ may 27 , 1893 ] that st ##oat is from the anglo - saxon ste ##ort , a tail .

reference_raw: A wretch named John Cordeaux was so brazen that he suggested on May 27, 1893 that the stoat was made of an Anglo-Saxon steort, a tail.

reference_spacy_tokens: A wretch named John Cordeaux was so brazen that he suggested on May 27 , 1893 that the stoat was made of an Anglo - Saxon steort , a tail .


fn_spacy_tokens_for_baseline: She went indoors and sat hunched in her coat and mittens on the sofa by the drawing - room fire .

source_bert_toks: she went indoors and sat hunched in her coat and mit ##tens on the sofa by the drawing - room fire .

reference_raw: She went inside and sat crouched in her coat and gloves on the couch by the fire in the living room.

reference_spacy_tokens: She went inside and sat crouched in her coat and gloves on the couch by the fire in the living room .


fn_spacy_tokens_for_baseline: All the spadefoots have a sharp - edged horny plate on the hind feet , the ' spade ' from which they get their name .

source_bert_toks: all the spade ##foot ##s have a sharp - edged horn ##y plate on the hind feet , the ' spade ' from which they get their name .

reference_raw: All the spadefoots have a sharp, horny plate on their backs, a "spade" from which they get their name.

reference_spacy_tokens: All the spadefoots have a sharp , horny plate on their backs , a " spade " from which they get their name .


fn_spacy_tokens_for_baseline: Exhibits cover fishing , seaborne trade , sea transport , and there is an aquarium .

source_bert_toks: exhibits cover fishing , sea ##borne trade , sea transport , and there is an aquarium .

reference_raw: The exhibitions include fishing, sea trade, shipping, and an aquarium.

reference_spacy_tokens: The exhibitions include fishing , sea trade , shipping , and an aquarium .


fn_spacy_tokens_for_baseline: " We believe the fire was caused by an electrical ( malfunction ) .

source_bert_toks: " we believe the fire was caused by an electrical ( mal ##fu ##nction ) .

reference_raw: "We believe that the fire was caused by an electric (malfunction).

reference_spacy_tokens: " We believe that the fire was caused by an electric ( malfunction ) .


fn_spacy_tokens_for_baseline: Fortunately , these same parents do want their children to get a decent education as traditionally understood , and they have enough common sense to know what that demands .

source_bert_toks: fortunately , these same parents do want their children to get a decent education as traditionally understood , and they have enough common sense to know what that demands .

reference_raw: Fortunately, the same parents want their children to have a decent education, as is traditional, and they have the common sense to know what it requires.

reference_spacy_tokens: Fortunately , the same parents want their children to have a decent education , as is traditional , and they have the common sense to know what it requires .


fn_spacy_tokens_for_baseline: In animal efficacy studies , Anthim demonstrated complete protection against an anthrax spore challenge with a single prophylactic dose and has shown significant protection when administered up to two days after a lethal challenge . ( Pharmabiz.com , 26Jun06 ) ( Link )

source_bert_toks: in animal efficacy studies , ant ##him demonstrated complete protection against an ant ##hra ##x sp ##ore challenge with a single prop ##hyl ##actic dose and has shown significant protection when administered up to two days after a lethal challenge . ( ph ##arm ##abi ##z . com , 26 ##jun ##0 ##6 ) ( link )

reference_raw: In animal efficacy studies, Anthim demonstrated complete protection against anthrax spore disease with a single prophylactic dose and demonstrated significant protection when administered up to two days after a fatal outcome. (Pharmabiz.com, 26 June 2006)

reference_spacy_tokens: In animal efficacy studies , Anthim demonstrated complete protection against anthrax spore disease with a single prophylactic dose and demonstrated significant protection when administered up to two days after a fatal outcome . ( Pharmabiz.com , 26 June 2006 )


fn_spacy_tokens_for_baseline: I was talking to that presenter of that alternative - politics programme -- what 's his name ? -- and he said that he 'd got annoyed with a colleague because she criticized his pink bow - tie .

source_bert_toks: i was talking to that presenter of that alternative - politics programme - - what ' s his name ? - - and he said that he ' d got annoyed with a colleague because she criticized his pink bow - tie .

reference_raw: I talked to the promoter of the alternative policy program -- what's his name? -- and he said he was mad at his colleague for criticizing his pink bow tie.

reference_spacy_tokens: I talked to the promoter of the alternative policy program -- what 's his name ? -- and he said he was mad at his colleague for criticizing his pink bow tie .


fn_spacy_tokens_for_baseline: He also seems to have donated his belt and hose , as a twelfth - century account of their treasures lists a girdle made from the one and an alb decorated with gold thread from the other .

source_bert_toks: he also seems to have donated his belt and hose , as a twelfth - century account of their treasures lists a gi ##rd ##le made from the one and an al ##b decorated with gold thread from the other .

reference_raw: He also appears to have donated his belt and hose, as a twelfth-century account of their treasures lists a girdle made of one and an alba decorated with gold thread from the other.

reference_spacy_tokens: He also appears to have donated his belt and hose , as a twelfth - century account of their treasures lists a girdle made of one and an alba decorated with gold thread from the other .


fn_spacy_tokens_for_baseline: I swear that he might have twisted it off had I understood what it would mean to Garcia .

source_bert_toks: i swear that he might have twisted it off had i understood what it would mean to garcia .

reference_raw: I swear, if I knew what that meant to Garcia, he'd turn it around.

reference_spacy_tokens: I swear , if I knew what that meant to Garcia , he 'd turn it around .


fn_spacy_tokens_for_baseline: The section puts it beyond argument that there is no defence that the affray took place in private .

source_bert_toks: the section puts it beyond argument that there is no defence that the af ##fra ##y took place in private .

reference_raw: The section puts forward the argument that there is no defence that the attack was carried out in private.

reference_spacy_tokens: The section puts forward the argument that there is no defence that the attack was carried out in private .


fn_spacy_tokens_for_baseline: Faced with probability of sanctions and international isolation in case of noncompliance with the IAEA 's demands , Iran announced on 21 October 2003 that it will cooperate with the IAEA with full transparency and disclosure , sign the Additional Protocol and commence its ratification procedures , and suspend all enrichment and reprocessing activities , albeit for an " interim period . "

source_bert_toks: faced with probability of sanctions and international isolation in case of non ##com ##pl ##iance with the ia ##ea ' s demands , iran announced on 21 october 2003 that it will cooperate with the ia ##ea with full transparency and disclosure , sign the additional protocol and commence its ratification procedures , and suspend all enrichment and rep ##ro ##ces ##sing activities , albeit for an " interim period . "

reference_raw: In the face of the likelihood of sanctions and international isolation in the event of non-compliance with the requirements of the IAEA, Iran announced on 21 October 2003 that it would cooperate fully with the IAEA with full transparency and disclosure, sign the Additional Protocol and initiate the process of ratifying it and suspend all enrichment and reprocessing activities, albeit temporarily.

reference_spacy_tokens: In the face of the likelihood of sanctions and international isolation in the event of non - compliance with the requirements of the IAEA , Iran announced on 21 October 2003 that it would cooperate fully with the IAEA with full transparency and disclosure , sign the Additional Protocol and initiate the process of ratifying it and suspend all enrichment and reprocessing activities , albeit temporarily .


fn_spacy_tokens_for_baseline: Winston made for the stairs .

source_bert_toks: winston made for the stairs .

reference_raw: Winston started up the steps.

reference_spacy_tokens: Winston started up the steps .


fn_spacy_tokens_for_baseline: North of the town , a commanding view over all the New Territories to the north can be seen from Tai Mo Shan , Hong Kong 's highest peak at 957 m ( 3,140 ft ) .

source_bert_toks: north of the town , a commanding view over all the new territories to the north can be seen from tai mo shan , hong kong ' s highest peak at 95 ##7 m ( 3 , 140 ft ) .

reference_raw: From Tai Mo Shan, the highest peak in Hong Kong is 957 m (3,140 ft), a commanding view of all the new territories in the northern part of the city.

reference_spacy_tokens: From Tai Mo Shan , the highest peak in Hong Kong is 957 m ( 3,140 ft ) , a commanding view of all the new territories in the northern part of the city .


fn_spacy_tokens_for_baseline: What seems clear in my mind is that the translation is not in several final protocols , but a protocol by itself -- like XDR -- that other protocols refer to .

source_bert_toks: what seems clear in my mind is that the translation is not in several final protocols , but a protocol by itself - - like x ##dr - - that other protocols refer to .

reference_raw: I think it's clear to me that the translation is not in a few final protocols, but in a protocol of its own -- like the XDR -- that other protocols make reference to.

reference_spacy_tokens: I think it 's clear to me that the translation is not in a few final protocols , but in a protocol of its own -- like the XDR -- that other protocols make reference to .


fn_spacy_tokens_for_baseline: Why do n't we split and have dinner ? '

source_bert_toks: why don ' t we split and have dinner ? '

reference_raw: How about we break up and have dinner?'

reference_spacy_tokens: How about we break up and have dinner ? '


fn_spacy_tokens_for_baseline: ' It 's a bit late for bank hold - ups and a bit early for night - club ructions . '

source_bert_toks: ' it ' s a bit late for bank hold - ups and a bit early for night - club ru ##ctions . '

reference_raw: "It's a little late for bank robberies and a little early for club ructions."

reference_spacy_tokens: " It 's a little late for bank robberies and a little early for club ructions . "


fn_spacy_tokens_for_baseline: The 24 China Folk Culture Villages represent China 's ethnic variety ; they feature craftspeople in traditional costumes along with folksong and dance performances .

source_bert_toks: the 24 china folk culture villages represent china ' s ethnic variety ; they feature crafts ##pe ##ople in traditional costumes along with folks ##ong and dance performances .

reference_raw: Twenty-four Chinese folk culture villages represent a Chinese ethnic diversity; they are characterised by craftsmen in traditional costumes, along with folk songs and dance shows.

reference_spacy_tokens: Twenty - four Chinese folk culture villages represent a Chinese ethnic diversity ; they are characterised by craftsmen in traditional costumes , along with folk songs and dance shows .


fn_spacy_tokens_for_baseline: These are surrounded by areas of limestone formations , scrub and grassland , coral cliffs , and fine sand beaches .

source_bert_toks: these are surrounded by areas of limestone formations , scrub and grassland , coral cliffs , and fine sand beaches .

reference_raw: They are surrounded by areas of limestone formation, shrubbery and grassland, coral reefs and fine sandy beaches.

reference_spacy_tokens: They are surrounded by areas of limestone formation , shrubbery and grassland , coral reefs and fine sandy beaches .


fn_spacy_tokens_for_baseline: The Marines involved in the incident initially reported that they had become embroiled in a firefight with insurgents after the explosion .

source_bert_toks: the marines involved in the incident initially reported that they had become em ##bro ##iled in a fire ##fight with insurgents after the explosion .

reference_raw: At first, the Marines involved in the incident reported that they had been involved in a firefight with the rebels after the explosion.

reference_spacy_tokens: At first , the Marines involved in the incident reported that they had been involved in a firefight with the rebels after the explosion .


fn_spacy_tokens_for_baseline: Certainly , the illness would have given me plenty of opportunities to make strings of fireworks fizzle and explode in bright , whirling wheels of sulphurous pain in and behind Miller 's word - jellied eyeballs .

source_bert_toks: certainly , the illness would have given me plenty of opportunities to make strings of fireworks fi ##zzle and explode in bright , w ##hir ##ling wheels of sul ##ph ##uro ##us pain in and behind miller ' s word - je ##llie ##d eye ##balls .

reference_raw: Of course, the disease would give me plenty of opportunity to make strings of fireworks fizz and explode in bright, swirling wheels of sulfurous pain inside and behind Miller's mouth-jelled eyeballs.

reference_spacy_tokens: Of course , the disease would give me plenty of opportunity to make strings of fireworks fizz and explode in bright , swirling wheels of sulfurous pain inside and behind Miller 's mouth - jelled eyeballs .


fn_spacy_tokens_for_baseline: Occasionally , syncopal episodes decrease in frequency and may even disappear with increasing age .

source_bert_toks: occasionally , sync ##opa ##l episodes decrease in frequency and may even disappear with increasing age .

reference_raw: Syncopal episodes sometimes reduce the frequency and may even vanish with increasing age.

reference_spacy_tokens: Syncopal episodes sometimes reduce the frequency and may even vanish with increasing age .


fn_spacy_tokens_for_baseline: He then forced himself to get through the rest of the day without writing , so that the well would have replenished its juice by the time he took up his pencil again the next daybreak .

source_bert_toks: he then forced himself to get through the rest of the day without writing , so that the well would have rep ##len ##ished its juice by the time he took up his pencil again the next day ##break .

reference_raw: Then he forced himself to spend the rest of the day without writing, so that the well would replenish its juice before he picked up his pencil again the next morning.

reference_spacy_tokens: Then he forced himself to spend the rest of the day without writing , so that the well would replenish its juice before he picked up his pencil again the next morning .


fn_spacy_tokens_for_baseline: If you can get up early enough , you can attend the pre - dawn auction held at the vast local wholesale fish market ; otherwise , have a look at the street market that goes on later in the day .

source_bert_toks: if you can get up early enough , you can attend the pre - dawn auction held at the vast local wholesale fish market ; otherwise , have a look at the street market that goes on later in the day .

reference_raw: If you wake up early enough, you can attend a pre-dawn auction on a large local wholesale fish market; otherwise, look at the street market, which will take place later in the day.

reference_spacy_tokens: If you wake up early enough , you can attend a pre - dawn auction on a large local wholesale fish market ; otherwise , look at the street market , which will take place later in the day .


fn_spacy_tokens_for_baseline: The soloist throughout is the estimable Norbert Kraft , and this label 's predilection for Canadian ensembles introduces us this time to the Winnipeg SO under Kazuhiro Koizumi .

source_bert_toks: the soloist throughout is the est ##ima ##ble nor ##bert kraft , and this label ' s pre ##di ##le ##ction for canadian ensembles introduces us this time to the winnipeg so under ka ##zu ##hiro ko ##iz ##umi .

reference_raw: The soloist in the world is the most estimate Norbert Kraft, and this label's fondness for Canadian assembly introduces us this time to the Winnipeg SO under Kazuhiro Koizumi.

reference_spacy_tokens: The soloist in the world is the most estimate Norbert Kraft , and this label 's fondness for Canadian assembly introduces us this time to the Winnipeg SO under Kazuhiro Koizumi .


fn_spacy_tokens_for_baseline: Plant breeders anywhere in the world can write in to ask for budwood from these clones , some of which are wild in origin while others have been selected from plantations in various countries .

source_bert_toks: plant breeders anywhere in the world can write in to ask for bud ##wood from these clones , some of which are wild in origin while others have been selected from plantations in various countries .

reference_raw: Plant-breeders anywhere in the world can come and ask for budwood from these clones, some of which are wild in origin, while others have been selected from plantations in different countries.

reference_spacy_tokens: Plant - breeders anywhere in the world can come and ask for budwood from these clones , some of which are wild in origin , while others have been selected from plantations in different countries .


fn_spacy_tokens_for_baseline: Talks between Israel and Lebanon focused on conditions for a possible Israeli withdrawal from southern Lebanon .

source_bert_toks: talks between israel and lebanon focused on conditions for a possible israeli withdrawal from southern lebanon .

reference_raw: The negotiations between Israel and Lebanon focused on the terms of a possible Israeli withdrawal from southern Lebanon.

reference_spacy_tokens: The negotiations between Israel and Lebanon focused on the terms of a possible Israeli withdrawal from southern Lebanon .


fn_spacy_tokens_for_baseline: As soon as a character lays a hand on this item , the skeletal Cleric grips it more tightly .

source_bert_toks: as soon as a character lays a hand on this item , the skeletal cleric grips it more tightly .

reference_raw: Once a character touches it, the skeletal cleric holds it tighter.

reference_spacy_tokens: Once a character touches it , the skeletal cleric holds it tighter .


fn_spacy_tokens_for_baseline: The only person you can discuss work with is your direct commander ( Amir ) , unless you are asked to do otherwise or if your work demands participation of others , and then through guidance of the leadership .

source_bert_toks: the only person you can discuss work with is your direct commander ( amir ) , unless you are asked to do otherwise or if your work demands participation of others , and then through guidance of the leadership .

reference_raw: The only person you can talk to is your direct commander (Amir), unless you are asked to do otherwise, or if your work requires the participation of others, and then through the leadership's guidance.

reference_spacy_tokens: The only person you can talk to is your direct commander ( Amir ) , unless you are asked to do otherwise , or if your work requires the participation of others , and then through the leadership 's guidance .


fn_spacy_tokens_for_baseline: Ten years later , the mission is more ambitious , the U. S. is more deeply entangled in Afghanistan and the military 's objectives often seem elusive .

source_bert_toks: ten years later , the mission is more ambitious , the u . s . is more deeply en ##tangled in afghanistan and the military ' s objectives often seem elusive .

reference_raw: Ten years later, the mission is more ambitious, the US is more deeply involved in Afghanistan, and military goals often seem elusive.

reference_spacy_tokens: Ten years later , the mission is more ambitious , the US is more deeply involved in Afghanistan , and military goals often seem elusive .


fn_spacy_tokens_for_baseline: In 1453 , they took Constantinople , and immediately made it their capital , renaming it Istanbul .

source_bert_toks: in 145 ##3 , they took constantinople , and immediately made it their capital , renaming it istanbul .

reference_raw: In 1453, they took Constantinople and immediately converted it into their capital and named it Istanbul.

reference_spacy_tokens: In 1453 , they took Constantinople and immediately converted it into their capital and named it Istanbul .


fn_spacy_tokens_for_baseline: 307 million bushels of grain passed through the city 's elevators in 1907 , representing an 88 per cent increase over 1887 .

source_bert_toks: 307 million bush ##els of grain passed through the city ' s elevators in 1907 , representing an 88 per cent increase over 1887 .

reference_raw: In 1907, 307 million grain shrubs passed through the city elevators, which represents a 88% increase in 1887.

reference_spacy_tokens: In 1907 , 307 million grain shrubs passed through the city elevators , which represents a 88 % increase in 1887 .


fn_spacy_tokens_for_baseline: In 1961 , Pyongyang signed " treaties of friendship , cooperation , and mutual assistance " with both Moscow and Beijing , but events led Kim to question the credibility of these alliances .

source_bert_toks: in 1961 , p ##yon ##gy ##ang signed " treaties of friendship , cooperation , and mutual assistance " with both moscow and beijing , but events led kim to question the credibility of these alliances .

reference_raw: In 1961, Pyongyang signed "familiary, cooperation, and mutual assistance" with Moscow and Beijing, but events led Kim to question the credibility of these alliances.

reference_spacy_tokens: In 1961 , Pyongyang signed " familiary , cooperation , and mutual assistance " with Moscow and Beijing , but events led Kim to question the credibility of these alliances .


fn_spacy_tokens_for_baseline: However , because catastrophic injuries are more worrisome to the emerging rugby nations , Akpata thinks that the IRB powers are doing the game a disservice by not acting enough to change the Laws for safety purposes .

source_bert_toks: however , because catastrophic injuries are more wo ##rri ##some to the emerging rugby nations , ak ##pa ##ta thinks that the ir ##b powers are doing the game a di ##sser ##vic ##e by not acting enough to change the laws for safety purposes .

reference_raw: But, since catastrophic injuries are more disturbing to emerging rugby countries, Akpata believes that the IRB forces are doing this game as a disservice by not acting enough to change the law for security reasons.

reference_spacy_tokens: But , since catastrophic injuries are more disturbing to emerging rugby countries , Akpata believes that the IRB forces are doing this game as a disservice by not acting enough to change the law for security reasons .


fn_spacy_tokens_for_baseline: On the day of its creation he had his armourers fuse the suit directly to his body .

source_bert_toks: on the day of its creation he had his armour ##ers fuse the suit directly to his body .

reference_raw: On the day of his creation, he had his armorers pin the suit directly to his body.

reference_spacy_tokens: On the day of his creation , he had his armorers pin the suit directly to his body .


fn_spacy_tokens_for_baseline: This means that Iran will place the Natanz facility , and any enriched uranium it produces , under IAEA inspection but that , as long as no nuclear materials are present , the IAEA would have no ability to examine locations in Iran where it believed nuclear weapons design research might be under way .

source_bert_toks: this means that iran will place the nat ##an ##z facility , and any enriched uranium it produces , under ia ##ea inspection but that , as long as no nuclear materials are present , the ia ##ea would have no ability to examine locations in iran where it believed nuclear weapons design research might be under way .

reference_raw: This implies that Iran will place the Natanz facility and any enriched uranium it produces under the control of the IAEA, but that until there is no nuclear material, the IAEA will not be able to examine the locations in Iran where it believes that research on the design of nuclear weapons may be ongoing.

reference_spacy_tokens: This implies that Iran will place the Natanz facility and any enriched uranium it produces under the control of the IAEA , but that until there is no nuclear material , the IAEA will not be able to examine the locations in Iran where it believes that research on the design of nuclear weapons may be ongoing .


fn_spacy_tokens_for_baseline: Louisa was patient with this choice .

source_bert_toks: louisa was patient with this choice .

reference_raw: Louisa had the patience to make that choice.

reference_spacy_tokens: Louisa had the patience to make that choice .


fn_spacy_tokens_for_baseline: For while the lantern 's spark shivered in the chill breeze , this burn was steady and true as the motion of its owner 's pen , scratching out the rhythm of the willow 's fingers .

source_bert_toks: for while the lantern ' s spark shivered in the chill breeze , this burn was steady and true as the motion of its owner ' s pen , scratching out the rhythm of the willow ' s fingers .

reference_raw: For while the spark of the lantern shivered in the cool breeze, the burn was as steady and real as the movement of the owner's pen, scratching the willow's fingers.

reference_spacy_tokens: For while the spark of the lantern shivered in the cool breeze , the burn was as steady and real as the movement of the owner 's pen , scratching the willow 's fingers .


fn_spacy_tokens_for_baseline: so that i would have something warm enough and i did n't need anything i mean it just happened to be the week that i was there it was just really nice and pleasant so

source_bert_toks: so that i would have something warm enough and i didn ' t need anything i mean it just happened to be the week that i was there it was just really nice and pleasant so

reference_raw: so I have something hot enough and I don't need anything, I mean, it's just a week when I'm there, it's really nice and nice,

reference_spacy_tokens: so I have something hot enough and I do n't need anything , I mean , it 's just a week when I 'm there , it 's really nice and nice ,


fn_spacy_tokens_for_baseline: I I must try and cop him tomorrow .

source_bert_toks: i i must try and cop him tomorrow .

reference_raw: I have to try to deal with him tomorrow.

reference_spacy_tokens: I have to try to deal with him tomorrow .


fn_spacy_tokens_for_baseline: But it remains to be seen whether that will prove a significant omission .

source_bert_toks: but it remains to be seen whether that will prove a significant om ##iss ##ion .

reference_raw: However, it is still necessary to determine whether this proves to be a significant omission.

reference_spacy_tokens: However , it is still necessary to determine whether this proves to be a significant omission .


fn_spacy_tokens_for_baseline: You can try your luck at pari mutuel betting on jai - alai at pari mutuel , greyhound - racing at the Canidrome ( one of the largest in the world ) , and harness - racing on Taipa .

source_bert_toks: you can try your luck at par ##i mu ##tu ##el betting on jai - ala ##i at par ##i mu ##tu ##el , greyhound - racing at the can ##id ##rom ##e ( one of the largest in the world ) , and harness - racing on tai ##pa .

reference_raw: You can try your fortune in Paris Mutuel betting on jai-alai in Paris Mutuel, Greyhound - race in the Canidrome (one of the world's largest) and harness - race in Taipa.

reference_spacy_tokens: You can try your fortune in Paris Mutuel betting on jai - alai in Paris Mutuel , Greyhound - race in the Canidrome ( one of the world 's largest ) and harness - race in Taipa .


fn_spacy_tokens_for_baseline: The base can no longer support the half - span which snaps off .

source_bert_toks: the base can no longer support the half - span which snaps off .

reference_raw: The base can no longer support the half-span that explodes.

reference_spacy_tokens: The base can no longer support the half - span that explodes .


fn_spacy_tokens_for_baseline: ( NYT_ENG _ 20130625.0044 ) Meanwhile , in Pretoria , doctors continued to treat Mandela for a lung ailment that he contracted on Robben Island , the notorious apartheid - era prison where he spent much of his 27 years behind bars until his release in 1990 .

source_bert_toks: ( ny ##t _ eng _ 2013 ##0 ##6 ##25 . 00 ##44 ) meanwhile , in pretoria , doctors continued to treat mandela for a lung ai ##lm ##ent that he contracted on robb ##en island , the notorious apartheid - era prison where he spent much of his 27 years behind bars until his release in 1990 .

reference_raw: (NYT_ENG_20130625.0044) Meanwhile, in Pretoria, doctors continued to treat Mandela for the lung disease he had contracted on Robben Island, the infamous apartheid-era prison where he had spent most of his 27 years in prison until his discharge in 1990.

reference_spacy_tokens: ( NYT_ENG_20130625.0044 ) Meanwhile , in Pretoria , doctors continued to treat Mandela for the lung disease he had contracted on Robben Island , the infamous apartheid - era prison where he had spent most of his 27 years in prison until his discharge in 1990 .


fn_spacy_tokens_for_baseline: Another Foxy scheming method to miss conscription is to join the Quakers , avoiding being drafted because of religious immunity [ not because of bloating on porridge].

source_bert_toks: another fox ##y sc ##hem ##ing method to miss conscription is to join the quakers , avoiding being drafted because of religious immunity [ not because of b ##lo ##ating on por ##ridge ] .

reference_raw: Another way to avoid conscripting is to join the Quakers and avoid being drafted for religious immunity [not because of bloating on oatmeal].

reference_spacy_tokens: Another way to avoid conscripting is to join the Quakers and avoid being drafted for religious immunity [ not because of bloating on oatmeal].


fn_spacy_tokens_for_baseline: In a statement , President Jacob Zuma said Mandela 's condition was unchanged .

source_bert_toks: in a statement , president jacob zu ##ma said mandela ' s condition was unchanged .

reference_raw: In his statement, President Jacob Zuma said that the state of Mandela had not changed.

reference_spacy_tokens: In his statement , President Jacob Zuma said that the state of Mandela had not changed .


fn_spacy_tokens_for_baseline: Louis Maddox : but his stage name was Orso .

source_bert_toks: louis maddox : but his stage name was or ##so .

reference_raw: Louis Maddox: but Orso's name was on the scene.

reference_spacy_tokens: Louis Maddox : but Orso 's name was on the scene .


fn_spacy_tokens_for_baseline: From the monastery , hikers enjoy the two - hour cross - country trek down to Silvermine Bay , but the authorities have warned walkers to be on the lookout for snakes , which can be plentiful in the Lantau hinterland , especially in summer .

source_bert_toks: from the monastery , hike ##rs enjoy the two - hour cross - country trek down to silver ##mine bay , but the authorities have warned walkers to be on the lookout for snakes , which can be pl ##ent ##iful in the lan ##ta ##u hint ##erland , especially in summer .

reference_raw: From the convent, tourists enjoy a two-hour cross-country trip to Silvermine Bay, but the authorities warned the pedestrians to look out for snakes, which could be abundant in the Land of Lantau, especially in the winter.

reference_spacy_tokens: From the convent , tourists enjoy a two - hour cross - country trip to Silvermine Bay , but the authorities warned the pedestrians to look out for snakes , which could be abundant in the Land of Lantau , especially in the winter .


fn_spacy_tokens_for_baseline: " If the cartel succeeds in blackmailing the Colombian authorities into negotiations , the cartel will be in control and Fidel can exploit his past relationships with them , " he told the Journal 's David Asman recently .

source_bert_toks: " if the cartel succeeds in blackmail ##ing the colombian authorities into negotiations , the cartel will be in control and fide ##l can exploit his past relationships with them , " he told the journal ' s david as ##man recently .

reference_raw: "If the cartel succeeds in extorting the Colombian authorities into negotiations, the cartel will be in control, and Fidel will be able to take advantage of his past relationship with them," David Asman told the Journal the other day.

reference_spacy_tokens: " If the cartel succeeds in extorting the Colombian authorities into negotiations , the cartel will be in control , and Fidel will be able to take advantage of his past relationship with them , " David Asman told the Journal the other day .


fn_spacy_tokens_for_baseline: Then as things got rougher , we ran for the door and spent the next few minutes outside watching the brick sidewalk under our feet oozing up and down , and the flowers waving in an eerie rhythm .

source_bert_toks: then as things got rough ##er , we ran for the door and spent the next few minutes outside watching the brick sidewalk under our feet o ##oz ##ing up and down , and the flowers waving in an eerie rhythm .

reference_raw: Then, as things got rougher, we ran to the door and spent the next few minutes outside watching the brick walkway beneath our feet, and the flowers rippled in a strange rhythm.

reference_spacy_tokens: Then , as things got rougher , we ran to the door and spent the next few minutes outside watching the brick walkway beneath our feet , and the flowers rippled in a strange rhythm .


fn_spacy_tokens_for_baseline: Then we wind through interminable streets of Edwardian terraced houses converted to flats and rooms .

source_bert_toks: then we wind through inter ##mina ##ble streets of edward ##ian terrace ##d houses converted to flats and rooms .

reference_raw: Then we cross the endless streets of Edwardian terraced houses, converted into apartments and rooms.

reference_spacy_tokens: Then we cross the endless streets of Edwardian terraced houses , converted into apartments and rooms .


fn_spacy_tokens_for_baseline: Winston Smith , his chin nuzzled into his breast in an effort to escape the vile wind , slipped quickly through the glass doors of Victory Mansions , though not quickly enough to prevent a swirl of gritty dust from entering along with him .

source_bert_toks: winston smith , his chin nu ##zzled into his breast in an effort to escape the vile wind , slipped quickly through the glass doors of victory mansions , though not quickly enough to prevent a swirl of grit ##ty dust from entering along with him .

reference_raw: Winston Smith, his chin thrust into his chest in an effort to escape the hideous wind, slid swiftly through the glass doors of the Victory Mansions, but not quickly enough to prevent a swirl of gritty dust from entering with him.

reference_spacy_tokens: Winston Smith , his chin thrust into his chest in an effort to escape the hideous wind , slid swiftly through the glass doors of the Victory Mansions , but not quickly enough to prevent a swirl of gritty dust from entering with him .


fn_spacy_tokens_for_baseline: Nearby , a steak sizzled on his small grill .

source_bert_toks: nearby , a steak si ##zzled on his small grill .

reference_raw: Nearby, a steak hissed on a small barbecue.

reference_spacy_tokens: Nearby , a steak hissed on a small barbecue .


fn_spacy_tokens_for_baseline: The releases could be part of China 's bid to sway the International Olympic Committee to award the 2000 Olympics to Beijing , which has made clear it will do anything to win the Games .

source_bert_toks: the releases could be part of china ' s bid to sway the international olympic committee to award the 2000 olympics to beijing , which has made clear it will do anything to win the games .

reference_raw: Releases could be part of China's bid to rock the International Olympic Committee to award the 2000 Olympics to Beijing, which made it clear that it would do anything to win the Games.

reference_spacy_tokens: Releases could be part of China 's bid to rock the International Olympic Committee to award the 2000 Olympics to Beijing , which made it clear that it would do anything to win the Games .


fn_spacy_tokens_for_baseline: Fiona could spot a phoney a mile off and Jennifer or whatever she called herself was a phoney .

source_bert_toks: fiona could spot a phone ##y a mile off and jennifer or whatever she called herself was a phone ##y .

reference_raw: Fiona saw a fake mile away, and Jennifer, or whatever she called herself, was a fake.

reference_spacy_tokens: Fiona saw a fake mile away , and Jennifer , or whatever she called herself , was a fake .


fn_spacy_tokens_for_baseline: Curbishley won the senior women 's race in an encouraging 63.7 seconds , even though she tore a ligament at the side of her knee at the halfway mark .

source_bert_toks: curb ##ish ##ley won the senior women ' s race in an encouraging 63 . 7 seconds , even though she tore a ligament at the side of her knee at the halfway mark .

reference_raw: Curbishley had won the senior female race in an encouraging 63.7 seconds, though she had ripped a ligament from the side of her knee at the halfway mark.

reference_spacy_tokens: Curbishley had won the senior female race in an encouraging 63.7 seconds , though she had ripped a ligament from the side of her knee at the halfway mark .


fn_spacy_tokens_for_baseline: And young graduates are not leaving now -- multinational corporations and European Union investment mean there are plenty of opportunities for them at home .

source_bert_toks: and young graduates are not leaving now - - multinational corporations and european union investment mean there are plenty of opportunities for them at home .

reference_raw: And young graduates don't leave now - multi-national corporations and investments in the European Union mean that they have a lot of opportunities at home.

reference_spacy_tokens: And young graduates do n't leave now - multi - national corporations and investments in the European Union mean that they have a lot of opportunities at home .


fn_spacy_tokens_for_baseline: Some Christian Identity groups believe in apocalyptic prophecy , including the " purifying " role of biblical plagues to vanquish sinners and help bring about Armageddon and the Second Coming .

source_bert_toks: some christian identity groups believe in apocalyptic prophecy , including the " pu ##ri ##fying " role of biblical plague ##s to van ##qui ##sh sinn ##ers and help bring about arm ##aged ##don and the second coming .

reference_raw: Some Christian identity groups believe in apocalyptic prophecies, including the "purification" role of biblical plagues to vanquish the sinners and help create Armageddon and the Second Coming.

reference_spacy_tokens: Some Christian identity groups believe in apocalyptic prophecies , including the " purification " role of biblical plagues to vanquish the sinners and help create Armageddon and the Second Coming .


fn_spacy_tokens_for_baseline: ' Though about 350 people participated in the drill , about 500 patients were actually processed because many participants went through multiple times , with varying symptoms each time .

source_bert_toks: ' though about 350 people participated in the drill , about 500 patients were actually processed because many participants went through multiple times , with varying symptoms each time .

reference_raw: Although there were about 350 people involved in the exercise, about 500 patients were actually processed because many of the participants went through several times, and each time they had different symptoms.

reference_spacy_tokens: Although there were about 350 people involved in the exercise , about 500 patients were actually processed because many of the participants went through several times , and each time they had different symptoms .


fn_spacy_tokens_for_baseline: It had been skinned , neatly eviscerated , and would have looked like any carcase in a butcher 's shop if it had n't been for the head .

source_bert_toks: it had been skinned , neatly ev ##is ##cera ##ted , and would have looked like any car ##case in a butcher ' s shop if it hadn ' t been for the head .

reference_raw: It was skinned, neatly gutted, and if it wasn't for the head, it would look like any carcase in a butcher shop.

reference_spacy_tokens: It was skinned , neatly gutted , and if it was n't for the head , it would look like any carcase in a butcher shop .


fn_spacy_tokens_for_baseline: A former CIA officer says he made repeated efforts to alert top agency officials to problems with an Iraqi defector 's claims about the country 's mobile biological weapons labs but he was ignored , the Washington Post reported Sunday .

source_bert_toks: a former cia officer says he made repeated efforts to alert top agency officials to problems with an iraqi defect ##or ' s claims about the country ' s mobile biological weapons labs but he was ignored , the washington post reported sunday .

reference_raw: An ex-C.I.A. officer said he made repeated attempts to alert top agency officials to problems with the Iraqi defector's claims about the country's cellular bio-weapons labs, but he was ignored, and the Washington Post reported on Sunday.

reference_spacy_tokens: An ex - C.I.A. officer said he made repeated attempts to alert top agency officials to problems with the Iraqi defector 's claims about the country 's cellular bio - weapons labs , but he was ignored , and the Washington Post reported on Sunday .


fn_spacy_tokens_for_baseline: Erika stamped her foot in vexation .

source_bert_toks: erika stamped her foot in ve ##xa ##tion .

reference_raw: Erica stamped her leg in exultation.

reference_spacy_tokens: Erica stamped her leg in exultation .


fn_spacy_tokens_for_baseline: I smiled and headed out on the road northwards .

source_bert_toks: i smiled and headed out on the road northwards .

reference_raw: I smiled and started north on the road.

reference_spacy_tokens: I smiled and started north on the road .


fn_spacy_tokens_for_baseline: In both cases , the pupils will enlarge more than normal , as if trying to increase the input of information from the exciting stimuli .

source_bert_toks: in both cases , the pupils will en ##lar ##ge more than normal , as if trying to increase the input of information from the exciting stimuli .

reference_raw: In both cases, pupils increase more than usual, as if they were trying to increase the input of information from an exciting stimulus.

reference_spacy_tokens: In both cases , pupils increase more than usual , as if they were trying to increase the input of information from an exciting stimulus .


fn_spacy_tokens_for_baseline: Just like the respect we 've earned from U.S. News and World Report .

source_bert_toks: just like the respect we ' ve earned from u . s . news and world report .

reference_raw: Just like the respect we deserve from the U.S. News and the World Report.

reference_spacy_tokens: Just like the respect we deserve from the U.S. News and the World Report .


fn_spacy_tokens_for_baseline: The preservation of this wonderful home is ongoing ; a projected restoration of the original garden is still in progress .

source_bert_toks: the preservation of this wonderful home is ongoing ; a projected restoration of the original garden is still in progress .

reference_raw: This beautiful house is being maintained; the planned restoration of the original garden is still underway.

reference_spacy_tokens: This beautiful house is being maintained ; the planned restoration of the original garden is still underway .


fn_spacy_tokens_for_baseline: Although the cost of research is undoubtedly cheaper in the developing world due to relatively low researcher salaries , overhead and other work standards , these factors do not explain the substantial increase in the number of publications per amount of money allocated to research and development in Latin America , particularly from 1995 until 2000 ( Figure 2 ) .

source_bert_toks: although the cost of research is undoubtedly cheaper in the developing world due to relatively low researcher salaries , overhead and other work standards , these factors do not explain the substantial increase in the number of publications per amount of money allocated to research and development in latin america , particularly from 1995 until 2000 ( figure 2 ) .

reference_raw: Although research costs are undoubtedly cheaper in the developing world due to relatively low research salaries, overheads and other working standards, these factors do not explain the significant increase in the number of publications per amount allocated to R&D in Latin America, in particular between 1995 and 2000 (Figure 2).

reference_spacy_tokens: Although research costs are undoubtedly cheaper in the developing world due to relatively low research salaries , overheads and other working standards , these factors do not explain the significant increase in the number of publications per amount allocated to R&D in Latin America , in particular between 1995 and 2000 ( Figure 2 ) .


fn_spacy_tokens_for_baseline: U.S. Congressman Tony Hall arrived here Sunday evening , becoming the first U.S. lawmaker to visit Iraq since the 1991 Gulf War .

source_bert_toks: u . s . congressman tony hall arrived here sunday evening , becoming the first u . s . law ##maker to visit iraq since the 1991 gulf war .

reference_raw: United States Congressman Tony Hall arrived on Sunday night and became the first American lawman to visit Iraq since the Gulf War of 1991.

reference_spacy_tokens: United States Congressman Tony Hall arrived on Sunday night and became the first American lawman to visit Iraq since the Gulf War of 1991 .


fn_spacy_tokens_for_baseline: The national side were not alone at the fort , which nestles high in the hills and was partially enshrouded in mist yesterday .

source_bert_toks: the national side were not alone at the fort , which nest ##les high in the hills and was partially en ##sh ##roud ##ed in mist yesterday .

reference_raw: The national side was not alone in the fort, which nestled high in the hills and was partially obscured by fog yesterday.

reference_spacy_tokens: The national side was not alone in the fort , which nestled high in the hills and was partially obscured by fog yesterday .


fn_spacy_tokens_for_baseline: In 1984 , East Germany ( GDR ) supplied Iran with 5,000 " respirators , " which turned out to be industrial half - masks with goggles , which are unsuitable for chemical defense .

source_bert_toks: in 1984 , east germany ( g ##dr ) supplied iran with 5 , 000 " res ##pi ##rator ##s , " which turned out to be industrial half - masks with go ##ggles , which are unsuitable for chemical defense .

reference_raw: In 1984, East Germany (GDR) delivered 5,000 "respirators" to Iran, which turned out to be an industrial half-mask with glasses that were not suitable for chemical defense.

reference_spacy_tokens: In 1984 , East Germany ( GDR ) delivered 5,000 " respirators " to Iran , which turned out to be an industrial half - mask with glasses that were not suitable for chemical defense .


fn_spacy_tokens_for_baseline: I wandered round the church among the dewy grass - grown graves and picturesque ivy -- and moss - hung tombstones .

source_bert_toks: i wandered round the church among the dew ##y grass - grown graves and picturesque ivy - - and moss - hung tombstone ##s .

reference_raw: I walked around the church among the dew-grassed graves and imaginative ivy-and the moss-hung tombstones.

reference_spacy_tokens: I walked around the church among the dew - grassed graves and imaginative ivy - and the moss - hung tombstones .


fn_spacy_tokens_for_baseline: One of the reasons American students do so poorly in math tests , as compared with British , French , German or Japanese students , is the influence of the " New Math " on American textbooks and teaching methods .

source_bert_toks: one of the reasons american students do so poorly in math tests , as compared with british , french , german or japanese students , is the influence of the " new math " on american textbooks and teaching methods .

reference_raw: One of the reasons why American students do so poorly in math tests compared to British, French, German, and Japanese students is the impact of New Math on American textbooks and teaching techniques.

reference_spacy_tokens: One of the reasons why American students do so poorly in math tests compared to British , French , German , and Japanese students is the impact of New Math on American textbooks and teaching techniques .


fn_spacy_tokens_for_baseline: Hear the songs of Bob Marley booming from a hundred cranked - up car stereos or the chorus of frogs that begin to call as evening descends .

source_bert_toks: hear the songs of bob marley booming from a hundred crank ##ed - up car stereo ##s or the chorus of frogs that begin to call as evening descends .

reference_raw: Hear Bob Marley's singing from a hundred cranks, up car stereos, or the chorus of frogs, which begin to call as the evening descends.

reference_spacy_tokens: Hear Bob Marley 's singing from a hundred cranks , up car stereos , or the chorus of frogs , which begin to call as the evening descends .


fn_spacy_tokens_for_baseline: Field Marshal Lord Wavell was strong in his support for the S.A.S. He had commented that one should never allow oneself to be ' trammelled by the bonds of orthodoxy ' .

source_bert_toks: field marshal lord wave ##ll was strong in his support for the s . a . s . he had commented that one should never allow oneself to be ' tram ##mel ##led by the bonds of orthodoxy ' .

reference_raw: Field Marshal Lord Wavell strongly supported the S.A.S., commented that one should never let himself be 'trammed with orthodoxy's bonds.

reference_spacy_tokens: Field Marshal Lord Wavell strongly supported the S.A.S. , commented that one should never let himself be ' trammed with orthodoxy 's bonds .


fn_spacy_tokens_for_baseline: But things have come to a pretty pass when obesity is confused with the wobbly bits the good Lord designed for girls -- the bits that should stick out at the front and back of a strapless ballgown .

source_bert_toks: but things have come to a pretty pass when obesity is confused with the wo ##bbly bits the good lord designed for girls - - the bits that should stick out at the front and back of a strap ##less ball ##go ##wn .

reference_raw: But things had come to a good deal when obesity was confused with the wobbly bits that the good Lord had designed for girls-the bits that should have stuck out on the front and back of the strapless robe.

reference_spacy_tokens: But things had come to a good deal when obesity was confused with the wobbly bits that the good Lord had designed for girls - the bits that should have stuck out on the front and back of the strapless robe .


fn_spacy_tokens_for_baseline: Maintenance and expansion of Sino - Iranian relations naturally constitutes an important component of Chinese strategy in extending its influence to the region .

source_bert_toks: maintenance and expansion of sino - iranian relations naturally constitutes an important component of chinese strategy in extending its influence to the region .

reference_raw: Maintaining and expanding Sino-Iran relations is, of course, an important part of China's strategy in extending its influence to the region.

reference_spacy_tokens: Maintaining and expanding Sino - Iran relations is , of course , an important part of China 's strategy in extending its influence to the region .


fn_spacy_tokens_for_baseline: The right solution is to auction off slots to the highest bidder .

source_bert_toks: the right solution is to auction off slots to the highest bid ##der .

reference_raw: The correct solution is to sell the slots to the highest bidder.

reference_spacy_tokens: The correct solution is to sell the slots to the highest bidder .


fn_spacy_tokens_for_baseline: My instructor played a role like no other instructor I 've ever had I appreciate everything that Goodwill has done for me . " -- Cornell

source_bert_toks: my instructor played a role like no other instructor i ' ve ever had i appreciate everything that goodwill has done for me . " - - cornell

reference_raw: My instructor has played a role like no other instructor I've ever had, and I appreciate everything Goodwill's made for me." - Cornell.

reference_spacy_tokens: My instructor has played a role like no other instructor I 've ever had , and I appreciate everything Goodwill 's made for me . " - Cornell .


fn_spacy_tokens_for_baseline: BBC editor John King said : ' Selina 's contribution has been immeasurable .

source_bert_toks: bbc editor john king said : ' se ##lina ' s contribution has been im ##me ##asurable .

reference_raw: BBC editor John King said, 'Selina's contribution was immense.

reference_spacy_tokens: BBC editor John King said , ' Selina 's contribution was immense .


fn_spacy_tokens_for_baseline: Those with dairy goats may need to have some goats kidding in the autumn to obtain good supplies of milk in winter .

source_bert_toks: those with dairy goats may need to have some goats kidding in the autumn to obtain good supplies of milk in winter .

reference_raw: Those with dairy goats may need to make fun of goats in the autumn to get a good supply of milk in the winter.

reference_spacy_tokens: Those with dairy goats may need to make fun of goats in the autumn to get a good supply of milk in the winter .


fn_spacy_tokens_for_baseline: Pinise Saul 's vocals added a spine - tingling force to a mid - tempo theme , Dave DeFries 's flugalhorn complementing her with brisk fluttering phrases .

source_bert_toks: pin ##ise saul ' s vocals added a spine - tingling force to a mid - tempo theme , dave def ##ries ' s flu ##gal ##horn complement ##ing her with brisk fluttering phrases .

reference_raw: Pinise Saul's voices added a spinal force to the mid-tempo theme, and Dave DeFries's flugalhorn filled it with brisk, fluttering phrases.

reference_spacy_tokens: Pinise Saul 's voices added a spinal force to the mid - tempo theme , and Dave DeFries 's flugalhorn filled it with brisk , fluttering phrases .


fn_spacy_tokens_for_baseline: It should have been raining , thundering , hailing .

source_bert_toks: it should have been raining , thunder ##ing , hail ##ing .

reference_raw: It was supposed to rain, to thunder, to call.

reference_spacy_tokens: It was supposed to rain , to thunder , to call .


fn_spacy_tokens_for_baseline: We tore away his collar , and Holmes breathed a prayer of gratitude when we saw that there was no sign of a wound and that the rescue had been in time .

source_bert_toks: we tore away his collar , and holmes breathed a prayer of gratitude when we saw that there was no sign of a wound and that the rescue had been in time .

reference_raw: We tore off his collar, and Holmes prayed gratefully when we saw that there was no sign of injury and that the rescue was in time.

reference_spacy_tokens: We tore off his collar , and Holmes prayed gratefully when we saw that there was no sign of injury and that the rescue was in time .


fn_spacy_tokens_for_baseline: The fire started in the basement and spread to a small portion of the first floor .

source_bert_toks: the fire started in the basement and spread to a small portion of the first floor .

reference_raw: The fire began in the cellar and spread to a small part of the first level.

reference_spacy_tokens: The fire began in the cellar and spread to a small part of the first level .


fn_spacy_tokens_for_baseline: Photos and documents tell the life story of the physician - revolutionary - statesman , who lived for a time in Macau , but never in this building .

source_bert_toks: photos and documents tell the life story of the physician - revolutionary - statesman , who lived for a time in macau , but never in this building .

reference_raw: The photographs and documents tell the life story of a doctor - a revolutionary - statesman who lived in Macau for a while, but never in this building.

reference_spacy_tokens: The photographs and documents tell the life story of a doctor - a revolutionary - statesman who lived in Macau for a while , but never in this building .


fn_spacy_tokens_for_baseline: He thought he could smell dope ; grass or resin fumes .

source_bert_toks: he thought he could smell do ##pe ; grass or resin fu ##mes .

reference_raw: He thought he could smell drugs; weeds or resin fumes.

reference_spacy_tokens: He thought he could smell drugs ; weeds or resin fumes .


fn_spacy_tokens_for_baseline: The Werewolves were founded in September 1944 by SS chief Heinrich Himmler , who saw them as a special force that would work behind U. S. lines to sabotage equipment and kill U. S. troops .

source_bert_toks: the werewolves were founded in september 1944 by ss chief heinrich him ##mler , who saw them as a special force that would work behind u . s . lines to sabotage equipment and kill u . s . troops .

reference_raw: The werewolves were founded in September 1944 by the head of the SS, Heinrich Himmler, who saw them as a special unit that would work behind the American lines to destroy equipment and kill U.S. troops.

reference_spacy_tokens: The werewolves were founded in September 1944 by the head of the SS , Heinrich Himmler , who saw them as a special unit that would work behind the American lines to destroy equipment and kill U.S. troops .


fn_spacy_tokens_for_baseline: The statement in my article , " I know of nothing in his behavior to me , to my family , to Israel , or to Jews in general that entitles him to anything less than my total loyalty , " is quite precise .

source_bert_toks: the statement in my article , " i know of nothing in his behavior to me , to my family , to israel , or to jews in general that en ##titles him to anything less than my total loyalty , " is quite precise .

reference_raw: The statement in my article, "I don't know anything about his behavior towards me, my family, Israel, or the Jews in general that give him anything less than my complete loyalty," is quite accurate.

reference_spacy_tokens: The statement in my article , " I do n't know anything about his behavior towards me , my family , Israel , or the Jews in general that give him anything less than my complete loyalty , " is quite accurate .


fn_spacy_tokens_for_baseline: " They are inevitably inclined to echo the conventional pap , since this is the least controversial option that is open to them .

source_bert_toks: " they are inevitably inclined to echo the conventional pa ##p , since this is the least controversial option that is open to them .

reference_raw: "They're bound to resonate with conventional paps, because it's the least controversial possibility they've got.

reference_spacy_tokens: " They 're bound to resonate with conventional paps , because it 's the least controversial possibility they 've got .


fn_spacy_tokens_for_baseline: In the first case , a syndrome is a set of symptoms which inevitably co - occur , the reason being that a single underlying malfunction of the language - processing system is responsible for all the symptoms .

source_bert_toks: in the first case , a syndrome is a set of symptoms which inevitably co - occur , the reason being that a single underlying mal ##fu ##nction of the language - processing system is responsible for all the symptoms .

reference_raw: In the first case, the syndrome is a series of symptoms that inevitably coincide with each other, because one basic failure of the language processing system is responsible for all the symptoms.

reference_spacy_tokens: In the first case , the syndrome is a series of symptoms that inevitably coincide with each other , because one basic failure of the language processing system is responsible for all the symptoms .


fn_spacy_tokens_for_baseline: QN : Does the US Department of Defense ( DOD ) plan to secure all of Russia 's CW stockpiles ?

source_bert_toks: q ##n : does the us department of defense ( dod ) plan to secure all of russia ' s cw stock ##pile ##s ?

reference_raw: QN: Does the U.S. Department of Defense intend to secure all Russian CW supplies?

reference_spacy_tokens: QN : Does the U.S. Department of Defense intend to secure all Russian CW supplies ?


fn_spacy_tokens_for_baseline: Note that because of the duty - free situation , good bargains may be found in European china , including Spode and Wedgwood .

source_bert_toks: note that because of the duty - free situation , good bargain ##s may be found in european china , including sp ##ode and wed ##g ##wood .

reference_raw: Note that due to the duty-free situation, good deals are available in Europe, including Spode and Wedgwood.

reference_spacy_tokens: Note that due to the duty - free situation , good deals are available in Europe , including Spode and Wedgwood .


fn_spacy_tokens_for_baseline: At the same time , many Jews sought religious freedom and fulfillment by moving to Palestine ( as the Holy Land was traditionally called ) and especially to Jerusalem .

source_bert_toks: at the same time , many jews sought religious freedom and fulfillment by moving to palestine ( as the holy land was traditionally called ) and especially to jerusalem .

reference_raw: At the same time, many Jews sought religious freedom and fulfilment by moving to Palestine (as the Holy Land was traditionally called) and, in particular, to Jerusalem.

reference_spacy_tokens: At the same time , many Jews sought religious freedom and fulfilment by moving to Palestine ( as the Holy Land was traditionally called ) and , in particular , to Jerusalem .


fn_spacy_tokens_for_baseline: He was hospitalized June 8 , his fourth hospitalization since late last year .

source_bert_toks: he was hospitalized june 8 , his fourth hospital ##ization since late last year .

reference_raw: He was hospitalized on June 8th, the fourth hospital since the end of last year.

reference_spacy_tokens: He was hospitalized on June 8th , the fourth hospital since the end of last year .


fn_spacy_tokens_for_baseline: ( The term bystander here does duty as a cover term for participants in audience role and for non - participating overhearers . )

source_bert_toks: ( the term by ##stand ##er here does duty as a cover term for participants in audience role and for non - participating over ##hear ##ers . )

reference_raw: (This term bystander serves as a cover term for audience participants and non-participating listeners.)

reference_spacy_tokens: ( This term bystander serves as a cover term for audience participants and non - participating listeners . )


fn_spacy_tokens_for_baseline: The early 1980s was a period of significant indigenous expansion , which included uranium milling facilities , a fuel rod fabrication complex , and a 5MW ( e ) nuclear reactor , as well as research and development institutions .

source_bert_toks: the early 1980s was a period of significant indigenous expansion , which included uranium milling facilities , a fuel rod fabrication complex , and a 5 ##m ##w ( e ) nuclear reactor , as well as research and development institutions .

reference_raw: In the early 1980s, there was a period of significant domestic expansion, including uranium milling facilities, a fuel rod production complex and a 5MW (e) nuclear reactor, as well as research and development institutions.

reference_spacy_tokens: In the early 1980s , there was a period of significant domestic expansion , including uranium milling facilities , a fuel rod production complex and a 5MW ( e ) nuclear reactor , as well as research and development institutions .


fn_spacy_tokens_for_baseline: The theater presents " sky shows " and IMAX films .

source_bert_toks: the theater presents " sky shows " and im ##ax films .

reference_raw: There are "Sky Shows" and "IMAX" films in the theater.

reference_spacy_tokens: There are " Sky Shows " and " IMAX " films in the theater .


fn_spacy_tokens_for_baseline: The woman was not affronted .

source_bert_toks: the woman was not af ##front ##ed .

reference_raw: The woman wasn't offended.

reference_spacy_tokens: The woman was n't offended .


fn_spacy_tokens_for_baseline: Perishable goods would perish or would have to be warehoused at an additional cost .

source_bert_toks: per ##isha ##ble goods would per ##ish or would have to be warehouse ##d at an additional cost .

reference_raw: Perishable goods would perish or have to be stored at an additional cost.

reference_spacy_tokens: Perishable goods would perish or have to be stored at an additional cost .


fn_spacy_tokens_for_baseline: A glimpse of Rosa , as she walks to the well in her pink tatters , and Hamilton 's blood slows and clogs , and his hair hums .

source_bert_toks: a glimpse of rosa , as she walks to the well in her pink ta ##tters , and hamilton ' s blood slow ##s and cl ##og ##s , and his hair hum ##s .

reference_raw: There was a glimpse of Rosa, walking toward the well in her pink tattoos, and Hamilton's blood was slowing and clogging, and his hair was humming.

reference_spacy_tokens: There was a glimpse of Rosa , walking toward the well in her pink tattoos , and Hamilton 's blood was slowing and clogging , and his hair was humming .


fn_spacy_tokens_for_baseline: A senior administration official said the White House does not want to give Kadafi a chance to cast himself as a patriot resisting American pressure .

source_bert_toks: a senior administration official said the white house does not want to give ka ##da ##fi a chance to cast himself as a patriot resisting american pressure .

reference_raw: The senior government official said the White House didn't want to give Kadafi the chance to pretend to be a patriot resisting American pressure.

reference_spacy_tokens: The senior government official said the White House did n't want to give Kadafi the chance to pretend to be a patriot resisting American pressure .


fn_spacy_tokens_for_baseline: The market runs all the way up to Tin Hau Temple , where you will find fortune tellers ' tables ( some speak English ) and possibly street performers singing Chinese opera or pop songs .

source_bert_toks: the market runs all the way up to tin ha ##u temple , where you will find fortune teller ##s ' tables ( some speak english ) and possibly street performers singing chinese opera or pop songs .

reference_raw: The market runs all the way to the Temple of Tin Hau, where you can find the tables of fortune tellers (some speak English) and perhaps the street artists who sing Chinese opera or pop songs.

reference_spacy_tokens: The market runs all the way to the Temple of Tin Hau , where you can find the tables of fortune tellers ( some speak English ) and perhaps the street artists who sing Chinese opera or pop songs .


fn_spacy_tokens_for_baseline: China 's missiles are operated by the Second Artillery Corps , and include about 650 DF -11 ( M-11 ) and DF-15 ( M-9 ) missiles opposite Taiwan ; several dozens of DF -3 , DF -4 , and DF -21 medium - range missiles that can reach Japan , India , and Russia ; and 18 - 24 DF -5 ICBMs that can reach the United States and Europe .

source_bert_toks: china ' s missiles are operated by the second artillery corps , and include about 650 d ##f - 11 ( m - 11 ) and d ##f - 15 ( m - 9 ) missiles opposite taiwan ; several dozens of d ##f - 3 , d ##f - 4 , and d ##f - 21 medium - range missiles that can reach japan , india , and russia ; and 18 - 24 d ##f - 5 ic ##bm ##s that can reach the united states and europe .

reference_raw: The Chinese missiles are operated by the Second Artillery Corps, comprising approximately 650 DF-11 (M-11) and DF-15 (M-9) rockets across Taiwan; several dozen DF-3, DF-4, and DF-21 intermediate-range missiles that can reach Japan, India, and Russia; and 18-24 DF-5 ICBMs that can reach the United States and Europe.

reference_spacy_tokens: The Chinese missiles are operated by the Second Artillery Corps , comprising approximately 650 DF-11 ( M-11 ) and DF-15 ( M-9 ) rockets across Taiwan ; several dozen DF-3 , DF-4 , and DF-21 intermediate - range missiles that can reach Japan , India , and Russia ; and 18 - 24 DF-5 ICBMs that can reach the United States and Europe .


fn_spacy_tokens_for_baseline: The royals , who normally have a special pew screened from other worshippers , behaved like any other wedding family .

source_bert_toks: the royals , who normally have a special pew screened from other worship ##pers , behaved like any other wedding family .

reference_raw: The royals, who usually had a special bench covered by other worshippers, behaved like any other wedding family.

reference_spacy_tokens: The royals , who usually had a special bench covered by other worshippers , behaved like any other wedding family .


fn_spacy_tokens_for_baseline: Taking a cloth to wrap bread because of the shortage of paper , and queuing for things bought so casually before the war , like hairgrips and torch batteries .

source_bert_toks: taking a cloth to wrap bread because of the shortage of paper , and que ##uing for things bought so casually before the war , like hair ##gr ##ip ##s and torch batteries .

reference_raw: I took a cloth to wrap bread for lack of paper, and wrote about things that had been bought so casually before the war, like hairdressers and torch batteries.

reference_spacy_tokens: I took a cloth to wrap bread for lack of paper , and wrote about things that had been bought so casually before the war , like hairdressers and torch batteries .


fn_spacy_tokens_for_baseline: The pupils of her eyes , black as sloes , dilated a little .

source_bert_toks: the pupils of her eyes , black as sl ##oes , dil ##ated a little .

reference_raw: The pupils of her eyes, black as sloes, widened slightly.

reference_spacy_tokens: The pupils of her eyes , black as sloes , widened slightly .


fn_spacy_tokens_for_baseline: You may be surprised to find that she does n't want to shackle you with a ball and chain .

source_bert_toks: you may be surprised to find that she doesn ' t want to shack ##le you with a ball and chain .

reference_raw: You might be surprised he doesn't want to handcuff you with a ball and a chain.

reference_spacy_tokens: You might be surprised he does n't want to handcuff you with a ball and a chain .


fn_spacy_tokens_for_baseline: Changing weather conditions also helped firefighting efforts , as temperature in the area fell to 90 degrees Fahrenheit , down from over a hundred degrees on Monday .

source_bert_toks: changing weather conditions also helped fire ##fighting efforts , as temperature in the area fell to 90 degrees fa ##hre ##nh ##eit , down from over a hundred degrees on monday .

reference_raw: The change in weather conditions also contributed to the fire-fighting effort, as the temperature in the area dropped to 90 degrees Fahrenheit and dropped from more than 100 degrees on Monday.

reference_spacy_tokens: The change in weather conditions also contributed to the fire - fighting effort , as the temperature in the area dropped to 90 degrees Fahrenheit and dropped from more than 100 degrees on Monday .


fn_spacy_tokens_for_baseline: Surprises spring up on all sides : new industrial complexes alongside sleepy farming villages , skyscraper towns blooming in the middle of nowhere , Hakka women in their traditional flat straw hats with hanging black curtains , water buffalo , and flashes of azalea everywhere .

source_bert_toks: surprises spring up on all sides : new industrial complexes alongside sleepy farming villages , skyscraper towns bloom ##ing in the middle of nowhere , ha ##kka women in their traditional flat straw hats with hanging black curtains , water buffalo , and flashes of az ##ale ##a everywhere .

reference_raw: There are surprises on all sides: new industry complexes along with sleepy agricultural villages, skyscraper cities blooming in the middle of nowhere, Hakka women in traditional, flat straw hats with black curtains hanging, water buffalo, and azalea flashes everywhere.

reference_spacy_tokens: There are surprises on all sides : new industry complexes along with sleepy agricultural villages , skyscraper cities blooming in the middle of nowhere , Hakka women in traditional , flat straw hats with black curtains hanging , water buffalo , and azalea flashes everywhere .


fn_spacy_tokens_for_baseline: Feeling faintly uncomfortable , Shannon moved towards the pantry to fetch a cup and saucer .

source_bert_toks: feeling faintly uncomfortable , shannon moved towards the pantry to fetch a cup and sauce ##r .

reference_raw: Feeling slightly uncomfortably uncomfortable, Shannon went to the closet for a cup and a plate.

reference_spacy_tokens: Feeling slightly uncomfortably uncomfortable , Shannon went to the closet for a cup and a plate .


fn_spacy_tokens_for_baseline: ' Well , she was oldish .

source_bert_toks: ' well , she was old ##ish .

reference_raw: 'She was old.

reference_spacy_tokens: ' She was old .


fn_spacy_tokens_for_baseline: There was a pop as if someone had exploded a huge paper bag , a disappearing electric sizzle , and the searchlight went out .

source_bert_toks: there was a pop as if someone had exploded a huge paper bag , a disappearing electric si ##zzle , and the search ##light went out .

reference_raw: There was a pop, as if someone had blown up a huge paper bag, a vanishing electric hiss, and the headlights went out.

reference_spacy_tokens: There was a pop , as if someone had blown up a huge paper bag , a vanishing electric hiss , and the headlights went out .


fn_spacy_tokens_for_baseline: If for example the fire officer requires a company to introduce new fire precaution equipment in an office and the owners of the office consider the fire officer is being unreasonable , the owners can appeal to the magistrates to adjudicate on the matter .

source_bert_toks: if for example the fire officer requires a company to introduce new fire pre ##ca ##ution equipment in an office and the owners of the office consider the fire officer is being unreasonable , the owners can appeal to the magistrates to ad ##ju ##dicate on the matter .

reference_raw: For example, if a firefighter requires a company to introduce new fire-fighting equipment in the office and the owners of the office consider that the firefighter is disproportionate, they may appeal to the judges to rule on the matter.

reference_spacy_tokens: For example , if a firefighter requires a company to introduce new fire - fighting equipment in the office and the owners of the office consider that the firefighter is disproportionate , they may appeal to the judges to rule on the matter .


fn_spacy_tokens_for_baseline: Iraqi officials argue that the U. S. government was supposed to safeguard the stash under a 2004 legal agreement it signed with Iraq .

source_bert_toks: iraqi officials argue that the u . s . government was supposed to safeguard the st ##ash under a 2004 legal agreement it signed with iraq .

reference_raw: Iraqi officials argue that the U.S. government should have protected the hideout on the basis of the 2004 legal agreement it signed with Iraq.

reference_spacy_tokens: Iraqi officials argue that the U.S. government should have protected the hideout on the basis of the 2004 legal agreement it signed with Iraq .


fn_spacy_tokens_for_baseline: If supplies are not reaching the people who need them , Hall said , he wanted to find out whether the United Nations or relief agencies needed to handle things differently , or whether " Iraq needs to get out of the way and let us do the job . "

source_bert_toks: if supplies are not reaching the people who need them , hall said , he wanted to find out whether the united nations or relief agencies needed to handle things differently , or whether " iraq needs to get out of the way and let us do the job . "

reference_raw: If the supplies don't reach the people who need them, Hall said, he wants to know if the UN or relief agencies need to do things differently, or if "Iraq needs to get out of the way and let us do it."

reference_spacy_tokens: If the supplies do n't reach the people who need them , Hall said , he wants to know if the UN or relief agencies need to do things differently , or if " Iraq needs to get out of the way and let us do it . "


fn_spacy_tokens_for_baseline: That seemed to have been what he had in mind , as he put a paw on the back of my neck and bent me forward until my face was squished into the table top .

source_bert_toks: that seemed to have been what he had in mind , as he put a paw on the back of my neck and bent me forward until my face was sq ##uis ##hed into the table top .

reference_raw: He seemed to have that in mind when he put his hand on the back of my neck and bent me forward until my face was pressed against the top of the table.

reference_spacy_tokens: He seemed to have that in mind when he put his hand on the back of my neck and bent me forward until my face was pressed against the top of the table .


fn_spacy_tokens_for_baseline: One can quibble over the slow speed for the opening movement of No . 1 , which is hardly an Allegro commodo .

source_bert_toks: one can qui ##bble over the slow speed for the opening movement of no . 1 , which is hardly an allegro com ##mo ##do .

reference_raw: One can squirm over the slow speed of the opening movement of No. 1, which is hardly an Allegro commodo.

reference_spacy_tokens: One can squirm over the slow speed of the opening movement of No . 1 , which is hardly an Allegro commodo .


fn_spacy_tokens_for_baseline: Russia is assisting Iran to construct a light water reactor at Bushehr , which is now nearing completion , and will supply the nuclear fuel needed to run it .

source_bert_toks: russia is assisting iran to construct a light water reactor at bush ##eh ##r , which is now nearing completion , and will supply the nuclear fuel needed to run it .

reference_raw: Russia is helping Iran build a light-water reactor in Bushehr, which is now nearing completion, and will provide the nuclear fuel needed to operate it.

reference_spacy_tokens: Russia is helping Iran build a light - water reactor in Bushehr , which is now nearing completion , and will provide the nuclear fuel needed to operate it .


fn_spacy_tokens_for_baseline: Some helicopters and airplanes , which were to drop water on the fires , continued to be delayed by strong winds .

source_bert_toks: some helicopters and airplanes , which were to drop water on the fires , continued to be delayed by strong winds .

reference_raw: Some of the helicopters and aircraft that were supposed to drop water on the fires were still being held back by strong winds.

reference_spacy_tokens: Some of the helicopters and aircraft that were supposed to drop water on the fires were still being held back by strong winds .


fn_spacy_tokens_for_baseline: " The result is a generation of young people whose ignorance and intellectual incompetence is matched only by their good opinion of themselves .

source_bert_toks: " the result is a generation of young people whose ignorance and intellectual inc ##omp ##ete ##nce is matched only by their good opinion of themselves .

reference_raw: "The result is a generation of young people whose incompetence and incompetence are matched only by their good opinion of themselves."

reference_spacy_tokens: " The result is a generation of young people whose incompetence and incompetence are matched only by their good opinion of themselves . "


fn_spacy_tokens_for_baseline: However , many inhabitants have been evacuated due to the fire threatening their homes , including the entire villages of Mykland and Belland .

source_bert_toks: however , many inhabitants have been evacuated due to the fire threatening their homes , including the entire villages of my ##kla ##nd and bella ##nd .

reference_raw: However, many people were evacuated as a result of a fire endangering their homes, including the entire villages of Mykland and Belland.

reference_spacy_tokens: However , many people were evacuated as a result of a fire endangering their homes , including the entire villages of Mykland and Belland .


fn_spacy_tokens_for_baseline: Of the scores of victims sentenced to be broken on the wheel , probably the most unjustly condemned was a young man , Jean Louschart .

source_bert_toks: of the scores of victims sentenced to be broken on the wheel , probably the most un ##just ##ly condemned was a young man , jean lou ##sch ##art .

reference_raw: Of the dozen victims convicted of driving a car, the most unjustly condemned was a young man, Jean Louschart.

reference_spacy_tokens: Of the dozen victims convicted of driving a car , the most unjustly condemned was a young man , Jean Louschart .


fn_spacy_tokens_for_baseline: The main highway makes a circuit of the New Territories , beginning with the new town of Tsuen Wan , situated in an area of heavy industry just west of Kowloon .

source_bert_toks: the main highway makes a circuit of the new territories , beginning with the new town of ts ##uen wan , situated in an area of heavy industry just west of ko ##wl ##oon .

reference_raw: The main road runs around the New Territories, starting with the new city of Tsuen Wan, which is located in a heavy-duty area just east of Kowloon.

reference_spacy_tokens: The main road runs around the New Territories , starting with the new city of Tsuen Wan , which is located in a heavy - duty area just east of Kowloon .


fn_spacy_tokens_for_baseline: These reports are termed speculative by a nuclear industry journal ( 7198 ) .

source_bert_toks: these reports are termed speculative by a nuclear industry journal ( 71 ##9 ##8 ) .

reference_raw: These reports are referred to as speculatives in the Nuclear Industry Journal (7198).

reference_spacy_tokens: These reports are referred to as speculatives in the Nuclear Industry Journal ( 7198 ) .


fn_spacy_tokens_for_baseline: Your gift will give children and families hope for improved tomorrows .

source_bert_toks: your gift will give children and families hope for improved tomorrow ##s .

reference_raw: Your gift will give the children and families hope for a better tomorrow.

reference_spacy_tokens: Your gift will give the children and families hope for a better tomorrow .


fn_spacy_tokens_for_baseline: The flat was seven flights up , and Winston , who was thirty - nine and had a varicose ulcer above his right ankle , went slowly , resting several times on the way .

source_bert_toks: the flat was seven flights up , and winston , who was thirty - nine and had a var ##ico ##se ul ##cer above his right ankle , went slowly , resting several times on the way .

reference_raw: The apartment was seven flights high, and Winston, who was thirty-nine and had a varicose ulcer over his right ankle, walked slowly and rested several times along the way.

reference_spacy_tokens: The apartment was seven flights high , and Winston , who was thirty - nine and had a varicose ulcer over his right ankle , walked slowly and rested several times along the way .


fn_spacy_tokens_for_baseline: ( NYT_ENG _ 20130625.0044 ) Meanwhile , in Pretoria , doctors continued to treat Mandela for a lung ailment that he contracted on Robben Island , the notorious apartheid - era prison where he spent much of his 27 years behind bars until his release in 1990 .

source_bert_toks: ( ny ##t _ eng _ 2013 ##0 ##6 ##25 . 00 ##44 ) meanwhile , in pretoria , doctors continued to treat mandela for a lung ai ##lm ##ent that he contracted on robb ##en island , the notorious apartheid - era prison where he spent much of his 27 years behind bars until his release in 1990 .

reference_raw: (NYT_ENG_20130625.0044) Meanwhile, in Pretoria, doctors continued to treat Mandela for the lung disease he had acquired on Robben Island, the infamous apartheid-era prison where he had spent most of his 27 years in prison until his release in 1990.

reference_spacy_tokens: ( NYT_ENG_20130625.0044 ) Meanwhile , in Pretoria , doctors continued to treat Mandela for the lung disease he had acquired on Robben Island , the infamous apartheid - era prison where he had spent most of his 27 years in prison until his release in 1990 .


fn_spacy_tokens_for_baseline: Robert Merkel , a former U.S. attorney handling drug indictments in Florida , does n't think for a minute that Castro 's much publicized trials of high officials engaged in the drug trade mean he has broken off with the Medellin drug cartel .

source_bert_toks: robert mer ##kel , a former u . s . attorney handling drug indictment ##s in florida , doesn ' t think for a minute that castro ' s much publicized trials of high officials engaged in the drug trade mean he has broken off with the med ##elli ##n drug cartel .

reference_raw: Robert Merkel, a former U.S. attorney dealing with drug charges in Florida, does not think for a moment that Castro's many publicized trials of high-level officials involved in drug trafficking mean that he broke up with the Medellin drug cartel.

reference_spacy_tokens: Robert Merkel , a former U.S. attorney dealing with drug charges in Florida , does not think for a moment that Castro 's many publicized trials of high - level officials involved in drug trafficking mean that he broke up with the Medellin drug cartel .


fn_spacy_tokens_for_baseline: The island is aligned almost east - to - west in the water so that sunrise wakes the eastern tip , proceeds to caress the length of the island , and kisses the western tip good night .

source_bert_toks: the island is aligned almost east - to - west in the water so that sunrise wakes the eastern tip , proceeds to caress the length of the island , and kisses the western tip good night .

reference_raw: The island is almost to the east - to the west in the water, so that the dawn wakes the eastern tip, continues to stroke the length of the island, and gives the western tip good night.

reference_spacy_tokens: The island is almost to the east - to the west in the water , so that the dawn wakes the eastern tip , continues to stroke the length of the island , and gives the western tip good night .


fn_spacy_tokens_for_baseline: For example , they may purchase raw or milled uranium ore from abroad , and then use indigenous facilities to enrich it to weapons - grade material .

source_bert_toks: for example , they may purchase raw or mill ##ed uranium ore from abroad , and then use indigenous facilities to en ##rich it to weapons - grade material .

reference_raw: For example, they can buy raw or ground uranium ore from abroad and then use domestic facilities to enrich it for weapons-grade materials.

reference_spacy_tokens: For example , they can buy raw or ground uranium ore from abroad and then use domestic facilities to enrich it for weapons - grade materials .


fn_spacy_tokens_for_baseline: His forces made a series of attacks from their bases in the Dodecanese islands , including sinking a Greek naval vessel in the harbor of Tinos Town , but they only succeeded in strengthening the resolve of the population against them .

source_bert_toks: his forces made a series of attacks from their bases in the dod ##eca ##nese islands , including sinking a greek naval vessel in the harbor of tin ##os town , but they only succeeded in strengthening the resolve of the population against them .

reference_raw: His troops had launched a series of attacks from their bases on the Dodecanese islands, including the sinking of a Greek ship in the port of Tinos City, but they had only been able to strengthen the resolve of the population against them.

reference_spacy_tokens: His troops had launched a series of attacks from their bases on the Dodecanese islands , including the sinking of a Greek ship in the port of Tinos City , but they had only been able to strengthen the resolve of the population against them .


fn_spacy_tokens_for_baseline: She pulled a handkerchief from her handbag on her lap , dabbed at her nose .

source_bert_toks: she pulled a handkerchief from her hand ##bag on her lap , da ##bbed at her nose .

reference_raw: She took a handkerchief from her purse in her lap and dabbed her nose.

reference_spacy_tokens: She took a handkerchief from her purse in her lap and dabbed her nose .


fn_spacy_tokens_for_baseline: He must have spent all last night developing and printing them ( as if he 'd go to the chemist 's !

source_bert_toks: he must have spent all last night developing and printing them ( as if he ' d go to the chemist ' s !

reference_raw: He had to spend the rest of the night building and printing them out (as if he were going to a pharmacist!

reference_spacy_tokens: He had to spend the rest of the night building and printing them out ( as if he were going to a pharmacist !


fn_spacy_tokens_for_baseline: Every August young women convene to light joss sticks and some even climb the nine - meter ( 30 - ft ) rock to pray for good husbands .

source_bert_toks: every august young women con ##ven ##e to light jo ##ss sticks and some even climb the nine - meter ( 30 - ft ) rock to pray for good husbands .

reference_raw: Every August, young women convene to light joss sticks, and some of them even climb a nine-meter-30-ft-rock to say their best husbands.

reference_spacy_tokens: Every August , young women convene to light joss sticks , and some of them even climb a nine - meter-30-ft - rock to say their best husbands .


fn_spacy_tokens_for_baseline: These scientists are supposedly experimenting with the causative agents of such diseases as Marburg , smallpox , plague , and tularemia .

source_bert_toks: these scientists are supposedly experimenting with the ca ##usa ##tive agents of such diseases as mar ##burg , smallpox , plague , and tu ##lar ##emia .

reference_raw: These scientists are supposed to be experimenting with the causes of diseases like Marburg, smallpox, plague, and tularaemia.

reference_spacy_tokens: These scientists are supposed to be experimenting with the causes of diseases like Marburg , smallpox , plague , and tularaemia .


fn_spacy_tokens_for_baseline: A Humboldt veteran 's tie to the new Hawaiian Islands monument : The nation 's newest national monument , a chain of islands that sweeps northwest from Hawaii , has a darker past than its azure waters and low - slung white sand beaches would reveal .

source_bert_toks: a humboldt veteran ' s tie to the new hawaiian islands monument : the nation ' s newest national monument , a chain of islands that sweeps northwest from hawaii , has a darker past than its azure waters and low - slung white sand beaches would reveal .

reference_raw: The Humboldt veteran's link to the new Hawaiian island monument: the nation's most recent national monument, the chain of islands sweeping northwest of Hawaii, has a darker past than its azure waters, and low--slung white sand beaches will reveal.

reference_spacy_tokens: The Humboldt veteran 's link to the new Hawaiian island monument : the nation 's most recent national monument , the chain of islands sweeping northwest of Hawaii , has a darker past than its azure waters , and low -- slung white sand beaches will reveal .


fn_spacy_tokens_for_baseline: The origins of the Iranian missile program date back to the late 1970s and the last years that the Shah Mohammed Reza Pahlavi ruled Iran .

source_bert_toks: the origins of the iranian missile program date back to the late 1970s and the last years that the shah mohammed reza pa ##hl ##avi ruled iran .

reference_raw: The source of the Iranian missile program dates back to the late 1970s and the last years when Iran was ruled by Shah Mohammed Reza Pahlavi.

reference_spacy_tokens: The source of the Iranian missile program dates back to the late 1970s and the last years when Iran was ruled by Shah Mohammed Reza Pahlavi .


fn_spacy_tokens_for_baseline: And in this city , where literature and theater have historically dominated the scene , visual arts are finally coming into their own with the new Museum of Modern Art and the many galleries that display the work of modern Irish artists .

source_bert_toks: and in this city , where literature and theater have historically dominated the scene , visual arts are finally coming into their own with the new museum of modern art and the many galleries that display the work of modern irish artists .

reference_raw: And in this city, where books and theatres have historically dominated the scene, the visual arts have finally come to their own with a new museum of modern art and many galleries showing the work of modern Irish artists.

reference_spacy_tokens: And in this city , where books and theatres have historically dominated the scene , the visual arts have finally come to their own with a new museum of modern art and many galleries showing the work of modern Irish artists .


fn_spacy_tokens_for_baseline: Iran responded by strenuously denying the charges , but also maintained that it reserved the right to possess nuclear weapons to counter Israel 's weaponry .

source_bert_toks: iran responded by st ##ren ##uously denying the charges , but also maintained that it reserved the right to possess nuclear weapons to counter israel ' s weaponry .

reference_raw: Iran responded by strenuously denying the charges, but also asserting that it reserved the right to own nuclear weapons against Israeli weapons.

reference_spacy_tokens: Iran responded by strenuously denying the charges , but also asserting that it reserved the right to own nuclear weapons against Israeli weapons .


fn_spacy_tokens_for_baseline: JOHANNESBURG - After four days in the hospital battling a lung infection , former President Nelson Mandela of South Africa " is responding better to treatment , " President Jacob Zuma told Parliament in Cape Town on Wednesday .

source_bert_toks: johannesburg - after four days in the hospital battling a lung infection , former president nelson mandela of south africa " is responding better to treatment , " president jacob zu ##ma told parliament in cape town on wednesday .

reference_raw: JOHANNESBURG - After four days in the hospital fighting lung disease, former President Nelson Mandela of South Africa "responds better to treatment," President Jacob Zuma said to Parliament in Cape Town on Wednesday.

reference_spacy_tokens: JOHANNESBURG - After four days in the hospital fighting lung disease , former President Nelson Mandela of South Africa " responds better to treatment , " President Jacob Zuma said to Parliament in Cape Town on Wednesday .


fn_spacy_tokens_for_baseline: Both young and old go through ballet - like movements in slow motion to discipline the mind and body .

source_bert_toks: both young and old go through ballet - like movements in slow motion to discipline the mind and body .

reference_raw: Both the young and the old go through the ballet - like moving slowly to discipline the mind and the body.

reference_spacy_tokens: Both the young and the old go through the ballet - like moving slowly to discipline the mind and the body .


fn_spacy_tokens_for_baseline: Chek Lap Kok airport sits on reclaimed land just off Lantau ; plans to build a bridge may change Lantau , but at present it is sparsely populated and makes a perfect getaway .

source_bert_toks: che ##k lap ko ##k airport sits on reclaimed land just off lan ##ta ##u ; plans to build a bridge may change lan ##ta ##u , but at present it is sparsely populated and makes a perfect get ##away .

reference_raw: Chek Lap Kok airport is located on reclaimed land just outside Lantau; plans to build a bridge can change Lantau, but it is currently sparsely populated and makes a perfect escape.

reference_spacy_tokens: Chek Lap Kok airport is located on reclaimed land just outside Lantau ; plans to build a bridge can change Lantau , but it is currently sparsely populated and makes a perfect escape .


fn_spacy_tokens_for_baseline: The Cortina blasted his horn and waved him on and that was that .

source_bert_toks: the co ##rti ##na blasted his horn and waved him on and that was that .

reference_raw: Cortina blew his horn and waved him on, and that was it.

reference_spacy_tokens: Cortina blew his horn and waved him on , and that was it .


fn_spacy_tokens_for_baseline: To the south and east is St. Stephen 's Green and Georgian Dublin where the national museums are located .

source_bert_toks: to the south and east is st . stephen ' s green and georgian dublin where the national museums are located .

reference_raw: The national museums are located in the south and east of St. Stephen's Grove and Georgian Dublin.

reference_spacy_tokens: The national museums are located in the south and east of St. Stephen 's Grove and Georgian Dublin .


fn_spacy_tokens_for_baseline: In 2003 , Russian and Syrian officials continued their negotiations for the construction of a nuclear facility that would include a nuclear power plant and a seawater atomic desalination plant .

source_bert_toks: in 2003 , russian and syrian officials continued their negotiations for the construction of a nuclear facility that would include a nuclear power plant and a sea ##water atomic des ##ali ##nation plant .

reference_raw: In 2003, Russia and Syria's officials continued to negotiate the construction of a nuclear facility, including a nuclear power plant and a marine nuclear desalination plant.

reference_spacy_tokens: In 2003 , Russia and Syria 's officials continued to negotiate the construction of a nuclear facility , including a nuclear power plant and a marine nuclear desalination plant .


fn_spacy_tokens_for_baseline: We eventually kill the lights .

source_bert_toks: we eventually kill the lights .

reference_raw: In the end, we'll destroy the lights.

reference_spacy_tokens: In the end , we 'll destroy the lights .


fn_spacy_tokens_for_baseline: Based on data supplied by the de jure nuclear weapons states , the IAEA Safeguards Division defines quantities of concern as 8 kg of plutonium and 25 kg of HEU .

source_bert_toks: based on data supplied by the de ju ##re nuclear weapons states , the ia ##ea safeguard ##s division defines quantities of concern as 8 ##k ##g of pluto ##nium and 25 ##k ##g of he ##u .

reference_raw: On the basis of the data provided by the de jure nuclear weapons states, the IAEA Safeguards Division identifies the quantities of concern as 8 kg plutonium and 25 kg HEU.

reference_spacy_tokens: On the basis of the data provided by the de jure nuclear weapons states , the IAEA Safeguards Division identifies the quantities of concern as 8 kg plutonium and 25 kg HEU .