fn_spacy_tokens_for_baseline: Then the auto paint shop fire sent an evil - looking cloud of black smoke into the air .

source_bert_toks: then the auto paint shop fire sent an evil - looking cloud of black smoke into the air .

reference_raw: Then the fire from the car-paint store blew up an evil-looking cloud of black smoke.

reference_spacy_tokens: Then the fire from the car - paint store blew up an evil - looking cloud of black smoke .


fn_spacy_tokens_for_baseline: Erm you probably need to practise a bit .

source_bert_toks: er ##m you probably need to pr ##act ##ise a bit .

reference_raw: Um, I guess you need to practice a little.

reference_spacy_tokens: Um , I guess you need to practice a little .


fn_spacy_tokens_for_baseline: She squealed , protesting as he bear - hugged her , ruffling the perfectly set hair and smudging her red lipstick .

source_bert_toks: she squealed , protesting as he bear - hugged her , ru ##ff ##ling the perfectly set hair and sm ##ud ##ging her red lipstick .

reference_raw: She screamed, protested as he embraced her, brushed her perfectly arranged hair, and smeared her red lipstick.

reference_spacy_tokens: She screamed , protested as he embraced her , brushed her perfectly arranged hair , and smeared her red lipstick .


fn_spacy_tokens_for_baseline: The next day he rescued one of his men from a shell crater and was shot in the back by a sniper .

source_bert_toks: the next day he rescued one of his men from a shell crater and was shot in the back by a sniper .

reference_raw: The next day he rescued one of his men from a shell crater and was shot in the rear by a sniper.

reference_spacy_tokens: The next day he rescued one of his men from a shell crater and was shot in the rear by a sniper .


fn_spacy_tokens_for_baseline: Have your oats with skimmed milk , and use granulated sweetener instead of sugar to save on calories , and you will feel so replete you wo n't want to nibble until lunch .

source_bert_toks: have your o ##ats with skimmed milk , and use gran ##ulated sweet ##ener instead of sugar to save on cal ##ories , and you will feel so rep ##lete you won ' t want to ni ##bble until lunch .

reference_raw: Have some skimmed milk oats and use granulated sugar instead of sugar to save on calories, and you'll feel so replete that you don't want to eat until lunch.

reference_spacy_tokens: Have some skimmed milk oats and use granulated sugar instead of sugar to save on calories , and you 'll feel so replete that you do n't want to eat until lunch .


fn_spacy_tokens_for_baseline: The Prevention of Terrorism Act ( PTA ) used to silence the Irish community , is increasingly being , used against the Black community .

source_bert_toks: the prevention of terrorism act ( pt ##a ) used to silence the irish community , is increasingly being , used against the black community .

reference_raw: The Prevention of Terrorism Act (PTA) used to quiet the Irish community is increasingly being used against the black community.

reference_spacy_tokens: The Prevention of Terrorism Act ( PTA ) used to quiet the Irish community is increasingly being used against the black community .


fn_spacy_tokens_for_baseline: Although perhaps not in the strictest sense of the word ' beautiful ' , the American girl had a very pleasing appearance , and despite her height and strong build , an attractive feminine figure .

source_bert_toks: although perhaps not in the strict ##est sense of the word ' beautiful ' , the american girl had a very pleasing appearance , and despite her height and strong build , an attractive feminine figure .

reference_raw: Though perhaps not in the strictest sense of the word 'beautiful', the American girl had a very pleasant look, and despite her height and strength, she was an attractive female figure.

reference_spacy_tokens: Though perhaps not in the strictest sense of the word ' beautiful ' , the American girl had a very pleasant look , and despite her height and strength , she was an attractive female figure .


fn_spacy_tokens_for_baseline: When I was playing rugby and I hurt my thumb she actually lent me a very expensive Jaeger coat to keep me warm .

source_bert_toks: when i was playing rugby and i hurt my thumb she actually lent me a very expensive jae ##ger coat to keep me warm .

reference_raw: When I played rugby and hit my thumb, she actually lent me a very expensive Jaeger coat to warm me up.

reference_spacy_tokens: When I played rugby and hit my thumb , she actually lent me a very expensive Jaeger coat to warm me up .


fn_spacy_tokens_for_baseline: The governments of the biggest economies are taking actions -- lower interest rates in Germany , fiscal expansion in Japan , fiscal contraction in America -- which are clearly in their own self - interest .

source_bert_toks: the governments of the biggest economies are taking actions - - lower interest rates in germany , fiscal expansion in japan , fiscal contraction in america - - which are clearly in their own self - interest .

reference_raw: Governments of the largest economies are taking action - lower interest rates in Germany, fiscal expansion in Japan, fiscal decline in America - which is clearly in their own interest.

reference_spacy_tokens: Governments of the largest economies are taking action - lower interest rates in Germany , fiscal expansion in Japan , fiscal decline in America - which is clearly in their own interest .


fn_spacy_tokens_for_baseline: If conditions remain favorable , it will be able to extend the reach of its ballistic missile forces to include Southern Europe , North Africa , and South Asia by 2005 - 2010 and possibly the continental United States by 2015 .

source_bert_toks: if conditions remain favorable , it will be able to extend the reach of its ballistic missile forces to include southern europe , north africa , and south asia by 2005 - 2010 and possibly the continental united states by 2015 .

reference_raw: If conditions remain favourable, it will be able to extend the range of its ballistic missile forces to include South Europe, North Africa, and South Asia by 2005 - 2010 and possibly the continental United States by 2015.

reference_spacy_tokens: If conditions remain favourable , it will be able to extend the range of its ballistic missile forces to include South Europe , North Africa , and South Asia by 2005 - 2010 and possibly the continental United States by 2015 .


fn_spacy_tokens_for_baseline: Without ceremony she dropped her silk gown , standing naked but for her briefs and her tattoos , which were all black .

source_bert_toks: without ceremony she dropped her silk gown , standing naked but for her briefs and her tattoos , which were all black .

reference_raw: She dropped her silk dress without ceremony and stood naked, except for shorts and tattoos that were all black.

reference_spacy_tokens: She dropped her silk dress without ceremony and stood naked , except for shorts and tattoos that were all black .


fn_spacy_tokens_for_baseline: He says there were bullets flying over the fence .

source_bert_toks: he says there were bullets flying over the fence .

reference_raw: He said there were bullets going over the fence.

reference_spacy_tokens: He said there were bullets going over the fence .


fn_spacy_tokens_for_baseline: Ranulf felt the wet scaliness against his skin as if some dreadful snake was slithering along his arm .

source_bert_toks: ran ##ulf felt the wet sc ##ali ##ness against his skin as if some dreadful snake was slit ##hering along his arm .

reference_raw: Ranulf felt a wet skin on his skin, as if a terrible snake were creeping along his arm.

reference_spacy_tokens: Ranulf felt a wet skin on his skin , as if a terrible snake were creeping along his arm .


fn_spacy_tokens_for_baseline: He hopes to bully Mr Kinnock -- Mr Major 's refusal to contemplate such a deal is absolute -- into establishing PR for ever , something for which only a fifth of the electorate will have voted .

source_bert_toks: he hopes to bully mr kin ##nock - - mr major ' s refusal to con ##tem ##plate such a deal is absolute - - into establishing pr for ever , something for which only a fifth of the electorate will have voted .

reference_raw: He hopes to bully Mr. Kinnock - the Major's refusal to consider such an agreement is absolute - into setting up a PR forever, for which only a fifth of the voters will vote.

reference_spacy_tokens: He hopes to bully Mr. Kinnock - the Major 's refusal to consider such an agreement is absolute - into setting up a PR forever , for which only a fifth of the voters will vote .


fn_spacy_tokens_for_baseline: The most spectacular mock accident was in 1984 , when a nuclear flask was virtually undamaged after a 100 mph rail crash .

source_bert_toks: the most spectacular mock accident was in 1984 , when a nuclear fl ##ask was virtually und ##ama ##ged after a 100 mph rail crash .

reference_raw: The most spectacular taunting accident was in 1984, when the nuclear bottle was virtually intact after a 100-mph rail accident.

reference_spacy_tokens: The most spectacular taunting accident was in 1984 , when the nuclear bottle was virtually intact after a 100-mph rail accident .


fn_spacy_tokens_for_baseline: We came out from church at about quarter - past ten and I would scoot home , for it was my job to take a can of tea and hot - cross buns ( they were really hot ) down to Dad already hard at work in the allotment .

source_bert_toks: we came out from church at about quarter - past ten and i would sc ##oot home , for it was my job to take a can of tea and hot - cross bun ##s ( they were really hot ) down to dad already hard at work in the all ##ot ##ment .

reference_raw: We got out of church at about ten-thirty, and I was going to go home, because it was my job to get a can of tea and hot cross buns (they were really hot) to my dad, who was already working hard in the allotment.

reference_spacy_tokens: We got out of church at about ten - thirty , and I was going to go home , because it was my job to get a can of tea and hot cross buns ( they were really hot ) to my dad , who was already working hard in the allotment .


fn_spacy_tokens_for_baseline: This conclusion should not be seen to reflect callous indifference to individuals who have suffered miserably or fatally at the hands of persons committing ' conventional ' crimes ; their agony is real and should never be ignored .

source_bert_toks: this conclusion should not be seen to reflect call ##ous indifference to individuals who have suffered mis ##era ##bly or fatally at the hands of persons committing ' conventional ' crimes ; their agony is real and should never be ignored .

reference_raw: This conclusion should not be seen as a reflection of insensitive indifference to individuals who have suffered poorly or fatally at the hands of those who commit "conventional" crimes; their pain is real and should never be ignored.

reference_spacy_tokens: This conclusion should not be seen as a reflection of insensitive indifference to individuals who have suffered poorly or fatally at the hands of those who commit " conventional " crimes ; their pain is real and should never be ignored .


fn_spacy_tokens_for_baseline: Travis 's mocking query made her start .

source_bert_toks: travis ' s mocking query made her start .

reference_raw: Travis's mocking question prompted her to begin.

reference_spacy_tokens: Travis 's mocking question prompted her to begin .


fn_spacy_tokens_for_baseline: But the feeling of an unseen presence never left him .

source_bert_toks: but the feeling of an unseen presence never left him .

reference_raw: But the sense of invisible presence had never left him.

reference_spacy_tokens: But the sense of invisible presence had never left him .


fn_spacy_tokens_for_baseline: Training is redefined as learning , and learning can take place with or without a tutor , in training rooms , in a bureau or at home , formally or informally .

source_bert_toks: training is red ##efined as learning , and learning can take place with or without a tutor , in training rooms , in a bureau or at home , formally or informally .

reference_raw: Training is defined as learning, and learning may take place with or without a teacher, in the training room, in the office or at home, either formally or informally.

reference_spacy_tokens: Training is defined as learning , and learning may take place with or without a teacher , in the training room , in the office or at home , either formally or informally .


fn_spacy_tokens_for_baseline: ' If my brother displeases you , ' she said , ' you should send him away . '

source_bert_toks: ' if my brother di ##sp ##lea ##ses you , ' she said , ' you should send him away . '

reference_raw: "If you don't like my brother," she said, "you should send him away."

reference_spacy_tokens: " If you do n't like my brother , " she said , " you should send him away . "


fn_spacy_tokens_for_baseline: Afterwards viewers sent a deluge of complaints about how boring the show was and asking them never to return to the Hacienda .

source_bert_toks: afterwards viewers sent a del ##uge of complaints about how boring the show was and asking them never to return to the ha ##cie ##nda .

reference_raw: Then the audience sent out a series of complaints about how boring the show was and asked them not to go back to the Hacienda.

reference_spacy_tokens: Then the audience sent out a series of complaints about how boring the show was and asked them not to go back to the Hacienda .


fn_spacy_tokens_for_baseline: THE Government 's cash - before - care NHS shake - up has come under fire -- from sickened hospital managers .

source_bert_toks: the government ' s cash - before - care nhs shake - up has come under fire - - from sick ##ened hospital managers .

reference_raw: The government's pre-care cash shake-up of the NHS came under fire - from sick hospital managers.

reference_spacy_tokens: The government 's pre - care cash shake - up of the NHS came under fire - from sick hospital managers .


fn_spacy_tokens_for_baseline: I 'm proud of their efforts to work safely as they safely destroy the chemical munitions that Anniston Chemical Activity stores .

source_bert_toks: i ' m proud of their efforts to work safely as they safely destroy the chemical munitions that ann ##isto ##n chemical activity stores .

reference_raw: I'm proud of their efforts to work safely once they've safely destroyed the chemistry ammunition that Anniston's chemistry activity stores.

reference_spacy_tokens: I 'm proud of their efforts to work safely once they 've safely destroyed the chemistry ammunition that Anniston 's chemistry activity stores .


fn_spacy_tokens_for_baseline: I 'm not frightened or bored or weary .

source_bert_toks: i ' m not frightened or bored or weary .

reference_raw: I'm not scared or bored or tired.

reference_spacy_tokens: I 'm not scared or bored or tired .


fn_spacy_tokens_for_baseline: Dad had turned away , and Mum and Mrs Fry were looking at each other like conspirators .

source_bert_toks: dad had turned away , and mum and mrs fry were looking at each other like con ##sp ##ira ##tors .

reference_raw: My father turned away, and my mother and Mrs. Fry looked at each other like conspirators.

reference_spacy_tokens: My father turned away , and my mother and Mrs. Fry looked at each other like conspirators .


fn_spacy_tokens_for_baseline: Formerly affiliated to the Psychopomps gangcult , her chapter was broken up in 1995 during a pitched battle with the Road Cavalry in Spanish Fork , Deseret , Jessamyn is now believed to be working alone . '

source_bert_toks: formerly affiliated to the psycho ##po ##mps gang ##cu ##lt , her chapter was broken up in 1995 during a pitched battle with the road cavalry in spanish fork , des ##ere ##t , jess ##amy ##n is now believed to be working alone . '

reference_raw: Formerly associated with the Psychopomps gangcult, her chapter was broken up in 1995 during a pitched war with the Spanish Fork Road Cavalry, Deseret, and Jessamyn is now believed to be working alone.'

reference_spacy_tokens: Formerly associated with the Psychopomps gangcult , her chapter was broken up in 1995 during a pitched war with the Spanish Fork Road Cavalry , Deseret , and Jessamyn is now believed to be working alone . '


fn_spacy_tokens_for_baseline: AN American biologist called Roger Knutson has produced what is surely , to date , the year 's most disheartening book .

source_bert_toks: an american biologist called roger kn ##uts ##on has produced what is surely , to date , the year ' s most dish ##ear ##ten ##ing book .

reference_raw: An American biologist named Roger Knutson has produced what is, to date, the most despicable book of the year.

reference_spacy_tokens: An American biologist named Roger Knutson has produced what is , to date , the most despicable book of the year .


fn_spacy_tokens_for_baseline: Chomping a guarana chewing gum , he bashfully accepts the compliments of a rather old - looking female fan .

source_bert_toks: cho ##mp ##ing a gu ##aran ##a chewing gum , he bash ##fully accepts the compliment ##s of a rather old - looking female fan .

reference_raw: He chopped off a guarana chewing gum and accepted the praises of a rather old-looking female fan.

reference_spacy_tokens: He chopped off a guarana chewing gum and accepted the praises of a rather old - looking female fan .


fn_spacy_tokens_for_baseline: " My friends are people that I trust and I do n't have to put on airs with them - they know me and do n't assume that I 'm a terrific snob if I happen to be very quiet . "

source_bert_toks: " my friends are people that i trust and i don ' t have to put on airs with them - they know me and don ' t assume that i ' m a terrific s ##nob if i happen to be very quiet . "

reference_raw: "My friends are people I trust, and I don't have to go on the air with them-they know me, and they don't think I'm a good snob if I'm ever very calm."

reference_spacy_tokens: " My friends are people I trust , and I do n't have to go on the air with them - they know me , and they do n't think I 'm a good snob if I 'm ever very calm . "


fn_spacy_tokens_for_baseline: October 26 : Charles and Diana attend the Queen 's 40th anniversary gala at Earl 's Court .

source_bert_toks: october 26 : charles and diana attend the queen ' s 40th anniversary gala at earl ' s court .

reference_raw: On October 26th, Charles and Diana attend the Queen's 40th anniversary ceremony at the Earl's Court.

reference_spacy_tokens: On October 26th , Charles and Diana attend the Queen 's 40th anniversary ceremony at the Earl 's Court .


fn_spacy_tokens_for_baseline: Middlesbrough men John Rigg and Jim Stokes donned crash helmets and fire - proof overalls to take part in the Sealink Stena Challenge .

source_bert_toks: middlesbrough men john rig ##g and jim stokes don ##ned crash helmets and fire - proof overall ##s to take part in the seal ##ink ste ##na challenge .

reference_raw: Middlesbrough men John Rigg and Jim Stokes wore crash helmets and fireproof overalls to attend the Sealink Stena Challenge.

reference_spacy_tokens: Middlesbrough men John Rigg and Jim Stokes wore crash helmets and fireproof overalls to attend the Sealink Stena Challenge .


fn_spacy_tokens_for_baseline: From traditional African to Jo'burg variety -- work song ( gumboot ) , disco , jazz funk , hot gospel -- and back again to a sensational African celebration which will leave you shouting for more .

source_bert_toks: from traditional african to jo ' bu ##rg variety - - work song ( gum ##boot ) , disco , jazz funk , hot gospel - - and back again to a sensation ##al african celebration which will leave you shouting for more .

reference_raw: From a traditional African to a Jo'burg variety - a work song (gumboot), a disco, a jazz funk, a hot gospel - and back to a wonderful African party that will make you cry for more.

reference_spacy_tokens: From a traditional African to a Jo'burg variety - a work song ( gumboot ) , a disco , a jazz funk , a hot gospel - and back to a wonderful African party that will make you cry for more .


fn_spacy_tokens_for_baseline: Keeping bent double , Hoomey wriggled in a frenzy back out of the door .

source_bert_toks: keeping bent double , ho ##ome ##y wr ##ig ##gled in a frenzy back out of the door .

reference_raw: Hoomey kept his head down twice and jerked frantically back out the door.

reference_spacy_tokens: Hoomey kept his head down twice and jerked frantically back out the door .


fn_spacy_tokens_for_baseline: An otherwise empty space , having the approximate dimensions of a master bedroom , is piled floor to ceiling with boxes and envelopes and packages .

source_bert_toks: an otherwise empty space , having the approximate dimensions of a master bedroom , is piled floor to ceiling with boxes and envelope ##s and packages .

reference_raw: An otherwise empty space, roughly the size of a master bedroom, is stacked floor-to-ceiling with boxes, covers, and parcels.

reference_spacy_tokens: An otherwise empty space , roughly the size of a master bedroom , is stacked floor - to - ceiling with boxes , covers , and parcels .


fn_spacy_tokens_for_baseline: His blue doublet was gold laced ; his breast plate gleamed ; his face , under its heavy helmet was smouldering with a familiar rage , and his dark eyes flared .

source_bert_toks: his blue double ##t was gold laced ; his breast plate gleamed ; his face , under its heavy helmet was sm ##ou ##lder ##ing with a familiar rage , and his dark eyes flared .

reference_raw: His blue jacket was laced with gold; his breastplate gleamed; his face smoldered with a familiar rage under his heavy helmet, and his dark eyes flared.

reference_spacy_tokens: His blue jacket was laced with gold ; his breastplate gleamed ; his face smoldered with a familiar rage under his heavy helmet , and his dark eyes flared .


fn_spacy_tokens_for_baseline: but he could n't hide his sexual inadequacy

source_bert_toks: but he couldn ' t hide his sexual ina ##de ##qua ##cy

reference_raw: but he couldn't hide his sexual insufficiency

reference_spacy_tokens: but he could n't hide his sexual insufficiency


fn_spacy_tokens_for_baseline: - life in prison then he 's available for parole .

source_bert_toks: - life in prison then he ' s available for parole .

reference_raw: - Life in jail, then available for parole.

reference_spacy_tokens: - Life in jail , then available for parole .


fn_spacy_tokens_for_baseline: Yet herd size is not constant ; it fluctuates in relation to environmental and social conditions .

source_bert_toks: yet herd size is not constant ; it flu ##ct ##uate ##s in relation to environmental and social conditions .

reference_raw: However, the size of the herd is not constant; it varies in relation to the environment and social conditions.

reference_spacy_tokens: However , the size of the herd is not constant ; it varies in relation to the environment and social conditions .


fn_spacy_tokens_for_baseline: ' They gave me the sack . '

source_bert_toks: ' they gave me the sack . '

reference_raw: "They gave me a bag."

reference_spacy_tokens: " They gave me a bag . "


fn_spacy_tokens_for_baseline: The Performing Right Society is currently circulating all orchestras and bands in the country with a directive instructing them no longer to submit notification of all live performances .

source_bert_toks: the performing right society is currently circulating all orchestras and bands in the country with a directive ins ##tructing them no longer to submit notification of all live performances .

reference_raw: The Performing Right Society currently circulates all orchestras and bands across the country with a directive that instructs them no longer to report all live performances.

reference_spacy_tokens: The Performing Right Society currently circulates all orchestras and bands across the country with a directive that instructs them no longer to report all live performances .


fn_spacy_tokens_for_baseline: Fiona leant back against the rear of the dressing table , breathing hard , and waved one hand , wafting air over her face .

source_bert_toks: fiona lean ##t back against the rear of the dressing table , breathing hard , and waved one hand , wa ##fting air over her face .

reference_raw: Fiona leaned back against the back of the dresser, breathing heavily, and waved one hand, waving the air over her face.

reference_spacy_tokens: Fiona leaned back against the back of the dresser , breathing heavily , and waved one hand , waving the air over her face .


fn_spacy_tokens_for_baseline: In a strife - torn country where terrorist hijacking and hostage taking is a common occurrence , full - blown sieges have been few and far between .

source_bert_toks: in a strife - torn country where terrorist hi ##jack ##ing and hostage taking is a common occurrence , full - blown siege ##s have been few and far between .

reference_raw: In a strife-torn country where terrorist abductions and the taking of hostages are common, there are few and far-reaching sieges.

reference_spacy_tokens: In a strife - torn country where terrorist abductions and the taking of hostages are common , there are few and far - reaching sieges .


fn_spacy_tokens_for_baseline: Much less happy is the Galatea , with a bright , glassy voice that often tends to flatten , an over - sophisticated manner , and a want of the agility and grace that the music requires .

source_bert_toks: much less happy is the gala ##tea , with a bright , glass ##y voice that often tends to flat ##ten , an over - sophisticated manner , and a want of the ag ##ility and grace that the music requires .

reference_raw: The Galatea is much less happy, with a clear, glassy voice that often tends to flatten, overly sophisticated, and a desire for the agility and grace that music requires.

reference_spacy_tokens: The Galatea is much less happy , with a clear , glassy voice that often tends to flatten , overly sophisticated , and a desire for the agility and grace that music requires .


fn_spacy_tokens_for_baseline: Not to be missed is a visit to Guangzhou 's famous open - air market , Qing Ping .

source_bert_toks: not to be missed is a visit to guangzhou ' s famous open - air market , qing ping .

reference_raw: Not to be missed is a visit to the well-known open air market in Guangzhou, Qing Ping.

reference_spacy_tokens: Not to be missed is a visit to the well - known open air market in Guangzhou , Qing Ping .


fn_spacy_tokens_for_baseline: ' I 'm so tired I 'm deaf , ' and he fell asleep .

source_bert_toks: ' i ' m so tired i ' m deaf , ' and he fell asleep .

reference_raw: "I'm so weary, I'm deaf," and he fell asleep.

reference_spacy_tokens: " I 'm so weary , I 'm deaf , " and he fell asleep .


fn_spacy_tokens_for_baseline: Minch and Atlantic fisheries are augmented by onshore and coastal fishing for valuable shellfish , including crabs and lobsters .

source_bert_toks: min ##ch and atlantic fisheries are augmented by on ##shore and coastal fishing for valuable shell ##fish , including crabs and lobster ##s .

reference_raw: Minch and Atlantic fisheries are increased by coastal and coastal fishing for valuable molluscs, including crabs and lobsters.

reference_spacy_tokens: Minch and Atlantic fisheries are increased by coastal and coastal fishing for valuable molluscs , including crabs and lobsters .


fn_spacy_tokens_for_baseline: ' I am heartbroken because football has been my whole life . '

source_bert_toks: ' i am heart ##broken because football has been my whole life . '

reference_raw: "I'm broken because football's been my whole life."

reference_spacy_tokens: " I 'm broken because football 's been my whole life . "


fn_spacy_tokens_for_baseline: With gloss paint the cause is painting over a dirty or glossy surface without preparing it properly and applying undercoat before the gloss finish .

source_bert_toks: with gloss paint the cause is painting over a dirty or glossy surface without preparing it properly and applying under ##coat before the gloss finish .

reference_raw: With shiny paint, the cause is painted on a dirty or shiny surface without proper preparation and application of the undercoat before the finish of the gloss.

reference_spacy_tokens: With shiny paint , the cause is painted on a dirty or shiny surface without proper preparation and application of the undercoat before the finish of the gloss .


fn_spacy_tokens_for_baseline: It was predictable that another important single issue could bring the students back out of their classrooms and onto the streets .

source_bert_toks: it was predictable that another important single issue could bring the students back out of their classrooms and onto the streets .

reference_raw: Another important one could be expected to bring students back from their classrooms to the streets.

reference_spacy_tokens: Another important one could be expected to bring students back from their classrooms to the streets .


fn_spacy_tokens_for_baseline: On May 13 UK Royal Marines were reported to have killed an Iraqi soldier and wounded two others during a series of military skirmishes near Sarsank , in the north of the country .

source_bert_toks: on may 13 uk royal marines were reported to have killed an iraqi soldier and wounded two others during a series of military skirmish ##es near sar ##san ##k , in the north of the country .

reference_raw: On May 13, British Royal Marines were reported to have killed an Iraqi soldier and injured two more in a series of military battles near Sarsank, north of the country.

reference_spacy_tokens: On May 13 , British Royal Marines were reported to have killed an Iraqi soldier and injured two more in a series of military battles near Sarsank , north of the country .


fn_spacy_tokens_for_baseline: The prince looked rueful .

source_bert_toks: the prince looked rue ##ful .

reference_raw: The prince looked sad.

reference_spacy_tokens: The prince looked sad .


fn_spacy_tokens_for_baseline: My sage remarks in Tirana were coming back to haunt me .

source_bert_toks: my sage remarks in tirana were coming back to haunt me .

reference_raw: My wise comments in Tirana came back to haunt me.

reference_spacy_tokens: My wise comments in Tirana came back to haunt me .


fn_spacy_tokens_for_baseline: But some arms control specialists worry that the National Biodefense Analysis and Countermeasures Center -- now operating out of borrowed lab space at the Frederick base and elsewhere -- might develop new vaccine - resistant or lethal microbes without solid evidence of a terrorist plot to unleash similar bugs .

source_bert_toks: but some arms control specialists worry that the national bio ##de ##fen ##se analysis and counter ##me ##as ##ures center - - now operating out of borrowed lab space at the frederick base and elsewhere - - might develop new vaccine - resistant or lethal micro ##bes without solid evidence of a terrorist plot to un ##lea ##sh similar bugs .

reference_raw: But some weapons control specialists fear that the National Biodefence Analysis and Countermeasures Center, now operating from borrowed laboratory space at Frederick Base and elsewhere, may develop new vaccines - resistant or deadly microbes without solid proof of a terrorist conspiracy to release such bugs.

reference_spacy_tokens: But some weapons control specialists fear that the National Biodefence Analysis and Countermeasures Center , now operating from borrowed laboratory space at Frederick Base and elsewhere , may develop new vaccines - resistant or deadly microbes without solid proof of a terrorist conspiracy to release such bugs .


fn_spacy_tokens_for_baseline: People do not make errors merely because they are careless or inattentive .

source_bert_toks: people do not make errors merely because they are careless or ina ##tten ##tive .

reference_raw: People don't make mistakes just because they're careless or careless.

reference_spacy_tokens: People do n't make mistakes just because they 're careless or careless .


fn_spacy_tokens_for_baseline: Several of these latter , above all the toxic organophosphates , were almost certainly employed to assassinate individual " enemies of the state . "

source_bert_toks: several of these latter , above all the toxic organ ##op ##hos ##phate ##s , were almost certainly employed to assassinate individual " enemies of the state . "

reference_raw: Some of them, especially toxic organophosphates, were almost certainly used to kill individual "enemies of the state."

reference_spacy_tokens: Some of them , especially toxic organophosphates , were almost certainly used to kill individual " enemies of the state . "


fn_spacy_tokens_for_baseline: Where 30,000 rice varieties once flourished in South - East Asia , one single kind now occupies two - thirds of the land .

source_bert_toks: where 30 , 000 rice varieties once flourished in south - east asia , one single kind now occupies two - thirds of the land .

reference_raw: Where 30,000 rice varieties once prospered in Southeast Asia, one species now occupys two-thirds of the country.

reference_spacy_tokens: Where 30,000 rice varieties once prospered in Southeast Asia , one species now occupys two - thirds of the country .


fn_spacy_tokens_for_baseline: And what use is it to provide more and more high - performance cultural facilities ( an unpleasing phrase ) if the artists who ought to be benefiting from them are lacking ?

source_bert_toks: and what use is it to provide more and more high - performance cultural facilities ( an un ##ple ##asi ##ng phrase ) if the artists who ought to be benefit ##ing from them are lacking ?

reference_raw: And what's the point of providing more and more high-performance cultural facilities (unpleasant phrase) when the artists who should benefit from them are missing?

reference_spacy_tokens: And what 's the point of providing more and more high - performance cultural facilities ( unpleasant phrase ) when the artists who should benefit from them are missing ?


fn_spacy_tokens_for_baseline: One is reminded of modernist poetry ; the echoes and reverberation of Eliot , the Imagists ' individual statements within a given form .

source_bert_toks: one is reminded of modernist poetry ; the echoes and rev ##er ##ber ##ation of eliot , the im ##agi ##sts ' individual statements within a given form .

reference_raw: One remembers modernist poems; echoes and echoes of Eliot, the individual statements of the Imagists in a given form.

reference_spacy_tokens: One remembers modernist poems ; echoes and echoes of Eliot , the individual statements of the Imagists in a given form .


fn_spacy_tokens_for_baseline: A sports and community hall was built on the sports field .

source_bert_toks: a sports and community hall was built on the sports field .

reference_raw: Sports and community rooms were built on a sporting field.

reference_spacy_tokens: Sports and community rooms were built on a sporting field .


fn_spacy_tokens_for_baseline: The compartment was filled by two middle - aged German couples with a sticky and unhappy child .

source_bert_toks: the compartment was filled by two middle - aged german couples with a sticky and unhappy child .

reference_raw: Two middle-aged German couples with a sticky, unhappy child crowded the compartment.

reference_spacy_tokens: Two middle - aged German couples with a sticky , unhappy child crowded the compartment .


fn_spacy_tokens_for_baseline: The stores were overrun with rats and mice and the cats came to feast on these rodent pests , thereby endearing themselves to the Egyptian people .

source_bert_toks: the stores were overrun with rats and mice and the cats came to feast on these rode ##nt pest ##s , thereby end ##earing themselves to the egyptian people .

reference_raw: The stores were crowded with rats and mice, and the cats had come to feed on these rodent pests, to feed on the Egyptians.

reference_spacy_tokens: The stores were crowded with rats and mice , and the cats had come to feed on these rodent pests , to feed on the Egyptians .


fn_spacy_tokens_for_baseline: Macau 's population is estimated at around 450,000 , an appallingly high figure for such a small area ; recent land reclamation has eased the situation to some extent .

source_bert_toks: macau ' s population is estimated at around 450 , 000 , an app ##all ##ingly high figure for such a small area ; recent land reclamation has eased the situation to some extent .

reference_raw: The population of Macau is estimated to be about 450,000, which is an appallingly high figure for such a small area; the recent land reclamation has eased the situation to a certain extent.

reference_spacy_tokens: The population of Macau is estimated to be about 450,000 , which is an appallingly high figure for such a small area ; the recent land reclamation has eased the situation to a certain extent .


fn_spacy_tokens_for_baseline: He was ever precise .

source_bert_toks: he was ever precise .

reference_raw: He's always been accurate.

reference_spacy_tokens: He 's always been accurate .


fn_spacy_tokens_for_baseline: Even when their vet warned them that Lizzie was getting on , they did n't realise just how much she had aged .

source_bert_toks: even when their vet warned them that lizzie was getting on , they didn ' t realise just how much she had aged .

reference_raw: Even when the vet warned them Lizzie was getting along, they didn't realize how old she was.

reference_spacy_tokens: Even when the vet warned them Lizzie was getting along , they did n't realize how old she was .


fn_spacy_tokens_for_baseline: Tony was with Miaco from its inception in 1967 when it was located at Hal Far airfield ( more of this in the January issue ) , moving through to the Hal Safi site in February 1979 .

source_bert_toks: tony was with mia ##co from its inception in 1967 when it was located at hal far airfield ( more of this in the january issue ) , moving through to the hal sa ##fi site in february 1979 .

reference_raw: Tony had been with Miaco since its inception in 1967, when he was stationed at Hal Far Airport (mostly in the January edition) and moved to Hal Safi in February 1979.

reference_spacy_tokens: Tony had been with Miaco since its inception in 1967 , when he was stationed at Hal Far Airport ( mostly in the January edition ) and moved to Hal Safi in February 1979 .


fn_spacy_tokens_for_baseline: During laparotomy , 2 cm of more proximal bile duct was missing and bile leaked from the common hepatic duct into the abdominal cavity , explaining the absence of obstructive jaundice .

source_bert_toks: during lap ##aro ##tom ##y , 2 cm of more pro ##xi ##mal bile duct was missing and bile leaked from the common he ##pati ##c duct into the abdominal cavity , explaining the absence of ob ##st ##ru ##ctive ja ##und ##ice .

reference_raw: During the laparotomy, 2 cm of more proximal bile duct was missing, and bile flowed from the normal liver duct to the abdomen, explaining the absence of obstructive jaundice.

reference_spacy_tokens: During the laparotomy , 2 cm of more proximal bile duct was missing , and bile flowed from the normal liver duct to the abdomen , explaining the absence of obstructive jaundice .


fn_spacy_tokens_for_baseline: She sidled along the drive after her husband and up to the front door .

source_bert_toks: she sid ##led along the drive after her husband and up to the front door .

reference_raw: She followed her husband down the driveway to the front door.

reference_spacy_tokens: She followed her husband down the driveway to the front door .


fn_spacy_tokens_for_baseline: Fifth , the theory may provide at least a partial reason for why ticket splitting has been particularly pronounced in the South .

source_bert_toks: fifth , the theory may provide at least a partial reason for why ticket splitting has been particularly pronounced in the south .

reference_raw: Fifth, the theory may give at least a partial reason why the distribution of tickets is particularly pronounced in the South.

reference_spacy_tokens: Fifth , the theory may give at least a partial reason why the distribution of tickets is particularly pronounced in the South .


fn_spacy_tokens_for_baseline: We decided to walk to the waterfall to see what Gullfoss , well known to us in the summer , had to offer in winter .

source_bert_toks: we decided to walk to the waterfall to see what gu ##ll ##fo ##ss , well known to us in the summer , had to offer in winter .

reference_raw: We decided to go to the falls and see what Gullfoss, well known in the summer, had to offer in the winter.

reference_spacy_tokens: We decided to go to the falls and see what Gullfoss , well known in the summer , had to offer in the winter .


fn_spacy_tokens_for_baseline: Or has he forgotten that ?

source_bert_toks: or has he forgotten that ?

reference_raw: Or did he leave it out of his mind?

reference_spacy_tokens: Or did he leave it out of his mind ?


fn_spacy_tokens_for_baseline: ' So you just barge into my bedroom and wake me up ? '

source_bert_toks: ' so you just barge into my bedroom and wake me up ? '

reference_raw: "So you're just going to break into my room and wake me up?"

reference_spacy_tokens: " So you 're just going to break into my room and wake me up ? "


fn_spacy_tokens_for_baseline: His hair naturally curled to his shoulders .

source_bert_toks: his hair naturally curled to his shoulders .

reference_raw: Naturally, his hair twitched to his shoulders.

reference_spacy_tokens: Naturally , his hair twitched to his shoulders .


fn_spacy_tokens_for_baseline: But as she reached him the vision shimmered and disappeared and she was alone , stumbling as she tried to find her way through the shadows of a forest , mist cloaking the branches of the trees .

source_bert_toks: but as she reached him the vision shi ##mmer ##ed and disappeared and she was alone , stumbling as she tried to find her way through the shadows of a forest , mist cloak ##ing the branches of the trees .

reference_raw: But when she got to him, the vision shimmered and vanished, and she was alone, stumbling as she tried to find her way through the shadows of the forest, the mist covering the branches of the trees.

reference_spacy_tokens: But when she got to him , the vision shimmered and vanished , and she was alone , stumbling as she tried to find her way through the shadows of the forest , the mist covering the branches of the trees .


fn_spacy_tokens_for_baseline: ' Oh yes it is , ' responded Mark .

source_bert_toks: ' oh yes it is , ' responded mark .

reference_raw: 'Ah, yes,' said Mark.

reference_spacy_tokens: ' Ah , yes , ' said Mark .


fn_spacy_tokens_for_baseline: Though I 'd visited the family in Al Ain and Abu Dhabi , it had been two years since I 'd been to their camp on the Gulf .

source_bert_toks: though i ' d visited the family in al ain and abu dhabi , it had been two years since i ' d been to their camp on the gulf .

reference_raw: Although I visited my family in Al Ain and Abu Dhabi, it had been two years since I had been in their encampment in the Gulf.

reference_spacy_tokens: Although I visited my family in Al Ain and Abu Dhabi , it had been two years since I had been in their encampment in the Gulf .


fn_spacy_tokens_for_baseline: The state legislature helped as well , by legalizing gambling in 1931 and thus solidifying the future of the town , though legislators and residents could never have known this at the time .

source_bert_toks: the state legislature helped as well , by legal ##izing gambling in 1931 and thus solid ##ifying the future of the town , though legislators and residents could never have known this at the time .

reference_raw: The State legislator also helped to legalize gambling in 1931 and thus strengthen the future of the city, although legislators and residents could not have known at the time.

reference_spacy_tokens: The State legislator also helped to legalize gambling in 1931 and thus strengthen the future of the city , although legislators and residents could not have known at the time .


fn_spacy_tokens_for_baseline: 1- The lower part of the tower should serve as a shelter for the guards , when needed .

source_bert_toks: 1 - the lower part of the tower should serve as a shelter for the guards , when needed .

reference_raw: 1- The lower part of the tower should, if necessary, serve as a protector's hiding place.

reference_spacy_tokens: 1- The lower part of the tower should , if necessary , serve as a protector 's hiding place .


fn_spacy_tokens_for_baseline: I arrived at work on the Monday and was handed a cheque and my personal belongings at the desk in the foyer and was then escorted out by Security .

source_bert_toks: i arrived at work on the monday and was handed a che ##que and my personal belongings at the desk in the foyer and was then escorted out by security .

reference_raw: I got to work on Monday, got a check and personal effects from a desk in the foyer, and the security guard escorted me out.

reference_spacy_tokens: I got to work on Monday , got a check and personal effects from a desk in the foyer , and the security guard escorted me out .


fn_spacy_tokens_for_baseline: He vaulted over the gate and hurried up the narrow driveway .

source_bert_toks: he vaulted over the gate and hurried up the narrow driveway .

reference_raw: He vaulted over the gate and hurried down the narrow drive.

reference_spacy_tokens: He vaulted over the gate and hurried down the narrow drive .


fn_spacy_tokens_for_baseline: " It 's . it 's you who 's being so unreasonable , " she stammered .

source_bert_toks: " it ' s . it ' s you who ' s being so unreasonable , " she stammered .

reference_raw: "You're the one who's being so unreasonable," she said.

reference_spacy_tokens: " You 're the one who 's being so unreasonable , " she said .


fn_spacy_tokens_for_baseline: Spencer 's magnificent self - portrait of 1914 , dark and mysterious as a Rembrandt , was snatched up by an important London collector .

source_bert_toks: spencer ' s magnificent self - portrait of 1914 , dark and mysterious as a re ##mb ##rand ##t , was snatched up by an important london collector .

reference_raw: Spencer's beautiful 1914 self-portrait, black and mysterious as the Rembrandt, was captured by an important London collector.

reference_spacy_tokens: Spencer 's beautiful 1914 self - portrait , black and mysterious as the Rembrandt , was captured by an important London collector .


fn_spacy_tokens_for_baseline: Citibus also travels to Guangzhou from CHKC ; there are five round - trips a day , taking 3 1/2 hours .

source_bert_toks: ci ##ti ##bus also travels to guangzhou from ch ##k ##c ; there are five round - trips a day , taking 3 1 / 2 hours .

reference_raw: Citibus also travels from CHKC to Guangzhou; there are five round trips a day, which lasts three and a half hours.

reference_spacy_tokens: Citibus also travels from CHKC to Guangzhou ; there are five round trips a day , which lasts three and a half hours .


fn_spacy_tokens_for_baseline: We found cocoa very comforting , and quite deprecated Chesterton 's rhyme :

source_bert_toks: we found cocoa very comforting , and quite de ##pre ##cated chester ##ton ' s rhyme :

reference_raw: We found cocoa very reassuring, and quite deprecated Chesterton's rhyme:

reference_spacy_tokens: We found cocoa very reassuring , and quite deprecated Chesterton 's rhyme :


fn_spacy_tokens_for_baseline: So in theory , you do n't have to save your work , and exit properly before you switch off ; the AccuCard will remember where you were and return you there next time you switch on .

source_bert_toks: so in theory , you don ' t have to save your work , and exit properly before you switch off ; the acc ##uca ##rd will remember where you were and return you there next time you switch on .

reference_raw: So, theoretically, you don't have to save your job and get out of it properly before you turn it off; the AccuCard will remember where you were and put you back in the next time you turn it on.

reference_spacy_tokens: So , theoretically , you do n't have to save your job and get out of it properly before you turn it off ; the AccuCard will remember where you were and put you back in the next time you turn it on .


fn_spacy_tokens_for_baseline: The fault 's western side is moving inexorably northward at a rate of five cm a year and should be part of Alaska in about 50 million years .

source_bert_toks: the fault ' s western side is moving in ##ex ##ora ##bly northward at a rate of five cm a year and should be part of alaska in about 50 million years .

reference_raw: The west side of the fault moves relentlessly north at five centimeters a year and should be part of Alaska in about 50 million years.

reference_spacy_tokens: The west side of the fault moves relentlessly north at five centimeters a year and should be part of Alaska in about 50 million years .


fn_spacy_tokens_for_baseline: And Helga Samuel was given every support and care by her well - off foster parents .

source_bert_toks: and he ##lga samuel was given every support and care by her well - off foster parents .

reference_raw: And Helga Samuel got all the support and care from her wealthy foster parents.

reference_spacy_tokens: And Helga Samuel got all the support and care from her wealthy foster parents .


fn_spacy_tokens_for_baseline: In May 1998 , the London Daily Telegraph reported that " Iran has concluded a secret deal with China to purchase banned chemicals that will enable it to become self - sufficient in producing large stockpiles of advanced nerve gas . "

source_bert_toks: in may 1998 , the london daily telegraph reported that " iran has concluded a secret deal with china to purchase banned chemicals that will enable it to become self - sufficient in producing large stock ##pile ##s of advanced nerve gas . "

reference_raw: In May 1998, the London Daily Telegraph announced that "Iran had concluded a secret agreement with China on the purchase of banned chemicals that would allow it to become self-sufficient in the production of large stocks of high-tech nerve gas."

reference_spacy_tokens: In May 1998 , the London Daily Telegraph announced that " Iran had concluded a secret agreement with China on the purchase of banned chemicals that would allow it to become self - sufficient in the production of large stocks of high - tech nerve gas . "


fn_spacy_tokens_for_baseline: Norway also produces Gjetost , a sweet , dark brown , fudge - like cheese that should be pared or sliced very thinly .

source_bert_toks: norway also produces g ##jet ##ost , a sweet , dark brown , fu ##dge - like cheese that should be par ##ed or sliced very thin ##ly .

reference_raw: Norway also produces Gjetost, a sweet, dark-brown, fruit-like cheese, which should be pared or cut very thinly.

reference_spacy_tokens: Norway also produces Gjetost , a sweet , dark - brown , fruit - like cheese , which should be pared or cut very thinly .


fn_spacy_tokens_for_baseline: A rocket atop the Warlord tracked tentatively towards the shuddering Emperor .

source_bert_toks: a rocket atop the warlord tracked tentatively towards the shuddering emperor .

reference_raw: The missile at the top of the Warlord watched the trembling Emperor tentatively.

reference_spacy_tokens: The missile at the top of the Warlord watched the trembling Emperor tentatively .


fn_spacy_tokens_for_baseline: Greenpeace hopes to identify individual dolphins by the bite and fight marks on their fins , and to chart their behaviour in an effort to protect them from extinction .

source_bert_toks: green ##pe ##ace hopes to identify individual dolphins by the bite and fight marks on their fins , and to chart their behaviour in an effort to protect them from extinction .

reference_raw: Greenpeace hopes to detect individual dolphins by biting and fighting marks on their fins, and map their behavior in an effort to protect them from extinction.

reference_spacy_tokens: Greenpeace hopes to detect individual dolphins by biting and fighting marks on their fins , and map their behavior in an effort to protect them from extinction .


fn_spacy_tokens_for_baseline: Without bothering to bag it , he stuffed the jib down into the sail - locker and lashed the main to the boom .

source_bert_toks: without bothering to bag it , he stuffed the ji ##b down into the sail - locker and lashed the main to the boom .

reference_raw: Without bothering to pack it, he stuffed the jib into the sail-locker and lashed the main into the boom.

reference_spacy_tokens: Without bothering to pack it , he stuffed the jib into the sail - locker and lashed the main into the boom .


fn_spacy_tokens_for_baseline: Some are on split levels , all are comfortable , full of atmosphere , and boasting an abundance of beautiful furniture and rafted ceilings .

source_bert_toks: some are on split levels , all are comfortable , full of atmosphere , and bo ##ast ##ing an abundance of beautiful furniture and raft ##ed ceilings .

reference_raw: Some of them are on separate floors, all comfortable, full of atmosphere, and boastful of beautiful furniture and rafted ceilings.

reference_spacy_tokens: Some of them are on separate floors , all comfortable , full of atmosphere , and boastful of beautiful furniture and rafted ceilings .


fn_spacy_tokens_for_baseline: The Green Man wore a coronet of leaves and a girdle of stems at his waist .

source_bert_toks: the green man wore a co ##rone ##t of leaves and a gi ##rd ##le of stems at his waist .

reference_raw: The green man wore a crown of leaves and a string of stalks at his waist.

reference_spacy_tokens: The green man wore a crown of leaves and a string of stalks at his waist .


fn_spacy_tokens_for_baseline: ' This guy wanted us to do a gig in this really horrible place .

source_bert_toks: ' this guy wanted us to do a gig in this really horrible place .

reference_raw: 'This guy wanted us to do a concert in this really awful place.

reference_spacy_tokens: ' This guy wanted us to do a concert in this really awful place .


fn_spacy_tokens_for_baseline: Martha paused with her , noticing that Hyacinth was sweating heavily and her skin , normally plump and smooth , looked oddly withered and sunken around her eyes .

source_bert_toks: martha paused with her , noticing that h ##ya ##cin ##th was sweating heavily and her skin , normally plump and smooth , looked oddly with ##ered and sunken around her eyes .

reference_raw: Martha paused with her, noticing that Hyacinth was pulsing heavily, and her skin, normally plump and smooth, seemed strangely wilted and sunken around her eyes.

reference_spacy_tokens: Martha paused with her , noticing that Hyacinth was pulsing heavily , and her skin , normally plump and smooth , seemed strangely wilted and sunken around her eyes .


fn_spacy_tokens_for_baseline: Ideally , every trailer should be anchored by the ball hitch on to a ball mounted in the ground .

source_bert_toks: ideally , every trailer should be anchored by the ball hitch on to a ball mounted in the ground .

reference_raw: Ideally, each trailer should be docked by a hitch on a ball mounted on the ground.

reference_spacy_tokens: Ideally , each trailer should be docked by a hitch on a ball mounted on the ground .


fn_spacy_tokens_for_baseline: ' You will not coax me into an indiscretion , so save your breath . '

source_bert_toks: ' you will not coa ##x me into an ind ##is ##cre ##tion , so save your breath . '

reference_raw: "You won't force me into indiscretion, so save your breath."

reference_spacy_tokens: " You wo n't force me into indiscretion , so save your breath . "


fn_spacy_tokens_for_baseline: Is my right hon . Friend at all surprised that the local health authority wants nothing to do with that document because it is pure Labour party propaganda and a cynical manipulation of the elderly and the frail ?

source_bert_toks: is my right hon . friend at all surprised that the local health authority wants nothing to do with that document because it is pure labour party propaganda and a cynical manipulation of the elderly and the frail ?

reference_raw: My friend is surprised that the local health authority doesn't want anything to do with this document because it's pure propaganda from the Labour Party and cynic manipulation of the elderly and the weak?

reference_spacy_tokens: My friend is surprised that the local health authority does n't want anything to do with this document because it 's pure propaganda from the Labour Party and cynic manipulation of the elderly and the weak ?


fn_spacy_tokens_for_baseline: Further , a dim counsellor is easily outwitted by the ' cunning , baffling and powerful ' addictive disease , as described in the ' Big Book ' of Alcoholics Anonymous .

source_bert_toks: further , a dim counsel ##lor is easily out ##wi ##tted by the ' cunning , ba ##ff ##ling and powerful ' addict ##ive disease , as described in the ' big book ' of alcoholic ##s anonymous .

reference_raw: In addition, a vague adviser is easily outwitted by the cunning, confusing and powerful addictive disease described in the "Big Book" of Alcoholics Anonymous.

reference_spacy_tokens: In addition , a vague adviser is easily outwitted by the cunning , confusing and powerful addictive disease described in the " Big Book " of Alcoholics Anonymous .


fn_spacy_tokens_for_baseline: During this period , East Coast Syndicate member Benjamin'Bugsy ' Siegel earned a foothold as a local casino operator .

source_bert_toks: during this period , east coast syndicate member benjamin ' bugs ##y ' siegel earned a foot ##hold as a local casino operator .

reference_raw: In that period, a member of the East Coast Syndicate Benjamin'Bugsy 'Siegel earned a foothold as a local casino operator.

reference_spacy_tokens: In that period , a member of the East Coast Syndicate Benjamin'Bugsy ' Siegel earned a foothold as a local casino operator .


fn_spacy_tokens_for_baseline: Duncan had been surprised by the policeman 's astuteness in deciding to investigate the Catherine Palace .

source_bert_toks: duncan had been surprised by the policeman ' s as ##tute ##ness in deciding to investigate the catherine palace .

reference_raw: Duncan was surprised at the cop's adolescence in his decision to investigate the Catherine Palace.

reference_spacy_tokens: Duncan was surprised at the cop 's adolescence in his decision to investigate the Catherine Palace .


fn_spacy_tokens_for_baseline: One attractive alternative to brushing bronzing powder on your cheeks is cream blusher : blend it in well with your fingertips over a base of tinted moisturiser , then dust any areas prone to shine with powder .

source_bert_toks: one attractive alternative to brushing bro ##nz ##ing powder on your cheeks is cream blush ##er : blend it in well with your fingertips over a base of tinted moist ##uri ##ser , then dust any areas prone to shine with powder .

reference_raw: One attractive alternative to dusting the bronze powder on the cheeks is the creamy flusher: mix it well with the tips of your fingers on the base of the tinted damper, and then dust any areas that are likely to shine with the powder.

reference_spacy_tokens: One attractive alternative to dusting the bronze powder on the cheeks is the creamy flusher : mix it well with the tips of your fingers on the base of the tinted damper , and then dust any areas that are likely to shine with the powder .


fn_spacy_tokens_for_baseline: I would rather forgo a very attractive acquisition if it would mean stretching the balance sheet

source_bert_toks: i would rather for ##go a very attractive acquisition if it would mean stretching the balance sheet

reference_raw: I'd rather give up a very attractive acquisition if that would mean stretching the balance sheet.

reference_spacy_tokens: I 'd rather give up a very attractive acquisition if that would mean stretching the balance sheet .


fn_spacy_tokens_for_baseline: During her interrogation she was given electric shocks , punched in the stomach and raped with a truncheon .

source_bert_toks: during her interrogation she was given electric shocks , punched in the stomach and raped with a tr ##un ##cheon .

reference_raw: She was electrocuted during the interview, punched in the stomach, and raped with a truncheon.

reference_spacy_tokens: She was electrocuted during the interview , punched in the stomach , and raped with a truncheon .


fn_spacy_tokens_for_baseline: Cockney dads were in form , threatening their kids with the belt if they misbehaved .

source_bert_toks: cock ##ney dad ##s were in form , threatening their kids with the belt if they mis ##be ##ha ##ved .

reference_raw: Cockney's fathers were in shape, threatening their children with a belt if they behaved badly.

reference_spacy_tokens: Cockney 's fathers were in shape , threatening their children with a belt if they behaved badly .


fn_spacy_tokens_for_baseline: Taking the roll of tools out of my stout and well travelled haversack , I unscrewed the plate with only a little difficulty and put it into the haversack .

source_bert_toks: taking the roll of tools out of my stout and well travelled have ##rsa ##ck , i un ##sc ##rew ##ed the plate with only a little difficulty and put it into the have ##rsa ##ck .

reference_raw: I took a roll of tools from my stout and well-traveled backpack, unscrewed it with a little difficulty, and put it in my backpack.

reference_spacy_tokens: I took a roll of tools from my stout and well - traveled backpack , unscrewed it with a little difficulty , and put it in my backpack .


fn_spacy_tokens_for_baseline: One can read off what will count as obeying an order from the order itself .

source_bert_toks: one can read off what will count as obey ##ing an order from the order itself .

reference_raw: You can read off what counts as following an order from the order itself.

reference_spacy_tokens: You can read off what counts as following an order from the order itself .


fn_spacy_tokens_for_baseline: ' I 'll warrant he is ! ' the old lady cackled unexpectedly .

source_bert_toks: ' i ' ll warrant he is ! ' the old lady ca ##ckle ##d unexpectedly .

reference_raw: 'I'll give you permission!' said the old woman, suddenly.

reference_spacy_tokens: ' I 'll give you permission ! ' said the old woman , suddenly .


fn_spacy_tokens_for_baseline: He spends his time drunk on excellent local wines , fantasizing a very fulfilling populist Catharism .

source_bert_toks: he spends his time drunk on excellent local wines , fan ##tas ##izing a very fulfilling pop ##uli ##st cat ##hari ##sm .

reference_raw: He spends his days drunk on excellent local wines, fantasizing about a very satisfying populist catharism.

reference_spacy_tokens: He spends his days drunk on excellent local wines , fantasizing about a very satisfying populist catharism .


fn_spacy_tokens_for_baseline: On the reverse of each plate is Cicely Mary Barker 's original poem that she penned for each fairy .

source_bert_toks: on the reverse of each plate is ci ##cel ##y mary barker ' s original poem that she penned for each fairy .

reference_raw: On the other side of each plate is the original poem of Cicely Mary Barker, which she wrote for every fairy.

reference_spacy_tokens: On the other side of each plate is the original poem of Cicely Mary Barker , which she wrote for every fairy .


fn_spacy_tokens_for_baseline: The main highway makes a circuit of the New Territories , beginning with the new town of Tsuen Wan , situated in an area of heavy industry just west of Kowloon .

source_bert_toks: the main highway makes a circuit of the new territories , beginning with the new town of ts ##uen wan , situated in an area of heavy industry just west of ko ##wl ##oon .

reference_raw: The main road runs around the new territories, starting with the new city of Tsuen Wan, which is located in a heavy industrial area just west of Kowloon.

reference_spacy_tokens: The main road runs around the new territories , starting with the new city of Tsuen Wan , which is located in a heavy industrial area just west of Kowloon .


fn_spacy_tokens_for_baseline: Patrick Seymour telephoned Vice - President Odell personally , on a secure line .

source_bert_toks: patrick seymour telephone ##d vice - president ode ##ll personally , on a secure line .

reference_raw: Patrick Seymour made a personal call to Vice President Odell on a secure line.

reference_spacy_tokens: Patrick Seymour made a personal call to Vice President Odell on a secure line .


fn_spacy_tokens_for_baseline: The biopsy tissue specimens taken from the gastric antrum or the second half of the duodenum were collected to make a pool from each subject of about 25 mg ( range 20 - 30 mg ) of fresh tissue .

source_bert_toks: the bio ##psy tissue specimens taken from the gas ##tric ant ##rum or the second half of the duo ##den ##um were collected to make a pool from each subject of about 25 mg ( range 20 - 30 mg ) of fresh tissue .

reference_raw: Samples of biopsy tissue taken from the stomach antrum or the second half of duodenum were collected to form a pool of approximately 25 mg (range 20 to 30 mg) of fresh tissue from each subject.

reference_spacy_tokens: Samples of biopsy tissue taken from the stomach antrum or the second half of duodenum were collected to form a pool of approximately 25 mg ( range 20 to 30 mg ) of fresh tissue from each subject .


fn_spacy_tokens_for_baseline: The fact remains , and will become more and more evident as the year goes by , that the deliberate under - funding of the Act was an act of incompetence by incompetent ministers .

source_bert_toks: the fact remains , and will become more and more evident as the year goes by , that the deliberate under - funding of the act was an act of inc ##omp ##ete ##nce by inc ##omp ##ete ##nt ministers .

reference_raw: The fact remains, and will become more and more evident as the year passes, that the intentional underfunding of the Act was an act of incompetent ministers.

reference_spacy_tokens: The fact remains , and will become more and more evident as the year passes , that the intentional underfunding of the Act was an act of incompetent ministers .


fn_spacy_tokens_for_baseline: ' I never expected travelling on foot to be so arduous , ' she said .

source_bert_toks: ' i never expected travelling on foot to be so ar ##du ##ous , ' she said .

reference_raw: 'I didn't expect walking to be so hard,' she said.

reference_spacy_tokens: ' I did n't expect walking to be so hard , ' she said .


fn_spacy_tokens_for_baseline: History is set out in apparently discouraging detail .

source_bert_toks: history is set out in apparently disco ##ura ##ging detail .

reference_raw: History is set out in seemingly disconcerting detail.

reference_spacy_tokens: History is set out in seemingly disconcerting detail .


fn_spacy_tokens_for_baseline: The old T'ang accepted Nocenzi 's resignation before he died .

source_bert_toks: the old t ' ang accepted no ##cen ##zi ' s resignation before he died .

reference_raw: Before he died, the old T'ang accepted the resignment of Nocenzi.

reference_spacy_tokens: Before he died , the old T'ang accepted the resignment of Nocenzi .


fn_spacy_tokens_for_baseline: He takes himself to have true premises and a valid inference to a true conclusion ; the premises might include the proposition that in the past he has made mistakes .

source_bert_toks: he takes himself to have true premises and a valid inference to a true conclusion ; the premises might include the proposition that in the past he has made mistakes .

reference_raw: It accepts that it has real premises and a valid conclusion; the premises may include a suggestion that it has made mistakes in the past.

reference_spacy_tokens: It accepts that it has real premises and a valid conclusion ; the premises may include a suggestion that it has made mistakes in the past .


fn_spacy_tokens_for_baseline: Magistrates used the in loco parentis provision of the Criminal Justice Act to impel the authority to compensate the 78-year - old woman who had her bag snatched by the youth .

source_bert_toks: magistrates used the in loco parent ##is provision of the criminal justice act to imp ##el the authority to compensate the 78 - year - old woman who had her bag snatched by the youth .

reference_raw: The magistrates used the provisions of the Criminal Justice Act in loco parentis to force the authority to compensate a 78-year-old woman who had her bag stolen by a young woman.

reference_spacy_tokens: The magistrates used the provisions of the Criminal Justice Act in loco parentis to force the authority to compensate a 78-year - old woman who had her bag stolen by a young woman .


fn_spacy_tokens_for_baseline: The maiden name of one of his wives ( probably the second ) was Watt .

source_bert_toks: the maiden name of one of his wives ( probably the second ) was watt .

reference_raw: One of his women's virgin names (probably the other) was Watt.

reference_spacy_tokens: One of his women 's virgin names ( probably the other ) was Watt .


fn_spacy_tokens_for_baseline: He said : ' I was made out to be the bad guy .

source_bert_toks: he said : ' i was made out to be the bad guy .

reference_raw: He said, "They made me the villain.

reference_spacy_tokens: He said , " They made me the villain .


fn_spacy_tokens_for_baseline: Her voice sounded a little strained , but only Portia caught the odd pitying look she gave Katherine as the girl rushed towards the salon .

source_bert_toks: her voice sounded a little strained , but only port ##ia caught the odd pity ##ing look she gave katherine as the girl rushed towards the salon .

reference_raw: Her voice was a little tense, but only Portia caught the strange, sympathetic look she gave Katherine as she hurried to the parlor.

reference_spacy_tokens: Her voice was a little tense , but only Portia caught the strange , sympathetic look she gave Katherine as she hurried to the parlor .


fn_spacy_tokens_for_baseline: Intensive road testing of the first ten Class 91s started in the spring of 1988 and the first public services with the new Mk 4 stock started between King 's Cross and Leeds in October 1989 .

source_bert_toks: intensive road testing of the first ten class 91 ##s started in the spring of 1988 and the first public services with the new mk 4 stock started between king ' s cross and leeds in october 1989 .

reference_raw: Intensive road trials for the first 10 Class 91s were launched in the spring of 1988 and the first public service with the new MK 4 stock was launched between King's Cross and Leeds in October 1989.

reference_spacy_tokens: Intensive road trials for the first 10 Class 91s were launched in the spring of 1988 and the first public service with the new MK 4 stock was launched between King 's Cross and Leeds in October 1989 .


fn_spacy_tokens_for_baseline: A massive , antiquated fan whirred and clattered in the corner of the office , turning on its metal stem , examining them one by one .

source_bert_toks: a massive , anti ##qua ##ted fan w ##hir ##red and cl ##atter ##ed in the corner of the office , turning on its metal stem , examining them one by one .

reference_raw: In the corner of the office, a huge, ancient fan whirred and rattled, turned on its metal stem and examined it one by one.

reference_spacy_tokens: In the corner of the office , a huge , ancient fan whirred and rattled , turned on its metal stem and examined it one by one .


fn_spacy_tokens_for_baseline: Dry desert gave way to blue lagoons full of water lilies , palm trees , islands and deep blue lakes .

source_bert_toks: dry desert gave way to blue lagoon ##s full of water lil ##ies , palm trees , islands and deep blue lakes .

reference_raw: The dry desert gave way to blue lagoons filled with water lilies, palm trees, islands, and dark blue lakes.

reference_spacy_tokens: The dry desert gave way to blue lagoons filled with water lilies , palm trees , islands , and dark blue lakes .


fn_spacy_tokens_for_baseline: Internationally , the most widely used approach is based on the international disease classification developed at Yale University .

source_bert_toks: internationally , the most widely used approach is based on the international disease classification developed at yale university .

reference_raw: At international level, the most widely used approach is based on the international nomenclature of diseases developed at Yale University.

reference_spacy_tokens: At international level , the most widely used approach is based on the international nomenclature of diseases developed at Yale University .


fn_spacy_tokens_for_baseline: The brain must extract , from a novel view of a face , the information necessary to achieve a match with a representation stored in memory .

source_bert_toks: the brain must extract , from a novel view of a face , the information necessary to achieve a match with a representation stored in memory .

reference_raw: From a new face view, the brain must obtain the information necessary to match the image stored in memory.

reference_spacy_tokens: From a new face view , the brain must obtain the information necessary to match the image stored in memory .


fn_spacy_tokens_for_baseline: Limiting oneself to just the products that run on the standard graphics card , be it colour or monochrome , reduces the options to a mere handful .

source_bert_toks: limiting oneself to just the products that run on the standard graphics card , be it colour or mono ##chrome , reduces the options to a mere handful .

reference_raw: Limiting yourself to products that run on a standard graphics card, whether coloured or monochrome, reduces the options to a few.

reference_spacy_tokens: Limiting yourself to products that run on a standard graphics card , whether coloured or monochrome , reduces the options to a few .


fn_spacy_tokens_for_baseline: Sometimes she 'd turn on her heel , snarling , and lunge at a dog that had gradually edged over and positioned itself expectantly behind her .

source_bert_toks: sometimes she ' d turn on her heel , snarl ##ing , and lung ##e at a dog that had gradually edged over and positioned itself expect ##antly behind her .

reference_raw: Occasionally she turned on her heel, snarled, and lunged at the dog, who had come over and positioned herself expectantly behind her.

reference_spacy_tokens: Occasionally she turned on her heel , snarled , and lunged at the dog , who had come over and positioned herself expectantly behind her .


fn_spacy_tokens_for_baseline: Iran is seeking foreign sources for many elements of the nuclear fuel cycle .

source_bert_toks: iran is seeking foreign sources for many elements of the nuclear fuel cycle .

reference_raw: Iran is looking for foreign resources for many elements of the nuclear fuel cycle.

reference_spacy_tokens: Iran is looking for foreign resources for many elements of the nuclear fuel cycle .


fn_spacy_tokens_for_baseline: He squatted and started to pick them up , then let them drop back to the floor and just crouched there and put his hands over his face and started to cry .

source_bert_toks: he squat ##ted and started to pick them up , then let them drop back to the floor and just crouched there and put his hands over his face and started to cry .

reference_raw: He crouched down and started to pick them up, then dropped them to the floor, crouched there, put his hands on his face, and began to cry.

reference_spacy_tokens: He crouched down and started to pick them up , then dropped them to the floor , crouched there , put his hands on his face , and began to cry .


fn_spacy_tokens_for_baseline: There seems to be rather a lot of names for those who share a proclivity for their own sex .

source_bert_toks: there seems to be rather a lot of names for those who share a pro ##cl ##ivity for their own sex .

reference_raw: There seem to be quite a lot of names for those who have a tendency to have sex.

reference_spacy_tokens: There seem to be quite a lot of names for those who have a tendency to have sex .


fn_spacy_tokens_for_baseline: Urgent plans were being made at the London office to fly next of kin to Katmandu tomorrow .

source_bert_toks: urgent plans were being made at the london office to fly next of kin to kat ##man ##du tomorrow .

reference_raw: There were urgent plans in the London office for tomorrow's next-of-kin flight to Katmandu.

reference_spacy_tokens: There were urgent plans in the London office for tomorrow 's next - of - kin flight to Katmandu .


fn_spacy_tokens_for_baseline: Two floors above , Jude heard what she took to be a domestic argument , and not wanting somebody else 's marital strife to sour her fine mood , was crossing to turn up the soul song on the turntable when somebody knocked on the door .

source_bert_toks: two floors above , jude heard what she took to be a domestic argument , and not wanting somebody else ' s marital strife to sour her fine mood , was crossing to turn up the soul song on the turn ##table when somebody knocked on the door .

reference_raw: Two floors above her, Jude heard what she thought was a domestic argument, and he didn't want someone else's marital struggle to sour her fine mood, and he went over and started a soul song on the turntable when someone knocked on the door.

reference_spacy_tokens: Two floors above her , Jude heard what she thought was a domestic argument , and he did n't want someone else 's marital struggle to sour her fine mood , and he went over and started a soul song on the turntable when someone knocked on the door .


fn_spacy_tokens_for_baseline: Then , as we saw in the previous chapter , it was introduced in Scotland in 1989 and in England and Wales in 1990 , but it lasted for a very short period .

source_bert_toks: then , as we saw in the previous chapter , it was introduced in scotland in 1989 and in england and wales in 1990 , but it lasted for a very short period .

reference_raw: Then, as we have seen in the previous chapter, it was introduced in Scotland in 1989 and in England and Wales in 1990, but lasted very briefly.

reference_spacy_tokens: Then , as we have seen in the previous chapter , it was introduced in Scotland in 1989 and in England and Wales in 1990 , but lasted very briefly .


fn_spacy_tokens_for_baseline: At last they reached the village and joined the rest of the crowd as they thronged towards the green in front of the parish church .

source_bert_toks: at last they reached the village and joined the rest of the crowd as they th ##rong ##ed towards the green in front of the parish church .

reference_raw: At last they reached the village and joined the rest of the crowd as they crowded toward the green in front of the parish church.

reference_spacy_tokens: At last they reached the village and joined the rest of the crowd as they crowded toward the green in front of the parish church .


fn_spacy_tokens_for_baseline: The dryish curd is cut into big chunks and piled into huge tubs that are left to stand in the dairy overnight to allow the acidity and flavour to develop .

source_bert_toks: the dry ##ish cu ##rd is cut into big chunks and piled into huge tub ##s that are left to stand in the dairy overnight to allow the acid ##ity and flavour to develop .

reference_raw: The dry curd is cut into large pieces and stacked in large tubs, which remain in the milk overnight so that the acidity and taste can develop.

reference_spacy_tokens: The dry curd is cut into large pieces and stacked in large tubs , which remain in the milk overnight so that the acidity and taste can develop .


fn_spacy_tokens_for_baseline: Thick corkscrew curls conditioned for maximum shine .

source_bert_toks: thick cork ##sc ##rew curls conditioned for maximum shine .

reference_raw: The thick corkscrew coils are conditioned for maximum illumination.

reference_spacy_tokens: The thick corkscrew coils are conditioned for maximum illumination .


fn_spacy_tokens_for_baseline: Afterwards , we all trooped along the narrow path and inspected the flowers .

source_bert_toks: afterwards , we all troop ##ed along the narrow path and inspected the flowers .

reference_raw: Then we all marched along the narrow trail and looked at the flowers.

reference_spacy_tokens: Then we all marched along the narrow trail and looked at the flowers .


fn_spacy_tokens_for_baseline: A lender classifies a borrower on the basis of credit - worthiness which , in turn , depends on the borrower 's status , income , current loan commitments , purpose of the loan and so on .

source_bert_toks: a lend ##er class ##ifies a borrow ##er on the basis of credit - worth ##iness which , in turn , depends on the borrow ##er ' s status , income , current loan commitments , purpose of the loan and so on .

reference_raw: The creditor grades the debtor on the basis of the creditworthiness, which in turn depends on the debtor's status, income, current credit obligations, the purpose of the loan, etc.

reference_spacy_tokens: The creditor grades the debtor on the basis of the creditworthiness , which in turn depends on the debtor 's status , income , current credit obligations , the purpose of the loan , etc .


fn_spacy_tokens_for_baseline: The outside door beyond the kitchen scraped open and was banged shut .

source_bert_toks: the outside door beyond the kitchen scraped open and was banged shut .

reference_raw: The outer door behind the kitchen creaked open and was slammed shut.

reference_spacy_tokens: The outer door behind the kitchen creaked open and was slammed shut .


fn_spacy_tokens_for_baseline: This enormous , modern version of a traditional Chinese building , with sweeping blue tile roofs , contains an auditorium big enough to seat 4,700 people .

source_bert_toks: this enormous , modern version of a traditional chinese building , with sweeping blue tile roofs , contains an auditorium big enough to seat 4 , 700 people .

reference_raw: This huge, modern version of the traditional Chinese building, with sweeping blue tile ceilings, contains an auditorium large enough to accommodate 4,700 people.

reference_spacy_tokens: This huge , modern version of the traditional Chinese building , with sweeping blue tile ceilings , contains an auditorium large enough to accommodate 4,700 people .


fn_spacy_tokens_for_baseline: The Pact would provide for the withdrawal of Soviet forces following the formation of a coalition government in Kabul .

source_bert_toks: the pact would provide for the withdrawal of soviet forces following the formation of a coalition government in kabul .

reference_raw: The Pact would provide for the withdrawal of Soviet troops after the formation of a coalition government in Kabul.

reference_spacy_tokens: The Pact would provide for the withdrawal of Soviet troops after the formation of a coalition government in Kabul .


fn_spacy_tokens_for_baseline: I draw parallel with the door and crane forward to see into the room .

source_bert_toks: i draw parallel with the door and crane forward to see into the room .

reference_raw: I'm drawing parallel to the door, and I'm leaning forward to look into the room.

reference_spacy_tokens: I 'm drawing parallel to the door , and I 'm leaning forward to look into the room .


fn_spacy_tokens_for_baseline: She was drowsy with the wine .

source_bert_toks: she was dr ##ows ##y with the wine .

reference_raw: She was sleepy with wine.

reference_spacy_tokens: She was sleepy with wine .


fn_spacy_tokens_for_baseline: Jumbut allegedly stole over dlrs 3 million in crimes which included at least one heist of an armored bank vehicle in Denmark and a robbery in Toulon , France , police officials said .

source_bert_toks: ju ##mb ##ut allegedly stole over dl ##rs 3 million in crimes which included at least one he ##ist of an armored bank vehicle in denmark and a robbery in toulon , france , police officials said .

reference_raw: Jumbut allegedly stole over $3 million in crimes involving at least one robbery of an armored bank car in Denmark and a robbery in Toulon, France, police said.

reference_spacy_tokens: Jumbut allegedly stole over $ 3 million in crimes involving at least one robbery of an armored bank car in Denmark and a robbery in Toulon , France , police said .


fn_spacy_tokens_for_baseline: From an enforcement perspective , the SEC has certain civil enforcement powers that it can use to address violations of the nation 's securities laws .

source_bert_toks: from an enforcement perspective , the sec has certain civil enforcement powers that it can use to address violations of the nation ' s securities laws .

reference_raw: From the point of view of law enforcement, the SEC has certain jurisdictions for the enforcement of civil law which it may use to address breaches of national securities law.

reference_spacy_tokens: From the point of view of law enforcement , the SEC has certain jurisdictions for the enforcement of civil law which it may use to address breaches of national securities law .


fn_spacy_tokens_for_baseline: The plate was then varnished and dried , providing a hard , multicoloured screen .

source_bert_toks: the plate was then var ##nished and dried , providing a hard , multi ##col ##oured screen .

reference_raw: The plate was then painted and dried, providing a hard, multicolored screen.

reference_spacy_tokens: The plate was then painted and dried , providing a hard , multicolored screen .


fn_spacy_tokens_for_baseline: A 27-YEAR - OLD British woman charged with heroin smuggling in Thailand yesterday said she would plead guilty .

source_bert_toks: a 27 - year - old british woman charged with heroin smuggling in thailand yesterday said she would plead guilty .

reference_raw: Last night, a 27-year-old British woman in charge of heroin trafficking in Thailand said she'd plead guilty.

reference_spacy_tokens: Last night , a 27-year - old British woman in charge of heroin trafficking in Thailand said she 'd plead guilty .


fn_spacy_tokens_for_baseline: He was given a scan at the hospital 's radiology department and once his treatment was finished he asked to go to the toilet .

source_bert_toks: he was given a scan at the hospital ' s radio ##logy department and once his treatment was finished he asked to go to the toilet .

reference_raw: He got a scan from the hospital's radiological department, and when his treatment was complete, he asked to go to the bathroom.

reference_spacy_tokens: He got a scan from the hospital 's radiological department , and when his treatment was complete , he asked to go to the bathroom .


fn_spacy_tokens_for_baseline: Most private militias have been disarmed .

source_bert_toks: most private militias have been di ##sar ##med .

reference_raw: Most of the private militia have been deactivated.

reference_spacy_tokens: Most of the private militia have been deactivated .


fn_spacy_tokens_for_baseline: The suggestion that privatisation is selling off the family silver is nonsense .

source_bert_toks: the suggestion that pri ##vati ##sation is selling off the family silver is nonsense .

reference_raw: The idea of privatization selling off family silver is nonsense.

reference_spacy_tokens: The idea of privatization selling off family silver is nonsense .


fn_spacy_tokens_for_baseline: It was Molly Piggott , later to be Molly Curdle , who took out Ruth Bassett 's little nephew Paul Young each afternoon .

source_bert_toks: it was molly pig ##go ##tt , later to be molly cu ##rd ##le , who took out ruth bassett ' s little nephew paul young each afternoon .

reference_raw: It was Molly Piggott, who was later Molly Curdle, who killed Ruth Bassett's little cousin Paul Young every afternoon.

reference_spacy_tokens: It was Molly Piggott , who was later Molly Curdle , who killed Ruth Bassett 's little cousin Paul Young every afternoon .


fn_spacy_tokens_for_baseline: If the ruse , which has never been tried before , fails a flotilla of small boats will be used in horseshoe formation in an attempt to shepherd the whales to safety .

source_bert_toks: if the ruse , which has never been tried before , fails a flotilla of small boats will be used in horseshoe formation in an attempt to shepherd the whales to safety .

reference_raw: If a ruse that has never been tried before fails, a fleet of small boats will be used in the formation of horseshoes in an attempt to feed the whales to safety.

reference_spacy_tokens: If a ruse that has never been tried before fails , a fleet of small boats will be used in the formation of horseshoes in an attempt to feed the whales to safety .


fn_spacy_tokens_for_baseline: As he finished tying the cravat into an acceptable knot he saw that one of the cheese - knives had stuck to the table linen by virtue of the butter that had been left on it .

source_bert_toks: as he finished tying the cr ##ava ##t into an acceptable knot he saw that one of the cheese - knives had stuck to the table linen by virtue of the butter that had been left on it .

reference_raw: When he had finished wrapping the cravat into an acceptable knot, he saw that one of the cheese-knives was glued to the table-linen with the butter that was left on it.

reference_spacy_tokens: When he had finished wrapping the cravat into an acceptable knot , he saw that one of the cheese - knives was glued to the table - linen with the butter that was left on it .


fn_spacy_tokens_for_baseline: Paul Caswell , who 's twenty seven , arrived at Witney Magistrates for this afternoon 's hearing his head covered in a blanket .

source_bert_toks: paul cas ##well , who ' s twenty seven , arrived at wit ##ney magistrates for this afternoon ' s hearing his head covered in a blanket .

reference_raw: Paul Caswell, who was twenty-seven, came to the Witney Magistrates to hear his head wrapped in a blanket this afternoon.

reference_spacy_tokens: Paul Caswell , who was twenty - seven , came to the Witney Magistrates to hear his head wrapped in a blanket this afternoon .


fn_spacy_tokens_for_baseline: Unofficial reports suggested that the troop casualties occurred when the army convoy was ambushed en route to Khamrang , close to the Afghan border .

source_bert_toks: unofficial reports suggested that the troop casualties occurred when the army convoy was ambushed en route to k ##ham ##rang , close to the afghan border .

reference_raw: Unofficial reports indicate that military casualties occurred when an army convoy was ambushed on its way to Khamrang, near the Afghan border.

reference_spacy_tokens: Unofficial reports indicate that military casualties occurred when an army convoy was ambushed on its way to Khamrang , near the Afghan border .


fn_spacy_tokens_for_baseline: ' I do n't normally eat veal now , ' she said after dissecting the course that followed .

source_bert_toks: ' i don ' t normally eat ve ##al now , ' she said after di ##sse ##cting the course that followed .

reference_raw: "I don't usually eat calves now," she said, dissecting the course that followed.

reference_spacy_tokens: " I do n't usually eat calves now , " she said , dissecting the course that followed .


fn_spacy_tokens_for_baseline: Firefighters rescue nearly a dozen animals in Buffalo , New York house fire

source_bert_toks: firefighters rescue nearly a dozen animals in buffalo , new york house fire

reference_raw: Firemen rescue almost a dozen animals in Buffalo, the fire of the New York house.

reference_spacy_tokens: Firemen rescue almost a dozen animals in Buffalo , the fire of the New York house .


fn_spacy_tokens_for_baseline: As he crept downstairs he could hear weird music floating out from under the door , queer spine - chilling music that reminded him of icebergs and great snowy wastes , and polar bears lumbering round in furthest Greenland .

source_bert_toks: as he crept downstairs he could hear weird music floating out from under the door , queer spine - chilling music that reminded him of ice ##berg ##s and great snowy waste ##s , and polar bears lumber ##ing round in fur ##thest greenland .

reference_raw: As he crept down the stairs, he could hear strange music coming from under the door, strange, spine-chilling music that reminded him of glaciers and great snowy wastes, and polar bears looming in the farthest Greenland.

reference_spacy_tokens: As he crept down the stairs , he could hear strange music coming from under the door , strange , spine - chilling music that reminded him of glaciers and great snowy wastes , and polar bears looming in the farthest Greenland .


fn_spacy_tokens_for_baseline: In 1990 , the Soviet Union and Iran began negotiating over the completion of the Bushehr reactors and the supply of additional nuclear plants .

source_bert_toks: in 1990 , the soviet union and iran began negotiating over the completion of the bush ##eh ##r reactors and the supply of additional nuclear plants .

reference_raw: In 1990, the Soviet Union and Iran began negotiations to complete the Bushehr reactors and supply other nuclear power plants.

reference_spacy_tokens: In 1990 , the Soviet Union and Iran began negotiations to complete the Bushehr reactors and supply other nuclear power plants .


fn_spacy_tokens_for_baseline: I tried to start the engine but the airman on the starter battery trailer had fled so I could not do a thing except huddle in the cockpit , waiting for the sensation of being hit .

source_bert_toks: i tried to start the engine but the air ##man on the starter battery trailer had fled so i could not do a thing except hu ##ddle in the cockpit , waiting for the sensation of being hit .

reference_raw: I tried to start the engine, but the airman in the starter battery trailer ran away, so there was nothing I could do but curl up in the cockpit and wait for the feeling of being hit.

reference_spacy_tokens: I tried to start the engine , but the airman in the starter battery trailer ran away , so there was nothing I could do but curl up in the cockpit and wait for the feeling of being hit .


fn_spacy_tokens_for_baseline: There are also the foreseeable difficulties that emerge when one takes as the basis for study the concepts of ' normal ' and ' typical ' children .

source_bert_toks: there are also the fore ##see ##able difficulties that emerge when one takes as the basis for study the concepts of ' normal ' and ' typical ' children .

reference_raw: There are also predictable problems that arise when you base your studies on the concepts of "normal" and "typical" children.

reference_spacy_tokens: There are also predictable problems that arise when you base your studies on the concepts of " normal " and " typical " children .


fn_spacy_tokens_for_baseline: We are moving into a decade when caring is no longer an issue to be scoffed at .

source_bert_toks: we are moving into a decade when caring is no longer an issue to be scoffed at .

reference_raw: We're moving into a decade when caring is no longer a problem to be mocked by.

reference_spacy_tokens: We 're moving into a decade when caring is no longer a problem to be mocked by .


fn_spacy_tokens_for_baseline: The reception , complete with Thai barbecue , was held in a marquee in the back garden of their south London home , and the newly - weds jetted off for a honeymoon in New York .

source_bert_toks: the reception , complete with thai barbecue , was held in a mar ##que ##e in the back garden of their south london home , and the newly - wed ##s jett ##ed off for a honeymoon in new york .

reference_raw: The reception, complete with Thai barbecue, took place in a marquee in the back garden of their South London house, and the newlyweds flew off to New York for their honeymoon.

reference_spacy_tokens: The reception , complete with Thai barbecue , took place in a marquee in the back garden of their South London house , and the newlyweds flew off to New York for their honeymoon .


fn_spacy_tokens_for_baseline: There is no reason , however , to believe that this allegation is true .

source_bert_toks: there is no reason , however , to believe that this all ##ega ##tion is true .

reference_raw: However, there is no reason to assume that this claim is true.

reference_spacy_tokens: However , there is no reason to assume that this claim is true .


fn_spacy_tokens_for_baseline: A key indication of this is that the world system approach , like the dependency approach , is having increasing difficulty in dealing with the development , or at least industrialization , of nonhegemon countries .

source_bert_toks: a key indication of this is that the world system approach , like the dependency approach , is having increasing difficulty in dealing with the development , or at least industrial ##ization , of non ##he ##ge ##mon countries .

reference_raw: A key indicator is that the global system approach, such as the dependency approach, is making it increasingly difficult to cope with the development of non-hegemon countries, or at least with industrialisation.

reference_spacy_tokens: A key indicator is that the global system approach , such as the dependency approach , is making it increasingly difficult to cope with the development of non - hegemon countries , or at least with industrialisation .


fn_spacy_tokens_for_baseline: This is most common in the case of overlapping when it can be falsely assumed that part of a continuous form is obscured from view .

source_bert_toks: this is most common in the case of overlapping when it can be falsely assumed that part of a continuous form is obscured from view .

reference_raw: This is most common in the case of overlap where it can be assumed that a part of a continuous shape is hidden from view.

reference_spacy_tokens: This is most common in the case of overlap where it can be assumed that a part of a continuous shape is hidden from view .


fn_spacy_tokens_for_baseline: The next time Anna had to scramble after the ball , she risked a glance at mummy .

source_bert_toks: the next time anna had to scramble after the ball , she risked a glance at mummy .

reference_raw: Next time Anna had to scramble after the ball, she took the chance to look at mummy.

reference_spacy_tokens: Next time Anna had to scramble after the ball , she took the chance to look at mummy .


fn_spacy_tokens_for_baseline: A serious feminist critique of masculinity and male power was long overdue ; Lynne Segal has at last provided it .

source_bert_toks: a serious feminist critique of mas ##cu ##lini ##ty and male power was long over ##due ; lynne sega ##l has at last provided it .

reference_raw: The serious feminist criticism of man and manpower was long overdue; Lynne Segal had finally given it to him.

reference_spacy_tokens: The serious feminist criticism of man and manpower was long overdue ; Lynne Segal had finally given it to him .