fn_spacy_tokens_for_baseline: Early on , the airstrikes protected the rebel - held eastern city of Benghazi from a counterattack by regime forces .

source_bert_toks: early on , the airs ##tri ##kes protected the rebel - held eastern city of ben ##gh ##azi from a counterattack by regime forces .

reference_raw: Early on, air strikes protected the rebellious eastern city of Benghazi from counter-attacks by the regiments.

reference_spacy_tokens: Early on , air strikes protected the rebellious eastern city of Benghazi from counter - attacks by the regiments .


fn_spacy_tokens_for_baseline: We now need to take a broader look at language and to consider the possibility that , as part of a language system , lexical items and grammatical structures have a ' meaning potential ' .

source_bert_toks: we now need to take a broader look at language and to consider the possibility that , as part of a language system , lexi ##cal items and grammatical structures have a ' meaning potential ' .

reference_raw: We now need to explore more widely the language and consider the possibility that lexical objects and grammatical structures have "meaning potential" as part of the language system.

reference_spacy_tokens: We now need to explore more widely the language and consider the possibility that lexical objects and grammatical structures have " meaning potential " as part of the language system .


fn_spacy_tokens_for_baseline: She wound a lime chiffon scarf of Madeleine 's around her head , and practised pouting with one hip thrust forward .

source_bert_toks: she wound a lime chi ##ff ##on scarf of madeleine ' s around her head , and practised po ##uting with one hip thrust forward .

reference_raw: She wound the lime chiffon shawl of Madeleine around her head and practiced pouting with one side thrust forward.

reference_spacy_tokens: She wound the lime chiffon shawl of Madeleine around her head and practiced pouting with one side thrust forward .


fn_spacy_tokens_for_baseline: Gina bit her lip as her sister 's anguished sobs echoed over the line .

source_bert_toks: gina bit her lip as her sister ' s anguish ##ed sobs echoed over the line .

reference_raw: Gina bit her lip as her sister's tortured sobs echoed across the line.

reference_spacy_tokens: Gina bit her lip as her sister 's tortured sobs echoed across the line .


fn_spacy_tokens_for_baseline: There was no reason , however , to link the unrest that was brewing up in the country with the Kamalian dictator .

source_bert_toks: there was no reason , however , to link the unrest that was brewing up in the country with the kamal ##ian dictator .

reference_raw: But there was no reason to link the riots in the country to the Kamalian warlord.

reference_spacy_tokens: But there was no reason to link the riots in the country to the Kamalian warlord .


fn_spacy_tokens_for_baseline: This is the most easily accessible of the New Territories ' walled villages .

source_bert_toks: this is the most easily accessible of the new territories ' walled villages .

reference_raw: It's the easiest to access the walls of the New Territories.

reference_spacy_tokens: It 's the easiest to access the walls of the New Territories .


fn_spacy_tokens_for_baseline: Huge rats roamed the streets slaying then devouring their victims .

source_bert_toks: huge rats roam ##ed the streets sl ##ay ##ing then dev ##ouring their victims .

reference_raw: Huge rats roamed the streets, killing and devouring their victims.

reference_spacy_tokens: Huge rats roamed the streets , killing and devouring their victims .


fn_spacy_tokens_for_baseline: Finally , Greece was ousted from its new territory in Asia Minor , which became part of the new Turkish state .

source_bert_toks: finally , greece was ousted from its new territory in asia minor , which became part of the new turkish state .

reference_raw: Finally, Greece has been expelled from its new territory in Asia Minor, which has become part of a new Turkish country.

reference_spacy_tokens: Finally , Greece has been expelled from its new territory in Asia Minor , which has become part of a new Turkish country .


fn_spacy_tokens_for_baseline: The Zambian capital of Lusaka , and surrounding towns , may be in danger of sinking into the ground because of the increasing numbers of water boreholes being drilled in the area .

source_bert_toks: the zambia ##n capital of lu ##saka , and surrounding towns , may be in danger of sinking into the ground because of the increasing numbers of water bore ##holes being drilled in the area .

reference_raw: The Zambian city of Lusaka and the surrounding cities may be at risk of sinking, due to an increasing number of water wells being drilled in the area.

reference_spacy_tokens: The Zambian city of Lusaka and the surrounding cities may be at risk of sinking , due to an increasing number of water wells being drilled in the area .


fn_spacy_tokens_for_baseline: He seemed to have a solid grasp of what it 's really like to live in one of these estates .

source_bert_toks: he seemed to have a solid grasp of what it ' s really like to live in one of these estates .

reference_raw: He seemed to understand what it was like to live in one of these estates.

reference_spacy_tokens: He seemed to understand what it was like to live in one of these estates .


fn_spacy_tokens_for_baseline: I managed to dissuade her from that and we settled on lunch together the following day .

source_bert_toks: i managed to di ##ss ##ua ##de her from that and we settled on lunch together the following day .

reference_raw: I managed to talk her out of it, and the next day we had lunch together.

reference_spacy_tokens: I managed to talk her out of it , and the next day we had lunch together .


fn_spacy_tokens_for_baseline: Even today Auntie Jean was straight - backed and splendid in high heels and a dark - blue dress with a diamond brooch in the shape of a diving fish pinned to her front .

source_bert_toks: even today aunt ##ie jean was straight - backed and splendid in high heels and a dark - blue dress with a diamond bro ##och in the shape of a diving fish pinned to her front .

reference_raw: Even today Aunt Jean was straight-backed and beautiful in high heels and a dark blue dress with a diamond brooch in the shape of a diving fish pinned to her front.

reference_spacy_tokens: Even today Aunt Jean was straight - backed and beautiful in high heels and a dark blue dress with a diamond brooch in the shape of a diving fish pinned to her front .


fn_spacy_tokens_for_baseline: This does not preclude the possibility that genes are normally transcribed at or shortly after the time of induction but exert their effects at later times .

source_bert_toks: this does not pre ##cl ##ude the possibility that genes are normally transcribed at or shortly after the time of induction but ex ##ert their effects at later times .

reference_raw: This does not exclude the possibility that genes are normally transcribed at the time of induction or shortly thereafter, but that they have a later effect.

reference_spacy_tokens: This does not exclude the possibility that genes are normally transcribed at the time of induction or shortly thereafter , but that they have a later effect .


fn_spacy_tokens_for_baseline: ( 5 ) Bleasdale Computers ( Harvard OTC ) ' The company has just arranged a major deal with British Telecom who will market and supply their computers .

source_bert_toks: ( 5 ) b ##lea ##sdale computers ( harvard ot ##c ) ' the company has just arranged a major deal with british telecom who will market and supply their computers .

reference_raw: (5) Bleasdale Computers (Harvard OTC)" The company has just entered into a large agreement with British Telecom, which will sell and supply its computers.

reference_spacy_tokens: ( 5 ) Bleasdale Computers ( Harvard OTC ) " The company has just entered into a large agreement with British Telecom , which will sell and supply its computers .


fn_spacy_tokens_for_baseline: Fonda studiously ignores the hairs as he drawls to an off - screen interrogator .

source_bert_toks: fond ##a studio ##usly ignores the hairs as he draw ##ls to an off - screen inter ##ro ##gat ##or .

reference_raw: Fonda studiously ignores her hair as she pulls toward the off-screen investigator.

reference_spacy_tokens: Fonda studiously ignores her hair as she pulls toward the off - screen investigator .


fn_spacy_tokens_for_baseline: Some might prefer the head not to be next to the cooker

source_bert_toks: some might prefer the head not to be next to the cooke ##r

reference_raw: Some would rather not have the head next to the cooker.

reference_spacy_tokens: Some would rather not have the head next to the cooker .


fn_spacy_tokens_for_baseline: It 's so unsettling . "

source_bert_toks: it ' s so un ##sett ##ling . "

reference_raw: It's so disturbing.

reference_spacy_tokens: It 's so disturbing .


fn_spacy_tokens_for_baseline: For instance , how long have people made compost in the garden , to put on Roses , and the like , using mown grass , and vegetable peelings ?

source_bert_toks: for instance , how long have people made com ##post in the garden , to put on roses , and the like , using mo ##wn grass , and vegetable peeling ##s ?

reference_raw: For example, how long have people been doing compost in the garden to wear roses and stuff like that, using mown grass and vegetable peels?

reference_spacy_tokens: For example , how long have people been doing compost in the garden to wear roses and stuff like that , using mown grass and vegetable peels ?


fn_spacy_tokens_for_baseline: The mayor had responded to the accusation by dismissing Lewis as ' a convicted felon ' who would ' say anything in court . trying to save his own hide ' .

source_bert_toks: the mayor had responded to the accusation by dismissing lewis as ' a convicted fe ##lon ' who would ' say anything in court . trying to save his own hide ' .

reference_raw: The mayor responded to the charge by dismissing Lewis as a convicted felon who wouldn't say anything in court... trying to save his own skin.

reference_spacy_tokens: The mayor responded to the charge by dismissing Lewis as a convicted felon who would n't say anything in court ... trying to save his own skin .


fn_spacy_tokens_for_baseline: My paternal Grandfather was a stubborn , domineering man who intimidated my little Grandmother and everyone else .

source_bert_toks: my paternal grandfather was a stubborn , dom ##ine ##ering man who intimidated my little grandmother and everyone else .

reference_raw: My father's grandfather was a stubborn, dominant man who intimidated my grandmother and everyone else.

reference_spacy_tokens: My father 's grandfather was a stubborn , dominant man who intimidated my grandmother and everyone else .


fn_spacy_tokens_for_baseline: Between them , the deceased Dr Alethea Ward and the surviving Rita Ablewhite directed Liz Ablewhite towards Cambridge , and Liz in her turn handed the same knowledge on to her stepsons and her daughters .

source_bert_toks: between them , the deceased dr ale ##the ##a ward and the surviving rita able ##w ##hit ##e directed liz able ##w ##hit ##e towards cambridge , and liz in her turn handed the same knowledge on to her steps ##ons and her daughters .

reference_raw: Between them, the late Dr. Alethea Ward and the surviving Rita Ablewhite directed Liz Ablewhite to Cambridge, and Liz, in turn, passed on the same knowledge to her step-sons and daughters.

reference_spacy_tokens: Between them , the late Dr. Alethea Ward and the surviving Rita Ablewhite directed Liz Ablewhite to Cambridge , and Liz , in turn , passed on the same knowledge to her step - sons and daughters .


fn_spacy_tokens_for_baseline: Into this the doe carries dry grass , straw , and suchlike , lining her nest with fur from the belly of her own body .

source_bert_toks: into this the doe carries dry grass , straw , and such ##like , lining her nest with fur from the belly of her own body .

reference_raw: In it, the doe carries dead grass, straw, and so on, lining its nest with fur from the belly of its own body.

reference_spacy_tokens: In it , the doe carries dead grass , straw , and so on , lining its nest with fur from the belly of its own body .


fn_spacy_tokens_for_baseline: The Mourabitoun gunmen and Palestinians fired their machine - guns in the air to welcome the Syrians , the thousands of bullets ricocheting off the ruins .

source_bert_toks: the mo ##ura ##bit ##oun gunmen and palestinians fired their machine - guns in the air to welcome the syrian ##s , the thousands of bullets rico ##chet ##ing off the ruins .

reference_raw: Mourabitoun gunmen and Palestinians shot their machine-guns into the air to greet the Syrians, and thousands of bullets bounced from the ruins.

reference_spacy_tokens: Mourabitoun gunmen and Palestinians shot their machine - guns into the air to greet the Syrians , and thousands of bullets bounced from the ruins .


fn_spacy_tokens_for_baseline: The only place I could think of was Stonehenge which must have been spanking new then and as up to date as a Hilton or an out - of - town Sainsburys .

source_bert_toks: the only place i could think of was stone ##hen ##ge which must have been span ##king new then and as up to date as a hilton or an out - of - town sai ##ns ##bury ##s .

reference_raw: The only place I could think of was Stonehenge, which must have been fresh and up-to-date at the time, like the Hilton or the Sainsburys.

reference_spacy_tokens: The only place I could think of was Stonehenge , which must have been fresh and up - to - date at the time , like the Hilton or the Sainsburys .


fn_spacy_tokens_for_baseline: Here we have a possible explanation of why the Cro - Magnons might have exterminated the Neanderthals : the Neanderthals were very like them , and therefore constituted a threat .

source_bert_toks: here we have a possible explanation of why the cr ##o - mag ##non ##s might have ex ##ter ##minated the ne ##ander ##thal ##s : the ne ##ander ##thal ##s were very like them , and therefore constituted a threat .

reference_raw: Here's a possible explanation of why the Cro-Magnons could have wiped out the Neanderthals: the Neanderthals were very much like them and therefore a threat.

reference_spacy_tokens: Here 's a possible explanation of why the Cro - Magnons could have wiped out the Neanderthals : the Neanderthals were very much like them and therefore a threat .


fn_spacy_tokens_for_baseline: Alexander was rattled , disturbed in his habits , by instant fame , by being treated as a major dramatist .

source_bert_toks: alexander was rattled , disturbed in his habits , by instant fame , by being treated as a major drama ##tist .

reference_raw: Alexander was shaken, disturbed by his habits, by instant glory, by being treated like a major dramatist.

reference_spacy_tokens: Alexander was shaken , disturbed by his habits , by instant glory , by being treated like a major dramatist .


fn_spacy_tokens_for_baseline: While this may have formed part of the rationale for the application of natural justice , the major reason for the development of the doctrine was the protection of property rights and interests akin thereto .

source_bert_toks: while this may have formed part of the rational ##e for the application of natural justice , the major reason for the development of the doctrine was the protection of property rights and interests akin there ##to .

reference_raw: Although this may have been part of the justification for the application of natural justice, the main reason for developing the doctrine was the protection of property rights and similar interests.

reference_spacy_tokens: Although this may have been part of the justification for the application of natural justice , the main reason for developing the doctrine was the protection of property rights and similar interests .


fn_spacy_tokens_for_baseline: Differentiation between remission / mild and moderate disease is mostly a function of stool frequency .

source_bert_toks: differentiation between re ##mission / mild and moderate disease is mostly a function of stool frequency .

reference_raw: The difference between remission/mild and moderate disease is mainly due to faecal frequency.

reference_spacy_tokens: The difference between remission / mild and moderate disease is mainly due to faecal frequency .


fn_spacy_tokens_for_baseline: Is not it now incumbent on all decent men and women in both our countries to sink their party differences and concentrate on destroying this evil ?

source_bert_toks: is not it now incumbent on all decent men and women in both our countries to sink their party differences and concentrate on destroying this evil ?

reference_raw: Isn't it now for all decent men and women in both countries to sink their party differences and focus on the destruction of this evil?

reference_spacy_tokens: Is n't it now for all decent men and women in both countries to sink their party differences and focus on the destruction of this evil ?


fn_spacy_tokens_for_baseline: Analytic tools include examining statements and articles in the news media , government reports including unclassified intelligence estimates , interviewing insiders who have had access to information about the clandestine program , reviewing secondary sources such as reports by analysts , and making scientific calculations based on the best available information about a country 's nuclear infrastructure .

source_bert_toks: analytic tools include examining statements and articles in the news media , government reports including un ##class ##ified intelligence estimates , interviewing insider ##s who have had access to information about the clandestine program , reviewing secondary sources such as reports by analysts , and making scientific calculations based on the best available information about a country ' s nuclear infrastructure .

reference_raw: The analytical tools include the examination of statements and articles in the news media, public reports, including unclassified intelligence estimates, the interview of insiders who had access to classified information, the review of secondary sources, such as reports from analysts, and the making of scientific calculations based on the best available information on the nuclear infrastructure of a country.

reference_spacy_tokens: The analytical tools include the examination of statements and articles in the news media , public reports , including unclassified intelligence estimates , the interview of insiders who had access to classified information , the review of secondary sources , such as reports from analysts , and the making of scientific calculations based on the best available information on the nuclear infrastructure of a country .


fn_spacy_tokens_for_baseline: The old approach to the problem was to raid discarded or inexpensive pieces of surplus equipment for any components that could be removed intact .

source_bert_toks: the old approach to the problem was to raid discarded or inexpensive pieces of surplus equipment for any components that could be removed intact .

reference_raw: The old approach to the problem was to attack discarded or cheap pieces of excess equipment for any parts that could be removed intact.

reference_spacy_tokens: The old approach to the problem was to attack discarded or cheap pieces of excess equipment for any parts that could be removed intact .


fn_spacy_tokens_for_baseline: That seems to me to be a fable from Thatcher 's Britain .

source_bert_toks: that seems to me to be a fable from thatcher ' s britain .

reference_raw: I think that's the story of Thatcher's Britain.

reference_spacy_tokens: I think that 's the story of Thatcher 's Britain .


fn_spacy_tokens_for_baseline: For once he has been left behind for a singularly devastating moment of pleasure .

source_bert_toks: for once he has been left behind for a singular ##ly devastating moment of pleasure .

reference_raw: For once, he was left behind for a singularly destructive moment of joy.

reference_spacy_tokens: For once , he was left behind for a singularly destructive moment of joy .


fn_spacy_tokens_for_baseline: Finally we came to a high plastic wall .

source_bert_toks: finally we came to a high plastic wall .

reference_raw: We came at last to a tall plastic wall.

reference_spacy_tokens: We came at last to a tall plastic wall .


fn_spacy_tokens_for_baseline: She could hear the concern in his voice , and her lower lip quivered .

source_bert_toks: she could hear the concern in his voice , and her lower lip quiver ##ed .

reference_raw: She heard concern in his voice, and her lower lip trembled.

reference_spacy_tokens: She heard concern in his voice , and her lower lip trembled .


fn_spacy_tokens_for_baseline: He was decoyed to the mainland by the Persian satrap , seized and put to death .

source_bert_toks: he was deco ##yed to the mainland by the persian sat ##ra ##p , seized and put to death .

reference_raw: A Persian satellite baited him into the mainland, seized him and put him to death.

reference_spacy_tokens: A Persian satellite baited him into the mainland , seized him and put him to death .


fn_spacy_tokens_for_baseline: Why ca n't we teach our children to read , write and reckon ?

source_bert_toks: why can ' t we teach our children to read , write and reckon ?

reference_raw: Why can't we learn how to read, write, and count our kids?

reference_spacy_tokens: Why ca n't we learn how to read , write , and count our kids ?


fn_spacy_tokens_for_baseline: His heart lurched and he splashed his goblet full to the brim with dark red claret .

source_bert_toks: his heart lurched and he splashed his go ##ble ##t full to the br ##im with dark red clare ##t .

reference_raw: His heart throbbed and he poured his goblet full into the brim with a dark red claret.

reference_spacy_tokens: His heart throbbed and he poured his goblet full into the brim with a dark red claret .


fn_spacy_tokens_for_baseline: Preliminary investigations by Netherlands aviation officials indicated that the disaster , the worst ever in the Netherlands , was probably caused by aircraft metal fatigue stemming from excessive stress and corrosion .

source_bert_toks: preliminary investigations by netherlands aviation officials indicated that the disaster , the worst ever in the netherlands , was probably caused by aircraft metal fatigue stemming from excessive stress and corrosion .

reference_raw: Preliminary enquiries by Dutch aviation officials have shown that the disaster, which is the worst in the Netherlands, is likely to be caused by the fatigue of aircraft metals caused by excessive stress and corrosion.

reference_spacy_tokens: Preliminary enquiries by Dutch aviation officials have shown that the disaster , which is the worst in the Netherlands , is likely to be caused by the fatigue of aircraft metals caused by excessive stress and corrosion .


fn_spacy_tokens_for_baseline: Besides , his ego was tickled by the implicit flattery of the journalist 's attention .

source_bert_toks: besides , his ego was tick ##led by the implicit flat ##tery of the journalist ' s attention .

reference_raw: Besides, his ego was twitched by the implication of the journalist's attention.

reference_spacy_tokens: Besides , his ego was twitched by the implication of the journalist 's attention .


fn_spacy_tokens_for_baseline: Every time I rave about how sexy Rancid Hell Spawn 's distorted , chaotic pop - stupidity is and every time you take not a blind bit of notice .

source_bert_toks: every time i rave about how sexy ran ##ci ##d hell spawn ' s distorted , chaotic pop - stupidity is and every time you take not a blind bit of notice .

reference_raw: Every time I think about how sexy Rancid Hell Spawn's deformed, chaotic pop-stupidity is, and every time you don't pay any attention.

reference_spacy_tokens: Every time I think about how sexy Rancid Hell Spawn 's deformed , chaotic pop - stupidity is , and every time you do n't pay any attention .


fn_spacy_tokens_for_baseline: In September 1999 , Pyongyang agreed to a moratorium on missile flight tests and later announced that it would maintain the moratorium until at least 2003 .

source_bert_toks: in september 1999 , p ##yon ##gy ##ang agreed to a mora ##torium on missile flight tests and later announced that it would maintain the mora ##torium until at least 2003 .

reference_raw: In September 1999, Pyongyang agreed to a moratorium on rocket flight tests and later stated that it would maintain the moratorium until at least 2003.

reference_spacy_tokens: In September 1999 , Pyongyang agreed to a moratorium on rocket flight tests and later stated that it would maintain the moratorium until at least 2003 .


fn_spacy_tokens_for_baseline: But the southwest 's growing need for water , combined with Las Vegas 's fortuitous proximity to the Colorado River , would give Las Vegas a second chance to achieve prosperity .

source_bert_toks: but the southwest ' s growing need for water , combined with las vegas ' s fort ##uit ##ous proximity to the colorado river , would give las vegas a second chance to achieve prosperity .

reference_raw: But the growing demand for water from the southwest, combined with the fortunate proximity of Las Vegas to the Colorado River, would give Las Vegas a second chance to achieve prosperity.

reference_spacy_tokens: But the growing demand for water from the southwest , combined with the fortunate proximity of Las Vegas to the Colorado River , would give Las Vegas a second chance to achieve prosperity .


fn_spacy_tokens_for_baseline: Libya has tried , with limited success , to develop its own indigenous missile , and to extend the range of its aging SCUD force for many years under the Al Fatah and other missile programs .

source_bert_toks: libya has tried , with limited success , to develop its own indigenous missile , and to extend the range of its aging sc ##ud force for many years under the al fat ##ah and other missile programs .

reference_raw: Libya has been trying, with limited success, to develop its own domestic missile and to extend the range of its aging SCUD forces for many years under Al Fatah's and further missile programmes.

reference_spacy_tokens: Libya has been trying , with limited success , to develop its own domestic missile and to extend the range of its aging SCUD forces for many years under Al Fatah 's and further missile programmes .


fn_spacy_tokens_for_baseline: Another figure may be responsible for drawing us out , eliciting all kinds of pained and disagreeable reactions .

source_bert_toks: another figure may be responsible for drawing us out , eli ##cit ##ing all kinds of pained and disagree ##able reactions .

reference_raw: Another figure could be responsible for pulling us out, causing all sorts of painful and unpleasant reactions.

reference_spacy_tokens: Another figure could be responsible for pulling us out , causing all sorts of painful and unpleasant reactions .


fn_spacy_tokens_for_baseline: He visited stately homes in the summer and was often at Bulstrode , where the Duchess of Portland pursued her great interest in botany .

source_bert_toks: he visited state ##ly homes in the summer and was often at bu ##ls ##tro ##de , where the duchess of portland pursued her great interest in botany .

reference_raw: He visited stately houses in the summer, often in Bulstrode, where the Duchess of Portland pursued her intense interest in botany.

reference_spacy_tokens: He visited stately houses in the summer , often in Bulstrode , where the Duchess of Portland pursued her intense interest in botany .


fn_spacy_tokens_for_baseline: Monuments to money ! Money and immortality ! Money and immortality and blistering heat ! Twenty - nine floors below diminished figures scuttle ! Descending twenty - nine floors rapid as a fibrillating heart you can join them ! You are choking in bus exhaust the blackest in the U.S.A. ! You are invisible amid the pedestrians of color ! On Commerce !

source_bert_toks: monuments to money ! money and immortality ! money and immortality and b ##list ##ering heat ! twenty - nine floors below diminished figures sc ##ut ##tle ! descending twenty - nine floors rapid as a fi ##bri ##lla ##ting heart you can join them ! you are choking in bus exhaust the black ##est in the u . s . a . ! you are invisible amid the pedestrians of color ! on commerce !

reference_raw: Monuments for money! Money and immortality! Money and immortality and blistering heat! Twenty-nine floors below reduced figures scuttle! Descending twenty-nine floors as fast as a fibrilling heart you can join them! You're choking in a bus exhaust the blackest in the United States!

reference_spacy_tokens: Monuments for money ! Money and immortality ! Money and immortality and blistering heat ! Twenty - nine floors below reduced figures scuttle ! Descending twenty - nine floors as fast as a fibrilling heart you can join them ! You 're choking in a bus exhaust the blackest in the United States !


fn_spacy_tokens_for_baseline: Anyway , this woman grabbed hold of me , and she just done it wrong .

source_bert_toks: anyway , this woman grabbed hold of me , and she just done it wrong .

reference_raw: Anyway, this woman caught me, and she did it the wrong way.

reference_spacy_tokens: Anyway , this woman caught me , and she did it the wrong way .


fn_spacy_tokens_for_baseline: AOL would never have existed if it had been founded here , I am sure , since its employees would have been mocked into obscurity by the digerati .

source_bert_toks: ao ##l would never have existed if it had been founded here , i am sure , since its employees would have been mocked into ob ##scu ##rity by the dig ##era ##ti .

reference_raw: I'm sure AOL would never have existed if it had been established here, for its employees would have been mocked by the digerati into obscurity.

reference_spacy_tokens: I 'm sure AOL would never have existed if it had been established here , for its employees would have been mocked by the digerati into obscurity .


fn_spacy_tokens_for_baseline: All these diverse atmospheres merge together beautifully to create a most delightful and unique East Lindsey market town .

source_bert_toks: all these diverse atmosphere ##s merge together beautifully to create a most delightful and unique east lindsey market town .

reference_raw: All these different atmospheres come together beautifully to create the most beautiful and unique market city in East Lindsey.

reference_spacy_tokens: All these different atmospheres come together beautifully to create the most beautiful and unique market city in East Lindsey .


fn_spacy_tokens_for_baseline: Gail was calculating bills in the office behind the reception desk , her pocket calculator chirping each time she touched its keys .

source_bert_toks: gail was calculating bills in the office behind the reception desk , her pocket cal ##cula ##tor chi ##rp ##ing each time she touched its keys .

reference_raw: Gail counted the bills in the office behind the desk, and every time she touched the keys, her pocket calculator buzzed.

reference_spacy_tokens: Gail counted the bills in the office behind the desk , and every time she touched the keys , her pocket calculator buzzed .


fn_spacy_tokens_for_baseline: Cottee was disciplined yesterday by Howard Kendall following his outburst against both manager and team - mates , reported in Saturday 's Daily Post .

source_bert_toks: cot ##tee was disciplined yesterday by howard kendall following his outburst against both manager and team - mates , reported in saturday ' s daily post .

reference_raw: Cottee was punished yesterday by Howard Kendall after an outburst against the manager and his teammates, reported at the Daily Post on Saturday.

reference_spacy_tokens: Cottee was punished yesterday by Howard Kendall after an outburst against the manager and his teammates , reported at the Daily Post on Saturday .


fn_spacy_tokens_for_baseline: It identifies best practices to facilitate this decision making at two critical junctures - transition from system integration to system demonstration during product development and then transition into production .

source_bert_toks: it identifies best practices to facilitate this decision making at two critical jun ##cture ##s - transition from system integration to system demonstration during product development and then transition into production .

reference_raw: It identifies best practices to facilitate the decision-making process at two critical points, from the integration of the system to the demonstration of the system during the production process and then the transition to production.

reference_spacy_tokens: It identifies best practices to facilitate the decision - making process at two critical points , from the integration of the system to the demonstration of the system during the production process and then the transition to production .


fn_spacy_tokens_for_baseline: Their seven daughters all married into prominent Devonshire families , two of them to baronets and four to knights .

source_bert_toks: their seven daughters all married into prominent devon ##shire families , two of them to baronet ##s and four to knights .

reference_raw: All their seven daughters wed to the prominent families of Devonshire, two to the baronets and four to the knights.

reference_spacy_tokens: All their seven daughters we d to the prominent families of Devonshire , two to the baronets and four to the knights .


fn_spacy_tokens_for_baseline: Those who have no or only an inadequate contributions record , and those who have exhausted their rights to Unemployment Benefit , can make a claim for means - tested Supplementary Benefit .

source_bert_toks: those who have no or only an inadequate contributions record , and those who have exhausted their rights to unemployment benefit , can make a claim for means - tested supplementary benefit .

reference_raw: Those who do not have or simply do not have a sufficient contribution record, and those who have exercised their right to unemployment benefit, may apply for a means-tested additional benefit.

reference_spacy_tokens: Those who do not have or simply do not have a sufficient contribution record , and those who have exercised their right to unemployment benefit , may apply for a means - tested additional benefit .


fn_spacy_tokens_for_baseline: Deforestation , overgrazing and shortened fallow periods threaten the fragility of Rwanda 's soils .

source_bert_toks: def ##orestation , over ##gra ##zing and shortened fall ##ow periods threaten the fra ##gil ##ity of rwanda ' s soils .

reference_raw: The instability of Rwanda soils is threatened by deforestation, overgrazing and shortening of fallow periods.

reference_spacy_tokens: The instability of Rwanda soils is threatened by deforestation , overgrazing and shortening of fallow periods .


fn_spacy_tokens_for_baseline: It was now just a hundred yards off our starboard bow .

source_bert_toks: it was now just a hundred yards off our starboard bow .

reference_raw: Now it was only a hundred yards from our starboard bow.

reference_spacy_tokens: Now it was only a hundred yards from our starboard bow .


fn_spacy_tokens_for_baseline: The constructivist theory of mind regards thinking on an analogy with action ; just as the representation theory takes an analogy with drawing and writing .

source_bert_toks: the construct ##ivist theory of mind regards thinking on an analogy with action ; just as the representation theory takes an analogy with drawing and writing .

reference_raw: The constructivist theory of the mind is about thinking in an analogous to action; just as the theory of representation takes an analogy with drawing and writing.

reference_spacy_tokens: The constructivist theory of the mind is about thinking in an analogous to action ; just as the theory of representation takes an analogy with drawing and writing .


fn_spacy_tokens_for_baseline: On another day when I asked the question , she began slowly and with difficulty to lift the skirts of her dress , revealing bare knees .

source_bert_toks: on another day when i asked the question , she began slowly and with difficulty to lift the skirts of her dress , revealing bare knees .

reference_raw: The next day, when I asked her the question, she began, slowly and with difficulty, to lift her dress and reveal her bare knees.

reference_spacy_tokens: The next day , when I asked her the question , she began , slowly and with difficulty , to lift her dress and reveal her bare knees .


fn_spacy_tokens_for_baseline: The test appeared to be Iran 's message to the international community that it can not and will not be bullied .

source_bert_toks: the test appeared to be iran ' s message to the international community that it can not and will not be bull ##ied .

reference_raw: The test seemed to be a message from Iran to the world that it could not and would not be bullied.

reference_spacy_tokens: The test seemed to be a message from Iran to the world that it could not and would not be bullied .


fn_spacy_tokens_for_baseline: Here a carpenter and his wife were lodged .

source_bert_toks: here a carpenter and his wife were lodged .

reference_raw: This is where the carpenter and his wife were deposited.

reference_spacy_tokens: This is where the carpenter and his wife were deposited .


fn_spacy_tokens_for_baseline: She leaned back and waggled her forefinger to show her disapproval .

source_bert_toks: she leaned back and wa ##ggle ##d her fore ##finger to show her disapproval .

reference_raw: She leaned back in her chair and waved her forefinger to protest.

reference_spacy_tokens: She leaned back in her chair and waved her forefinger to protest .


fn_spacy_tokens_for_baseline: The backs of pews were generally panelled which makes them super for panelling a whole room if you can get the quantity , given a bit of designing skill and reworking .

source_bert_toks: the backs of pew ##s were generally panel ##led which makes them super for panel ##ling a whole room if you can get the quantity , given a bit of designing skill and re ##working .

reference_raw: The backs of the benches were generally boarded, which makes them super-paneling for the whole room, if you can get that amount, given some design skills and reworking.

reference_spacy_tokens: The backs of the benches were generally boarded , which makes them super - paneling for the whole room , if you can get that amount , given some design skills and reworking .


fn_spacy_tokens_for_baseline: That is an analysis by the officers of what additional funds they felt was needed for them to fulfil their statutory duties .

source_bert_toks: that is an analysis by the officers of what additional funds they felt was needed for them to fu ##lf ##il their statutory duties .

reference_raw: This is a study carried out by the officers of what additional resources they felt necessary to perform their statutory duties.

reference_spacy_tokens: This is a study carried out by the officers of what additional resources they felt necessary to perform their statutory duties .


fn_spacy_tokens_for_baseline: Emotionally , you still appear to be feeling somewhat torn and indecisive and the trouble is you have an enormous yearning to give while asking for very little or even nothing in return .

source_bert_toks: emotionally , you still appear to be feeling somewhat torn and ind ##ec ##isi ##ve and the trouble is you have an enormous yearning to give while asking for very little or even nothing in return .

reference_raw: Emotionally, you still seem to feel a little torn and indecisive, and the problem is that you have a huge desire to give and ask for very little or nothing in return.

reference_spacy_tokens: Emotionally , you still seem to feel a little torn and indecisive , and the problem is that you have a huge desire to give and ask for very little or nothing in return .


fn_spacy_tokens_for_baseline: ' It was as much hers as it was Terry 's , I suppose , but the Bank he heisted it from might think it had a prior claim .

source_bert_toks: ' it was as much hers as it was terry ' s , i suppose , but the bank he he ##iste ##d it from might think it had a prior claim .

reference_raw: 'I think it was as much hers as Terry's, but the bank he had robbed might have thought it had a previous claim.

reference_spacy_tokens: ' I think it was as much hers as Terry 's , but the bank he had robbed might have thought it had a previous claim .


fn_spacy_tokens_for_baseline: Without bacteria , moulds and fungi , we would all be wading around in undecayed vegetation many miles deep .

source_bert_toks: without bacteria , mo ##uld ##s and fungi , we would all be wadi ##ng around in und ##eca ##yed vegetation many miles deep .

reference_raw: Without the bacteria, the moulds, and the mushrooms, we'd all be wandering around in undead vegetation many miles deep.

reference_spacy_tokens: Without the bacteria , the moulds , and the mushrooms , we 'd all be wandering around in undead vegetation many miles deep .


fn_spacy_tokens_for_baseline: He issued a series of varied and confusing demands , ranging from reaffirmations of his patriotism to claims that he was fighting for an ' authentic democracy ' .

source_bert_toks: he issued a series of varied and confusing demands , ranging from re ##af ##firm ##ations of his patriot ##ism to claims that he was fighting for an ' authentic democracy ' .

reference_raw: He made a series of diverse and perplexing demands, ranging from confirming his patriotism to claiming that he was fighting for an authentic democracy.

reference_spacy_tokens: He made a series of diverse and perplexing demands , ranging from confirming his patriotism to claiming that he was fighting for an authentic democracy .


fn_spacy_tokens_for_baseline: Becky slipped out of her dress .

source_bert_toks: becky slipped out of her dress .

reference_raw: Becky slid out of the dress.

reference_spacy_tokens: Becky slid out of the dress .


fn_spacy_tokens_for_baseline: If he won here too , if he came back from Barashevo without a stain of the shit and slime of this place on his tailored khaki uniform then the road upwards and onwards was clear to him .

source_bert_toks: if he won here too , if he came back from bar ##ash ##ev ##o without a stain of the shit and slim ##e of this place on his tailored k ##hak ##i uniform then the road upwards and onwards was clear to him .

reference_raw: If he'd won here, if he'd come back from Barashevo without a stain of shit and slime in his tailored khaki outfit, he'd know the way up and down.

reference_spacy_tokens: If he 'd won here , if he 'd come back from Barashevo without a stain of shit and slime in his tailored khaki outfit , he 'd know the way up and down .


fn_spacy_tokens_for_baseline: He put his hands to his temples , feigning weariness .

source_bert_toks: he put his hands to his temples , fei ##gni ##ng wear ##iness .

reference_raw: He put his hands to his temples and pretended to be tired.

reference_spacy_tokens: He put his hands to his temples and pretended to be tired .


fn_spacy_tokens_for_baseline: Skid Row are ninth row division Guns N'Roses wannabes , and this turgid slab of rotting , flyblown rock ratmeat is about as sexy , young and wild as the corpse of David Mellor in a bulging G - string .

source_bert_toks: ski ##d row are ninth row division guns n ' roses wanna ##bes , and this tu ##rg ##id slab of rotting , fly ##bl ##own rock rat ##me ##at is about as sexy , young and wild as the corpse of david mel ##lor in a bulging g - string .

reference_raw: Skid Row is the 9th row division Guns N'Roses Wanted, and this turgid slab of rotting, fly-blown rock rats is about as hot, young, and wild as David Mellor's dead body in a bulging G string.

reference_spacy_tokens: Skid Row is the 9th row division Guns N'Roses Wanted , and this turgid slab of rotting , fly - blown rock rats is about as hot , young , and wild as David Mellor 's dead body in a bulging G string .


fn_spacy_tokens_for_baseline: Antique dealers and bargain hunters have been looking through the belongings of the late Robert Maxwell .

source_bert_toks: antique dealers and bargain hunters have been looking through the belongings of the late robert maxwell .

reference_raw: Antique dealers and dealers searched the late Robert Maxwell's possessions.

reference_spacy_tokens: Antique dealers and dealers searched the late Robert Maxwell 's possessions .


fn_spacy_tokens_for_baseline: A thin disdainful blonde girl led me up narrow stairs to a room filled completely by a single bed .

source_bert_toks: a thin disdain ##ful blonde girl led me up narrow stairs to a room filled completely by a single bed .

reference_raw: A thin, contemptuous blonde girl led me up a narrow staircase to a room full of one bed.

reference_spacy_tokens: A thin , contemptuous blonde girl led me up a narrow staircase to a room full of one bed .


fn_spacy_tokens_for_baseline: Giles reached for the wine and emptied the rest of it into their glasses .

source_bert_toks: giles reached for the wine and emptied the rest of it into their glasses .

reference_raw: Giles reached for his wine and drained the rest of it into his spectacles.

reference_spacy_tokens: Giles reached for his wine and drained the rest of it into his spectacles .


fn_spacy_tokens_for_baseline: The supply question has taken on added urgency with the planned deployment of up to 30,000 more U. S. troops in the Afghan theater in the next 18 months .

source_bert_toks: the supply question has taken on added urgency with the planned deployment of up to 30 , 000 more u . s . troops in the afghan theater in the next 18 months .

reference_raw: The supply issue has become increasingly urgent with the planned deployment of up to 30,000 additional U.S. troops at the Afghan Theatre in the next 18 months.

reference_spacy_tokens: The supply issue has become increasingly urgent with the planned deployment of up to 30,000 additional U.S. troops at the Afghan Theatre in the next 18 months .


fn_spacy_tokens_for_baseline: Surely it could not take this long to gather up a few baskets of food ?

source_bert_toks: surely it could not take this long to gather up a few baskets of food ?

reference_raw: Surely it couldn't have taken so long to get a couple of buckets of food?

reference_spacy_tokens: Surely it could n't have taken so long to get a couple of buckets of food ?


fn_spacy_tokens_for_baseline: They were good astronomers , had complex religious beliefs ( human sacrifice is conveniently forgotten ) and , on the whole , benevolent rulers .

source_bert_toks: they were good astronomers , had complex religious beliefs ( human sacrifice is convenient ##ly forgotten ) and , on the whole , benevolent rulers .

reference_raw: They were good astronomers, had complex religious beliefs (the human sacrifice was conveniently forgotten) and, on the whole, benevolent emperors.

reference_spacy_tokens: They were good astronomers , had complex religious beliefs ( the human sacrifice was conveniently forgotten ) and , on the whole , benevolent emperors .


fn_spacy_tokens_for_baseline: Occasionally , they heard a pack of jackals howling , and the dog guarding the sheep outside would growl and bark a warning to them .

source_bert_toks: occasionally , they heard a pack of jack ##als howling , and the dog guarding the sheep outside would growl and bark a warning to them .

reference_raw: From time to time they could hear a pack of jackals whining, and the dog guarding the sheep outside growled and barked a warning.

reference_spacy_tokens: From time to time they could hear a pack of jackals whining , and the dog guarding the sheep outside growled and barked a warning .


fn_spacy_tokens_for_baseline: It seemed she had only just drifted off when she was woken by a sharp rap on the door and Nathan 's impatient voice announcing , ' Breakfast in five minutes ! '

source_bert_toks: it seemed she had only just drifted off when she was woken by a sharp rap on the door and nathan ' s impatient voice announcing , ' breakfast in five minutes ! '

reference_raw: She seemed to have just left when she was awakened by a sharp knock on the door, and Nathan's impatient voice said, "Breakfast in five minutes!"

reference_spacy_tokens: She seemed to have just left when she was awakened by a sharp knock on the door , and Nathan 's impatient voice said , " Breakfast in five minutes ! "


fn_spacy_tokens_for_baseline: This concept was clearly articulated by Iranian Defense Minister Ali Shamkhani on 7 February 1999 when he stated , " Iraq would have undoubtedly not attacked us 20 years ago if we he had then the power we have now ... .Because of our deterrent power , Israel 's threatening rhetoric against us has also decreased lately . "

source_bert_toks: this concept was clearly articulated by iranian defense minister ali sham ##khan ##i on 7 february 1999 when he stated , " iraq would have undoubtedly not attacked us 20 years ago if we he had then the power we have now . . . . because of our deter ##rent power , israel ' s threatening rhetoric against us has also decreased lately . "

reference_raw: On 7 February 1999, Iran's Defense Minister Ali Shamkhani said, "Iraq would certainly not have invaded us 20 years ago if we had the power we now have... ...because of our deterrence, the threat of Israel's rhetoric against us has been reduced recently."

reference_spacy_tokens: On 7 February 1999 , Iran 's Defense Minister Ali Shamkhani said , " Iraq would certainly not have invaded us 20 years ago if we had the power we now have ... ... because of our deterrence , the threat of Israel 's rhetoric against us has been reduced recently . "


fn_spacy_tokens_for_baseline: We met our new lecturer Mr H.B. Acton of the London School of Economics who was to lecture in Social Philosophy .

source_bert_toks: we met our new lecturer mr h . b . acton of the london school of economics who was to lecture in social philosophy .

reference_raw: We met our new teacher, Mr. H.B. Acton, from the London School of Economics, who was supposed to give a lecture on social philosophy.

reference_spacy_tokens: We met our new teacher , Mr. H.B. Acton , from the London School of Economics , who was supposed to give a lecture on social philosophy .


fn_spacy_tokens_for_baseline: The terms of engagement against patrols are almost always the foe 's to decide .

source_bert_toks: the terms of engagement against patrols are almost always the foe ' s to decide .

reference_raw: It's almost always up to the enemy to decide the terms of attack against the patrols.

reference_spacy_tokens: It 's almost always up to the enemy to decide the terms of attack against the patrols .


fn_spacy_tokens_for_baseline: The child may rationalise the situation by saying that the family is the only family he or she knows and thereby acquire a psychic balance .

source_bert_toks: the child may rational ##ise the situation by saying that the family is the only family he or she knows and thereby acquire a psychic balance .

reference_raw: The child can rationalize the situation by stating that the family is the only family he or she knows, thereby gaining a mental balance.

reference_spacy_tokens: The child can rationalize the situation by stating that the family is the only family he or she knows , thereby gaining a mental balance .


fn_spacy_tokens_for_baseline: Sainthood and mercy are entities of the most considerable sort in Leonard Cohen 's work , as we shall see .

source_bert_toks: saint ##hood and mercy are entities of the most considerable sort in leonard cohen ' s work , as we shall see .

reference_raw: Sacredness and mercy are the most important entities in Leonard Cohen's work, as we shall see.

reference_spacy_tokens: Sacredness and mercy are the most important entities in Leonard Cohen 's work , as we shall see .


fn_spacy_tokens_for_baseline: She certainly needed all her expertise one night when the children made their entrance for a skipping rope routine .

source_bert_toks: she certainly needed all her expertise one night when the children made their entrance for a skipping rope routine .

reference_raw: I'm sure she needed all her expertise one night when the kids came in to skip the rope routine.

reference_spacy_tokens: I 'm sure she needed all her expertise one night when the kids came in to skip the rope routine .


fn_spacy_tokens_for_baseline: 100 years ago a legion of artists and craftsmen made the same journey .

reference_raw: A hundred years ago, the legions of artists and craftsmen made the same journey.

reference_spacy_tokens: A hundred years ago , the legions of artists and craftsmen made the same journey .


fn_spacy_tokens_for_baseline: Some places take credit cards , but cash is better for bargaining .

source_bert_toks: some places take credit cards , but cash is better for bargaining .

reference_raw: Some places take credit cards, but money's better to negotiate.

reference_spacy_tokens: Some places take credit cards , but money 's better to negotiate .


fn_spacy_tokens_for_baseline: There are many pleasant walks through the cool olive groves leading to abandoned villages , hilltop windmills with lovely views , or tiny coves among the cliffs of the west coast .

source_bert_toks: there are many pleasant walks through the cool olive groves leading to abandoned villages , hilltop windmill ##s with lovely views , or tiny cove ##s among the cliffs of the west coast .

reference_raw: There are many pleasant passages through the cool olive groves that lead to deserted villages, high windmills with beautiful views, or small bays between the cliffs of the West Coast.

reference_spacy_tokens: There are many pleasant passages through the cool olive groves that lead to deserted villages , high windmills with beautiful views , or small bays between the cliffs of the West Coast .


fn_spacy_tokens_for_baseline: When Charles came to visit , he did so as a guest , and when he departed he left no possessions behind him .

source_bert_toks: when charles came to visit , he did so as a guest , and when he departed he left no possessions behind him .

reference_raw: When Charles came to visit, he did so as a guest, leaving nothing behind when he left.

reference_spacy_tokens: When Charles came to visit , he did so as a guest , leaving nothing behind when he left .


fn_spacy_tokens_for_baseline: Dr Neil was now seated at his desk and she lingered a little .

source_bert_toks: dr neil was now seated at his desk and she lingered a little .

reference_raw: Dr. Neil was sitting at his desk now, and she lingered a bit.

reference_spacy_tokens: Dr. Neil was sitting at his desk now , and she lingered a bit .


fn_spacy_tokens_for_baseline: These are just a few examples of animal - borne infection to which humans are susceptible .

source_bert_toks: these are just a few examples of animal - borne infection to which humans are susceptible .

reference_raw: These are just a few examples of animal-borne infections that people are sensitive to.

reference_spacy_tokens: These are just a few examples of animal - borne infections that people are sensitive to .


fn_spacy_tokens_for_baseline: Why should we have assumed that a little thing like a gunfight in the street would attract attention ?

source_bert_toks: why should we have assumed that a little thing like a gun ##fight in the street would attract attention ?

reference_raw: Why would we assume something like a shooting on the street would attract attention?

reference_spacy_tokens: Why would we assume something like a shooting on the street would attract attention ?


fn_spacy_tokens_for_baseline: Also worth investigating are contemporary handicrafts , both Portuguese and Chinese , from across the border .

source_bert_toks: also worth investigating are contemporary hand ##ic ##raf ##ts , both portuguese and chinese , from across the border .

reference_raw: Contemporary handicrafts, both Portuguese and Chinese, from across the border are also worthy of investigation.

reference_spacy_tokens: Contemporary handicrafts , both Portuguese and Chinese , from across the border are also worthy of investigation .


fn_spacy_tokens_for_baseline: During 19 - 21 April 2004 , North Korean National Defense Commission Chairman Kim Jong Il visited China and reportedly told Chinese President Hu Jintao that " the DRPK side will continue to adopt a patient and flexible manner and actively participate in the six - party talks process , and make its own contributions to the progress of the talks . "

source_bert_toks: during 19 - 21 april 2004 , north korean national defense commission chairman kim jong il visited china and reportedly told chinese president hu jin ##tao that " the dr ##p ##k side will continue to adopt a patient and flexible manner and actively participate in the six - party talks process , and make its own contributions to the progress of the talks . "

reference_raw: In the course of 19-21 April 2004, Chairman of the North Korean National Defence Commission Kim Jong II visited China and allegedly informed Chinese President Hu Jintao that "the DRPK Party will continue to take a patient and flexible approach and actively participate in the six-party talks process and contribute to the progress of the negotiations."

reference_spacy_tokens: In the course of 19 - 21 April 2004 , Chairman of the North Korean National Defence Commission Kim Jong II visited China and allegedly informed Chinese President Hu Jintao that " the DRPK Party will continue to take a patient and flexible approach and actively participate in the six - party talks process and contribute to the progress of the negotiations . "


fn_spacy_tokens_for_baseline: ' I reckon , ' said Marie slowly , ' that you must think I 'm a right idiot . '

source_bert_toks: ' i reckon , ' said marie slowly , ' that you must think i ' m a right idiot . '

reference_raw: "I suppose," said Marie slowly, "you must think I'm an idiot."

reference_spacy_tokens: " I suppose , " said Marie slowly , " you must think I 'm an idiot . "


fn_spacy_tokens_for_baseline: Such indirect arguments are scorned by modern biologists , but at the turn of the century they were the mainstay of support for an active Lamarckian movement .

source_bert_toks: such indirect arguments are sc ##orne ##d by modern biologist ##s , but at the turn of the century they were the main ##sta ##y of support for an active lamar ##cki ##an movement .

reference_raw: Modern biologists despise such indirect arguments, but at the turn of the century they were the main source of support for the active Lamarckian movement.

reference_spacy_tokens: Modern biologists despise such indirect arguments , but at the turn of the century they were the main source of support for the active Lamarckian movement .


fn_spacy_tokens_for_baseline: " They were down on the Grose River working in atrocious conditions as a last - ditch stand ... and they nearly got there .

source_bert_toks: " they were down on the gr ##ose river working in at ##ro ##cious conditions as a last - ditch stand . . . and they nearly got there .

reference_raw: "They were down on the Grose River, operating under terrible conditions like the last ditch... "and they almost got there.

reference_spacy_tokens: " They were down on the Grose River , operating under terrible conditions like the last ditch ... " and they almost got there .


fn_spacy_tokens_for_baseline: But I can console myself that at least I had fun .

source_bert_toks: but i can console myself that at least i had fun .

reference_raw: But I can take comfort in the fact that at least I had a good time.

reference_spacy_tokens: But I can take comfort in the fact that at least I had a good time .


fn_spacy_tokens_for_baseline: ' I was sure Henderson , as he calls himself , felt that he was suspected , and that he would lie low and make no move so long as he thought he was in any danger .

source_bert_toks: ' i was sure henderson , as he calls himself , felt that he was suspected , and that he would lie low and make no move so long as he thought he was in any danger .

reference_raw: 'I was sure that Henderson, as he called himself, felt suspicious, and that he would lie low and do nothing as long as he thought he was in jeopardy.

reference_spacy_tokens: ' I was sure that Henderson , as he called himself , felt suspicious , and that he would lie low and do nothing as long as he thought he was in jeopardy .


fn_spacy_tokens_for_baseline: We can not read intentions . "

source_bert_toks: we can not read intentions . "

reference_raw: We don't read intentions.

reference_spacy_tokens: We do n't read intentions .


fn_spacy_tokens_for_baseline: Under the deal , concluded last month , China supplied Iran with 500 tons of phosphorus pentsulfide , material banned under the terms of the CWC if known to be used in a CW program .

source_bert_toks: under the deal , concluded last month , china supplied iran with 500 tons of phosphorus pen ##tsu ##lf ##ide , material banned under the terms of the cw ##c if known to be used in a cw program .

reference_raw: On the basis of an agreement concluded last month, China supplied Iran with 500 tonnes of phosphorus pentsulfide, materials banned under the terms of the Convention, provided that they are deemed to be used in the CW programme.

reference_spacy_tokens: On the basis of an agreement concluded last month , China supplied Iran with 500 tonnes of phosphorus pentsulfide , materials banned under the terms of the Convention , provided that they are deemed to be used in the CW programme .


fn_spacy_tokens_for_baseline: The boy later wrote his memoirs ; again , I quote : ' Mme Picard 's opinion was that a child should be allowed to read everything .

source_bert_toks: the boy later wrote his memoirs ; again , i quote : ' mm ##e pic ##ard ' s opinion was that a child should be allowed to read everything .

reference_raw: The boy wrote his memories later, and I quote again, "Mme Picard felt that the child should be allowed to read everything.

reference_spacy_tokens: The boy wrote his memories later , and I quote again , " Mme Picard felt that the child should be allowed to read everything .


fn_spacy_tokens_for_baseline: Unwary buyers could find someone else laying claim to their property .

source_bert_toks: un ##war ##y buyers could find someone else laying claim to their property .

reference_raw: The unwary buyers might find someone else who would give him the right to his property.

reference_spacy_tokens: The unwary buyers might find someone else who would give him the right to his property .


fn_spacy_tokens_for_baseline: He enjoys the company of others , likes nothing better than a good dinner surrounded by friends , and large noisy get - togethers with his family .

source_bert_toks: he enjoys the company of others , likes nothing better than a good dinner surrounded by friends , and large noisy get - together ##s with his family .

reference_raw: He likes the company of others, likes nothing better than a good dinner, surrounded by friends, and a big noisy reunion with his family.

reference_spacy_tokens: He likes the company of others , likes nothing better than a good dinner , surrounded by friends , and a big noisy reunion with his family .


fn_spacy_tokens_for_baseline: No harm done , or anything -- I had a bet with a friend that I could n't con you . '

source_bert_toks: no harm done , or anything - - i had a bet with a friend that i couldn ' t con you . '

reference_raw: Nothing happened or anything - I bet my friend I couldn't cheat on you.'

reference_spacy_tokens: Nothing happened or anything - I bet my friend I could n't cheat on you . '


fn_spacy_tokens_for_baseline: A recreated street of colonial Macau is lined with traditional Chinese shops .

source_bert_toks: a recreated street of colonial macau is lined with traditional chinese shops .

reference_raw: The recreated street of colonial Macao is lined with traditional shops in China.

reference_spacy_tokens: The recreated street of colonial Macao is lined with traditional shops in China .


fn_spacy_tokens_for_baseline: The reason for breaking our vows were pecuniary and made financial sense .

source_bert_toks: the reason for breaking our vows were pe ##cu ##nia ##ry and made financial sense .

reference_raw: The reason we broke our promises was financial, and it made financial sense.

reference_spacy_tokens: The reason we broke our promises was financial , and it made financial sense .


fn_spacy_tokens_for_baseline: In September he was granted bail on a burglary charge by Ealing magistrates even though he had breached the terms of his earlier bail conditions .

source_bert_toks: in september he was granted bail on a bu ##rg ##lary charge by ea ##ling magistrates even though he had breached the terms of his earlier bail conditions .

reference_raw: In September, the Ealing Magistrates released him on a burglary charge, even though he violated the terms of his previous parole.

reference_spacy_tokens: In September , the Ealing Magistrates released him on a burglary charge , even though he violated the terms of his previous parole .


fn_spacy_tokens_for_baseline: One of the biologists ' jobs , according to chief scientist Bernard Courtney , will be to create pathogens to match strains that terrorists are clandestinely producing and then develop vaccines and drugs to combat them .

source_bert_toks: one of the biologist ##s ' jobs , according to chief scientist bernard courtney , will be to create pathogen ##s to match strains that terrorists are clandestine ##ly producing and then develop vaccines and drugs to combat them .

reference_raw: According to Chief Scientist Bernard Courtney, one of the roles of biologists is to develop pathogens to match the strains that terrorists secretly produce and then develop vaccines and drugs to fight them.

reference_spacy_tokens: According to Chief Scientist Bernard Courtney , one of the roles of biologists is to develop pathogens to match the strains that terrorists secretly produce and then develop vaccines and drugs to fight them .


fn_spacy_tokens_for_baseline: We now have the fact of Soviet military superiority , and President Reagan 's theory that the aim of Soviet policy is expansion by military means .

source_bert_toks: we now have the fact of soviet military superiority , and president reagan ' s theory that the aim of soviet policy is expansion by military means .

reference_raw: We now have Soviet military superiority and President Reagan's theory that Soviet policy aims to expand by military means.

reference_spacy_tokens: We now have Soviet military superiority and President Reagan 's theory that Soviet policy aims to expand by military means .


fn_spacy_tokens_for_baseline: The chill air cooled her face and seemed to sweep her problems into the distance .

source_bert_toks: the chill air cooled her face and seemed to sweep her problems into the distance .

reference_raw: The cold air chilled her face, seeming to sweep her problems into the distance.

reference_spacy_tokens: The cold air chilled her face , seeming to sweep her problems into the distance .


fn_spacy_tokens_for_baseline: While Mr Stych was canoeing back down a tributary of the Mackenzie- already dangerous with chunks of ice , to an appointment with a helicopter , Mr Frizzell was trying on his last year 's brocade waistcoat and finding it too small ; Mr MacDonald , Ian 's father , was winding up a trying compensation case for his insurance company at Vermilion ; and Mr MacDonald ( oil ) was trying to explain to his superiors in Sarnia , Ontario , why he must be back in a place like Tollemarche by the middle of December .

source_bert_toks: while mr st ##ych was canoe ##ing back down a tributary of the mackenzie - already dangerous with chunks of ice , to an appointment with a helicopter , mr fr ##iz ##zell was trying on his last year ' s bro ##cade waist ##coat and finding it too small ; mr macdonald , ian ' s father , was winding up a trying compensation case for his insurance company at ve ##rmi ##lion ; and mr macdonald ( oil ) was trying to explain to his superiors in sar ##nia , ontario , why he must be back in a place like toll ##ema ##rch ##e by the middle of december .

reference_raw: While Mr. Stych had been canoeing down the MacKenzie tributary - already dangerous with ice, to a helicopter meeting, Mr. Frizzell had tried his last year's brocade vest and found it too small; Mr. MacDonald, Ian's father, had wound up trying to make up for his insurance company in Vermilion; and Mr. MacDonald (oil) trying to explain to his superiors in Sarnia, Ontario, why he had to return to a place like Tollemarche by mid-December.

reference_spacy_tokens: While Mr. Stych had been canoeing down the MacKenzie tributary - already dangerous with ice , to a helicopter meeting , Mr. Frizzell had tried his last year 's brocade vest and found it too small ; Mr. MacDonald , Ian 's father , had wound up trying to make up for his insurance company in Vermilion ; and Mr. MacDonald ( oil ) trying to explain to his superiors in Sarnia , Ontario , why he had to return to a place like Tollemarche by mid - December .


fn_spacy_tokens_for_baseline: She was sick when she ate certain foods , notably fish .

source_bert_toks: she was sick when she ate certain foods , notably fish .

reference_raw: When she ate certain foods, especially fish, she was ill.

reference_spacy_tokens: When she ate certain foods , especially fish , she was ill .


fn_spacy_tokens_for_baseline: Other status groups erect less formidable barriers to entry .

source_bert_toks: other status groups erect less formidable barriers to entry .

reference_raw: Other status groups create less formidable barriers to entry.

reference_spacy_tokens: Other status groups create less formidable barriers to entry .


fn_spacy_tokens_for_baseline: In Afghanistan 's increasingly restive north , a bomb planted on a motorbike blew up in a busy market area in the district of Imam Sahib , a longtime trouble spot in Kunduz province .

source_bert_toks: in afghanistan ' s increasingly rest ##ive north , a bomb planted on a motor ##bi ##ke blew up in a busy market area in the district of imam sahib , a longtime trouble spot in kun ##du ##z province .

reference_raw: In the increasingly restful north of Afghanistan, a bomb planted on a motorcycle exploded in a busy market area in Imam Sahib, a long-term problem area in Kunduz Province.

reference_spacy_tokens: In the increasingly restful north of Afghanistan , a bomb planted on a motorcycle exploded in a busy market area in Imam Sahib , a long - term problem area in Kunduz Province .


fn_spacy_tokens_for_baseline: Although over 500 settlers occupied the Grande Ronde valley , the Wallowa remained free from invasion until surveyors , those harbingers of doom among the Indians , arrived in 1866 .

source_bert_toks: although over 500 settlers occupied the grande ron ##de valley , the wall ##owa remained free from invasion until surveyor ##s , those ha ##rbin ##gers of doom among the indians , arrived in 1866 .

reference_raw: Although the Grande Ronde Valley was occupied by more than 500 settlers, the Wallowa remained free from invasion until in 1866 the surveyors, the predators of destruction among the Indians, arrived.

reference_spacy_tokens: Although the Grande Ronde Valley was occupied by more than 500 settlers , the Wallowa remained free from invasion until in 1866 the surveyors , the predators of destruction among the Indians , arrived .


fn_spacy_tokens_for_baseline: For practical reasons , it is not more than an interest though -- but probably as a direct result of this interest , my fish collection always seems to have an excessive quantity of eels .

source_bert_toks: for practical reasons , it is not more than an interest though - - but probably as a direct result of this interest , my fish collection always seems to have an excessive quantity of eels .

reference_raw: But, for practical reasons, it's nothing more than an interest - but it's probably the direct result of that interest that my fish harvest always seems to have an excessive amount of eels.

reference_spacy_tokens: But , for practical reasons , it 's nothing more than an interest - but it 's probably the direct result of that interest that my fish harvest always seems to have an excessive amount of eels .


fn_spacy_tokens_for_baseline: Hazardous waste smuggled from Germany into Hungary is to be returned .

source_bert_toks: hazardous waste smug ##gled from germany into hungary is to be returned .

reference_raw: Hazardous waste shipped from Germany to Hungary will be returned.

reference_spacy_tokens: Hazardous waste shipped from Germany to Hungary will be returned .


fn_spacy_tokens_for_baseline: His mind was racing now , beads of sweat standing out on his forehead , as he desperately tried to think of some way of alerting the pump attendant to his predicament without endangering them both .

source_bert_toks: his mind was racing now , beads of sweat standing out on his forehead , as he desperately tried to think of some way of alert ##ing the pump attendant to his pre ##dic ##ament without end ##anger ##ing them both .

reference_raw: His mind was racing now, beads of sweat standing on his forehead, and he was desperately trying to figure out a way to alert the pump crew to his predicament without jeopardizing both of them.

reference_spacy_tokens: His mind was racing now , beads of sweat standing on his forehead , and he was desperately trying to figure out a way to alert the pump crew to his predicament without jeopardizing both of them .


fn_spacy_tokens_for_baseline: ' There was real genuine sadness for the death of this respected monarch in the staffroom that day . '

source_bert_toks: ' there was real genuine sadness for the death of this respected monarch in the staff ##room that day . '

reference_raw: "That day, there was real sorrow in the staff room for the death of this revered ruler."

reference_spacy_tokens: " That day , there was real sorrow in the staff room for the death of this revered ruler . "


fn_spacy_tokens_for_baseline: This enormous , modern version of a traditional Chinese building , with sweeping blue tile roofs , contains an auditorium big enough to seat 4,700 people .

source_bert_toks: this enormous , modern version of a traditional chinese building , with sweeping blue tile roofs , contains an auditorium big enough to seat 4 , 700 people .

reference_raw: This huge, modern version of the conventional Chinese building, with sweeping blue tile roofs, contains an auditorium large enough to accommodate 4,700 people.

reference_spacy_tokens: This huge , modern version of the conventional Chinese building , with sweeping blue tile roofs , contains an auditorium large enough to accommodate 4,700 people .


fn_spacy_tokens_for_baseline: If the answer to the question is known , there is no scientific purpose in conducting the trial , and it is also unethical to do so .

source_bert_toks: if the answer to the question is known , there is no scientific purpose in conducting the trial , and it is also une ##thic ##al to do so .

reference_raw: If the answer to this question is known, there is no scientific purpose for conducting the experiment and it is not ethical.

reference_spacy_tokens: If the answer to this question is known , there is no scientific purpose for conducting the experiment and it is not ethical .


fn_spacy_tokens_for_baseline: I just tried to defend myself from the blows . '

source_bert_toks: i just tried to defend myself from the blows . '

reference_raw: I was just trying to protect myself from the blows.'

reference_spacy_tokens: I was just trying to protect myself from the blows . '


fn_spacy_tokens_for_baseline: He had smeared the shape with coal dust .

source_bert_toks: he had smeared the shape with coal dust .

reference_raw: He stained the figure with charcoal dust.

reference_spacy_tokens: He stained the figure with charcoal dust .


fn_spacy_tokens_for_baseline: On a superficial level this can be seen in her long and mutually admiring correspondence with Voltaire , and in her financial help to Diderot and the unsuccessful visit to Russia which he paid at her invitation .

source_bert_toks: on a superficial level this can be seen in her long and mutually admiring correspondence with volta ##ire , and in her financial help to did ##ero ##t and the unsuccessful visit to russia which he paid at her invitation .

reference_raw: On the surface, it is evident from her long and mutually admirable correspondence with Voltaire, her financial assistance to Diderot and her failed visit to Russia, which he paid at her invitation.

reference_spacy_tokens: On the surface , it is evident from her long and mutually admirable correspondence with Voltaire , her financial assistance to Diderot and her failed visit to Russia , which he paid at her invitation .


fn_spacy_tokens_for_baseline: ' As I typed my manuscript in the attic , I thought that perhaps jet had once been strewn along its broad oak floorboards . '

source_bert_toks: ' as i typed my manuscript in the attic , i thought that perhaps jet had once been strewn along its broad oak floor ##boards . '

reference_raw: "When I wrote my handwriting in the attic, I thought the jet might once have been strewn on its broad oak floorboards."

reference_spacy_tokens: " When I wrote my handwriting in the attic , I thought the jet might once have been strewn on its broad oak floorboards . "


fn_spacy_tokens_for_baseline: Here , arched bridges , pagodas , fish ponds , and stands of bamboo create the mood of a timeless Chinese painting .

source_bert_toks: here , arched bridges , pagoda ##s , fish ponds , and stands of bamboo create the mood of a timeless chinese painting .

reference_raw: Here, arched bridges, pagodas, fish ponds, and bamboo stands make the mood of a timeless Chinese painting.

reference_spacy_tokens: Here , arched bridges , pagodas , fish ponds , and bamboo stands make the mood of a timeless Chinese painting .


fn_spacy_tokens_for_baseline: Always scrupulously wash and dry a board between uses , preferably drying with disposable kitchen paper rather than a tea towel to avoid transferring flavours or bacteria .

source_bert_toks: always sc ##rup ##ulously wash and dry a board between uses , prefer ##ably drying with di ##sp ##osa ##ble kitchen paper rather than a tea towel to avoid transferring flavour ##s or bacteria .

reference_raw: Always carefully wash and dry the board between uses, preferably dry with a disposable kitchen paper instead of a tea towel, in order to prevent the transfer of flavors or bacteria.

reference_spacy_tokens: Always carefully wash and dry the board between uses , preferably dry with a disposable kitchen paper instead of a tea towel , in order to prevent the transfer of flavors or bacteria .


fn_spacy_tokens_for_baseline: Callers of any sort were scarce at Four Winds , mostly people who came asking for directions or even a glass of water when the weather was hot .

source_bert_toks: caller ##s of any sort were scarce at four winds , mostly people who came asking for directions or even a glass of water when the weather was hot .

reference_raw: Callers of all sorts were rare in the Four Winds, mostly people who asked for instructions or even a drink of water in the hot weather.

reference_spacy_tokens: Callers of all sorts were rare in the Four Winds , mostly people who asked for instructions or even a drink of water in the hot weather .


fn_spacy_tokens_for_baseline: Nearly breaking her neck , the pony pulled away in panic , the whites of her eyes glinting in the moonlight , coat curled with dried sweat like an Irish Water Spaniel .

source_bert_toks: nearly breaking her neck , the pony pulled away in panic , the whites of her eyes glint ##ing in the moonlight , coat curled with dried sweat like an irish water span ##iel .

reference_raw: The pony almost broke her neck and drew back in panic, the whites of her eyes gleaming in the moonlight, her coat curled in dry sweat like an Irish Water Spaniel.

reference_spacy_tokens: The pony almost broke her neck and drew back in panic , the whites of her eyes gleaming in the moonlight , her coat curled in dry sweat like an Irish Water Spaniel .


fn_spacy_tokens_for_baseline: The Foreign Office deplored ' the infringement of human rights in Malawi ' .

source_bert_toks: the foreign office de ##pl ##ored ' the infringement of human rights in malawi ' .

reference_raw: The State Department regrets "the human rights violations in Malawi."

reference_spacy_tokens: The State Department regrets " the human rights violations in Malawi . "


fn_spacy_tokens_for_baseline: What a terrible thing it is for our literary establishment to be peopled by degenerates like this , he felt .

source_bert_toks: what a terrible thing it is for our literary establishment to be people ##d by de ##gen ##erate ##s like this , he felt .

reference_raw: It was a terrible thing, he thought, for our literary establishment to be inhabited by such perverts.

reference_spacy_tokens: It was a terrible thing , he thought , for our literary establishment to be inhabited by such perverts .


fn_spacy_tokens_for_baseline: All students should be encouraged to take an active part and not merely listen passively to the tutor and one or two loquacious individuals .

source_bert_toks: all students should be encouraged to take an active part and not merely listen passive ##ly to the tutor and one or two lo ##qua ##cious individuals .

reference_raw: All students should be encouraged to play an active role and not simply listen passively to a teacher and one or two wealthy individuals.

reference_spacy_tokens: All students should be encouraged to play an active role and not simply listen passively to a teacher and one or two wealthy individuals .


fn_spacy_tokens_for_baseline: She has never received a lira of State help , despite the fact that her brother , Giuseppe Ciarrapico , chairman of the Roma football team , was a close associate of ex - Prime Minister Andreotti .

source_bert_toks: she has never received a li ##ra of state help , despite the fact that her brother , giuseppe cia ##rra ##pic ##o , chairman of the roma football team , was a close associate of ex - prime minister andre ##otti .

reference_raw: She had never received a lira of State aid, despite the fact that her brother, Giuseppe Ciarrapico, head of the Roma football team, was a close partner of former Prime Minister Andreotti.

reference_spacy_tokens: She had never received a lira of State aid , despite the fact that her brother , Giuseppe Ciarrapico , head of the Roma football team , was a close partner of former Prime Minister Andreotti .


fn_spacy_tokens_for_baseline: After all , I live in the Palace and nothing like that happens there , does it . '

source_bert_toks: after all , i live in the palace and nothing like that happens there , does it . '

reference_raw: After all, I'm living in a castle, and there's no such thing, is there?'

reference_spacy_tokens: After all , I 'm living in a castle , and there 's no such thing , is there ? '


fn_spacy_tokens_for_baseline: Two men were last night helping police investigating a till snatch from a wine shop in North Shields town centre .

source_bert_toks: two men were last night helping police investigating a till snatch from a wine shop in north shields town centre .

reference_raw: Last night, two men helped the police investigate a till robbery from a wine shop in the city center of North Shields.

reference_spacy_tokens: Last night , two men helped the police investigate a till robbery from a wine shop in the city center of North Shields .


fn_spacy_tokens_for_baseline: American officials now say they believe that Muhammad was warned by someone in the Qatar government and that he was staying at the estate of Abdallah bin Khalid , a fundamentalist who has provided support for other Islamic radicals .

source_bert_toks: american officials now say they believe that muhammad was warned by someone in the qatar government and that he was staying at the estate of abd ##alla ##h bin khalid , a fundamental ##ist who has provided support for other islamic radicals .

reference_raw: U.S. officials now say that they believe that Muhammad was warned by a member of the Qatar government and that he resided in Abdallah bin Khalid, a fundamentalist who supported other Islamic radicals.

reference_spacy_tokens: U.S. officials now say that they believe that Muhammad was warned by a member of the Qatar government and that he resided in Abdallah bin Khalid , a fundamentalist who supported other Islamic radicals .


fn_spacy_tokens_for_baseline: Dashing his pint mug down on the bar , Greg Hocking darted through the door before any of the idly curious could bar his way .

source_bert_toks: dash ##ing his pin ##t mug down on the bar , greg hoc ##king darted through the door before any of the id ##ly curious could bar his way .

reference_raw: Greg Hocking threw his pint cup down on the bar and darted through the door before any of the idly curious could get in the way.

reference_spacy_tokens: Greg Hocking threw his pint cup down on the bar and darted through the door before any of the idly curious could get in the way .


fn_spacy_tokens_for_baseline: The psychologists would be in the manger with the TV crews , evaluating them on the basis of their offerings -- gold , frankincense and myrrh .

source_bert_toks: the psychologists would be in the man ##ger with the tv crews , evaluating them on the basis of their offerings - - gold , frank ##in ##cens ##e and my ##rr ##h .

reference_raw: Psychologists would be in charge of the TV crews, assessing them on the basis of their offerings - gold, Frankincense, and myrrh.

reference_spacy_tokens: Psychologists would be in charge of the TV crews , assessing them on the basis of their offerings - gold , Frankincense , and myrrh .


fn_spacy_tokens_for_baseline: Sinead O'Connor has phoned and donated her house in Los Angeles to the appeal .

source_bert_toks: sin ##ead o ' connor has phone ##d and donated her house in los angeles to the appeal .

reference_raw: Sinead O'Connor called and gave her home in L.A. to appeal.

reference_spacy_tokens: Sinead O'Connor called and gave her home in L.A. to appeal .


fn_spacy_tokens_for_baseline: An Iranian scientist reports that Iran has built a plutonium extraction laboratory at the Tehran Research Center , but the laboratory has not yet operated with plutonium - bearing materials ( Spector , 208 ) .

source_bert_toks: an iranian scientist reports that iran has built a pluto ##nium extraction laboratory at the tehran research center , but the laboratory has not yet operated with pluto ##nium - bearing materials ( spec ##tor , 208 ) .

reference_raw: Iran's scientists report that Iran has set up a plutonium extraction laboratory at the Tehran Research Centre, but that laboratory has not yet operated with plutonium-bearing materials (Spector, 208).

reference_spacy_tokens: Iran 's scientists report that Iran has set up a plutonium extraction laboratory at the Tehran Research Centre , but that laboratory has not yet operated with plutonium - bearing materials ( Spector , 208 ) .


fn_spacy_tokens_for_baseline: And I have regular letters and comments from returning guests saying how friendly and helpful the staff have been . '

source_bert_toks: and i have regular letters and comments from returning guests saying how friendly and helpful the staff have been . '

reference_raw: And I have regular letters and remarks from returning guests saying how friendly and useful the staff were.'

reference_spacy_tokens: And I have regular letters and remarks from returning guests saying how friendly and useful the staff were . '


fn_spacy_tokens_for_baseline: HEADLINE from the Reigate and Banstead Independent : ' Police hunt handbag snatcher in stolen car . '

source_bert_toks: headline from the rei ##gate and ban ##stead independent : ' police hunt hand ##bag snatch ##er in stolen car . '

reference_raw: HEADLINE of the Reigate and Banstead Independent: 'Police hunts a purse thief in a stolen car.'

reference_spacy_tokens: HEADLINE of the Reigate and Banstead Independent : ' Police hunts a purse thief in a stolen car . '


fn_spacy_tokens_for_baseline: At Isleten a narrow mountain road ( used by the postbus ) also swings off to the left , running for 19 km ( 12 miles ) to the rocky and romantic Isenthal from which the ascent to the ice - capped Uri Rotstock is approached .

source_bert_toks: at isle ##ten a narrow mountain road ( used by the post ##bus ) also swings off to the left , running for 19 ##km ( 12 miles ) to the rocky and romantic is ##ent ##hal from which the ascent to the ice - capped ur ##i rot ##stock is approached .

reference_raw: In Isleten, a narrow mountain road (used by a postbus) also rolls to the left and runs 19 km (12 miles) to the rocky and romantic Isenthal from which the climb to the ice-capped Uri Rotstock is approaching.

reference_spacy_tokens: In Isleten , a narrow mountain road ( used by a postbus ) also rolls to the left and runs 19 km ( 12 miles ) to the rocky and romantic Isenthal from which the climb to the ice - capped Uri Rotstock is approaching .


fn_spacy_tokens_for_baseline: She was wearing blue tights and sandals and had hitched her dress well up in order to swing her legs .

source_bert_toks: she was wearing blue tight ##s and sandals and had hitch ##ed her dress well up in order to swing her legs .

reference_raw: She wore blue stockings and sandals and hitched her dress well enough to swing her legs.

reference_spacy_tokens: She wore blue stockings and sandals and hitched her dress well enough to swing her legs .


fn_spacy_tokens_for_baseline: The red woollen mantle with the hood will be the most suitable , I think . '

source_bert_toks: the red wool ##len mantle with the hood will be the most suitable , i think . '

reference_raw: I think a red wool cloak with a hood will be the most appropriate.'

reference_spacy_tokens: I think a red wool cloak with a hood will be the most appropriate . '


fn_spacy_tokens_for_baseline: Liquidise a large , raw carrot to a smooth paste , or boil or steam the carrot then mash it thoroughly .

source_bert_toks: liquid ##ise a large , raw carrot to a smooth paste , or boil or steam the carrot then mas ##h it thoroughly .

reference_raw: Liquidise a large raw carrot into a smooth paste, or boil or smoke the carrot and then wash it thoroughly.

reference_spacy_tokens: Liquidise a large raw carrot into a smooth paste , or boil or smoke the carrot and then wash it thoroughly .


fn_spacy_tokens_for_baseline: We were dead lucky to get to bed without a belting on a Sunday . '

source_bert_toks: we were dead lucky to get to bed without a belt ##ing on a sunday . '

reference_raw: We were fortunate enough to go to bed on a Sunday without a belt.'

reference_spacy_tokens: We were fortunate enough to go to bed on a Sunday without a belt . '


fn_spacy_tokens_for_baseline: If two strange males meet , they box and wrestle , emitting a succession of sounds at between 40 000 and 70 000 hertz , each lasting less than seven - hundredths of a second .

source_bert_toks: if two strange males meet , they box and wrestle , emi ##tting a succession of sounds at between 40 000 and 70 000 her ##tz , each lasting less than seven - hundred ##ths of a second .

reference_raw: When two strange men meet, they fight and fight, emitting a series of noises of between 40,000 and 70,000 hertz, each of which lasts less than seven hundredths of a second.

reference_spacy_tokens: When two strange men meet , they fight and fight , emitting a series of noises of between 40,000 and 70,000 hertz , each of which lasts less than seven hundredths of a second .


fn_spacy_tokens_for_baseline: When his hand was on the knob she said :

source_bert_toks: when his hand was on the knob she said :

reference_raw: When he touched the button, she said:

reference_spacy_tokens: When he touched the button , she said :


fn_spacy_tokens_for_baseline: If Bootsy had a chin , it was not much in evidence and Matthew could see two distinct pimples beside his nose .

source_bert_toks: if boots ##y had a chin , it was not much in evidence and matthew could see two distinct pi ##mple ##s beside his nose .

reference_raw: If Bootsy had a beard, there wasn't much evidence, and Matthew saw two distinct pimples next to his nose.

reference_spacy_tokens: If Bootsy had a beard , there was n't much evidence , and Matthew saw two distinct pimples next to his nose .


fn_spacy_tokens_for_baseline: Even music fans who have n't dirtied their hands in their lives adore Bruce Springsteen for being America 's earnest , sincere , blue - collar rock ' n ' roll conscience in a tatty , checked shirt .

source_bert_toks: even music fans who haven ' t dirt ##ied their hands in their lives ad ##ore bruce springsteen for being america ' s earnest , sincere , blue - collar rock ' n ' roll conscience in a ta ##tty , checked shirt .

reference_raw: Even music fans who haven't dirtyed their hands in their lives love Bruce Springsteen because he's America's serious, honest, blue-collar rock 'n' roll conscience in a tattoo, checked shirt.

reference_spacy_tokens: Even music fans who have n't dirtyed their hands in their lives love Bruce Springsteen because he 's America 's serious , honest , blue - collar rock ' n ' roll conscience in a tattoo , checked shirt .


fn_spacy_tokens_for_baseline: Peter , born into a working - class family in Edinburgh , had barely known his mother , who died when he was still a baby .

source_bert_toks: peter , born into a working - class family in edinburgh , had barely known his mother , who died when he was still a baby .

reference_raw: Peter, who had become a working-class family in Edinburgh, barely knew his mother, who had died when he was a child.

reference_spacy_tokens: Peter , who had become a working - class family in Edinburgh , barely knew his mother , who had died when he was a child .


fn_spacy_tokens_for_baseline: But schools often under - use the talents and energies of their teachers , or fail to develop them in any consistent and systematic way .

source_bert_toks: but schools often under - use the talents and energies of their teachers , or fail to develop them in any consistent and systematic way .

reference_raw: But schools often do not use their teachers' talents and power, or do not develop them in a consistent and systematic manner.

reference_spacy_tokens: But schools often do not use their teachers ' talents and power , or do not develop them in a consistent and systematic manner .


fn_spacy_tokens_for_baseline: And you can manufacture bucketfuls of this marvellous stuff from nothing more than kitchen waste .

source_bert_toks: and you can manufacture bucket ##ful ##s of this marvel ##lous stuff from nothing more than kitchen waste .

reference_raw: And you can make buckets of this amazing stuff out of nothing but kitchen waste.

reference_spacy_tokens: And you can make buckets of this amazing stuff out of nothing but kitchen waste .


fn_spacy_tokens_for_baseline: MAKING toys is child 's play for Courtaulds employee Ted Richards -- and he ensures a perfect finish by using paint from International .

source_bert_toks: making toys is child ' s play for court ##au ##ld ##s employee ted richards - - and he ensures a perfect finish by using paint from international .

reference_raw: Making toys is a kid's game for an employee of the courtaulds, Ted Richards - and he ensures a perfect finish through the use of international paint.

reference_spacy_tokens: Making toys is a kid 's game for an employee of the courtaulds , Ted Richards - and he ensures a perfect finish through the use of international paint .


fn_spacy_tokens_for_baseline: She dared to open her eyes again and found him still there , close to her .

source_bert_toks: she dared to open her eyes again and found him still there , close to her .

reference_raw: She ventured to open her eyes again and found him still there, near her.

reference_spacy_tokens: She ventured to open her eyes again and found him still there , near her .


fn_spacy_tokens_for_baseline: METHOD : To make bread , place yeast in a bowl with 150ml of water .

source_bert_toks: method : to make bread , place yeast in a bowl with 150 ##ml of water .

reference_raw: METHOD: Place the yeast in a bowl containing 150 ml of water for the manufacture of sandwiches.

reference_spacy_tokens: METHOD : Place the yeast in a bowl containing 150 ml of water for the manufacture of sandwiches .


fn_spacy_tokens_for_baseline: Report by German intelligence on Iranian efforts to acquire production equipment for tabun and sarin , using three Indian companies as fronts .

source_bert_toks: report by german intelligence on iranian efforts to acquire production equipment for tab ##un and sar ##in , using three indian companies as fronts .

reference_raw: A report from the German Intelligence on Iran's attempts to acquire production equipment for tabun and sarin, using three Indian corporations as fronts.

reference_spacy_tokens: A report from the German Intelligence on Iran 's attempts to acquire production equipment for tabun and sarin , using three Indian corporations as fronts .


fn_spacy_tokens_for_baseline: The division has the important task of defeating any enemy breakthrough into the British Corps area and is equipped with the Army 's latest equipment , including the Warrior Armoured Infantry Fighting Vehicle .

source_bert_toks: the division has the important task of defeating any enemy breakthrough into the british corps area and is equipped with the army ' s latest equipment , including the warrior armoured infantry fighting vehicle .

reference_raw: The division has an important task of defeating any enemy breach into the British Corps area, and it is equipped with the most recent military facilities, including a combat vehicle armed with infantry.

reference_spacy_tokens: The division has an important task of defeating any enemy breach into the British Corps area , and it is equipped with the most recent military facilities , including a combat vehicle armed with infantry .


fn_spacy_tokens_for_baseline: If you buy all the trips , then we 'll give you a great voucher pack which will save you £ £ £ 's in discos and clubs around the resort .

source_bert_toks: if you buy all the trips , then we ' ll give you a great vo ##ucher pack which will save you £ ##£ ##£ ' s in disco ##s and clubs around the resort .

reference_raw: If you buy all these trips, we'll give you a great package of vouchers that will save you £4,000 in discos and clubs around the resort.

reference_spacy_tokens: If you buy all these trips , we 'll give you a great package of vouchers that will save you £ 4,000 in discos and clubs around the resort .