fn_spacy_tokens_for_baseline: The law , enacted last year , requires longer prison sentences for felons with at least one prior conviction for a serious or violent felony .

source_bert_toks: the law , enacted last year , requires longer prison sentences for fe ##lon ##s with at least one prior conviction for a serious or violent felony .

reference_raw: The law adopted last year requires a longer prison sentence for criminals with at least one previous conviction for a serious or violent crime.

reference_spacy_tokens: The law adopted last year requires a longer prison sentence for criminals with at least one previous conviction for a serious or violent crime .


fn_spacy_tokens_for_baseline: Moreover , particularly when a complex is relatively unstable , the bound protein can detach from the protected DNA fragment and reassociate to other DNA fragments that have already been modified by DMS .

source_bert_toks: moreover , particularly when a complex is relatively unstable , the bound protein can det ##ach from the protected dna fragment and re ##ass ##oc ##iate to other dna fragments that have already been modified by d ##ms .

reference_raw: In addition, in particular if the complex is relatively unstable, the bonded protein can separate from the protected DNA fragment and re-associate with other DNA fragments that have already been modified by DMS.

reference_spacy_tokens: In addition , in particular if the complex is relatively unstable , the bonded protein can separate from the protected DNA fragment and re - associate with other DNA fragments that have already been modified by DMS .


fn_spacy_tokens_for_baseline: The goalless draw threatened to flare into an ugly row between several players after Luton 's teenage striker John Hartson appeared to be fouled .

source_bert_toks: the goal ##less draw threatened to flare into an ugly row between several players after luton ' s teenage striker john hart ##son appeared to be foul ##ed .

reference_raw: When Luton's teenage striker, John Hartson, appeared to have been fouled, the goalless draw threatened to burst into an ugly line between a few players.

reference_spacy_tokens: When Luton 's teenage striker , John Hartson , appeared to have been fouled , the goalless draw threatened to burst into an ugly line between a few players .


fn_spacy_tokens_for_baseline: What has such a man as this , he marvelled , to do with our loud , headlong , candid Stephen , who charges at events like a stamping bull ?

source_bert_toks: what has such a man as this , he marvel ##led , to do with our loud , head ##long , candi ##d stephen , who charges at events like a stamp ##ing bull ?

reference_raw: What does a man like that, he wondered, have to do with our noisy, headlong, honest Stephen, who blames events like a stamped bull?

reference_spacy_tokens: What does a man like that , he wondered , have to do with our noisy , headlong , honest Stephen , who blames events like a stamped bull ?


fn_spacy_tokens_for_baseline: And at least some of the weaponry they have been using comes from unguarded arms caches like Al Qaqaa 's .

source_bert_toks: and at least some of the weaponry they have been using comes from un ##guard ##ed arms cache ##s like al q ##aq ##aa ' s .

reference_raw: And at least some of the weapons they're using come from unguarded arms cages like Al Qaqaa's.

reference_spacy_tokens: And at least some of the weapons they 're using come from unguarded arms cages like Al Qaqaa 's .


fn_spacy_tokens_for_baseline: To cheers and aahs he emerged on the far bank , shook himself and set off in dripping pursuit .

source_bert_toks: to cheers and aa ##hs he emerged on the far bank , shook himself and set off in dripping pursuit .

reference_raw: To cheers and aahs, he emerged on the far side of the river, shuddered, and set off in a dripping chase.

reference_spacy_tokens: To cheers and aahs , he emerged on the far side of the river , shuddered , and set off in a dripping chase .


fn_spacy_tokens_for_baseline: Anger flickered in his eyes .

source_bert_toks: anger flickered in his eyes .

reference_raw: There was a flash of anger in his eyes.

reference_spacy_tokens: There was a flash of anger in his eyes .


fn_spacy_tokens_for_baseline: He hoped she was n't offended , as a Times reporter .

source_bert_toks: he hoped she wasn ' t offended , as a times reporter .

reference_raw: As a reporter from the Times, he hoped she wasn't insulted.

reference_spacy_tokens: As a reporter from the Times , he hoped she was n't insulted .


fn_spacy_tokens_for_baseline: Also in front of the ferry terminal is a new Cyber fountain , with 86 water spouts that shoot up to 70 m ( 230 ft ) and are illuminated at night by 288 spotlights producing 80 colors .

source_bert_toks: also in front of the ferry terminal is a new cyber fountain , with 86 water sp ##outs that shoot up to 70 m ( 230 ft ) and are illuminated at night by 288 spotlight ##s producing 80 colors .

reference_raw: There is also a new Cyber fountain outside the ferry terminal, with 86 water spouts that fire up to 70 m (230 ft) and are lit at night by 288 spotlights that produce 80 colours.

reference_spacy_tokens: There is also a new Cyber fountain outside the ferry terminal , with 86 water spouts that fire up to 70 m ( 230 ft ) and are lit at night by 288 spotlights that produce 80 colours .


fn_spacy_tokens_for_baseline: Given Iran 's strong biotechnology and pharmaceutical infrastructure , it is not difficult to envision the development of a concealed BW program .

source_bert_toks: given iran ' s strong biotechnology and pharmaceutical infrastructure , it is not difficult to en ##vision the development of a concealed b ##w program .

reference_raw: Given Iran's strong biotech and pharmaceutical infrastructure, it is not difficult to imagine the development of a hidden BW program.

reference_spacy_tokens: Given Iran 's strong biotech and pharmaceutical infrastructure , it is not difficult to imagine the development of a hidden BW program .


fn_spacy_tokens_for_baseline: Through both the death and resurrection of Jesus , humanity is now reconciled to God even if some people are unaware of , or do not care to hear , the good news .

source_bert_toks: through both the death and resurrection of jesus , humanity is now reconciled to god even if some people are unaware of , or do not care to hear , the good news .

reference_raw: Through the death and rebirth of Jesus, mankind is now at peace with God, even though some people do not know or care to hear the good news.

reference_spacy_tokens: Through the death and rebirth of Jesus , mankind is now at peace with God , even though some people do not know or care to hear the good news .


fn_spacy_tokens_for_baseline: Worst part was watching power lines waving above my head and no way to drive away .

source_bert_toks: worst part was watching power lines waving above my head and no way to drive away .

reference_raw: The worst part was watching the power lines swing over my head, and I couldn't get away.

reference_spacy_tokens: The worst part was watching the power lines swing over my head , and I could n't get away .


fn_spacy_tokens_for_baseline: A waiter wound through the tables towards them , bringing an ice bucket with a bobbing bottle and two chilled glasses .

source_bert_toks: a waiter wound through the tables towards them , bringing an ice bucket with a bob ##bing bottle and two chilled glasses .

reference_raw: The waiter went through the tables and brought a bucket of ice with a bobbing bottle and two cold glasses.

reference_spacy_tokens: The waiter went through the tables and brought a bucket of ice with a bobbing bottle and two cold glasses .


fn_spacy_tokens_for_baseline: Two main factories located in the cities of Kanggye and Sakchu are reportedly tasked with the final preparation , filling , and distribution of CW agents in artillery shells from 80 mm and larger , as well as 240 mm caliber artillery rockets .

source_bert_toks: two main factories located in the cities of kang ##gy ##e and sa ##k ##chu are reportedly tasked with the final preparation , filling , and distribution of cw agents in artillery shells from 80 mm and larger , as well as 240 mm caliber artillery rockets .

reference_raw: Two major factories located in Kanggye and Sakchu are said to be responsible for the final preparation, filling and dissemination of CW agents in artillery shells of 80 mm or more, as well as 240 mm in artillery rockets.

reference_spacy_tokens: Two major factories located in Kanggye and Sakchu are said to be responsible for the final preparation , filling and dissemination of CW agents in artillery shells of 80 mm or more , as well as 240 mm in artillery rockets .


fn_spacy_tokens_for_baseline: 2- Belongings A : Cars B : Personal effects C : Electronic equipment .

source_bert_toks: 2 - belongings a : cars b : personal effects c : electronic equipment .

reference_raw: 2- Belongs A: Cars B: Personal possessions C: Electronic equipment.

reference_spacy_tokens: 2- Belongs A : Cars B : Personal possessions C : Electronic equipment .


fn_spacy_tokens_for_baseline: Construction on Hoover Dam ( originally Boulder Dam , subsequently renamed for the president who authorized the project ) began in 1931 in a canyon 45 miles ( 72 km ) southeast of Las Vegas .

source_bert_toks: construction on hoover dam ( originally boulder dam , subsequently renamed for the president who authorized the project ) began in 1931 in a canyon 45 miles ( 72 km ) southeast of las vegas .

reference_raw: The construction of the Hoover Dam (the original Boulder Dam, later renamed by the President who approved the project) began in 1931 in a canyon 45 miles (72 km) south-east of Las Vegas.

reference_spacy_tokens: The construction of the Hoover Dam ( the original Boulder Dam , later renamed by the President who approved the project ) began in 1931 in a canyon 45 miles ( 72 km ) south - east of Las Vegas .


fn_spacy_tokens_for_baseline: From inside there came the clink of crockery and Mrs Binkworthy 's high - pitched voice feigning joviality .

source_bert_toks: from inside there came the cl ##ink of cr ##ock ##ery and mrs bin ##k ##worthy ' s high - pitched voice fei ##gni ##ng jo ##vial ##ity .

reference_raw: There was a clank of crockery from inside, and Mrs. Binkworthy's high-pitched voice feigned joviality.

reference_spacy_tokens: There was a clank of crockery from inside , and Mrs. Binkworthy 's high - pitched voice feigned joviality .


fn_spacy_tokens_for_baseline: At least three vans regularly tour London persuading Jews to fulfil religious obligations -- inviting them into the vans to say prayers or recite the traditional blessings over bread and wine .

source_bert_toks: at least three vans regularly tour london per ##su ##ading jews to fu ##lf ##il religious obligations - - inviting them into the vans to say prayers or rec ##ite the traditional blessings over bread and wine .

reference_raw: At least three vans regularly travel to London to persuade Jews to carry out their religious duties - to invite them to their vans to pray or recite their traditional bliss over bread and wine.

reference_spacy_tokens: At least three vans regularly travel to London to persuade Jews to carry out their religious duties - to invite them to their vans to pray or recite their traditional bliss over bread and wine .


reference_raw: There is also a new Cyber fountain outside the ferry terminal, with 86 sprays that shoot up to 70 metres (230 ft) and are lit at night by 288 spotlights that produce 80 colours.

reference_spacy_tokens: There is also a new Cyber fountain outside the ferry terminal , with 86 sprays that shoot up to 70 metres ( 230 ft ) and are lit at night by 288 spotlights that produce 80 colours .


fn_spacy_tokens_for_baseline: If n is negative the pseudo random sequence generator is set to a number based on n and n is returned .

source_bert_toks: if n is negative the pseudo random sequence generator is set to a number based on n and n is returned .

reference_raw: If n is negative, it shall be set to a number based on n and n shall be returned.

reference_spacy_tokens: If n is negative , it shall be set to a number based on n and n shall be returned .


fn_spacy_tokens_for_baseline: She is dissatisfied and tends to comment apathetically on her dissatisfaction , but her observations at this point in the interview were very lively indeed :

source_bert_toks: she is dissatisfied and tends to comment ap ##ath ##etic ##ally on her dissatisfaction , but her observations at this point in the interview were very lively indeed :

reference_raw: She is unsatisfied and has a tendency to comment apathetically on her dissatisfaction, but her remarks at this stage of the interview were very vivid:

reference_spacy_tokens: She is unsatisfied and has a tendency to comment apathetically on her dissatisfaction , but her remarks at this stage of the interview were very vivid :


fn_spacy_tokens_for_baseline: Acer Group Inc is hitching its wagon very closely to Microsoft Corp 's Windows NT 's star by developing a Mips Technologies Inc R4000/4400 six - chip chipset specifically for NT personal computers .

source_bert_toks: ace ##r group inc is hitch ##ing its wagon very closely to microsoft corp ' s windows nt ' s star by developing a mi ##ps technologies inc r ##400 ##0 / 440 ##0 six - chip chips ##et specifically for nt personal computers .

reference_raw: Acer Group Inc. tracks its car very close to the star of Microsoft Corp's Windows NT by developing a six-chip set of Mips Technologies Inc R400/4400, specifically for NT personal computers.

reference_spacy_tokens: Acer Group Inc. tracks its car very close to the star of Microsoft Corp 's Windows NT by developing a six - chip set of Mips Technologies Inc R400/4400 , specifically for NT personal computers .


fn_spacy_tokens_for_baseline: This behavior and not the edict itself forced them to be deceptive .

source_bert_toks: this behavior and not the edict itself forced them to be dec ##eptive .

reference_raw: This behavior, not the edict itself, made them deceitful.

reference_spacy_tokens: This behavior , not the edict itself , made them deceitful .


fn_spacy_tokens_for_baseline: He explained without the slightest embarrassment , and while he did so he looped lengths of the rope clothes ' line by his feet .

source_bert_toks: he explained without the slightest embarrassment , and while he did so he loop ##ed lengths of the rope clothes ' line by his feet .

reference_raw: He explained without the slightest embarrassment, and as he did so he swung the lengths of the rope line at his feet.

reference_spacy_tokens: He explained without the slightest embarrassment , and as he did so he swung the lengths of the rope line at his feet .


fn_spacy_tokens_for_baseline: New construction is everywhere , the streets buzz , traffic is increasingly congested , and in the frenetic pace of rush hour everyone in Dublin seems intent on changing places with everyone else .

source_bert_toks: new construction is everywhere , the streets buzz , traffic is increasingly cong ##ested , and in the fr ##ene ##tic pace of rush hour everyone in dublin seems intent on changing places with everyone else .

reference_raw: New buildings are everywhere, streets are buzzing, traffic is getting more and more crowded, and at the frantic speed of rush hour, everyone in Dublin seems to want to change places with everyone else.

reference_spacy_tokens: New buildings are everywhere , streets are buzzing , traffic is getting more and more crowded , and at the frantic speed of rush hour , everyone in Dublin seems to want to change places with everyone else .


fn_spacy_tokens_for_baseline: They are very direct in their dealings with each other , as you might discover if you come across a friendly conversation among a group of friends .

source_bert_toks: they are very direct in their dealings with each other , as you might discover if you come across a friendly conversation among a group of friends .

reference_raw: They're very direct in their dealings with each other, as you might find when you find a friendly conversation between a group of friends.

reference_spacy_tokens: They 're very direct in their dealings with each other , as you might find when you find a friendly conversation between a group of friends .


fn_spacy_tokens_for_baseline: She was lost in her own delirium and clawed him unmercifully as she rode the mad race .

source_bert_toks: she was lost in her own del ##iri ##um and clawed him un ##mer ##ciful ##ly as she rode the mad race .

reference_raw: Lost in her own delirium, she clutched at him unmercifully as she rode the mad race.

reference_spacy_tokens: Lost in her own delirium , she clutched at him unmercifully as she rode the mad race .


fn_spacy_tokens_for_baseline: One writer , signing his letter as " Red - blooded , balanced male , " remarked on the " frequency of women fainting in peals , " and suggested that they " settle back into their traditional role of making tea at meetings .

source_bert_toks: one writer , signing his letter as " red - blooded , balanced male , " remarked on the " frequency of women faint ##ing in pea ##ls , " and suggested that they " settle back into their traditional role of making tea at meetings .

reference_raw: One of the writers, who signed his letter as a red-blooded, balanced man, commented on the "frequency of women fainting in peals," and suggested that they "return to their traditional role of tea-making in sessions.

reference_spacy_tokens: One of the writers , who signed his letter as a red - blooded , balanced man , commented on the " frequency of women fainting in peals , " and suggested that they " return to their traditional role of tea - making in sessions .


fn_spacy_tokens_for_baseline: For example , said Mr Webster , while many investors shun nuclear weapons at all costs , they may not care if the portfolio includes alcohol .

source_bert_toks: for example , said mr webster , while many investors shu ##n nuclear weapons at all costs , they may not care if the portfolio includes alcohol .

reference_raw: For example, Mr. Webster said, while many investors avoid nuclear weapons at all costs, they might not care if the portfolio contains alcohol.

reference_spacy_tokens: For example , Mr. Webster said , while many investors avoid nuclear weapons at all costs , they might not care if the portfolio contains alcohol .


fn_spacy_tokens_for_baseline: The minor Aegean Islands were taken by various powerful European noblemen , many of whom were Genoese or Venetian , such as Marco Sanudo on Naxos .

source_bert_toks: the minor aegean islands were taken by various powerful european noble ##men , many of whom were gen ##oese or venetian , such as marco san ##ud ##o on na ##x ##os .

reference_raw: The smaller Aegean islands were conquered by a number of powerful European nobles, many of whom were Genoese or Venetian, such as Marco Sanudo in Naxos.

reference_spacy_tokens: The smaller Aegean islands were conquered by a number of powerful European nobles , many of whom were Genoese or Venetian , such as Marco Sanudo in Naxos .


fn_spacy_tokens_for_baseline: Now I am getting way too philosophical , but this is my final missive , so why not ?

source_bert_toks: now i am getting way too philosophical , but this is my final miss ##ive , so why not ?

reference_raw: I'm getting too philosophical right now, but this is my last missive, so why not?

reference_spacy_tokens: I 'm getting too philosophical right now , but this is my last missive , so why not ?


fn_spacy_tokens_for_baseline: A lot of people do n't realise he has electrifying pace .

source_bert_toks: a lot of people don ' t realise he has elect ##ri ##fying pace .

reference_raw: A lot of people don't realize he's got an electric pace.

reference_spacy_tokens: A lot of people do n't realize he 's got an electric pace .


fn_spacy_tokens_for_baseline: Emergency crews said they were hopeful that they would be able to control the fire .

source_bert_toks: emergency crews said they were hopeful that they would be able to control the fire .

reference_raw: The emergency crews said they were hoping to manage the fire.

reference_spacy_tokens: The emergency crews said they were hoping to manage the fire .


fn_spacy_tokens_for_baseline: By this measure , the companies ' analysts figure , the combination of Staples ' 553 superstores in 100 markets across the United States and Canada and Office Depot 's 571 North American outlets ( mostly superstores ) would still command less than 10 percent of the market .

source_bert_toks: by this measure , the companies ' analysts figure , the combination of staples ' 55 ##3 super ##stor ##es in 100 markets across the united states and canada and office depot ' s 57 ##1 north american outlets ( mostly super ##stor ##es ) would still command less than 10 percent of the market .

reference_raw: As a result of this measure, the company's analysts conclude that the mix of Staples' 553 supermarkets in 100 markets in the United States and Canada and Office Depot's 571 North American outlets (mostly superstores) would still dominate less than 10 % of the market.

reference_spacy_tokens: As a result of this measure , the company 's analysts conclude that the mix of Staples ' 553 supermarkets in 100 markets in the United States and Canada and Office Depot 's 571 North American outlets ( mostly superstores ) would still dominate less than 10 % of the market .


fn_spacy_tokens_for_baseline: Sample the taste of ackee cooked with saltfish , Jamaica 's national dish , and the smell of hot jerk pork cooked in a pit barbecue .

source_bert_toks: sample the taste of ac ##kee cooked with salt ##fish , jamaica ' s national dish , and the smell of hot jerk pork cooked in a pit barbecue .

reference_raw: Sample the taste of ackee cooked with saltfish, Jamaica's domestic food, and the smell of hot jerk pork cooked in a pit grill.

reference_spacy_tokens: Sample the taste of ackee cooked with saltfish , Jamaica 's domestic food , and the smell of hot jerk pork cooked in a pit grill .


fn_spacy_tokens_for_baseline: If it was idiotic of the BP jury to make the award to such an obviously vested interest , it seems even odder that Mr Whittam - Smith , who places such store on journalistic integrity , should have seen fit to accept it .

source_bert_toks: if it was idiot ##ic of the bp jury to make the award to such an obviously vested interest , it seems even odd ##er that mr w ##hit ##tam - smith , who places such store on journalist ##ic integrity , should have seen fit to accept it .

reference_raw: If it was stupid of the BP jury to award such an obvious vested interest, it would seem even more odd that Mr. Whittam-Smith, who puts such a store on journalistic integrity, would see fit to accept it.

reference_spacy_tokens: If it was stupid of the BP jury to award such an obvious vested interest , it would seem even more odd that Mr. Whittam - Smith , who puts such a store on journalistic integrity , would see fit to accept it .


fn_spacy_tokens_for_baseline: The center contains a concert hall with acclaimed acoustics , theaters , a library , an exhibition gallery , shops , restaurants , and bars .

source_bert_toks: the center contains a concert hall with acclaimed acoustic ##s , theaters , a library , an exhibition gallery , shops , restaurants , and bars .

reference_raw: The centre comprises a concert hall with acoustics, theatres, library, exhibition hall, shops, restaurants and bars.

reference_spacy_tokens: The centre comprises a concert hall with acoustics , theatres , library , exhibition hall , shops , restaurants and bars .


fn_spacy_tokens_for_baseline: The latter were forced to repair to the waiting area where they enviously sipped ginger beer while waiting their turn and watching the old horses pull the machines into the water , one after another .

source_bert_toks: the latter were forced to repair to the waiting area where they en ##vious ##ly sipped ginger beer while waiting their turn and watching the old horses pull the machines into the water , one after another .

reference_raw: They had to fix up in the waiting room, where they drank ginger beer enviously while they waited their turn and watched the old horses pull the machines into the water, one by one.

reference_spacy_tokens: They had to fix up in the waiting room , where they drank ginger beer enviously while they waited their turn and watched the old horses pull the machines into the water , one by one .


fn_spacy_tokens_for_baseline: I trust that you have been reading my peerless prose this lovely morning . '

source_bert_toks: i trust that you have been reading my peer ##less prose this lovely morning . '

reference_raw: I believe you've read my unparalleled prose this beautiful morning.'

reference_spacy_tokens: I believe you 've read my unparalleled prose this beautiful morning . '


fn_spacy_tokens_for_baseline: In general , these groups are more prepared to inflict indiscriminate casualties because they are not driven by specific political goals but rather by irrational belief systems , extremist ideologies ( such as neo - Nazism ) , apocalyptic prophecy ( predicting the end of the world ) , or religious fundamentalism .

source_bert_toks: in general , these groups are more prepared to in ##flict ind ##is ##cr ##imi ##nate casualties because they are not driven by specific political goals but rather by irrational belief systems , ex ##tre ##mist id ##eo ##logies ( such as neo - nazis ##m ) , apocalyptic prophecy ( predicting the end of the world ) , or religious fundamental ##ism .

reference_raw: In general, these groups are more willing to inflict indiscriminate losses because they are not driven by specific political goals, but by irrational belief systems, extremist ideologies (such as neo-Nazism), apocalyptic prophecy (predicting the end of the world), or religious fundamentalism.

reference_spacy_tokens: In general , these groups are more willing to inflict indiscriminate losses because they are not driven by specific political goals , but by irrational belief systems , extremist ideologies ( such as neo - Nazism ) , apocalyptic prophecy ( predicting the end of the world ) , or religious fundamentalism .


fn_spacy_tokens_for_baseline: He did not enter a plea .

source_bert_toks: he did not enter a plea .

reference_raw: He didn't ask.

reference_spacy_tokens: He did n't ask .


fn_spacy_tokens_for_baseline: The unnatural act of Dara 's murder and the treacherous overthrow of Shah Jehan acted like a curse upon Delhi .

source_bert_toks: the unnatural act of dar ##a ' s murder and the treacherous overthrow of shah je ##han acted like a curse upon delhi .

reference_raw: The unnatural act of Dara's murder and the treacherous topple of Shah Jehan had been a curse on Delhi.

reference_spacy_tokens: The unnatural act of Dara 's murder and the treacherous topple of Shah Jehan had been a curse on Delhi .


fn_spacy_tokens_for_baseline: Even at the best of times it was seldom working , and at present the electric current was cut off during daylight hours .

source_bert_toks: even at the best of times it was seldom working , and at present the electric current was cut off during daylight hours .

reference_raw: Even at the best of times, it rarely worked, and the current was now shut down during the daytime.

reference_spacy_tokens: Even at the best of times , it rarely worked , and the current was now shut down during the daytime .


fn_spacy_tokens_for_baseline: The Manitoba assembly was adjourned for the weekend on June 22 after Harper refused to allow an extended sitting .

source_bert_toks: the manitoba assembly was ad ##jou ##rned for the weekend on june 22 after harper refused to allow an extended sitting .

reference_raw: The Manitoba meeting was adjourned on the weekend of June 22, following Harper's refusal to allow the extension of the sitting.

reference_spacy_tokens: The Manitoba meeting was adjourned on the weekend of June 22 , following Harper 's refusal to allow the extension of the sitting .


fn_spacy_tokens_for_baseline: The utter confidence of the claim incensed her , but then came the pain of knowing that it was all too true .

source_bert_toks: the utter confidence of the claim incense ##d her , but then came the pain of knowing that it was all too true .

reference_raw: The complete self-confidence of the claim inflamed her, but then she felt the pain of knowing it was all too true.

reference_spacy_tokens: The complete self - confidence of the claim inflamed her , but then she felt the pain of knowing it was all too true .


fn_spacy_tokens_for_baseline: The Russo - Japanese War of 1904 - 05 occurred because the partially concealed rivalry of a decade before was now overt .

source_bert_toks: the russo - japanese war of 1904 - 05 occurred because the partially concealed rivalry of a decade before was now over ##t .

reference_raw: The Russo-Japanese War of 1904-05 took place because the partially hidden rivalry of the decade before was now overt.

reference_spacy_tokens: The Russo - Japanese War of 1904 - 05 took place because the partially hidden rivalry of the decade before was now overt .


fn_spacy_tokens_for_baseline: To counter this diversity , though , we also have the following common or shared characteristics : the same sense receptors ; similar goals ; recurring experiences ; and recurring issues and problems .

source_bert_toks: to counter this diversity , though , we also have the following common or shared characteristics : the same sense receptors ; similar goals ; recurring experiences ; and recurring issues and problems .

reference_raw: However, in order to combat this diversity, we also have the following common or common characteristics: the same sensory receptors; similar objectives; recurrent experiences; and recurrent problems and problems.

reference_spacy_tokens: However , in order to combat this diversity , we also have the following common or common characteristics : the same sensory receptors ; similar objectives ; recurrent experiences ; and recurrent problems and problems .


fn_spacy_tokens_for_baseline: Water World , formerly in the complex , has closed for redevelopment .

source_bert_toks: water world , formerly in the complex , has closed for redevelopment .

reference_raw: Water World, once in the complex, has been shut down for redevelopment.

reference_spacy_tokens: Water World , once in the complex , has been shut down for redevelopment .


fn_spacy_tokens_for_baseline: To glue them up , arrange your heaviest cramps with blocks and , to save time later , go through a dry run .

source_bert_toks: to glue them up , arrange your heaviest cr ##amps with blocks and , to save time later , go through a dry run .

reference_raw: To stick them together, arrange the heaviest spasms with blocks, and to save time later, go dry.

reference_spacy_tokens: To stick them together , arrange the heaviest spasms with blocks , and to save time later , go dry .


fn_spacy_tokens_for_baseline: 12:06 a.m. HRH : I was in the Berkeley Main library when it hit .

source_bert_toks: 12 : 06 a . m . hr ##h : i was in the berkeley main library when it hit .

reference_raw: 12:06 a.m. HRH: I was in Berkeley's main bookcase when it hit.

reference_spacy_tokens: 12:06 a.m. HRH : I was in Berkeley 's main bookcase when it hit .


fn_spacy_tokens_for_baseline: QN : Does Walden think Grand Slam deserves respect ?

source_bert_toks: q ##n : does walden think grand slam deserves respect ?

reference_raw: QN: Does Walden think the Grand Slam is worthy of respect?

reference_spacy_tokens: QN : Does Walden think the Grand Slam is worthy of respect ?


fn_spacy_tokens_for_baseline: " O play to me gypsy , " " he warbled .

source_bert_toks: " o play to me gypsy , " " he war ##bled .

reference_raw: "O play me gypsy," he said.

reference_spacy_tokens: " O play me gypsy , " he said .


fn_spacy_tokens_for_baseline: He was coatless and shivering .

source_bert_toks: he was coat ##less and shivering .

reference_raw: He was uncoated and trembling.

reference_spacy_tokens: He was uncoated and trembling .


fn_spacy_tokens_for_baseline: Modrow entitled his proposals ' For Germany , united fatherland ' , using a slogan often chanted by East German demonstrators .

source_bert_toks: mod ##row entitled his proposals ' for germany , united father ##land ' , using a slogan often chant ##ed by east german demonstrators .

reference_raw: Modrow claimed his proposals for Germany, united country , using a slogan often chanted by East German protestors.

reference_spacy_tokens: Modrow claimed his proposals for Germany , united country , using a slogan often chanted by East German protestors .


fn_spacy_tokens_for_baseline: As the day wore on they heard everywhere around them the rill of running water , and grass began to poke up through the snow in clumps .

source_bert_toks: as the day wore on they heard everywhere around them the ri ##ll of running water , and grass began to poke up through the snow in cl ##ump ##s .

reference_raw: As the day wore on, they could hear the sound of running water everywhere, and the grass began to poke through the snow in clumps.

reference_spacy_tokens: As the day wore on , they could hear the sound of running water everywhere , and the grass began to poke through the snow in clumps .


fn_spacy_tokens_for_baseline: At 934 m ( 3,064 ft ) , Lantau Peak is high enough to attract the occasional rain cloud - refreshingly cool breezes blow on most hot summer days .

source_bert_toks: at 93 ##4 m ( 3 , 06 ##4 ft ) , lan ##ta ##u peak is high enough to attract the occasional rain cloud - refreshing ##ly cool breeze ##s blow on most hot summer days .

reference_raw: At 934 m (3,064 ft), Lantau Peak is so high that it attracts occasional rain clouds - a refreshingly cool breeze blows on most warm summer days.

reference_spacy_tokens: At 934 m ( 3,064 ft ) , Lantau Peak is so high that it attracts occasional rain clouds - a refreshingly cool breeze blows on most warm summer days .


fn_spacy_tokens_for_baseline: All members commanders as well as subordinates must obey these rules .

source_bert_toks: all members commanders as well as subordinate ##s must obey these rules .

reference_raw: All member commanders and underlings must comply with these rules.

reference_spacy_tokens: All member commanders and underlings must comply with these rules .


fn_spacy_tokens_for_baseline: All our reasoning seems to point that way .

source_bert_toks: all our reasoning seems to point that way .

reference_raw: All of our reasoning seems to show that way.

reference_spacy_tokens: All of our reasoning seems to show that way .


fn_spacy_tokens_for_baseline: Jimmy was terrific at centre - half .

source_bert_toks: jimmy was terrific at centre - half .

reference_raw: Jimmy was amazing in the middle half.

reference_spacy_tokens: Jimmy was amazing in the middle half .


fn_spacy_tokens_for_baseline: Well , we deferred many difficult decisions , and this was just one of them . '

source_bert_toks: well , we def ##erre ##d many difficult decisions , and this was just one of them . '

reference_raw: Well, we've postponed a lot of difficult decisions, and that's just one of them.'

reference_spacy_tokens: Well , we 've postponed a lot of difficult decisions , and that 's just one of them . '


fn_spacy_tokens_for_baseline: Atherton batted beautifully for 42 but then left kicking himself for slamming a wide ball from Reiffel straight to cover off the back foot .

source_bert_toks: at ##herton batted beautifully for 42 but then left kicking himself for slamming a wide ball from rei ##ffe ##l straight to cover off the back foot .

reference_raw: Atherton took a great swing at 42, then left kicking himself for hitting the broad ball from Reiffel directly to cover his back leg.

reference_spacy_tokens: Atherton took a great swing at 42 , then left kicking himself for hitting the broad ball from Reiffel directly to cover his back leg .


fn_spacy_tokens_for_baseline: There 's an abundance of nature , history , art , and modern culture to be explored and enjoyed .

source_bert_toks: there ' s an abundance of nature , history , art , and modern culture to be explored and enjoyed .

reference_raw: There is a great deal of nature, history, art, and modern culture to be studied and enjoyed.

reference_spacy_tokens: There is a great deal of nature , history , art , and modern culture to be studied and enjoyed .


fn_spacy_tokens_for_baseline: It was seven o'clock in the evening and Lowell was mashing up cat biscuits in hot water for Middy .

source_bert_toks: it was seven o ' clock in the evening and lowell was mas ##hing up cat biscuits in hot water for mid ##dy .

reference_raw: It was seven o'clock in the evening, and Lowell was mashing cat cookies in hot water for Middy.

reference_spacy_tokens: It was seven o'clock in the evening , and Lowell was mashing cat cookies in hot water for Middy .


fn_spacy_tokens_for_baseline: Sarah smirked at him nastily .

source_bert_toks: sarah smirked at him nas ##ti ##ly .

reference_raw: Sarah gave him a nasty smile.

reference_spacy_tokens: Sarah gave him a nasty smile .


fn_spacy_tokens_for_baseline: These form the substance of the annual official criminal statistics on indictable offences ( or the Crime Index offences in America ) .

source_bert_toks: these form the substance of the annual official criminal statistics on ind ##ic ##table offences ( or the crime index offences in america ) .

reference_raw: This is the content of the annual official criminal statistics on criminal offences (or crime index offences in the United States).

reference_spacy_tokens: This is the content of the annual official criminal statistics on criminal offences ( or crime index offences in the United States ) .


fn_spacy_tokens_for_baseline: Evans was arrested in piccadilly in 1908 , wearing ' lace petticoats and stays and drinking from an opened spirit bottle ' .

source_bert_toks: evans was arrested in pic ##ca ##dilly in 1908 , wearing ' lace pet ##tic ##oat ##s and stays and drinking from an opened spirit bottle ' .

reference_raw: Evans was arrested in Piccadilly in 1908, wearing a "lace petticoat and a stay and a drink from an open bottle of alcohol."

reference_spacy_tokens: Evans was arrested in Piccadilly in 1908 , wearing a " lace petticoat and a stay and a drink from an open bottle of alcohol . "


fn_spacy_tokens_for_baseline: ' Oh stow it , Bumface .

source_bert_toks: ' oh st ##ow it , bum ##face .

reference_raw: 'Stow it, Bumface.

reference_spacy_tokens: ' Stow it , Bumface .


fn_spacy_tokens_for_baseline: They claim that the huge crop will push down prices , and this , coupled with cheap imported plums from Spain will mean it simply wo n't be worth picking the fruits .

source_bert_toks: they claim that the huge crop will push down prices , and this , coupled with cheap imported plum ##s from spain will mean it simply won ' t be worth picking the fruits .

reference_raw: They say a huge crop will drive down prices, and that, coupled with cheap imported plums from Spain, means it's just not worth picking fruit.

reference_spacy_tokens: They say a huge crop will drive down prices , and that , coupled with cheap imported plums from Spain , means it 's just not worth picking fruit .


fn_spacy_tokens_for_baseline: They are antiviral drugs uh designed to basically shorten uh how bad the flu might effect you uh try to lessen its impact .

source_bert_toks: they are anti ##vira ##l drugs uh designed to basically short ##en uh how bad the flu might effect you uh try to less ##en its impact .

reference_raw: They're antiviral drugs, uh, designed to essentially reduce the extent to which the flu can affect you, uh, trying to reduce the effect.

reference_spacy_tokens: They 're antiviral drugs , uh , designed to essentially reduce the extent to which the flu can affect you , uh , trying to reduce the effect .


fn_spacy_tokens_for_baseline: Saul Bellow 's new novella , his second in six months , is a mean 100 pages .

source_bert_toks: saul bell ##ow ' s new novella , his second in six months , is a mean 100 pages .

reference_raw: Saul Bellow's new novel, the second in six months, is an average of 100 pages.

reference_spacy_tokens: Saul Bellow 's new novel , the second in six months , is an average of 100 pages .


fn_spacy_tokens_for_baseline: ' She did n't , I think , mention that , ' Gilbert sounded detached , as though it would have been ill - mannered of him to enquire .

source_bert_toks: ' she didn ' t , i think , mention that , ' gilbert sounded detached , as though it would have been ill - manner ##ed of him to en ##qui ##re .

reference_raw: 'I don't think she mentioned it,' Gilbert said indifferently, as if it would be rude of him to ask.

reference_spacy_tokens: ' I do n't think she mentioned it , ' Gilbert said indifferently , as if it would be rude of him to ask .


fn_spacy_tokens_for_baseline: Wearing tunic and hose of pale blue satin lavishly ornamented with silver , he looked more angelic than ever .

source_bert_toks: wearing tunic and hose of pale blue satin lavish ##ly or ##name ##nted with silver , he looked more angel ##ic than ever .

reference_raw: He wore a tunic and hose of pale blue satin, lavishly decorated with silver, and looked more angelic than ever.

reference_spacy_tokens: He wore a tunic and hose of pale blue satin , lavishly decorated with silver , and looked more angelic than ever .


fn_spacy_tokens_for_baseline: Le Cerf was rightly taken to task for his selective criticisms of Bononcini , 3 but the tonal oddness of Quando ridi is by no means exceptional in Italian music of the period .

source_bert_toks: le ce ##rf was right ##ly taken to task for his selective criticisms of bono ##nc ##ini , 3 but the ton ##al odd ##ness of quan ##do rid ##i is by no means exceptional in italian music of the period .

reference_raw: Le Cerf was rightly placed in charge of his selective criticism of Bononcini, 3, but the tonal peculiarity of Quando Ridi is not in any way exceptional in the Italian music of that period.

reference_spacy_tokens: Le Cerf was rightly placed in charge of his selective criticism of Bononcini , 3 , but the tonal peculiarity of Quando Ridi is not in any way exceptional in the Italian music of that period .


fn_spacy_tokens_for_baseline: She flashed Frau Geller and her companion a glance of the deepest loathing .

source_bert_toks: she flashed fra ##u gel ##ler and her companion a glance of the deepest lo ##athing .

reference_raw: She gave Frau Geller and her companion a look of disgust.

reference_spacy_tokens: She gave Frau Geller and her companion a look of disgust .


fn_spacy_tokens_for_baseline: You will need to plait your horse 's mane and pull or plait his tail .

source_bert_toks: you will need to pl ##ai ##t your horse ' s mane and pull or pl ##ai ##t his tail .

reference_raw: You're going to have to plat your horse's mane and pull or play its tail.

reference_spacy_tokens: You 're going to have to plat your horse 's mane and pull or play its tail .


fn_spacy_tokens_for_baseline: She was wearing a low - cut green silk dress , partially covered by a charming little white broderie anglaise nonsense of an apron , the sort of apron that features in blue movies .

source_bert_toks: she was wearing a low - cut green silk dress , partially covered by a charming little white bro ##der ##ie ang ##laise nonsense of an apron , the sort of apron that features in blue movies .

reference_raw: She was dressed in a low-cut green silk dress, partly obscured by the glamorous white broderie anglaise nonsense of an apron, the sort of apron that features in blue films.

reference_spacy_tokens: She was dressed in a low - cut green silk dress , partly obscured by the glamorous white broderie anglaise nonsense of an apron , the sort of apron that features in blue films .


fn_spacy_tokens_for_baseline: LINFORD Christie will quit athletics in two years ' time -- aiming to bow out as the undisputed No 1 sprinter in the world , writes David Harrison .

source_bert_toks: lin ##ford christie will quit athletics in two years ' time - - aiming to bow out as the und ##is ##puted no 1 sprinter in the world , writes david harrison .

reference_raw: LINFORD Christie will be out of athletics in two years - he's trying to bow down as the undisputed number one sprinter in the world - and he's writing David Harrison.

reference_spacy_tokens: LINFORD Christie will be out of athletics in two years - he 's trying to bow down as the undisputed number one sprinter in the world - and he 's writing David Harrison .


fn_spacy_tokens_for_baseline: Immigration officials detained him at Heathrow Airport and threatened to return him to Sweden .

source_bert_toks: immigration officials detained him at heath ##row airport and threatened to return him to sweden .

reference_raw: Immigration officials arrested him at Heathrow Airport and threatened to return him to Sweden.

reference_spacy_tokens: Immigration officials arrested him at Heathrow Airport and threatened to return him to Sweden .


fn_spacy_tokens_for_baseline: Beds planted with summer filling of tiger lilies , carnations , sweet peas , poppies , marigolds , gentians and fuchsias .

source_bert_toks: beds planted with summer filling of tiger lil ##ies , car ##nation ##s , sweet peas , pop ##pies , mari ##gold ##s , gen ##tian ##s and fu ##chs ##ias .

reference_raw: Beds sown in summer filled with tiger lilies, carnations, sweet peas, poppies, marigolds, gents and fuchsias.

reference_spacy_tokens: Beds sown in summer filled with tiger lilies , carnations , sweet peas , poppies , marigolds , gents and fuchsias .


fn_spacy_tokens_for_baseline: It was not until 1829 that Rafael Rivera , a Mexican scout , found a spring -fed valley and dubbed it Las Vegas -- a Spanish name that leaves many modern visitors wondering exactly where " the meadows " really lay .

source_bert_toks: it was not until 1829 that rafael rivera , a mexican scout , found a spring - fed valley and dubbed it las vegas - - a spanish name that leaves many modern visitors wondering exactly where " the meadows " really lay .

reference_raw: Only in 1829 did Rafael Rivera, a Mexican explorer, find a spring-fed valley and call it Las Vegas-a Spanish name that makes many modern visitors wonder exactly where the meadows really are.

reference_spacy_tokens: Only in 1829 did Rafael Rivera , a Mexican explorer , find a spring - fed valley and call it Las Vegas - a Spanish name that makes many modern visitors wonder exactly where the meadows really are .


fn_spacy_tokens_for_baseline: During its existence Coast scientists tested and developed both small quantities of well - known CW agents ( including mustard agent , sarin , tabun , BZ , and perhaps VX ) and a host of lethal , hard - to - trace toxic chemicals .

source_bert_toks: during its existence coast scientists tested and developed both small quantities of well - known cw agents ( including mustard agent , sar ##in , tab ##un , b ##z , and perhaps v ##x ) and a host of lethal , hard - to - trace toxic chemicals .

reference_raw: During its life, coastal scientists have tested and developed both small quantities of well-known CW agents (including mustard agents, sarins, tabuns, BZs, and possibly VXs) and a host of deadly, hard-to-trace toxic chemicals.

reference_spacy_tokens: During its life , coastal scientists have tested and developed both small quantities of well - known CW agents ( including mustard agents , sarins , tabuns , BZs , and possibly VXs ) and a host of deadly , hard - to - trace toxic chemicals .


fn_spacy_tokens_for_baseline: ' Maybe you oughta stay where you are , ' he suggested .

source_bert_toks: ' maybe you ought ##a stay where you are , ' he suggested .

reference_raw: "Perhaps you should stay where you are," he said.

reference_spacy_tokens: " Perhaps you should stay where you are , " he said .


fn_spacy_tokens_for_baseline: The passengers , replete with the lamb and chocolate mousse , lingered over coffee , and began to drift away to the dome car 's bar lounge .

source_bert_toks: the passengers , rep ##lete with the lamb and chocolate mo ##uss ##e , lingered over coffee , and began to drift away to the dome car ' s bar lounge .

reference_raw: The passengers, replenished with lamb and chocolate mousse, lingered over their coffee and began to walk away to the barroom of the dome-car.

reference_spacy_tokens: The passengers , replenished with lamb and chocolate mousse , lingered over their coffee and began to walk away to the barroom of the dome - car .


fn_spacy_tokens_for_baseline: In the tower , five men and women pull rhythmically on ropes attached to the same five bells that first sounded here in 1614 .

source_bert_toks: in the tower , five men and women pull rhythmic ##ally on ropes attached to the same five bells that first sounded here in 161 ##4 .

reference_raw: In the tower, five men and women pull rhythmically on ropes attached to the same five bells that were first heard here in 1614.

reference_spacy_tokens: In the tower , five men and women pull rhythmically on ropes attached to the same five bells that were first heard here in 1614 .


fn_spacy_tokens_for_baseline: " A deadly - chemical exercise sent nearly 100 national guardsmen and women into action Wednesday morning .

source_bert_toks: " a deadly - chemical exercise sent nearly 100 national guards ##men and women into action wednesday morning .

reference_raw: "A deadly chemical exercise sent nearly a hundred National Guardsmen and females into action on Wednesday morning."

reference_spacy_tokens: " A deadly chemical exercise sent nearly a hundred National Guardsmen and females into action on Wednesday morning . "


fn_spacy_tokens_for_baseline: You do n't chop off a man 's arms while he 's sitting there watching you . '

source_bert_toks: you don ' t chop off a man ' s arms while he ' s sitting there watching you . '

reference_raw: You can't cut off a man's hands while he sits there and watches you.'

reference_spacy_tokens: You ca n't cut off a man 's hands while he sits there and watches you . '


fn_spacy_tokens_for_baseline: Inside , about 12 demonstrators , believed to be National Front members , were ejected by police after attempting to disrupt the meeting .

source_bert_toks: inside , about 12 demonstrators , believed to be national front members , were ejected by police after attempting to disrupt the meeting .

reference_raw: Inside, some 12 protestors, who were believed to be members of the National Front, were expelled by the police after trying to disrupt the meeting.

reference_spacy_tokens: Inside , some 12 protestors , who were believed to be members of the National Front , were expelled by the police after trying to disrupt the meeting .


fn_spacy_tokens_for_baseline: of the two biggest shopping developments in Belfast are let , which is an extraordinary figure in comparison with other new developments in the rest of the country .

source_bert_toks: of the two biggest shopping developments in belfast are let , which is an extraordinary figure in comparison with other new developments in the rest of the country .

reference_raw: of the two largest shopping trends in Belfast, which is an exceptional figure compared to other new trends in the rest of the country.

reference_spacy_tokens: of the two largest shopping trends in Belfast , which is an exceptional figure compared to other new trends in the rest of the country .


fn_spacy_tokens_for_baseline: At first glance , Wilson should have been a superlative practitioner of Cabinet government .

source_bert_toks: at first glance , wilson should have been a super ##lative practitioner of cabinet government .

reference_raw: At first sight, Wilson was supposed to be a super-lative government official.

reference_spacy_tokens: At first sight , Wilson was supposed to be a super - lative government official .


fn_spacy_tokens_for_baseline: Carrie and Nick and Mister Johnny helped too , to begin with , but their efforts were puny beside Frederick 's and they tired much more quickly .

source_bert_toks: carrie and nick and mister johnny helped too , to begin with , but their efforts were pun ##y beside frederick ' s and they tired much more quickly .

reference_raw: For starters, Carrie, Nick, and Mr. Johnny helped, but their efforts were small next to Frederick's, and they got tired a lot faster.

reference_spacy_tokens: For starters , Carrie , Nick , and Mr. Johnny helped , but their efforts were small next to Frederick 's , and they got tired a lot faster .


fn_spacy_tokens_for_baseline: Reproachfully , Rosa dipped into the deep pot of olives and served a scoop of the waxy jade pebbles on to a dish and set it near Tommaso .

source_bert_toks: rep ##ro ##ach ##fully , rosa dipped into the deep pot of olive ##s and served a scoop of the wax ##y jade pebbles on to a dish and set it near tom ##mas ##o .

reference_raw: Reproachfully, Rosa dipped into a deep pot of olives, served a cup of waxy jade pebbles on a bowl, and placed it near Tommaso.

reference_spacy_tokens: Reproachfully , Rosa dipped into a deep pot of olives , served a cup of waxy jade pebbles on a bowl , and placed it near Tommaso .


fn_spacy_tokens_for_baseline: " Another women wrote from Sheffield to say that in her 60 years of ringing , " I have never known a lady to faint in the belfry .

source_bert_toks: " another women wrote from sheffield to say that in her 60 years of ringing , " i have never known a lady to faint in the bel ##fr ##y .

reference_raw: "Another woman from Sheffield wrote that in her 60 years of ringing, "I've never known a woman to pass out in a bell.

reference_spacy_tokens: " Another woman from Sheffield wrote that in her 60 years of ringing , " I 've never known a woman to pass out in a bell .


fn_spacy_tokens_for_baseline: As he collapsed he saw the Doctor being pummelled by the mob .

source_bert_toks: as he collapsed he saw the doctor being pu ##mmel ##led by the mob .

reference_raw: As he collapsed, he saw the Doctor being hit by a crowd.

reference_spacy_tokens: As he collapsed , he saw the Doctor being hit by a crowd .


fn_spacy_tokens_for_baseline: The taxpayer companies , Delapage Ltd and Twinsectra Ltd , each appealed against assessments in respect of the years to 31 March 1987 and 1988 .

source_bert_toks: the taxpayer companies , del ##apa ##ge ltd and twins ##ect ##ra ltd , each appealed against assessments in respect of the years to 31 march 1987 and 1988 .

reference_raw: The taxpayer companies, Delapage Ltd and Twinsectra Ltd, each brought an action against the assessment for the period up to 31 March 1987 and 1988.

reference_spacy_tokens: The taxpayer companies , Delapage Ltd and Twinsectra Ltd , each brought an action against the assessment for the period up to 31 March 1987 and 1988 .


fn_spacy_tokens_for_baseline: The sea , rather than dipping to the horizon , curled up like the lip of a dish .

source_bert_toks: the sea , rather than dipping to the horizon , curled up like the lip of a dish .

reference_raw: Instead of sinking to the horizon, the sea curled like the lip of a bowl.

reference_spacy_tokens: Instead of sinking to the horizon , the sea curled like the lip of a bowl .


fn_spacy_tokens_for_baseline: He has n't got a pliable conscience like me .

source_bert_toks: he hasn ' t got a pl ##iable conscience like me .

reference_raw: He doesn't have a reasonable conscience like me.

reference_spacy_tokens: He does n't have a reasonable conscience like me .


fn_spacy_tokens_for_baseline: Maggie quickly brought her attention back to the cross - eyed girl and forgot all about the young man .

source_bert_toks: maggie quickly brought her attention back to the cross - eyed girl and forgot all about the young man .

reference_raw: Maggie quickly returned her attention to the girl with the cross eyes, forgetting the young man.

reference_spacy_tokens: Maggie quickly returned her attention to the girl with the cross eyes , forgetting the young man .


fn_spacy_tokens_for_baseline: M. Robert illustrates an example from Pompeii , now in Naples Museum , in which the handle was decorated by the figures of a farrier and a horse , clearly demonstrating the use of the tool .

source_bert_toks: m . robert illustrates an example from po ##mp ##ei ##i , now in naples museum , in which the handle was decorated by the figures of a far ##rier and a horse , clearly demonstrating the use of the tool .

reference_raw: Mr. Robert illustrates the example of Pompeii, which is now at the Naples Museum, where the handle was adorned by the figures of a farrier and a horse, which clearly demonstrates the use of the instrument.

reference_spacy_tokens: Mr. Robert illustrates the example of Pompeii , which is now at the Naples Museum , where the handle was adorned by the figures of a farrier and a horse , which clearly demonstrates the use of the instrument .


fn_spacy_tokens_for_baseline: A great longing to see his father 's face had swept over him , filling him with a sudden , intense pain .

source_bert_toks: a great longing to see his father ' s face had swept over him , filling him with a sudden , intense pain .

reference_raw: A great desire to see his father's face swept over him, filling him with sudden, intense pain.

reference_spacy_tokens: A great desire to see his father 's face swept over him , filling him with sudden , intense pain .


fn_spacy_tokens_for_baseline: The province 's deputy governor was killed by a suicide bomber last month as he drove to work .

source_bert_toks: the province ' s deputy governor was killed by a suicide bomber last month as he drove to work .

reference_raw: The deputy governor of the province was killed last month by a suicidal bomber on his way to work.

reference_spacy_tokens: The deputy governor of the province was killed last month by a suicidal bomber on his way to work .


fn_spacy_tokens_for_baseline: Lambert looked at Woolley with dull loathing .

source_bert_toks: lambert looked at wool ##ley with dull lo ##athing .

reference_raw: Lambert gave Woolley a dull look of disgust.

reference_spacy_tokens: Lambert gave Woolley a dull look of disgust .


fn_spacy_tokens_for_baseline: It is divided into three areas : a highland , a lowland , and the Middle Kingdom .

source_bert_toks: it is divided into three areas : a highland , a lowland , and the middle kingdom .

reference_raw: It is divided into three regions: the highlands, the lowlands, and the Middle Kingdom.

reference_spacy_tokens: It is divided into three regions : the highlands , the lowlands , and the Middle Kingdom .


fn_spacy_tokens_for_baseline: Tons of caustic sodium leaked from a plant cooling system in the accident and some of it combusted with the air .

source_bert_toks: tons of ca ##ust ##ic sodium leaked from a plant cooling system in the accident and some of it comb ##ust ##ed with the air .

reference_raw: In the accident, tons of caustic sodium leaked out of the plant's cooling system, and some of it blew up in the air.

reference_spacy_tokens: In the accident , tons of caustic sodium leaked out of the plant 's cooling system , and some of it blew up in the air .


fn_spacy_tokens_for_baseline: The State Department recently issued warnings or alerts for these areas :

source_bert_toks: the state department recently issued warnings or alert ##s for these areas :

reference_raw: The Ministry of Foreign Affairs has recently issued warnings or warnings for the following areas:

reference_spacy_tokens: The Ministry of Foreign Affairs has recently issued warnings or warnings for the following areas :


fn_spacy_tokens_for_baseline: But security experts believe that the deal was authorized by Dr. Majid Tehrani Abbaspur , Iran 's chief security adviser and a close associate of President Rafsanjani .

source_bert_toks: but security experts believe that the deal was authorized by dr . maj ##id tehran ##i abbas ##pur , iran ' s chief security adviser and a close associate of president raf ##san ##jan ##i .

reference_raw: But security experts believe that the deal was approved by Dr. Majid Tehrani Abbaspur, Iran's Chief Security Adviser, and an intimate associate of President Rafsanjani.

reference_spacy_tokens: But security experts believe that the deal was approved by Dr. Majid Tehrani Abbaspur , Iran 's Chief Security Adviser , and an intimate associate of President Rafsanjani .


fn_spacy_tokens_for_baseline: Over his shoulder was hung a canvas bag which contained all his worldly possessions , and close to his left heel trotted a black and white collie .

source_bert_toks: over his shoulder was hung a canvas bag which contained all his world ##ly possessions , and close to his left heel tr ##otted a black and white col ##lie .

reference_raw: There was a canvas bag over his shoulder that contained all of his worldly property, and a black-and-white collie trotted near his left heel.

reference_spacy_tokens: There was a canvas bag over his shoulder that contained all of his worldly property , and a black - and - white collie trotted near his left heel .


fn_spacy_tokens_for_baseline: In a public interview , the Iranian representative to the United Nations , Rajai'e Korassani , stated that " ... if the Iraqi regime does not take any steps in putting an end to the crimes of the Iraqi regime , we will retaliate in kind , and in that case , we will certainly announce it . "

source_bert_toks: in a public interview , the iranian representative to the united nations , raja ##i ' e ko ##ras ##san ##i , stated that " . . . if the iraqi regime does not take any steps in putting an end to the crimes of the iraqi regime , we will re ##tal ##iate in kind , and in that case , we will certainly announce it . "

reference_raw: In a public interview, an Iranian representative of the United Nations, Rajai'e Korassani, said, "...if the Iraqi regime does not take steps to put an end to the crimes of the Iraqi regime, we will retaliate in kind, and in that case, we will certainly announce it."

reference_spacy_tokens: In a public interview , an Iranian representative of the United Nations , Rajai'e Korassani , said , " ... if the Iraqi regime does not take steps to put an end to the crimes of the Iraqi regime , we will retaliate in kind , and in that case , we will certainly announce it . "


fn_spacy_tokens_for_baseline: During a comical lesson on how to catch her man , Little Cog is told she must weep not buckets but spoons .

source_bert_toks: during a comical lesson on how to catch her man , little co ##g is told she must weep not bucket ##s but spoon ##s .

reference_raw: During the comic lesson of capturing her husband, Little Cog was told that she had to cry not buckets but spoons.

reference_spacy_tokens: During the comic lesson of capturing her husband , Little Cog was told that she had to cry not buckets but spoons .


fn_spacy_tokens_for_baseline: Thera Island was some four miles distant with Cape Akrotiri lying directly to the north and Mount Elias , the highest point of the island -- it was close on 2000 feet -- to the north - east .

source_bert_toks: the ##ra island was some four miles distant with cape ak ##rot ##iri lying directly to the north and mount elias , the highest point of the island - - it was close on 2000 feet - - to the north - east .

reference_raw: Thera Island was about four miles away, and Cape Akrotiri lay directly to the northern side of the island and Mount Elias, the highest point of the island - it was almost two thousand feet - to the southeast.

reference_spacy_tokens: Thera Island was about four miles away , and Cape Akrotiri lay directly to the northern side of the island and Mount Elias , the highest point of the island - it was almost two thousand feet - to the southeast .


fn_spacy_tokens_for_baseline: Software vendors such as Telesmart are doing their bit to help by providing software to sit between users ' applications and the various EDI networks ( see Panel 2 -- British Gypsum ) .

source_bert_toks: software vendors such as tel ##es ##mart are doing their bit to help by providing software to sit between users ' applications and the various ed ##i networks ( see panel 2 - - british g ##yp ##sum ) .

reference_raw: Software sellers like Telesmart do their part to help by providing software that sits between user applications and different EDI networks (see Panel 2 - British Gypsum).

reference_spacy_tokens: Software sellers like Telesmart do their part to help by providing software that sits between user applications and different EDI networks ( see Panel 2 - British Gypsum ) .


fn_spacy_tokens_for_baseline: Boil the potatoes until well done and mash with a little water to achieve a soft consistency .

source_bert_toks: boil the potatoes until well done and mas ##h with a little water to achieve a soft consistency .

reference_raw: The potatoes are cooked until they are well-done and mashed with a little water in order to achieve a soft consistency.

reference_spacy_tokens: The potatoes are cooked until they are well - done and mashed with a little water in order to achieve a soft consistency .


fn_spacy_tokens_for_baseline: Shooting the rapids on the Ottawa River

source_bert_toks: shooting the rapids on the ottawa river

reference_raw: We're shooting fasts on the Ottawa River.

reference_spacy_tokens: We 're shooting fasts on the Ottawa River .


fn_spacy_tokens_for_baseline: I pointed to three red , leather bangles , decorated with turquoise beads -- presents for my daughter Susan and my two nieces .

source_bert_toks: i pointed to three red , leather bang ##les , decorated with turquoise beads - - presents for my daughter susan and my two niece ##s .

reference_raw: I pointed to three red leather bracelets decorated with turquoise beads - a present for my daughter Susan and two nieces.

reference_spacy_tokens: I pointed to three red leather bracelets decorated with turquoise beads - a present for my daughter Susan and two nieces .


fn_spacy_tokens_for_baseline: Finally , R. xanthina ' Canary Bird " is one of the most popular of the species roses , having 2 inch ( 5 cm ) bright yellow flowers on 7 ft ( 2 m ) shrubs clothed with delicate fern - like foliage .

source_bert_toks: finally , r . x ##ant ##hin ##a ' canary bird " is one of the most popular of the species roses , having 2 inch ( 5 cm ) bright yellow flowers on 7 ft ( 2 m ) shrubs clothed with delicate fern - like foliage .

reference_raw: Last but not least, R. xanthina "Canary Bird" is one of the most popular roses of the species, with two inches (5 cm) of clear yellow flowers on 7 ft (2 m) of bushes covered with fine fern-like leaves.

reference_spacy_tokens: Last but not least , R. xanthina " Canary Bird " is one of the most popular roses of the species , with two inches ( 5 cm ) of clear yellow flowers on 7 ft ( 2 m ) of bushes covered with fine fern - like leaves .


fn_spacy_tokens_for_baseline: Most people could make better use of their time and the whole idea of the log is to provide the information and stimulus for improvement .

source_bert_toks: most people could make better use of their time and the whole idea of the log is to provide the information and stimulus for improvement .

reference_raw: Most people can make better use of their time, and the whole idea of the protocol is to provide information and incentives for improvement.

reference_spacy_tokens: Most people can make better use of their time , and the whole idea of the protocol is to provide information and incentives for improvement .


fn_spacy_tokens_for_baseline: The protesters , mostly farmers in straw sombreros , raised banners of the leftist Democratic Revolution Party , traditionally the biggest opponent of 65 years of uninterrupted rule by the Institutional Revolutionary Party , or PRI .

source_bert_toks: the protesters , mostly farmers in straw so ##mbre ##ros , raised banners of the leftist democratic revolution party , traditionally the biggest opponent of 65 years of un ##int ##er ##rup ##ted rule by the institutional revolutionary party , or pri .

reference_raw: Protestants, mostly straw-sombrero farmers, raised flags from the leftist Democratic Revolutionary Party, traditionally the largest opponent of 65 years of uninterrupted government by the Institutional Revolutionary Party or the PRI.

reference_spacy_tokens: Protestants , mostly straw - sombrero farmers , raised flags from the leftist Democratic Revolutionary Party , traditionally the largest opponent of 65 years of uninterrupted government by the Institutional Revolutionary Party or the PRI .


fn_spacy_tokens_for_baseline: The suicide attacker 's vehicle ' suddenly came on the road and hit a black Mercedes , which was just behind Gen. Musharraf 's car , ' Siddiqui said .

source_bert_toks: the suicide attacker ' s vehicle ' suddenly came on the road and hit a black mercedes , which was just behind gen . mu ##sha ##rra ##f ' s car , ' sid ##di ##qui said .

reference_raw: The car of the suicide bomber suddenly hit the black Mercedes just behind General Musharraf's car," Siddiqui said.

reference_spacy_tokens: The car of the suicide bomber suddenly hit the black Mercedes just behind General Musharraf 's car , " Siddiqui said .


fn_spacy_tokens_for_baseline: Short of declaring Iran in violation of the NPT , the IAEA Director - General Mohamed ElBaradei stated , " Iran has failed to meet its obligations under its Safeguards Agreement " and criticized Iran for not being transparent with the construction of its nuclear - related facilities and import of nuclear material .

source_bert_toks: short of declaring iran in violation of the np ##t , the ia ##ea director - general mohamed el ##bara ##de ##i stated , " iran has failed to meet its obligations under its safeguard ##s agreement " and criticized iran for not being transparent with the construction of its nuclear - related facilities and import of nuclear material .

reference_raw: Shortly before declaring Iran to be in breach of the NPT, the Director of the International Atomic Energy Agency - General Mohamed ElBaradei said, "Iran has failed to fulfil its obligations under the Safeguards Convention" and criticized Iran for not being transparent about the construction of its nuclear-related equipment and the import of nuclear material.

reference_spacy_tokens: Shortly before declaring Iran to be in breach of the NPT , the Director of the International Atomic Energy Agency - General Mohamed ElBaradei said , " Iran has failed to fulfil its obligations under the Safeguards Convention " and criticized Iran for not being transparent about the construction of its nuclear - related equipment and the import of nuclear material .


fn_spacy_tokens_for_baseline: the banks , so that capital could then be lent to help rebuild businesses ravaged

reference_raw: banks, so that capital could then be loaned to help rebuild businesses ravaged

reference_spacy_tokens: banks , so that capital could then be loaned to help rebuild businesses ravaged


fn_spacy_tokens_for_baseline: This paper describes the first attempt in any organism to determine how the presence of a replication enhancer next to a core replication origin alters the relative importance of the sequences within the core origin .

source_bert_toks: this paper describes the first attempt in any organism to determine how the presence of a replication enhance ##r next to a core replication origin alter ##s the relative importance of the sequences within the core origin .

reference_raw: This document describes the first attempt in any organism to determine how the presence of a replication enhancer in addition to the origin of the core replication alters the relative importance of the sequences in the core origin.

reference_spacy_tokens: This document describes the first attempt in any organism to determine how the presence of a replication enhancer in addition to the origin of the core replication alters the relative importance of the sequences in the core origin .


fn_spacy_tokens_for_baseline: It was found that Mrs Thomlinson 's frugality had been deceptive .

source_bert_toks: it was found that mrs thom ##linson ' s fr ##uga ##lity had been dec ##eptive .

reference_raw: It was found that Mrs. Thomlinson's rudeness was deceitful.

reference_spacy_tokens: It was found that Mrs. Thomlinson 's rudeness was deceitful .


fn_spacy_tokens_for_baseline: Alexia was tormented , and poured her feelings out on canvas , producing some of her best work .

source_bert_toks: alexia was tormented , and poured her feelings out on canvas , producing some of her best work .

reference_raw: Alexia was tortured, and she poured her feelings onto the screen to produce some of her best work.

reference_spacy_tokens: Alexia was tortured , and she poured her feelings onto the screen to produce some of her best work .


fn_spacy_tokens_for_baseline: The university places emphasis on its strong relationship with the nation 's industries and the practical application of its training programs .

source_bert_toks: the university places emphasis on its strong relationship with the nation ' s industries and the practical application of its training programs .

reference_raw: The university highlights its strong link with the national industry and the practical application of its training programmes.

reference_spacy_tokens: The university highlights its strong link with the national industry and the practical application of its training programmes .


fn_spacy_tokens_for_baseline: As its temperature increases , a higher pressure must be employed to liquefy it ( see table 3.4 ) .

source_bert_toks: as its temperature increases , a higher pressure must be employed to li ##que ##fy it ( see table 3 . 4 ) .

reference_raw: As the temperature rises, a higher pressure should be used to liquidate the product (see Table 3.4).

reference_spacy_tokens: As the temperature rises , a higher pressure should be used to liquidate the product ( see Table 3.4 ) .


fn_spacy_tokens_for_baseline: He heard with awful clarity , above the shuffle of feet and the soft roaring of cars , the croak and caw of rooks and their tattered scuffling overhead .

source_bert_toks: he heard with awful clarity , above the shuffle of feet and the soft roaring of cars , the cr ##oa ##k and ca ##w of rook ##s and their ta ##ttered sc ##uf ##fl ##ing overhead .

reference_raw: He could hear, with terrible clarity, the shuffling of feet and the soft roaring of the cars, the creaking and the howling of the rooks and their ragged scuffling above his head.

reference_spacy_tokens: He could hear , with terrible clarity , the shuffling of feet and the soft roaring of the cars , the creaking and the howling of the rooks and their ragged scuffling above his head .


fn_spacy_tokens_for_baseline: I made a free house call for you doctor .

source_bert_toks: i made a free house call for you doctor .

reference_raw: I phoned your doctor for the free house.

reference_spacy_tokens: I phoned your doctor for the free house .


fn_spacy_tokens_for_baseline: A haven for persecuted Japanese Christians in the 17th century , Portugal 's neutrality during World War II assured the territory a flood of refugees .

source_bert_toks: a haven for persecuted japanese christians in the 17th century , portugal ' s neutrality during world war ii assured the territory a flood of refugees .

reference_raw: In the seventeenth century, Portugal's neutrality during World War II provided the territory with a flood of refugees.

reference_spacy_tokens: In the seventeenth century , Portugal 's neutrality during World War II provided the territory with a flood of refugees .


fn_spacy_tokens_for_baseline: She should have left Rome as she 'd planned , she should never have looked into her heart and discovered a truth that could destroy her .

source_bert_toks: she should have left rome as she ' d planned , she should never have looked into her heart and discovered a truth that could destroy her .

reference_raw: She should have left Rome the way she had planned, never to look into her heart and discover the truth that would ruin her.

reference_spacy_tokens: She should have left Rome the way she had planned , never to look into her heart and discover the truth that would ruin her .


fn_spacy_tokens_for_baseline: For a short time , at least 100 hikers were trapped in the mountains and a boy scout camp was also threatened by the blaze .

source_bert_toks: for a short time , at least 100 hike ##rs were trapped in the mountains and a boy scout camp was also threatened by the blaze .

reference_raw: At least a hundred tourists had been trapped in the mountains for a short time, and the boy scout camp was also in danger of the fire.

reference_spacy_tokens: At least a hundred tourists had been trapped in the mountains for a short time , and the boy scout camp was also in danger of the fire .


fn_spacy_tokens_for_baseline: He and his master dragged me to my room and held judgment upon me as a convicted traitress .

source_bert_toks: he and his master dragged me to my room and held judgment upon me as a convicted trait ##ress .

reference_raw: He and his master dragged me into my room, judging me like a convicted traitor.

reference_spacy_tokens: He and his master dragged me into my room , judging me like a convicted traitor .


fn_spacy_tokens_for_baseline: That made Jay nervous again but Peter assured him they would manage , it was dead easy , a breeze .

source_bert_toks: that made jay nervous again but peter assured him they would manage , it was dead easy , a breeze .

reference_raw: Jay was nervous again, but Peter assured him that they could handle it, that it was dead easily, like the wind.

reference_spacy_tokens: Jay was nervous again , but Peter assured him that they could handle it , that it was dead easily , like the wind .


fn_spacy_tokens_for_baseline: It is clear that the APU agonised greatly on just what to assess under the umbrella word ' science ' - and how to assess it .

source_bert_toks: it is clear that the ap ##u ago ##nis ##ed greatly on just what to assess under the umbrella word ' science ' - and how to assess it .

reference_raw: Clearly, the APU was very concerned about what to judge under the umbrella word "science" and how to evaluate it.

reference_spacy_tokens: Clearly , the APU was very concerned about what to judge under the umbrella word " science " and how to evaluate it .


fn_spacy_tokens_for_baseline: Conversely , there are the majority of unsuccessful schools , and we know which efforts at educational reform are doomed beforehand .

source_bert_toks: conversely , there are the majority of unsuccessful schools , and we know which efforts at educational reform are doomed beforehand .

reference_raw: On the other hand, most failed schools exist, and we know which attempts to reform education are lost in advance.

reference_spacy_tokens: On the other hand , most failed schools exist , and we know which attempts to reform education are lost in advance .


fn_spacy_tokens_for_baseline: We created an attractive and useful patio area paved with wooden decking and surrounded by planting towards the lower end of the garden .

source_bert_toks: we created an attractive and useful patio area paved with wooden deck ##ing and surrounded by planting towards the lower end of the garden .

reference_raw: We created an attractive and useful patio area covered with wooden floors and surrounded by planting at the bottom of the garden.

reference_spacy_tokens: We created an attractive and useful patio area covered with wooden floors and surrounded by planting at the bottom of the garden .


fn_spacy_tokens_for_baseline: This is an ominous development since there is little doubt that Iran perceives the ballistic missile to be the delivery system of choice for nuclear weapons .

source_bert_toks: this is an ominous development since there is little doubt that iran perceive ##s the ballistic missile to be the delivery system of choice for nuclear weapons .

reference_raw: This is a sinister development, because there is no doubt that Iran sees a ballistic missile as a delivery system for nuclear weapons.

reference_spacy_tokens: This is a sinister development , because there is no doubt that Iran sees a ballistic missile as a delivery system for nuclear weapons .


fn_spacy_tokens_for_baseline: It has been suggested that he has claimed to have absorbed the banned substance through eating meat but one observer claimed cryptically yesterday : ' He would have to eat three cows a day for that to be the case . "

source_bert_toks: it has been suggested that he has claimed to have absorbed the banned substance through eating meat but one observer claimed cryptic ##ally yesterday : ' he would have to eat three cows a day for that to be the case . "

reference_raw: It was suggested that he had consumed the forbidden substance by eating meat, but one observer said mysteriously yesterday: "To do so, he would have to eat three cows a day."

reference_spacy_tokens: It was suggested that he had consumed the forbidden substance by eating meat , but one observer said mysteriously yesterday : " To do so , he would have to eat three cows a day . "


fn_spacy_tokens_for_baseline: And in this case , the exercise is illuminating .

source_bert_toks: and in this case , the exercise is illuminating .

reference_raw: And in this case, the drill is enlightening.

reference_spacy_tokens: And in this case , the drill is enlightening .


fn_spacy_tokens_for_baseline: The response to Wilson 's arguments was intense and varied .

source_bert_toks: the response to wilson ' s arguments was intense and varied .

reference_raw: The response to Wilson's arguments was strong and varied.

reference_spacy_tokens: The response to Wilson 's arguments was strong and varied .


fn_spacy_tokens_for_baseline: My poor husband , who wanted only to help , ended up as their victim .

source_bert_toks: my poor husband , who wanted only to help , ended up as their victim .

reference_raw: My poor husband, who was just trying to help, turned out to be their victim.

reference_spacy_tokens: My poor husband , who was just trying to help , turned out to be their victim .


fn_spacy_tokens_for_baseline: Rourke 's voice sounded low and even across the silence of the room , and Lissa 's heart began to thump wildly against her ribcage .

source_bert_toks: rourke ' s voice sounded low and even across the silence of the room , and lissa ' s heart began to thump wildly against her rib ##ca ##ge .

reference_raw: Rourke's voice was low, even in the stillness of the room, and Lissa's heart was pounding wildly on her rib cage.

reference_spacy_tokens: Rourke 's voice was low , even in the stillness of the room , and Lissa 's heart was pounding wildly on her rib cage .


fn_spacy_tokens_for_baseline: The decision , which takes the form of adding the bird to Schedule 9 of the Wildlife and Countryside Act , follows growing evidence that captive - bred barn owls are prone to dying of starvation after release .

source_bert_toks: the decision , which takes the form of adding the bird to schedule 9 of the wildlife and countryside act , follows growing evidence that captive - bred barn owls are prone to dying of starvation after release .

reference_raw: The decision, which takes the form of adding a bird to Schedule 9 of the Wildlife and Country Law, is based on growing evidence that captive barn owls tend to starve after release.

reference_spacy_tokens: The decision , which takes the form of adding a bird to Schedule 9 of the Wildlife and Country Law , is based on growing evidence that captive barn owls tend to starve after release .


fn_spacy_tokens_for_baseline: The sterile debate about the contemporary Japanese state has , in . my opinion , emerged from the failure to confront the deeper arguments of both perspectives .

source_bert_toks: the sterile debate about the contemporary japanese state has , in . my opinion , emerged from the failure to confront the deeper arguments of both perspectives .

reference_raw: In my opinion, a sterile discussion of the current Japanese state has emerged from the failure to face deeper arguments from both perspectives.

reference_spacy_tokens: In my opinion , a sterile discussion of the current Japanese state has emerged from the failure to face deeper arguments from both perspectives .


fn_spacy_tokens_for_baseline: The acquisition and creation of these various weapon systems can also be seen as a response to Iran 's own experience as a victim of chemical and missile attacks during the Iran - Iraq War .

source_bert_toks: the acquisition and creation of these various weapon systems can also be seen as a response to iran ' s own experience as a victim of chemical and missile attacks during the iran - iraq war .

reference_raw: The acquisition and creation of these different weapons systems can also be seen as a response to Iran's own experience in the course of the Iran-Iraq War as a result of chemical and missile attacks.

reference_spacy_tokens: The acquisition and creation of these different weapons systems can also be seen as a response to Iran 's own experience in the course of the Iran - Iraq War as a result of chemical and missile attacks .


fn_spacy_tokens_for_baseline: Sweep was found dead 20 ft down the hole and Red was lying hungry and weak tethered to a tree .

source_bert_toks: sweep was found dead 20 ##ft down the hole and red was lying hungry and weak te ##ther ##ed to a tree .

reference_raw: Sweep was found dead twenty feet down the hole, and Red lay starved and weakly tied to a tree.

reference_spacy_tokens: Sweep was found dead twenty feet down the hole , and Red lay starved and weakly tied to a tree .


fn_spacy_tokens_for_baseline: When other sunsigner 's get up and go has got up and gone you 're still going strong , so take pity on a pooped pal or po - fagged partner and ease up a little Tuesday .

source_bert_toks: when other suns ##ign ##er ' s get up and go has got up and gone you ' re still going strong , so take pity on a po ##oped pal or po - fa ##gged partner and ease up a little tuesday .

reference_raw: When the other sunsigners get up and go, they get up and go, you're still strong, so feel sorry for your poor friend or po-fag partner and relax for a little Tuesday.

reference_spacy_tokens: When the other sunsigners get up and go , they get up and go , you 're still strong , so feel sorry for your poor friend or po - fag partner and relax for a little Tuesday .


fn_spacy_tokens_for_baseline: As a young teenager he enrolled in drama school , his passion for acting excited by watching a performance of the musical Hair in the mid - Seventies .

source_bert_toks: as a young teenager he enrolled in drama school , his passion for acting excited by watching a performance of the musical hair in the mid - seventies .

reference_raw: When he was a young teenager, he applied to drama school, and his passion for acting enthusiastic was to watch a musical Hair show in the middle of the seventies.

reference_spacy_tokens: When he was a young teenager , he applied to drama school , and his passion for acting enthusiastic was to watch a musical Hair show in the middle of the seventies .


fn_spacy_tokens_for_baseline: Winter sweet , viburnum , and witch hazel were all in flower ; the air was so still that they could hear the distant gurgle of the river from down in the valley .

source_bert_toks: winter sweet , vi ##burn ##um , and witch hazel were all in flower ; the air was so still that they could hear the distant gu ##rg ##le of the river from down in the valley .

reference_raw: The winter's sweet, viburnum, and the witch's hazel were all in bloom; the air was so calm that they could hear the distant roar of the river from the valley below.

reference_spacy_tokens: The winter 's sweet , viburnum , and the witch 's hazel were all in bloom ; the air was so calm that they could hear the distant roar of the river from the valley below .


fn_spacy_tokens_for_baseline: He tugged off the leather breastplate , then the tunic , and brushed at the blood .

source_bert_toks: he tugged off the leather breast ##plate , then the tunic , and brushed at the blood .

reference_raw: He pulled off his leather chest, then his tunic, and rubbed his blood.

reference_spacy_tokens: He pulled off his leather chest , then his tunic , and rubbed his blood .


fn_spacy_tokens_for_baseline: If the model is set up correctly , it should make a steep descent under full control .

source_bert_toks: if the model is set up correctly , it should make a steep descent under full control .

reference_raw: If the model is configured correctly, it should go down steeply under full control.

reference_spacy_tokens: If the model is configured correctly , it should go down steeply under full control .


fn_spacy_tokens_for_baseline: Please print it on a thin paper ; may God reward you .

source_bert_toks: please print it on a thin paper ; may god reward you .

reference_raw: Put it on a thin paper, please, God bless you.

reference_spacy_tokens: Put it on a thin paper , please , God bless you .


fn_spacy_tokens_for_baseline: Roy 's partner for the feat , Judy Perry , who runs her own acupunture therapy centre .

source_bert_toks: roy ' s partner for the feat , judy perry , who runs her own ac ##up ##unt ##ure therapy centre .

reference_raw: Roy's playmate, Judy Perry, who runs her own acupunt therapy center.

reference_spacy_tokens: Roy 's playmate , Judy Perry , who runs her own acupunt therapy center .


fn_spacy_tokens_for_baseline: A BRITON sentenced by a Saudi court to a flogging for allegedly swearing at his staff may have the sentence doubled for appealing .

source_bert_toks: a brit ##on sentenced by a saudi court to a fl ##og ##ging for allegedly swearing at his staff may have the sentence doubled for appealing .

reference_raw: A BRITON sentenced by a Saudi court to be whipped for allegedly cursing his staff may be doubled for appeal.

reference_spacy_tokens: A BRITON sentenced by a Saudi court to be whipped for allegedly cursing his staff may be doubled for appeal .


fn_spacy_tokens_for_baseline: It is essential in these cases to toot before overtaking .

source_bert_toks: it is essential in these cases to too ##t before over ##taking .

reference_raw: In such cases, it is necessary to take a tooth before it can be overtaken.

reference_spacy_tokens: In such cases , it is necessary to take a tooth before it can be overtaken .


fn_spacy_tokens_for_baseline: By extracting the oil too quickly , the engineer risks losing touch with the larger deposit and having to drill again .

source_bert_toks: by extract ##ing the oil too quickly , the engineer risks losing touch with the larger deposit and having to drill again .

reference_raw: If the oil is removed too quickly, the engineer risks losing contact with the larger deposit and having to drill again.

reference_spacy_tokens: If the oil is removed too quickly , the engineer risks losing contact with the larger deposit and having to drill again .


fn_spacy_tokens_for_baseline: Dr _ Gupto : The other thing Paula really important is that they talk a lot about the fact that our- we 're a lot better at taking care of patients now than we were in nineteen eighteen , we have a lot of ICUs a lot of ICUs in the hospital behind me that can take care of critically ill patients .

source_bert_toks: dr _ gu ##pt ##o : the other thing paula really important is that they talk a lot about the fact that our - we ' re a lot better at taking care of patients now than we were in nineteen eighteen , we have a lot of ic ##us a lot of ic ##us in the hospital behind me that can take care of critically ill patients .

reference_raw: Dr. Gupto: The other thing Paula's really important is that he talks a lot about the fact that our-- we're a lot better at treating patients than we were in 1918, and there's a lot of ICUs in the hospital behind me who can take care of critically sick patients.

reference_spacy_tokens: Dr. Gupto : The other thing Paula 's really important is that he talks a lot about the fact that our-- we 're a lot better at treating patients than we were in 1918 , and there 's a lot of ICUs in the hospital behind me who can take care of critically sick patients .


fn_spacy_tokens_for_baseline: One after the other , the bubbles plop and the rough edges sizzle back just like they 're being eaten away by invisible acid .

source_bert_toks: one after the other , the bubbles pl ##op and the rough edges si ##zzle back just like they ' re being eaten away by invisible acid .

reference_raw: One by one, the bubbles pulsing and the rough edges hissing back as if they were being eaten away by invisible acids.

reference_spacy_tokens: One by one , the bubbles pulsing and the rough edges hissing back as if they were being eaten away by invisible acids .


fn_spacy_tokens_for_baseline: " Those arrested are people who knew exactly what they were doing , knew they were committing crimes and went up into the hills to start fires , sometimes more than one , " said the president of Galicia 's regional government , Emilio Perez Tourino .

source_bert_toks: " those arrested are people who knew exactly what they were doing , knew they were committing crimes and went up into the hills to start fires , sometimes more than one , " said the president of galicia ' s regional government , emilio perez tour ##ino .

reference_raw: "The ones arrested are people who knew exactly what they were up to, knew they were committing crimes, and went up into the hills to start fires, sometimes more than one," said the president of Galicia's regional government, Emilio Perez Tourino.

reference_spacy_tokens: " The ones arrested are people who knew exactly what they were up to , knew they were committing crimes , and went up into the hills to start fires , sometimes more than one , " said the president of Galicia 's regional government , Emilio Perez Tourino .


fn_spacy_tokens_for_baseline: Key data sources for DPRK include defector testimony , which may be unreliable given possibility of deliberate disinformation by double agents and defectors exaggerating what they know , and unclassified estimates by US intelligence agencies , which may have certain biases based on national interest , worst - case expectations , domestic politics , etc . Also , most estimates do not rely on original texts in Korean , which may introduce some errors due to translation issues .

source_bert_toks: key data sources for d ##pr ##k include defect ##or testimony , which may be unreliable given possibility of deliberate di ##sin ##form ##ation by double agents and defect ##ors ex ##agger ##ating what they know , and un ##class ##ified estimates by us intelligence agencies , which may have certain bias ##es based on national interest , worst - case expectations , domestic politics , etc . also , most estimates do not rely on original texts in korean , which may introduce some errors due to translation issues .

reference_raw: The main data sources for the DPRK include defector testimony, which may be unreliable due to the possibility of intentional disinformation by doubles and defectors exaggerating what they know, and unclassified estimates by U.S. intelligence agencies, which may have some prejudices based on national interest, worst case expectations, domestic policy, etc.

reference_spacy_tokens: The main data sources for the DPRK include defector testimony , which may be unreliable due to the possibility of intentional disinformation by doubles and defectors exaggerating what they know , and unclassified estimates by U.S. intelligence agencies , which may have some prejudices based on national interest , worst case expectations , domestic policy , etc .


fn_spacy_tokens_for_baseline: Fire crews had been attempting to contain the fire before the onset of difficult conditions today .

source_bert_toks: fire crews had been attempting to contain the fire before the onset of difficult conditions today .

reference_raw: The fire crews were trying to contain the fire before the onslaught of difficult conditions today.

reference_spacy_tokens: The fire crews were trying to contain the fire before the onslaught of difficult conditions today .


fn_spacy_tokens_for_baseline: Everyone benefits from the work we do together .

source_bert_toks: everyone benefits from the work we do together .

reference_raw: Everyone's benefiting from the work we're doing.

reference_spacy_tokens: Everyone 's benefiting from the work we 're doing .


fn_spacy_tokens_for_baseline: He was friendly to everyone .

source_bert_toks: he was friendly to everyone .

reference_raw: He's been good to everybody.

reference_spacy_tokens: He 's been good to everybody .


fn_spacy_tokens_for_baseline: ' This greater broad backed bookworm must be found before he encourages other animals to read those books he seems to devouring just now , ' said laid back Rabbit .

source_bert_toks: ' this greater broad backed book ##worm must be found before he encourages other animals to read those books he seems to dev ##ouring just now , ' said laid back rabbit .

reference_raw: 'We have to find this larger, wide-backed bookworm before he encourages other animals to read the books he seems to be eating right now,' said Rabbit.

reference_spacy_tokens: ' We have to find this larger , wide - backed bookworm before he encourages other animals to read the books he seems to be eating right now , ' said Rabbit .


fn_spacy_tokens_for_baseline: did you have uh very warm sleeping bag or

reference_raw: you had a very hot sleeping bag or

reference_spacy_tokens: you had a very hot sleeping bag or


fn_spacy_tokens_for_baseline: It is remarkable only for the fact that amid a perfect jungle of possibilities we , with our worthy collaborator , the inspector , have kept our close hold on the essentials and so been guided along the crooked and winding path .

source_bert_toks: it is remarkable only for the fact that amid a perfect jungle of possibilities we , with our worthy collaborator , the inspector , have kept our close hold on the essential ##s and so been guided along the crooked and winding path .

reference_raw: The only remarkable thing is that, in the midst of a perfect jungle of opportunities, we and our worthy co-worker, the inspector, kept a close grip on the essentials, and thus led the way down a curved and twisting path.

reference_spacy_tokens: The only remarkable thing is that , in the midst of a perfect jungle of opportunities , we and our worthy co - worker , the inspector , kept a close grip on the essentials , and thus led the way down a curved and twisting path .


fn_spacy_tokens_for_baseline: I hope the others have been copped by the attendants .

source_bert_toks: i hope the others have been cop ##ped by the attendants .

reference_raw: I hope the others were covered by the servants.

reference_spacy_tokens: I hope the others were covered by the servants .