fn_spacy_tokens_for_baseline: If you snack between meals ( and most people do ! ) try to limit this to one or two snacks a day if you are trying to lose weight .

source_bert_toks: if you snack between meals ( and most people do ! ) try to limit this to one or two snacks a day if you are trying to lose weight .

reference_raw: If you eat between meals (and most people do!) try to limit it to one or two refreshments a day if you want to lose weight.

reference_spacy_tokens: If you eat between meals ( and most people do ! ) try to limit it to one or two refreshments a day if you want to lose weight .


fn_spacy_tokens_for_baseline: Carrying out Jihad is the main reason the members of AL - QAEDA have gathered , together with performing the different duties of Islam as much as possible , shouldering together the duty of Jihad and preparing the efficient duties during conflicts .

source_bert_toks: carrying out jihad is the main reason the members of al - qaeda have gathered , together with performing the different duties of islam as much as possible , shoulder ##ing together the duty of jihad and preparing the efficient duties during conflicts .

reference_raw: The deployment of the Jihad is the main reason why the AL-QAEDA members have gathered together, as far as possible, to carry out the various responsibilities of Islam, to shoulder the responsibilities of the Jihad and to prepare for effective responsibilities in the event of confrontation.

reference_spacy_tokens: The deployment of the Jihad is the main reason why the AL - QAEDA members have gathered together , as far as possible , to carry out the various responsibilities of Islam , to shoulder the responsibilities of the Jihad and to prepare for effective responsibilities in the event of confrontation .


fn_spacy_tokens_for_baseline: Much of the land is extremely fertile and produces a range of tropical fruit and vegetable crops , providing ample food for the people and such lucrative cash crops as sugar and coffee .

source_bert_toks: much of the land is extremely fertile and produces a range of tropical fruit and vegetable crops , providing ample food for the people and such lucrative cash crops as sugar and coffee .

reference_raw: A large part of the land is extremely fertile and produces a variety of tropical fruit and vegetable crops, which provide people with plenty of food and cash crops such as sugar and coffee.

reference_spacy_tokens: A large part of the land is extremely fertile and produces a variety of tropical fruit and vegetable crops , which provide people with plenty of food and cash crops such as sugar and coffee .


fn_spacy_tokens_for_baseline: The Cantonese love to eat and have the reputation of eating almost anything that walks on four legs .

source_bert_toks: the cantonese love to eat and have the reputation of eating almost anything that walks on four legs .

reference_raw: Cantonese like to eat and have a reputation for eating almost anything that walks on four feet.

reference_spacy_tokens: Cantonese like to eat and have a reputation for eating almost anything that walks on four feet .


fn_spacy_tokens_for_baseline: " So crunch , crunch , crunch , bang , bang , bang -- here come the ringers from above , making a very obvious exit while the congregation is at prayer , " he says .

source_bert_toks: " so crunch , crunch , crunch , bang , bang , bang - - here come the ring ##ers from above , making a very obvious exit while the congregation is at prayer , " he says .

reference_raw: "That's crunching, crunching, crunching, banging, banging -- here comes the ringers from above, making a very clear way out while the congregation is in prayer," he says.

reference_spacy_tokens: " That 's crunching , crunching , crunching , banging , banging -- here comes the ringers from above , making a very clear way out while the congregation is in prayer , " he says .


fn_spacy_tokens_for_baseline: And the look of it - the great staring goggle eyes , and the line of white teeth like a hungry beast .

source_bert_toks: and the look of it - the great staring go ##ggle eyes , and the line of white teeth like a hungry beast .

reference_raw: And what it looked like - those big, staring glasses, and those white-toothed rows like a hungry animal.

reference_spacy_tokens: And what it looked like - those big , staring glasses , and those white - toothed rows like a hungry animal .


fn_spacy_tokens_for_baseline: Inspector Baynes , who , with his usual astuteness , had minimized the incident before me , had really recognized its importance and had left a trap into which the creature walked .

source_bert_toks: inspector bay ##nes , who , with his usual as ##tute ##ness , had minimize ##d the incident before me , had really recognized its importance and had left a trap into which the creature walked .

reference_raw: Inspector Baynes, who, with his usual astuteness, had minimized the event before me, had in fact recognized its importance and had left the trap into which the creature was walking.

reference_spacy_tokens: Inspector Baynes , who , with his usual astuteness , had minimized the event before me , had in fact recognized its importance and had left the trap into which the creature was walking .


fn_spacy_tokens_for_baseline: Some of the most common agents that are associated with the Iranian BW program in the open literature are B. anthracis , botulinum toxin , ricin , T-2 mycotoxin , and Variola virus , the causative agent of smallpox .

source_bert_toks: some of the most common agents that are associated with the iranian b ##w program in the open literature are b . ant ##hra ##cis , bot ##ulin ##um toxin , ric ##in , t - 2 my ##cot ##ox ##in , and var ##iol ##a virus , the ca ##usa ##tive agent of smallpox .

reference_raw: B. anthracis, botulinum toxin, ricin, T-2 mycotoxin and Variola virus, the cause of smallpox, are among the most common agents associated with the Iranian BW programme in open literature.

reference_spacy_tokens: B. anthracis , botulinum toxin , ricin , T-2 mycotoxin and Variola virus , the cause of smallpox , are among the most common agents associated with the Iranian BW programme in open literature .


fn_spacy_tokens_for_baseline: At the end , assisted by the two younger priests , he came through the altar rails and sprinkled the coffin with Holy Water .

source_bert_toks: at the end , assisted by the two younger priests , he came through the altar rails and sp ##rin ##kled the coffin with holy water .

reference_raw: At last, with the help of two younger priests, he passed through the altar railings and sprayed the coffin with holy water.

reference_spacy_tokens: At last , with the help of two younger priests , he passed through the altar railings and sprayed the coffin with holy water .


fn_spacy_tokens_for_baseline: With a sob she tore her mouth from his .

source_bert_toks: with a sob she tore her mouth from his .

reference_raw: She ripped her mouth out of his with a sob.

reference_spacy_tokens: She ripped her mouth out of his with a sob .


fn_spacy_tokens_for_baseline: I took a swig of wine and collapsed on to the bed fully dressed .

source_bert_toks: i took a sw ##ig of wine and collapsed on to the bed fully dressed .

reference_raw: I drank a sip of wine and collapsed on the bed, fully clothed.

reference_spacy_tokens: I drank a sip of wine and collapsed on the bed , fully clothed .


fn_spacy_tokens_for_baseline: ' Good morning ! ' he chirruped .

source_bert_toks: ' good morning ! ' he chi ##rr ##up ##ed .

reference_raw: 'Good morning!' he chirped.

reference_spacy_tokens: ' Good morning ! ' he chirped .


fn_spacy_tokens_for_baseline: Far from ' solving ' her problems in this way , Britain merely aggravated them .

source_bert_toks: far from ' solving ' her problems in this way , britain merely aggravated them .

reference_raw: Far from "solving" her problems in this way, Britain only made them worse.

reference_spacy_tokens: Far from " solving " her problems in this way , Britain only made them worse .


fn_spacy_tokens_for_baseline: Behind him , pathetically , Tibbles mewed in the hall .

source_bert_toks: behind him , pathetic ##ally , ti ##bble ##s me ##wed in the hall .

reference_raw: Behind him, pathetically, Tibbles mowed in the corridor.

reference_spacy_tokens: Behind him , pathetically , Tibbles mowed in the corridor .


fn_spacy_tokens_for_baseline: Autumn calving presumes mating in early to mid Winter , the worst possible period for this exercise .

source_bert_toks: autumn calvin ##g pre ##sume ##s mating in early to mid winter , the worst possible period for this exercise .

reference_raw: The autumn calf presupposes mating in the early to mid-Winter, which is the worst possible time for this exercise.

reference_spacy_tokens: The autumn calf presupposes mating in the early to mid - Winter , which is the worst possible time for this exercise .


fn_spacy_tokens_for_baseline: 6:50 a.m. CAROLG : I was just sitting down to meet with some new therapy clients , a couple , and the building started shaking like crazy .

source_bert_toks: 6 : 50 a . m . carol ##g : i was just sitting down to meet with some new therapy clients , a couple , and the building started shaking like crazy .

reference_raw: 6:50 in the morning, I was sitting down to meet some new therapists, a couple, and the building started to shake like a madman.

reference_spacy_tokens: 6:50 in the morning , I was sitting down to meet some new therapists , a couple , and the building started to shake like a madman .


fn_spacy_tokens_for_baseline: I tell you , sir , I could n't move a finger , nor get my breath , till it whisked away and was gone .

source_bert_toks: i tell you , sir , i couldn ' t move a finger , nor get my breath , till it w ##his ##ked away and was gone .

reference_raw: I'm telling you, sir, I couldn't move a finger or breathe until it blew away and was gone.

reference_spacy_tokens: I 'm telling you , sir , I could n't move a finger or breathe until it blew away and was gone .


fn_spacy_tokens_for_baseline: The old laboratory is still intact , and there are exhibits on Chinese pharmacology and the history of medicine in Hong Kong .

source_bert_toks: the old laboratory is still intact , and there are exhibits on chinese ph ##arm ##aco ##logy and the history of medicine in hong kong .

reference_raw: The old lab is still intact, and there are exhibits of Chinese pharmacology and medical history in Hong Kong.

reference_spacy_tokens: The old lab is still intact , and there are exhibits of Chinese pharmacology and medical history in Hong Kong .


fn_spacy_tokens_for_baseline: Typically , a gardener sent surplus dates to the cities , or trucked onions from Tazarbu to Ajdabiya .

source_bert_toks: typically , a gardener sent surplus dates to the cities , or truck ##ed onions from ta ##zar ##bu to aj ##da ##bi ##ya .

reference_raw: A gardener usually sends out surplus data to towns, or delivers onions from Tazarbu to Ajdabiya.

reference_spacy_tokens: A gardener usually sends out surplus data to towns , or delivers onions from Tazarbu to Ajdabiya .


fn_spacy_tokens_for_baseline: While the proliferation legacies of South Africa 's nuclear and missile programs were effectively resolved through verified disarmament measures that won international acclaim , dismantlement of the country 's CBW capabilities was not verified to a comparable degree of certainty .

source_bert_toks: while the proliferation leg ##acies of south africa ' s nuclear and missile programs were effectively resolved through verified di ##sar ##mament measures that won international acclaim , di ##sman ##tlement of the country ' s cb ##w capabilities was not verified to a comparable degree of certainty .

reference_raw: While the proliferation legacies of South Africa's nuclear and missile programmes have been effectively addressed through verified disarmament actions that have won international recognition, the dismantling of the country's CBW capabilities has not been verified to a comparable degree of certainty.

reference_spacy_tokens: While the proliferation legacies of South Africa 's nuclear and missile programmes have been effectively addressed through verified disarmament actions that have won international recognition , the dismantling of the country 's CBW capabilities has not been verified to a comparable degree of certainty .


fn_spacy_tokens_for_baseline: ' Yes , ' he reported , after a short examination of the grass bed , ' a number twelve shoe , I should say .

source_bert_toks: ' yes , ' he reported , after a short examination of the grass bed , ' a number twelve shoe , i should say .

reference_raw: 'Yes,' he said, after a brief look at the grass bed,' the number twelve boot, I should say.

reference_spacy_tokens: ' Yes , ' he said , after a brief look at the grass bed , ' the number twelve boot , I should say .


fn_spacy_tokens_for_baseline: Under Biset 's orders they were to search for the evildoers and those who harboured them , and do whatever was necessary to maintain the king 's peace in those parts .

source_bert_toks: under bis ##et ' s orders they were to search for the evil ##do ##ers and those who harbour ##ed them , and do whatever was necessary to maintain the king ' s peace in those parts .

reference_raw: Under Biset's orders, they were to seek out the evils and those who harbored them, and to do whatever was necessary to keep the King's peace in these parts.

reference_spacy_tokens: Under Biset 's orders , they were to seek out the evils and those who harbored them , and to do whatever was necessary to keep the King 's peace in these parts .


fn_spacy_tokens_for_baseline: This is not talk for a police - constable . '

source_bert_toks: this is not talk for a police - constable . '

reference_raw: That's not a word for a cop.'

reference_spacy_tokens: That 's not a word for a cop . '


fn_spacy_tokens_for_baseline: It remained stuck fast and it screeched again , waving shredded arms as Duvall slammed the door shut and blocked out the hideous spectacle .

source_bert_toks: it remained stuck fast and it sc ##ree ##ched again , waving shredded arms as duval ##l slammed the door shut and blocked out the hideous spectacle .

reference_raw: It stayed fast and screamed again, waving shredded arms as Duvall slammed the door shut and blocked the hideous spectacle.

reference_spacy_tokens: It stayed fast and screamed again , waving shredded arms as Duvall slammed the door shut and blocked the hideous spectacle .


fn_spacy_tokens_for_baseline: The prospect of Britain becoming irretrievably stuck in a slough without forward movement is not attractive , for us now or as trustees for our children and successors .

source_bert_toks: the prospect of britain becoming ir ##ret ##rie ##va ##bly stuck in a sl ##ough without forward movement is not attractive , for us now or as trustees for our children and successors .

reference_raw: The prospect that Britain will become irretrievably trapped in the slow without a forward movement is not attractive to us now or as trustees of our children and successors.

reference_spacy_tokens: The prospect that Britain will become irretrievably trapped in the slow without a forward movement is not attractive to us now or as trustees of our children and successors .


fn_spacy_tokens_for_baseline: What was more painful were Kate 's fists smacking into his stomach , blow after blow .

source_bert_toks: what was more painful were kate ' s fists smack ##ing into his stomach , blow after blow .

reference_raw: What hurt more was Kate's fists slapping him in the stomach, blow by blow.

reference_spacy_tokens: What hurt more was Kate 's fists slapping him in the stomach , blow by blow .


fn_spacy_tokens_for_baseline: However , sometimes it seems that the city produced artists of this stature by accident , even against its will .

source_bert_toks: however , sometimes it seems that the city produced artists of this stature by accident , even against its will .

reference_raw: Sometimes, however, the city seems to have created artists of that status by accident, even against its will.

reference_spacy_tokens: Sometimes , however , the city seems to have created artists of that status by accident , even against its will .


fn_spacy_tokens_for_baseline: The village was too peopled by women , fit only for the baking of cakes and arranging tombola stalls .

source_bert_toks: the village was too people ##d by women , fit only for the baking of cakes and arranging tomb ##ola stalls .

reference_raw: The village was too crowded with women, fit only to cook cakes and arrange tombola stalls.

reference_spacy_tokens: The village was too crowded with women , fit only to cook cakes and arrange tombola stalls .


fn_spacy_tokens_for_baseline: The Grand Canal was wider than she 'd anticipated , teeming with water - buses and motorboats , barges and gondolas .

source_bert_toks: the grand canal was wider than she ' d anticipated , tee ##ming with water - buses and motor ##boats , barges and go ##ndo ##las .

reference_raw: The Grand Canal was wider than she had expected, full of water buses and motorboats, barges and gondolas.

reference_spacy_tokens: The Grand Canal was wider than she had expected , full of water buses and motorboats , barges and gondolas .


fn_spacy_tokens_for_baseline: As impassive as ever to the casual observer , there were none the less a subdued eagerness and suggestion of tension in his brightened eyes and brisker manner which assured me that the game was afoot .

source_bert_toks: as imp ##ass ##ive as ever to the casual observer , there were none the less a subdued eager ##ness and suggestion of tension in his brightened eyes and brisk ##er manner which assured me that the game was af ##oot .

reference_raw: Impassive as ever to the casual observer, however, there was a faint eagerness and a hint of tension in his bright eyes and brightness that reassured me that the game was on its way.

reference_spacy_tokens: Impassive as ever to the casual observer , however , there was a faint eagerness and a hint of tension in his bright eyes and brightness that reassured me that the game was on its way .


fn_spacy_tokens_for_baseline: Shops in Central are an exception ; they generally close at 6 pm and are not open on Sunday .

source_bert_toks: shops in central are an exception ; they generally close at 6 pm and are not open on sunday .

reference_raw: The shops in Central are exceptional; they usually close at 6 p.m. and are not open on Sundays.

reference_spacy_tokens: The shops in Central are exceptional ; they usually close at 6 p.m. and are not open on Sundays .


fn_spacy_tokens_for_baseline: And young graduates are not leaving now -- multinational corporations and European Union investment mean there are plenty of opportunities for them at home .

source_bert_toks: and young graduates are not leaving now - - multinational corporations and european union investment mean there are plenty of opportunities for them at home .

reference_raw: And young graduates don't leave now - multinational corporations and EU investment mean that they have a lot of opportunities at home.

reference_spacy_tokens: And young graduates do n't leave now - multinational corporations and EU investment mean that they have a lot of opportunities at home .


fn_spacy_tokens_for_baseline: Chechen President Ramzan Kadyrov , a onetime rebel fighter who is backed by the Kremlin , mocked Yevkurov 's killers .

source_bert_toks: che ##chen president ram ##zan ka ##dy ##rov , a one ##time rebel fighter who is backed by the k ##rem ##lin , mocked ye ##v ##kur ##ov ' s killers .

reference_raw: Chechen President Ramzan Kadyrov, a former rebel warrior backed by the Kremlin, laughed at the assassins of Yevkurov.

reference_spacy_tokens: Chechen President Ramzan Kadyrov , a former rebel warrior backed by the Kremlin , laughed at the assassins of Yevkurov .


fn_spacy_tokens_for_baseline: so you really not making a sizeable profit so it 's not really lucrative to take chances like that you know even though it it does exist

source_bert_toks: so you really not making a size ##able profit so it ' s not really lucrative to take chances like that you know even though it it does exist

reference_raw: so you really don't make a big profit, so it's not really lucrative to take a risk like you know, even if it exists.

reference_spacy_tokens: so you really do n't make a big profit , so it 's not really lucrative to take a risk like you know , even if it exists .


fn_spacy_tokens_for_baseline: UI will then release the interface specifications and conformance tests to the industry to encourage development of other compliant implementations .

source_bert_toks: ui will then release the interface specifications and conform ##ance tests to the industry to encourage development of other compliant implementations .

reference_raw: The Union industry will then publish interface specifications and conformity tests to the industry in order to support the development of other compatible implementations.

reference_spacy_tokens: The Union industry will then publish interface specifications and conformity tests to the industry in order to support the development of other compatible implementations .


fn_spacy_tokens_for_baseline: But now , says the paper 's headline , " Long Strike Likely . "

source_bert_toks: but now , says the paper ' s headline , " long strike likely . "

reference_raw: But now it says in the headlines, "Long Hit Possibilities."

reference_spacy_tokens: But now it says in the headlines , " Long Hit Possibilities . "


fn_spacy_tokens_for_baseline: The man holding the crossbow approached ; his voice , muffled by the mask he wore , ordered me to dismount .

source_bert_toks: the man holding the crossbow approached ; his voice , muffled by the mask he wore , ordered me to di ##smo ##unt .

reference_raw: The man holding the bow came to me; his voice, muffled by the mask he wore, commanded me to dismount.

reference_spacy_tokens: The man holding the bow came to me ; his voice , muffled by the mask he wore , commanded me to dismount .


fn_spacy_tokens_for_baseline: Blood dripped into the chalice .

source_bert_toks: blood dripped into the cha ##lice .

reference_raw: Blood trickled into the chalice.

reference_spacy_tokens: Blood trickled into the chalice .


fn_spacy_tokens_for_baseline: The torturers had chained him to a wall , applying searing hot pokers to the softest and most tender parts of his body .

source_bert_toks: the torture ##rs had chained him to a wall , applying searing hot poker ##s to the soft ##est and most tender parts of his body .

reference_raw: The tormentors tied him to the wall and applied hot pokers to the softest, gentlest part of him.

reference_spacy_tokens: The tormentors tied him to the wall and applied hot pokers to the softest , gentlest part of him .


fn_spacy_tokens_for_baseline: During 19 - 21 April 2004 , North Korean National Defense Commission Chairman Kim Jong Il visited China and reportedly told Chinese President Hu Jintao that " the DRPK side will continue to adopt a patient and flexible manner and actively participate in the six - party talks process , and make its own contributions to the progress of the talks . "

source_bert_toks: during 19 - 21 april 2004 , north korean national defense commission chairman kim jong il visited china and reportedly told chinese president hu jin ##tao that " the dr ##p ##k side will continue to adopt a patient and flexible manner and actively participate in the six - party talks process , and make its own contributions to the progress of the talks . "

reference_raw: In the course of 19-21 April 2004, Chairman of the North Korean National Defence Commission Kim Jong II visited China and reportedly informed Chinese President Hu Jintao that "the DRPK Party will continue to take a patient and flexible approach and actively participate in the six-party talks process and contribute to the progress of the negotiations."

reference_spacy_tokens: In the course of 19 - 21 April 2004 , Chairman of the North Korean National Defence Commission Kim Jong II visited China and reportedly informed Chinese President Hu Jintao that " the DRPK Party will continue to take a patient and flexible approach and actively participate in the six - party talks process and contribute to the progress of the negotiations . "


fn_spacy_tokens_for_baseline: Visits may strengthen bonds with a parent who is unlikely to resume care , and then constitute an obstacle to finding an appropriate placement .

source_bert_toks: visits may strengthen bonds with a parent who is unlikely to resume care , and then constitute an obstacle to finding an appropriate placement .

reference_raw: Visits can reinforce bonds with a parent who is unlikely to return to care, and thus constitute an obstacle to finding a suitable placement.

reference_spacy_tokens: Visits can reinforce bonds with a parent who is unlikely to return to care , and thus constitute an obstacle to finding a suitable placement .


fn_spacy_tokens_for_baseline: Most of my friends collapsed thankfully on to their beds , but I slunk down the long flights of stone stairs and took up a position in the foyer where I could watch the front door .

source_bert_toks: most of my friends collapsed thankfully on to their beds , but i sl ##unk down the long flights of stone stairs and took up a position in the foyer where i could watch the front door .

reference_raw: Most of my friends fell gratefully to their beds, but I ducked down the long flight of stone steps and took up my place in the foyer, where I could see the front door.

reference_spacy_tokens: Most of my friends fell gratefully to their beds , but I ducked down the long flight of stone steps and took up my place in the foyer , where I could see the front door .


fn_spacy_tokens_for_baseline: This was The Battle of the Books ( 1704 ) by Jonathan Swift ( 1667 -- 1745 ) , a satire in which the Ancients battle against the Moderns .

source_bert_toks: this was the battle of the books ( 1704 ) by jonathan swift ( 1667 - - 1745 ) , a satire in which the ancient ##s battle against the modern ##s .

reference_raw: This was the fight of books (1704) by Jonathan Swift (1667 - 1745), the satire in which the Ancients fought against the Moderns.

reference_spacy_tokens: This was the fight of books ( 1704 ) by Jonathan Swift ( 1667 - 1745 ) , the satire in which the Ancients fought against the Moderns .


fn_spacy_tokens_for_baseline: Today Hong Kong remains a capitalist enclave with its laws and rights intact , and China has promised that Hong Kong will continue in this fashion for at least 50 years .

source_bert_toks: today hong kong remains a capitalist enclave with its laws and rights intact , and china has promised that hong kong will continue in this fashion for at least 50 years .

reference_raw: Today, Hong Kong remains a capitalist enclave with its laws and rights intact, and China has promised that Hong Kong will continue to do so for a minimum of 50 years.

reference_spacy_tokens: Today , Hong Kong remains a capitalist enclave with its laws and rights intact , and China has promised that Hong Kong will continue to do so for a minimum of 50 years .


fn_spacy_tokens_for_baseline: The railroad was coming , and when it arrived , Las Vegas would never be the same again .

source_bert_toks: the railroad was coming , and when it arrived , las vegas would never be the same again .

reference_raw: The railroad was coming, and by the time it arrived, Las Vegas would not be the same.

reference_spacy_tokens: The railroad was coming , and by the time it arrived , Las Vegas would not be the same .


fn_spacy_tokens_for_baseline: He could do more to cut public subsidies and transfers , thus making funds available for public services starved of money for six years .

source_bert_toks: he could do more to cut public subsidies and transfers , thus making funds available for public services starved of money for six years .

reference_raw: It could do more to reduce public subsidies and transfers, making public service funds hungry for six years.

reference_spacy_tokens: It could do more to reduce public subsidies and transfers , making public service funds hungry for six years .


fn_spacy_tokens_for_baseline: Depressed and bewildered because it had inexplicably impaired his ability to think and concentrate , he soon guessed that his paralysis and clumsiness would make him always dependent on a wheelchair .

source_bert_toks: depressed and bewildered because it had in ##ex ##pl ##ica ##bly impaired his ability to think and concentrate , he soon guessed that his paralysis and cl ##ums ##iness would make him always dependent on a wheelchair .

reference_raw: Depressed and confused by the inexplicable damage to his ability to think and concentrate, he soon realized that his paralysis and awkwardness would always make him dependent on a wheelchair.

reference_spacy_tokens: Depressed and confused by the inexplicable damage to his ability to think and concentrate , he soon realized that his paralysis and awkwardness would always make him dependent on a wheelchair .


fn_spacy_tokens_for_baseline: The trees are anchored by 20 metre polyurethane roots , formed by injecting liquid chemicals down a steel tube .

source_bert_toks: the trees are anchored by 20 metre poly ##ure ##than ##e roots , formed by in ##ject ##ing liquid chemicals down a steel tube .

reference_raw: The trees are moored with 20-meter polyurethane roots, formed by injecting liquid chemicals into a steel tube.

reference_spacy_tokens: The trees are moored with 20-meter polyurethane roots , formed by injecting liquid chemicals into a steel tube .


fn_spacy_tokens_for_baseline: He called to Laura , who was lolling in the kind of leather teddy , which I for one , would dearly like to see in real life .

source_bert_toks: he called to laura , who was lo ##lling in the kind of leather teddy , which i for one , would dear ##ly like to see in real life .

reference_raw: He called to Laura, who was looming in a leather bear that I, for one, would love to see in real life.

reference_spacy_tokens: He called to Laura , who was looming in a leather bear that I , for one , would love to see in real life .


fn_spacy_tokens_for_baseline: I thought that was a very diplomatic way of putting it .

source_bert_toks: i thought that was a very diplomatic way of putting it .

reference_raw: Well, I think that's a very diplomacy way of putting it.

reference_spacy_tokens: Well , I think that 's a very diplomacy way of putting it .


fn_spacy_tokens_for_baseline: ' Buckingham is the protector 's chief confederate ? '

source_bert_toks: ' buckingham is the protector ' s chief confederate ? '

reference_raw: "Buckingham is the head of the Protector's Confederacy?"

reference_spacy_tokens: " Buckingham is the head of the Protector 's Confederacy ? "


fn_spacy_tokens_for_baseline: This proposal was tested in rat experiments by Brunsson , who showed that the fluid secretion evoked by an invasive strain of Salmonella typhimurium ( R5 ) was turned into absorption after giving intravenous hexamethonium or by exposing the intestinal serosa to lidocaine , a local anaesthetic .

source_bert_toks: this proposal was tested in rat experiments by br ##un ##sson , who showed that the fluid secret ##ion ev ##oked by an invasive strain of salmon ##ella ty ##phi ##mur ##ium ( r ##5 ) was turned into absorption after giving intra ##ven ##ous he ##xa ##met ##hon ##ium or by exposing the int ##estinal ser ##osa to lid ##oca ##ine , a local ana ##est ##hetic .

reference_raw: The proposal was examined in rat experiments by Brunsson, who demonstrated that fluid secretion caused by an invasive strain of Salmonella typhimurium (R5) was converted into absorption after intravenous administration of hexamethonium or by exposure of the intestinal serosa to lidocaine, a local anaesthetic.

reference_spacy_tokens: The proposal was examined in rat experiments by Brunsson , who demonstrated that fluid secretion caused by an invasive strain of Salmonella typhimurium ( R5 ) was converted into absorption after intravenous administration of hexamethonium or by exposure of the intestinal serosa to lidocaine , a local anaesthetic .


fn_spacy_tokens_for_baseline: It would have been impolite to refuse so Elisa found herself back in the sitting room .

source_bert_toks: it would have been imp ##oli ##te to refuse so elisa found herself back in the sitting room .

reference_raw: It would be rude to refuse, so Elisa was back in the living room.

reference_spacy_tokens: It would be rude to refuse , so Elisa was back in the living room .


fn_spacy_tokens_for_baseline: One moment the sun was on her face , the next raindrops the size of golf balls were pelting down on her , drenching her as thoroughly as a bathroom shower .

source_bert_toks: one moment the sun was on her face , the next rain ##drop ##s the size of golf balls were pe ##lt ##ing down on her , dr ##en ##ching her as thoroughly as a bathroom shower .

reference_raw: One minute the sun was on her face, and the next droplets, the size of golf balls, spilled down on her, drenching her like a shower in a bathroom.

reference_spacy_tokens: One minute the sun was on her face , and the next droplets , the size of golf balls , spilled down on her , drenching her like a shower in a bathroom .


fn_spacy_tokens_for_baseline: You ca n't hear me gnashing my teeth , but that 's what I 'm doing .

source_bert_toks: you can ' t hear me g ##nas ##hing my teeth , but that ' s what i ' m doing .

reference_raw: You can't hear me grinding my teeth, but I do.

reference_spacy_tokens: You ca n't hear me grinding my teeth , but I do .


fn_spacy_tokens_for_baseline: Upon arrival , Hall said that his visit , the first of its kind by an American congressman since the 1991 Gulf War , was not political but humanitarian .

source_bert_toks: upon arrival , hall said that his visit , the first of its kind by an american congressman since the 1991 gulf war , was not political but humanitarian .

reference_raw: When Hall arrived, he said that his visit, the first of his kind to be made by a U.S. Congressman since the Bay War of 1991, was not political but humanitarian.

reference_spacy_tokens: When Hall arrived , he said that his visit , the first of his kind to be made by a U.S. Congressman since the Bay War of 1991 , was not political but humanitarian .


fn_spacy_tokens_for_baseline: But not your place , of course : we 're a good four hundred light years from your usual stamping grounds .

source_bert_toks: but not your place , of course : we ' re a good four hundred light years from your usual stamp ##ing grounds .

reference_raw: But it's not your place, of course: we're about four hundred light-years from your usual stamping site.

reference_spacy_tokens: But it 's not your place , of course : we 're about four hundred light - years from your usual stamping site .


fn_spacy_tokens_for_baseline: It 's perfectly reasonable that they ca n't understand . '

source_bert_toks: it ' s perfectly reasonable that they can ' t understand . '

reference_raw: It is perfectly logical that they do not understand.'

reference_spacy_tokens: It is perfectly logical that they do not understand . '


fn_spacy_tokens_for_baseline: Decorate with a slice of kiwi and a sprig of mint .

source_bert_toks: decorate with a slice of ki ##wi and a sp ##ri ##g of mint .

reference_raw: Decorate with a piece of kiwi and a mint sprig.

reference_spacy_tokens: Decorate with a piece of kiwi and a mint sprig .


fn_spacy_tokens_for_baseline: Additionally , a handful of resorts -- such as the South - Seas themed Mandalay Bay , the Mirage , and the new Four Seasons -- are now catering exclusively to the luxury travel market .

source_bert_toks: additionally , a handful of resorts - - such as the south - seas themed mandal ##ay bay , the mirage , and the new four seasons - - are now catering exclusively to the luxury travel market .

reference_raw: In addition, a handful of resorts - like the South Seas themed Mandalay Bay, Mirage, and the new Four Seasons - now feed exclusively to the luxury travel market.

reference_spacy_tokens: In addition , a handful of resorts - like the South Seas themed Mandalay Bay , Mirage , and the new Four Seasons - now feed exclusively to the luxury travel market .


fn_spacy_tokens_for_baseline: Official word of Tuesday 's incident coincided with reports that a chopper had been fired upon while flying low over a Sunni district .

source_bert_toks: official word of tuesday ' s incident coincided with reports that a chopper had been fired upon while flying low over a sunni district .

reference_raw: The official report of Tuesday's incident coincided with the report that the helicopter had been fired on while flying low over the Sunni district.

reference_spacy_tokens: The official report of Tuesday 's incident coincided with the report that the helicopter had been fired on while flying low over the Sunni district .


fn_spacy_tokens_for_baseline: Its strategic value lay in its situation , ideal for commercial use of the trade routes to England and France in the west and Russia and Europe to the east .

source_bert_toks: its strategic value lay in its situation , ideal for commercial use of the trade routes to england and france in the west and russia and europe to the east .

reference_raw: Its strategic value lies in its position, ideal for the commercial use of the trade lines to England and France to the west and to Russia and Europe to the east.

reference_spacy_tokens: Its strategic value lies in its position , ideal for the commercial use of the trade lines to England and France to the west and to Russia and Europe to the east .


fn_spacy_tokens_for_baseline: In March 2004 , the revelation , combined with IAEA evidence that nuclear activities had been pursued on Iranian military bases , led to a first - ever acknowledgment by Defense Minister Ali Shamkhani that the Iranian military had produced centrifuges to enrich uranium .

source_bert_toks: in march 2004 , the revelation , combined with ia ##ea evidence that nuclear activities had been pursued on iranian military bases , led to a first - ever ac ##k ##now ##led ##gm ##ent by defense minister ali sham ##khan ##i that the iranian military had produced cent ##ri ##fu ##ges to en ##rich uranium .

reference_raw: In March 2004, the revelation, together with the evidence from the IAEA that nuclear activities were carried out on Iranian military bases, led to the first-ever acknowledgement of Defense Minister Ali Shamkhani that the Iranian military produced centrifuges for uranium enrichment.

reference_spacy_tokens: In March 2004 , the revelation , together with the evidence from the IAEA that nuclear activities were carried out on Iranian military bases , led to the first - ever acknowledgement of Defense Minister Ali Shamkhani that the Iranian military produced centrifuges for uranium enrichment .


fn_spacy_tokens_for_baseline: There was glittering blue mystery in his eyes , and his voice was lethally soft , like a snake rustling through dry grass .

source_bert_toks: there was glittering blue mystery in his eyes , and his voice was lethal ##ly soft , like a snake rustling through dry grass .

reference_raw: There was a gleaming blue mystery in his eyes, and his voice was deadly soft, like a snake whispering through dry grass.

reference_spacy_tokens: There was a gleaming blue mystery in his eyes , and his voice was deadly soft , like a snake whispering through dry grass .


fn_spacy_tokens_for_baseline: The motion of workers is minimized to the extent possible .

source_bert_toks: the motion of workers is minimize ##d to the extent possible .

reference_raw: The movement of workers shall be minimised as far as possible.

reference_spacy_tokens: The movement of workers shall be minimised as far as possible .


fn_spacy_tokens_for_baseline: If the buyer is a limited company , it is important to check that you are obtaining instructions from the appropriately authorised personnel .

source_bert_toks: if the buyer is a limited company , it is important to check that you are obtaining instructions from the appropriately authorised personnel .

reference_raw: If the purchaser is a limited company, it is important to check that you have received instructions from duly authorised staff.

reference_spacy_tokens: If the purchaser is a limited company , it is important to check that you have received instructions from duly authorised staff .


fn_spacy_tokens_for_baseline: He could see Harry 's puzzlement .

source_bert_toks: he could see harry ' s puzzle ##ment .

reference_raw: He saw Harry's confusion.

reference_spacy_tokens: He saw Harry 's confusion .


fn_spacy_tokens_for_baseline: Mr Shamir refused to reverse his decision not to allow the United Nations to investigate the killing of at least nineteen Arabs by Israeli security forces .

source_bert_toks: mr sham ##ir refused to reverse his decision not to allow the united nations to investigate the killing of at least nineteen arabs by israeli security forces .

reference_raw: Mr. Shamir refused to reverse his decision not to allow the UN to investigate the murder of at least nineteen Arabs by Israeli security forces.

reference_spacy_tokens: Mr. Shamir refused to reverse his decision not to allow the UN to investigate the murder of at least nineteen Arabs by Israeli security forces .


fn_spacy_tokens_for_baseline: Sun intends to set up a Sun Integration Service as part of its field organisation as a way to create demand and route business to the system integrators it 's partnering with .

source_bert_toks: sun intends to set up a sun integration service as part of its field organisation as a way to create demand and route business to the system int ##eg ##rator ##s it ' s partnering with .

reference_raw: Sun intends to set up a Sun Integration Service as part of its field organisation as a way of creating demand and directing business to the system integrators with which it is affiliated.

reference_spacy_tokens: Sun intends to set up a Sun Integration Service as part of its field organisation as a way of creating demand and directing business to the system integrators with which it is affiliated .


fn_spacy_tokens_for_baseline: Did n't he mess up the header / flick on that allowed Sheron to score the first goal ?

source_bert_toks: didn ' t he mess up the header / flick on that allowed she ##ron to score the first goal ?

reference_raw: Didn't he screw up the header/flick that made it possible for Sheron to score the first target?

reference_spacy_tokens: Did n't he screw up the header / flick that made it possible for Sheron to score the first target ?


fn_spacy_tokens_for_baseline: Garlands of fresh bay were looped around a table containing a silver platter with a two - foot - high mound of Beluga caviare .

source_bert_toks: garland ##s of fresh bay were loop ##ed around a table containing a silver platt ##er with a two - foot - high mound of bel ##uga ca ##via ##re .

reference_raw: The garlands of the fresh bay were looped around a table containing a silver plate with a six-foot-high pile of Beluga caviare.

reference_spacy_tokens: The garlands of the fresh bay were looped around a table containing a silver plate with a six - foot - high pile of Beluga caviare .


fn_spacy_tokens_for_baseline: Nothing very interesting happened until the leg was found , and that was n't until the canal had thawed out and somebody could go down .

source_bert_toks: nothing very interesting happened until the leg was found , and that wasn ' t until the canal had tha ##wed out and somebody could go down .

reference_raw: Nothing very interesting happened until they found the foot, and it wasn't until the canal melted and someone went down.

reference_spacy_tokens: Nothing very interesting happened until they found the foot , and it was n't until the canal melted and someone went down .


fn_spacy_tokens_for_baseline: Those whose fate was to die on some far foreign field could not have wanted a more peaceful , lovely graveyard .

source_bert_toks: those whose fate was to die on some far foreign field could not have wanted a more peaceful , lovely graveyard .

reference_raw: Those whose fate was to die in a distant foreign field couldn't want a more peaceful, beautiful cemetery.

reference_spacy_tokens: Those whose fate was to die in a distant foreign field could n't want a more peaceful , beautiful cemetery .


fn_spacy_tokens_for_baseline: The watery fluid plashed against my cheeks ; as it did so I felt a novel sensation , a sloughing , pulling and slipping of the skin .

source_bert_toks: the watery fluid pl ##ash ##ed against my cheeks ; as it did so i felt a novel sensation , a sl ##ough ##ing , pulling and slipping of the skin .

reference_raw: The watery liquid brushed against my cheeks; as it did, I felt a new sensation, a sloughing, pulling, and sliding of the skin.

reference_spacy_tokens: The watery liquid brushed against my cheeks ; as it did , I felt a new sensation , a sloughing , pulling , and sliding of the skin .


fn_spacy_tokens_for_baseline: After the cleaning in AlbuFahd , the brothers killed three of the spies in his tribe , and for the first time there was no reaction against the brothers , but instead he came to them , asking for forgiveness , and he 's ready to cooperate .

source_bert_toks: after the cleaning in al ##bu ##fa ##hd , the brothers killed three of the spies in his tribe , and for the first time there was no reaction against the brothers , but instead he came to them , asking for forgiveness , and he ' s ready to cooperate .

reference_raw: After cleaning up in AlbuFahd, the brothers killed three of his tribe's spies, and for the first time there was no response to the brothers, but instead he came to them and asked for forgiveness, and he was prepared to cooperate.

reference_spacy_tokens: After cleaning up in AlbuFahd , the brothers killed three of his tribe 's spies , and for the first time there was no response to the brothers , but instead he came to them and asked for forgiveness , and he was prepared to cooperate .


fn_spacy_tokens_for_baseline: Long before mediocre crooner Curtis Stiger landed in the middle of the road there was another , greater Curtis .

source_bert_toks: long before med ##io ##cre cr ##oon ##er curtis st ##iger landed in the middle of the road there was another , greater curtis .

reference_raw: Long before the average crooner, Curtis Stiger, landed in the middle of the road, there was another, larger Curtis.

reference_spacy_tokens: Long before the average crooner , Curtis Stiger , landed in the middle of the road , there was another , larger Curtis .


fn_spacy_tokens_for_baseline: Both donned two - pieces to prove they 're a match for anybody .

source_bert_toks: both don ##ned two - pieces to prove they ' re a match for anybody .

reference_raw: They both wore two pieces to prove that they match anyone.

reference_spacy_tokens: They both wore two pieces to prove that they match anyone .


fn_spacy_tokens_for_baseline: In August 2002 , China issued regulations and a control list restricting the export of missiles and missile technology .

source_bert_toks: in august 2002 , china issued regulations and a control list restricting the export of missiles and missile technology .

reference_raw: In August 2002, China issued regulations and checklists restricting exports of missile and missile technology.

reference_spacy_tokens: In August 2002 , China issued regulations and checklists restricting exports of missile and missile technology .


fn_spacy_tokens_for_baseline: ' We 'll radio Athens right away .

source_bert_toks: ' we ' ll radio athens right away .

reference_raw: 'We're going to broadcast Athens now.

reference_spacy_tokens: ' We 're going to broadcast Athens now .


fn_spacy_tokens_for_baseline: We stagnate in the provinces .

source_bert_toks: we st ##ag ##nate in the provinces .

reference_raw: We're stagnant in the provinces.

reference_spacy_tokens: We 're stagnant in the provinces .


fn_spacy_tokens_for_baseline: But such simple fare he knew full well would be disdained .

source_bert_toks: but such simple fare he knew full well would be disdain ##ed .

reference_raw: But such a simple fare, he knew perfectly well, would be despised.

reference_spacy_tokens: But such a simple fare , he knew perfectly well , would be despised .


fn_spacy_tokens_for_baseline: Long skirts in the middle of the day were acceptable when walking through the halls of Al Ain or Abu Dhabi hotels , but a blue - eyed English woman in black veils and coat ?

source_bert_toks: long skirts in the middle of the day were acceptable when walking through the halls of al ain or abu dhabi hotels , but a blue - eyed english woman in black veil ##s and coat ?

reference_raw: Long skirts in the middle of the day were acceptable as they passed through the halls of the hotels of Al Ain and Abu Dhabi, but a blue-haired English woman in black veils and coats?

reference_spacy_tokens: Long skirts in the middle of the day were acceptable as they passed through the halls of the hotels of Al Ain and Abu Dhabi , but a blue - haired English woman in black veils and coats ?


fn_spacy_tokens_for_baseline: She flung out her hands .

source_bert_toks: she flung out her hands .

reference_raw: She spread her hands.

reference_spacy_tokens: She spread her hands .


fn_spacy_tokens_for_baseline: For many , these works recall childhood memories ; they were the silent witnesses to countless formative experiences .

source_bert_toks: for many , these works recall childhood memories ; they were the silent witnesses to countless format ##ive experiences .

reference_raw: For many, these works remembrance childhood memories; they were silent witnesses to countless formative experiences.

reference_spacy_tokens: For many , these works remembrance childhood memories ; they were silent witnesses to countless formative experiences .


fn_spacy_tokens_for_baseline: Police seized 3,000 pieces of evidence during their raid on the foundry , placed under the name of Hains 's former wife Solange Jonkheere , who was also charged .

source_bert_toks: police seized 3 , 000 pieces of evidence during their raid on the foundry , placed under the name of hai ##ns ' s former wife sol ##ange jon ##kh ##eer ##e , who was also charged .

reference_raw: During the raid on the foundry, police confiscated 3,000 pieces of evidence under the name of Hains' ex-wife, Solange Jonkheer, who was also indicted.

reference_spacy_tokens: During the raid on the foundry , police confiscated 3,000 pieces of evidence under the name of Hains ' ex - wife , Solange Jonkheer , who was also indicted .


fn_spacy_tokens_for_baseline: Even access is not encouraged , and the tracks leading to the caverns are also closed .

source_bert_toks: even access is not encouraged , and the tracks leading to the cavern ##s are also closed .

reference_raw: Even access is not encouraged, and the paths leading to the caves are also closed.

reference_spacy_tokens: Even access is not encouraged , and the paths leading to the caves are also closed .


fn_spacy_tokens_for_baseline: Iran 's ballistic missile capabilities are complemented by extensive nuclear , biological , and chemical weapons programs , which themselves are the recipients of significant foreign assistance .

source_bert_toks: iran ' s ballistic missile capabilities are complement ##ed by extensive nuclear , biological , and chemical weapons programs , which themselves are the recipients of significant foreign assistance .

reference_raw: Iran's ballistic missile capabilities are supplemented by large-scale nuclear, biological, and chemical weapons programmes that themselves receive significant foreign assistance.

reference_spacy_tokens: Iran 's ballistic missile capabilities are supplemented by large - scale nuclear , biological , and chemical weapons programmes that themselves receive significant foreign assistance .


fn_spacy_tokens_for_baseline: He knelt up in front of me , our bodies touching from shoulder to knee , his hands in my hair , his mouth at the side of mine .

source_bert_toks: he knelt up in front of me , our bodies touching from shoulder to knee , his hands in my hair , his mouth at the side of mine .

reference_raw: He was on his knees before me, our bodies touching from shoulder to knee, hands in my hair, mouth at my side.

reference_spacy_tokens: He was on his knees before me , our bodies touching from shoulder to knee , hands in my hair , mouth at my side .


fn_spacy_tokens_for_baseline: Mainland newspaper reporters have been scouring the island .

source_bert_toks: mainland newspaper reporters have been sc ##ouring the island .

reference_raw: Newspapers search the island.

reference_spacy_tokens: Newspapers search the island .


fn_spacy_tokens_for_baseline: A stolen car which was set alight at Acklam Rugby Club , Saltersgill Avenue , Middlesbrough , damaged part of the pitch .

source_bert_toks: a stolen car which was set ali ##ght at ac ##kla ##m rugby club , salt ##ers ##gill avenue , middlesbrough , damaged part of the pitch .

reference_raw: The stolen car that was set on fire at the Acklam Rugby Club, Saltersgill Avenue, Middlesbrough, damaged part of the pitch.

reference_spacy_tokens: The stolen car that was set on fire at the Acklam Rugby Club , Saltersgill Avenue , Middlesbrough , damaged part of the pitch .


fn_spacy_tokens_for_baseline: She fiddled a tiny key into an infinitesimal lock and turned back the lid of her jewel - case .

source_bert_toks: she fiddle ##d a tiny key into an infinite ##si ##mal lock and turned back the lid of her jewel - case .

reference_raw: She slipped the tiny key into the infinite lock and turned the lid of the jewel case back.

reference_spacy_tokens: She slipped the tiny key into the infinite lock and turned the lid of the jewel case back .


fn_spacy_tokens_for_baseline: ' The firefight started when enemy forces engaged U. S. forces at approximately 4 a. m. , ' the statement said .

source_bert_toks: ' the fire ##fight started when enemy forces engaged u . s . forces at approximately 4 a . m . , ' the statement said .

reference_raw: "The shooting started when the enemy forces attacked the U.S. forces at about four o'clock in the morning," he said.

reference_spacy_tokens: " The shooting started when the enemy forces attacked the U.S. forces at about four o'clock in the morning , " he said .


fn_spacy_tokens_for_baseline: This time Donna stepped on the accelerator and the Volvo shot forward , dirt and stones spraying up behind it as she guided it back onto the road .

source_bert_toks: this time donna stepped on the accelerator and the volvo shot forward , dirt and stones spraying up behind it as she guided it back onto the road .

reference_raw: This time Donna stepped on the accelerator, and the Volvo shot forward, dust and rocks splashing behind her as she led her back to the road.

reference_spacy_tokens: This time Donna stepped on the accelerator , and the Volvo shot forward , dust and rocks splashing behind her as she led her back to the road .


fn_spacy_tokens_for_baseline: Skilled ringers use their wrists to advance or retard the next swing , so that one bell can swap places with another in the following change .

source_bert_toks: skilled ring ##ers use their wrists to advance or re ##tar ##d the next swing , so that one bell can swap places with another in the following change .

reference_raw: Skilled ringers use their wrists to move or slow down the next swing, so that one bell can switch places with another in the next change.

reference_spacy_tokens: Skilled ringers use their wrists to move or slow down the next swing , so that one bell can switch places with another in the next change .


fn_spacy_tokens_for_baseline: At church follow road as it bends to right but immediately take enclosed path on left , signposted Knightley Way .

source_bert_toks: at church follow road as it bends to right but immediately take enclosed path on left , sign ##post ##ed knight ##ley way .

reference_raw: The church follows the road as it turns to the right, but immediately takes the enclosed road to the left, marked Knightley Way.

reference_spacy_tokens: The church follows the road as it turns to the right , but immediately takes the enclosed road to the left , marked Knightley Way .


fn_spacy_tokens_for_baseline: In a village somewhere in the uezd of Roslavl ' in the southwest of the Smolensk guberniia a peasant mother rises at dawn in the spring of 1922 on hearing the passing herdsman drum on his barabanka , a cast - iron drum .

source_bert_toks: in a village somewhere in the u ##ez ##d of ro ##sl ##av ##l ' in the southwest of the sm ##ole ##nsk gu ##ber ##ni ##ia a peasant mother rises at dawn in the spring of 1922 on hearing the passing herds ##man drum on his bar ##aba ##nka , a cast - iron drum .

reference_raw: In a village somewhere in the Uezd of Roslavl in the southwest of Smolensk Gubernia, a peasant mother wakes up at dawn in the spring of 1922 when she hears a passing shepherd drum on his barabanka like a cast iron drum.

reference_spacy_tokens: In a village somewhere in the Uezd of Roslavl in the southwest of Smolensk Gubernia , a peasant mother wakes up at dawn in the spring of 1922 when she hears a passing shepherd drum on his barabanka like a cast iron drum .


fn_spacy_tokens_for_baseline: Our Neolithic ancestors , while they are best remembered for their massive megalithic monuments such as those at Newgrange and Knowth , began their farming revolution in the clear glades of the Irish forests .

source_bert_toks: our neolithic ancestors , while they are best remembered for their massive mega ##lithic monuments such as those at new ##gra ##nge and know ##th , began their farming revolution in the clear glad ##es of the irish forests .

reference_raw: Our neolithic ancestors, though best remembered for their massive megalithic monuments like Newgrange and Knowth, began their agricultural revolution in the bright clearings of the Irish forests.

reference_spacy_tokens: Our neolithic ancestors , though best remembered for their massive megalithic monuments like Newgrange and Knowth , began their agricultural revolution in the bright clearings of the Irish forests .


fn_spacy_tokens_for_baseline: My suggestion is that you and I go to - night and see if we can strike at the very heart of the mystery . '

source_bert_toks: my suggestion is that you and i go to - night and see if we can strike at the very heart of the mystery . '

reference_raw: I suggest we go tonight and see if we can strike at the very heart of the mystery.'

reference_spacy_tokens: I suggest we go tonight and see if we can strike at the very heart of the mystery . '


fn_spacy_tokens_for_baseline: He lives in South Stoke in Oxfordshire and is is working flat out on a film script .

source_bert_toks: he lives in south stoke in oxfordshire and is is working flat out on a film script .

reference_raw: He lives in South Stoke, Oxfordshire, and he's working on a movie screenplay.

reference_spacy_tokens: He lives in South Stoke , Oxfordshire , and he 's working on a movie screenplay .


fn_spacy_tokens_for_baseline: The next day , fresh chip butties and burgers in hand , we readied for the weekend 's big attraction : a copy of a New Generation episode , not due to be shown here for months .

source_bert_toks: the next day , fresh chip butt ##ies and burger ##s in hand , we read ##ied for the weekend ' s big attraction : a copy of a new generation episode , not due to be shown here for months .

reference_raw: The next day, fresh chip butts and burgers in hand, we prepared for the great weekend attraction: a copy of the New Generation episode, which will not be shown here for months.

reference_spacy_tokens: The next day , fresh chip butts and burgers in hand , we prepared for the great weekend attraction : a copy of the New Generation episode , which will not be shown here for months .


fn_spacy_tokens_for_baseline: You ai n't gone and got yourself worked up into a glum mood , have you now ? '

source_bert_toks: you ain ' t gone and got yourself worked up into a g ##lum mood , have you now ? '

reference_raw: You're not gone and you're in a bad mood, are you?'

reference_spacy_tokens: You 're not gone and you 're in a bad mood , are you ? '


fn_spacy_tokens_for_baseline: And Dublin , a city large in expectations , is still small enough for the visitor to see most of its sights on foot .

source_bert_toks: and dublin , a city large in expectations , is still small enough for the visitor to see most of its sights on foot .

reference_raw: And Dublin, a city big in anticipation, is still so small that a visitor can see most of his sights on foot.

reference_spacy_tokens: And Dublin , a city big in anticipation , is still so small that a visitor can see most of his sights on foot .


fn_spacy_tokens_for_baseline: The pictures have to be developed and printed to a suitable quality for the media and you will need enlargements , possibly in some quantity .

source_bert_toks: the pictures have to be developed and printed to a suitable quality for the media and you will need en ##lar ##gement ##s , possibly in some quantity .

reference_raw: Images must be designed and printed to a suitable quality for the media, and you will need to be expanded, possibly in a certain amount.

reference_spacy_tokens: Images must be designed and printed to a suitable quality for the media , and you will need to be expanded , possibly in a certain amount .


fn_spacy_tokens_for_baseline: Or will it be none of them because the Internet allows and encourages a plethora of strong companies and a complex interconnection of businesses where none are allowed to dominate ?

source_bert_toks: or will it be none of them because the internet allows and encourages a pl ##eth ##ora of strong companies and a complex inter ##con ##ne ##ction of businesses where none are allowed to dominate ?

reference_raw: Or will it not be one of them, because the Internet allows and encourages a multitude of powerful companies and an intricate network of companies where no one can control them?

reference_spacy_tokens: Or will it not be one of them , because the Internet allows and encourages a multitude of powerful companies and an intricate network of companies where no one can control them ?


fn_spacy_tokens_for_baseline: A final statement yesterday said : " While some advances are being made in nations throughout the hemisphere , the state of press freedom in the Americas still must be regarded as grim as long as journalists and their families are subject to the crudest form of censorship : death by assassination . "

source_bert_toks: a final statement yesterday said : " while some advances are being made in nations throughout the hemisphere , the state of press freedom in the americas still must be regarded as grim as long as journalists and their families are subject to the crude ##st form of censorship : death by assassination . "

reference_raw: Yesterday's final statement said, "While some progress has been made in countries across the hemisphere, the state of freedom of the press in America must still be considered gloomy as long as journalists and their families are subject to the most brutal form of censorship: death by murder."

reference_spacy_tokens: Yesterday 's final statement said , " While some progress has been made in countries across the hemisphere , the state of freedom of the press in America must still be considered gloomy as long as journalists and their families are subject to the most brutal form of censorship : death by murder . "


fn_spacy_tokens_for_baseline: During the 1992 campaign , when Gennifer Flowers first brought Clinton 's philandering to public attention , Stephanopoulos -- as Clinton 's chief spinner , distracter , and all - around bullshit artist -- played a crucial role in discrediting Flowers and anyone else who tried to point out the truth , namely that Clinton had a disturbing zipper problem . ( Do n't say Stephanopoulos did n't know .

source_bert_toks: during the 1992 campaign , when gen ##ni ##fer flowers first brought clinton ' s phil ##ander ##ing to public attention , stephan ##op ##oulos - - as clinton ' s chief spin ##ner , distract ##er , and all - around bullshit artist - - played a crucial role in disc ##red ##iting flowers and anyone else who tried to point out the truth , namely that clinton had a disturbing zipper problem . ( don ' t say stephan ##op ##oulos didn ' t know .

reference_raw: During the campaign of 1992, when Gennifer Flowers first brought Clinton's philandering to the public, Stephanopoulos - as Clinton's chief spinner, distracter, and all-around bullshit artist - played a key role in discrediting Flowers and anyone else who tried to point out the truth, namely that Clinton had a disturbing zip problem.

reference_spacy_tokens: During the campaign of 1992 , when Gennifer Flowers first brought Clinton 's philandering to the public , Stephanopoulos - as Clinton 's chief spinner , distracter , and all - around bullshit artist - played a key role in discrediting Flowers and anyone else who tried to point out the truth , namely that Clinton had a disturbing zip problem .


fn_spacy_tokens_for_baseline: After the recent blood - bath in Westminster Abbey his heart flipped over and his head swam about .

source_bert_toks: after the recent blood - bath in westminster abbey his heart flipped over and his head swam about .

reference_raw: After a recent blood bath in Westminster Abbey, his heart turned and his head swam.

reference_spacy_tokens: After a recent blood bath in Westminster Abbey , his heart turned and his head swam .


fn_spacy_tokens_for_baseline: ' You ! ' said the Caterpillar , in a very unfriendly voice .

source_bert_toks: ' you ! ' said the cater ##pi ##llar , in a very un ##fr ##ien ##dly voice .

reference_raw: 'You!' said the Caterpillar, his voice very hostile.

reference_spacy_tokens: ' You ! ' said the Caterpillar , his voice very hostile .


fn_spacy_tokens_for_baseline: She has five hedgehogs hibernating in mounds of leaves and a kestrel which was left on her doorstep with a damaged foot .

source_bert_toks: she has five hedge ##hog ##s hi ##ber ##nat ##ing in mounds of leaves and a ke ##strel which was left on her doorstep with a damaged foot .

reference_raw: He's got five hedgehogs hibernation in piles of leaves and a kestrel left on his doorstep with a broken leg.

reference_spacy_tokens: He 's got five hedgehogs hibernation in piles of leaves and a kestrel left on his doorstep with a broken leg .


fn_spacy_tokens_for_baseline: It would have been hard to sit there smouldering with scorn while all around children were bouncing about delivering their verdict of unrestrained approval .

source_bert_toks: it would have been hard to sit there sm ##ou ##lder ##ing with sc ##orn while all around children were bouncing about delivering their verdict of unrest ##rained approval .

reference_raw: It would be hard to sit there, smoldering with contempt, while the children were bouncing around to deliver their verdict of unrestricted approval.

reference_spacy_tokens: It would be hard to sit there , smoldering with contempt , while the children were bouncing around to deliver their verdict of unrestricted approval .


fn_spacy_tokens_for_baseline: Iranian agents are believed to be actively seeking deals to procure critical technologies .

source_bert_toks: iranian agents are believed to be actively seeking deals to pro ##cure critical technologies .

reference_raw: It is believed that Iranian agents are actively seeking deals for the acquisition of critical technologies.

reference_spacy_tokens: It is believed that Iranian agents are actively seeking deals for the acquisition of critical technologies .


fn_spacy_tokens_for_baseline: But details about when and how the U. S. will hand over leadership of the operation were elusive .

source_bert_toks: but details about when and how the u . s . will hand over leadership of the operation were elusive .

reference_raw: But the details of when and how the U.S. would hand over command of the operation were evasive.

reference_spacy_tokens: But the details of when and how the U.S. would hand over command of the operation were evasive .


fn_spacy_tokens_for_baseline: ANCDF [ Anniston Chemical Agent Disposal Facility ] receives third consecutive Safe Operating Facility of the Year Award

source_bert_toks: an ##cd ##f [ ann ##isto ##n chemical agent disposal facility ] receives third consecutive safe operating facility of the year award

reference_raw: ANCDF [Anniston Chemical Disposal Facility] receives the third consecutive secure operating facility of the Year Award.

reference_spacy_tokens: ANCDF [ Anniston Chemical Disposal Facility ] receives the third consecutive secure operating facility of the Year Award .


fn_spacy_tokens_for_baseline: The struggle against the drug lords in Colombia will be a near thing .

source_bert_toks: the struggle against the drug lords in colombia will be a near thing .

reference_raw: Fighting drug lords in Colombia will be close.

reference_spacy_tokens: Fighting drug lords in Colombia will be close .


fn_spacy_tokens_for_baseline: One year after the auction , the population of Las Vegas had ballooned to 1500 residents , a portent of things to come for the next ninety years .

source_bert_toks: one year after the auction , the population of las vegas had balloon ##ed to 1500 residents , a porte ##nt of things to come for the next ninety years .

reference_raw: One year after the auction, the population of Las Vegas went up to 1,500 inhabitants, and that's what's going to happen for the next ninety years.

reference_spacy_tokens: One year after the auction , the population of Las Vegas went up to 1,500 inhabitants , and that 's what 's going to happen for the next ninety years .


fn_spacy_tokens_for_baseline: The scary traffic is a real experience - vehicles of all kinds jockey for position on crowded streets , missing each other by inches , and speeding on the freeways is rampant .

source_bert_toks: the scary traffic is a real experience - vehicles of all kinds jockey for position on crowded streets , missing each other by inches , and speeding on the freeway ##s is rampant .

reference_raw: Scary traffic is a real thing - cars of all sorts of jockeys for positioning on crowded streets, missing each other by inches, and speeding on highways is rampant.

reference_spacy_tokens: Scary traffic is a real thing - cars of all sorts of jockeys for positioning on crowded streets , missing each other by inches , and speeding on highways is rampant .


fn_spacy_tokens_for_baseline: Such terms are best confined to an appendix .

source_bert_toks: such terms are best confined to an appendix .

reference_raw: Such terms are best limited to the appendix.

reference_spacy_tokens: Such terms are best limited to the appendix .


fn_spacy_tokens_for_baseline: You could not hunch up into the tree , hugging closer to the trunk .

source_bert_toks: you could not hu ##nch up into the tree , hugging closer to the trunk .

reference_raw: You couldn't crouch in a tree and hold it closer to the trunk.

reference_spacy_tokens: You could n't crouch in a tree and hold it closer to the trunk .


fn_spacy_tokens_for_baseline: ' Sarah Byrne , unmarried , of Stone Alley , Turnmill Street , Clerkenwell , left a female infant , subsequently baptized Anna Beckett .

source_bert_toks: ' sarah byrne , unmarried , of stone alley , turn ##mill street , clerk ##en ##well , left a female infant , subsequently baptized anna beckett .

reference_raw: Sarah Byrne, single from Stone Alley, Turnmill Street, Clerkenwell, left the baby and then christened Anna Beckett.

reference_spacy_tokens: Sarah Byrne , single from Stone Alley , Turnmill Street , Clerkenwell , left the baby and then christened Anna Beckett .


fn_spacy_tokens_for_baseline: ' Very astute of you , ' the Doctor said approvingly .

source_bert_toks: ' very as ##tute of you , ' the doctor said app ##roving ##ly .

reference_raw: "That's very nice of you," the doctor said approvingly.

reference_spacy_tokens: " That 's very nice of you , " the doctor said approvingly .


fn_spacy_tokens_for_baseline: Back in the tent there is more soup , coffee and a hunk of smoked lamb that goes down well .

source_bert_toks: back in the tent there is more soup , coffee and a hu ##nk of smoked lamb that goes down well .

reference_raw: There's more soup back in the tent, coffee, and a bunch of smoked lambs that go well.

reference_spacy_tokens: There 's more soup back in the tent , coffee , and a bunch of smoked lambs that go well .


fn_spacy_tokens_for_baseline: Pulling on a sweater and wrapping my long kilt around me , I made my way towards Sheikha Grandmother 's house .

source_bert_toks: pulling on a sweater and wrapping my long ki ##lt around me , i made my way towards sheikh ##a grandmother ' s house .

reference_raw: I pulled on my sweater and put my long kilt around me and headed for Sheikh's grandmother's house.

reference_spacy_tokens: I pulled on my sweater and put my long kilt around me and headed for Sheikh 's grandmother 's house .


fn_spacy_tokens_for_baseline: At the top of the social pyramid was the aristocracy , large landowners whose families had long served Moscow ( the boyars ) and ex - appanage princes who had gradually been drawn to the metropolis .

source_bert_toks: at the top of the social pyramid was the aristocracy , large landowners whose families had long served moscow ( the boy ##ars ) and ex - app ##ana ##ge princes who had gradually been drawn to the metropolis .

reference_raw: At the top of the social pyramid were aristocracy, large landowners whose families had long served Moscow (boyars) and former apprentice princes who had been drawn to the capital.

reference_spacy_tokens: At the top of the social pyramid were aristocracy , large landowners whose families had long served Moscow ( boyars ) and former apprentice princes who had been drawn to the capital .


fn_spacy_tokens_for_baseline: The National Trust here bent its rather strict rules on lending in honour of the importance of the exhibition .

source_bert_toks: the national trust here bent its rather strict rules on lending in honour of the importance of the exhibition .

reference_raw: In honor of the importance of the exhibition, the National Trust here has waived its rather stringent lending rules.

reference_spacy_tokens: In honor of the importance of the exhibition , the National Trust here has waived its rather stringent lending rules .


fn_spacy_tokens_for_baseline: The grapeshot strikes her in the rump .

source_bert_toks: the grapes ##hot strikes her in the rum ##p .

reference_raw: The grapeshot hits her in the back.

reference_spacy_tokens: The grapeshot hits her in the back .


fn_spacy_tokens_for_baseline: US concerns about Iranian nuclear ambitions are currently delaying the granting of IAEA fellowships to Iranian nationals .

source_bert_toks: us concerns about iranian nuclear ambitions are currently delaying the granting of ia ##ea fellowships to iranian nationals .

reference_raw: U.S. concerns about Iran's nuclear ambitions are currently delaying the grant of IAEA scholarships to Iranian citizens.

reference_spacy_tokens: U.S. concerns about Iran 's nuclear ambitions are currently delaying the grant of IAEA scholarships to Iranian citizens .


fn_spacy_tokens_for_baseline: Certain CW facilities also carried out research on the suitability of using illegal drugs such as methaqualone ( " Quaaludes " ) , MDMA ( " Ecstasy " ) , LSD , marijuana extract ( tetrahydrocannibol ) , and cocaine as incapacitating " calmatives , " but some of these illegal drugs may have ended up being sold for a profit .

source_bert_toks: certain cw facilities also carried out research on the suit ##ability of using illegal drugs such as met ##ha ##qual ##one ( " qu ##aa ##lu ##des " ) , md ##ma ( " ecstasy " ) , l ##sd , marijuana extract ( te ##tra ##hy ##dro ##can ##ni ##bol ) , and cocaine as inca ##pac ##itating " calm ##ative ##s , " but some of these illegal drugs may have ended up being sold for a profit .

reference_raw: Some CW facilities have also carried out research into the appropriate use of illicit drugs such as methaqualone ( Quaaludes ), MDMA ( "Ecstasy" ), LSD, marijuana extract (tetrahydrocannibol) and cocaine as incapacitating "calmatives", but some of these illegal drugs may have been sold for profit.

reference_spacy_tokens: Some CW facilities have also carried out research into the appropriate use of illicit drugs such as methaqualone ( Quaaludes ) , MDMA ( " Ecstasy " ) , LSD , marijuana extract ( tetrahydrocannibol ) and cocaine as incapacitating " calmatives " , but some of these illegal drugs may have been sold for profit .


fn_spacy_tokens_for_baseline: A simple economic theory may provide at least a partial explanation for the split personality displayed by Americans in the voting booth .

source_bert_toks: a simple economic theory may provide at least a partial explanation for the split personality displayed by americans in the voting booth .

reference_raw: A simple economic theory can provide at least a partial explanation of the split personality that America displays in the voting booth.

reference_spacy_tokens: A simple economic theory can provide at least a partial explanation of the split personality that America displays in the voting booth .


fn_spacy_tokens_for_baseline: Yeah , yeah , I get back to Price 's comment when he , uh , was found guilty he said , well , he did n't have any blacks , uh , you know from his neck of the woods .

source_bert_toks: yeah , yeah , i get back to price ' s comment when he , uh , was found guilty he said , well , he didn ' t have any blacks , uh , you know from his neck of the woods .

reference_raw: Yeah, yeah, I get back to Price's comment when he, uh, got convicted, said, well, he didn't have any blacks, you know, in the woods.

reference_spacy_tokens: Yeah , yeah , I get back to Price 's comment when he , uh , got convicted , said , well , he did n't have any blacks , you know , in the woods .


fn_spacy_tokens_for_baseline: Your powers , if I may say so without offence , seem superior to your opportunities . '

source_bert_toks: your powers , if i may say so without offence , seem superior to your opportunities . '

reference_raw: Your powers, if you don't mind my saying so, seem better than your opportunities.'

reference_spacy_tokens: Your powers , if you do n't mind my saying so , seem better than your opportunities . '


fn_spacy_tokens_for_baseline: Through 1905 , Helen Stewart expanded the ranch to 2000 acres ( 810 hectares ) , making quite a bit of money in the process .

source_bert_toks: through 1905 , helen stewart expanded the ranch to 2000 acres ( 81 ##0 hectares ) , making quite a bit of money in the process .

reference_raw: In 1905, Helen Stewart expanded the ranch to 2,000 acres (810 hectares) and made quite a lot of money.

reference_spacy_tokens: In 1905 , Helen Stewart expanded the ranch to 2,000 acres ( 810 hectares ) and made quite a lot of money .


fn_spacy_tokens_for_baseline: They even reported a bonfire that went out of control in the local rag ! "

source_bert_toks: they even reported a bonfire that went out of control in the local rag ! "

reference_raw: They even reported a fire that got out of hand in a local rag!

reference_spacy_tokens: They even reported a fire that got out of hand in a local rag !


fn_spacy_tokens_for_baseline: Indeed , it is said that Scotland gave golf to the world .

source_bert_toks: indeed , it is said that scotland gave golf to the world .

reference_raw: In fact, there are rumors that Scotland has given the world golf.

reference_spacy_tokens: In fact , there are rumors that Scotland has given the world golf .


fn_spacy_tokens_for_baseline: Huyton councillor Fred Curran said he was appalled at the cuts in the library book fund .

source_bert_toks: hu ##yt ##on councillor fred curran said he was appalled at the cuts in the library book fund .

reference_raw: Huyton Councilman Fred Curran said he was horrified by the cuts in the library book fund.

reference_spacy_tokens: Huyton Councilman Fred Curran said he was horrified by the cuts in the library book fund .


fn_spacy_tokens_for_baseline: Discussants will respond to the speakers with their assessment of the implications of the work undertaken and the need for future development .

source_bert_toks: discuss ##ants will respond to the speakers with their assessment of the implications of the work undertaken and the need for future development .

reference_raw: The debaters will respond to the speakers by assessing the impact of the work carried out and the need for future development.

reference_spacy_tokens: The debaters will respond to the speakers by assessing the impact of the work carried out and the need for future development .


fn_spacy_tokens_for_baseline: He sat back to let this sink in .

source_bert_toks: he sat back to let this sink in .

reference_raw: He leaned back and let it sink.

reference_spacy_tokens: He leaned back and let it sink .


fn_spacy_tokens_for_baseline: Gold . beautiful , bright , glittering , glistening , lovely yellow gold !

source_bert_toks: gold . beautiful , bright , glittering , glistening , lovely yellow gold !

reference_raw: Gold ..beautiful, bright, shiny, beautiful yellow gold!

reference_spacy_tokens: Gold .. beautiful , bright , shiny , beautiful yellow gold !


fn_spacy_tokens_for_baseline: The walls were panelled in mahogany except for the fourth wall behind him .

source_bert_toks: the walls were panel ##led in mahogany except for the fourth wall behind him .

reference_raw: The walls were lined with mahogany, except for the fourth wall beyond.

reference_spacy_tokens: The walls were lined with mahogany , except for the fourth wall beyond .


fn_spacy_tokens_for_baseline: In Northern Iraq over a hundred thousand Kurdish children are still unable to return to their homes after being forced to flee Saddam Hussein 's army .

source_bert_toks: in northern iraq over a hundred thousand kurdish children are still unable to return to their homes after being forced to flee saddam hussein ' s army .

reference_raw: In Northern Iraq, more than 100,000 Kurdish children are still unable to return to their homes after being forced to escape the army of Saddam Hussein.

reference_spacy_tokens: In Northern Iraq , more than 100,000 Kurdish children are still unable to return to their homes after being forced to escape the army of Saddam Hussein .


fn_spacy_tokens_for_baseline: As the happy couple took their places there was a stir and a rising babble behind them .

source_bert_toks: as the happy couple took their places there was a stir and a rising ba ##bble behind them .

reference_raw: There was a stir and a growing babble behind them as the happy pair took their places.

reference_spacy_tokens: There was a stir and a growing babble behind them as the happy pair took their places .


fn_spacy_tokens_for_baseline: And all the time she thirsted for the words of love which she made the young boy recite .

source_bert_toks: and all the time she thirst ##ed for the words of love which she made the young boy rec ##ite .

reference_raw: And all the while she was thirsty for the words of love that she had forced the young boy to recite.

reference_spacy_tokens: And all the while she was thirsty for the words of love that she had forced the young boy to recite .


fn_spacy_tokens_for_baseline: The weather reports indicate that we may get a light snowfall some time over the next few days .

source_bert_toks: the weather reports indicate that we may get a light snowfall some time over the next few days .

reference_raw: According to the weather reports, we may have a little bit of snow in the next few days.

reference_spacy_tokens: According to the weather reports , we may have a little bit of snow in the next few days .


fn_spacy_tokens_for_baseline: The conspicuous exterior dado , the baseboards , and the chair - rails in the Vanna Venturi House were hardly Classical moldings - they were merely boards with chamfered edges - yet they challenged the assumption that trim and Modernism were incompatible .

source_bert_toks: the conspicuous exterior dad ##o , the base ##boards , and the chair - rails in the van ##na vent ##uri house were hardly classical mold ##ings - they were merely boards with cha ##m ##fer ##ed edges - yet they challenged the assumption that trim and modernism were incompatible .

reference_raw: The conspicuous outdoor pado, the baseboards, and the chair-rails of the Vanna Venturi House were hardly classic shapes - they were just panels with chamfered edges - but they questioned the assumption that trim and modernism were incompatible.

reference_spacy_tokens: The conspicuous outdoor pado , the baseboards , and the chair - rails of the Vanna Venturi House were hardly classic shapes - they were just panels with chamfered edges - but they questioned the assumption that trim and modernism were incompatible .


fn_spacy_tokens_for_baseline: Sulphamic acid is often blended with a non - ionic detergent for use in descaling expensive equipment such as dishwashing machines and as an acid wash in ' clean - in - place " systems after the use of an alkali machine detergent .

source_bert_toks: sul ##pha ##mic acid is often blended with a non - ionic deter ##gent for use in des ##cal ##ing expensive equipment such as dish ##wash ##ing machines and as an acid wash in ' clean - in - place " systems after the use of an al ##kali machine deter ##gent .

reference_raw: Sulphamic acid is often mixed with a non-ionic detergent used to descale expensive equipment, such as dishwashing machines and acid washing in a "clean-in-place" system after the use of an alkali machine detergent.

reference_spacy_tokens: Sulphamic acid is often mixed with a non - ionic detergent used to descale expensive equipment , such as dishwashing machines and acid washing in a " clean - in - place " system after the use of an alkali machine detergent .


fn_spacy_tokens_for_baseline: Philip was called upon to build a wine cellar dug out of the side of a hill .

source_bert_toks: philip was called upon to build a wine cellar dug out of the side of a hill .

reference_raw: Philip was invited to build a wine basement dug from the side of the hill.

reference_spacy_tokens: Philip was invited to build a wine basement dug from the side of the hill .


fn_spacy_tokens_for_baseline: On the other hand , some people believe North Korea is a state satisfied with the status quo and that it seeks peaceful coexistence with South Korea and the international community .

source_bert_toks: on the other hand , some people believe north korea is a state satisfied with the status quo and that it seeks peaceful coe ##xi ##sten ##ce with south korea and the international community .

reference_raw: On the other hand, some believe that North Korea is a state that is happy with the status quo and that it seeks to co-exist peacefully with South Korea and the international community.

reference_spacy_tokens: On the other hand , some believe that North Korea is a state that is happy with the status quo and that it seeks to co - exist peacefully with South Korea and the international community .


fn_spacy_tokens_for_baseline: For some reason she could only move with nightmarish sluggishness , while everyone around her tore past with dizzying speed .

source_bert_toks: for some reason she could only move with night ##mar ##ish slug ##gis ##hn ##ess , while everyone around her tore past with dizzy ##ing speed .

reference_raw: For some reason, she could only move with nightmarish slowness, while everyone around her tore past with dizzying speed.

reference_spacy_tokens: For some reason , she could only move with nightmarish slowness , while everyone around her tore past with dizzying speed .


fn_spacy_tokens_for_baseline: The way we had taken was winding down towards a small lock or tarn .

source_bert_toks: the way we had taken was winding down towards a small lock or tar ##n .

reference_raw: The path we took curved toward a small lock or tarnish.

reference_spacy_tokens: The path we took curved toward a small lock or tarnish .


fn_spacy_tokens_for_baseline: The three upper parts of the harmony may be reduplicated at the octave above , and the bass at the octave below .

source_bert_toks: the three upper parts of the harmony may be red ##up ##lica ##ted at the octave above , and the bass at the octave below .

reference_raw: Three upper parts of the harmony can be doubled in the octave above and the bass in the octave below.

reference_spacy_tokens: Three upper parts of the harmony can be doubled in the octave above and the bass in the octave below .


fn_spacy_tokens_for_baseline: Only 4 % of the females did not mate , and even those were vigorously courted ; but 21 % of the males did not mate at all , even though they courted hard .

source_bert_toks: only 4 % of the females did not mate , and even those were vigorously court ##ed ; but 21 % of the males did not mate at all , even though they court ##ed hard .

reference_raw: Only four percent of the females didn't mate, and even they were admirable; but twenty-one percent of the males didn't mate at all, though they were admiring.

reference_spacy_tokens: Only four percent of the females did n't mate , and even they were admirable ; but twenty - one percent of the males did n't mate at all , though they were admiring .


fn_spacy_tokens_for_baseline: It flicked behind each dimpled knee ; and then scourged her at intervals from her pretty ankles to her shoulder blades .

source_bert_toks: it flicked behind each dim ##pled knee ; and then sc ##our ##ged her at intervals from her pretty ankles to her shoulder blades .

reference_raw: She flicked behind every dimpled knee, then scoured her from her pretty ankles to her shoulder blades at intervals.

reference_spacy_tokens: She flicked behind every dimpled knee , then scoured her from her pretty ankles to her shoulder blades at intervals .


fn_spacy_tokens_for_baseline: The average dividend of eighty canals in 1825 was 5.75 per cent , but the top ten were averaging 28 per cent .

source_bert_toks: the average divide ##nd of eighty canals in 1825 was 5 . 75 per cent , but the top ten were averaging 28 per cent .

reference_raw: In 1825, the average dividend of 80 channels was 5.75 percent, but the first ten averaged 28 percent.

reference_spacy_tokens: In 1825 , the average dividend of 80 channels was 5.75 percent , but the first ten averaged 28 percent .


fn_spacy_tokens_for_baseline: Jerusalem grew , surrounded with a formidable wall and defended by towers beside the Jaffa Gate .

source_bert_toks: jerusalem grew , surrounded with a formidable wall and defended by towers beside the ja ##ffa gate .

reference_raw: Jerusalem was growing, surrounded by a terrible wall, guarded by towers beside the Jaffa Gate.

reference_spacy_tokens: Jerusalem was growing , surrounded by a terrible wall , guarded by towers beside the Jaffa Gate .


fn_spacy_tokens_for_baseline: Skilled ringers use their wrists to advance or retard the next swing , so that one bell can swap places with another in the following change .

source_bert_toks: skilled ring ##ers use their wrists to advance or re ##tar ##d the next swing , so that one bell can swap places with another in the following change .

reference_raw: Skill ringers use their wrists to move or slow down the next swing, so that one bell can switch places with another in the next change.

reference_spacy_tokens: Skill ringers use their wrists to move or slow down the next swing , so that one bell can switch places with another in the next change .


fn_spacy_tokens_for_baseline: Different cuisines will use different types of ovens ; for example , Indian culture uses a Tandoor oven , which is a cylindrical clay oven which operates at a single high temperature .

source_bert_toks: different cuisine ##s will use different types of oven ##s ; for example , indian culture uses a tan ##door oven , which is a cylindrical clay oven which operates at a single high temperature .

reference_raw: Different kitchens use different types of furnaces; for example, Indian culture uses a tandoor furnace, a cylindrical clay furnace that operates at a single high temperature.

reference_spacy_tokens: Different kitchens use different types of furnaces ; for example , Indian culture uses a tandoor furnace , a cylindrical clay furnace that operates at a single high temperature .


fn_spacy_tokens_for_baseline: They do n't do them real often which is obviously the death penalty .

source_bert_toks: they don ' t do them real often which is obviously the death penalty .

reference_raw: They don't do it very often, which is, of course, the death penalty.

reference_spacy_tokens: They do n't do it very often , which is , of course , the death penalty .


fn_spacy_tokens_for_baseline: But there was no doubt who Tina took after ; she was tall and slim and strongly built , just like her father .

source_bert_toks: but there was no doubt who tina took after ; she was tall and slim and strongly built , just like her father .

reference_raw: But there was no question of who Tina followed; she was tall and slender and strong, like her father.

reference_spacy_tokens: But there was no question of who Tina followed ; she was tall and slender and strong , like her father .


fn_spacy_tokens_for_baseline: In the wider world , though Britain 's trading primacy remained universally recognized , perplexing questions of commercial influence and colonial domination presented themselves .

source_bert_toks: in the wider world , though britain ' s trading prima ##cy remained universally recognized , per ##plex ##ing questions of commercial influence and colonial domination presented themselves .

reference_raw: In the wider world, although Britain's trade primacy remained universally recognised, the confusing questions of trade influence and colonial dominance presented themselves.

reference_spacy_tokens: In the wider world , although Britain 's trade primacy remained universally recognised , the confusing questions of trade influence and colonial dominance presented themselves .


fn_spacy_tokens_for_baseline: baboons in their Sunday tippets ,

source_bert_toks: ba ##bo ##ons in their sunday tip ##pet ##s ,

reference_raw: baboons on their Sunday tips,

reference_spacy_tokens: baboons on their Sunday tips ,


fn_spacy_tokens_for_baseline: He varied this routine by pushing rubbish through the letter box , pulling the flowers from the tiny strip of garden we tried to cultivate between the flagstones and chalking rude messages on my car .

source_bert_toks: he varied this routine by pushing rubbish through the letter box , pulling the flowers from the tiny strip of garden we tried to cult ##ivate between the flags ##tones and chalk ##ing rude messages on my car .

reference_raw: He changed the routine by pushing trash through the letterbox, pulling flowers from a small strip of garden we were trying to grow among the tiles and chalking rude messages on my car.

reference_spacy_tokens: He changed the routine by pushing trash through the letterbox , pulling flowers from a small strip of garden we were trying to grow among the tiles and chalking rude messages on my car .


fn_spacy_tokens_for_baseline: With rail service in place and forty blocks of private property , it was ready to become a real town .

source_bert_toks: with rail service in place and forty blocks of private property , it was ready to become a real town .

reference_raw: With the railway service in place and forty blocks of private property, the city was ready to become a true city.

reference_spacy_tokens: With the railway service in place and forty blocks of private property , the city was ready to become a true city .


fn_spacy_tokens_for_baseline: This lending ceiling was reinforced by a further statement by the Bank in November 1968 which gave the banks four months ' notice to reduce their lending to 98 per cent of the mid November 1967 level .

source_bert_toks: this lending ceiling was reinforced by a further statement by the bank in november 1968 which gave the banks four months ' notice to reduce their lending to 98 per cent of the mid november 1967 level .

reference_raw: This loan ceiling was strengthened by a new statement by the Bank in November 1968, which gave four months' notice to the banks to reduce their lending to 98 % of the mid-November 1967 level.

reference_spacy_tokens: This loan ceiling was strengthened by a new statement by the Bank in November 1968 , which gave four months ' notice to the banks to reduce their lending to 98 % of the mid - November 1967 level .


fn_spacy_tokens_for_baseline: Also in the top 10 was Scottish Television 's feature - length version of the police mystery Taggart , which attracted 18.3 million viewers on New Year 's Day .

source_bert_toks: also in the top 10 was scottish television ' s feature - length version of the police mystery tag ##gart , which attracted 18 . 3 million viewers on new year ' s day .

reference_raw: Also in the top ten was the feature-length version of the Taggart Police Secret, which attracted 18.3 million viewers on New Year's Day.

reference_spacy_tokens: Also in the top ten was the feature - length version of the Taggart Police Secret , which attracted 18.3 million viewers on New Year 's Day .


fn_spacy_tokens_for_baseline: ' He was working one day , painting from nature , and got caught in a rainstorm .

source_bert_toks: ' he was working one day , painting from nature , and got caught in a rains ##torm .

reference_raw: 'One day he was working, painting from nature, and he was caught in a storm.

reference_spacy_tokens: ' One day he was working , painting from nature , and he was caught in a storm .


fn_spacy_tokens_for_baseline: The only injury Crawford sustained in making the second series was when he stubbed his finger while inside a wardrobe that tumbled down a flight of stairs in an episode about Frank attending an RAF reunion .

source_bert_toks: the only injury crawford sustained in making the second series was when he stu ##bbed his finger while inside a wardrobe that tumbled down a flight of stairs in an episode about frank attending an raf reunion .

reference_raw: The only injury Crawford sustained in the second series was when he stabbed his finger in the closet, which fell down the stairs in the episode of Frank attending the RAF meeting.

reference_spacy_tokens: The only injury Crawford sustained in the second series was when he stabbed his finger in the closet , which fell down the stairs in the episode of Frank attending the RAF meeting .


reference_raw: With the railway service in place and forty blocks of private property, he was ready to become a real city.

reference_spacy_tokens: With the railway service in place and forty blocks of private property , he was ready to become a real city .