fn_spacy_tokens_for_baseline: The brothers now are wiping out the heads of infidelity , as soon as they started , and never claiming responsibility , we found among us who wants to make fuss about it , and regretfully some of the brothers with us in the organization ( al - Qa'ida ) see it as nonsense , and God is my witness .

source_bert_toks: the brothers now are wiping out the heads of in ##fide ##lity , as soon as they started , and never claiming responsibility , we found among us who wants to make fuss about it , and regret ##fully some of the brothers with us in the organization ( al - q ##a ' ida ) see it as nonsense , and god is my witness .

reference_raw: The brothers now wipe out the heads of infidelity, and when they began and never claimed responsibility, we found among us who wanted to make a fuss about it, and regrettably some of the brothers in the organization (al-qa'ida) thought it was nonsense, and God is my witness.

reference_spacy_tokens: The brothers now wipe out the heads of infidelity , and when they began and never claimed responsibility , we found among us who wanted to make a fuss about it , and regrettably some of the brothers in the organization ( al - qa'ida ) thought it was nonsense , and God is my witness .


fn_spacy_tokens_for_baseline: Lettie , a smart and tweedy battleaxe suddenly glimpsed in flannelette nightie and a hairnet , is a figure of fun who would be utterly loathsome if she really existed .

source_bert_toks: let ##tie , a smart and tweed ##y battle ##ax ##e suddenly glimpse ##d in fl ##anne ##lette night ##ie and a hair ##net , is a figure of fun who would be utterly lo ##ath ##some if she really existed .

reference_raw: Lettie, a clever, tweedy battle-axe suddenly caught in a flannelette nightie and a hair-net, was a figure of amusement that would have been completely disgusting if it had actually existed.

reference_spacy_tokens: Lettie , a clever , tweedy battle - axe suddenly caught in a flannelette nightie and a hair - net , was a figure of amusement that would have been completely disgusting if it had actually existed .


fn_spacy_tokens_for_baseline: Similarly , one organization 's central group was instrumental in acquiring a strong user authentication system to help ensure that network use could be reliably traced to the individual users .

source_bert_toks: similarly , one organization ' s central group was instrumental in acquiring a strong user authentication system to help ensure that network use could be re ##lia ##bly traced to the individual users .

reference_raw: Similarly, a central group of one organisation has contributed to the creation of a robust user authentication system to help ensure that the use of the network can be reliably traced to individual users.

reference_spacy_tokens: Similarly , a central group of one organisation has contributed to the creation of a robust user authentication system to help ensure that the use of the network can be reliably traced to individual users .


fn_spacy_tokens_for_baseline: The main test of Mahmoud Abbas , will be to establish an overall command of all armed groups , if not , it does n't have a chance .

source_bert_toks: the main test of mahmoud abbas , will be to establish an overall command of all armed groups , if not , it doesn ' t have a chance .

reference_raw: Mahmoud Abbas' main test will be to establish the overall control of all armed groups, and if not, he has no chance.

reference_spacy_tokens: Mahmoud Abbas ' main test will be to establish the overall control of all armed groups , and if not , he has no chance .


fn_spacy_tokens_for_baseline: ' You could catch trout and smoke them if you had to , " I said .

source_bert_toks: ' you could catch trout and smoke them if you had to , " i said .

reference_raw: "You can pick up trout and smoke it if you have to," I said.

reference_spacy_tokens: " You can pick up trout and smoke it if you have to , " I said .


fn_spacy_tokens_for_baseline: Just then Biff started clanging the iron triangle to summon them together .

source_bert_toks: just then bi ##ff started clan ##ging the iron triangle to summon them together .

reference_raw: At that moment, Biff began to ring the iron triangle and summon them together.

reference_spacy_tokens: At that moment , Biff began to ring the iron triangle and summon them together .


fn_spacy_tokens_for_baseline: The only person you can discuss work with is your direct commander ( Amir ) , unless you are asked to do otherwise or if your work demands participation of others , and then through guidance of the leadership .

source_bert_toks: the only person you can discuss work with is your direct commander ( amir ) , unless you are asked to do otherwise or if your work demands participation of others , and then through guidance of the leadership .

reference_raw: The only person you can talk to is your direct commander (Amir), unless you are asked to do otherwise, or if your work requires the participation of others, and then by directing management.

reference_spacy_tokens: The only person you can talk to is your direct commander ( Amir ) , unless you are asked to do otherwise , or if your work requires the participation of others , and then by directing management .


fn_spacy_tokens_for_baseline: In this respect , it would be helpful if our political leaders were mute , rather than eloquently " concerned .

source_bert_toks: in this respect , it would be helpful if our political leaders were mute , rather than el ##o ##quent ##ly " concerned .

reference_raw: In that regard, it would be useful for our political leaders to be silent rather than eloquently concerned.

reference_spacy_tokens: In that regard , it would be useful for our political leaders to be silent rather than eloquently concerned .


fn_spacy_tokens_for_baseline: We continued our work until the fingerprint man arrived to dust that dreadful black powder everywhere .

source_bert_toks: we continued our work until the finger ##print man arrived to dust that dreadful black powder everywhere .

reference_raw: We went on with our work until the man with the fingerprints got here to powder that awful black powder all over the place.

reference_spacy_tokens: We went on with our work until the man with the fingerprints got here to powder that awful black powder all over the place .


fn_spacy_tokens_for_baseline: After adding water , the beef can be barbecued or fried .

source_bert_toks: after adding water , the beef can be barbecue ##d or fried .

reference_raw: After the addition of water, the beef may be roasted or fried.

reference_spacy_tokens: After the addition of water , the beef may be roasted or fried .


fn_spacy_tokens_for_baseline: It was my system which enabled me to find John Warner , late gardener of High Gable , sacked in a moment of temper by his imperious employer .

source_bert_toks: it was my system which enabled me to find john warner , late gardener of high gable , sacked in a moment of temper by his imp ##eri ##ous employer .

reference_raw: It was my system that allowed me to find John Warner, the late gardener of High Gable, who had been sacked in a moment of temper by his boss.

reference_spacy_tokens: It was my system that allowed me to find John Warner , the late gardener of High Gable , who had been sacked in a moment of temper by his boss .


fn_spacy_tokens_for_baseline: ' I shall stand first and foremost for the exercise of a complete and thorough boycott of the Germans as the cruellest slaughterers of innocent lives on the high seas that the world has ever known .

source_bert_toks: ' i shall stand first and foremost for the exercise of a complete and thorough boycott of the germans as the cruel ##les ##t slaughter ##ers of innocent lives on the high seas that the world has ever known .

reference_raw: I will stand first and foremost in the pursuit of a full and thorough boycott of the Germans as the cruelest assassins of innocent lives on the high seas the world has ever known.

reference_spacy_tokens: I will stand first and foremost in the pursuit of a full and thorough boycott of the Germans as the cruelest assassins of innocent lives on the high seas the world has ever known .


fn_spacy_tokens_for_baseline: On Sunday , Mrs. Gandhi accused the government of Prime Minister I.K. Gujral with trying to hush up Jain 's report .

source_bert_toks: on sunday , mrs . gandhi accused the government of prime minister i . k . gu ##j ##ral with trying to hush up jain ' s report .

reference_raw: On Sunday, Mrs. Gandhi accused Prime Minister I.K. Gujral of trying to silence Jain's report.

reference_spacy_tokens: On Sunday , Mrs. Gandhi accused Prime Minister I.K. Gujral of trying to silence Jain 's report .


fn_spacy_tokens_for_baseline: He promised a modern state for his people , but as the situation became volatile , civil strife broke out in Turkish cities , and those considered Greek were victims of threats and violence .

source_bert_toks: he promised a modern state for his people , but as the situation became volatile , civil strife broke out in turkish cities , and those considered greek were victims of threats and violence .

reference_raw: He promised his people a modern state, but as the situation became unstable, civil strife broke out in Turkey's cities, and those considered Greek to be victims of threats and violence.

reference_spacy_tokens: He promised his people a modern state , but as the situation became unstable , civil strife broke out in Turkey 's cities , and those considered Greek to be victims of threats and violence .


fn_spacy_tokens_for_baseline: The chief reason for this was that people were living longer .

source_bert_toks: the chief reason for this was that people were living longer .

reference_raw: The main reason was that people lived longer.

reference_spacy_tokens: The main reason was that people lived longer .


fn_spacy_tokens_for_baseline: What we 've had in parts of London are so called turf wars between crack crack dealers , crack sellers , fighting for territory .

source_bert_toks: what we ' ve had in parts of london are so called turf wars between crack crack dealers , crack sellers , fighting for territory .

reference_raw: What we have in parts of London is what we call turf wars between junk dealers and junk dealers who fight for territory.

reference_spacy_tokens: What we have in parts of London is what we call turf wars between junk dealers and junk dealers who fight for territory .


fn_spacy_tokens_for_baseline: Almost half of Ireland 's population is under twenty - five , and with its universities and professional schools , Dublin also has a large student population .

source_bert_toks: almost half of ireland ' s population is under twenty - five , and with its universities and professional schools , dublin also has a large student population .

reference_raw: Nearly half of the Irish population is under twenty-five, and Dublin also has a large student population with its universities and professional schools.

reference_spacy_tokens: Nearly half of the Irish population is under twenty - five , and Dublin also has a large student population with its universities and professional schools .


fn_spacy_tokens_for_baseline: In fact in - laws , and indeed kin as distant as cousins , seem commonly to be included in these employment networks .

source_bert_toks: in fact in - laws , and indeed kin as distant as cousins , seem commonly to be included in these employment networks .

reference_raw: In fact, relatives, and even relatives as distant as cousins, appear to be usually included in these employment networks.

reference_spacy_tokens: In fact , relatives , and even relatives as distant as cousins , appear to be usually included in these employment networks .


fn_spacy_tokens_for_baseline: This permitted the Anasazi to achieve a benchmark of advanced society -- the ability to live in permanent shelters year - round without need to follow wildlife .

source_bert_toks: this permitted the ana ##sa ##zi to achieve a bench ##mark of advanced society - - the ability to live in permanent shelters year - round without need to follow wildlife .

reference_raw: This allowed the Anasazi to achieve the standard of advanced society - the ability to live in permanent shelters year after year without having to follow wildlife.

reference_spacy_tokens: This allowed the Anasazi to achieve the standard of advanced society - the ability to live in permanent shelters year after year without having to follow wildlife .


fn_spacy_tokens_for_baseline: In the latter case , suicide bombers stormed the hotel , set off explosions and exchanged gunfire with Afghan security forces for hours .

source_bert_toks: in the latter case , suicide bombers stormed the hotel , set off explosions and exchanged gunfire with afghan security forces for hours .

reference_raw: In the latter case, suicide bombers stormed the hotel, detonated explosions and exchanged fire with Afghan security forces for hours.

reference_spacy_tokens: In the latter case , suicide bombers stormed the hotel , detonated explosions and exchanged fire with Afghan security forces for hours .


fn_spacy_tokens_for_baseline: I felt the temblor begin and glanced at the table next to mine , smiled that guilty smile and we both mouthed the words , " Earth - quake ! " together .

source_bert_toks: i felt the te ##mb ##lor begin and glanced at the table next to mine , smiled that guilty smile and we both mouthed the words , " earth - quake ! " together .

reference_raw: I felt the pace begin, looked at the table beside me, smiled the guilty smile, and we both said, "Earth earthquake!" together.

reference_spacy_tokens: I felt the pace begin , looked at the table beside me , smiled the guilty smile , and we both said , " Earth earthquake ! " together .


fn_spacy_tokens_for_baseline: New construction in the past 10 years has changed the city 's skyline ; with new , glittering hotels and highrise apartment blocks , the city is beginning to look a little more like Hong Kong .

source_bert_toks: new construction in the past 10 years has changed the city ' s skyline ; with new , glittering hotels and high ##rise apartment blocks , the city is beginning to look a little more like hong kong .

reference_raw: The city's skyline has changed over the last ten years; with new, shiny hotels and high-rise apartment blocks, the city is starting to look more like Hong Kong.

reference_spacy_tokens: The city 's skyline has changed over the last ten years ; with new , shiny hotels and high - rise apartment blocks , the city is starting to look more like Hong Kong .


fn_spacy_tokens_for_baseline: 2 Show the patient to his bed and ask the patient to change into nightwear .

source_bert_toks: 2 show the patient to his bed and ask the patient to change into night ##wear .

reference_raw: 2 Show the patient to his bed and ask him to change into a nightgown.

reference_spacy_tokens: 2 Show the patient to his bed and ask him to change into a nightgown .


fn_spacy_tokens_for_baseline: We are pleased to tell you of a very exciting development with the fund , which has reached a market value of $ 750,000 .

source_bert_toks: we are pleased to tell you of a very exciting development with the fund , which has reached a market value of $ 750 , 000 .

reference_raw: We are pleased to report a very exciting development with the fund, which has reached a market value of $750,000.

reference_spacy_tokens: We are pleased to report a very exciting development with the fund , which has reached a market value of $ 750,000 .


fn_spacy_tokens_for_baseline: Reflecting on the extermination of million human beings in recent times , Steiner argues that

source_bert_toks: reflecting on the ex ##ter ##mina ##tion of million human beings in recent times , steiner argues that

reference_raw: Reflecting the extinction of millions of people in recent times, Steiner argues that

reference_spacy_tokens: Reflecting the extinction of millions of people in recent times , Steiner argues that


fn_spacy_tokens_for_baseline: Barbed wire zigzagged in front of the small houses and large Alsatians snarled at strangers from behind steel fences .

source_bert_toks: barbed wire z ##ig ##za ##gged in front of the small houses and large als ##ati ##ans snarled at strangers from behind steel fences .

reference_raw: The barbed wire swung in front of the small houses, and the great Alsatians snarled at the strangers from behind the steel fences.

reference_spacy_tokens: The barbed wire swung in front of the small houses , and the great Alsatians snarled at the strangers from behind the steel fences .


fn_spacy_tokens_for_baseline: He rocked back on his heels and steadied himself .

source_bert_toks: he rocked back on his heels and ste ##adi ##ed himself .

reference_raw: He rocked back on his feet, steadying himself.

reference_spacy_tokens: He rocked back on his feet , steadying himself .


fn_spacy_tokens_for_baseline: The peppers are pulped , then left to mature for three years before being distilled with vinegar .

source_bert_toks: the peppers are pulp ##ed , then left to mature for three years before being di ##sti ##lled with vinegar .

reference_raw: The peppers are pulverized and then matured for three years before being distilled with vinegar.

reference_spacy_tokens: The peppers are pulverized and then matured for three years before being distilled with vinegar .


fn_spacy_tokens_for_baseline: China has produced and deployed a wide range of ballistic missiles , ranging from short - range missiles to intercontinental ballistic missiles ( ICBMs ) .

source_bert_toks: china has produced and deployed a wide range of ballistic missiles , ranging from short - range missiles to intercontinental ballistic missiles ( ic ##bm ##s ) .

reference_raw: China has produced and deployed a wide range of ballistic missiles, ranging from small-range to intercontinental ballistic missiles.

reference_spacy_tokens: China has produced and deployed a wide range of ballistic missiles , ranging from small - range to intercontinental ballistic missiles .


fn_spacy_tokens_for_baseline: The high quality of the seam on Milos ensured that the area remained popular with early travelers .

source_bert_toks: the high quality of the seam on milos ensured that the area remained popular with early travelers .

reference_raw: The high quality of the seam on Milos ensures that the area is still popular with early travellers.

reference_spacy_tokens: The high quality of the seam on Milos ensures that the area is still popular with early travellers .


fn_spacy_tokens_for_baseline: Occasional hurricanes can spoil the idyllic climate and contribute to this " laid back " attitude : Jamaicans are aware that circumstances can suddenly alter dramatically and yet life will always carry on .

source_bert_toks: occasional hurricanes can spoil the id ##yl ##lic climate and contribute to this " laid back " attitude : jamaican ##s are aware that circumstances can suddenly alter dramatically and yet life will always carry on .

reference_raw: Sometimes hurricanes can spoil idyllic weather and contribute to this "laid back" approach: the Jamaicans are aware that circumstances can change dramatically, but life will always continue.

reference_spacy_tokens: Sometimes hurricanes can spoil idyllic weather and contribute to this " laid back " approach : the Jamaicans are aware that circumstances can change dramatically , but life will always continue .


fn_spacy_tokens_for_baseline: However , with a vibrant grassroots culture and the growing confidence of an independent nation , it defies the advertising stereotype of the deserted island .

source_bert_toks: however , with a vibrant grassroots culture and the growing confidence of an independent nation , it def ##ies the advertising stereo ##type of the deserted island .

reference_raw: But, with a vibrant grassroots culture and increasing self-confidence of an independent nation, it defies the advertising stereotype of an abandoned island.

reference_spacy_tokens: But , with a vibrant grassroots culture and increasing self - confidence of an independent nation , it defies the advertising stereotype of an abandoned island .


reference_raw: Nearly half of the Irish population is less than 25 years old, and Dublin also has a large student population with its universities and professional schools.

reference_spacy_tokens: Nearly half of the Irish population is less than 25 years old , and Dublin also has a large student population with its universities and professional schools .


fn_spacy_tokens_for_baseline: And if I can not rid myself of it I will just have to go into the service and begin to root out the cause .

source_bert_toks: and if i can not rid myself of it i will just have to go into the service and begin to root out the cause .

reference_raw: And if I can't get away from it, I'm gonna have to go to the service and start rooting out the cause.

reference_spacy_tokens: And if I ca n't get away from it , I 'm gon na have to go to the service and start rooting out the cause .


fn_spacy_tokens_for_baseline: Brush the top of one semi - circle with apricot glaze and place the other on top to form a half - moon sandwich .

source_bert_toks: brush the top of one semi - circle with apr ##ico ##t g ##laze and place the other on top to form a half - moon sandwich .

reference_raw: Break the top of one half circle with apricot glass and place the other on top to make a half-moon sandwich.

reference_spacy_tokens: Break the top of one half circle with apricot glass and place the other on top to make a half - moon sandwich .


fn_spacy_tokens_for_baseline: I decided it was because my watering schedule was a lot like nature - - sometimes it 's dry for a couple of weeks , then it rains a lot all at once .

source_bert_toks: i decided it was because my watering schedule was a lot like nature - - sometimes it ' s dry for a couple of weeks , then it rains a lot all at once .

reference_raw: I decided it was because my watering plan was a lot like nature - sometimes it's dry for a few weeks, then it's raining a lot at once.

reference_spacy_tokens: I decided it was because my watering plan was a lot like nature - sometimes it 's dry for a few weeks , then it 's raining a lot at once .


fn_spacy_tokens_for_baseline: The idea of presenting a yearly ' report ' to the European Parliament , as the Draft Treaty suggests , is laughably inadequate , since the author of such a report could put what he liked in it .

source_bert_toks: the idea of presenting a yearly ' report ' to the european parliament , as the draft treaty suggests , is laugh ##ably inadequate , since the author of such a report could put what he liked in it .

reference_raw: The idea of presenting an annual "report" to the European Parliament, as proposed in the draft contract, is absurdly inadequate, since the author of such a report can put in what he likes.

reference_spacy_tokens: The idea of presenting an annual " report " to the European Parliament , as proposed in the draft contract , is absurdly inadequate , since the author of such a report can put in what he likes .


fn_spacy_tokens_for_baseline: Yeah there was about three kids three kids in a in one of these cupboards , and they were sniffing butane gas .

source_bert_toks: yeah there was about three kids three kids in a in one of these cupboard ##s , and they were sniffing but ##ane gas .

reference_raw: Yeah, in one of those closets, there were about three kids, three kids, smelling butane gas.

reference_spacy_tokens: Yeah , in one of those closets , there were about three kids , three kids , smelling butane gas .


fn_spacy_tokens_for_baseline: As for the red - bearded Squat who only stood waist - high to Meh'Lindi . dapper in his quilted red flak jacket , green coveralls , and forage cap , his was obviously a comically hopeless passion .

source_bert_toks: as for the red - bearded squat who only stood waist - high to me ##h ' lin ##di . da ##pper in his quilt ##ed red fl ##ak jacket , green cover ##all ##s , and for ##age cap , his was obviously a comical ##ly hopeless passion .

reference_raw: As for the red-bearded Squat, who was only waist-high to Meh'Lindi... ...dapper in a quilted red flak jacket, green jumpsuits, and a forage cap... ...he was obviously a comically hopeless passion.

reference_spacy_tokens: As for the red - bearded Squat , who was only waist - high to Meh'Lindi ... ... dapper in a quilted red flak jacket , green jumpsuits , and a forage cap ... ... he was obviously a comically hopeless passion .


fn_spacy_tokens_for_baseline: Intelligence reports regarding Iran 's expansion of capabilities and persistent interest in acquiring new technologies have led the United States to seek other options in dealing with Iran as a regional threat .

source_bert_toks: intelligence reports regarding iran ' s expansion of capabilities and persistent interest in acquiring new technologies have led the united states to seek other options in dealing with iran as a regional threat .

reference_raw: Intelligence reports on Iran's expansion of capabilities and continuing interest in acquiring new technologies have led the US to look for other options to address Iran as a regional threat.

reference_spacy_tokens: Intelligence reports on Iran 's expansion of capabilities and continuing interest in acquiring new technologies have led the US to look for other options to address Iran as a regional threat .


fn_spacy_tokens_for_baseline: The vineyard was planted by entrepreneur John Broome .

source_bert_toks: the vineyard was planted by entrepreneur john broom ##e .

reference_raw: The vineyard was set up by a businessman John Broome.

reference_spacy_tokens: The vineyard was set up by a businessman John Broome .


fn_spacy_tokens_for_baseline: Gass took over the abandoned Mormon fort and 640 acres ( 260 hectares ) surrounding it , dubbing it the Las Vegas Ranch .

source_bert_toks: gas ##s took over the abandoned mormon fort and 640 acres ( 260 hectares ) surrounding it , dub ##bing it the las vegas ranch .

reference_raw: Gass took over the abandoned fortress of Mormon and 640 acres (260 hectares) surrounding it and dubbed it to the Las Vegas ranch.

reference_spacy_tokens: Gass took over the abandoned fortress of Mormon and 640 acres ( 260 hectares ) surrounding it and dubbed it to the Las Vegas ranch .


fn_spacy_tokens_for_baseline: At about ten to nine I tethered the bike to a lamp - post and proceeded at a leisurely pace on foot to the Parsons ' .

source_bert_toks: at about ten to nine i te ##ther ##ed the bike to a lamp - post and proceeded at a leisure ##ly pace on foot to the parsons ' .

reference_raw: At about ten or nine I tied my bike to the lamppost and walked at a leisurely pace toward the Parsons.

reference_spacy_tokens: At about ten or nine I tied my bike to the lamppost and walked at a leisurely pace toward the Parsons .


fn_spacy_tokens_for_baseline: I will assume that this information satisfies your requirements , unless I hear to the contrary .

source_bert_toks: i will assume that this information sat ##is ##fies your requirements , unless i hear to the contrary .

reference_raw: If I don't hear to the contrary, I'll assume that this information meets your requirements.

reference_spacy_tokens: If I do n't hear to the contrary , I 'll assume that this information meets your requirements .


fn_spacy_tokens_for_baseline: They like to tangle their victims ' hair into elflocks , or as they are also called , tangle locks , or mare 's braids .

source_bert_toks: they like to tangle their victims ' hair into elf ##lock ##s , or as they are also called , tangle locks , or mare ' s braid ##s .

reference_raw: They like to mix their victim's hair into elflocks, or, as they call it, intricate locks or mare's braids.

reference_spacy_tokens: They like to mix their victim 's hair into elflocks , or , as they call it , intricate locks or mare 's braids .


fn_spacy_tokens_for_baseline: At St. Mary 's Church in Ilminster , Somerset , the bells have fallen silent following a dust - up over church attendance .

source_bert_toks: at st . mary ' s church in il ##minster , somerset , the bells have fallen silent following a dust - up over church attendance .

reference_raw: In the Church of Saint Mary in Ilminster, Somerset, the bells fell silent after the dust of church attendance.

reference_spacy_tokens: In the Church of Saint Mary in Ilminster , Somerset , the bells fell silent after the dust of church attendance .


fn_spacy_tokens_for_baseline: Canada 's merchandise exports and imports posted increases in February as automobile assembly lines stepped up production after shutdowns in January .

source_bert_toks: canada ' s merchandise exports and imports posted increases in february as automobile assembly lines stepped up production after shut ##down ##s in january .

reference_raw: Canada's exports and imports increased in February as car assembly lines increased production after the shutdown in January.

reference_spacy_tokens: Canada 's exports and imports increased in February as car assembly lines increased production after the shutdown in January .


fn_spacy_tokens_for_baseline: The current resurgence of local music has produced some great songs and Overspill , another group from Alton , continue the good work on their latest grunge injected collection .

source_bert_toks: the current resurgence of local music has produced some great songs and overs ##pi ##ll , another group from alton , continue the good work on their latest gr ##ung ##e injected collection .

reference_raw: The recent resurgence of local music has produced some great songs and Overspill, another group from Alton, is continuing to work well on their latest collection of grunge injections.

reference_spacy_tokens: The recent resurgence of local music has produced some great songs and Overspill , another group from Alton , is continuing to work well on their latest collection of grunge injections .


fn_spacy_tokens_for_baseline: But lacking the means to enforce its decision , the United Nations was powerless to halt the fighting that erupted as the British withdrew their troops in 1948 .

source_bert_toks: but lacking the means to enforce its decision , the united nations was powerless to halt the fighting that erupted as the british withdrew their troops in 1948 .

reference_raw: But, lacking the means to enforce its decision, the United Nations was unable to stop the battle that exploded when the British withdrew their troops in 1948.

reference_spacy_tokens: But , lacking the means to enforce its decision , the United Nations was unable to stop the battle that exploded when the British withdrew their troops in 1948 .


fn_spacy_tokens_for_baseline: His mouth was contorted in a grotesque snarl , pulling back his lips to reveal yellow teeth dripping with misdirected digestive enzyme fluids .

source_bert_toks: his mouth was con ##tort ##ed in a grotesque snarl , pulling back his lips to reveal yellow teeth dripping with mis ##di ##re ##cted digest ##ive enzyme fluids .

reference_raw: His mouth twisted in a grotesque growl, and his lips pulled back to reveal yellow teeth dripping with misdirected digestive enzyme fluids.

reference_spacy_tokens: His mouth twisted in a grotesque growl , and his lips pulled back to reveal yellow teeth dripping with misdirected digestive enzyme fluids .


fn_spacy_tokens_for_baseline: For some time , the mill stood idle and decaying , but was eventually stripped of its machinery and converted to two cottages .

source_bert_toks: for some time , the mill stood idle and decay ##ing , but was eventually stripped of its machinery and converted to two cottages .

reference_raw: For a while the mill stood idly and decaying, but at last it lost its machinery and turned into two huts.

reference_spacy_tokens: For a while the mill stood idly and decaying , but at last it lost its machinery and turned into two huts .


fn_spacy_tokens_for_baseline: Clive spilled some of the powder as he heaped it in the spoon , and could not hold it steady over his lighter flame , but finally he got it liquefied .

source_bert_toks: clive spilled some of the powder as he heap ##ed it in the spoon , and could not hold it steady over his lighter flame , but finally he got it li ##que ##fied .

reference_raw: Clive spilled some powder as he piled it into the spoon, unable to hold it steady over the lighter flame, but at last it was liquefied.

reference_spacy_tokens: Clive spilled some powder as he piled it into the spoon , unable to hold it steady over the lighter flame , but at last it was liquefied .


fn_spacy_tokens_for_baseline: We were so poor we had a chicken in the oven for Christmas , and I opened the door to see how it was doing and the fellow from next door was dipping his bread in the gravy .

source_bert_toks: we were so poor we had a chicken in the oven for christmas , and i opened the door to see how it was doing and the fellow from next door was dipping his bread in the gr ##av ##y .

reference_raw: We were so poor, we had chicken in the oven for Christmas, and I opened the door to see what was going on, and the guy next door was dipping his bread into the sauce.

reference_spacy_tokens: We were so poor , we had chicken in the oven for Christmas , and I opened the door to see what was going on , and the guy next door was dipping his bread into the sauce .


fn_spacy_tokens_for_baseline: They would then take it in turns to piece together each others jigsaw , guaranteed to keep them happy for years .

source_bert_toks: they would then take it in turns to piece together each others ji ##gs ##aw , guaranteed to keep them happy for years .

reference_raw: Then they'd take it in turn, and they'd pick up the puzzles, guaranteeing that they'd be happy for years.

reference_spacy_tokens: Then they 'd take it in turn , and they 'd pick up the puzzles , guaranteeing that they 'd be happy for years .


fn_spacy_tokens_for_baseline: He always used to wear a bowler hat and very dark clothes .

source_bert_toks: he always used to wear a bowler hat and very dark clothes .

reference_raw: He always wore a bowling hat and a very dark dress.

reference_spacy_tokens: He always wore a bowling hat and a very dark dress .


fn_spacy_tokens_for_baseline: An inquest in Wirral heard how Andrew Venables , 20 , suffered an agonizing death after having an adverse reaction to the drug .

source_bert_toks: an in ##quest in wi ##rral heard how andrew ve ##nable ##s , 20 , suffered an ago ##ni ##zing death after having an adverse reaction to the drug .

reference_raw: The Wirral investigation heard that Andrew Venables, 20 years old, had suffered a painful death after an adverse drug reaction.

reference_spacy_tokens: The Wirral investigation heard that Andrew Venables , 20 years old , had suffered a painful death after an adverse drug reaction .


fn_spacy_tokens_for_baseline: It was not impossible they planned to work some malign mischief upon himself and the gullible Mistress Sinister .

source_bert_toks: it was not impossible they planned to work some mali ##gn mischief upon himself and the gu ##lli ##ble mistress sinister .

reference_raw: It was not inconceivable that they were planning some malignant mischief on himself and the trusting Lady Sinister.

reference_spacy_tokens: It was not inconceivable that they were planning some malignant mischief on himself and the trusting Lady Sinister .


fn_spacy_tokens_for_baseline: The layout of a story ballet or ballet d'action was first conceived by John Weaver in 1717 when he did away with actors and/or singers to tell the story .

source_bert_toks: the layout of a story ballet or ballet d ' action was first conceived by john weaver in 1717 when he did away with actors and / or singers to tell the story .

reference_raw: The layout of the story ballet or ballet d'action was conceived by John Weaver for the first time in 1717, when he went to the actors and/or singers to tell the story.

reference_spacy_tokens: The layout of the story ballet or ballet d'action was conceived by John Weaver for the first time in 1717 , when he went to the actors and/or singers to tell the story .


fn_spacy_tokens_for_baseline: In a statement , Hall expressed regret over the negative impacts of the decade - old sanctions on Iraqi people .

source_bert_toks: in a statement , hall expressed regret over the negative impacts of the decade - old sanctions on iraqi people .

reference_raw: Hall expressed regret in his statement about the negative effects of decade-old sanctions on the Iraqi people.

reference_spacy_tokens: Hall expressed regret in his statement about the negative effects of decade - old sanctions on the Iraqi people .


fn_spacy_tokens_for_baseline: The theater presents " sky shows " and IMAX films .

source_bert_toks: the theater presents " sky shows " and im ##ax films .

reference_raw: The theatre presents "Sky Shows" and "IMAX" movies.

reference_spacy_tokens: The theatre presents " Sky Shows " and " IMAX " movies .


fn_spacy_tokens_for_baseline: As the double - decker boats get ready to leave the pier , bells ring , the gangplank is raised , deckhands in blue sailor suits man the hawsers , and a couple of hundred commuters begin a seven - minute sightseeing tour .

source_bert_toks: as the double - decker boats get ready to leave the pier , bells ring , the gang ##pl ##an ##k is raised , deck ##hand ##s in blue sailor suits man the ha ##ws ##ers , and a couple of hundred commuter ##s begin a seven - minute sights ##ee ##ing tour .

reference_raw: As the two deckboats prepare to leave the pier, the bells ring, the gangplank rises, the deckhands in the blue sailor suits the hawsers, and a few hundred commuters begin a seven-minute sightseeing tour.

reference_spacy_tokens: As the two deckboats prepare to leave the pier , the bells ring , the gangplank rises , the deckhands in the blue sailor suits the hawsers , and a few hundred commuters begin a seven - minute sightseeing tour .


fn_spacy_tokens_for_baseline: This study was part of an IAEA cooperative assistance project to help Syria understand the requirements for developing and maintaining a nuclear program .

source_bert_toks: this study was part of an ia ##ea cooperative assistance project to help syria understand the requirements for developing and maintaining a nuclear program .

reference_raw: The study was part of the cooperation project of the IAEA to help Syria understand the needs for the development and maintenance of the nuclear programme.

reference_spacy_tokens: The study was part of the cooperation project of the IAEA to help Syria understand the needs for the development and maintenance of the nuclear programme .


fn_spacy_tokens_for_baseline: Such transfers have resulted in numerous U.S. nonproliferation sanctions being imposed on Chinese entities .

source_bert_toks: such transfers have resulted in numerous u . s . non ##pro ##life ##ration sanctions being imposed on chinese entities .

reference_raw: These transfers led to the imposition of a number of US non-proliferation sanctions on Chinese entities.

reference_spacy_tokens: These transfers led to the imposition of a number of US non - proliferation sanctions on Chinese entities .


fn_spacy_tokens_for_baseline: He had a broad forehead , rather sallow face , and thinning hair .

source_bert_toks: he had a broad forehead , rather sal ##low face , and thin ##ning hair .

reference_raw: His brow was wide, rather sallow, and his hair was thinning.

reference_spacy_tokens: His brow was wide , rather sallow , and his hair was thinning .


fn_spacy_tokens_for_baseline: The survey also confirmed that even during the current economic climate with high interest rates , the South East remains top of the spending league .

source_bert_toks: the survey also confirmed that even during the current economic climate with high interest rates , the south east remains top of the spending league .

reference_raw: According to the survey, even in the current economic climate with high interest rates, the South East remains at the top of the spending league.

reference_spacy_tokens: According to the survey , even in the current economic climate with high interest rates , the South East remains at the top of the spending league .


fn_spacy_tokens_for_baseline: Robyn 's insides clenched into a tight ball .

source_bert_toks: robyn ' s insides clenched into a tight ball .

reference_raw: Robyn's guts tightened into a tight ball.

reference_spacy_tokens: Robyn 's guts tightened into a tight ball .


fn_spacy_tokens_for_baseline: My best friends used to twang my bra straps in front of the boys , and although I always laughed , I felt humiliated .

source_bert_toks: my best friends used to t ##wang my bra straps in front of the boys , and although i always laughed , i felt humiliated .

reference_raw: My best friends twanged bra belts in front of the boys, and even though I always laughed, I felt humiliated.

reference_spacy_tokens: My best friends twanged bra belts in front of the boys , and even though I always laughed , I felt humiliated .


fn_spacy_tokens_for_baseline: Extremely dry weather , and difficult wind conditions , have caused severe difficulties in fighting the fire .

source_bert_toks: extremely dry weather , and difficult wind conditions , have caused severe difficulties in fighting the fire .

reference_raw: Extremely dry weather and difficult wind conditions have caused serious fire-fighting problems.

reference_spacy_tokens: Extremely dry weather and difficult wind conditions have caused serious fire - fighting problems .


fn_spacy_tokens_for_baseline: You 'll have to soften it in milk .

source_bert_toks: you ' ll have to soft ##en it in milk .

reference_raw: You're going to have to make it soft with milk.

reference_spacy_tokens: You 're going to have to make it soft with milk .


fn_spacy_tokens_for_baseline: Similarly , the textural and structural elements of a space can be surveyed to reveal an intrinsic scale and intensity of energy .

source_bert_toks: similarly , the text ##ural and structural elements of a space can be surveyed to reveal an intrinsic scale and intensity of energy .

reference_raw: Similarly, the textural and structural elements of the space may be explored in order to reveal the inherent scale and strength of the energy.

reference_spacy_tokens: Similarly , the textural and structural elements of the space may be explored in order to reveal the inherent scale and strength of the energy .


fn_spacy_tokens_for_baseline: In its 19 December 2003 announcement that it was eliminating all materials , equipment and programs proscribed by the international community , Libya took the unusual step of first publicly revealing its nuclear weapons program , then renouncing it .

source_bert_toks: in its 19 december 2003 announcement that it was eliminating all materials , equipment and programs pro ##scribe ##d by the international community , libya took the unusual step of first publicly revealing its nuclear weapons program , then reno ##un ##cing it .

reference_raw: In its notification of 19 December 2003 of the elimination of all materials, equipment and programs prohibited by the international community, Libya took an unusual step to reveal its nuclear weapons program to the public and then to renounce it.

reference_spacy_tokens: In its notification of 19 December 2003 of the elimination of all materials , equipment and programs prohibited by the international community , Libya took an unusual step to reveal its nuclear weapons program to the public and then to renounce it .


fn_spacy_tokens_for_baseline: It was urged into the air again , kicking out with its back legs , seeming to hang there motionless , and then on hind legs it walked several steps forwards .

source_bert_toks: it was urged into the air again , kicking out with its back legs , seeming to hang there motionless , and then on hind legs it walked several steps forwards .

reference_raw: He was pushed back into the air, kicked out with his back legs, seemed to hang there motionless, and then walked a few steps forward on his back legs.

reference_spacy_tokens: He was pushed back into the air , kicked out with his back legs , seemed to hang there motionless , and then walked a few steps forward on his back legs .


fn_spacy_tokens_for_baseline: As she listened to the faint smack of the sea on the rocks below , she thought again , regretfully , of Angus .

source_bert_toks: as she listened to the faint smack of the sea on the rocks below , she thought again , regret ##fully , of angus .

reference_raw: As she listened to the faint slap of the sea on the rocks below, she thought regretfully of Angus again.

reference_spacy_tokens: As she listened to the faint slap of the sea on the rocks below , she thought regretfully of Angus again .


fn_spacy_tokens_for_baseline: However , there are currently around 1000 people under mandatory evacuations , and the city has been declared in a state of emergency .

source_bert_toks: however , there are currently around 1000 people under mandatory evacuation ##s , and the city has been declared in a state of emergency .

reference_raw: At present, however, about 1,000 people are being evacuated and the city has been declared to be in an emergency.

reference_spacy_tokens: At present , however , about 1,000 people are being evacuated and the city has been declared to be in an emergency .


fn_spacy_tokens_for_baseline: Skill makes men dextrous , but that does n't diminish the spectacle of a man leaping like a fox around corridors of coal too low to stand up , cramped with hydraulic props and coal - cutters .

source_bert_toks: skill makes men dex ##tro ##us , but that doesn ' t dim ##ini ##sh the spectacle of a man leaping like a fox around corridors of coal too low to stand up , cramped with hydraulic props and coal - cutter ##s .

reference_raw: Skills make men dextrous, but that does not diminish the sight of a man who jumps like a fox through coal corridors so low that he can't stand, surrounded by hydraulic props and coal-cutters.

reference_spacy_tokens: Skills make men dextrous , but that does not diminish the sight of a man who jumps like a fox through coal corridors so low that he ca n't stand , surrounded by hydraulic props and coal - cutters .


fn_spacy_tokens_for_baseline: We know that very early exposure to schooling improves performance in the first grade , but afterward the difference is quickly washed away .

source_bert_toks: we know that very early exposure to schooling improves performance in the first grade , but afterward the difference is quickly washed away .

reference_raw: We know that early exposure to education improves first-grade performance, but then the difference is quickly erased.

reference_spacy_tokens: We know that early exposure to education improves first - grade performance , but then the difference is quickly erased .


fn_spacy_tokens_for_baseline: His wife , a short , thin woman with a disagreeable face , came out to see .

source_bert_toks: his wife , a short , thin woman with a disagree ##able face , came out to see .

reference_raw: His wife, a small, thin woman with a disagreeable face, came out to look at him.

reference_spacy_tokens: His wife , a small , thin woman with a disagreeable face , came out to look at him .


fn_spacy_tokens_for_baseline: However campers should only stay for a night or two , be unobtrusive and sensitive to wildlife , and leave no litter .

source_bert_toks: however camp ##ers should only stay for a night or two , be uno ##bt ##rus ##ive and sensitive to wildlife , and leave no litter .

reference_raw: But they should only stay for one or two nights, be inconspicuous and sensitive to the wild, and leave no litter.

reference_spacy_tokens: But they should only stay for one or two nights , be inconspicuous and sensitive to the wild , and leave no litter .


fn_spacy_tokens_for_baseline: She burped , surreptitiously , lady - like , a nasty taste in her mouth .

source_bert_toks: she bu ##rp ##ed , sur ##re ##pt ##iti ##ously , lady - like , a nasty taste in her mouth .

reference_raw: She bellowed, secretly, like a lady, with a nasty taste in her mouth.

reference_spacy_tokens: She bellowed , secretly , like a lady , with a nasty taste in her mouth .


fn_spacy_tokens_for_baseline: SUMMER is n't over yet -- and next week could well be a real scorcher .

source_bert_toks: summer isn ' t over yet - - and next week could well be a real sc ##or ##cher .

reference_raw: Summer's not over yet - and next week might be a real burner.

reference_spacy_tokens: Summer 's not over yet - and next week might be a real burner .


fn_spacy_tokens_for_baseline: The Cycladic culture was influenced by societies in the east , importing the pottery wheel from Mesopotamia .

source_bert_toks: the cy ##cl ##adi ##c culture was influenced by societies in the east , import ##ing the pottery wheel from mesopotamia .

reference_raw: The Cycladic culture was influenced by companies in the eastern part, which imported ceramic wheels from Mesopotamia.

reference_spacy_tokens: The Cycladic culture was influenced by companies in the eastern part , which imported ceramic wheels from Mesopotamia .


fn_spacy_tokens_for_baseline: The basic elements of life in the Aegean began to come together as early as 5000 b.c . , and were already in place by the late Bronze Age ( c. 2700 b.c . ) .

source_bert_toks: the basic elements of life in the aegean began to come together as early as 5000 b . c . , and were already in place by the late bronze age ( c . 270 ##0 b . c . ) .

reference_raw: At the end of the Bronze Age (c. 2700 b.c.), the essential elements of life in the Aegean began to come together as early as 5,000 b.c..

reference_spacy_tokens: At the end of the Bronze Age ( c. 2700 b.c . ) , the essential elements of life in the Aegean began to come together as early as 5,000 b.c ..


fn_spacy_tokens_for_baseline: He swung around upon his kidnapper and with deadly accuracy kneed him in the groin .

source_bert_toks: he swung around upon his kidnap ##per and with deadly accuracy knee ##d him in the groin .

reference_raw: He turned on his abductor and knelt in his groin with deadly precision.

reference_spacy_tokens: He turned on his abductor and knelt in his groin with deadly precision .


fn_spacy_tokens_for_baseline: He even bleats that she did n't want to have sex with him when they were married .

source_bert_toks: he even b ##lea ##ts that she didn ' t want to have sex with him when they were married .

reference_raw: He even said she didn't want to sleep with him when they got married.

reference_spacy_tokens: He even said she did n't want to sleep with him when they got married .


fn_spacy_tokens_for_baseline: An estate agent has valued their home at seventy thousand pounds .

source_bert_toks: an estate agent has valued their home at seventy thousand pounds .

reference_raw: The realtor appreciated their house for £70,000.

reference_spacy_tokens: The realtor appreciated their house for £ 70,000 .


fn_spacy_tokens_for_baseline: It really looks the part ; the tourists know its name even before the guide can translate it .

source_bert_toks: it really looks the part ; the tourists know its name even before the guide can translate it .

reference_raw: It really looks like a part of it; tourism knows its name before it can be translated by a guide.

reference_spacy_tokens: It really looks like a part of it ; tourism knows its name before it can be translated by a guide .


fn_spacy_tokens_for_baseline: The 24 China Folk Culture Villages represent China 's ethnic variety ; they feature craftspeople in traditional costumes along with folksong and dance performances .

source_bert_toks: the 24 china folk culture villages represent china ' s ethnic variety ; they feature crafts ##pe ##ople in traditional costumes along with folks ##ong and dance performances .

reference_raw: Twenty-four Chinese folk culture villages represent a Chinese ethnic diversity; they are characterised by craftsmen in traditional costumes, along with folksong and dance performances.

reference_spacy_tokens: Twenty - four Chinese folk culture villages represent a Chinese ethnic diversity ; they are characterised by craftsmen in traditional costumes , along with folksong and dance performances .


fn_spacy_tokens_for_baseline: ' We have been given reassurances that the water is safe to drink and it was just the long hot summer but we are not so sure .

source_bert_toks: ' we have been given re ##ass ##urance ##s that the water is safe to drink and it was just the long hot summer but we are not so sure .

reference_raw: We've been assured the water is safe to drink, and it's only been a long hot summer, but we're not so sure.

reference_spacy_tokens: We 've been assured the water is safe to drink , and it 's only been a long hot summer , but we 're not so sure .


fn_spacy_tokens_for_baseline: The question can be answered by using homophones : printed words with the same pronunciations but different spellings and different meanings , such as frays and phrase .

source_bert_toks: the question can be answered by using homo ##phones : printed words with the same pronunciation ##s but different spelling ##s and different meanings , such as fray ##s and phrase .

reference_raw: The answer to this question is homophonous: printed words with the same pronunciation, but different spellings and different meanings, such as frays and phrases.

reference_spacy_tokens: The answer to this question is homophonous : printed words with the same pronunciation , but different spellings and different meanings , such as frays and phrases .


fn_spacy_tokens_for_baseline: One of the most interesting sites in the New Territories is Tai Fu Tai , another rare survivor , this one a mansion that belonged to a Confucian high official .

source_bert_toks: one of the most interesting sites in the new territories is tai fu tai , another rare survivor , this one a mansion that belonged to a con ##fu ##cian high official .

reference_raw: One of the most interesting places in the New Territories is Tai Fu Tai, another precious survivor, this one a mansion belonging to a Confucian high-ranking official.

reference_spacy_tokens: One of the most interesting places in the New Territories is Tai Fu Tai , another precious survivor , this one a mansion belonging to a Confucian high - ranking official .


fn_spacy_tokens_for_baseline: And to a former federal bomb investigator , that description suggests a powerful military - style plastic explosive C-4 that can be cut or molded into different shapes .

source_bert_toks: and to a former federal bomb investigator , that description suggests a powerful military - style plastic explosive c - 4 that can be cut or molded into different shapes .

reference_raw: And for an ex-Federal Bomb Investigator, this description indicates a powerful military-style plastic C-4 explosive that can be cut or shaped in various forms.

reference_spacy_tokens: And for an ex - Federal Bomb Investigator , this description indicates a powerful military - style plastic C-4 explosive that can be cut or shaped in various forms .


fn_spacy_tokens_for_baseline: He also witnessed cases of malnutrition and poliomyelitis that have doubled since 1990 , when U.N. imposed the sanctions against Iraq for its invasion of Kuwait , said the INA .

source_bert_toks: he also witnessed cases of mal ##nut ##rit ##ion and pol ##iom ##ye ##lit ##is that have doubled since 1990 , when u . n . imposed the sanctions against iraq for its invasion of kuwait , said the ina .

reference_raw: He also saw cases of malnutrition and poliomyelitis, which have doubled since 1990, when the UN imposed sanctions on Iraq for its invasion of Kuwait, said the INA.

reference_spacy_tokens: He also saw cases of malnutrition and poliomyelitis , which have doubled since 1990 , when the UN imposed sanctions on Iraq for its invasion of Kuwait , said the INA .


fn_spacy_tokens_for_baseline: 1- There must be time priorities .

source_bert_toks: 1 - there must be time priorities .

reference_raw: 1- There must be a time-priority.

reference_spacy_tokens: 1- There must be a time - priority .


fn_spacy_tokens_for_baseline: The dog was snarling low in its throat .

source_bert_toks: the dog was snarl ##ing low in its throat .

reference_raw: The dog growled low in its throat.

reference_spacy_tokens: The dog growled low in its throat .


fn_spacy_tokens_for_baseline: The essence of the drill was to test how quickly a mass amount of medicine and treatment could be delivered to the public .

source_bert_toks: the essence of the drill was to test how quickly a mass amount of medicine and treatment could be delivered to the public .

reference_raw: The essence of the exercise was to test how quickly the mass of medicine and treatment could be delivered to the public.

reference_spacy_tokens: The essence of the exercise was to test how quickly the mass of medicine and treatment could be delivered to the public .


fn_spacy_tokens_for_baseline: Hobbes conceived of what he called a state of nature .

source_bert_toks: ho ##bbe ##s conceived of what he called a state of nature .

reference_raw: Hobbes invented what he called a natural state.

reference_spacy_tokens: Hobbes invented what he called a natural state .


fn_spacy_tokens_for_baseline: The deer were not to be fenced out of enclosures in the forest with ' unreasonable hedges and ditches ' , unless ' the greater part of the enclosure be sown with corn ' .

source_bert_toks: the deer were not to be fence ##d out of enclosure ##s in the forest with ' unreasonable hedges and ditch ##es ' , unless ' the greater part of the enclosure be so ##wn with corn ' .

reference_raw: The deer should not have been fenced from fences in the woods with 'unreasonable fences and ditches', unless 'most of the enclosure is planted with corn'.

reference_spacy_tokens: The deer should not have been fenced from fences in the woods with ' unreasonable fences and ditches ' , unless ' most of the enclosure is planted with corn ' .


fn_spacy_tokens_for_baseline: Star Micronics now exports printers to Russia .

source_bert_toks: star micro ##nic ##s now exports printers to russia .

reference_raw: Star Micronics is now shipping printers to Russia.

reference_spacy_tokens: Star Micronics is now shipping printers to Russia .


fn_spacy_tokens_for_baseline: The maid had cleared away , and now she came out with a jug of wine and two glasses .

source_bert_toks: the maid had cleared away , and now she came out with a jug of wine and two glasses .

reference_raw: The maid had left, and now she came out with a glass of wine and two glasses.

reference_spacy_tokens: The maid had left , and now she came out with a glass of wine and two glasses .


fn_spacy_tokens_for_baseline: So in theory a computer , by comparing the pattern of voltages registered by the voltmeters at all the portholes , could calculate the pattern of obstacles around the fish .

source_bert_toks: so in theory a computer , by comparing the pattern of voltage ##s registered by the vol ##tm ##eter ##s at all the port ##holes , could calculate the pattern of obstacles around the fish .

reference_raw: So, theoretically, a computer can calculate the pattern of obstacles around fish by comparing the voltage patterns recorded by the voltmeters in all the windows.

reference_spacy_tokens: So , theoretically , a computer can calculate the pattern of obstacles around fish by comparing the voltage patterns recorded by the voltmeters in all the windows .


fn_spacy_tokens_for_baseline: Unhappily , Murillo heard of his excellence , recalled him on some pretext , and had him shot .

source_bert_toks: un ##ha ##pp ##ily , mu ##rill ##o heard of his excellence , recalled him on some pre ##text , and had him shot .

reference_raw: Unfortunately, Murillo had heard of his perfection, recalled him under some pretext, and had him shot.

reference_spacy_tokens: Unfortunately , Murillo had heard of his perfection , recalled him under some pretext , and had him shot .


fn_spacy_tokens_for_baseline: It is also reported that shipments of CW agents are conducted in such a way so as not to attract undue attention , and are camouflaged as ordinary military cargo .

source_bert_toks: it is also reported that shipments of cw agents are conducted in such a way so as not to attract und ##ue attention , and are camouflage ##d as ordinary military cargo .

reference_raw: It is also reported that consignments of CW agents are carried out in such a way that they do not attract undue attention and are disguised as ordinary military cargo.

reference_spacy_tokens: It is also reported that consignments of CW agents are carried out in such a way that they do not attract undue attention and are disguised as ordinary military cargo .


fn_spacy_tokens_for_baseline: It stated , rather that homosexuality was merely a difference in the opinion and values of the common person , but must still be respected as an individual orientation , and thus treated as one ( Resolution on Appropriate Therapeutic Responses to Sexual Orientation ) .

source_bert_toks: it stated , rather that homosexuality was merely a difference in the opinion and values of the common person , but must still be respected as an individual orientation , and thus treated as one ( resolution on appropriate therapeutic responses to sexual orientation ) .

reference_raw: On the contrary, it stated that homosexuality is only a difference in the opinion and values of a single person, but it must still be respected as an individual orientation and therefore treated as such (resolution on appropriate therapeutic responses to sexual orientation).

reference_spacy_tokens: On the contrary , it stated that homosexuality is only a difference in the opinion and values of a single person , but it must still be respected as an individual orientation and therefore treated as such ( resolution on appropriate therapeutic responses to sexual orientation ) .


fn_spacy_tokens_for_baseline: David felt too enervated to resist .

source_bert_toks: david felt too en ##er ##vate ##d to resist .

reference_raw: David was too excited to resist.

reference_spacy_tokens: David was too excited to resist .


fn_spacy_tokens_for_baseline: Stores do not open until 10 am or later , but shopping goes on into the evening , up to 9:30 pm .

source_bert_toks: stores do not open until 10 am or later , but shopping goes on into the evening , up to 9 : 30 pm .

reference_raw: The shops will not be opened until 10 in the morning or later, but the shopping will continue until 9:30 in the evening.

reference_spacy_tokens: The shops will not be opened until 10 in the morning or later , but the shopping will continue until 9:30 in the evening .


fn_spacy_tokens_for_baseline: The flat was seven flights up , and Winston , who was thirty - nine and had a varicose ulcer above his right ankle , went slowly , resting several times on the way .

source_bert_toks: the flat was seven flights up , and winston , who was thirty - nine and had a var ##ico ##se ul ##cer above his right ankle , went slowly , resting several times on the way .

reference_raw: The apartment was seven floors up, and Winston, who was thirty-nine and had a varicose ulcer over his right ankle, walked slowly and rested several times along the way.

reference_spacy_tokens: The apartment was seven floors up , and Winston , who was thirty - nine and had a varicose ulcer over his right ankle , walked slowly and rested several times along the way .


fn_spacy_tokens_for_baseline: Heat the butter and oil in a large , heavy based frying pan , then fry the sausage , peppers and garlic for 5 minutes until softened .

source_bert_toks: heat the butter and oil in a large , heavy based fry ##ing pan , then fry the sausage , peppers and garlic for 5 minutes until softened .

reference_raw: Heat the butter and oil in a large, heavy-breeding pan, then roast sausages, peppers and garlic for five minutes before softening.

reference_spacy_tokens: Heat the butter and oil in a large , heavy - breeding pan , then roast sausages , peppers and garlic for five minutes before softening .


fn_spacy_tokens_for_baseline: In fact , nearly half found their dependence on skilled labour had actually increased , suggesting that the ' deskilling ' effect of new technology may have been exaggerated .

source_bert_toks: in fact , nearly half found their dependence on skilled labour had actually increased , suggesting that the ' desk ##ill ##ing ' effect of new technology may have been exaggerated .

reference_raw: In fact, almost half of them found that their dependency on skilled work had actually increased, suggesting that the "deskilling" effect of new technologies might have been exaggerated.

reference_spacy_tokens: In fact , almost half of them found that their dependency on skilled work had actually increased , suggesting that the " deskilling " effect of new technologies might have been exaggerated .


fn_spacy_tokens_for_baseline: She lowered herself further down into the gully , and urinated on the ground .

source_bert_toks: she lowered herself further down into the gu ##lly , and ur ##inated on the ground .

reference_raw: She sank deeper into the ravine and urinated on the floor.

reference_spacy_tokens: She sank deeper into the ravine and urinated on the floor .


fn_spacy_tokens_for_baseline: They spend most of their time traveling to housing camps - few workers own cars - and setting up presentations in schools and community centers .

source_bert_toks: they spend most of their time traveling to housing camps - few workers own cars - and setting up presentations in schools and community centers .

reference_raw: They spend most of their time traveling to housing camps - few workers own cars - and making presentations at schools and community centers.

reference_spacy_tokens: They spend most of their time traveling to housing camps - few workers own cars - and making presentations at schools and community centers .


fn_spacy_tokens_for_baseline: Typical of artists to read nothing except what they happen upon and then to pontificate about life and art and the way the world is going .

source_bert_toks: typical of artists to read nothing except what they happen upon and then to pont ##ific ##ate about life and art and the way the world is going .

reference_raw: It's typical of artists to read nothing but what happens on and off about life and art and the way the world goes.

reference_spacy_tokens: It 's typical of artists to read nothing but what happens on and off about life and art and the way the world goes .


fn_spacy_tokens_for_baseline: as tall as a palm tree and perfectly black [ with ] one eye which flamed like a burning coal in the middle of his forehead .

source_bert_toks: as tall as a palm tree and perfectly black [ with ] one eye which flame ##d like a burning coal in the middle of his forehead .

reference_raw: As tall as a palm tree and perfectly black [with] one eye that burned like a burning coal in the center of his forehead.

reference_spacy_tokens: As tall as a palm tree and perfectly black [ with ] one eye that burned like a burning coal in the center of his forehead .


fn_spacy_tokens_for_baseline: One possibility is that the MIDAS site serves to attach protein ligands through a mechanism involving participation of a glutamate or aspartate residue on the ligand in the coordination of a Mg 2+ion at the MIDAS site of midasin , in a manner similar to that by which the MIDAS site in integrin I - domains appears to mediate attachment of collagen through the glutamate in the GFOGER binding motif [ 36]. Interestingly , the related RGE ligand - binding motif [ 41 ] occurs in a conserved region of the midasin AAA - domain ( yeast , residues 1835 - 1838 ) , as well as in the AAA -domain of Mg chelatases [ 32]. The presence of this consensus binding motif in the AAA domain raises the possibility of the midasin molecule folding back onto itself , with the M - domain becoming attached to one face of the AAA domain and perhaps regulating access to its central chamber , in a manner analogous to that in which the 19S proteasome regulator , also an AAA protein , controls access to the central proteolytic chamber of the proteasome [ 42].

source_bert_toks: one possibility is that the mid ##as site serves to attach protein ligand ##s through a mechanism involving participation of a g ##lu ##tama ##te or as ##par ##tate residue on the ligand in the coordination of a mg 2 + ion at the mid ##as site of mid ##asi ##n , in a manner similar to that by which the mid ##as site in int ##eg ##rin i - domains appears to media ##te attachment of col ##lage ##n through the g ##lu ##tama ##te in the g ##fo ##ger binding motif [ 36 ] . interesting ##ly , the related r ##ge ligand - binding motif [ 41 ] occurs in a conserved region of the mid ##asi ##n aaa - domain ( yeast , residues 1835 - 1838 ) , as well as in the aaa - domain of mg che ##lat ##ase ##s [ 32 ] . the presence of this consensus binding motif in the aaa domain raises the possibility of the mid ##asi ##n molecule folding back onto itself , with the m - domain becoming attached to one face of the aaa domain and perhaps regulating access to its central chamber , in a manner analogous to that in which the 19 ##s pro ##tea ##some regulator , also an aaa protein , controls access to the central pro ##te ##ol ##ytic chamber of the pro ##tea ##some [ 42 ] .

reference_raw: One possibility is that the MIDAS site is used to attach protein ligands by means of a mechanism involving the involvement of glutamate or aspartate residues in the ligand in the coordination of Mg 2+ion at the MIDAS site of midasin, in a way similar to that by which the MIDAS site in integrin I domains appears to mediate the attachment of collagen via glutamate in G. Interestingly, the associated RGE ligand binding motif [41] is located in the conserved area of the midasin AAA domain (yeast, residues 1835-1838) and in the AAA-domain of Mg chelatases[32]. increases the possibility that the midasin molecule re-assembles itself and that the M-domain is attached to one side of the AAA domain and possibly regulates access to its central chamber in a way similar to that in which the 19S protein regulator, also the AAA protein, controls access to the central proteolytic chamber of the proteasome [42].

reference_spacy_tokens: One possibility is that the MIDAS site is used to attach protein ligands by means of a mechanism involving the involvement of glutamate or aspartate residues in the ligand in the coordination of Mg 2+ion at the MIDAS site of midasin , in a way similar to that by which the MIDAS site in integrin I domains appears to mediate the attachment of collagen via glutamate in G. Interestingly , the associated RGE ligand binding motif [ 41 ] is located in the conserved area of the midasin AAA domain ( yeast , residues 1835 - 1838 ) and in the AAA - domain of Mg chelatases[32]. increases the possibility that the midasin molecule re - assembles itself and that the M - domain is attached to one side of the AAA domain and possibly regulates access to its central chamber in a way similar to that in which the 19S protein regulator , also the AAA protein , controls access to the central proteolytic chamber of the proteasome [ 42].


fn_spacy_tokens_for_baseline: The Premier League 's leading scorer underwent immediate treatment after clocking up his 22nd goal of the season for Blackburn , who face Ipswich today .

source_bert_toks: the premier league ' s leading scorer underwent immediate treatment after clock ##ing up his 22nd goal of the season for blackburn , who face ipswich today .

reference_raw: The leading scorer in the Premier League went through immediate therapy after the 22nd target of Blackburn, who is now facing Ipswich.

reference_spacy_tokens: The leading scorer in the Premier League went through immediate therapy after the 22nd target of Blackburn , who is now facing Ipswich .


fn_spacy_tokens_for_baseline: He chuckled as he exhaled cigarette smoke across the space between us .

source_bert_toks: he chuckled as he exhaled cigarette smoke across the space between us .

reference_raw: He laughed and blew cigarette smoke through the space between us.

reference_spacy_tokens: He laughed and blew cigarette smoke through the space between us .


fn_spacy_tokens_for_baseline: He then began to tell his trademark joke .

source_bert_toks: he then began to tell his trademark joke .

reference_raw: Then he began to tell his trade mark joke.

reference_spacy_tokens: Then he began to tell his trade mark joke .


fn_spacy_tokens_for_baseline: He went to Poole , where my Aunt and her family lived and , on one occasion walked down the High Street wearing Chinese garb and sporting a pigtail .

source_bert_toks: he went to poole , where my aunt and her family lived and , on one occasion walked down the high street wearing chinese ga ##rb and sporting a pig ##tail .

reference_raw: He went to Poole, where my aunt and her family lived, and on one occasion he went down High Street, dressed in Chinese clothes and sporting a pig-tail.

reference_spacy_tokens: He went to Poole , where my aunt and her family lived , and on one occasion he went down High Street , dressed in Chinese clothes and sporting a pig - tail .


fn_spacy_tokens_for_baseline: ' Zambia exhaled a plume of smoke , tossed hir head and extended a hand .

source_bert_toks: ' zambia exhaled a plume of smoke , tossed hi ##r head and extended a hand .

reference_raw: Zambia blew out a cloud of smoke, shook his head, and held out his hand.

reference_spacy_tokens: Zambia blew out a cloud of smoke , shook his head , and held out his hand .


fn_spacy_tokens_for_baseline: All the denunciations of a property tax could just about be accommodated , but how were the Government to overcome the whole rationale of the ill - fated poll tax experiment , the supposed unacceptability of the rates ?

source_bert_toks: all the den ##unciation ##s of a property tax could just about be accommodated , but how were the government to overcome the whole rational ##e of the ill - fated poll tax experiment , the supposed una ##cc ##ept ##ability of the rates ?

reference_raw: All denouncing of the property tax might almost have been acceptable, but how could the government have overcome the whole reason for the ill-fated poll tax experiment, the alleged inacceptability of the rates?

reference_spacy_tokens: All denouncing of the property tax might almost have been acceptable , but how could the government have overcome the whole reason for the ill - fated poll tax experiment , the alleged inacceptability of the rates ?


fn_spacy_tokens_for_baseline: Two firefighters were injured while fighting the fire and were transported to Erie County Medical Center , " said Division Fire Chief Thomas Ashe who also said that sections of the kitchen wall at the back of the house had to be torn out to stop the fire from spreading through the walls .

source_bert_toks: two firefighters were injured while fighting the fire and were transported to erie county medical center , " said division fire chief thomas ashe who also said that sections of the kitchen wall at the back of the house had to be torn out to stop the fire from spreading through the walls .

reference_raw: Two firemen were injured in a firefight and transported to the Erie County Medical Center," said Division Fire Chief Thomas Ashe, who also said that sections of the kitchen wall in the back of the house had to be torn apart to prevent the fire from spreading through the walls.

reference_spacy_tokens: Two firemen were injured in a firefight and transported to the Erie County Medical Center , " said Division Fire Chief Thomas Ashe , who also said that sections of the kitchen wall in the back of the house had to be torn apart to prevent the fire from spreading through the walls .


fn_spacy_tokens_for_baseline: that a kid that 's just a question of maturity or is he problem child but teachers are asked to diagnose so much

source_bert_toks: that a kid that ' s just a question of maturity or is he problem child but teachers are asked to dia ##gno ##se so much

reference_raw: that a child who is only a matter of adulthood or is troubled by a child, but teachers are asked to diagnose so much

reference_spacy_tokens: that a child who is only a matter of adulthood or is troubled by a child , but teachers are asked to diagnose so much


fn_spacy_tokens_for_baseline: Her colleague 's fairy costume had been badly injured by an admirer who had sat on it .

source_bert_toks: her colleague ' s fairy costume had been badly injured by an admire ##r who had sat on it .

reference_raw: Her co-worker's fairy suit was badly wounded by an admirer sitting on it.

reference_spacy_tokens: Her co - worker 's fairy suit was badly wounded by an admirer sitting on it .


fn_spacy_tokens_for_baseline: She was endangering my future , my career and freedom . '

source_bert_toks: she was end ##anger ##ing my future , my career and freedom . '

reference_raw: It threatened my future, my career, and my freedom.'

reference_spacy_tokens: It threatened my future , my career , and my freedom . '


fn_spacy_tokens_for_baseline: Then he became instrumental in a signal deliverance for his country .

source_bert_toks: then he became instrumental in a signal deliver ##ance for his country .

reference_raw: Then he helped deliver the signal to his country.

reference_spacy_tokens: Then he helped deliver the signal to his country .


fn_spacy_tokens_for_baseline: In the rucksack in which she seemed to keep half her life she burrowed and came up with a biro and writing - pad .

source_bert_toks: in the ru ##cks ##ack in which she seemed to keep half her life she burr ##owed and came up with a bi ##ro and writing - pad .

reference_raw: She buried herself in the backpack, where she seemed to hold on to half her life, and came up with a biro and a paper.

reference_spacy_tokens: She buried herself in the backpack , where she seemed to hold on to half her life , and came up with a biro and a paper .


fn_spacy_tokens_for_baseline: Police say a stolen lorry which had four foot long spikes welded to the back was probably going to be used in a ram raid .

source_bert_toks: police say a stolen lo ##rry which had four foot long spikes welded to the back was probably going to be used in a ram raid .

reference_raw: According to the police, a stolen truck with four-foot-long spikes wedged in the back probably would have been used in a ram raid.

reference_spacy_tokens: According to the police , a stolen truck with four - foot - long spikes wedged in the back probably would have been used in a ram raid .


fn_spacy_tokens_for_baseline: Chief executive Derek Hunt said : ' We have a high regard for Carpertright and a good commercial relationship with the company , which we expect to continue . '

source_bert_toks: chief executive derek hunt said : ' we have a high regard for carp ##ert ##right and a good commercial relationship with the company , which we expect to continue . '

reference_raw: Director Derek Hunt said, "We have a great deal of respect for Carpertright and a good business relationship with the company that we expect to continue."

reference_spacy_tokens: Director Derek Hunt said , " We have a great deal of respect for Carpertright and a good business relationship with the company that we expect to continue . "


fn_spacy_tokens_for_baseline: What happened next would mark the end of the successful Las Vegas Ranch and the beginning of the era of the subdivision seen across almost all of Western America to this day .

source_bert_toks: what happened next would mark the end of the successful las vegas ranch and the beginning of the era of the subdivision seen across almost all of western america to this day .

reference_raw: What happened next would mark the end of the successful Las Vegas ranch and the beginning of the era of subdivision that had been seen so far in nearly all of West America.

reference_spacy_tokens: What happened next would mark the end of the successful Las Vegas ranch and the beginning of the era of subdivision that had been seen so far in nearly all of West America .


fn_spacy_tokens_for_baseline: And there are a lot of people who face these challenges every day of their lives .

source_bert_toks: and there are a lot of people who face these challenges every day of their lives .

reference_raw: And there's a lot of people who deal with these challenges every day of their lives.

reference_spacy_tokens: And there 's a lot of people who deal with these challenges every day of their lives .


fn_spacy_tokens_for_baseline: A simple economic theory may provide at least a partial explanation for the split personality displayed by Americans in the voting booth .

source_bert_toks: a simple economic theory may provide at least a partial explanation for the split personality displayed by americans in the voting booth .

reference_raw: A simple economic theory can provide at least a partial explanation of the divided personality that Americans show in the voting booth.

reference_spacy_tokens: A simple economic theory can provide at least a partial explanation of the divided personality that Americans show in the voting booth .


fn_spacy_tokens_for_baseline: New Zealand says he 's an embezzler .

source_bert_toks: new zealand says he ' s an em ##be ##zzle ##r .

reference_raw: New Zealand says he's a fraud.

reference_spacy_tokens: New Zealand says he 's a fraud .


fn_spacy_tokens_for_baseline: 6:50 a.m. CAROLG : I was just sitting down to meet with some new therapy clients , a couple , and the building started shaking like crazy .

source_bert_toks: 6 : 50 a . m . carol ##g : i was just sitting down to meet with some new therapy clients , a couple , and the building started shaking like crazy .

reference_raw: 6:50 in the morning, I was sitting down to meet some new therapists, a couple, and the building started to shake like a madman.

reference_spacy_tokens: 6:50 in the morning , I was sitting down to meet some new therapists , a couple , and the building started to shake like a madman .


fn_spacy_tokens_for_baseline: Jerusalem 's physical existence as a spiritual city seemed finished , but its spiritual power for Jews , and for the struggling new Christian religion , remained .

source_bert_toks: jerusalem ' s physical existence as a spiritual city seemed finished , but its spiritual power for jews , and for the struggling new christian religion , remained .

reference_raw: The physical existence of Jerusalem as a spiritual city seemed to be over, but its spiritual strength remained for the Jews and the struggling new Christian religion.

reference_spacy_tokens: The physical existence of Jerusalem as a spiritual city seemed to be over , but its spiritual strength remained for the Jews and the struggling new Christian religion .


fn_spacy_tokens_for_baseline: Additionally , Las Vegas had been made a part of Nevada 's new Clark County in 1909 , a year when the legislature also outlawed gambling .

source_bert_toks: additionally , las vegas had been made a part of nevada ' s new clark county in 1909 , a year when the legislature also outlawed gambling .

reference_raw: In addition, Las Vegas became part of the new Clark County of Nevada in 1909, a year when the legislature also banned gambling.

reference_spacy_tokens: In addition , Las Vegas became part of the new Clark County of Nevada in 1909 , a year when the legislature also banned gambling .


fn_spacy_tokens_for_baseline: Ed_Henry : Democrats say they also want to signal they 're ready to stand up to the Republican majority and may even filibuster the president 's latest Supreme Court pick Samuel Alito a move that would make these events seem like the opening fireworks in a much nastier battle .

source_bert_toks: ed _ henry : democrats say they also want to signal they ' re ready to stand up to the republican majority and may even fi ##lib ##ust ##er the president ' s latest supreme court pick samuel ali ##to a move that would make these events seem like the opening fireworks in a much nas ##tier battle .

reference_raw: Ed_Henry: Democrats say that they also want to signal that they are ready to face the Republican majority, and that they may even filibuster the President's last Supreme Court of the President's choice of Samuel Alito to make these events look like the opening of fireworks in a much nastier battle.

reference_spacy_tokens: Ed_Henry : Democrats say that they also want to signal that they are ready to face the Republican majority , and that they may even filibuster the President 's last Supreme Court of the President 's choice of Samuel Alito to make these events look like the opening of fireworks in a much nastier battle .


fn_spacy_tokens_for_baseline: The morally estimable act of exposing to us the worst in ourselves nearly always has something morally equivocal about it .

source_bert_toks: the morally est ##ima ##ble act of exposing to us the worst in ourselves nearly always has something morally e ##qui ##vo ##cal about it .

reference_raw: The morally estimate act of revealing to us the worst in ourselves almost always has something morally equivocal about it.

reference_spacy_tokens: The morally estimate act of revealing to us the worst in ourselves almost always has something morally equivocal about it .


fn_spacy_tokens_for_baseline: Sue the commissioner for unlawful arrest or something like that . '

source_bert_toks: sue the commissioner for unlawful arrest or something like that . '

reference_raw: "Sue the Commissioner for illegal arrest or something."

reference_spacy_tokens: " Sue the Commissioner for illegal arrest or something . "


fn_spacy_tokens_for_baseline: With an abstracted look , she removed her sweater and brassiere .

source_bert_toks: with an abstract ##ed look , she removed her sweater and brass ##iere .

reference_raw: She took off her sweater and brassiere with an abstract look.

reference_spacy_tokens: She took off her sweater and brassiere with an abstract look .


fn_spacy_tokens_for_baseline: If any readers also have the Japanese games machine ' INueNDO ' they will probably buy that mag which is Total crap .

source_bert_toks: if any readers also have the japanese games machine ' in ##uen ##do ' they will probably buy that mag which is total crap .

reference_raw: If any reader has a Japanese game machine called INUENDO, they'll probably buy it, which is Total bullshit.

reference_spacy_tokens: If any reader has a Japanese game machine called INUENDO , they 'll probably buy it , which is Total bullshit .


fn_spacy_tokens_for_baseline: The Phantom Menace : A film with half a plot , no engaging characters to speak of , and actors who speak in inhibited - zombie monotones as if the director had warned them to keep quiet while someone on the set took a nap .

source_bert_toks: the phantom menace : a film with half a plot , no engaging characters to speak of , and actors who speak in inhibit ##ed - zombie mono ##tones as if the director had warned them to keep quiet while someone on the set took a nap .

reference_raw: The Phantom Menace: a movie with half a plot, no engaging characters to talk about, and actors talking in suppressed - zombie monotones, as if the director had warned them to shut up while someone on the scene was taking a nap.

reference_spacy_tokens: The Phantom Menace : a movie with half a plot , no engaging characters to talk about , and actors talking in suppressed - zombie monotones , as if the director had warned them to shut up while someone on the scene was taking a nap .


fn_spacy_tokens_for_baseline: During the great party rallies at Nuremberg Himmler and the SS hierarchy rode through the streets on horseback , dressed in the full regalia of Teutonic knights .

source_bert_toks: during the great party rallies at nuremberg him ##mler and the ss hierarchy rode through the streets on horseback , dressed in the full regal ##ia of te ##uto ##nic knights .

reference_raw: During the great party gatherings in Nuremberg Himmler and the SS hierarchy rode the streets on horseback, dressed in the full regal of Teutonic Knights.

reference_spacy_tokens: During the great party gatherings in Nuremberg Himmler and the SS hierarchy rode the streets on horseback , dressed in the full regal of Teutonic Knights .


fn_spacy_tokens_for_baseline: ' Kindly desist !

source_bert_toks: ' kindly des ##ist !

reference_raw: 'Kindly resist!

reference_spacy_tokens: ' Kindly resist !


fn_spacy_tokens_for_baseline: I should be glad to be able to say afterwards that I had solved it without your help . '

source_bert_toks: i should be glad to be able to say afterwards that i had solved it without your help . '

reference_raw: I'd like to say later that I've solved this without your help.'

reference_spacy_tokens: I 'd like to say later that I 've solved this without your help . '


fn_spacy_tokens_for_baseline: Firemen had to wait for the mains to be turned off before engineers could cap the broken pipe .

source_bert_toks: fire ##men had to wait for the main ##s to be turned off before engineers could cap the broken pipe .

reference_raw: The firemen had to wait until the mains were shut down before the engineers could catch the broken pipe.

reference_spacy_tokens: The firemen had to wait until the mains were shut down before the engineers could catch the broken pipe .


fn_spacy_tokens_for_baseline: Knighton remained ummoved as the money rolled out , Ferguson paying more than £ 4 m for Gary Pallister , Paul Ince and Danny Wallace .

source_bert_toks: knight ##on remained umm ##ove ##d as the money rolled out , ferguson paying more than £ ##4 ##m for gary pal ##list ##er , paul inc ##e and danny wallace .

reference_raw: When the money went out, Knighton remained suspended, and Ferguson paid over four million pounds to Gary Pallister, Paul Ince, and Danny Wallace.

reference_spacy_tokens: When the money went out , Knighton remained suspended , and Ferguson paid over four million pounds to Gary Pallister , Paul Ince , and Danny Wallace .


fn_spacy_tokens_for_baseline: Fresh water from tropical storms feeds 120 rivers and some of the most celebrated waterfalls and cascades on earth .

source_bert_toks: fresh water from tropical storms feeds 120 rivers and some of the most celebrated waterfalls and cascade ##s on earth .

reference_raw: Fresh water from tropical storms feeds 120 rivers and some of the most famous waterfalls and waterfalls in the world.

reference_spacy_tokens: Fresh water from tropical storms feeds 120 rivers and some of the most famous waterfalls and waterfalls in the world .


fn_spacy_tokens_for_baseline: ' He 's the one who 's always covered in snuff .

source_bert_toks: ' he ' s the one who ' s always covered in s ##nu ##ff .

reference_raw: 'He's the one who's always smothered.

reference_spacy_tokens: ' He 's the one who 's always smothered .


fn_spacy_tokens_for_baseline: If , you study the evidences and statements released by these people , we tend to appreciate their ignorance which was based on prominent views .

source_bert_toks: if , you study the evidence ##s and statements released by these people , we tend to appreciate their ignorance which was based on prominent views .

reference_raw: When you study the evidence and statements released by these people, we tend to appreciate their ignorance, which is based on strong opinions.

reference_spacy_tokens: When you study the evidence and statements released by these people , we tend to appreciate their ignorance , which is based on strong opinions .


fn_spacy_tokens_for_baseline: It did n't take him long , and all she wanted were her books and all the time the mother was crying and rocking backwards and forwards and the old father was ranting on in Yiddish .

source_bert_toks: it didn ' t take him long , and all she wanted were her books and all the time the mother was crying and rocking backwards and forwards and the old father was ran ##ting on in yiddish .

reference_raw: It didn't take him long, and all she wanted was her books, and all the time her mother cried and rocked back and forth, and her father ran on in Yiddish.

reference_spacy_tokens: It did n't take him long , and all she wanted was her books , and all the time her mother cried and rocked back and forth , and her father ran on in Yiddish .


fn_spacy_tokens_for_baseline: Why did the equally conservative Richard Gid Powers call Heilbrunn 's accusations against Yale " absurd " and existing " only in the minds of the pathologically suspicious " on the same page ?

source_bert_toks: why did the equally conservative richard gi ##d powers call he ##il ##br ##un ##n ' s accusations against yale " absurd " and existing " only in the minds of the path ##ological ##ly suspicious " on the same page ?

reference_raw: Why did the equally conservative Richard Gid Powers call Heilbrunn's allegations against Yale "abomination" and the existence of "only in the pathological suspicions" on the same page?

reference_spacy_tokens: Why did the equally conservative Richard Gid Powers call Heilbrunn 's allegations against Yale " abomination " and the existence of " only in the pathological suspicions " on the same page ?


fn_spacy_tokens_for_baseline: Each salmon remembers the precise taste of the waters in which it hatched , a flavour derived from the mix of minerals in its mud and the plants and animals that live in it .

source_bert_toks: each salmon remembers the precise taste of the waters in which it hatch ##ed , a flavour derived from the mix of minerals in its mud and the plants and animals that live in it .

reference_raw: Each salmon remembers the exact flavour of the water in which it was hatched, the flavour of the mixture of minerals in its mud and of the plants and animals in it.

reference_spacy_tokens: Each salmon remembers the exact flavour of the water in which it was hatched , the flavour of the mixture of minerals in its mud and of the plants and animals in it .


fn_spacy_tokens_for_baseline: It must be wonderful , watching the world float by while you eat lobster and drink champagne .

source_bert_toks: it must be wonderful , watching the world float by while you eat lobster and drink champagne .

reference_raw: It must be wonderful to watch the world go by while you're eating lobs and drinking champagne.

reference_spacy_tokens: It must be wonderful to watch the world go by while you 're eating lobs and drinking champagne .


fn_spacy_tokens_for_baseline: So the shift in the image of Gates has been an interesting one for me to watch .

source_bert_toks: so the shift in the image of gates has been an interesting one for me to watch .

reference_raw: So the change in Gates' image was interesting for me to see.

reference_spacy_tokens: So the change in Gates ' image was interesting for me to see .


fn_spacy_tokens_for_baseline: But before falling in love with Lucy , she was not the type to lie awake , miss meals , weep , miss work , lose weight , have eczema , fall asleep with the light and fire blazing , feel hopeless , feel that everything was more or less meaningless , be unable to cope .

source_bert_toks: but before falling in love with lucy , she was not the type to lie awake , miss meals , weep , miss work , lose weight , have ec ##ze ##ma , fall asleep with the light and fire blazing , feel hopeless , feel that everything was more or less meaningless , be unable to cope .

reference_raw: But before she fell in love with Lucy, she wasn't the type to lie awake, to miss food, to cry, to miss work, to lose weight, to have eczema, to sleep with the light and fire burning, to feel hopeless, to feel that everything was more or less meaningless, to be unable to deal with.

reference_spacy_tokens: But before she fell in love with Lucy , she was n't the type to lie awake , to miss food , to cry , to miss work , to lose weight , to have eczema , to sleep with the light and fire burning , to feel hopeless , to feel that everything was more or less meaningless , to be unable to deal with .


fn_spacy_tokens_for_baseline: Turned out that some well - meaning wally had given it a tankful of unleaded two - star .

source_bert_toks: turned out that some well - meaning wally had given it a tank ##ful of un ##lea ##ded two - star .

reference_raw: Turns out some well-meaning wally gave him a tank full of unleaded two-stars.

reference_spacy_tokens: Turns out some well - meaning wally gave him a tank full of unleaded two - stars .


fn_spacy_tokens_for_baseline: ' We alighted at the morgue .

source_bert_toks: ' we ali ##ght ##ed at the mor ##gue .

reference_raw: 'We set fire to the morgue.

reference_spacy_tokens: ' We set fire to the morgue .


fn_spacy_tokens_for_baseline: GMB boss John Edmonds lashed the banks for joining in speculators ' attacks on the pound .

source_bert_toks: gm ##b boss john edmond ##s lashed the banks for joining in spec ##ulator ##s ' attacks on the pound .

reference_raw: GMB boss John Edmonds was whipping banks to join the speculators' attacks on the pound.

reference_spacy_tokens: GMB boss John Edmonds was whipping banks to join the speculators ' attacks on the pound .


fn_spacy_tokens_for_baseline: The law does not seek to prohibit all asymmetric trades ( trades where one party has more information than another ) ; nor should it .

source_bert_toks: the law does not seek to prohibit all as ##ym ##metric trades ( trades where one party has more information than another ) ; nor should it .

reference_raw: The law does not seek to forbid all asymmetric trades (trades where one party has more information than the other); nor should it.

reference_spacy_tokens: The law does not seek to forbid all asymmetric trades ( trades where one party has more information than the other ) ; nor should it .


fn_spacy_tokens_for_baseline: Brian ( twelve , knock - kneed and beginning to sprout acne ) has the unshakable conviction that you 're panting to hear the entire plot of last night 's horror movie .

source_bert_toks: brian ( twelve , knock - knee ##d and beginning to sp ##rou ##t ac ##ne ) has the un ##sha ##ka ##ble conviction that you ' re panting to hear the entire plot of last night ' s horror movie .

reference_raw: Brian (twelves, knocks, and starts to grow acne) has an unshakable conviction that you are panting to hear the whole plot of last night's horror film.

reference_spacy_tokens: Brian ( twelves , knocks , and starts to grow acne ) has an unshakable conviction that you are panting to hear the whole plot of last night 's horror film .


fn_spacy_tokens_for_baseline: I do not know whether admissions about the past are as important as agreement about the future .

source_bert_toks: i do not know whether admissions about the past are as important as agreement about the future .

reference_raw: I don't know if a confession about the past is as important as a deal about the future.

reference_spacy_tokens: I do n't know if a confession about the past is as important as a deal about the future .