fn_spacy_tokens_for_baseline: " As far back as Plato and Socrates , " Frederickson said , " there were admonishments for people to spend time with animals and nature for their health .

source_bert_toks: " as far back as plato and socrates , " frederick ##son said , " there were ad ##mon ##ishment ##s for people to spend time with animals and nature for their health .

reference_raw: "As far as Plato and Socrates," Frederickson said, "people have been warned to spend time with animals and nature for their health.

reference_spacy_tokens: " As far as Plato and Socrates , " Frederickson said , " people have been warned to spend time with animals and nature for their health .


fn_spacy_tokens_for_baseline: A look at a Thursday night practice at St. Mary Abbot church in the Kensington district of London gives an idea of the work involved .

source_bert_toks: a look at a thursday night practice at st . mary abbot church in the kensington district of london gives an idea of the work involved .

reference_raw: The sight of Thursday night's training at St. Mary Abbot's church in the Kensington District of London gives you an idea of the work involved.

reference_spacy_tokens: The sight of Thursday night 's training at St. Mary Abbot 's church in the Kensington District of London gives you an idea of the work involved .


fn_spacy_tokens_for_baseline: The Holy City remained a backwater until the 19th century , when renewed interest among Christian pilgrims made it the destination of thousands of travelers each year .

source_bert_toks: the holy city remained a back ##water until the 19th century , when renewed interest among christian pilgrims made it the destination of thousands of travelers each year .

reference_raw: The Holy City remained a backwater until the 19th century, when the new interest of Christian pilgrims made it the destination of thousands of pilgrims every year.

reference_spacy_tokens: The Holy City remained a backwater until the 19th century , when the new interest of Christian pilgrims made it the destination of thousands of pilgrims every year .


fn_spacy_tokens_for_baseline: It wo n't rain on you in Dublin all the time .

source_bert_toks: it won ' t rain on you in dublin all the time .

reference_raw: You won't always be raining in Dublin.

reference_spacy_tokens: You wo n't always be raining in Dublin .


fn_spacy_tokens_for_baseline: I personally always thought it was a risk to pin the image of Microsoft on just one man -- at AOL , for example , there was a conscious effort to develop other " characters , " for lack of a better word .

source_bert_toks: i personally always thought it was a risk to pin the image of microsoft on just one man - - at ao ##l , for example , there was a conscious effort to develop other " characters , " for lack of a better word .

reference_raw: Personally, I've always thought it was risky to put Microsoft's image on one person - in AOL, for example, there was a conscious effort to develop other "characters" for lack of a better word.

reference_spacy_tokens: Personally , I 've always thought it was risky to put Microsoft 's image on one person - in AOL , for example , there was a conscious effort to develop other " characters " for lack of a better word .


fn_spacy_tokens_for_baseline: The Chinook helicopter had just touched down .

source_bert_toks: the chin ##ook helicopter had just touched down .

reference_raw: Chinook's helicopter just landed.

reference_spacy_tokens: Chinook 's helicopter just landed .


fn_spacy_tokens_for_baseline: ' Tell me you like it , Mademoiselle de Courmont , ' he commanded , with a disdainful smile , ' tell me what it is you want .

source_bert_toks: ' tell me you like it , made ##mo ##ise ##lle de co ##ur ##mont , ' he commanded , with a disdain ##ful smile , ' tell me what it is you want .

reference_raw: 'Tell me you like it, Mademoiselle de Courmont,' he said, smiling contemptuously, 'tell me what you want.

reference_spacy_tokens: ' Tell me you like it , Mademoiselle de Courmont , ' he said , smiling contemptuously , ' tell me what you want .


fn_spacy_tokens_for_baseline: The next step forward would seem to be : that the letter had been forged by Hilda Machin .

source_bert_toks: the next step forward would seem to be : that the letter had been forged by hilda mach ##in .

reference_raw: It would appear that the next step forward was that Hilda Machin had falsified the letter.

reference_spacy_tokens: It would appear that the next step forward was that Hilda Machin had falsified the letter .


fn_spacy_tokens_for_baseline: Dominic , tying the belt of the dressing - gown , seemed unaware of her .

source_bert_toks: dominic , tying the belt of the dressing - gown , seemed unaware of her .

reference_raw: Dominic, who had fastened his robe belt, did not seem to notice her.

reference_spacy_tokens: Dominic , who had fastened his robe belt , did not seem to notice her .


fn_spacy_tokens_for_baseline: When there is a Labour Government and the Leader of the House finds himself sitting on the Opposition Benches , that Administration will be gracious to the then Opposition .

source_bert_toks: when there is a labour government and the leader of the house finds himself sitting on the opposition benches , that administration will be gr ##acious to the then opposition .

reference_raw: If there is a labor government and the leader of the House sits on opposition benches, the administration will be kind to the opposition then.

reference_spacy_tokens: If there is a labor government and the leader of the House sits on opposition benches , the administration will be kind to the opposition then .


fn_spacy_tokens_for_baseline: Mariano Fiallos , president of the old Council , was re - elected to the post .

source_bert_toks: mariano fia ##llo ##s , president of the old council , was re - elected to the post .

reference_raw: Mariano Fiallos, chairman of the old Council, has been re-elected.

reference_spacy_tokens: Mariano Fiallos , chairman of the old Council , has been re - elected .


fn_spacy_tokens_for_baseline: After 1854 appeals to the Supreme Court on matters of law were allowed .

source_bert_toks: after 1854 appeals to the supreme court on matters of law were allowed .

reference_raw: Following 1854, legal remedies were granted to the Supreme Court.

reference_spacy_tokens: Following 1854 , legal remedies were granted to the Supreme Court .


fn_spacy_tokens_for_baseline: When it did , the Las Vegas Valley ( which at the time had a non - native population of less than 30 ) would change as well .

source_bert_toks: when it did , the las vegas valley ( which at the time had a non - native population of less than 30 ) would change as well .

reference_raw: When this happened, the Valley of Las Vegas (which at the time had an unnatural population of less than 30) would also change.

reference_spacy_tokens: When this happened , the Valley of Las Vegas ( which at the time had an unnatural population of less than 30 ) would also change .


fn_spacy_tokens_for_baseline: Cover with a damp cloth and iron gently , fusing the woven ribbon to the interfacing .

source_bert_toks: cover with a damp cloth and iron gently , fu ##sing the woven ribbon to the inter ##fa ##cing .

reference_raw: Cover with wet cloth and iron gently, mixing the woven ribbon to the interface.

reference_spacy_tokens: Cover with wet cloth and iron gently , mixing the woven ribbon to the interface .


fn_spacy_tokens_for_baseline: But I must ask you to be patient with my navigation in these uncharted waters .

source_bert_toks: but i must ask you to be patient with my navigation in these un ##cha ##rted waters .

reference_raw: But I must ask you to have patience with my navigation in these uncharted waters.

reference_spacy_tokens: But I must ask you to have patience with my navigation in these uncharted waters .


fn_spacy_tokens_for_baseline: The dogs obviously did catch a scent , and it was true .

source_bert_toks: the dogs obviously did catch a scent , and it was true .

reference_raw: Apparently, the dogs caught a scent, and that was the truth.

reference_spacy_tokens: Apparently , the dogs caught a scent , and that was the truth .


fn_spacy_tokens_for_baseline: ' I had to do extra rehearsals because I was new and she would daub my legs with methylated spirits and iodine .

source_bert_toks: ' i had to do extra rehearsals because i was new and she would da ##ub my legs with methyl ##ated spirits and io ##dine .

reference_raw: 'I had to do some extra tests 'cause I was new and she was going to rub my legs with methylated alcohol and iodine.

reference_spacy_tokens: ' I had to do some extra tests 'cause I was new and she was going to rub my legs with methylated alcohol and iodine .


fn_spacy_tokens_for_baseline: In the old natural woodland which had been there originally , in a small clearing , a log cabin had been built and thatched with heather .

source_bert_toks: in the old natural woodland which had been there originally , in a small clearing , a log cabin had been built and that ##ched with heather .

reference_raw: In the old natural forest that had been there, in a small clearing, a log hut was built and itched with heather.

reference_spacy_tokens: In the old natural forest that had been there , in a small clearing , a log hut was built and itched with heather .


fn_spacy_tokens_for_baseline: It was rumoured that he even had his neckties specially made .

source_bert_toks: it was rum ##oured that he even had his neck ##ties specially made .

reference_raw: They said he even had a special necktie made.

reference_spacy_tokens: They said he even had a special necktie made .


fn_spacy_tokens_for_baseline: Around 1500 b.c . , a massive volcanic eruption at Santorini destroyed not only Akrotiri -- under feet of ash and pumice -- but the whole Minoan civilization .

source_bert_toks: around 1500 b . c . , a massive volcanic eruption at santo ##rini destroyed not only ak ##rot ##iri - - under feet of ash and pu ##mic ##e - - but the whole min ##oa ##n civilization .

reference_raw: By 1500 B.C., the great volcanic eruption in Santorini had destroyed not only Akrotiri - beneath the feet of ash and pumice - but also the entire Minoan civilization.

reference_spacy_tokens: By 1500 B.C. , the great volcanic eruption in Santorini had destroyed not only Akrotiri - beneath the feet of ash and pumice - but also the entire Minoan civilization .


fn_spacy_tokens_for_baseline: Knowing that she simply had to shake off this mood of dreamy awareness , she turned on her heel , some grit beneath the leather soles of her flat white sandals grating harshly .

source_bert_toks: knowing that she simply had to shake off this mood of dream ##y awareness , she turned on her heel , some grit beneath the leather sole ##s of her flat white sandals gr ##ating harshly .

reference_raw: Knowing that she simply had to shake off the mood of dreamy awareness, she turned on her heel, and a grit under the leather soles of her flat white sandals gritted harshly.

reference_spacy_tokens: Knowing that she simply had to shake off the mood of dreamy awareness , she turned on her heel , and a grit under the leather soles of her flat white sandals gritted harshly .


fn_spacy_tokens_for_baseline: The rocket fizzled , and shot through him , exploding against the gallows on the other side of the square .

source_bert_toks: the rocket fi ##zzled , and shot through him , exploding against the gallo ##ws on the other side of the square .

reference_raw: The rocket fizzed and shot through him, bursting into the gallows on the far side of the square.

reference_spacy_tokens: The rocket fizzed and shot through him , bursting into the gallows on the far side of the square .


fn_spacy_tokens_for_baseline: Fire - fighters first had hope of gaining control on the morning of Thursday , June 12 , but the wind changed direction during the day , causing a large extension of the fire .

source_bert_toks: fire - fighters first had hope of gaining control on the morning of thursday , june 12 , but the wind changed direction during the day , causing a large extension of the fire .

reference_raw: For the first time, the firemen had hopes of gaining control on Thursday, June 12th, but the wind changed direction during the day, causing the fire to expand considerably.

reference_spacy_tokens: For the first time , the firemen had hopes of gaining control on Thursday , June 12th , but the wind changed direction during the day , causing the fire to expand considerably .


fn_spacy_tokens_for_baseline: The construction company said fire broke out at about 2:10pm local time ( 0310 UTC ) and appeared to have been caused by a welding accident in the basement of a building .

source_bert_toks: the construction company said fire broke out at about 2 : 10 ##pm local time ( 03 ##10 utc ) and appeared to have been caused by a welding accident in the basement of a building .

reference_raw: According to the construction company, the fire broke out at approximately 2:10 p.m. local time (0310 UTC) and appeared to have been caused by a welding incident in the basement of the building.

reference_spacy_tokens: According to the construction company , the fire broke out at approximately 2:10 p.m. local time ( 0310 UTC ) and appeared to have been caused by a welding incident in the basement of the building .


fn_spacy_tokens_for_baseline: The blue patch of sky had long since disappeared and as the light faded the snow took on a fluorescent glow .

source_bert_toks: the blue patch of sky had long since disappeared and as the light faded the snow took on a fluorescent glow .

reference_raw: The blue patch of sky was long gone, and the snow became fluorescent as the light faded.

reference_spacy_tokens: The blue patch of sky was long gone , and the snow became fluorescent as the light faded .


fn_spacy_tokens_for_baseline: The last show of the tour was in Atlanta and I decided to give a little party for the singers and musicians and the crew and I t ried to rent a banquet room at the hotel , but because it was Thanksgiving Weekend , they said they could only give me a suite . N

source_bert_toks: the last show of the tour was in atlanta and i decided to give a little party for the singers and musicians and the crew and i t ri ##ed to rent a banquet room at the hotel , but because it was thanksgiving weekend , they said they could only give me a suite . n

reference_raw: The last show of the tour was in Atlanta, and I decided to throw a party for the singers and musicians and the crew, and I went to the hotel to rent a reception room, but since it was Thanksgiving weekend, they said they could just give me a suite.

reference_spacy_tokens: The last show of the tour was in Atlanta , and I decided to throw a party for the singers and musicians and the crew , and I went to the hotel to rent a reception room , but since it was Thanksgiving weekend , they said they could just give me a suite .


fn_spacy_tokens_for_baseline: In other instances we read that museum collections were set on fire .

source_bert_toks: in other instances we read that museum collections were set on fire .

reference_raw: In other cases, we've read that museum collections have been burned.

reference_spacy_tokens: In other cases , we 've read that museum collections have been burned .


fn_spacy_tokens_for_baseline: Sir Ralph , he thought , was probably a miser .

source_bert_toks: sir ralph , he thought , was probably a mis ##er .

reference_raw: Sir Ralph, he thought, must have been a poor man.

reference_spacy_tokens: Sir Ralph , he thought , must have been a poor man .


fn_spacy_tokens_for_baseline: During the ' phoney war ' -- the eerie nine months between Chamberlain 's declaration of war and Hitler 's attack in the West -- there was a substantial current of support for a negotiated peace .

source_bert_toks: during the ' phone ##y war ' - - the eerie nine months between chamberlain ' s declaration of war and hitler ' s attack in the west - - there was a substantial current of support for a negotiated peace .

reference_raw: During the 'false war' - the eerie nine months between Chamberlain's declaration of war and Hitler's attack in the West - there was a strong stream of support for a negotiated peace.

reference_spacy_tokens: During the ' false war ' - the eerie nine months between Chamberlain 's declaration of war and Hitler 's attack in the West - there was a strong stream of support for a negotiated peace .


fn_spacy_tokens_for_baseline: The inhabited history of the Las Vegas Valley stretches to 23,000 b.c . , when much of the area was covered by a prehistoric lake .

source_bert_toks: the inhabited history of the las vegas valley stretches to 23 , 000 b . c . , when much of the area was covered by a prehistoric lake .

reference_raw: The populated history of the Las Vegas Valley extends to 23,000 B.C., where a prehistorical lake covered most of the area.

reference_spacy_tokens: The populated history of the Las Vegas Valley extends to 23,000 B.C. , where a prehistorical lake covered most of the area .


fn_spacy_tokens_for_baseline: There Suzan was haunted by visions of her father , beckoning her to come and lie beside his tomb .

source_bert_toks: there su ##zan was haunted by visions of her father , beck ##oning her to come and lie beside his tomb .

reference_raw: There Suzan was haunted by her father's visions, and he motioned for her to come and lie beside his grave.

reference_spacy_tokens: There Suzan was haunted by her father 's visions , and he motioned for her to come and lie beside his grave .


fn_spacy_tokens_for_baseline: A few villas , white or pale yellow buildings , could be seen dotted haphazardly across the face of the hill , separated by small groves of olive trees and the occasional stand of poplars .

source_bert_toks: a few villas , white or pale yellow buildings , could be seen dotted ha ##pha ##zard ##ly across the face of the hill , separated by small groves of olive trees and the occasional stand of pop ##lars .

reference_raw: A few villas, white or pale yellow buildings, were speckled haphazardly across the face of the hill, separated by small groves of olive trees and occasional stands of poplars.

reference_spacy_tokens: A few villas , white or pale yellow buildings , were speckled haphazardly across the face of the hill , separated by small groves of olive trees and occasional stands of poplars .


fn_spacy_tokens_for_baseline: Ambulance staff tried to resuscitate the couple , but they were both dead .

source_bert_toks: ambulance staff tried to res ##us ##cit ##ate the couple , but they were both dead .

reference_raw: The ambulance staff tried to revive the couple, but they were both dead.

reference_spacy_tokens: The ambulance staff tried to revive the couple , but they were both dead .


fn_spacy_tokens_for_baseline: These trap the air and so inflate the wing .

source_bert_toks: these trap the air and so in ##fl ##ate the wing .

reference_raw: They trap the air and blow up the wings.

reference_spacy_tokens: They trap the air and blow up the wings .


fn_spacy_tokens_for_baseline: They held sway over islands off the northern Greek coast , but the Phoenicians kept control of the main sea routes ; south of the area , trade continued as usual .

source_bert_toks: they held sway over islands off the northern greek coast , but the ph ##oe ##nic ##ians kept control of the main sea routes ; south of the area , trade continued as usual .

reference_raw: They held sway over the islands off the northern Greek coast, but the Phoenicians maintained control of the main sea routes; the trade continued in the southern part of the region as usual.

reference_spacy_tokens: They held sway over the islands off the northern Greek coast , but the Phoenicians maintained control of the main sea routes ; the trade continued in the southern part of the region as usual .


fn_spacy_tokens_for_baseline: Over by the fireplace , the headmaster had exhausted his limited store of small talk and had advanced to matters of serious educational concern .

source_bert_toks: over by the fireplace , the headmaster had exhausted his limited store of small talk and had advanced to matters of serious educational concern .

reference_raw: Over by the hearth, the director drained his limited supply of small conversations and moved on to matters of serious educational interest.

reference_spacy_tokens: Over by the hearth , the director drained his limited supply of small conversations and moved on to matters of serious educational interest .


fn_spacy_tokens_for_baseline: The art of change - ringing is peculiar to the English , and , like most English peculiarities , unintelligible to the rest of the world .

source_bert_toks: the art of change - ringing is peculiar to the english , and , like most english peculiar ##ities , un ##int ##elli ##gible to the rest of the world .

reference_raw: The art of changing rings is peculiar to England, and, like most of its peculiarities, is incomprehensible to the rest of the world.

reference_spacy_tokens: The art of changing rings is peculiar to England , and , like most of its peculiarities , is incomprehensible to the rest of the world .


fn_spacy_tokens_for_baseline: Inspector Baynes visited us at Baker Street with a printed description of the dark face of the secretary , and of the masterful features , the magnetic black eyes , and the tufted brows of his master .

source_bert_toks: inspector bay ##nes visited us at baker street with a printed description of the dark face of the secretary , and of the master ##ful features , the magnetic black eyes , and the tu ##fted brows of his master .

reference_raw: Inspector Baynes visited us on Baker Street with a printed description of his secretary's black face, his master's mastery features, his magnetic black eyes, and his master's tufted eyebrows.

reference_spacy_tokens: Inspector Baynes visited us on Baker Street with a printed description of his secretary 's black face , his master 's mastery features , his magnetic black eyes , and his master 's tufted eyebrows .


fn_spacy_tokens_for_baseline: ' I needed something to bind my lord fitzAlan 's arm , ' explained Isabel weakly , feeling compelled to offer an apology for the indecent state of her underclothing .

source_bert_toks: ' i needed something to bind my lord fitz ##ala ##n ' s arm , ' explained isabel weakly , feeling compelled to offer an apology for the ind ##ece ##nt state of her under ##cloth ##ing .

reference_raw: 'I needed something to bind my Lord Fitzalan's hand,' said Isabel weakly, feeling compelled to offer an apology for the rudeness of her clothes.

reference_spacy_tokens: ' I needed something to bind my Lord Fitzalan 's hand , ' said Isabel weakly , feeling compelled to offer an apology for the rudeness of her clothes .


fn_spacy_tokens_for_baseline: The Dayton Democrat , who has traveled to other crisis points including Sierra Leone and North Korea , will spend three days visiting hospitals and other facilities to seek understanding why aid has been ineffective in stemming malnourishment and other medical problems .

source_bert_toks: the dayton democrat , who has traveled to other crisis points including sierra leone and north korea , will spend three days visiting hospitals and other facilities to seek understanding why aid has been ineffective in stemming mal ##no ##uri ##sh ##ment and other medical problems .

reference_raw: Dayton Democrat, who has travelled to other crisis sites, including Sierra Leone and North Korea, will spend three days visiting hospitals and other facilities to try to understand why assistance is not effective in curbing malnutrition and other health problems.

reference_spacy_tokens: Dayton Democrat , who has travelled to other crisis sites , including Sierra Leone and North Korea , will spend three days visiting hospitals and other facilities to try to understand why assistance is not effective in curbing malnutrition and other health problems .


fn_spacy_tokens_for_baseline: Competition for a female or other sex object may not produce the same hierarchy as that for food , simply because a sexually aroused animal , say , is not necessarily a hungry one .

source_bert_toks: competition for a female or other sex object may not produce the same hierarchy as that for food , simply because a sexually aroused animal , say , is not necessarily a hungry one .

reference_raw: Competition for a female or other sexual object may not lead to the same hierarchy as food, simply because a sexually excited animal, for example, is not necessarily hungry.

reference_spacy_tokens: Competition for a female or other sexual object may not lead to the same hierarchy as food , simply because a sexually excited animal , for example , is not necessarily hungry .


fn_spacy_tokens_for_baseline: Even more encouragingly , a working replica , ' The Iron Duke ' was built for the GWR 150 celebrations in 1985 .

source_bert_toks: even more encouraging ##ly , a working replica , ' the iron duke ' was built for the g ##wr 150 celebrations in 1985 .

reference_raw: Even more encouragingly, a working copy of the "Iron Duke" was built in 1985 to celebrate GWR 150.

reference_spacy_tokens: Even more encouragingly , a working copy of the " Iron Duke " was built in 1985 to celebrate GWR 150 .


fn_spacy_tokens_for_baseline: Lampard shushed him again .

source_bert_toks: lamp ##ard shu ##shed him again .

reference_raw: Lampard silenced him again.

reference_spacy_tokens: Lampard silenced him again .


fn_spacy_tokens_for_baseline: ' It was Luke 's gift to me , ' she said .

source_bert_toks: ' it was luke ' s gift to me , ' she said .

reference_raw: "It was a present for me from Luke," she said.

reference_spacy_tokens: " It was a present for me from Luke , " she said .


fn_spacy_tokens_for_baseline: The perils of ignoring this advice were well illustrated by Angel of Bengal ( C4 ) , the True Stories documentary by Anna Raphael which was by turns hilarious and enraging .

source_bert_toks: the per ##ils of ignoring this advice were well illustrated by angel of bengal ( c ##4 ) , the true stories documentary by anna raphael which was by turns hilarious and en ##rag ##ing .

reference_raw: The dangers of ignoring this advice were well illustrated by Angel of Bengal (C4), a document from the True Stories of Anna Raphael, which turned hilarious and angry.

reference_spacy_tokens: The dangers of ignoring this advice were well illustrated by Angel of Bengal ( C4 ) , a document from the True Stories of Anna Raphael , which turned hilarious and angry .


fn_spacy_tokens_for_baseline: The way to get the maximum flavour out of dried apricots is to bake them slowly in the oven instead of stewing them .

source_bert_toks: the way to get the maximum flavour out of dried apr ##ico ##ts is to ba ##ke them slowly in the oven instead of stew ##ing them .

reference_raw: The way to extract the maximum taste from dried apricots is to roast them slowly in the oven instead of stewing them.

reference_spacy_tokens: The way to extract the maximum taste from dried apricots is to roast them slowly in the oven instead of stewing them .


fn_spacy_tokens_for_baseline: Filming has finished on the tear - jerking episode where he dies in Rita Fairclough 's arms .

source_bert_toks: filming has finished on the tear - jerking episode where he dies in rita fair ##cl ##ough ' s arms .

reference_raw: The film ended in a tear joke episode where he died in the arms of Rita Fairclough.

reference_spacy_tokens: The film ended in a tear joke episode where he died in the arms of Rita Fairclough .


fn_spacy_tokens_for_baseline: Serious concerns remain about China 's proliferation of ballistic missile technology and its ability to control chemical items that could be used in the production of chemical weapons .

source_bert_toks: serious concerns remain about china ' s proliferation of ballistic missile technology and its ability to control chemical items that could be used in the production of chemical weapons .

reference_raw: There are still serious concerns about China's proliferation of ballistic missile technology and its ability to control chemical items that could be used in the manufacture of chemical weapons.

reference_spacy_tokens: There are still serious concerns about China 's proliferation of ballistic missile technology and its ability to control chemical items that could be used in the manufacture of chemical weapons .


fn_spacy_tokens_for_baseline: In the torrent of replies that followed , one woman ringer from Solihull observed that " the average male ringer leaves quite a lot to be desired : badly dressed , decorated with acne and a large beer - belly , frequently unwashed and unbearably flatulent in peals .

source_bert_toks: in the torre ##nt of replies that followed , one woman ring ##er from sol ##ih ##ull observed that " the average male ring ##er leaves quite a lot to be desired : badly dressed , decorated with ac ##ne and a large beer - belly , frequently un ##washed and un ##be ##ara ##bly flat ##ulent in pea ##ls .

reference_raw: In the torrent of answers that followed, one of Solihull's ringers said, "Mediocre male ringers leave quite a lot to be desired: ill-dressed, decorated with acne and a large beer belly, often unwashed and unbearably flatulent in peals.

reference_spacy_tokens: In the torrent of answers that followed , one of Solihull 's ringers said , " Mediocre male ringers leave quite a lot to be desired : ill - dressed , decorated with acne and a large beer belly , often unwashed and unbearably flatulent in peals .


fn_spacy_tokens_for_baseline: The typewriter clashed and harried him at night , never rhythmical enough to be ignored .

source_bert_toks: the type ##writer clashed and ha ##rrie ##d him at night , never rhythmic ##al enough to be ignored .

reference_raw: The typewriter clattered and harried him at night, never rhythmic enough to ignore him.

reference_spacy_tokens: The typewriter clattered and harried him at night , never rhythmic enough to ignore him .


fn_spacy_tokens_for_baseline: Weapons programs can be based on indigenous ( i.e. , domestic ) production capabilities , or they can rely on foreign supplies and technologies .

source_bert_toks: weapons programs can be based on indigenous ( i . e . , domestic ) production capabilities , or they can rely on foreign supplies and technologies .

reference_raw: Weapons programs may be based on domestic (i.e. domestic) production capabilities, or may rely on foreign resources and technologies.

reference_spacy_tokens: Weapons programs may be based on domestic ( i.e. domestic ) production capabilities , or may rely on foreign resources and technologies .


fn_spacy_tokens_for_baseline: And , in the " it may not sound like progress but it is " department , Utah residents overturned a 102-year - old law limiting the property rights of married women , and South Carolinians struck the miscegenation ban from the state constitution .

source_bert_toks: and , in the " it may not sound like progress but it is " department , utah residents overturned a 102 - year - old law limiting the property rights of married women , and south carol ##inian ##s struck the mis ##ce ##gen ##ation ban from the state constitution .

reference_raw: And in the "it may not sound like progress, but it does" section, Utah residents have overturned a 102-year-old law that restricts the property rights of married women, and South Carolinians have imposed a miscreation ban on the state constitution.

reference_spacy_tokens: And in the " it may not sound like progress , but it does " section , Utah residents have overturned a 102-year - old law that restricts the property rights of married women , and South Carolinians have imposed a miscreation ban on the state constitution .


fn_spacy_tokens_for_baseline: However , the Russian Foreign Ministry spokesman refuted the Minatom statement and denied that any discussion had taken place .

source_bert_toks: however , the russian foreign ministry spokesman ref ##uted the mina ##tom statement and denied that any discussion had taken place .

reference_raw: But the spokesman of the Russian Foreign Ministry rejected the Minatom statement and denied that any discussion had taken place.

reference_spacy_tokens: But the spokesman of the Russian Foreign Ministry rejected the Minatom statement and denied that any discussion had taken place .


fn_spacy_tokens_for_baseline: If , you study the evidences and statements released by these people , we tend to appreciate their ignorance which was based on prominent views .

source_bert_toks: if , you study the evidence ##s and statements released by these people , we tend to appreciate their ignorance which was based on prominent views .

reference_raw: When you study the evidence and statements released by these people, we tend to appreciate their indifference, which is based on prominent opinions.

reference_spacy_tokens: When you study the evidence and statements released by these people , we tend to appreciate their indifference , which is based on prominent opinions .


fn_spacy_tokens_for_baseline: " They were down on the Grose River working in atrocious conditions as a last - ditch stand ... and they nearly got there .

source_bert_toks: " they were down on the gr ##ose river working in at ##ro ##cious conditions as a last - ditch stand . . . and they nearly got there .

reference_raw: "They were down on the Grose River, working under terrible conditions as a last-ditch stand... "and they almost reached it.

reference_spacy_tokens: " They were down on the Grose River , working under terrible conditions as a last - ditch stand ... " and they almost reached it .


fn_spacy_tokens_for_baseline: Portugal 's resulting near - monopoly of East - West trade understandably awakened the competitive instincts of other European powers .

source_bert_toks: portugal ' s resulting near - monopoly of east - west trade understand ##ably awakened the competitive instincts of other european powers .

reference_raw: The result of Portugal's near-monopolis of the East-West Trade has, of course, awakened the competing instincts of other European powers.

reference_spacy_tokens: The result of Portugal 's near - monopolis of the East - West Trade has , of course , awakened the competing instincts of other European powers .


fn_spacy_tokens_for_baseline: But a drop of rain is no problem for the famous Co Antrim golf links set among the sand dunes behind the strand .

source_bert_toks: but a drop of rain is no problem for the famous co antrim golf links set among the sand dunes behind the strand .

reference_raw: But a drop of rain isn't a problem for the famous Co Antrim golf links set between the sand dunes behind the strand.

reference_spacy_tokens: But a drop of rain is n't a problem for the famous Co Antrim golf links set between the sand dunes behind the strand .


fn_spacy_tokens_for_baseline: U.S. intelligence agencies assess that barring acquisition of a complete system or major subsystem from North Korea , Iran is unlikely to launch an ICBM or satellite launch vehicle ( SLV ) before mid - decade .

source_bert_toks: u . s . intelligence agencies assess that barr ##ing acquisition of a complete system or major sub ##sy ##ste ##m from north korea , iran is unlikely to launch an ic ##bm or satellite launch vehicle ( sl ##v ) before mid - decade .

reference_raw: U.S. intelligence agencies consider that it is unlikely that Iran will launch an ICBM or satellite launch vehicle (SLV) before the middle of the decade to prevent the acquisition of a complete system or major subsystem from North Korea.

reference_spacy_tokens: U.S. intelligence agencies consider that it is unlikely that Iran will launch an ICBM or satellite launch vehicle ( SLV ) before the middle of the decade to prevent the acquisition of a complete system or major subsystem from North Korea .


fn_spacy_tokens_for_baseline: After a few blows there , the porcupine succumbs and is then turned carefully over and eaten from underneath , its soft underbelly causing no problems .

source_bert_toks: after a few blows there , the por ##cup ##ine su ##cc ##umb ##s and is then turned carefully over and eaten from underneath , its soft under ##bell ##y causing no problems .

reference_raw: After a few blows, the porcupine succumbs and is then carefully turned over and eaten from the underside, its soft belly causing no trouble.

reference_spacy_tokens: After a few blows , the porcupine succumbs and is then carefully turned over and eaten from the underside , its soft belly causing no trouble .


fn_spacy_tokens_for_baseline: The implication was that with a bit more happening in the sack , hubby would n't have felt he was getting past it and tried to prove his virility by punting up the north face of the Thames .

source_bert_toks: the implication was that with a bit more happening in the sack , hub ##by wouldn ' t have felt he was getting past it and tried to prove his vi ##ril ##ity by punt ##ing up the north face of the thames .

reference_raw: The point was, with a little more going on in the bag, Hubby wouldn't feel like he was getting over it, trying to prove his virility by stabbing the northern face of the Thames.

reference_spacy_tokens: The point was , with a little more going on in the bag , Hubby would n't feel like he was getting over it , trying to prove his virility by stabbing the northern face of the Thames .


fn_spacy_tokens_for_baseline: " You shall not covet your neighbour 's house .

source_bert_toks: " you shall not cove ##t your neighbour ' s house .

reference_raw: "You won't want your neighbor's house."

reference_spacy_tokens: " You wo n't want your neighbor 's house . "


fn_spacy_tokens_for_baseline: China is not , however , a member of the Australia Group ( AG ) , a voluntary supply - side export control regime focused on chemical and biological weapons , though the issuance of new export control regulations in 2002 has put Beijing 's export control policy fully in line with that of the AG .

source_bert_toks: china is not , however , a member of the australia group ( ag ) , a voluntary supply - side export control regime focused on chemical and biological weapons , though the iss ##uance of new export control regulations in 2002 has put beijing ' s export control policy fully in line with that of the ag .

reference_raw: However, China is not a member of the Australia Group (AG), a voluntary supply-side export control regime focusing on chemical and biological weapons, although the issue of new export control regulations in 2002 has fully aligned Beijing's export control policy with that of the AG.

reference_spacy_tokens: However , China is not a member of the Australia Group ( AG ) , a voluntary supply - side export control regime focusing on chemical and biological weapons , although the issue of new export control regulations in 2002 has fully aligned Beijing 's export control policy with that of the AG .


fn_spacy_tokens_for_baseline: If it has n't , the only thing you can do -- apart from continuing your garage - less existence , or renting one from a car - less neighbour -- is to convert part of the ground floor of your house to construct a built - in garage , with all the upheaval and loss of living space which that entails .

source_bert_toks: if it hasn ' t , the only thing you can do - - apart from continuing your garage - less existence , or rent ##ing one from a car - less neighbour - - is to convert part of the ground floor of your house to construct a built - in garage , with all the up ##hea ##val and loss of living space which that en ##tails .

reference_raw: If you don't, the only thing you can do - apart from continuing to live without a car, or renting one from a neighbor without a car - is convert part of the ground floor of your house to build a built-in workshop, with all the upheaval and loss of living space involved.

reference_spacy_tokens: If you do n't , the only thing you can do - apart from continuing to live without a car , or renting one from a neighbor without a car - is convert part of the ground floor of your house to build a built - in workshop , with all the upheaval and loss of living space involved .


fn_spacy_tokens_for_baseline: In 1904 , the narrow , double - decker trams ran along the waterfront , but land reclamation has placed them far inland .

source_bert_toks: in 1904 , the narrow , double - decker trams ran along the waterfront , but land reclamation has placed them far inland .

reference_raw: In 1904, small double-decker trams ran along the waterfront, but land reclamation put them far inland.

reference_spacy_tokens: In 1904 , small double - decker trams ran along the waterfront , but land reclamation put them far inland .


fn_spacy_tokens_for_baseline: The soldiers ' battle garb was different from that of the armies in Blake 's time .

source_bert_toks: the soldiers ' battle ga ##rb was different from that of the armies in blake ' s time .

reference_raw: The combat clothing of the soldiers was different from that of the army in Blake's time.

reference_spacy_tokens: The combat clothing of the soldiers was different from that of the army in Blake 's time .


fn_spacy_tokens_for_baseline: Now fed - up councillors are planning to meet officials from the Re - Roof Housing Association .

source_bert_toks: now fed - up councillors are planning to meet officials from the re - roof housing association .

reference_raw: Now the fed councillors plan to meet the officials of the Re-Roof Housing Association.

reference_spacy_tokens: Now the fed councillors plan to meet the officials of the Re - Roof Housing Association .


fn_spacy_tokens_for_baseline: We used Ahab with a 500 bp window to scan the Drosophila genome .

source_bert_toks: we used ah ##ab with a 500 bp window to scan the dr ##oso ##phila genome .

reference_raw: We used Ahab to scan the Drosophila genome with a 500-bp glass.

reference_spacy_tokens: We used Ahab to scan the Drosophila genome with a 500-bp glass .


fn_spacy_tokens_for_baseline: Now he talks of revoking some of the freedoms , including a freer press , that the Soviet parliament brought into being last year .

source_bert_toks: now he talks of rev ##oki ##ng some of the freedoms , including a free ##r press , that the soviet parliament brought into being last year .

reference_raw: He is now speaking of the abolition of some of the freedoms, including the freer press, that the Soviet Parliament created last year.

reference_spacy_tokens: He is now speaking of the abolition of some of the freedoms , including the freer press , that the Soviet Parliament created last year .


fn_spacy_tokens_for_baseline: She 's been searching for signs of extraterrestrial life ever since she was a little girl .

source_bert_toks: she ' s been searching for signs of extra ##ter ##rest ##rial life ever since she was a little girl .

reference_raw: Ever since she was a little girl, she's been looking for signs of alien existence.

reference_spacy_tokens: Ever since she was a little girl , she 's been looking for signs of alien existence .


fn_spacy_tokens_for_baseline: Iraq has been under economic sanctions since the war ended , which some say have thwarted the country 's ability to recover from the devastation of the bombing campaign .

source_bert_toks: iraq has been under economic sanctions since the war ended , which some say have thwarted the country ' s ability to recover from the devastation of the bombing campaign .

reference_raw: Since the end of the war, Iraq has been subject to economic sanctions, which some say undermined the country's ability to recover from the destruction of the bombing campaign.

reference_spacy_tokens: Since the end of the war , Iraq has been subject to economic sanctions , which some say undermined the country 's ability to recover from the destruction of the bombing campaign .


fn_spacy_tokens_for_baseline: I stopped playing and tossed my trumpet to Kim who had been showering our remaining advertising leaflets on to the melee .

source_bert_toks: i stopped playing and tossed my trumpet to kim who had been shower ##ing our remaining advertising leaflets on to the melee .

reference_raw: I stopped playing and threw my trumpet at Kim, who was throwing our remaining ads on the melee.

reference_spacy_tokens: I stopped playing and threw my trumpet at Kim , who was throwing our remaining ads on the melee .


fn_spacy_tokens_for_baseline: But in Mexico , peasants pulverise the plump triticale kernels in stone mortars to prepare tortillas ; they taste a little different from those made from traditional maize , but are relished nevertheless .

source_bert_toks: but in mexico , peasants pu ##lver ##ise the plump tri ##tical ##e kernel ##s in stone mortar ##s to prepare tor ##till ##as ; they taste a little different from those made from traditional maize , but are re ##lish ##ed nevertheless .

reference_raw: But in Mexico, peasants pulverize plump triticale cores in stone mortars to prepare tortillas; they taste a little different from traditional corn, but they enjoy it anyway.

reference_spacy_tokens: But in Mexico , peasants pulverize plump triticale cores in stone mortars to prepare tortillas ; they taste a little different from traditional corn , but they enjoy it anyway .


fn_spacy_tokens_for_baseline: Last buses from Princes Street leave at approximately 23.30 .

source_bert_toks: last buses from princes street leave at approximately 23 . 30 .

reference_raw: The last train from Princes Street leaves at approximately 23:30.

reference_spacy_tokens: The last train from Princes Street leaves at approximately 23:30 .


fn_spacy_tokens_for_baseline: The " Hsin Chu " program involved procurement and operation of a heavy water reactor , a heavy water production plant , a reprocessing research laboratory , and a plutonium separation plant .

source_bert_toks: the " hs ##in chu " program involved procurement and operation of a heavy water reactor , a heavy water production plant , a rep ##ro ##ces ##sing research laboratory , and a pluto ##nium separation plant .

reference_raw: The Hsin Chu programme included the purchase and operation of a heavy water reactor, a heavy water production plant, a research laboratory for reprocessing, and a plutonium separation plant.

reference_spacy_tokens: The Hsin Chu programme included the purchase and operation of a heavy water reactor , a heavy water production plant , a research laboratory for reprocessing , and a plutonium separation plant .


fn_spacy_tokens_for_baseline: yeah yeah like those E - bonds there 's something called an E - bond that you can buy and it and it you do n't have to pay taxes on it and it 's for the child and then when they turn it in when it matures

source_bert_toks: yeah yeah like those e - bonds there ' s something called an e - bond that you can buy and it and it you don ' t have to pay taxes on it and it ' s for the child and then when they turn it in when it mature ##s

reference_raw: Yeah, like those e-bonds, there's something called an e-bond that you can buy and that you don't have to pay taxes on, and it's for the baby, and then when it grows up,

reference_spacy_tokens: Yeah , like those e - bonds , there 's something called an e - bond that you can buy and that you do n't have to pay taxes on , and it 's for the baby , and then when it grows up ,


fn_spacy_tokens_for_baseline: QN : Does Iran want to be a self - sufficient producer of CW ?

source_bert_toks: q ##n : does iran want to be a self - sufficient producer of cw ?

reference_raw: QN: Is Iran a self-sufficient manufacturer of CW?

reference_spacy_tokens: QN : Is Iran a self - sufficient manufacturer of CW ?


fn_spacy_tokens_for_baseline: ' They put together a group of people like Take That ! , who did n't even know each other until they formed -- not that I 'm knocking them , because they 've got more front than we have -- but it 's not going to work unless it 's real , ' gripes Tony .

source_bert_toks: ' they put together a group of people like take that ! , who didn ' t even know each other until they formed - - not that i ' m knocking them , because they ' ve got more front than we have - - but it ' s not going to work unless it ' s real , ' grip ##es tony .

reference_raw: 'They've put together a group of people like Take That! who didn't even know each other until they formed - not that I'm going to knock them out because they have a bigger front than we do - but it won't work unless it's real,' Tony says.

reference_spacy_tokens: ' They 've put together a group of people like Take That ! who did n't even know each other until they formed - not that I 'm going to knock them out because they have a bigger front than we do - but it wo n't work unless it 's real , ' Tony says .


fn_spacy_tokens_for_baseline: On one of these outings , the nervous mare I was riding was already unsettled by strong winds .

source_bert_toks: on one of these outing ##s , the nervous mare i was riding was already un ##sett ##led by strong winds .

reference_raw: On one of those excursions, the nervous mare I had ridden had been disturbed by a strong wind.

reference_spacy_tokens: On one of those excursions , the nervous mare I had ridden had been disturbed by a strong wind .


fn_spacy_tokens_for_baseline: There is also one confidential manservant .

source_bert_toks: there is also one confidential mans ##er ##vant .

reference_raw: There's also a confidential servant.

reference_spacy_tokens: There 's also a confidential servant .


fn_spacy_tokens_for_baseline: Rachel fidgets round the room like it 's a hotel we got to leave by ten .

source_bert_toks: rachel fi ##dgets round the room like it ' s a hotel we got to leave by ten .

reference_raw: Rachel moves around the room like it's a hotel we have to leave at 10:00.

reference_spacy_tokens: Rachel moves around the room like it 's a hotel we have to leave at 10:00 .


fn_spacy_tokens_for_baseline: He tossed back his hair and glared down at Rain .

source_bert_toks: he tossed back his hair and glared down at rain .

reference_raw: He threw back his hair and looked down at Rain.

reference_spacy_tokens: He threw back his hair and looked down at Rain .


fn_spacy_tokens_for_baseline: ' She did tell me she has sensitive eyes .

source_bert_toks: ' she did tell me she has sensitive eyes .

reference_raw: She told me she had delicate eyes.

reference_spacy_tokens: She told me she had delicate eyes .


fn_spacy_tokens_for_baseline: He hastily pulled off his clothes and stood facing Mrs Sweet .

source_bert_toks: he hastily pulled off his clothes and stood facing mrs sweet .

reference_raw: Quickly he undressed and faced Mrs Sweet.

reference_spacy_tokens: Quickly he undressed and faced Mrs Sweet .


fn_spacy_tokens_for_baseline: As they cross the lobby of the Langham Hilton , Mr and Mrs Koons scarcely warrant a second glance from the assembled tourists , despite Mrs Koons 's shocking pink dress , platinum - blonde coiffure and orange eyebrows .

source_bert_toks: as they cross the lobby of the lang ##ham hilton , mr and mrs ko ##ons scarcely warrant a second glance from the assembled tourists , despite mrs ko ##ons ' s shocking pink dress , platinum - blonde co ##iff ##ure and orange eyebrows .

reference_raw: As they pass through the lobby of the Langham Hilton, Mr. and Mrs. Koons hardly deserve a second look from the assembled tourists, despite Mrs. Koons's stupendous pink dress, platinum blond hair, and orange eyebrows.

reference_spacy_tokens: As they pass through the lobby of the Langham Hilton , Mr. and Mrs. Koons hardly deserve a second look from the assembled tourists , despite Mrs. Koons 's stupendous pink dress , platinum blond hair , and orange eyebrows .


fn_spacy_tokens_for_baseline: He grimaced slightly as a traditional Korean band in multi - coloured silk costumes played a welcome fanfare on conch shells .

source_bert_toks: he grimaced slightly as a traditional korean band in multi - coloured silk costumes played a welcome fan ##fare on con ##ch shells .

reference_raw: He grinned a little as a traditional Korean band in multicolored silk suits played a welcome fanfare on conch shells.

reference_spacy_tokens: He grinned a little as a traditional Korean band in multicolored silk suits played a welcome fanfare on conch shells .


fn_spacy_tokens_for_baseline: I got up and dressed in a sweater and pants , made my bed , then sat on the end and shook physically with anxiety .

source_bert_toks: i got up and dressed in a sweater and pants , made my bed , then sat on the end and shook physically with anxiety .

reference_raw: I got up, put on a sweater and trousers, made a bed, and sat on the end of it, shaking physically with anxiety.

reference_spacy_tokens: I got up , put on a sweater and trousers , made a bed , and sat on the end of it , shaking physically with anxiety .


fn_spacy_tokens_for_baseline: A legitimate businessman , Hughes was nonetheless eccentric and dramatic , a style suited to the Las Vegas ethos .

source_bert_toks: a legitimate businessman , hughes was nonetheless eccentric and dramatic , a style suited to the las vegas et ##hos .

reference_raw: Hughes, a legitimate trader, was eccentric and dramatic, a style suitable for Las Vegas ethos.

reference_spacy_tokens: Hughes , a legitimate trader , was eccentric and dramatic , a style suitable for Las Vegas ethos .


fn_spacy_tokens_for_baseline: RENFE 's deficit , for reasons discussed in other chapters , exploded during the 1970s and the first half of the 1980s .

source_bert_toks: ren ##fe ' s deficit , for reasons discussed in other chapters , exploded during the 1970s and the first half of the 1980s .

reference_raw: The RENFE deficit erupted in the 1970s and the first half of the 1980s for reasons discussed in other chapters.

reference_spacy_tokens: The RENFE deficit erupted in the 1970s and the first half of the 1980s for reasons discussed in other chapters .


fn_spacy_tokens_for_baseline: Although Phillips hazarded some theoretical conjectures concerning the relationship he had uncovered , it was left to others , most notably R. G.

source_bert_toks: although phillips hazard ##ed some theoretical conjecture ##s concerning the relationship he had uncovered , it was left to others , most notably r . g .

reference_raw: Although Phillips had risked some theoretical assumptions about the relationship he'd discovered, it was left to others, especially R.G.

reference_spacy_tokens: Although Phillips had risked some theoretical assumptions about the relationship he 'd discovered , it was left to others , especially R.G.


fn_spacy_tokens_for_baseline: The maid gave a brief curtsy and left .

source_bert_toks: the maid gave a brief curt ##sy and left .

reference_raw: The maid bowed briefly and left.

reference_spacy_tokens: The maid bowed briefly and left .


fn_spacy_tokens_for_baseline: Party Election Broadcasts ( PEBs ) at election - time and the equivalent Party Political Broadcasts ( PPBs ) at non - election times are one method by which broadcasting attempts to achieve balance and impartiality between the parties .

source_bert_toks: party election broadcasts ( pe ##bs ) at election - time and the equivalent party political broadcasts ( pp ##bs ) at non - election times are one method by which broadcasting attempts to achieve balance and imp ##art ##ial ##ity between the parties .

reference_raw: Party Election Broadcasts (PEBs) during the election period and the equivalent Party Political broadcasts (PPBs) during the non-election period are one of the methods by which the transmission attempts to achieve a balance and fairness between the Parties.

reference_spacy_tokens: Party Election Broadcasts ( PEBs ) during the election period and the equivalent Party Political broadcasts ( PPBs ) during the non - election period are one of the methods by which the transmission attempts to achieve a balance and fairness between the Parties .


fn_spacy_tokens_for_baseline: They had been trained in their own callings -- pilots , navigators , gunners and wireless operator 's -- and came together at No 19 OTU Kinloss where they were to be trained on Whitleys .

source_bert_toks: they had been trained in their own calling ##s - - pilots , navigator ##s , gunners and wireless operator ' s - - and came together at no 19 ot ##u kin ##los ##s where they were to be trained on whitley ##s .

reference_raw: They'd been trained on their own missions-pilots, navigators, gunners, and wireless operators-and they'd met at No 19 OTU Kinloss, where they'd been trained on the Whitleys.

reference_spacy_tokens: They 'd been trained on their own missions - pilots , navigators , gunners , and wireless operators - and they 'd met at No 19 OTU Kinloss , where they 'd been trained on the Whitleys .


fn_spacy_tokens_for_baseline: But the southwest 's growing need for water , combined with Las Vegas 's fortuitous proximity to the Colorado River , would give Las Vegas a second chance to achieve prosperity .

source_bert_toks: but the southwest ' s growing need for water , combined with las vegas ' s fort ##uit ##ous proximity to the colorado river , would give las vegas a second chance to achieve prosperity .

reference_raw: But the growing need for water from the southwest, coupled with the fortunate proximity of Las Vegas to the Colorado River, would give Las Vegas a second chance to prosper.

reference_spacy_tokens: But the growing need for water from the southwest , coupled with the fortunate proximity of Las Vegas to the Colorado River , would give Las Vegas a second chance to prosper .


fn_spacy_tokens_for_baseline: But these are not precise antonyms , and it must be borne in mind that the purpose of the use of the word is to stigmatise certain types of behaviour as criminal .

source_bert_toks: but these are not precise antony ##ms , and it must be borne in mind that the purpose of the use of the word is to stigma ##tis ##e certain types of behaviour as criminal .

reference_raw: However, these are not precise anonyms, and it should be borne in mind that the use of the word is intended to stigmatise certain types of behavior as criminals.

reference_spacy_tokens: However , these are not precise anonyms , and it should be borne in mind that the use of the word is intended to stigmatise certain types of behavior as criminals .


fn_spacy_tokens_for_baseline: But of course the erotic can be conceived quite differently , as it was by Pound .

source_bert_toks: but of course the erotic can be conceived quite differently , as it was by pound .

reference_raw: But of course, erotics can be imagined in a completely different way, just like Pound.

reference_spacy_tokens: But of course , erotics can be imagined in a completely different way , just like Pound .


fn_spacy_tokens_for_baseline: If he follows the correct path , he may be able to look back on this election as the high - water mark of far - left opposition .

source_bert_toks: if he follows the correct path , he may be able to look back on this election as the high - water mark of far - left opposition .

reference_raw: If he's on the right track, he can look back on this election as a high water sign of a far-left opposition.

reference_spacy_tokens: If he 's on the right track , he can look back on this election as a high water sign of a far - left opposition .


fn_spacy_tokens_for_baseline: Making no concessions to the concept of melody , the band members blasted away at their instruments as loud as they could .

source_bert_toks: making no concessions to the concept of melody , the band members blasted away at their instruments as loud as they could .

reference_raw: The band members made no concession to the concept of melody and blew as loudly as they could at their instruments.

reference_spacy_tokens: The band members made no concession to the concept of melody and blew as loudly as they could at their instruments .


fn_spacy_tokens_for_baseline: I know many schoolteachers and , on the whole , they are seriously committed to conscientious teaching .

source_bert_toks: i know many school ##teacher ##s and , on the whole , they are seriously committed to con ##sc ##ient ##ious teaching .

reference_raw: I know a lot of teachers, and on the whole, they're really determined to be conscientious.

reference_spacy_tokens: I know a lot of teachers , and on the whole , they 're really determined to be conscientious .


fn_spacy_tokens_for_baseline: It was midday when they faced one another on the level field in the north - east quarter of Caer Camel .

source_bert_toks: it was midday when they faced one another on the level field in the north - east quarter of ca ##er camel .

reference_raw: It was noon when they faced each other on a level field in the northeast quarter of Caer Camel.

reference_spacy_tokens: It was noon when they faced each other on a level field in the northeast quarter of Caer Camel .


fn_spacy_tokens_for_baseline: It was overfilled with a huge walnut and chrome table and ranks of black leatherette chairs .

source_bert_toks: it was over ##fi ##lled with a huge walnut and chrome table and ranks of black leather ##ette chairs .

reference_raw: It was filled with huge walnuts and chrome tables and rows of black leather chairs.

reference_spacy_tokens: It was filled with huge walnuts and chrome tables and rows of black leather chairs .


fn_spacy_tokens_for_baseline: Useful contributions from the tail swelled the score to 451 , leaving India a distant victory target of 372 .

source_bert_toks: useful contributions from the tail swelled the score to 451 , leaving india a distant victory target of 37 ##2 .

reference_raw: Useful tail contributions have increased the score to 451, leaving India a distant victory target of 372.

reference_spacy_tokens: Useful tail contributions have increased the score to 451 , leaving India a distant victory target of 372 .


fn_spacy_tokens_for_baseline: ' In your attitude towards me , of course , ' she returned in what sounded like a reproachful whimper .

source_bert_toks: ' in your attitude towards me , of course , ' she returned in what sounded like a rep ##ro ##ach ##ful whimper .

reference_raw: 'In your attitude toward me, of course,' she said, sounding like a scornful whine.

reference_spacy_tokens: ' In your attitude toward me , of course , ' she said , sounding like a scornful whine .


fn_spacy_tokens_for_baseline: The deputy mayor of the town , Panayiotis Bitakos , told Skai TV that " I call on all residents to follow the instructions of the police as to where they will go .

source_bert_toks: the deputy mayor of the town , pan ##ay ##iot ##is bit ##ako ##s , told ska ##i tv that " i call on all residents to follow the instructions of the police as to where they will go .

reference_raw: The city's deputy mayor, Panayiotis Bitakos, said to Skai TV, "I invite all residents to follow the police's instructions as to where they're going.

reference_spacy_tokens: The city 's deputy mayor , Panayiotis Bitakos , said to Skai TV , " I invite all residents to follow the police 's instructions as to where they 're going .


fn_spacy_tokens_for_baseline: There are also demonstrations of traditional Chinese crafts , including silk - weaving , pottery , and papermaking .

source_bert_toks: there are also demonstrations of traditional chinese crafts , including silk - weaving , pottery , and paper ##making .

reference_raw: There are also demonstrations of traditional Chinese arts, including silk, weaving, ceramic and papermaking.

reference_spacy_tokens: There are also demonstrations of traditional Chinese arts , including silk , weaving , ceramic and papermaking .


fn_spacy_tokens_for_baseline: But in a deeper sense , the limits on garages are emblematic of the way successive administrations in New York have handled most things : They have consistently assumed that without a strong managerial hand , the city would degenerate into chaos .

source_bert_toks: but in a deeper sense , the limits on garage ##s are emblem ##atic of the way successive administrations in new york have handled most things : they have consistently assumed that without a strong managerial hand , the city would de ##gen ##erate into chaos .

reference_raw: In a deeper sense, however, the limits of garages are symbolic of how successive administrations in New York have handled most of the things: they consistently assumed that the city would degenerate into chaos without a powerful management hand.

reference_spacy_tokens: In a deeper sense , however , the limits of garages are symbolic of how successive administrations in New York have handled most of the things : they consistently assumed that the city would degenerate into chaos without a powerful management hand .


fn_spacy_tokens_for_baseline: Rep. Tony Hall , D- Ohio , did not call for a lifting of sanctions imposed on Iraq for its 1990 invasion of Kuwait , but said the United Nations should make sure that sanctions do not hurt innocent Iraqis .

source_bert_toks: rep . tony hall , d - ohio , did not call for a lifting of sanctions imposed on iraq for its 1990 invasion of kuwait , but said the united nations should make sure that sanctions do not hurt innocent iraqi ##s .

reference_raw: Rep. Tony Hall, D-Ohio, did not call for the lifting of the sanctions imposed on Iraq for the invasion of Kuwait in 1990, but said that the United Nations should ensure that sanctions do not harm innocuous Iraqis.

reference_spacy_tokens: Rep. Tony Hall , D - Ohio , did not call for the lifting of the sanctions imposed on Iraq for the invasion of Kuwait in 1990 , but said that the United Nations should ensure that sanctions do not harm innocuous Iraqis .


fn_spacy_tokens_for_baseline: Just past the temple is the aptly named Ladder Street .

source_bert_toks: just past the temple is the apt ##ly named ladder street .

reference_raw: There's a well-named Ladder Street just outside the temple.

reference_spacy_tokens: There 's a well - named Ladder Street just outside the temple .


fn_spacy_tokens_for_baseline: Any secret can be pirated , the experts said , if it is transmitted over the air .

source_bert_toks: any secret can be pirate ##d , the experts said , if it is transmitted over the air .

reference_raw: Any secret can be piracy, the experts said, if it's airborne.

reference_spacy_tokens: Any secret can be piracy , the experts said , if it 's airborne .


fn_spacy_tokens_for_baseline: This led to a military standoff between French and American troops and a bitter rebuke from President Truman .

source_bert_toks: this led to a military stand ##off between french and american troops and a bitter re ##bu ##ke from president truman .

reference_raw: This led to a military standstill between French and American troops and a bitter rebuke from President Truman.

reference_spacy_tokens: This led to a military standstill between French and American troops and a bitter rebuke from President Truman .


fn_spacy_tokens_for_baseline: It was very noisy ; every other table was full and music babbled from the walls .

source_bert_toks: it was very noisy ; every other table was full and music ba ##bbled from the walls .

reference_raw: It was very loud; all the other tables were full, and the music was bubbling from the walls.

reference_spacy_tokens: It was very loud ; all the other tables were full , and the music was bubbling from the walls .


fn_spacy_tokens_for_baseline: The American Medical Association voted to form a union to negotiate for better wages and working conditions but promised never to strike .

source_bert_toks: the american medical association voted to form a union to negotiate for better wages and working conditions but promised never to strike .

reference_raw: The American Medical Association voted to form a union to negotiate better wages and working conditions, but promised never to attack.

reference_spacy_tokens: The American Medical Association voted to form a union to negotiate better wages and working conditions , but promised never to attack .


fn_spacy_tokens_for_baseline: There are plenty of fine areas for cycle touring within easy reach of Auckland .

source_bert_toks: there are plenty of fine areas for cycle touring within easy reach of auckland .

reference_raw: There are plenty of good areas for cycle tours within easy reach of Auckland.

reference_spacy_tokens: There are plenty of good areas for cycle tours within easy reach of Auckland .


fn_spacy_tokens_for_baseline: But the other way this particular Friday can be called ' good ' is by reading back into it the astounding outcome on the day after the Sabbath -- the 1st day of the new week .

source_bert_toks: but the other way this particular friday can be called ' good ' is by reading back into it the as ##tou ##nding outcome on the day after the sabbath - - the 1st day of the new week .

reference_raw: But another way to call this particular Friday "good" is to read into it the stunning result of the day after the Sabbath - the first day of the new week.

reference_spacy_tokens: But another way to call this particular Friday " good " is to read into it the stunning result of the day after the Sabbath - the first day of the new week .


fn_spacy_tokens_for_baseline: Lexandro stripped off his mustardy cadet 's tunic , and boots , and loincloth quickly and stood naked .

source_bert_toks: lex ##and ##ro stripped off his mustard ##y cadet ' s tunic , and boots , and lo ##in ##cloth quickly and stood naked .

reference_raw: Lexandro quickly removed his mustardy cadet tunic, boots, and loincloth, and stood naked.

reference_spacy_tokens: Lexandro quickly removed his mustardy cadet tunic , boots , and loincloth , and stood naked .


fn_spacy_tokens_for_baseline: FYI - I will be out of the office all next week .

source_bert_toks: f ##yi - i will be out of the office all next week .

reference_raw: For the record, I'm not going to work for the rest of the week.

reference_spacy_tokens: For the record , I 'm not going to work for the rest of the week .


fn_spacy_tokens_for_baseline: The sensors control the pump -- allowing water to be pumped around the system only when the temperature at the solar panel is higher than the temperature in the cylinder .

source_bert_toks: the sensors control the pump - - allowing water to be pumped around the system only when the temperature at the solar panel is higher than the temperature in the cylinder .

reference_raw: Sensors operate the pump, allowing water to be pumped around the system only if the temperature in the solar panel is higher than the temperature in the cylinder.

reference_spacy_tokens: Sensors operate the pump , allowing water to be pumped around the system only if the temperature in the solar panel is higher than the temperature in the cylinder .


fn_spacy_tokens_for_baseline: Despite its good intentions , however , ICL is only able to deliver , at present , a rather lacklustre SCO implementation running under Powerwindows -- a Microsoft Corp Windows based graphical user interface .

source_bert_toks: despite its good intentions , however , ic ##l is only able to deliver , at present , a rather lack ##lus ##tre sc ##o implementation running under power ##wind ##ows - - a microsoft corp windows based graphical user interface .

reference_raw: However, despite its well-intentioned intentions, ICL is currently only able to provide a relatively poor implementation of the SCO that runs under PowerWindows, a graphical user interface based on Microsoft Corp Windows.

reference_spacy_tokens: However , despite its well - intentioned intentions , ICL is currently only able to provide a relatively poor implementation of the SCO that runs under PowerWindows , a graphical user interface based on Microsoft Corp Windows .


fn_spacy_tokens_for_baseline: The objective of having kiosks is they serve as communication points between the guards and the visitors or those who are approaching the building and deal with them according to their requirements .

source_bert_toks: the objective of having ki ##os ##ks is they serve as communication points between the guards and the visitors or those who are approaching the building and deal with them according to their requirements .

reference_raw: The purpose of having a kiosk is that it serves as a contact point between a guard and a visitor or a person who approaches a building and deals with it in accordance with their requirements.

reference_spacy_tokens: The purpose of having a kiosk is that it serves as a contact point between a guard and a visitor or a person who approaches a building and deals with it in accordance with their requirements .


fn_spacy_tokens_for_baseline: It was precisely at this time that the Chinese were having to obtain supplies as tribute or by way of trade from the southernmost provinces of the empire or from Java and Sumatra .

source_bert_toks: it was precisely at this time that the chinese were having to obtain supplies as tribute or by way of trade from the southernmost provinces of the empire or from java and sumatra .

reference_raw: It was at that moment that the Chinese had to obtain supplies from the southmost provinces of the realm, or from Java and Sumatra, either as a tribute or as a trade.

reference_spacy_tokens: It was at that moment that the Chinese had to obtain supplies from the southmost provinces of the realm , or from Java and Sumatra , either as a tribute or as a trade .


fn_spacy_tokens_for_baseline: When children quarrel excessively there is something going badly wrong with their interactions and relationships , since few of us really enjoy arguing and fighting .

source_bert_toks: when children quarrel excessive ##ly there is something going badly wrong with their interactions and relationships , since few of us really enjoy arguing and fighting .

reference_raw: When children argue too much, there's something wrong with their interactions and relationships, because few of us really like to argue and fight.

reference_spacy_tokens: When children argue too much , there 's something wrong with their interactions and relationships , because few of us really like to argue and fight .


fn_spacy_tokens_for_baseline: The thugs pounced as Tony McLoughlin prepared to open up the school shortly after 7 am .

source_bert_toks: the thugs po ##unced as tony mc ##lou ##gh ##lin prepared to open up the school shortly after 7 ##am .

reference_raw: The thugs jumped as Tony McLoughlin prepared to open the school shortly after 7:00 in the morning.

reference_spacy_tokens: The thugs jumped as Tony McLoughlin prepared to open the school shortly after 7:00 in the morning .


fn_spacy_tokens_for_baseline: This scholar dribbling tea

source_bert_toks: this scholar dr ##ib ##bling tea

reference_raw: This scholar dripping tea

reference_spacy_tokens: This scholar dripping tea


fn_spacy_tokens_for_baseline: It may well happen , however , that the users of a hierarchy ( in the case of a lexical hierarchy the speakers of the language ) have positive intuitions concerning which items belong together at a given level ; and these intuitions may conflict with the level assignations according to technical criteria .

source_bert_toks: it may well happen , however , that the users of a hierarchy ( in the case of a lexi ##cal hierarchy the speakers of the language ) have positive intuition ##s concerning which items belong together at a given level ; and these intuition ##s may conflict with the level assign ##ations according to technical criteria .

reference_raw: However, users of the hierarchy (in the case of a lexical hierarchy, speakers of the language) may have positive intuitions about which items belong together at a given level; and such intuitions may contradict the allocation of the level according to technical criteria.

reference_spacy_tokens: However , users of the hierarchy ( in the case of a lexical hierarchy , speakers of the language ) may have positive intuitions about which items belong together at a given level ; and such intuitions may contradict the allocation of the level according to technical criteria .


fn_spacy_tokens_for_baseline: There had been sick mothers , sudden marriages , several funerals of grandparents who had mysteriously resurrected themselves in time for work at the mills .

source_bert_toks: there had been sick mothers , sudden marriages , several funeral ##s of grandparents who had mysteriously resurrected themselves in time for work at the mills .

reference_raw: There were sick mothers, sudden weddings, several funerals of grandparents who had mysteriously resurrected themselves in time to work in the mills.

reference_spacy_tokens: There were sick mothers , sudden weddings , several funerals of grandparents who had mysteriously resurrected themselves in time to work in the mills .


fn_spacy_tokens_for_baseline: Managers at the Landing Gear factory have so far refused to confirm or deny the report that up to two hundred jobs are to go .

source_bert_toks: managers at the landing gear factory have so far refused to confirm or deny the report that up to two hundred jobs are to go .

reference_raw: The managers of the Landing Gear plant have so far declined to confirm or deny the report that up to 200 jobs will be made.

reference_spacy_tokens: The managers of the Landing Gear plant have so far declined to confirm or deny the report that up to 200 jobs will be made .


fn_spacy_tokens_for_baseline: Our target is to publish original papers within eight weeks of final acceptance .

source_bert_toks: our target is to publish original papers within eight weeks of final acceptance .

reference_raw: Our goal is to publish the original papers within eight weeks of the final adoption.

reference_spacy_tokens: Our goal is to publish the original papers within eight weeks of the final adoption .


fn_spacy_tokens_for_baseline: Visibility in the Corrado is obstructed by the broad C - pillars and high rear -- made even higher by an electrically - raised spoiler .

source_bert_toks: visibility in the co ##rrado is ob ##st ##ru ##cted by the broad c - pillars and high rear - - made even higher by an electrically - raised spoil ##er .

reference_raw: Visibility in the Corrado is blocked by wide C-pillars and high back - made even higher by an electric spoiler.

reference_spacy_tokens: Visibility in the Corrado is blocked by wide C - pillars and high back - made even higher by an electric spoiler .


fn_spacy_tokens_for_baseline: Tweed stood behind the heavy net curtains masking the windows of his Park Crescent office , watching the trees in distant Regent 's Park shuffle and shudder under the wind 's onslaught .

source_bert_toks: tweed stood behind the heavy net curtains mask ##ing the windows of his park crescent office , watching the trees in distant regent ' s park shuffle and shudder under the wind ' s onslaught .

reference_raw: Tweed stood behind the heavy net curtains that covered the windows of his Park Crescent office, watching the trees in the distant Regent's Park shuffle and shiver under the wind.

reference_spacy_tokens: Tweed stood behind the heavy net curtains that covered the windows of his Park Crescent office , watching the trees in the distant Regent 's Park shuffle and shiver under the wind .


fn_spacy_tokens_for_baseline: In Kimber , it was held that an honest but unreasonable belief in consent is a defence to a charge of indecent assault .

source_bert_toks: in kim ##ber , it was held that an honest but unreasonable belief in consent is a defence to a charge of ind ##ece ##nt assault .

reference_raw: In Kimber, it was held that an honest but disproportionate faith in consent was a defense against a charge of indignant assault.

reference_spacy_tokens: In Kimber , it was held that an honest but disproportionate faith in consent was a defense against a charge of indignant assault .


fn_spacy_tokens_for_baseline: The sound of his music attracted a school of dolphins , whereupon Arion leapt overboard and was carried safely to shore on the back of one of the dolphins .

source_bert_toks: the sound of his music attracted a school of dolphins , whereupon ari ##on leapt overboard and was carried safely to shore on the back of one of the dolphins .

reference_raw: The sound of his music attracted a flock of dolphins, and then Arion jumped overboard and was safely carried to shore at the back of one of the dolphins.

reference_spacy_tokens: The sound of his music attracted a flock of dolphins , and then Arion jumped overboard and was safely carried to shore at the back of one of the dolphins .


fn_spacy_tokens_for_baseline: The studios sleep 2 - 3 people and the apartments sleep 2 - 4 .

source_bert_toks: the studios sleep 2 - 3 people and the apartments sleep 2 - 4 .

reference_raw: The studios are two to three people asleep, and the apartments are two to four.

reference_spacy_tokens: The studios are two to three people asleep , and the apartments are two to four .


fn_spacy_tokens_for_baseline: ' Hush up , guy .

source_bert_toks: ' hush up , guy .

reference_raw: 'Shut up, man.

reference_spacy_tokens: ' Shut up , man .


fn_spacy_tokens_for_baseline: The second and other ' alleged reason ' was to do with Potidaia , another Corinthian colony , this time in northern Greece , on the westernmost claw of the crab - like Chalcidic peninsula .

source_bert_toks: the second and other ' alleged reason ' was to do with pot ##ida ##ia , another co ##rin ##thi ##an colony , this time in northern greece , on the western ##most claw of the crab - like cha ##lc ##idi ##c peninsula .

reference_raw: The second and other 'alleged cause' was that of Potidaia, another Corinthian colony, this time in northern Greece, on the westmost claw of the crab-like Chalcidic peninsula.

reference_spacy_tokens: The second and other ' alleged cause ' was that of Potidaia , another Corinthian colony , this time in northern Greece , on the westmost claw of the crab - like Chalcidic peninsula .


fn_spacy_tokens_for_baseline: With a plastic top affixed to a metal base the ME6 looks and feels like it will stand up to a fair bit of punishment .

source_bert_toks: with a plastic top af ##fixed to a metal base the me ##6 looks and feels like it will stand up to a fair bit of punishment .

reference_raw: With a plastic top attached to a metal base, the ME6 looks like it's going to face a fair amount of punishment.

reference_spacy_tokens: With a plastic top attached to a metal base , the ME6 looks like it 's going to face a fair amount of punishment .


fn_spacy_tokens_for_baseline: Deadwood prospered and Costner was befriended by locals until they discovered he had drawn up plans for an 800-room hotel and conference centre nearby .

source_bert_toks: dead ##wood pro ##sper ##ed and cost ##ner was befriended by locals until they discovered he had drawn up plans for an 800 - room hotel and conference centre nearby .

reference_raw: Deadwood prospered and Costner made friends with the locals until they found out that he had made plans for the 800-room hotel and conference center nearby.

reference_spacy_tokens: Deadwood prospered and Costner made friends with the locals until they found out that he had made plans for the 800-room hotel and conference center nearby .


fn_spacy_tokens_for_baseline: As his fingers casually brushed her neck Laura froze , her nails biting into the palms of her hands at the sudden , shuddering quiver that zigzagged like lightning through her tired body .

source_bert_toks: as his fingers casually brushed her neck laura froze , her nails biting into the palms of her hands at the sudden , shuddering quiver that z ##ig ##za ##gged like lightning through her tired body .

reference_raw: As his fingers casually brushed her neck, Laura stiffened, her nails bit into her palms at the sudden, shivering tremor that rippled through her weary body like lightning.

reference_spacy_tokens: As his fingers casually brushed her neck , Laura stiffened , her nails bit into her palms at the sudden , shivering tremor that rippled through her weary body like lightning .


fn_spacy_tokens_for_baseline: He touched nothing , just went down the passage and looked through the half - open door , gave a whistle of amazement and came back down to use the bookseller 's phone .

source_bert_toks: he touched nothing , just went down the passage and looked through the half - open door , gave a whistle of amazement and came back down to use the books ##eller ' s phone .

reference_raw: He didn't touch anything, just walked down the corridor, looked through the half-open door, gave a gasp of surprise, and went back downstairs to use the bookseller's phone.

reference_spacy_tokens: He did n't touch anything , just walked down the corridor , looked through the half - open door , gave a gasp of surprise , and went back downstairs to use the bookseller 's phone .


fn_spacy_tokens_for_baseline: In 386 Ambrose moved relics he had just discovered in a Milan suburb to one of the new churches he had built to ring the growing city with prestigious sanctuaries ; it was a well thought out act .

source_bert_toks: in 38 ##6 ambrose moved relics he had just discovered in a milan suburb to one of the new churches he had built to ring the growing city with prestigious san ##ct ##uaries ; it was a well thought out act .

reference_raw: In 386 Ambrose had moved the relics he had just discovered in the outskirts of Milan to one of the new churches he had built to surround the growing city with prestigious sanctuaries; this was a well-thought-out act.

reference_spacy_tokens: In 386 Ambrose had moved the relics he had just discovered in the outskirts of Milan to one of the new churches he had built to surround the growing city with prestigious sanctuaries ; this was a well - thought - out act .


fn_spacy_tokens_for_baseline: The nuclear agency had hoped to monitor the larger centrifuge cascade with cameras , but Iranian officials were " not allowing the IAEA to install the cameras inside the cascade halls in Natanz and are causing further delays in the inspectors ' activity , " a diplomat who closely monitors the agency said yesterday .

source_bert_toks: the nuclear agency had hoped to monitor the larger cent ##ri ##fu ##ge cascade with cameras , but iranian officials were " not allowing the ia ##ea to install the cameras inside the cascade halls in nat ##an ##z and are causing further delays in the inspectors ' activity , " a diplomat who closely monitors the agency said yesterday .

reference_raw: The N.A.P.D. thought it would follow the larger centrifuge cascade with cameras, but Iranian officials "don't allow the I.A.E.A. to install cameras in the cascade halls of Natanz and cause further delays in the inspectors' activities," a diplomat who closely monitors the agency said yesterday.

reference_spacy_tokens: The N.A.P.D. thought it would follow the larger centrifuge cascade with cameras , but Iranian officials " do n't allow the I.A.E.A. to install cameras in the cascade halls of Natanz and cause further delays in the inspectors ' activities , " a diplomat who closely monitors the agency said yesterday .


fn_spacy_tokens_for_baseline: All those gushy words .

source_bert_toks: all those gus ##hy words .

reference_raw: All those dirty words.

reference_spacy_tokens: All those dirty words .


fn_spacy_tokens_for_baseline: The trouble is that Stephanopoulos himself helped propagate those lies in the first place .

source_bert_toks: the trouble is that stephan ##op ##oulos himself helped prop ##aga ##te those lies in the first place .

reference_raw: The problem is that Stephanopoulos himself helped spread these lies.

reference_spacy_tokens: The problem is that Stephanopoulos himself helped spread these lies .


fn_spacy_tokens_for_baseline: This is my case , ' he almost wailed .

source_bert_toks: this is my case , ' he almost wai ##led .

reference_raw: That's my case," he almost moaned.

reference_spacy_tokens: That 's my case , " he almost moaned .


fn_spacy_tokens_for_baseline: Cattle theft was recognized as a problem in the early years of British rule .

source_bert_toks: cattle theft was recognized as a problem in the early years of british rule .

reference_raw: In the early years of British rule, stealing cattle was recognised as a problem.

reference_spacy_tokens: In the early years of British rule , stealing cattle was recognised as a problem .


fn_spacy_tokens_for_baseline: Smoking is a very ancient art that has been used for hundreds of years to preserve fish and meat , preferred to salting because it does not destroy the natural flavour of the food to the same extent .

source_bert_toks: smoking is a very ancient art that has been used for hundreds of years to preserve fish and meat , preferred to salt ##ing because it does not destroy the natural flavour of the food to the same extent .

reference_raw: Smoking is a very ancient art, which has been used for centuries for the preservation of fish and meat, and is preferable to salting, since it does not destroy the natural flavour of the food to the same extent.

reference_spacy_tokens: Smoking is a very ancient art , which has been used for centuries for the preservation of fish and meat , and is preferable to salting , since it does not destroy the natural flavour of the food to the same extent .


fn_spacy_tokens_for_baseline: This is a very simple example ; it is easy to conceive of extremely varied and complex patterns of linkage appearing in various contexts .

source_bert_toks: this is a very simple example ; it is easy to con ##ce ##ive of extremely varied and complex patterns of link ##age appearing in various contexts .

reference_raw: This is a very simple example; it is easy to imagine a very diverse and complex pattern of connections that appear in different contexts.

reference_spacy_tokens: This is a very simple example ; it is easy to imagine a very diverse and complex pattern of connections that appear in different contexts .


fn_spacy_tokens_for_baseline: Topaz did n't whimper or plead .

source_bert_toks: top ##az didn ' t whimper or plead .

reference_raw: Topaz did not moan or beg.

reference_spacy_tokens: Topaz did not moan or beg .


fn_spacy_tokens_for_baseline: Even the most efficient switchboard operator will at times dial a wrong number or make an incorrect connection , but this should never cause impatience or anger , the error should be corrected as quickly as possible in a pleasing and charming manner .

source_bert_toks: even the most efficient switch ##board operator will at times dial a wrong number or make an incorrect connection , but this should never cause impatience or anger , the error should be corrected as quickly as possible in a pleasing and charming manner .

reference_raw: Even the most efficient transmission operator sometimes dials the wrong number or makes the wrong connection, but this should never cause impatience or anger, and the error should be corrected in a pleasant and charming way as soon as possible.

reference_spacy_tokens: Even the most efficient transmission operator sometimes dials the wrong number or makes the wrong connection , but this should never cause impatience or anger , and the error should be corrected in a pleasant and charming way as soon as possible .


fn_spacy_tokens_for_baseline: He finally withdrew with Rupert and , like him , was at length formally reconciled to the king , being pardoned on 3 April 1646 and created baronet on 11 June .

source_bert_toks: he finally withdrew with rupert and , like him , was at length formally reconciled to the king , being pardon ##ed on 3 april 1646 and created baronet on 11 june .

reference_raw: At last he withdrew from Rupert and, like him, was formally reconciled to the King, who was pardoned on April 3, 1646 and made a baronet on June 11th.

reference_spacy_tokens: At last he withdrew from Rupert and , like him , was formally reconciled to the King , who was pardoned on April 3 , 1646 and made a baronet on June 11th .


fn_spacy_tokens_for_baseline: ' Naturally , we are very aggrieved at the incident and are considering citing Jones for the incident in the tackle . '

source_bert_toks: ' naturally , we are very ag ##gr ##ie ##ved at the incident and are considering citing jones for the incident in the tackle . '

reference_raw: "Of course, we're very upset about the incident, and we're considering quoting Jones for the incident at hand."

reference_spacy_tokens: " Of course , we 're very upset about the incident , and we 're considering quoting Jones for the incident at hand . "


fn_spacy_tokens_for_baseline: Your description is of someone who suffers from an " endogenous mania " , though your husband would need to be clinically assessed to confirm this .

source_bert_toks: your description is of someone who suffers from an " end ##ogen ##ous mania " , though your husband would need to be clinical ##ly assessed to confirm this .

reference_raw: You describe someone suffering from endogenous mania, although your husband would have to be clinically evaluated to confirm it.

reference_spacy_tokens: You describe someone suffering from endogenous mania , although your husband would have to be clinically evaluated to confirm it .


fn_spacy_tokens_for_baseline: The panels of her door crackled open .

source_bert_toks: the panels of her door crack ##led open .

reference_raw: Her door panels cracked open.

reference_spacy_tokens: Her door panels cracked open .


fn_spacy_tokens_for_baseline: Thousands of people in Greece have been forced to evacuate their homes after major wildfires continued for their third day in the suburbs outside of Athens .

source_bert_toks: thousands of people in greece have been forced to evacuate their homes after major wild ##fires continued for their third day in the suburbs outside of athens .

reference_raw: Thousands of people in Greece were forced to evacuate their homes after major fires continued in the suburbs of Athens for the third time.

reference_spacy_tokens: Thousands of people in Greece were forced to evacuate their homes after major fires continued in the suburbs of Athens for the third time .


fn_spacy_tokens_for_baseline: The state and localities , Chafee said , sometimes get mandated to use federal homeland security funds for decontamination or preparation for bioterrorism , when the money might be better spent putting together a communications systems that would let first responders such as police , fire and rescue from different communities communicate with each other more easily . " ( Pawtucket Times , 21Apr06 , Jim Baron ) ( Link )

source_bert_toks: the state and localities , cha ##fe ##e said , sometimes get mandated to use federal homeland security funds for deco ##nta ##mina ##tion or preparation for bio ##ter ##ror ##ism , when the money might be better spent putting together a communications systems that would let first respond ##ers such as police , fire and rescue from different communities communicate with each other more easily . " ( paw ##tucket times , 21 ##ap ##r ##0 ##6 , jim baron ) ( link )

reference_raw: The state and localities, Chafee said, are sometimes mandated to use federal national security funds to decontaminate or prepare for bioterrorism, when money could be better spent putting together a communication system that would make it easier for the first responders, such as police, fire and rescue from various communities to communicate with one another." (Pawtucket Times, 21 April 2006, Jim Baron)

reference_spacy_tokens: The state and localities , Chafee said , are sometimes mandated to use federal national security funds to decontaminate or prepare for bioterrorism , when money could be better spent putting together a communication system that would make it easier for the first responders , such as police , fire and rescue from various communities to communicate with one another . " ( Pawtucket Times , 21 April 2006 , Jim Baron )


fn_spacy_tokens_for_baseline: Sufficient for me to share the sport and lend my humble help to the capture without distracting that intent brain with needless interruption .

source_bert_toks: sufficient for me to share the sport and lend my humble help to the capture without distracting that intent brain with needles ##s interruption .

reference_raw: Suffice it for me to share the sport and lend my humble help in capturing it without distracting that intensive brain with unnecessary disruption.

reference_spacy_tokens: Suffice it for me to share the sport and lend my humble help in capturing it without distracting that intensive brain with unnecessary disruption .


fn_spacy_tokens_for_baseline: They touched my heart and I know they 'll touch yours .

source_bert_toks: they touched my heart and i know they ' ll touch yours .

reference_raw: They've touched my heart, and I'm sure they're going to touch yours.

reference_spacy_tokens: They 've touched my heart , and I 'm sure they 're going to touch yours .


fn_spacy_tokens_for_baseline: They banded themselves into a society which should never be dissolved until the work was done .

source_bert_toks: they banded themselves into a society which should never be dissolved until the work was done .

reference_raw: They joined a society that should never be dissolved until the job was done.

reference_spacy_tokens: They joined a society that should never be dissolved until the job was done .


fn_spacy_tokens_for_baseline: Improved export control laws and enforcement have addressed many ( but not all ) concerns about nuclear and chemical weapons - related proliferation .

source_bert_toks: improved export control laws and enforcement have addressed many ( but not all ) concerns about nuclear and chemical weapons - related proliferation .

reference_raw: Better export control legislation and enforcement have addressed many (but not all) concerns about nuclear and chemical weapons - related proliferation.

reference_spacy_tokens: Better export control legislation and enforcement have addressed many ( but not all ) concerns about nuclear and chemical weapons - related proliferation .


fn_spacy_tokens_for_baseline: ' Why , Mr. Holmes , when you were crawling in the shrubbery at High Gable I was up one of the trees in the plantation and saw you down below .

source_bert_toks: ' why , mr . holmes , when you were crawling in the shrub ##bery at high gable i was up one of the trees in the plantation and saw you down below .

reference_raw: 'Why, Mr. Holmes, when you crawled through the bushes at High Gable, I climbed one of the trees in the plantation and saw you below.

reference_spacy_tokens: ' Why , Mr. Holmes , when you crawled through the bushes at High Gable , I climbed one of the trees in the plantation and saw you below .