fn_spacy_tokens_for_baseline: ' All the walls were black on the inside with fluorescent pink skylines of places like New York painted on .

source_bert_toks: ' all the walls were black on the inside with fluorescent pink skyline ##s of places like new york painted on .

reference_raw: On the inside, all the walls were dark, with fluorescent pink skylines painted in places like New York.

reference_spacy_tokens: On the inside , all the walls were dark , with fluorescent pink skylines painted in places like New York .


fn_spacy_tokens_for_baseline: It never ceased to amaze her that she should have given birth to such tall children .

source_bert_toks: it never ceased to ama ##ze her that she should have given birth to such tall children .

reference_raw: She never stopped wondering that she should have given birth to such tall children.

reference_spacy_tokens: She never stopped wondering that she should have given birth to such tall children .


fn_spacy_tokens_for_baseline: The product of collusion between politicians and mass media controllers to exclude threatening issues from the scope of effective electoral competition has been termed the ' mobilization of bias ' ( Schattschneider , 1960 ) .

source_bert_toks: the product of col ##lusion between politicians and mass media controllers to exclude threatening issues from the scope of effective electoral competition has been termed the ' mobilization of bias ' ( sc ##hat ##ts ##ch ##ne ##ider , 1960 ) .

reference_raw: The "mobilisation of bias" (Schattschneider, 1960) is the result of a concerted action between politicians and mass media controllers to exclude threat issues from the scope of effective electoral competition.

reference_spacy_tokens: The " mobilisation of bias " ( Schattschneider , 1960 ) is the result of a concerted action between politicians and mass media controllers to exclude threat issues from the scope of effective electoral competition .


fn_spacy_tokens_for_baseline: Further evaluation of these possibilities awaits selective study of apical and basolateral acid - base transport systems and their regulation in intact NaCl absorbing epithelia .

source_bert_toks: further evaluation of these possibilities await ##s selective study of apical and bas ##olate ##ral acid - base transport systems and their regulation in intact na ##cl absorbing ep ##ith ##elia .

reference_raw: Further assessment of these options awaits a selective analysis of the apical and basolateral acid-based transport systems and their regulation in the intact absorption of epithelia by NaCl.

reference_spacy_tokens: Further assessment of these options awaits a selective analysis of the apical and basolateral acid - based transport systems and their regulation in the intact absorption of epithelia by NaCl .


fn_spacy_tokens_for_baseline: The books of the Bible are marked by a rich diversity of genre , content , and manner .

source_bert_toks: the books of the bible are marked by a rich diversity of genre , content , and manner .

reference_raw: Bible books are marked by a rich variety of genres, contents, and manners.

reference_spacy_tokens: Bible books are marked by a rich variety of genres , contents , and manners .


fn_spacy_tokens_for_baseline: The cloud 's rising internal heat can no longer be radiated away into space , and the dust cloud -- originally resembling a giant gaseous ball like Jupiter -- becomes a warm gassy protostar .

source_bert_toks: the cloud ' s rising internal heat can no longer be radiated away into space , and the dust cloud - - originally resembling a giant gas ##eous ball like jupiter - - becomes a warm gas ##sy proto ##star .

reference_raw: The rising internal heat of the cloud can no longer be emitted into space, and the dust cloud - originally like a giant gas ball like Jupiter - becomes a warm, gassy protostar.

reference_spacy_tokens: The rising internal heat of the cloud can no longer be emitted into space , and the dust cloud - originally like a giant gas ball like Jupiter - becomes a warm , gassy protostar .


fn_spacy_tokens_for_baseline: They chained and manacled their dangerous charge once more leaving him only sufficient movement to shamble and struggle along the ancient passageways of his confinemnent

source_bert_toks: they chained and mana ##cle ##d their dangerous charge once more leaving him only sufficient movement to sham ##ble and struggle along the ancient passageway ##s of his con ##fine ##m ##nent

reference_raw: Once again they chained and harnessed their dangerous charge, leaving him only enough movement to shamble and fight along the ancient corridors of his confinement.

reference_spacy_tokens: Once again they chained and harnessed their dangerous charge , leaving him only enough movement to shamble and fight along the ancient corridors of his confinement .


fn_spacy_tokens_for_baseline: A report from the Panamanian National Human Rights Commission states that in Cocle province ' hundreds of bodies were cremated ' by troops using flame - throwers .

source_bert_toks: a report from the panama ##nian national human rights commission states that in co ##cle province ' hundreds of bodies were cremated ' by troops using flame - throw ##ers .

reference_raw: According to a report from the Panamanian National Human Rights Commission, in Cocle Province, "hundreds of bodies have been cremated by soldiers using fire-throwers.

reference_spacy_tokens: According to a report from the Panamanian National Human Rights Commission , in Cocle Province , " hundreds of bodies have been cremated by soldiers using fire - throwers .


fn_spacy_tokens_for_baseline: You meet some of the wildest , wackiest , weirdest , most fun people -- and at the same time there 's some really dark forces at work . '

source_bert_toks: you meet some of the wilde ##st , wa ##cki ##est , weird ##est , most fun people - - and at the same time there ' s some really dark forces at work . '

reference_raw: One encounters some of the wildest, wickest, strangest, most entertaining people - and at the same time, some very dark forces are at work.'

reference_spacy_tokens: One encounters some of the wildest , wickest , strangest , most entertaining people - and at the same time , some very dark forces are at work . '


fn_spacy_tokens_for_baseline: The following morning there will be an opportunity to tour some of the local cultural attractions in informal groups .

source_bert_toks: the following morning there will be an opportunity to tour some of the local cultural attractions in informal groups .

reference_raw: The next morning, we will be able to visit some of the local cultural attractions in informal groups.

reference_spacy_tokens: The next morning , we will be able to visit some of the local cultural attractions in informal groups .


fn_spacy_tokens_for_baseline: In hot weather cold poached salmon or sea bass is the lazy cook 's dream .

source_bert_toks: in hot weather cold po ##ache ##d salmon or sea bass is the lazy cook ' s dream .

reference_raw: In the hot weather, the cold poached salmon or sea bass is the dream of a sluggish cook.

reference_spacy_tokens: In the hot weather , the cold poached salmon or sea bass is the dream of a sluggish cook .


fn_spacy_tokens_for_baseline: He found its heavy odour suffocating .

source_bert_toks: he found its heavy o ##dou ##r su ##ff ##ocating .

reference_raw: He found the heavy smell smothering.

reference_spacy_tokens: He found the heavy smell smothering .


fn_spacy_tokens_for_baseline: He knew he had made a bad mistake , but despite his commitment to rebuilding his life , he just did n't count on the obstacles that would be thrown up in his path .

source_bert_toks: he knew he had made a bad mistake , but despite his commitment to rebuilding his life , he just didn ' t count on the obstacles that would be thrown up in his path .

reference_raw: He knew he'd made a terrible mistake, but despite his commitment to rebuilding his life, he simply hadn't counted on the obstacles he'd put in his way.

reference_spacy_tokens: He knew he 'd made a terrible mistake , but despite his commitment to rebuilding his life , he simply had n't counted on the obstacles he 'd put in his way .


fn_spacy_tokens_for_baseline: A senior officer in the alliance said there was no specific intelligence that Kadafi was in either of the two vehicles that were hit , which were part of the larger convoy maneuvering through the area .

source_bert_toks: a senior officer in the alliance said there was no specific intelligence that ka ##da ##fi was in either of the two vehicles that were hit , which were part of the larger convoy maneuver ##ing through the area .

reference_raw: One of the senior officers in the Alliance said there was no specific information that Kadafi was in one of the two vehicles that had been hit, and that one of the larger convoys maneuvered through the area.

reference_spacy_tokens: One of the senior officers in the Alliance said there was no specific information that Kadafi was in one of the two vehicles that had been hit , and that one of the larger convoys maneuvered through the area .


fn_spacy_tokens_for_baseline: Corporation of the US withdraws the request it had made for a license to export components to India for the Tarapur System .

source_bert_toks: corporation of the us withdraw ##s the request it had made for a license to export components to india for the tara ##pur system .

reference_raw: The U.S. Corporation withdraws its request for a licence to export parts of the Tarapur system to India.

reference_spacy_tokens: The U.S. Corporation withdraws its request for a licence to export parts of the Tarapur system to India .


fn_spacy_tokens_for_baseline: The ribbon of tarmac goes on to the lonely outpost of Leck Fell House , a speck of civilisation in a wide panorama that has no other sign of life .

source_bert_toks: the ribbon of tar ##mac goes on to the lonely outpost of le ##ck fell house , a spec ##k of civil ##isation in a wide panorama that has no other sign of life .

reference_raw: The tape of asphalt goes to the lonely base of Leck Fell House, a speck of civilization in a broad panorama with no other sign of life.

reference_spacy_tokens: The tape of asphalt goes to the lonely base of Leck Fell House , a speck of civilization in a broad panorama with no other sign of life .


fn_spacy_tokens_for_baseline: Following Alexander 's death , his lands were divided among his generals .

source_bert_toks: following alexander ' s death , his lands were divided among his generals .

reference_raw: After Alexander's death, his lands were split between his generals.

reference_spacy_tokens: After Alexander 's death , his lands were split between his generals .


fn_spacy_tokens_for_baseline: Computational biology , in the sense used above , arouses some skepticism among scientists .

source_bert_toks: computational biology , in the sense used above , ar ##ouse ##s some skepticism among scientists .

reference_raw: Computer biology, in the way used above, creates a kind of skepticism among scientists.

reference_spacy_tokens: Computer biology , in the way used above , creates a kind of skepticism among scientists .


fn_spacy_tokens_for_baseline: Long acquaintance with the clergy had convinced him that priests could not tell one layman from the next if they happened to be on their own administrative staff .

source_bert_toks: long acquaintance with the clergy had convinced him that priests could not tell one lay ##man from the next if they happened to be on their own administrative staff .

reference_raw: A long acquaintance with the priests had convinced him that priests couldn't tell one layman from another if they were on their own administrative staff.

reference_spacy_tokens: A long acquaintance with the priests had convinced him that priests could n't tell one layman from another if they were on their own administrative staff .


fn_spacy_tokens_for_baseline: She dried the udder and pulled the three - legged stool across , jamming the first bucket between her knees as she sat down , so that Florence could not kick it over .

source_bert_toks: she dried the ud ##der and pulled the three - legged stool across , jam ##ming the first bucket between her knees as she sat down , so that florence could not kick it over .

reference_raw: Drying the udder, she pulled the three-legged chair over and pushed the first bucket between her knees so Florence wouldn't be able to kick it.

reference_spacy_tokens: Drying the udder , she pulled the three - legged chair over and pushed the first bucket between her knees so Florence would n't be able to kick it .


fn_spacy_tokens_for_baseline: Amnesty International says it has learned of ' only a fraction ' of the cases in which people were imprisoned for their beliefs .

source_bert_toks: amnesty international says it has learned of ' only a fraction ' of the cases in which people were imprisoned for their beliefs .

reference_raw: Amnesty International says he's been told "only a fraction" of the cases in which people have been imprisoned for their beliefs.

reference_spacy_tokens: Amnesty International says he 's been told " only a fraction " of the cases in which people have been imprisoned for their beliefs .


fn_spacy_tokens_for_baseline: Rebels armed with assault rifles manned checkpoints along roads , searching cars for contraband and preventing civilians from entering huge swaths of the city 's southeast quadrant because of ongoing gun battles .

source_bert_toks: rebels armed with assault rifles manned checkpoint ##s along roads , searching cars for contra ##band and preventing civilians from entering huge swat ##hs of the city ' s southeast quadrant because of ongoing gun battles .

reference_raw: Rebels armed with assault rifles occupied checkpoints along the roads, looking for contraband and preventing civilians from entering the massive swaths of the southeast quadrant of the city due to ongoing gunfights.

reference_spacy_tokens: Rebels armed with assault rifles occupied checkpoints along the roads , looking for contraband and preventing civilians from entering the massive swaths of the southeast quadrant of the city due to ongoing gunfights .


fn_spacy_tokens_for_baseline: With a grimace , Donal murmured gloomily , ' He was n't exactly ecstatic at my explanation . '

source_bert_toks: with a grimace , dona ##l murmured gloom ##ily , ' he wasn ' t exactly ec ##static at my explanation . '

reference_raw: Donal muttered grimly, "He wasn't exactly excited by my explanation."

reference_spacy_tokens: Donal muttered grimly , " He was n't exactly excited by my explanation . "


fn_spacy_tokens_for_baseline: He was only a little'un , but he got one weight over his head all right .

source_bert_toks: he was only a little ' un , but he got one weight over his head all right .

reference_raw: He was just a little'un, but he's got a weight right over his head.

reference_spacy_tokens: He was just a little'un , but he 's got a weight right over his head .


fn_spacy_tokens_for_baseline: She was wonderful at her job and utterly unaware that she was fabulous to look at -- tall , slim , with a skin like magnolia blossom and astonishing hair .

source_bert_toks: she was wonderful at her job and utterly unaware that she was fabulous to look at - - tall , slim , with a skin like magnolia blossom and astonishing hair .

reference_raw: She was amazing at her work, and she didn't know how amazing she was to look at her -- tall, slender, with the skin of a magnolia flower and amazing hair.

reference_spacy_tokens: She was amazing at her work , and she did n't know how amazing she was to look at her -- tall , slender , with the skin of a magnolia flower and amazing hair .


fn_spacy_tokens_for_baseline: The full picture will not become public knowledge .

source_bert_toks: the full picture will not become public knowledge .

reference_raw: The full picture will not be publicly known.

reference_spacy_tokens: The full picture will not be publicly known .


fn_spacy_tokens_for_baseline: Tuesday , Bush warned , " Too often , on social issues , my party has painted an image of America slouching toward Gomorrah .

source_bert_toks: tuesday , bush warned , " too often , on social issues , my party has painted an image of america sl ##ou ##ching toward go ##mo ##rra ##h .

reference_raw: Tuesday, Bush said, "Too often, on social matters, my party paints a picture of America slouching toward Gomorrah.

reference_spacy_tokens: Tuesday , Bush said , " Too often , on social matters , my party paints a picture of America slouching toward Gomorrah .


fn_spacy_tokens_for_baseline: The commissioners are also probing into irregularities in the management of a Capital Development Fund to pay for construction projects .

source_bert_toks: the commissioners are also probing into irregularities in the management of a capital development fund to pay for construction projects .

reference_raw: Commissioners also report irregularities in the management of the capital development fund for the payment of construction projects.

reference_spacy_tokens: Commissioners also report irregularities in the management of the capital development fund for the payment of construction projects .


fn_spacy_tokens_for_baseline: Thank you for your letter of 8th July about suitable projects for funding by the Rural Development Programme 1993 / 94 .

source_bert_toks: thank you for your letter of 8th july about suitable projects for funding by the rural development programme 1993 / 94 .

reference_raw: Thank you for your letter of 8 July concerning the appropriate projects to be financed under the 1993/94 rural development programme.

reference_spacy_tokens: Thank you for your letter of 8 July concerning the appropriate projects to be financed under the 1993/94 rural development programme .


fn_spacy_tokens_for_baseline: It was a bit scary to cut an artery and they had cancelled their Italian holiday at once .

source_bert_toks: it was a bit scary to cut an artery and they had cancelled their italian holiday at once .

reference_raw: Cutting an artery was a little frightening, and the Italian holidays were canceled immediately.

reference_spacy_tokens: Cutting an artery was a little frightening , and the Italian holidays were canceled immediately .


fn_spacy_tokens_for_baseline: ' The object of the mulatto cook 's return ? '

source_bert_toks: ' the object of the mu ##lat ##to cook ' s return ? '

reference_raw: "What's the object of the mulatto chef's coming back?"

reference_spacy_tokens: " What 's the object of the mulatto chef 's coming back ? "


fn_spacy_tokens_for_baseline: It can take up to 30 days , dependant on temperature for a biological filter to become established .

source_bert_toks: it can take up to 30 days , depend ##ant on temperature for a biological filter to become established .

reference_raw: It may take up to 30 days to determine the biological filter, depending on the temperature.

reference_spacy_tokens: It may take up to 30 days to determine the biological filter , depending on the temperature .


fn_spacy_tokens_for_baseline: Black steam - pipes criss - cross the 1,000 acres as they always have done , hissing here and there through open valves .

source_bert_toks: black steam - pipes cr ##iss - cross the 1 , 000 acres as they always have done , hissing here and there through open valves .

reference_raw: Black steam pipes cross a thousand acres as they always do, sizzling from time to time through open valves.

reference_spacy_tokens: Black steam pipes cross a thousand acres as they always do , sizzling from time to time through open valves .


fn_spacy_tokens_for_baseline: The Dome of the Rock remains Jerusalem 's most striking monument ; it is counted among the most beautiful buildings ever created .

source_bert_toks: the dome of the rock remains jerusalem ' s most striking monument ; it is counted among the most beautiful buildings ever created .

reference_raw: The Dome of the Rock remains the most remarkable monument in Jerusalem; it counts as one of the most beautiful buildings ever built.

reference_spacy_tokens: The Dome of the Rock remains the most remarkable monument in Jerusalem ; it counts as one of the most beautiful buildings ever built .


fn_spacy_tokens_for_baseline: It catastrophically invaded the loess - covered Columbia Plateau in south - eastern Washington . and reached Pacific Ocean level via the Columbia River , 430 miles or more from the glacial dam .

source_bert_toks: it catastrophic ##ally invaded the lo ##ess - covered columbia plateau in south - eastern washington . and reached pacific ocean level via the columbia river , 430 miles or more from the glacial dam .

reference_raw: It catastrophically attacked the Loss-covered Columbia Plateau in Southeast Washington . . . and reached Pacific level through the Columbia River, 430 miles or more from the glacial dam.

reference_spacy_tokens: It catastrophically attacked the Loss - covered Columbia Plateau in Southeast Washington . . . and reached Pacific level through the Columbia River , 430 miles or more from the glacial dam .


fn_spacy_tokens_for_baseline: As you slowly lose weight you can programme little rewards for yourself , like a visit to the hairdresser for a restyle , new make - up , new glasses , a tour of the clothes shops to try out new styles , and so on .

source_bert_toks: as you slowly lose weight you can programme little rewards for yourself , like a visit to the hair ##dre ##sser for a rest ##yle , new make - up , new glasses , a tour of the clothes shops to try out new styles , and so on .

reference_raw: As you slowly lose weight, you can program small rewards for yourself, like visiting a hairdresser for a change, a new makeup, a new pair of glasses, a tour of clothing stores to try new styles, etc.

reference_spacy_tokens: As you slowly lose weight , you can program small rewards for yourself , like visiting a hairdresser for a change , a new makeup , a new pair of glasses , a tour of clothing stores to try new styles , etc .


fn_spacy_tokens_for_baseline: On Malta the reduced Axis air activity as the last of the German aircraft departed Sicily allowed more offensive action to be put in hand .

source_bert_toks: on malta the reduced axis air activity as the last of the german aircraft departed sicily allowed more offensive action to be put in hand .

reference_raw: In Malta, the reduced air activity of Axis since the last German aircraft left Sicily allowed for more aggressive action.

reference_spacy_tokens: In Malta , the reduced air activity of Axis since the last German aircraft left Sicily allowed for more aggressive action .


fn_spacy_tokens_for_baseline: I realized that Rachel had disappeared without leaving a clue and I had no way to do anything but wait for her to show up - which , if she were in a situation where I should be doing something , would probably be never .

source_bert_toks: i realized that rachel had disappeared without leaving a clue and i had no way to do anything but wait for her to show up - which , if she were in a situation where i should be doing something , would probably be never .

reference_raw: I realized that Rachel had disappeared without leaving a trace, and I had no choice but to expect her to show up-which, if she were in a position to do something, would probably never have happened.

reference_spacy_tokens: I realized that Rachel had disappeared without leaving a trace , and I had no choice but to expect her to show up - which , if she were in a position to do something , would probably never have happened .


fn_spacy_tokens_for_baseline: It is just that modern physicists seem to have more imaginative ways of naming new particles and phenomena -- they no longer restrict themselves to Greek ! )

source_bert_toks: it is just that modern physicist ##s seem to have more imaginative ways of naming new particles and phenomena - - they no longer restrict themselves to greek ! )

reference_raw: It's just that modern physicists seem to have a better idea of how to name new particles and phenomena - they're no longer limited to Greece!)

reference_spacy_tokens: It 's just that modern physicists seem to have a better idea of how to name new particles and phenomena - they 're no longer limited to Greece ! )


fn_spacy_tokens_for_baseline: However , DOD has no plans to help secure three other Russian nerve agent storage sites that store 65 percent of Russia 's declared nerve agent stockpile .

source_bert_toks: however , dod has no plans to help secure three other russian nerve agent storage sites that store 65 percent of russia ' s declared nerve agent stock ##pile .

reference_raw: However, the Ministry of Defence has no intention of helping to secure three other Russian nerve agent warehouses that store 65 per cent of Russia's declared supply of nerve agents.

reference_spacy_tokens: However , the Ministry of Defence has no intention of helping to secure three other Russian nerve agent warehouses that store 65 per cent of Russia 's declared supply of nerve agents .


fn_spacy_tokens_for_baseline: We would like to add comments about its use relevant to non - anaesthetists .

source_bert_toks: we would like to add comments about its use relevant to non - ana ##est ##het ##ists .

reference_raw: We would like to include comments on its use, which are relevant to non-anaesthetics.

reference_spacy_tokens: We would like to include comments on its use , which are relevant to non - anaesthetics .


fn_spacy_tokens_for_baseline: At one point Eva turned and gesticulated towards me , as if she were taking him to task for something he 'd done to me .

source_bert_toks: at one point eva turned and ge ##stic ##ulated towards me , as if she were taking him to task for something he ' d done to me .

reference_raw: At one point, Eva turned and gestured toward me, as if she were taking him on a mission for something he had done to me.

reference_spacy_tokens: At one point , Eva turned and gestured toward me , as if she were taking him on a mission for something he had done to me .


fn_spacy_tokens_for_baseline: The thick fingers were spattered with blobs of bright paint .

source_bert_toks: the thick fingers were spat ##tered with b ##lo ##bs of bright paint .

reference_raw: Blobs of bright paint stained his thick fingers.

reference_spacy_tokens: Blobs of bright paint stained his thick fingers .


fn_spacy_tokens_for_baseline: Hope looked down the fell where Colonel and Mrs Moore were strolling with unskilful aimlessness , taking care never to look up towards the two figures on the rump of mountain .

source_bert_toks: hope looked down the fell where colonel and mrs moore were stroll ##ing with un ##ski ##lf ##ul aim ##lessness , taking care never to look up towards the two figures on the rum ##p of mountain .

reference_raw: Hope looked down the slope, where Colonel and Mrs Moore walked with incompetent aimlessness, careful not to look up at the two figures on the top of the mountain.

reference_spacy_tokens: Hope looked down the slope , where Colonel and Mrs Moore walked with incompetent aimlessness , careful not to look up at the two figures on the top of the mountain .


fn_spacy_tokens_for_baseline: Eggs can be removed for hatching ; they should be kept in a humid place to avoid drying out , but kept clear of the water .

source_bert_toks: eggs can be removed for hatch ##ing ; they should be kept in a humid place to avoid drying out , but kept clear of the water .

reference_raw: The eggs may be removed for hatching; they should be kept in a wet place to prevent drying, but kept away from the water.

reference_spacy_tokens: The eggs may be removed for hatching ; they should be kept in a wet place to prevent drying , but kept away from the water .


fn_spacy_tokens_for_baseline: There are also handouts , which may be photocopied for personal use .

source_bert_toks: there are also hand ##outs , which may be photo ##co ##pie ##d for personal use .

reference_raw: There are also handouts that can be copied for personal use.

reference_spacy_tokens: There are also handouts that can be copied for personal use .


fn_spacy_tokens_for_baseline: The United States also learned that Iran and Russia concluded a secret protocol stipulating , among other things , construction of a gas centrifuge enrichment facility .

source_bert_toks: the united states also learned that iran and russia concluded a secret protocol st ##ip ##ulating , among other things , construction of a gas cent ##ri ##fu ##ge enrichment facility .

reference_raw: The United States has also learned that Iran and Russia have concluded a secret protocol stipulating, among other things, the building of a gas centrifuge enrichment facility.

reference_spacy_tokens: The United States has also learned that Iran and Russia have concluded a secret protocol stipulating , among other things , the building of a gas centrifuge enrichment facility .


fn_spacy_tokens_for_baseline: ' It is another punishment for our rebellion . '

source_bert_toks: ' it is another punishment for our rebellion . '

reference_raw: "That's another punishment for our insurrection."

reference_spacy_tokens: " That 's another punishment for our insurrection . "


fn_spacy_tokens_for_baseline: The idea is to rescue six scientists imprisoned by aliens .

source_bert_toks: the idea is to rescue six scientists imprisoned by aliens .

reference_raw: The idea is to save six scientists trapped by extraterrestrials.

reference_spacy_tokens: The idea is to save six scientists trapped by extraterrestrials .


fn_spacy_tokens_for_baseline: Fairbrother yelled , ' Goodbye , Toady ! ' after the Murrays ' car , and crowed loudly with his diminishing circle of admirers over his enemies ' downfall , thereby reducing his popularity still further .

source_bert_toks: fair ##bro ##ther yelled , ' goodbye , toad ##y ! ' after the murray ##s ' car , and crowe ##d loudly with his dim ##ini ##shing circle of admire ##rs over his enemies ' downfall , thereby reducing his popularity still further .

reference_raw: Fairbrother shouted, "Goodbye, Toady!" after the Murrays' car, crowing loudly with his diminishing ring of admirers over the fall of his enemies, thus reducing his popularity even further.

reference_spacy_tokens: Fairbrother shouted , " Goodbye , Toady ! " after the Murrays ' car , crowing loudly with his diminishing ring of admirers over the fall of his enemies , thus reducing his popularity even further .


fn_spacy_tokens_for_baseline: She tries to prise them from my invisible grasp .

source_bert_toks: she tries to pri ##se them from my invisible grasp .

reference_raw: He's trying to get them out of my invisible grip.

reference_spacy_tokens: He 's trying to get them out of my invisible grip .


fn_spacy_tokens_for_baseline: Such a heroic venture requires heroic singing , and that is where it seemed this enthralling evening would fall short of its target .

source_bert_toks: such a heroic venture requires heroic singing , and that is where it seemed this en ##th ##ral ##ling evening would fall short of its target .

reference_raw: Such a heroic venture requires heroic singing, and it seemed that this enchanting evening would fall short of its goal.

reference_spacy_tokens: Such a heroic venture requires heroic singing , and it seemed that this enchanting evening would fall short of its goal .


fn_spacy_tokens_for_baseline: Neil Cardow , 25 , had knifed John Kerr , 24 , nine times after he got the better of Cardow in a fight .

source_bert_toks: neil card ##ow , 25 , had knife ##d john kerr , 24 , nine times after he got the better of card ##ow in a fight .

reference_raw: Neil Cardow, 25 years old, stabbed John Kerr 24, 9 times after he got a better cardow fight.

reference_spacy_tokens: Neil Cardow , 25 years old , stabbed John Kerr 24 , 9 times after he got a better cardow fight .


fn_spacy_tokens_for_baseline: One noticeable difference in the use of conjunctions which is well documented in the literature is that between English and Arabic .

source_bert_toks: one noticeable difference in the use of conjunction ##s which is well documented in the literature is that between english and arabic .

reference_raw: One noticeable distinction between English and Arabic in the use of combinations, which is well documented in the literature.

reference_spacy_tokens: One noticeable distinction between English and Arabic in the use of combinations , which is well documented in the literature .


fn_spacy_tokens_for_baseline: His body was bony against her .

source_bert_toks: his body was bony against her .

reference_raw: He had a bone in his body against her.

reference_spacy_tokens: He had a bone in his body against her .


fn_spacy_tokens_for_baseline: The hound grunted with pain and he let it fall limp at his feet , a small dark trickle of blood flowing from one nostril .

source_bert_toks: the hound grunted with pain and he let it fall limp at his feet , a small dark trickle of blood flowing from one nos ##tri ##l .

reference_raw: The dog grunted in pain, and he let it limp at his feet, a small dark stream of blood flowing from one nostril.

reference_spacy_tokens: The dog grunted in pain , and he let it limp at his feet , a small dark stream of blood flowing from one nostril .


fn_spacy_tokens_for_baseline: A plump , pretty girl , with a sensible scarf , two badges on the lapel of her corduroy overcoat , her face and stance vibrant , unflinching , exalted .

source_bert_toks: a plump , pretty girl , with a sensible scarf , two badges on the lap ##el of her cord ##uro ##y over ##coat , her face and stance vibrant , un ##fl ##in ##ching , ex ##al ##ted .

reference_raw: A fat, pretty girl with a sensible scarf, two badges on the lapel of a corduroy coat, her face and posture vibrant, unflinching, exalted.

reference_spacy_tokens: A fat , pretty girl with a sensible scarf , two badges on the lapel of a corduroy coat , her face and posture vibrant , unflinching , exalted .


fn_spacy_tokens_for_baseline: Violence flared first in Helston , where an angry crowd of about a thousand gathered as William Body , a Commissioner charged with destroying every relic of popery , was desecrating the Church .

source_bert_toks: violence flared first in he ##lston , where an angry crowd of about a thousand gathered as william body , a commissioner charged with destroying every relic of pope ##ry , was des ##ec ##rating the church .

reference_raw: Violence flared first in Helston, where the church was desecrated by an angry mob of a thousand or so, as William Body, the commissioner charged with the destruction of all the remnants of the Pope.

reference_spacy_tokens: Violence flared first in Helston , where the church was desecrated by an angry mob of a thousand or so , as William Body , the commissioner charged with the destruction of all the remnants of the Pope .


fn_spacy_tokens_for_baseline: She blinked as they emerged into blinding brightness and searing heat , and paused to fumble for her sunglasses before they descended the broad flight of steps that led down to the canal .

source_bert_toks: she blinked as they emerged into blinding brightness and searing heat , and paused to fumble for her sunglasses before they descended the broad flight of steps that led down to the canal .

reference_raw: She blinked as they came out into the blinding brightness and burning heat, and stopped to fumble for her sunglasses before they descended the wide flight of stairs leading down to the canal.

reference_spacy_tokens: She blinked as they came out into the blinding brightness and burning heat , and stopped to fumble for her sunglasses before they descended the wide flight of stairs leading down to the canal .


fn_spacy_tokens_for_baseline: Step - family life is multi - dimensional and multi - faceted , making it a complex arena for parents and children to live in , or practitioners to work in .

source_bert_toks: step - family life is multi - dimensional and multi - face ##ted , making it a complex arena for parents and children to live in , or practitioners to work in .

reference_raw: Step-family life is multi-dimensional and multi-faceted, making it a complex area for parents and children to live in, or for professionals to work in.

reference_spacy_tokens: Step - family life is multi - dimensional and multi - faceted , making it a complex area for parents and children to live in , or for professionals to work in .


fn_spacy_tokens_for_baseline: It may seem a lot to you , but for a cast - iron story that might bring down a government , it 's cheap at the price , believe me .

source_bert_toks: it may seem a lot to you , but for a cast - iron story that might bring down a government , it ' s cheap at the price , believe me .

reference_raw: This may seem a lot to you, but for a cast iron story that could bring down a government, it's inexpensive at the cost, believe me.

reference_spacy_tokens: This may seem a lot to you , but for a cast iron story that could bring down a government , it 's inexpensive at the cost , believe me .


fn_spacy_tokens_for_baseline: Separation was bound to be painful , and the republics are now in the middle of their most serious tiff since independence .

source_bert_toks: separation was bound to be painful , and the republics are now in the middle of their most serious ti ##ff since independence .

reference_raw: The separation must have been painful, and the Republics are now in the midst of the most serious problems since independence.

reference_spacy_tokens: The separation must have been painful , and the Republics are now in the midst of the most serious problems since independence .


fn_spacy_tokens_for_baseline: It has secured and increased the supply of water .

source_bert_toks: it has secured and increased the supply of water .

reference_raw: It has secured and enhanced water supply.

reference_spacy_tokens: It has secured and enhanced water supply .


fn_spacy_tokens_for_baseline: Proof of this crime must be established by confession or by four witnesses .

source_bert_toks: proof of this crime must be established by confession or by four witnesses .

reference_raw: Proof of such a crime must be proved by admission or by four witnesses.

reference_spacy_tokens: Proof of such a crime must be proved by admission or by four witnesses .


fn_spacy_tokens_for_baseline: A facade has a function as an ornament to a town as well as cloaking a building .

source_bert_toks: a facade has a function as an or ##name ##nt to a town as well as cloak ##ing a building .

reference_raw: The facade has the function of decorating the city and camouflaging the building.

reference_spacy_tokens: The facade has the function of decorating the city and camouflaging the building .


fn_spacy_tokens_for_baseline: Muscovy 's major European rivals were investing in full - time professional infantry and modernized cavalry using firearms .

source_bert_toks: mu ##sco ##vy ' s major european rivals were investing in full - time professional infantry and modernized cavalry using firearms .

reference_raw: The main European rivals in Muscovy invested in full-time professional infantry and modernized cavalry with weapons.

reference_spacy_tokens: The main European rivals in Muscovy invested in full - time professional infantry and modernized cavalry with weapons .


fn_spacy_tokens_for_baseline: North Korean government statements and media reports often cite a " nuclear threat from the United States , " and continue to claim that the United States has about 1,000 nuclear weapons deployed in South Korea .

source_bert_toks: north korean government statements and media reports often cite a " nuclear threat from the united states , " and continue to claim that the united states has about 1 , 000 nuclear weapons deployed in south korea .

reference_raw: North Korean government statements and media reports often refer to the "nuclear danger of the US" and continue to claim that the US has around 1,000 nuclear weapons deployed in South Korea.

reference_spacy_tokens: North Korean government statements and media reports often refer to the " nuclear danger of the US " and continue to claim that the US has around 1,000 nuclear weapons deployed in South Korea .


fn_spacy_tokens_for_baseline: For one moment he almost fell again , then he thrust one leg forward , finding his balance .

source_bert_toks: for one moment he almost fell again , then he thrust one leg forward , finding his balance .

reference_raw: He almost fell again for a moment, then pushed his foot forward and found his balance.

reference_spacy_tokens: He almost fell again for a moment , then pushed his foot forward and found his balance .


fn_spacy_tokens_for_baseline: Responsibility for the stocking and issue of computer disks , printer ribbons and laser printer toner cartridges will be transferred to Stationery with effect from .

source_bert_toks: responsibility for the stock ##ing and issue of computer disks , printer ribbons and laser printer tone ##r cartridges will be transferred to station ##ery with effect from .

reference_raw: Responsibility for storing and issuing computer disks, printer ribbons and laser printer toner shells shall be transferred to Stationery with effect from .

reference_spacy_tokens: Responsibility for storing and issuing computer disks , printer ribbons and laser printer toner shells shall be transferred to Stationery with effect from .


fn_spacy_tokens_for_baseline: She 'd been incarcerated for thirty years or so , poor imbecile .

source_bert_toks: she ' d been incarcerated for thirty years or so , poor im ##be ##ci ##le .

reference_raw: She's been locked up for about thirty years, poor idiot.

reference_spacy_tokens: She 's been locked up for about thirty years , poor idiot .


fn_spacy_tokens_for_baseline: PP helped in planning the study , collecting the data and writing the manuscript .

source_bert_toks: pp helped in planning the study , collecting the data and writing the manuscript .

reference_raw: PP helped plan the study, collect the data, and compile the manuscript.

reference_spacy_tokens: PP helped plan the study , collect the data , and compile the manuscript .


fn_spacy_tokens_for_baseline: I had become a skinny , sickly , snuffly bronchial child .

source_bert_toks: i had become a skinny , sick ##ly , s ##nu ##ff ##ly bro ##nch ##ial child .

reference_raw: I became a thin, sickly, snuffy bronchial child.

reference_spacy_tokens: I became a thin , sickly , snuffy bronchial child .


fn_spacy_tokens_for_baseline: At the time , the force declined to name the five cases under investigation .

source_bert_toks: at the time , the force declined to name the five cases under investigation .

reference_raw: At that time, the force refused to name the five cases in question.

reference_spacy_tokens: At that time , the force refused to name the five cases in question .


fn_spacy_tokens_for_baseline: The military has rounded up dozens of officials of the Islamist group and bombarded such targets as Prime Minister Ismail Haniyeh 's office and the Hamas - run Interior Ministry .

source_bert_toks: the military has rounded up dozens of officials of the islamist group and bomb ##arded such targets as prime minister ismail han ##iy ##eh ' s office and the hamas - run interior ministry .

reference_raw: The army gathered dozens of Islamist officials and bombed targets such as the office of Prime Minister Ismail Haniyeh and the Home Office of Hamas.

reference_spacy_tokens: The army gathered dozens of Islamist officials and bombed targets such as the office of Prime Minister Ismail Haniyeh and the Home Office of Hamas .


fn_spacy_tokens_for_baseline: Earlier we had been told that some ' lascivious ' nudes were ' a sign of increasing decadence at the centre of an inflexible regime ' , a phrase with some deeply troubling echoes of vocabulary .

source_bert_toks: earlier we had been told that some ' las ##ci ##vious ' nude ##s were ' a sign of increasing decade ##nce at the centre of an in ##fle ##xi ##ble regime ' , a phrase with some deeply tr ##ou ##bling echoes of vocabulary .

reference_raw: We were told earlier that some of the 'lascivious' nudes were 'a sign of increasing decadence at the center of an inflexible regime', a phrase with a deeply disturbing echo of vocabulary.

reference_spacy_tokens: We were told earlier that some of the ' lascivious ' nudes were ' a sign of increasing decadence at the center of an inflexible regime ' , a phrase with a deeply disturbing echo of vocabulary .


fn_spacy_tokens_for_baseline: She also knew that he liked to boast and she would egg him on shamelessly .

source_bert_toks: she also knew that he liked to bo ##ast and she would egg him on shame ##lessly .

reference_raw: She knew he liked to brag about it, too, and she would have egged him shamelessly.

reference_spacy_tokens: She knew he liked to brag about it , too , and she would have egged him shamelessly .


fn_spacy_tokens_for_baseline: An unknown portion of CW agents are stored in bulk , but a significant portion is reported to be filled into artillery shells and rocket warheads .

source_bert_toks: an unknown portion of cw agents are stored in bulk , but a significant portion is reported to be filled into artillery shells and rocket war ##heads .

reference_raw: An unknown portion of CW agents is stored in bulk, but a significant part is reported to have been filled with artillery shells and missiles.

reference_spacy_tokens: An unknown portion of CW agents is stored in bulk , but a significant part is reported to have been filled with artillery shells and missiles .


fn_spacy_tokens_for_baseline: ' Does n't matter but he must be nice , ' Sarah pulled thoughtfully at her pink hair ribbon .

source_bert_toks: ' doesn ' t matter but he must be nice , ' sarah pulled thoughtfully at her pink hair ribbon .

reference_raw: 'It doesn't matter, but it's got to be nice,' Sarah pulled thoughtfully at her pink hair band.

reference_spacy_tokens: ' It does n't matter , but it 's got to be nice , ' Sarah pulled thoughtfully at her pink hair band .


fn_spacy_tokens_for_baseline: The gaucho was a swarthy old man in a red woollen cap and a leather jacket ; his saddle was a grubby sheepskin , and the horse 's nose was bridled with a yellow wool cabeza .

source_bert_toks: the ga ##uch ##o was a sw ##arth ##y old man in a red wool ##len cap and a leather jacket ; his saddle was a gr ##ub ##by sheep ##skin , and the horse ' s nose was br ##id ##led with a yellow wool cab ##eza .

reference_raw: The gaucho was a dark old man in a red wool hat and a leather jacket; his saddle was a grubby sheepskin, and the horse's nose was covered with a yellow wool cabeza.

reference_spacy_tokens: The gaucho was a dark old man in a red wool hat and a leather jacket ; his saddle was a grubby sheepskin , and the horse 's nose was covered with a yellow wool cabeza .


fn_spacy_tokens_for_baseline: But emotionally he was pitiful , held to ransom by an appalling wife .

source_bert_toks: but emotionally he was pit ##iful , held to ransom by an app ##all ##ing wife .

reference_raw: But he was emotionally pathetic, held for ransom by a horrible woman.

reference_spacy_tokens: But he was emotionally pathetic , held for ransom by a horrible woman .


fn_spacy_tokens_for_baseline: ' I know you will , honey , ' she murmured , fondly brushing the pale blonde curls from the child 's brow before walking slowly back to rejoin her friend .

source_bert_toks: ' i know you will , honey , ' she murmured , fond ##ly brushing the pale blonde curls from the child ' s brow before walking slowly back to rejoin her friend .

reference_raw: "I know you will, honey," she whispered, fondly brushing the pale blond curls from the baby's forehead before slowly returning to her friend.

reference_spacy_tokens: " I know you will , honey , " she whispered , fondly brushing the pale blond curls from the baby 's forehead before slowly returning to her friend .


fn_spacy_tokens_for_baseline: That is due partly to the sticky summer which saw Englishmen dare to walk open - necked in daylight .

source_bert_toks: that is due partly to the sticky summer which saw english ##men dare to walk open - neck ##ed in daylight .

reference_raw: This is partly because of the sticky summer that has seen the English dare to go open-necked in the daytime.

reference_spacy_tokens: This is partly because of the sticky summer that has seen the English dare to go open - necked in the daytime .


fn_spacy_tokens_for_baseline: The first batch of 50 units costs 10 per unit and the second batch of 50 identical units costs 20 per unit because of inflation .

source_bert_toks: the first batch of 50 units costs 10 per unit and the second batch of 50 identical units costs 20 per unit because of inflation .

reference_raw: The first lot of 50 units is 10 per unit and the second lot of 50 identical units is 20 per unit due to inflation.

reference_spacy_tokens: The first lot of 50 units is 10 per unit and the second lot of 50 identical units is 20 per unit due to inflation .


fn_spacy_tokens_for_baseline: Three things I did n't know about her , one , she 's painted a kid 's playroom in primary colours , red , yellow , blue and green , that 's gloss on walls etcetera .

source_bert_toks: three things i didn ' t know about her , one , she ' s painted a kid ' s play ##room in primary colours , red , yellow , blue and green , that ' s gloss on walls etc ##eter ##a .

reference_raw: Three things I didn't know about her, one of them, she painted the children's room in primary colors, red, yellow, blue, and green, that's glistening on the walls and so on.

reference_spacy_tokens: Three things I did n't know about her , one of them , she painted the children 's room in primary colors , red , yellow , blue , and green , that 's glistening on the walls and so on .


fn_spacy_tokens_for_baseline: Kevin Mack , the Cleveland full - back and two - time Pro Bowl selection , was yesterday sentenced to six months in prison after pleading guilty in August to using cocaine .

source_bert_toks: kevin mack , the cleveland full - back and two - time pro bowl selection , was yesterday sentenced to six months in prison after pleading guilty in august to using cocaine .

reference_raw: Kevin Mack, Cleveland's full-back and double selection of the Pro Bowl, was sentenced to six months in prison yesterday after confessing to the use of coke in August.

reference_spacy_tokens: Kevin Mack , Cleveland 's full - back and double selection of the Pro Bowl , was sentenced to six months in prison yesterday after confessing to the use of coke in August .


fn_spacy_tokens_for_baseline: Even the criteria of logic ' are not a direct gift from God but arise out of and are intelligible only in the context of ways of living or modes of social life ' .

source_bert_toks: even the criteria of logic ' are not a direct gift from god but arise out of and are intel ##li ##gible only in the context of ways of living or modes of social life ' .

reference_raw: Even the criteria of logic 'are not a direct gift from God, but arise from and are understandable only in relation to the ways of life or the ways of social life'.

reference_spacy_tokens: Even the criteria of logic ' are not a direct gift from God , but arise from and are understandable only in relation to the ways of life or the ways of social life ' .


fn_spacy_tokens_for_baseline: The adequate return of organic wastes to the soil through its own decaying vegetation , grazing animals , rotted farmyard manures , and the avoidance of continuous extractive cropping is the primary measure required to maintain fertility .

source_bert_toks: the adequate return of organic waste ##s to the soil through its own decay ##ing vegetation , grazing animals , rot ##ted farm ##yard man ##ures , and the avoidance of continuous extract ##ive crop ##ping is the primary measure required to maintain fertility .

reference_raw: One of the main measures necessary for maintaining fertility is the appropriate return of organic waste to the soil through its own decaying vegetation, grazing animals, rotten farmyard manure and the prevention of continuous harvesting.

reference_spacy_tokens: One of the main measures necessary for maintaining fertility is the appropriate return of organic waste to the soil through its own decaying vegetation , grazing animals , rotten farmyard manure and the prevention of continuous harvesting .


fn_spacy_tokens_for_baseline: It ferries commuters from the Mid - Levels apartment complexes downhill from 6 to 10 am , and uphill from 10 am to midnight .

source_bert_toks: it ferries commuter ##s from the mid - levels apartment complexes downhill from 6 to 10 ##am , and up ##hill from 10 ##am to midnight .

reference_raw: It ferryes commuters from mid-level apartment complexes downhill from 6:00 a.m. to 10:00 a.m. and uphill from 10:00 a.m. to midnight.

reference_spacy_tokens: It ferryes commuters from mid - level apartment complexes downhill from 6:00 a.m. to 10:00 a.m. and uphill from 10:00 a.m. to midnight .


fn_spacy_tokens_for_baseline: The men , stripped to breech - cloths , plunged into the torrential waters on horseback , and hauled the women and children across on great buffalo - robe bundles filled with their belongings .

source_bert_toks: the men , stripped to bree ##ch - cloth ##s , plunged into the torre ##ntial waters on horseback , and hauled the women and children across on great buffalo - robe bundles filled with their belongings .

reference_raw: The men, undressed in their breech clothes, rode their horses into the torrential water and dragged the women and children to the other side in large bundles of buffalo robes filled with their belongings.

reference_spacy_tokens: The men , undressed in their breech clothes , rode their horses into the torrential water and dragged the women and children to the other side in large bundles of buffalo robes filled with their belongings .


fn_spacy_tokens_for_baseline: Mr Lamont said the move would take the Government two - thirds of the way down the road to the Rio commitment on global warming , signed at the Earth Summit last June by the Prime Minister .

source_bert_toks: mr lam ##ont said the move would take the government two - thirds of the way down the road to the rio commitment on global warming , signed at the earth summit last june by the prime minister .

reference_raw: Mr. Lamont said that the move would take the government two-thirds of the way to the Rio Global Warming Commitment, which was agreed by the Prime Minister at the Earth Summit last June.

reference_spacy_tokens: Mr. Lamont said that the move would take the government two - thirds of the way to the Rio Global Warming Commitment , which was agreed by the Prime Minister at the Earth Summit last June .


fn_spacy_tokens_for_baseline: Kitchen full of broken crystal .

source_bert_toks: kitchen full of broken crystal .

reference_raw: A kitchen filled with broken crystals.

reference_spacy_tokens: A kitchen filled with broken crystals .


fn_spacy_tokens_for_baseline: The other factor was public opinion , and pressure from opposition groups began to mount .

source_bert_toks: the other factor was public opinion , and pressure from opposition groups began to mount .

reference_raw: The second factor was public opinion, and the push of opposition groups was mounting.

reference_spacy_tokens: The second factor was public opinion , and the push of opposition groups was mounting .


fn_spacy_tokens_for_baseline: Earlier Saturday , a plane was shot down over the outskirts of Benghazi , sending up a massive black cloud of smoke .

source_bert_toks: earlier saturday , a plane was shot down over the outskirts of ben ##gh ##azi , sending up a massive black cloud of smoke .

reference_raw: Earlier Saturday, a plane was shot over the edge of Benghazi, sending out a huge black cloud of smoke.

reference_spacy_tokens: Earlier Saturday , a plane was shot over the edge of Benghazi , sending out a huge black cloud of smoke .


fn_spacy_tokens_for_baseline: He enjoyed the old man 's bluntness -- a trait which had grown more pronounced with every year .

source_bert_toks: he enjoyed the old man ' s blunt ##ness - - a trait which had grown more pronounced with every year .

reference_raw: He liked the old man's audacity - a feature that grew stronger every year.

reference_spacy_tokens: He liked the old man 's audacity - a feature that grew stronger every year .


fn_spacy_tokens_for_baseline: Boys who were caned at school for smoking were found to be more likely to increase their smoking than those not caned .

source_bert_toks: boys who were cane ##d at school for smoking were found to be more likely to increase their smoking than those not cane ##d .

reference_raw: It was found that the boys who smoked in school were more likely to increase their smoking than the ones who didn't.

reference_spacy_tokens: It was found that the boys who smoked in school were more likely to increase their smoking than the ones who did n't .


fn_spacy_tokens_for_baseline: The foal cringes , lowering its shoulders , extending its neck , and raising its muzzle up to the other horse .

source_bert_toks: the f ##oa ##l cr ##inge ##s , lowering its shoulders , extending its neck , and raising its muzzle up to the other horse .

reference_raw: The foal cringes, lowers its shoulders, stretches its neck, and lifts its mouth to the other horse.

reference_spacy_tokens: The foal cringes , lowers its shoulders , stretches its neck , and lifts its mouth to the other horse .


fn_spacy_tokens_for_baseline: She was staring at a party of five men , heavily armed , who had appeared from behind a rock pile and now stood , several metres away , pointing machine guns at us .

source_bert_toks: she was staring at a party of five men , heavily armed , who had appeared from behind a rock pile and now stood , several metres away , pointing machine guns at us .

reference_raw: She stared at a group of five men, heavily armed, who had emerged from behind a pile of rock and were standing a few meters away, pointing machine guns at us.

reference_spacy_tokens: She stared at a group of five men , heavily armed , who had emerged from behind a pile of rock and were standing a few meters away , pointing machine guns at us .


fn_spacy_tokens_for_baseline: It frequently unites with neighbouring sclerites , or it may be divided into a pair of plates .

source_bert_toks: it frequently unite ##s with neighbouring sc ##ler ##ites , or it may be divided into a pair of plates .

reference_raw: It often combines with adjacent sclerites or can be divided into two plates.

reference_spacy_tokens: It often combines with adjacent sclerites or can be divided into two plates .


fn_spacy_tokens_for_baseline: However , Iran continues to retain a strong incentive for developing a defensive CW program .

source_bert_toks: however , iran continues to retain a strong incentive for developing a defensive cw program .

reference_raw: But Iran remains strongly motivated to develop a defense program for the CW.

reference_spacy_tokens: But Iran remains strongly motivated to develop a defense program for the CW .


fn_spacy_tokens_for_baseline: A useful feature divides the working area into multiple screens , each of which can display a selected part of the main drawing at any level of magnification .

source_bert_toks: a useful feature divides the working area into multiple screens , each of which can display a selected part of the main drawing at any level of mag ##ni ##fication .

reference_raw: The useful function divides the workspace into multiple screens, each of which can display a selected portion of the main drawing at any level of enlargement.

reference_spacy_tokens: The useful function divides the workspace into multiple screens , each of which can display a selected portion of the main drawing at any level of enlargement .


fn_spacy_tokens_for_baseline: She saw them then , with shattering clarity ; they crowded the dunes in a cold eddying radiance , each spear - point a spark of light , grimly staring as if from a trance .

source_bert_toks: she saw them then , with shattering clarity ; they crowded the dunes in a cold eddy ##ing ra ##dian ##ce , each spear - point a spark of light , grimly staring as if from a trance .

reference_raw: Then she saw them with shattering clarity; they filled the dunes with a cool, radiant glow, each spear-point a spark of light, staring grimly as if from a trance.

reference_spacy_tokens: Then she saw them with shattering clarity ; they filled the dunes with a cool , radiant glow , each spear - point a spark of light , staring grimly as if from a trance .


fn_spacy_tokens_for_baseline: This religious ban compounded the chronic shortage of grazing land .

source_bert_toks: this religious ban compound ##ed the chronic shortage of grazing land .

reference_raw: This religious ban has compounded a long-term lack of pasture.

reference_spacy_tokens: This religious ban has compounded a long - term lack of pasture .


fn_spacy_tokens_for_baseline: Oocytes were transferred into tubes containing Hepes - buffered TCM-199 ( Gibco BRL , Grand Island , NY ) supplemented with 0.57 mM cysteine , 10 ng / ml epidermal growth factor ( Sigma ) , 100 IU / ml penicillin , 100 ? g / ml streptomycin , 0.25 ng / ml amphotericin , 0.01 IU / ml porcine FSH ( Sioux Biochemicals , Sioux Center , IA ) , 0.01 IU / ml porcine LH ( Sioux Biochemicals ) and 0.1 % ( w : v ) polyvinyl alcohol ( maturation medium ) [ 50 ] , and shipped to the laboratory overnight ( 20 - 24 h ) at 38 .

source_bert_toks: o ##ocytes were transferred into tubes containing he ##pes - buffer ##ed tc ##m - 199 ( gi ##bc ##o br ##l , grand island , ny ) supplemented with 0 . 57 mm cy ##stein ##e , 10 ng / ml ep ##ider ##mal growth factor ( sigma ) , 100 i ##u / ml pen ##ici ##llin , 100 ? g / ml st ##re ##pt ##omy ##cin , 0 . 25 ng / ml amp ##hot ##eric ##in , 0 . 01 i ##u / ml por ##cine f ##sh ( sioux bio ##chemical ##s , sioux center , ia ) , 0 . 01 i ##u / ml por ##cine l ##h ( sioux bio ##chemical ##s ) and 0 . 1 % ( w : v ) poly ##vin ##yl alcohol ( mat ##uration medium ) [ 50 ] , and shipped to the laboratory overnight ( 20 - 24 h ) at 38 .

reference_raw: Oocytes were transported to tubes containing Hepes - buffered TCM-199 (Gibco BRL, Grand Island, New York) supplemented with 0.57 mm cystein, 10 ng/ml epidermal growth factor (Sigma), 100 IU/ml penicillin, 100 mL streptomycin, 0.25 ng/ml amphotericin, 0.01 IU/ml porcine) FSH (Sioux Biochemicals, Sioux Center, IA), 0.01 IU/ml Porcine LH (Sioux Biochemicals) and 0.1% (w:v) Polyvinyl alcohol (maturation medium) [50] and shipped overnight (20-24 hours) at 38.

reference_spacy_tokens: Oocytes were transported to tubes containing Hepes - buffered TCM-199 ( Gibco BRL , Grand Island , New York ) supplemented with 0.57 mm cystein , 10 ng / ml epidermal growth factor ( Sigma ) , 100 IU / ml penicillin , 100 mL streptomycin , 0.25 ng / ml amphotericin , 0.01 IU / ml porcine ) FSH ( Sioux Biochemicals , Sioux Center , IA ) , 0.01 IU / ml Porcine LH ( Sioux Biochemicals ) and 0.1 % ( w : v ) Polyvinyl alcohol ( maturation medium ) [ 50 ] and shipped overnight ( 20 - 24 hours ) at 38 .


fn_spacy_tokens_for_baseline: Cleo could not understand why Dauntless was not similarly enchanted by the place .

source_bert_toks: cl ##eo could not understand why da ##unt ##less was not similarly enchanted by the place .

reference_raw: Cleo couldn't understand why Dauntless didn't like it.

reference_spacy_tokens: Cleo could n't understand why Dauntless did n't like it .


fn_spacy_tokens_for_baseline: For us , the only difference is that the barriers which we have to address are dissimilar to those faced by able - bodied people .

source_bert_toks: for us , the only difference is that the barriers which we have to address are di ##ssi ##mi ##lar to those faced by able - bodied people .

reference_raw: For us, the only difference is that the obstacles we face are different from those faced by capable people.

reference_spacy_tokens: For us , the only difference is that the obstacles we face are different from those faced by capable people .


fn_spacy_tokens_for_baseline: Produces chemical agents and is capable of use on limited scale .

source_bert_toks: produces chemical agents and is capable of use on limited scale .

reference_raw: It produces chemical agents and is able to be applied on a limited scale.

reference_spacy_tokens: It produces chemical agents and is able to be applied on a limited scale .


fn_spacy_tokens_for_baseline: The Iranians tacitly agreed and the War of the Cities was over .

source_bert_toks: the iranian ##s ta ##cit ##ly agreed and the war of the cities was over .

reference_raw: The Iranians tacitly agreed, and the war of the cities ended.

reference_spacy_tokens: The Iranians tacitly agreed , and the war of the cities ended .


fn_spacy_tokens_for_baseline: Once on the other side turn left to follow the stream to the stepping stones across the East Dart .

source_bert_toks: once on the other side turn left to follow the stream to the stepping stones across the east dart .

reference_raw: Once on the other side, turn left and follow the river to the stepping stones on the other side of the East Dart.

reference_spacy_tokens: Once on the other side , turn left and follow the river to the stepping stones on the other side of the East Dart .


fn_spacy_tokens_for_baseline: " With the aid of Indian companies , Iran is nearing the completion of a secret poison - gas plant , which was claimed by the Indian companies to be a pesticide factory . "

source_bert_toks: " with the aid of indian companies , iran is nearing the completion of a secret poison - gas plant , which was claimed by the indian companies to be a pest ##icide factory . "

reference_raw: "With the help of Indian companies, Iran is approaching the completion of a secret poison, a gas plant that Indian companies say is a pesticide plant."

reference_spacy_tokens: " With the help of Indian companies , Iran is approaching the completion of a secret poison , a gas plant that Indian companies say is a pesticide plant . "


fn_spacy_tokens_for_baseline: Flora 's coolness carried her through a dinner attended by the head of a platoon of soldiers on Skye to apprehend the Prince , who was then conducted to Raasay .

source_bert_toks: flora ' s cool ##ness carried her through a dinner attended by the head of a platoon of soldiers on skye to app ##re ##hend the prince , who was then conducted to ra ##asa ##y .

reference_raw: Flora's coldness carried her through a dinner attended by a squad of soldiers on Skye to arrest the Prince, who was then carried to Raasay.

reference_spacy_tokens: Flora 's coldness carried her through a dinner attended by a squad of soldiers on Skye to arrest the Prince , who was then carried to Raasay .


fn_spacy_tokens_for_baseline: The report calculates that acid rain throughout Europe causes between £ 200 billion and £ 600 billion of damage to lakes , forests , crops , buildings and human health every year .

source_bert_toks: the report calculate ##s that acid rain throughout europe causes between £2 ##00 billion and £ ##60 ##0 billion of damage to lakes , forests , crops , buildings and human health every year .

reference_raw: According to the report, acid rain in Europe brings about £200 billion to £600 billion in damage to lakes, forests, crops, buildings and human health every year.

reference_spacy_tokens: According to the report , acid rain in Europe brings about £ 200 billion to £ 600 billion in damage to lakes , forests , crops , buildings and human health every year .


fn_spacy_tokens_for_baseline: We squelched across the field , finally reaching the altar , a single slate slab mounted on stones , on the side of a bank overlooking a tangle of briars .

source_bert_toks: we sq ##uel ##ched across the field , finally reaching the altar , a single slate slab mounted on stones , on the side of a bank overlooking a tangle of br ##ia ##rs .

reference_raw: We squirmed across the field, and at last we came to the altar, a single slab mounted on the rocks, on the side of the bank, overlooking the tangle of briars.

reference_spacy_tokens: We squirmed across the field , and at last we came to the altar , a single slab mounted on the rocks , on the side of the bank , overlooking the tangle of briars .


fn_spacy_tokens_for_baseline: In 1870 , Prussian Chancellor Bismarck exploited an obscure diplomatic conflict with France to unite the various German principalities and kingdoms into a fighting force well equipped for war .

source_bert_toks: in 1870 , prussian chancellor bismarck exploited an obscure diplomatic conflict with france to unite the various german principal ##ities and kingdoms into a fighting force well equipped for war .

reference_raw: In 1870, Prussian Chancellor Bismarck used an obscure diplomatic conflict with France to unite the various German principalities and kingdoms into a military unit well equipped for war.

reference_spacy_tokens: In 1870 , Prussian Chancellor Bismarck used an obscure diplomatic conflict with France to unite the various German principalities and kingdoms into a military unit well equipped for war .


fn_spacy_tokens_for_baseline: Meetings were minuted and records forwarded to the head for report to heads of department .

source_bert_toks: meetings were minute ##d and records forward ##ed to the head for report to heads of department .

reference_raw: The meetings were recorded and the records sent to the head of department for reporting.

reference_spacy_tokens: The meetings were recorded and the records sent to the head of department for reporting .


fn_spacy_tokens_for_baseline: She added that Juliana would also look fabulous in the new long , straight skirts rather than her usual full skirts , which only emphasised her hips .

source_bert_toks: she added that juliana would also look fabulous in the new long , straight skirts rather than her usual full skirts , which only emphasis ##ed her hips .

reference_raw: She added that Juliana would look wonderful in her new long, straight skirts, instead of her usual full skirts, which only emphasized her hips.

reference_spacy_tokens: She added that Juliana would look wonderful in her new long , straight skirts , instead of her usual full skirts , which only emphasized her hips .


fn_spacy_tokens_for_baseline: But morphine , the precursor for heroin . can be obtained from thebaine only by a series of elaborate and inefficient chemical processes .

source_bert_toks: but mor ##phine , the precursor for heroin . can be obtained from the ##bain ##e only by a series of elaborate and in ##ef ##fi ##cie ##nt chemical processes .

reference_raw: But morphine, a precipitate of heroin, can only be extracted from the baine by a series of complex and inefficient chemical processes.

reference_spacy_tokens: But morphine , a precipitate of heroin , can only be extracted from the baine by a series of complex and inefficient chemical processes .


fn_spacy_tokens_for_baseline: As a teenager I moved out of the nursery into the attic .

source_bert_toks: as a teenager i moved out of the nursery into the attic .

reference_raw: When I was a teenager, I moved out of kindergarten to the attic.

reference_spacy_tokens: When I was a teenager , I moved out of kindergarten to the attic .


fn_spacy_tokens_for_baseline: ' The accounts have obviously been falsified . '

source_bert_toks: ' the accounts have obviously been fa ##ls ##ified . '

reference_raw: "Obviously, the accounts were forged."

reference_spacy_tokens: " Obviously , the accounts were forged . "


fn_spacy_tokens_for_baseline: The man who will have to answer these questions , the new environment Secretary John Gummer , was visiting Cheltenham today by coincidence .

source_bert_toks: the man who will have to answer these questions , the new environment secretary john gum ##mer , was visiting cheltenham today by coincidence .

reference_raw: The man who would have to answer these questions, the new Secretary of the Environment, John Gummer, was visiting Cheltenham by chance today.

reference_spacy_tokens: The man who would have to answer these questions , the new Secretary of the Environment , John Gummer , was visiting Cheltenham by chance today .


fn_spacy_tokens_for_baseline: Two types of failure were observed ; with incorrect mappings being proposed in some cases , and correct mappings being missed in others .

source_bert_toks: two types of failure were observed ; with incorrect mapping ##s being proposed in some cases , and correct mapping ##s being missed in others .

reference_raw: Two types of failure have been observed; in some cases, erroneous mappings have been proposed and correct mappings have been missed in others.

reference_spacy_tokens: Two types of failure have been observed ; in some cases , erroneous mappings have been proposed and correct mappings have been missed in others .


fn_spacy_tokens_for_baseline: These days it is the San Diego cops who are doing the shooting , killing more people , proportionately , than any other police force in America .

source_bert_toks: these days it is the san diego cops who are doing the shooting , killing more people , proportion ##ately , than any other police force in america .

reference_raw: These days, it's the San Diego police who are firing and killing more people, proportionally, than any other police force in America.

reference_spacy_tokens: These days , it 's the San Diego police who are firing and killing more people , proportionally , than any other police force in America .


fn_spacy_tokens_for_baseline: The building of the now leaking sarcophagus alone cost an astonishing amount of money , on the best estimate available .

source_bert_toks: the building of the now leaking sar ##co ##pha ##gus alone cost an astonishing amount of money , on the best estimate available .

reference_raw: The construction of the now leaking sarcophagus alone, according to the best estimate available, cost a staggering amount of money.

reference_spacy_tokens: The construction of the now leaking sarcophagus alone , according to the best estimate available , cost a staggering amount of money .


fn_spacy_tokens_for_baseline: The ambassador rapped out an order and four servants , their faces masked by cloths soaked in vinegar , hurried across with a linen sheet .

source_bert_toks: the ambassador rap ##ped out an order and four servants , their faces masked by cloth ##s soaked in vinegar , hurried across with a linen sheet .

reference_raw: The ambassador shouted an order, and four servants, their faces masked by cloths soaked with vinegar, hurried over with a canvas sheet.

reference_spacy_tokens: The ambassador shouted an order , and four servants , their faces masked by cloths soaked with vinegar , hurried over with a canvas sheet .


fn_spacy_tokens_for_baseline: But that stretch of beach itself still tends to lose material further to the east , because the winds are still coming from the southwest predominantly , still driving the , the beach material along .

source_bert_toks: but that stretch of beach itself still tends to lose material further to the east , because the winds are still coming from the southwest predominantly , still driving the , the beach material along .

reference_raw: But this part of the beach itself still tends to lose material further east, because the winds continue to come mainly from the south-west, still driving the beach material.

reference_spacy_tokens: But this part of the beach itself still tends to lose material further east , because the winds continue to come mainly from the south - west , still driving the beach material .


fn_spacy_tokens_for_baseline: It characterized such children as a potential revolutionary army of the future .

source_bert_toks: it characterized such children as a potential revolutionary army of the future .

reference_raw: It described such children as a potential revolutionary army of the future.

reference_spacy_tokens: It described such children as a potential revolutionary army of the future .


fn_spacy_tokens_for_baseline: Although all members participate in the decision - making process , votes are allotted in proportion to the size of their quotas .

source_bert_toks: although all members participate in the decision - making process , votes are allotted in proportion to the size of their quota ##s .

reference_raw: Although all members are involved in the decision-making process, the votes are allocated in proportion to the size of their quotas.

reference_spacy_tokens: Although all members are involved in the decision - making process , the votes are allocated in proportion to the size of their quotas .


fn_spacy_tokens_for_baseline: It ranks high among those topics which you fear may bore your listeners , but which , secretly , you take very seriously .

source_bert_toks: it ranks high among those topics which you fear may bore your listeners , but which , secretly , you take very seriously .

reference_raw: He is high among the topics that you fear may bore your listeners, but which you secretly take very seriously.

reference_spacy_tokens: He is high among the topics that you fear may bore your listeners , but which you secretly take very seriously .


fn_spacy_tokens_for_baseline: Nevertheless , tigers once roamed over most of Asia , some trekked over the frozen north , others up into the mountains of Central Asia and more through the hot humid rain forests of the south .

source_bert_toks: nevertheless , tigers once roam ##ed over most of asia , some trek ##ked over the frozen north , others up into the mountains of central asia and more through the hot humid rain forests of the south .

reference_raw: However, tigers once roamed most of Asia, some of them stumbled across the frozen north, others to the mountains of Central Asia, and more to the hot wet rainforests of the south.

reference_spacy_tokens: However , tigers once roamed most of Asia , some of them stumbled across the frozen north , others to the mountains of Central Asia , and more to the hot wet rainforests of the south .


fn_spacy_tokens_for_baseline: Hastily she searched for her purse in her bag , recalling part of their earlier conversation when he had been escorting her around the park .

source_bert_toks: hastily she searched for her purse in her bag , recalling part of their earlier conversation when he had been escorting her around the park .

reference_raw: She searched hurriedly for her purse in her bag, remembering part of their conversation when he had accompanied her around the park.

reference_spacy_tokens: She searched hurriedly for her purse in her bag , remembering part of their conversation when he had accompanied her around the park .


fn_spacy_tokens_for_baseline: He brought her a silver bucket of ice cubes with the glimmer of a flourish .

source_bert_toks: he brought her a silver bucket of ice cube ##s with the g ##lim ##mer of a flourish .

reference_raw: He brought her a silver pail of ice cubes with a flash of flowers.

reference_spacy_tokens: He brought her a silver pail of ice cubes with a flash of flowers .


fn_spacy_tokens_for_baseline: He removed her hands from his person and deposited them in her lap .

source_bert_toks: he removed her hands from his person and deposited them in her lap .

reference_raw: He took her hands from him and put them in her lap.

reference_spacy_tokens: He took her hands from him and put them in her lap .


fn_spacy_tokens_for_baseline: Bugs use their antennae to detect blood heat , while a tick will sink its proboscis into any liquid at blood heat , even water .

source_bert_toks: bugs use their antennae to detect blood heat , while a tick will sink its pro ##bos ##cis into any liquid at blood heat , even water .

reference_raw: The bugs use their aerials to detect the heat of the blood, while the tick sinks its proboscis into any fluid in the heat of the blood, even water.

reference_spacy_tokens: The bugs use their aerials to detect the heat of the blood , while the tick sinks its proboscis into any fluid in the heat of the blood , even water .


fn_spacy_tokens_for_baseline: In all about fifty articles could be classed as literary criticism .

source_bert_toks: in all about fifty articles could be classed as literary criticism .

reference_raw: In all, about fifty articles could be classified as literary criticisms.

reference_spacy_tokens: In all , about fifty articles could be classified as literary criticisms .


fn_spacy_tokens_for_baseline: The specialist bustled in , with a hand - wag ,

source_bert_toks: the specialist bust ##led in , with a hand - wa ##g ,

reference_raw: A specialist rushed in with a hand-wag,

reference_spacy_tokens: A specialist rushed in with a hand - wag ,


fn_spacy_tokens_for_baseline: The farmers who own the land around Pot Scar are getting increasingly agitated over the way climbers using the crag are parking their cars .

source_bert_toks: the farmers who own the land around pot scar are getting increasingly agitated over the way climb ##ers using the cr ##ag are parking their cars .

reference_raw: Farmers who own the land around Pot Scar are getting more and more excited about the way the climbers who use the rock drive their cars.

reference_spacy_tokens: Farmers who own the land around Pot Scar are getting more and more excited about the way the climbers who use the rock drive their cars .


fn_spacy_tokens_for_baseline: I would even say something nice about his new - fangled haircut if he were to say something hopeful to the London borough of Newham .

source_bert_toks: i would even say something nice about his new - fang ##led hair ##cut if he were to say something hopeful to the london borough of new ##ham .

reference_raw: If he had said anything hopeful to the London borough of Newham, I'd have said something pleasant about his new haircut.

reference_spacy_tokens: If he had said anything hopeful to the London borough of Newham , I 'd have said something pleasant about his new haircut .


fn_spacy_tokens_for_baseline: A crowd estimated at several thousands gathered outside the former embassy chanting ' Death to America ' .

source_bert_toks: a crowd estimated at several thousands gathered outside the former embassy chanting ' death to america ' .

reference_raw: The crowd estimated that several thousand people had gathered in front of the former embassy singing the Death of America.

reference_spacy_tokens: The crowd estimated that several thousand people had gathered in front of the former embassy singing the Death of America .


fn_spacy_tokens_for_baseline: ' Yes , you do , and I want it to say yes , ' he urged against her mouth .

source_bert_toks: ' yes , you do , and i want it to say yes , ' he urged against her mouth .

reference_raw: 'Yes, you do, and I want you to say yes,' he said.

reference_spacy_tokens: ' Yes , you do , and I want you to say yes , ' he said .


fn_spacy_tokens_for_baseline: My own experience when devising a controller for use with computer control is that if low - enough frequencies are employed the motors respond like ' stepper - motors ' advancing a small amount for each pulse .

source_bert_toks: my own experience when devi ##sing a controller for use with computer control is that if low - enough frequencies are employed the motors respond like ' steppe ##r - motors ' advancing a small amount for each pulse .

reference_raw: My own experience in designing a controller for use with computer control is that when low-enough frequencies are used, engines react like "stepper engines" increasing a small amount for each pulse.

reference_spacy_tokens: My own experience in designing a controller for use with computer control is that when low - enough frequencies are used , engines react like " stepper engines " increasing a small amount for each pulse .


fn_spacy_tokens_for_baseline: It could take several weeks before the fire is completely extinguished .

source_bert_toks: it could take several weeks before the fire is completely extinguished .

reference_raw: It could take a couple of months for the fire to go out completely.

reference_spacy_tokens: It could take a couple of months for the fire to go out completely .


fn_spacy_tokens_for_baseline: One is , if we make a certain common assumption , and taking the first example , that if the switch had not been flipped , then the windscreen wipers would not have started to work .

source_bert_toks: one is , if we make a certain common assumption , and taking the first example , that if the switch had not been flipped , then the winds ##creen wipe ##rs would not have started to work .

reference_raw: One is, if we make a common assumption, and we take the first example, that if it hadn't been turned on, the windshield wipers wouldn't have started working.

reference_spacy_tokens: One is , if we make a common assumption , and we take the first example , that if it had n't been turned on , the windshield wipers would n't have started working .


fn_spacy_tokens_for_baseline: The motor manufacturer is not going to be best pleased to discover that the aircraft he though he had retained has hopped to Ibiza with a load of spotty would - be tourists from Kettering .

source_bert_toks: the motor manufacturer is not going to be best pleased to discover that the aircraft he though he had retained has hopped to ib ##iza with a load of spot ##ty would - be tourists from ke ##ttering .

reference_raw: The engine manufacturer won't be happy to find that the plane he'd kept had hopped to Ibiza with a bunch of random tourists from Kettering.

reference_spacy_tokens: The engine manufacturer wo n't be happy to find that the plane he 'd kept had hopped to Ibiza with a bunch of random tourists from Kettering .


fn_spacy_tokens_for_baseline: She 's also accused the country 's drug mafia , saying they are angry that her government has agreed to extradite suspected drug traffickers to the United States .

source_bert_toks: she ' s also accused the country ' s drug mafia , saying they are angry that her government has agreed to extra ##dit ##e suspected drug traffic ##kers to the united states .

reference_raw: She also blamed the country's drug lords and said they were angry that her government had agreed to release suspected drug dealers to the United States.

reference_spacy_tokens: She also blamed the country 's drug lords and said they were angry that her government had agreed to release suspected drug dealers to the United States .


fn_spacy_tokens_for_baseline: When the Dunner froze at low tide and you could skate from Odborough to Furness .

source_bert_toks: when the dunne ##r froze at low tide and you could skate from o ##db ##orough to fur ##ness .

reference_raw: When Dunner freezes at a low tide and you can roll from Odborough to Furness.

reference_spacy_tokens: When Dunner freezes at a low tide and you can roll from Odborough to Furness .


fn_spacy_tokens_for_baseline: He himself would probably have claimed that his greatest achievement was to be able to predict accurately where and when a particular cuckoo would lay its eggs .

source_bert_toks: he himself would probably have claimed that his greatest achievement was to be able to predict accurately where and when a particular cuckoo would lay its eggs .

reference_raw: He would probably have said that his greatest achievement was to be able to predict exactly where and when a particular cuckoo would put his eggs.

reference_spacy_tokens: He would probably have said that his greatest achievement was to be able to predict exactly where and when a particular cuckoo would put his eggs .


fn_spacy_tokens_for_baseline: Iran currently possesses the capability to employ ballistic missiles and/or long - range artillery rockets against its regional neighbors , Israel and US forces deployed in the region .

source_bert_toks: iran currently possesses the capability to employ ballistic missiles and / or long - range artillery rockets against its regional neighbors , israel and us forces deployed in the region .

reference_raw: Iran currently has the capacity to use ballistic missiles and/or long-range artillery rockets against its regional neighbours, Israel and the US forces stationed in the region.

reference_spacy_tokens: Iran currently has the capacity to use ballistic missiles and/or long - range artillery rockets against its regional neighbours , Israel and the US forces stationed in the region .


fn_spacy_tokens_for_baseline: However , the more recent evidence reviewed in this chapter clearly indicates that children are able to give and understand explanations well before the age of seven years .

source_bert_toks: however , the more recent evidence reviewed in this chapter clearly indicates that children are able to give and understand explanations well before the age of seven years .

reference_raw: However, the more recent evidence examined in this chapter clearly shows that children are able to provide and understand explanations well before the age of seven.

reference_spacy_tokens: However , the more recent evidence examined in this chapter clearly shows that children are able to provide and understand explanations well before the age of seven .


fn_spacy_tokens_for_baseline: He shaved , changed his doublet , put on his sword belt and took his heaviest cloak from its hook outside the buttery .

source_bert_toks: he shaved , changed his double ##t , put on his sword belt and took his heaviest cloak from its hook outside the butter ##y .

reference_raw: He shaved, changed his jacket, put on his sword belt, and pulled his heavy cloak from the hook in front of the butter.

reference_spacy_tokens: He shaved , changed his jacket , put on his sword belt , and pulled his heavy cloak from the hook in front of the butter .


fn_spacy_tokens_for_baseline: At weekends we cycled there under the hot sun in the early afternoon , not minding the heat at all because we knew that as soon as we arrived the cool water would welcome us .

source_bert_toks: at weekends we cycle ##d there under the hot sun in the early afternoon , not mind ##ing the heat at all because we knew that as soon as we arrived the cool water would welcome us .

reference_raw: We circled there on weekends in the early afternoon under the hot sun, and we didn't mind the heat, because we knew the cold water would welcome us when we got there.

reference_spacy_tokens: We circled there on weekends in the early afternoon under the hot sun , and we did n't mind the heat , because we knew the cold water would welcome us when we got there .


fn_spacy_tokens_for_baseline: He sticks one between his teeth but does n't light it -- just holds it there like a storeman 's pencil .

source_bert_toks: he sticks one between his teeth but doesn ' t light it - - just holds it there like a store ##man ' s pencil .

reference_raw: He puts one between his teeth, but he doesn't light it -- he's just holding it there like a shopper's pencil.

reference_spacy_tokens: He puts one between his teeth , but he does n't light it -- he 's just holding it there like a shopper 's pencil .


fn_spacy_tokens_for_baseline: In language that was strikingly reminiscent of the Khmers Rouges , a CPP official predicted that popular anger at the conduct of the election might lead to ' insurrection or riot ' .

source_bert_toks: in language that was striking ##ly reminiscent of the khmer ##s rouge ##s , a cp ##p official predicted that popular anger at the conduct of the election might lead to ' insurrection or riot ' .

reference_raw: In a language strikingly reminiscent of the Khmers Rouges, a CPP official foresaw that popular anger at election behavior could lead to 'insurrection or insurrection'.

reference_spacy_tokens: In a language strikingly reminiscent of the Khmers Rouges , a CPP official foresaw that popular anger at election behavior could lead to ' insurrection or insurrection ' .


fn_spacy_tokens_for_baseline: The car owner who leaves his car with a garage for repairs to be carried out does not consent to the garage having possession in its capacity as a mercantile agent ( i.e. as a dealer ) .

source_bert_toks: the car owner who leaves his car with a garage for repairs to be carried out does not consent to the garage having possession in its capacity as a mercantile agent ( i . e . as a dealer ) .

reference_raw: The proprietor of the vehicle who leaves his car with a garage for repairs to be carried out does not consent to the fact that the garage is held as a mercantile agent (i.e. as a dealer).

reference_spacy_tokens: The proprietor of the vehicle who leaves his car with a garage for repairs to be carried out does not consent to the fact that the garage is held as a mercantile agent ( i.e. as a dealer ) .


fn_spacy_tokens_for_baseline: The winter population has decreased in recent years .

source_bert_toks: the winter population has decreased in recent years .

reference_raw: The winter population has fallen in recent years.

reference_spacy_tokens: The winter population has fallen in recent years .


fn_spacy_tokens_for_baseline: Last autumn , we invited readers to contribute essays on how they believed information technology would change life in Britain .

source_bert_toks: last autumn , we invited readers to contribute essays on how they believed information technology would change life in britain .

reference_raw: Last fall, we invited the readers to do a paper on how they believed that information technology would change the life of Britain.

reference_spacy_tokens: Last fall , we invited the readers to do a paper on how they believed that information technology would change the life of Britain .


fn_spacy_tokens_for_baseline: Some children become institutionalised more quickly than others , and she still had a bit of fire left in her when I went to the orphanage for her .

source_bert_toks: some children become institutional ##ised more quickly than others , and she still had a bit of fire left in her when i went to the orphanage for her .

reference_raw: Some kids get institutionalized faster than others, and when I went to the orphanage, she still had a little fire left.

reference_spacy_tokens: Some kids get institutionalized faster than others , and when I went to the orphanage , she still had a little fire left .


fn_spacy_tokens_for_baseline: Weimar , to the south - east of Bremen , was marked with a golden circle , forming a triangle with the Berlin garrison to the north - east .

source_bert_toks: weimar , to the south - east of bremen , was marked with a golden circle , forming a triangle with the berlin garrison to the north - east .

reference_raw: To the south-east of Bremen, Weimar was marked with a golden circle, forming a triangular with the Berlin crew to the north-east.

reference_spacy_tokens: To the south - east of Bremen , Weimar was marked with a golden circle , forming a triangular with the Berlin crew to the north - east .


fn_spacy_tokens_for_baseline: Grubby little man he may be -- he shits in my presence without embarrassment -- yet in his thought I perceive he is fastidious .

source_bert_toks: gr ##ub ##by little man he may be - - he shit ##s in my presence without embarrassment - - yet in his thought i perceive he is fast ##idi ##ous .

reference_raw: He may be a grumpy little man - he craps in my presence without embarrassment - but in his mind I sense he's fast.

reference_spacy_tokens: He may be a grumpy little man - he craps in my presence without embarrassment - but in his mind I sense he 's fast .


fn_spacy_tokens_for_baseline: The local people had stoned her for wearing trousers in the street and Fernando had ruefully added how things had changed since then -- now anything went in Majorca .

source_bert_toks: the local people had stone ##d her for wearing trousers in the street and fernando had rue ##fully added how things had changed since then - - now anything went in major ##ca .

reference_raw: The locals had high-pitched her for wearing pants on the street, and Fernando had sadly added how things had changed since then-and now everything was going on in Majorca.

reference_spacy_tokens: The locals had high - pitched her for wearing pants on the street , and Fernando had sadly added how things had changed since then - and now everything was going on in Majorca .


fn_spacy_tokens_for_baseline: Development of both an indigenous missile design and production capability , and the evolution of a strategic doctrine that foresees Iran as a regional superpower , " ... a missile power second only to the superpowers , " and a " ... center ... " for other third world nations seeking missile capabilities .

source_bert_toks: development of both an indigenous missile design and production capability , and the evolution of a strategic doctrine that fore ##see ##s iran as a regional super ##power , " . . . a missile power second only to the super ##power ##s , " and a " . . . center . . . " for other third world nations seeking missile capabilities .

reference_raw: The development of both domestic missile design and production capabilities and the development of a strategic doctrine that foresees Iran as a regional superpower, "...missile power second only to superpowers" and "...centre" for other third-world countries looking for missile capabilities.

reference_spacy_tokens: The development of both domestic missile design and production capabilities and the development of a strategic doctrine that foresees Iran as a regional superpower , " ... missile power second only to superpowers " and " ... centre " for other third - world countries looking for missile capabilities .


fn_spacy_tokens_for_baseline: Norman also pictured the almost unbelievable sumptuousness of the luxury steamboat liners , with their relaxed passengers at cards or dinner , a waiter for every passenger .

source_bert_toks: norman also pictured the almost unbelievable sum ##pt ##uous ##ness of the luxury steamboat liner ##s , with their relaxed passengers at cards or dinner , a waiter for every passenger .

reference_raw: Norman also pictured the almost incredible sumptuousness of luxury steamer liners, their free passengers at cards or dinner, the waiter for each passenger.

reference_spacy_tokens: Norman also pictured the almost incredible sumptuousness of luxury steamer liners , their free passengers at cards or dinner , the waiter for each passenger .