fn_spacy_tokens_for_baseline: The presence of these facilities confirms Iran 's growing determination to achieve a full nuclear fuel cycle .

source_bert_toks: the presence of these facilities confirms iran ' s growing determination to achieve a full nuclear fuel cycle .

reference_raw: The presence of such facilities demonstrates Iran's increasing commitment to the full nuclear fuel cycle.

reference_spacy_tokens: The presence of such facilities demonstrates Iran 's increasing commitment to the full nuclear fuel cycle .


fn_spacy_tokens_for_baseline: This muscle leaves a conspicuous scar on the inside of the shell , an impression which is easily preserved in the fossil state .

source_bert_toks: this muscle leaves a conspicuous scar on the inside of the shell , an impression which is easily preserved in the fossil state .

reference_raw: This muscle leaves a conspicuous scar on the interior of the shell, an impression that can be easily preserved in a fossil state.

reference_spacy_tokens: This muscle leaves a conspicuous scar on the interior of the shell , an impression that can be easily preserved in a fossil state .


fn_spacy_tokens_for_baseline: More than 100 were homeless .

source_bert_toks: more than 100 were homeless .

reference_raw: Over a hundred people were homeless.

reference_spacy_tokens: Over a hundred people were homeless .


fn_spacy_tokens_for_baseline: Joachim eventually broke away from the Cistercians and retired to a lonely spot in Calabria where disciples gathered around him and he was given papal permission to found his own congregation .

source_bert_toks: joachim eventually broke away from the cis ##ter ##cian ##s and retired to a lonely spot in calabria where disciples gathered around him and he was given papal permission to found his own congregation .

reference_raw: Joachim finally broke away from the Cistercians and went to a lonely place in Calabria, where the pupils gathered around him and gave the papal permission to find his own congregation.

reference_spacy_tokens: Joachim finally broke away from the Cistercians and went to a lonely place in Calabria , where the pupils gathered around him and gave the papal permission to find his own congregation .


fn_spacy_tokens_for_baseline: They will be secure enough about their own capabilities and limitations to take the lead in talking in ways which the old lags will continue to denigrate for a while as ' weak ' or ' idealistic ' .

source_bert_toks: they will be secure enough about their own capabilities and limitations to take the lead in talking in ways which the old la ##gs will continue to den ##ig ##rate for a while as ' weak ' or ' ideal ##istic ' .

reference_raw: They would be safe enough in terms of their own abilities and limitations to take the lead in speaking in a way that the old lags would continue to deny for a while as 'weak' or 'idealistic'.

reference_spacy_tokens: They would be safe enough in terms of their own abilities and limitations to take the lead in speaking in a way that the old lags would continue to deny for a while as ' weak ' or ' idealistic ' .


fn_spacy_tokens_for_baseline: I think we know what we 're going to speak about .

source_bert_toks: i think we know what we ' re going to speak about .

reference_raw: We know what we're talking about.

reference_spacy_tokens: We know what we 're talking about .


fn_spacy_tokens_for_baseline: Analytic tools include examining statements and articles in the news media , government reports including unclassified intelligence estimates , interviewing insiders who have had access to information about the clandestine program , reviewing secondary sources such as reports by analysts , and making scientific calculations based on the best available information about a country 's nuclear infrastructure .

source_bert_toks: analytic tools include examining statements and articles in the news media , government reports including un ##class ##ified intelligence estimates , interviewing insider ##s who have had access to information about the clandestine program , reviewing secondary sources such as reports by analysts , and making scientific calculations based on the best available information about a country ' s nuclear infrastructure .

reference_raw: The analytical tools include examining statements and articles in the news media, government reports, including unclassified intelligence forecasts, interviewing insiders who had access to classified information, reviewing secondary sources, such as analysts' reports, and making scientific calculations based on the best available information on the nuclear infrastructure of a country.

reference_spacy_tokens: The analytical tools include examining statements and articles in the news media , government reports , including unclassified intelligence forecasts , interviewing insiders who had access to classified information , reviewing secondary sources , such as analysts ' reports , and making scientific calculations based on the best available information on the nuclear infrastructure of a country .


fn_spacy_tokens_for_baseline: It was true that Conchis was a recluse and never came to the village , but that he had been a collaborationist was a lie .

source_bert_toks: it was true that con ##chi ##s was a rec ##lus ##e and never came to the village , but that he had been a collaboration ##ist was a lie .

reference_raw: It was true that Conchis was a solitary man who had never come to the village, but the fact that he was a co-operator was a lie.

reference_spacy_tokens: It was true that Conchis was a solitary man who had never come to the village , but the fact that he was a co - operator was a lie .


fn_spacy_tokens_for_baseline: He put the syringe in her hand .

source_bert_toks: he put the sy ##ring ##e in her hand .

reference_raw: He slipped the needle into her hand.

reference_spacy_tokens: He slipped the needle into her hand .


fn_spacy_tokens_for_baseline: He was speared to death six years later by a Masai whose favourite bullock he insisted on requisitioning for a government destocking programme .

source_bert_toks: he was spear ##ed to death six years later by a mas ##ai whose favourite bullock he insisted on re ##qui ##sit ##ion ##ing for a government des ##tock ##ing programme .

reference_raw: Six years later, he was stabbed to death by a Masai whose favorite bullock he insisted on requesting a government destocking program.

reference_spacy_tokens: Six years later , he was stabbed to death by a Masai whose favorite bullock he insisted on requesting a government destocking program .


fn_spacy_tokens_for_baseline: The more resentful and unforgiving Willie Morgan , was taken to court and then had to terminate a lucrative six year contract after only nine months .

source_bert_toks: the more res ##ent ##ful and un ##for ##giving willie morgan , was taken to court and then had to terminate a lucrative six year contract after only nine months .

reference_raw: The more grumpy and unforgivable Willie Morgan was brought to court, and after only nine months he had to terminate his lucrative six-year contract.

reference_spacy_tokens: The more grumpy and unforgivable Willie Morgan was brought to court , and after only nine months he had to terminate his lucrative six - year contract .


fn_spacy_tokens_for_baseline: Yet in the past decade more than 50,000 people have died in the fighting between the security forces , separatist Tamil guerrillas and a now - faded nationalist revolt ; and prominent politicians and soldiers are murdered with monotonous regularity .

source_bert_toks: yet in the past decade more than 50 , 000 people have died in the fighting between the security forces , sep ##arat ##ist tamil guerrillas and a now - faded nationalist revolt ; and prominent politicians and soldiers are murdered with mono ##ton ##ous regular ##ity .

reference_raw: But in the last decade, over 50,000 people have died fighting the security forces, the separatist Tamil guerrillas, and the now-faded nationalist rebellion, and prominent politicians and soldiers have been assassinated with monotonous regularity.

reference_spacy_tokens: But in the last decade , over 50,000 people have died fighting the security forces , the separatist Tamil guerrillas , and the now - faded nationalist rebellion , and prominent politicians and soldiers have been assassinated with monotonous regularity .


fn_spacy_tokens_for_baseline: Strapping himself into the vacated chair , he entreated Rogal Dorn to guide him -- then emptied his mind of all but titanic tech thoughts .

source_bert_toks: strap ##ping himself into the vacated chair , he en ##tre ##ated ro ##gal do ##rn to guide him - - then emptied his mind of all but titanic tech thoughts .

reference_raw: He sat back in the empty chair, encumbered Rogal Dorn to guide him, then emptied his mind of all but titanic technical thoughts.

reference_spacy_tokens: He sat back in the empty chair , encumbered Rogal Dorn to guide him , then emptied his mind of all but titanic technical thoughts .


fn_spacy_tokens_for_baseline: It showed the east facade of the house .

source_bert_toks: it showed the east facade of the house .

reference_raw: It showed the eastern front of the house.

reference_spacy_tokens: It showed the eastern front of the house .


fn_spacy_tokens_for_baseline: The Spanish style , favoured by the Santa Fe and other railroads in the Southern States , can be divided into two streams , the baroque and the mission .

source_bert_toks: the spanish style , favoured by the santa fe and other railroads in the southern states , can be divided into two streams , the baroque and the mission .

reference_raw: The Spanish style, favored by Santa Fe and other southern railways, can be divided into two streams, a baroque and a mission.

reference_spacy_tokens: The Spanish style , favored by Santa Fe and other southern railways , can be divided into two streams , a baroque and a mission .


fn_spacy_tokens_for_baseline: Oxygen travels by means of billions of collisions of gas particles , a process that would be too slow if the molecules had to travel more than a fraction of an inch .

source_bert_toks: oxygen travels by means of billions of collisions of gas particles , a process that would be too slow if the molecules had to travel more than a fraction of an inch .

reference_raw: Oxygen travels through trillions of gas particle collisions, a process that would be too slow if molecules had to travel more than a fraction of an inch.

reference_spacy_tokens: Oxygen travels through trillions of gas particle collisions , a process that would be too slow if molecules had to travel more than a fraction of an inch .


fn_spacy_tokens_for_baseline: While Acheson continued to support the British against Greek claims in Cyprus , elsewhere he was increasingly doubtful of the viability of existing policies and positions .

source_bert_toks: while ache ##son continued to support the british against greek claims in cyprus , elsewhere he was increasingly doubtful of the via ##bility of existing policies and positions .

reference_raw: While Acheson continued to support the British against Greek claims in Cyprus, elsewhere, he doubted more and more about the viability of existing policies and positions.

reference_spacy_tokens: While Acheson continued to support the British against Greek claims in Cyprus , elsewhere , he doubted more and more about the viability of existing policies and positions .


fn_spacy_tokens_for_baseline: Paula , 30 , is a fighter and is back with a vengeance , looking fantastic with a shorter hairdo , body toned to perfection and for once , she 's feeling fit .

source_bert_toks: paula , 30 , is a fighter and is back with a vengeance , looking fantastic with a shorter hair ##do , body toned to perfection and for once , she ' s feeling fit .

reference_raw: Paula, 30, he's a fighter, and he's back in revenge, and he looks fantastic with a short hair, a body toned to perfection, and for once he feels fit.

reference_spacy_tokens: Paula , 30 , he 's a fighter , and he 's back in revenge , and he looks fantastic with a short hair , a body toned to perfection , and for once he feels fit .


fn_spacy_tokens_for_baseline: However , DOD has no plans to help secure three other Russian nerve agent storage sites that store 65 percent of Russia 's declared nerve agent stockpile .

source_bert_toks: however , dod has no plans to help secure three other russian nerve agent storage sites that store 65 percent of russia ' s declared nerve agent stock ##pile .

reference_raw: However, the Ministry of Defence has no intention of helping to secure the three other Russian nerve agent warehouses that store 65 percent of Russia's declared supply of nerve agents.

reference_spacy_tokens: However , the Ministry of Defence has no intention of helping to secure the three other Russian nerve agent warehouses that store 65 percent of Russia 's declared supply of nerve agents .


fn_spacy_tokens_for_baseline: Harriet slipped on the stairs and twisted her ankle .

source_bert_toks: harriet slipped on the stairs and twisted her ankle .

reference_raw: Harriet slid down the steps and turned her ankle.

reference_spacy_tokens: Harriet slid down the steps and turned her ankle .


fn_spacy_tokens_for_baseline: A Brief History

source_bert_toks: a brief history

reference_raw: Brief Histories

reference_spacy_tokens: Brief Histories


fn_spacy_tokens_for_baseline: In his rooms by ten , he summoned a cold platter and a pint of beer and wrote an optimistic , almost boastful letter to Newton .

source_bert_toks: in his rooms by ten , he summoned a cold platt ##er and a pin ##t of beer and wrote an optimistic , almost bo ##ast ##ful letter to newton .

reference_raw: At ten o'clock in his room, he called out a cold tray and a pint of beer and wrote an optimistic, almost boastful letter to Newton.

reference_spacy_tokens: At ten o'clock in his room , he called out a cold tray and a pint of beer and wrote an optimistic , almost boastful letter to Newton .


fn_spacy_tokens_for_baseline: The reader in men and masculinity from Bradford University conjured up images for me of a muscular man walking in with a few four - packs of larger under his arms ready to address BASW delegates .

source_bert_toks: the reader in men and mas ##cu ##lini ##ty from bradford university con ##jured up images for me of a muscular man walking in with a few four - packs of larger under his arms ready to address bas ##w delegates .

reference_raw: A reader of men and men at Bradford University conjured up images of a muscled man walking in with a couple of four packs of larger ones under his arm, ready to speak to the BASW delegates.

reference_spacy_tokens: A reader of men and men at Bradford University conjured up images of a muscled man walking in with a couple of four packs of larger ones under his arm , ready to speak to the BASW delegates .


fn_spacy_tokens_for_baseline: I still do n't understand why she was all bashed up .

source_bert_toks: i still don ' t understand why she was all bash ##ed up .

reference_raw: I still don't understand why they beat her up.

reference_spacy_tokens: I still do n't understand why they beat her up .


fn_spacy_tokens_for_baseline: When he felt he had said enough and made us laugh enough , he went back to his dressing room .

source_bert_toks: when he felt he had said enough and made us laugh enough , he went back to his dressing room .

reference_raw: When he felt that he had said enough and made us laugh enough, he returned to the locker room.

reference_spacy_tokens: When he felt that he had said enough and made us laugh enough , he returned to the locker room .


fn_spacy_tokens_for_baseline: The Saxon peasant worked from dawn until dusk and as one went down the class ladder life was harder .

source_bert_toks: the saxon peasant worked from dawn until dusk and as one went down the class ladder life was harder .

reference_raw: The Saxon farmer worked from dawn to sunset, and life became more difficult as he descended the class ladder.

reference_spacy_tokens: The Saxon farmer worked from dawn to sunset , and life became more difficult as he descended the class ladder .


fn_spacy_tokens_for_baseline: If you read her diaries you discover that she travelled incessantly on trains and overnight trains so that she could speak at meetings the next morning .

source_bert_toks: if you read her diaries you discover that she travelled inc ##ess ##antly on trains and overnight trains so that she could speak at meetings the next morning .

reference_raw: If you read her journals, you'll find she's always traveling on trains and night trains, so she can talk at meetings the next morning.

reference_spacy_tokens: If you read her journals , you 'll find she 's always traveling on trains and night trains , so she can talk at meetings the next morning .


fn_spacy_tokens_for_baseline: Threats in the external environment also provide a compelling reason to expand beyond the home market .

source_bert_toks: threats in the external environment also provide a compelling reason to expand beyond the home market .

reference_raw: The threat to the external environment is also a compelling reason to expand beyond the domestic market.

reference_spacy_tokens: The threat to the external environment is also a compelling reason to expand beyond the domestic market .


fn_spacy_tokens_for_baseline: It started as baby Thomas was lowered into his high chair -- and ended when a dollop of Ready Brek left his plastic spoon mid - grapple to go flying over both breakfast - time combatants .

source_bert_toks: it started as baby thomas was lowered into his high chair - - and ended when a doll ##op of ready br ##ek left his plastic spoon mid - gr ##apple to go flying over both breakfast - time combatants .

reference_raw: It began when little Thomas had been lowered into his high chair-and ended when a dollop of Ready Brek had left his plastic teaspoon in the middle of the grapple to fly over the two breakfast fighters.

reference_spacy_tokens: It began when little Thomas had been lowered into his high chair - and ended when a dollop of Ready Brek had left his plastic teaspoon in the middle of the grapple to fly over the two breakfast fighters .


fn_spacy_tokens_for_baseline: That movement is highly suspect , for two reasons .

source_bert_toks: that movement is highly suspect , for two reasons .

reference_raw: This movement is highly suspicious for two reasons.

reference_spacy_tokens: This movement is highly suspicious for two reasons .


fn_spacy_tokens_for_baseline: The salesperson 's task is to provide it in a manner which does not antagonise the buyer and , yet , is convincing .

source_bert_toks: the sales ##person ' s task is to provide it in a manner which does not ant ##ago ##nis ##e the buyer and , yet , is convincing .

reference_raw: It is the task of the seller to provide it in a way that does not antagonize the buyer but is persuasive.

reference_spacy_tokens: It is the task of the seller to provide it in a way that does not antagonize the buyer but is persuasive .


fn_spacy_tokens_for_baseline: The plan was to categorise aliens under one of three headings .

source_bert_toks: the plan was to cat ##ego ##rise aliens under one of three heading ##s .

reference_raw: The plan was to classify the aliens under one of three headings.

reference_spacy_tokens: The plan was to classify the aliens under one of three headings .


fn_spacy_tokens_for_baseline: To the north and west are the ancient sites of Ireland : Malahide Castle , the evocative hill of Tara , and the long barrows of Knowth and Newgrange .

source_bert_toks: to the north and west are the ancient sites of ireland : mala ##hide castle , the ev ##oca ##tive hill of tara , and the long barrow ##s of know ##th and new ##gra ##nge .

reference_raw: Northern and western are the ancient sites of Ireland: the castle of Malahide, Tara's evocative hill, and the long barrows of Knowth and Newgrange.

reference_spacy_tokens: Northern and western are the ancient sites of Ireland : the castle of Malahide , Tara 's evocative hill , and the long barrows of Knowth and Newgrange .


fn_spacy_tokens_for_baseline: " Yugoslavia produces so many talented players , there is no such production in Germany , " said Lucic , who in the past had coached several of the players on the Yugoslav team here .

source_bert_toks: " yugoslavia produces so many talented players , there is no such production in germany , " said luc ##ic , who in the past had coached several of the players on the yugoslav team here .

reference_raw: "Yugoslavia produces so many talented players that there is no such production in Germany," said Lucic, who had trained several players on the Yugoslav team in the past.

reference_spacy_tokens: " Yugoslavia produces so many talented players that there is no such production in Germany , " said Lucic , who had trained several players on the Yugoslav team in the past .


fn_spacy_tokens_for_baseline: For a second she knew an intense longing to flee -- to get a million miles away from this place and everyone in it .

source_bert_toks: for a second she knew an intense longing to flee - - to get a million miles away from this place and everyone in it .

reference_raw: For a moment she knew an intense desire to run - to get a million miles away from here and everyone in it.

reference_spacy_tokens: For a moment she knew an intense desire to run - to get a million miles away from here and everyone in it .


fn_spacy_tokens_for_baseline: A diplomat based in Afghanistan who is familiar with suicide bomber tactics said the timing differed from previous attacks .

source_bert_toks: a diplomat based in afghanistan who is familiar with suicide bomber tactics said the timing differed from previous attacks .

reference_raw: A diplomat based in Afghanistan, familiar with the tactics of suicidal bombers, said that the timing was different from the previous attacks.

reference_spacy_tokens: A diplomat based in Afghanistan , familiar with the tactics of suicidal bombers , said that the timing was different from the previous attacks .


fn_spacy_tokens_for_baseline: To both of them , the human sacrifice of 1914 - 18 created not just a deep loathing of war but also a determination that such sacrifice should not be in vain .

source_bert_toks: to both of them , the human sacrifice of 1914 - 18 created not just a deep lo ##athing of war but also a determination that such sacrifice should not be in vain .

reference_raw: For both of them, the human sacrifice of 1914-18 created not only a deep hatred of war, but also a determination that such sacrifice should not be in vain.

reference_spacy_tokens: For both of them , the human sacrifice of 1914 - 18 created not only a deep hatred of war , but also a determination that such sacrifice should not be in vain .


fn_spacy_tokens_for_baseline: It rarely speaks , though if frightened it may bleat like a goat . some occasionally have goats ' shanks and hooves as well .

source_bert_toks: it rarely speaks , though if frightened it may b ##lea ##t like a goat . some occasionally have goats ' shan ##ks and hooves as well .

reference_raw: He rarely talks, but when he's scared, he can bleed like a goat, and sometimes he's got goat shanks and hooves.

reference_spacy_tokens: He rarely talks , but when he 's scared , he can bleed like a goat , and sometimes he 's got goat shanks and hooves .


fn_spacy_tokens_for_baseline: ' I have n't been well , ' she stuttered .

source_bert_toks: ' i haven ' t been well , ' she stu ##ttered .

reference_raw: 'I wasn't feeling well,' she said.

reference_spacy_tokens: ' I was n't feeling well , ' she said .


fn_spacy_tokens_for_baseline: MPs have now completed work on the Bill drafted by Parents against Tobacco to prevent the sale of cigarettes to children .

source_bert_toks: mps have now completed work on the bill drafted by parents against tobacco to prevent the sale of cigarettes to children .

reference_raw: Members of Parliament have now completed their work on a bill drawn up by parents against tobacco to prevent the sale of cigarettes to children.

reference_spacy_tokens: Members of Parliament have now completed their work on a bill drawn up by parents against tobacco to prevent the sale of cigarettes to children .


fn_spacy_tokens_for_baseline: Nathan , who had emerged from the room behind , took in the situation at a glance and , with a blood - curdling scream , threw himself at Lennon .

source_bert_toks: nathan , who had emerged from the room behind , took in the situation at a glance and , with a blood - cu ##rd ##ling scream , threw himself at lennon .

reference_raw: Nathan, who had come out of the room behind him, took a look at the situation and threw himself at Lennon with a bloody cry.

reference_spacy_tokens: Nathan , who had come out of the room behind him , took a look at the situation and threw himself at Lennon with a bloody cry .


fn_spacy_tokens_for_baseline: When the chairman seemed intent on remaining in the post , White House Chief of Staff Samuel Skinner fired him .

source_bert_toks: when the chairman seemed intent on remaining in the post , white house chief of staff samuel skinner fired him .

reference_raw: When the Chairman seemed determined to remain in office, he was dismissed by the White House Chief of Staff, Samuel Skinner.

reference_spacy_tokens: When the Chairman seemed determined to remain in office , he was dismissed by the White House Chief of Staff , Samuel Skinner .


fn_spacy_tokens_for_baseline: At supper , now they were thirteen , they were allowed one tumbler , well watered .

source_bert_toks: at supper , now they were thirteen , they were allowed one tumble ##r , well watered .

reference_raw: At dinner, when they were thirteen years old, they were allowed to have one pitcher, well watered.

reference_spacy_tokens: At dinner , when they were thirteen years old , they were allowed to have one pitcher , well watered .


fn_spacy_tokens_for_baseline: In the Arab world Syria has atoned for its support of Iran during the previous Gulf war , and forged a lucrative friendship with Saudi Arabia .

source_bert_toks: in the arab world syria has at ##oned for its support of iran during the previous gulf war , and forged a lucrative friendship with saudi arabia .

reference_raw: In the Arab world, Syria redeemed its support for Iran during the previous Gulf War and forged a lucrative friendship with Saudi Arabia.

reference_spacy_tokens: In the Arab world , Syria redeemed its support for Iran during the previous Gulf War and forged a lucrative friendship with Saudi Arabia .


fn_spacy_tokens_for_baseline: This created a pattern seen today throughout the Aegean of a small port ( skala ) which serves an inland settlement or chora , making it easier to protect the island from attack .

source_bert_toks: this created a pattern seen today throughout the aegean of a small port ( ska ##la ) which serves an inland settlement or cho ##ra , making it easier to protect the island from attack .

reference_raw: This gave rise to a pattern seen today throughout the Aegean of a small port (skala) that serves a land-based settlement or chora, which facilitates the protection of the island from attack.

reference_spacy_tokens: This gave rise to a pattern seen today throughout the Aegean of a small port ( skala ) that serves a land - based settlement or chora , which facilitates the protection of the island from attack .


fn_spacy_tokens_for_baseline: Whilst his companion 's back was turned , Tuppe swiped one of his sausages and thrust it into his mouth .

source_bert_toks: whilst his companion ' s back was turned , tu ##ppe swiped one of his sausage ##s and thrust it into his mouth .

reference_raw: While his companion turned his back, Tuppe took one of the sausages and stuck it in his mouth.

reference_spacy_tokens: While his companion turned his back , Tuppe took one of the sausages and stuck it in his mouth .


fn_spacy_tokens_for_baseline: The document contains many guidelines .

source_bert_toks: the document contains many guidelines .

reference_raw: There are a number of instructions in this document.

reference_spacy_tokens: There are a number of instructions in this document .


fn_spacy_tokens_for_baseline: We recall Sonnet 129 , with its bitter puns on ' expence ' and ' action ' , or the sniggers of Lucio or Pistol .

source_bert_toks: we recall son ##net 129 , with its bitter pun ##s on ' ex ##pen ##ce ' and ' action ' , or the s ##nig ##gers of luc ##io or pistol .

reference_raw: We remember Sonnet 129, with its bitter puns on 'expendence' and 'action', or Lucius or Pistol's snigglers.

reference_spacy_tokens: We remember Sonnet 129 , with its bitter puns on ' expendence ' and ' action ' , or Lucius or Pistol 's snigglers .


fn_spacy_tokens_for_baseline: ' Nor is he a top - notch marksman .

source_bert_toks: ' nor is he a top - notch marks ##man .

reference_raw: 'He's not even the best shot.

reference_spacy_tokens: ' He 's not even the best shot .


fn_spacy_tokens_for_baseline: The Frenchman treated me like a son ; his wife was a little more distant and cool so I complimented her and brought her small gifts , wooing her as if she was the maid .

source_bert_toks: the frenchman treated me like a son ; his wife was a little more distant and cool so i complimented her and brought her small gifts , woo ##ing her as if she was the maid .

reference_raw: The Frenchman treated me like a son; his wife was more distant and cold, so I flattered her, brought her little gifts, and courted her as if she were a servant.

reference_spacy_tokens: The Frenchman treated me like a son ; his wife was more distant and cold , so I flattered her , brought her little gifts , and courted her as if she were a servant .


fn_spacy_tokens_for_baseline: Zimbabwe 's Rhodesian inheritance persists in its barely - changed colonial pattern of land ownership , with the best land used for private commercial farming and cattle grazing .

source_bert_toks: zimbabwe ' s rhodesia ##n inheritance persist ##s in its barely - changed colonial pattern of land ownership , with the best land used for private commercial farming and cattle grazing .

reference_raw: The Rhodesian heritage of Zimbabwe persists in its barely changed colonial structure of landownership, with the best land used for private commercial farming and cattle grazing.

reference_spacy_tokens: The Rhodesian heritage of Zimbabwe persists in its barely changed colonial structure of landownership , with the best land used for private commercial farming and cattle grazing .


fn_spacy_tokens_for_baseline: Covering the sprawled guards constantly , Mortimer hopped over the bodies and continued downwards , his men jabbing the bodies with bayonets to make sure .

source_bert_toks: covering the sprawled guards constantly , mortimer hopped over the bodies and continued downwards , his men ja ##bbing the bodies with bay ##one ##ts to make sure .

reference_raw: Mortimer, covering the sprawled guards all the time, hopped over the bodies and continued down, his men stabbing the bodies with bayonets to make sure.

reference_spacy_tokens: Mortimer , covering the sprawled guards all the time , hopped over the bodies and continued down , his men stabbing the bodies with bayonets to make sure .


fn_spacy_tokens_for_baseline: Rugby Union : Summit a total success for Bath

source_bert_toks: rugby union : summit a total success for bath

reference_raw: Rugby Union: The summit for Bath is a complete success

reference_spacy_tokens: Rugby Union : The summit for Bath is a complete success


fn_spacy_tokens_for_baseline: The issue of sampling adequacy does not arise if our analysis is based on the whole of the text under consideration .

source_bert_toks: the issue of sampling ad ##e ##qua ##cy does not arise if our analysis is based on the whole of the text under consideration .

reference_raw: The question of the appropriateness of sampling does not arise if our analysis is based on the whole of the text under consideration.

reference_spacy_tokens: The question of the appropriateness of sampling does not arise if our analysis is based on the whole of the text under consideration .


fn_spacy_tokens_for_baseline: In the latest three months the volume overall sales were down 1 per cent with the steepest falls registered by retailers of clothing and footwear , down 5 per cent and household goods , 4 per cent .

source_bert_toks: in the latest three months the volume overall sales were down 1 per cent with the steep ##est falls registered by retailers of clothing and foot ##wear , down 5 per cent and household goods , 4 per cent .

reference_raw: Over the last three months, total sales have decreased by 1 %, with the steepest drops registered by clothing and footwear distributors, down by 5 % and household goods by 4 %.

reference_spacy_tokens: Over the last three months , total sales have decreased by 1 % , with the steepest drops registered by clothing and footwear distributors , down by 5 % and household goods by 4 % .


fn_spacy_tokens_for_baseline: The boy may have sounded bull - headed and arrogant to you , but he knew something more .

source_bert_toks: the boy may have sounded bull - headed and arrogant to you , but he knew something more .

reference_raw: The boy might sound bully and arrogant to you, but he knew more than that.

reference_spacy_tokens: The boy might sound bully and arrogant to you , but he knew more than that .


fn_spacy_tokens_for_baseline: " You would be laughed at ... " he tells the caller .

source_bert_toks: " you would be laughed at . . . " he tells the caller .

reference_raw: "They'd make fun of you..." he says to the caller.

reference_spacy_tokens: " They 'd make fun of you ... " he says to the caller .


fn_spacy_tokens_for_baseline: Hayes moved his residence frequently .

source_bert_toks: hayes moved his residence frequently .

reference_raw: Hayes moved his place a lot.

reference_spacy_tokens: Hayes moved his place a lot .


fn_spacy_tokens_for_baseline: ' He has avowed only that I can .

source_bert_toks: ' he has av ##owed only that i can .

reference_raw: 'He swore only that I could.

reference_spacy_tokens: ' He swore only that I could .


fn_spacy_tokens_for_baseline: Her red high heels were clicking on the pavement .

source_bert_toks: her red high heels were clicking on the pavement .

reference_raw: Her red high heels clattered on the sidewalk.

reference_spacy_tokens: Her red high heels clattered on the sidewalk .


fn_spacy_tokens_for_baseline: Then she said , " Our viewers are curious . "

source_bert_toks: then she said , " our viewers are curious . "

reference_raw: Then she said, "Our viewers are inquisitive."

reference_spacy_tokens: Then she said , " Our viewers are inquisitive . "


fn_spacy_tokens_for_baseline: Nobody had ever survived a drugs bust in Hollywood .

source_bert_toks: nobody had ever survived a drugs bust in hollywood .

reference_raw: No one's ever survived a drug raid in Hollywood.

reference_spacy_tokens: No one 's ever survived a drug raid in Hollywood .


fn_spacy_tokens_for_baseline: Roehampton Hospital is , justly , world - famous for its marvellous skills of rehabilitation for people with limb disabilities .

source_bert_toks: roe ##hampton hospital is , just ##ly , world - famous for its marvel ##lous skills of rehabilitation for people with limb disabilities .

reference_raw: Roehampton Hospital is well known in the world for its wonderful ability to rehabilitate people with limbal disabilities.

reference_spacy_tokens: Roehampton Hospital is well known in the world for its wonderful ability to rehabilitate people with limbal disabilities .


fn_spacy_tokens_for_baseline: Bellowing and rearing on its hind legs , the massive bull lifted him bodily off the ground and shook him repeatedly like a rag - doll .

source_bert_toks: bell ##owing and rear ##ing on its hind legs , the massive bull lifted him bodily off the ground and shook him repeatedly like a rag - doll .

reference_raw: The huge bull roared and reared on its hind legs, lifting it bodily from the ground, shaking it repeatedly like a rag doll.

reference_spacy_tokens: The huge bull roared and reared on its hind legs , lifting it bodily from the ground , shaking it repeatedly like a rag doll .


fn_spacy_tokens_for_baseline: Mitchum , wearing dark glasses , insisted the lights be dimmed , and then threw a packet of cigarettes on to the coffee table .

source_bert_toks: mitch ##um , wearing dark glasses , insisted the lights be dim ##med , and then threw a packet of cigarettes on to the coffee table .

reference_raw: Mitchum, wearing dark glasses, insisted on dimming the lights, then tossed a pack of cigarettes onto the coffee table.

reference_spacy_tokens: Mitchum , wearing dark glasses , insisted on dimming the lights , then tossed a pack of cigarettes onto the coffee table .


fn_spacy_tokens_for_baseline: Near the end of The War Room , Stephanopoulos gets a call from someone who apparently claims to have a list of Clinton paramours , which he is about to publicize .

source_bert_toks: near the end of the war room , stephan ##op ##oulos gets a call from someone who apparently claims to have a list of clinton para ##mour ##s , which he is about to public ##ize .

reference_raw: In the middle of the war room, Stephanopoulos receives a call from someone who apparently claims to have a list of Clinton paramours that he's about to publish.

reference_spacy_tokens: In the middle of the war room , Stephanopoulos receives a call from someone who apparently claims to have a list of Clinton paramours that he 's about to publish .


fn_spacy_tokens_for_baseline: More generally , however , this tort has been said to be the genus of which the other unlawful means torts ( intimidation and interference with contract and conspiracy where unlawful means are involved ) are species .

source_bert_toks: more generally , however , this tor ##t has been said to be the genus of which the other unlawful means tor ##ts ( intimidation and interference with contract and conspiracy where unlawful means are involved ) are species .

reference_raw: More generally, however, it is said that this tort is a genus of which other illegal means of tort (intimidation and interference with contracts and conspiracy in the case of illegal means) are species.

reference_spacy_tokens: More generally , however , it is said that this tort is a genus of which other illegal means of tort ( intimidation and interference with contracts and conspiracy in the case of illegal means ) are species .


fn_spacy_tokens_for_baseline: Dr McIntyre was slowly removing his rubber gloves .

source_bert_toks: dr mcintyre was slowly removing his rubber gloves .

reference_raw: Dr. McIntyre slowly took off his rubber gloves.

reference_spacy_tokens: Dr. McIntyre slowly took off his rubber gloves .


fn_spacy_tokens_for_baseline: Customs have now returned the Skin 2 tapes ( perhaps they got bored with them ) , but still seem gripped by the American mags , the comics and the fetish art .

source_bert_toks: customs have now returned the skin 2 tapes ( perhaps they got bored with them ) , but still seem gripped by the american mag ##s , the comics and the fe ##tish art .

reference_raw: Customs now returned the Skin Two tapes (perhaps they got bored with them), but they still seem to be trapped by American magazines, comics, and fetish art.

reference_spacy_tokens: Customs now returned the Skin Two tapes ( perhaps they got bored with them ) , but they still seem to be trapped by American magazines , comics , and fetish art .


fn_spacy_tokens_for_baseline: I listen for noises , but it 's real quiet .

source_bert_toks: i listen for noises , but it ' s real quiet .

reference_raw: I'm listening to the noise, but it's really calm.

reference_spacy_tokens: I 'm listening to the noise , but it 's really calm .


fn_spacy_tokens_for_baseline: Tammuz managed to catch Roirbak just as he was making the finishing touches to his evening regalia : black , matt silk suit with thread - wide yellow pinstripe , understated gold adornments , I - Ching earrings .

source_bert_toks: tam ##mu ##z managed to catch roi ##rba ##k just as he was making the finishing touches to his evening regal ##ia : black , matt silk suit with thread - wide yellow pins ##trip ##e , under ##sta ##ted gold ad ##orn ##ments , i - ching earrings .

reference_raw: Tammuz managed to catch up with Roirbak just as he was making final touches to his evening regiment: a black, matt silk suit with thread-wide yellow stripes, underestimated gold ornaments, I-Ching earrings.

reference_spacy_tokens: Tammuz managed to catch up with Roirbak just as he was making final touches to his evening regiment : a black , matt silk suit with thread - wide yellow stripes , underestimated gold ornaments , I - Ching earrings .


fn_spacy_tokens_for_baseline: If the term ' crusty ' slips into your mind , desist .

source_bert_toks: if the term ' crust ##y ' slips into your mind , des ##ist .

reference_raw: When the word "crusty" slips into your head, you're in denial.

reference_spacy_tokens: When the word " crusty " slips into your head , you 're in denial .


fn_spacy_tokens_for_baseline: Jets from the government 's air force counterattacked , bombing the rebel stronghold at the ancient Bala Hissar fort south of Kabul .

source_bert_toks: jets from the government ' s air force counterattack ##ed , bombing the rebel stronghold at the ancient bala hiss ##ar fort south of kabul .

reference_raw: The jets from the government's air force attacked and bombed the rebel fortress at the ancient Bala Hissar fortress south of Kabul.

reference_spacy_tokens: The jets from the government 's air force attacked and bombed the rebel fortress at the ancient Bala Hissar fortress south of Kabul .


fn_spacy_tokens_for_baseline: This is a response from workers who are perhaps seeking a respite from a tedious job , or who wish to defy what they regard as an oppressive management .

source_bert_toks: this is a response from workers who are perhaps seeking a res ##pit ##e from a ted ##ious job , or who wish to def ##y what they regard as an oppressive management .

reference_raw: This is the reaction of workers who may be seeking relief from boring work, or who want to resist what they consider to be oppressive management.

reference_spacy_tokens: This is the reaction of workers who may be seeking relief from boring work , or who want to resist what they consider to be oppressive management .


fn_spacy_tokens_for_baseline: Saddam offers to free Westerners held in Iraq and Kuwait in return for the withdrawal of US forces from the Gulf .

source_bert_toks: saddam offers to free western ##ers held in iraq and kuwait in return for the withdrawal of us forces from the gulf .

reference_raw: Saddam offers the freedom of Westerners who are in Iraq and Kuwait in exchange for the withdrawal of US troops from the Gulf.

reference_spacy_tokens: Saddam offers the freedom of Westerners who are in Iraq and Kuwait in exchange for the withdrawal of US troops from the Gulf .


fn_spacy_tokens_for_baseline: The most important members of this courtier group were the king 's mistress Alice Perrers , William Latimer and John Lord Neville .

source_bert_toks: the most important members of this court ##ier group were the king ' s mistress alice per ##rer ##s , william la ##time ##r and john lord neville .

reference_raw: The King's Lady Alice Perrers, William Latimer and John Lord Neville, were the most important members of the courtier group.

reference_spacy_tokens: The King 's Lady Alice Perrers , William Latimer and John Lord Neville , were the most important members of the courtier group .


fn_spacy_tokens_for_baseline: On Nov. 4 , the National Assembly elected Stefan Savov as its Speaker .

source_bert_toks: on nov . 4 , the national assembly elected stefan sa ##vo ##v as its speaker .

reference_raw: On November 4, the National Assembly chose Stefan Savov as its spokesman.

reference_spacy_tokens: On November 4 , the National Assembly chose Stefan Savov as its spokesman .


fn_spacy_tokens_for_baseline: The estate is substantial and much of it is located in areas which are highly desirable to the private sector .

source_bert_toks: the estate is substantial and much of it is located in areas which are highly desirable to the private sector .

reference_raw: The property is significant and most of it is located in areas that are highly desirable for the private sector.

reference_spacy_tokens: The property is significant and most of it is located in areas that are highly desirable for the private sector .


fn_spacy_tokens_for_baseline: He describes a conspiracy in the early 390s of helots , who together with the other inferior classes outnumber the full Spartan citizens , at a casual count in the agora , by four thousand to forty .

source_bert_toks: he describes a conspiracy in the early 390 ##s of he ##lot ##s , who together with the other inferior classes out ##num ##ber the full spartan citizens , at a casual count in the ago ##ra , by four thousand to forty .

reference_raw: It describes a plot in the early 390s of helicopters, which, together with other lower classes, outnumber all Spartan citizens by four thousand to forty at a random number in the agora.

reference_spacy_tokens: It describes a plot in the early 390s of helicopters , which , together with other lower classes , outnumber all Spartan citizens by four thousand to forty at a random number in the agora .


fn_spacy_tokens_for_baseline: For many years the decision in Prince ( 1875 ) , in effect that the man is strictly liable when the girl is under 16 , has been paraded by academic lawyers as the acme of injustice .

source_bert_toks: for many years the decision in prince ( 1875 ) , in effect that the man is strictly liable when the girl is under 16 , has been parade ##d by academic lawyers as the ac ##me of injustice .

reference_raw: For many years, the Prince's decision (1875) that the man is strictly responsible when the girl is under 16 has been treated by academic lawyers as an act of injustice.

reference_spacy_tokens: For many years , the Prince 's decision ( 1875 ) that the man is strictly responsible when the girl is under 16 has been treated by academic lawyers as an act of injustice .


fn_spacy_tokens_for_baseline: I also admired the way he could peel an apple with the skin in one piece , coiled like a spring .

source_bert_toks: i also admired the way he could peel an apple with the skin in one piece , coiled like a spring .

reference_raw: I was also admiring how he could peel a skin-skinned orb, curled up like a spring.

reference_spacy_tokens: I was also admiring how he could peel a skin - skinned orb , curled up like a spring .


fn_spacy_tokens_for_baseline: Not that the ball needed an extra medal for , to Lucille , it seemed as though a jewel shop had been exploded into extravagant shards of light and colour .

source_bert_toks: not that the ball needed an extra medal for , to lucille , it seemed as though a jewel shop had been exploded into extravagant shards of light and colour .

reference_raw: It wasn't that the ball needed an extra medal for Lucille, but it looked as if a jewellery store had been blown into extravagant pieces of light and color.

reference_spacy_tokens: It was n't that the ball needed an extra medal for Lucille , but it looked as if a jewellery store had been blown into extravagant pieces of light and color .


fn_spacy_tokens_for_baseline: I do n't think she has the faintest idea what it would mean to marry a chap without private means , and if she did , I 'm afraid she 'd change her mind . '

source_bert_toks: i don ' t think she has the faint ##est idea what it would mean to marry a cha ##p without private means , and if she did , i ' m afraid she ' d change her mind . '

reference_raw: I don't think he has any idea what it's like to marry a guy without private resources, and if he does, I'm afraid he'll change his mind.'

reference_spacy_tokens: I do n't think he has any idea what it 's like to marry a guy without private resources , and if he does , I 'm afraid he 'll change his mind . '


fn_spacy_tokens_for_baseline: We do n't of course see the kind of thing that went on in Germany under Hitler , but you feel a disaster is waiting , another disaster of some kind is waiting .

source_bert_toks: we don ' t of course see the kind of thing that went on in germany under hitler , but you feel a disaster is waiting , another disaster of some kind is waiting .

reference_raw: Of course, we don't see what happened in Germany under Hitler, but you feel like there's a catastrophe waiting, and there's another catastrophe waiting.

reference_spacy_tokens: Of course , we do n't see what happened in Germany under Hitler , but you feel like there 's a catastrophe waiting , and there 's another catastrophe waiting .


fn_spacy_tokens_for_baseline: To European eyes United States communications policy seemed dominated by the Department of Defense .

source_bert_toks: to european eyes united states communications policy seemed dominated by the department of defense .

reference_raw: To European eyes, the U.S. communications policy seemed to be under the control of the Department of Defense.

reference_spacy_tokens: To European eyes , the U.S. communications policy seemed to be under the control of the Department of Defense .


fn_spacy_tokens_for_baseline: We finished with some very good summer pudding and an okay cheese board .

source_bert_toks: we finished with some very good summer pudding and an okay cheese board .

reference_raw: We're done with a very good summer pudding and a good cheeseboard.

reference_spacy_tokens: We 're done with a very good summer pudding and a good cheeseboard .


fn_spacy_tokens_for_baseline: ' I still ca n't believe you , ' he remarked , but he washed anyway and he dried himself on the piece of hessian and then spat on his hands and flattened his hair .

source_bert_toks: ' i still can ' t believe you , ' he remarked , but he washed anyway and he dried himself on the piece of hess ##ian and then spat on his hands and flattened his hair .

reference_raw: 'I still don't believe you,' he said, still washing and drying on a piece of hessian, then spitting on his hands and smoothing his hair.

reference_spacy_tokens: ' I still do n't believe you , ' he said , still washing and drying on a piece of hessian , then spitting on his hands and smoothing his hair .


fn_spacy_tokens_for_baseline: Two vehicles were damaged , one destroyed and one disabled by Serb fire , Coward said .

source_bert_toks: two vehicles were damaged , one destroyed and one disabled by serb fire , coward said .

reference_raw: Two vehicles have been damaged, one destroyed and the other destroyed by Serbian fire, Coward said.

reference_spacy_tokens: Two vehicles have been damaged , one destroyed and the other destroyed by Serbian fire , Coward said .


fn_spacy_tokens_for_baseline: ' Smell the ozone ! ' he whooped .

source_bert_toks: ' smell the ozone ! ' he who ##oped .

reference_raw: "I can smell the ozone!" he said.

reference_spacy_tokens: " I can smell the ozone ! " he said .


fn_spacy_tokens_for_baseline: He saw Owen redden with pleasure , and laughed , flinging an arm about his shoulders so forgetfully that it was a worthy as well as a willing sacrifice Owen made for him , containing the pain of the embrace .

source_bert_toks: he saw owen red ##den with pleasure , and laughed , fling ##ing an arm about his shoulders so forget ##fully that it was a worthy as well as a willing sacrifice owen made for him , containing the pain of the embrace .

reference_raw: He saw Owen blush with joy, and laughed, throwing his arm around his shoulders so obliviously that it was both a worthy and willing sacrifice Owen had made for him, containing the pain of his embrace.

reference_spacy_tokens: He saw Owen blush with joy , and laughed , throwing his arm around his shoulders so obliviously that it was both a worthy and willing sacrifice Owen had made for him , containing the pain of his embrace .


fn_spacy_tokens_for_baseline: The Friar plunged down into the ravine and toiled up the other side .

source_bert_toks: the friar plunged down into the ravine and to ##iled up the other side .

reference_raw: The monk plunged into the gorge and toiled the other side.

reference_spacy_tokens: The monk plunged into the gorge and toiled the other side .


fn_spacy_tokens_for_baseline: He began to pour all his time and emotion into poetry , writing with a passion that recalls the English romantics , Oscar Wilde and the American beats .

source_bert_toks: he began to pour all his time and emotion into poetry , writing with a passion that recalls the english romantic ##s , oscar wilde and the american beats .

reference_raw: He began to pour all his time and emotion into poetry, writing with a passion that reminded him of the English romances, Oscar Wilde and the American rhythms.

reference_spacy_tokens: He began to pour all his time and emotion into poetry , writing with a passion that reminded him of the English romances , Oscar Wilde and the American rhythms .


fn_spacy_tokens_for_baseline: Works of art were seized from private homes and accessioned as museum property after World War II and , as such , exhibited to the public .

source_bert_toks: works of art were seized from private homes and accession ##ed as museum property after world war ii and , as such , exhibited to the public .

reference_raw: The works of art were confiscated from private homes and entered as museum property after the Second World War and, as such, displayed to the public.

reference_spacy_tokens: The works of art were confiscated from private homes and entered as museum property after the Second World War and , as such , displayed to the public .


fn_spacy_tokens_for_baseline: Abudah had to make his way through that cavern , that dungeon of lust , and the merchant was assailed now by stench and utter filth instead of sweet perfumes and woods of spices .

source_bert_toks: abu ##dah had to make his way through that cavern , that dungeon of lust , and the merchant was ass ##ailed now by stench and utter fi ##lth instead of sweet perfume ##s and woods of spices .

reference_raw: Abudah had to make his way through the cave, the dungeon of lust, and now the merchant was attacked by smell and utter dirt instead of sweet perfumes and spice forests.

reference_spacy_tokens: Abudah had to make his way through the cave , the dungeon of lust , and now the merchant was attacked by smell and utter dirt instead of sweet perfumes and spice forests .


fn_spacy_tokens_for_baseline: IT WAS LATE AT NIGHT and Alistair was in his room working on a screenplay about a high IQ - IQ homeless black man who is transformed into a white lady junk - bond dealer by a South Moluccan terrorist witch - doctor .

source_bert_toks: it was late at night and alistair was in his room working on a screenplay about a high iq - iq homeless black man who is transformed into a white lady junk - bond dealer by a south mo ##lu ##cca ##n terrorist witch - doctor .

reference_raw: IT WAS LATE AT NIGHT and Alistair were in his room working on a script about a high-level IQ-IQ homeless black man who was turned into a white lady junk dealer by a South Moluccan terrorist witch doctor.

reference_spacy_tokens: IT WAS LATE AT NIGHT and Alistair were in his room working on a script about a high - level IQ - IQ homeless black man who was turned into a white lady junk dealer by a South Moluccan terrorist witch doctor .


fn_spacy_tokens_for_baseline: The gift that I am asking you to make will be used to continue our mission of helping people prepare for , find and keep jobs .

source_bert_toks: the gift that i am asking you to make will be used to continue our mission of helping people prepare for , find and keep jobs .

reference_raw: The gift I ask of you will be used to continue our mission to help people prepare, find and maintain jobs.

reference_spacy_tokens: The gift I ask of you will be used to continue our mission to help people prepare , find and maintain jobs .


fn_spacy_tokens_for_baseline: Though the number of cases where a link between HIV / AIDS and child sexual abuse has been made is relatively small , the long - term implications can not be ignored .

source_bert_toks: though the number of cases where a link between hiv / aids and child sexual abuse has been made is relatively small , the long - term implications can not be ignored .

reference_raw: Although the number of cases where there is a link between HIV/AIDS and sexual exploitation of children is relatively small, the long-term consequences cannot be ignored.

reference_spacy_tokens: Although the number of cases where there is a link between HIV / AIDS and sexual exploitation of children is relatively small , the long - term consequences can not be ignored .


fn_spacy_tokens_for_baseline: Many of the components for new binary agents developed by the former Soviet Union are not on the CWC 's schedules of chemicals and have legitimate civil applications , clouding their association with chemical weapons use .

source_bert_toks: many of the components for new binary agents developed by the former soviet union are not on the cw ##c ' s schedules of chemicals and have legitimate civil applications , cloud ##ing their association with chemical weapons use .

reference_raw: Many of the components of the new binary agents developed by the former Soviet Union are not included in the chemical schedules of the CWC and have legitimate civil uses that cloud their association with the use of chemical weapons.

reference_spacy_tokens: Many of the components of the new binary agents developed by the former Soviet Union are not included in the chemical schedules of the CWC and have legitimate civil uses that cloud their association with the use of chemical weapons .


fn_spacy_tokens_for_baseline: ' I do n't like computers , ' ranted the Doctor .

source_bert_toks: ' i don ' t like computers , ' ran ##ted the doctor .

reference_raw: "I hate computers," the Doctor said.

reference_spacy_tokens: " I hate computers , " the Doctor said .


fn_spacy_tokens_for_baseline: ' Ja ' , he whispered , as she caressed his corded neck with her open mouth , overwhelmed by the scent and taste of his heated , sweat - dampened skin .

source_bert_toks: ' ja ' , he whispered , as she caressed his cord ##ed neck with her open mouth , overwhelmed by the scent and taste of his heated , sweat - damp ##ened skin .

reference_raw: "Ja," he whispered, as she stroked his corded neck with her open mouth, overwhelmed by the smell and smell of his hot, sweaty skin.

reference_spacy_tokens: " Ja , " he whispered , as she stroked his corded neck with her open mouth , overwhelmed by the smell and smell of his hot , sweaty skin .


fn_spacy_tokens_for_baseline: Underneath his suit , he must be glowing like a fresh - cooked lobster .

source_bert_toks: underneath his suit , he must be glowing like a fresh - cooked lobster .

reference_raw: Underneath his suit, he'd have to glow like a fresh-cooked Nephrops.

reference_spacy_tokens: Underneath his suit , he 'd have to glow like a fresh - cooked Nephrops .


fn_spacy_tokens_for_baseline: The Chinese authorities organized low - key celebrations on May 23 to mark the 40th anniversary of the ' liberation ' of Tibet .

source_bert_toks: the chinese authorities organized low - key celebrations on may 23 to mark the 40th anniversary of the ' liberation ' of tibet .

reference_raw: On May 23rd, the Chinese authorities organized a low-key ceremony to mark the 40th anniversary of Tibet's liberation.

reference_spacy_tokens: On May 23rd , the Chinese authorities organized a low - key ceremony to mark the 40th anniversary of Tibet 's liberation .


fn_spacy_tokens_for_baseline: This busy , modern European city sits on a thousand years of history -- history is present everywhere , from elegant Merrion Square to the bullet holes on the General Post Office .

source_bert_toks: this busy , modern european city sits on a thousand years of history - - history is present everywhere , from elegant mer ##rion square to the bullet holes on the general post office .

reference_raw: This busy, modern European city sits on thousands of years of history-history is all over the place, from the elegant Merrion Square to the bullet holes in the General Post Office.

reference_spacy_tokens: This busy , modern European city sits on thousands of years of history - history is all over the place , from the elegant Merrion Square to the bullet holes in the General Post Office .


fn_spacy_tokens_for_baseline: While Ian menaces around the ice with his blond ponytail flowing from beneath his helmet , Stephen , 25 , is a clean - cut , gentlemanly defenceman who commands great respect .

source_bert_toks: while ian menace ##s around the ice with his blond ponytail flowing from beneath his helmet , stephen , 25 , is a clean - cut , gentleman ##ly defence ##man who commands great respect .

reference_raw: While Ian threatens the ice with his blond tail flowing under his helmet, Stephen, 25, is a clean-cut, gentlemanly defender who commands a great deal of respect.

reference_spacy_tokens: While Ian threatens the ice with his blond tail flowing under his helmet , Stephen , 25 , is a clean - cut , gentlemanly defender who commands a great deal of respect .


fn_spacy_tokens_for_baseline: He more than anything wanted to be remembered as one fantastic player . "

source_bert_toks: he more than anything wanted to be remembered as one fantastic player . "

reference_raw: More than anything else, he wanted to be remembered as a fanciful player.

reference_spacy_tokens: More than anything else , he wanted to be remembered as a fanciful player .


fn_spacy_tokens_for_baseline: Their sensory perception as well as their motor responses -- their behaviour -- are thus totally consonant with their bodily form and function .

source_bert_toks: their sensory perception as well as their motor responses - - their behaviour - - are thus totally consonant with their bodily form and function .

reference_raw: Their senses and motor reactions - their behavior - are therefore entirely consistent with their physical form and function.

reference_spacy_tokens: Their senses and motor reactions - their behavior - are therefore entirely consistent with their physical form and function .


fn_spacy_tokens_for_baseline: On August 6th 1945 , the first atomic bomb was dropped on Hiroshima and four weeks later the Japanese surrendered .

source_bert_toks: on august 6th 1945 , the first atomic bomb was dropped on hiroshima and four weeks later the japanese surrendered .

reference_raw: The first atomic bomb was dropped on Hiroshima on August 6, 1945, and four weeks later the Japanese gave up.

reference_spacy_tokens: The first atomic bomb was dropped on Hiroshima on August 6 , 1945 , and four weeks later the Japanese gave up .


fn_spacy_tokens_for_baseline: A very hardy modern variety having white blossoms with bright yellow stamens . 60 - 90 cm ( 2 - 3 ft )

source_bert_toks: a very hardy modern variety having white blossoms with bright yellow st ##amen ##s . 60 - 90 cm ( 2 - 3 ft )

reference_raw: Very tough modern variety with white flowers with bright yellow stamens. 60 to 90 cm (2 to 3 ft)

reference_spacy_tokens: Very tough modern variety with white flowers with bright yellow stamens . 60 to 90 cm ( 2 to 3 ft )


fn_spacy_tokens_for_baseline: It invites denigration , even denial , of the link between physical care and care for the whole person whose body needs tending , and therefore of the knowledge and skill which such activities may require .

source_bert_toks: it invites den ##ig ##ration , even denial , of the link between physical care and care for the whole person whose body needs tending , and therefore of the knowledge and skill which such activities may require .

reference_raw: It calls for denial, even denial, of the relationship between physical care and care for the entire person whose body needs care and, consequently, of the knowledge and skills that these activities may require.

reference_spacy_tokens: It calls for denial , even denial , of the relationship between physical care and care for the entire person whose body needs care and , consequently , of the knowledge and skills that these activities may require .


fn_spacy_tokens_for_baseline: She saw a dark , circular shape rising from the depths , ascending the sides of the canyon .

source_bert_toks: she saw a dark , circular shape rising from the depths , ascending the sides of the canyon .

reference_raw: She could see a dark, round shape rising from the depths and rising up the sides of the chasm.

reference_spacy_tokens: She could see a dark , round shape rising from the depths and rising up the sides of the chasm .


fn_spacy_tokens_for_baseline: At the top end of the Via XXIV Maggio , a blue aerosol script waltzes along an adobi terrace : ' We are Kaos -- Ultras . '

source_bert_toks: at the top end of the via xx ##iv mag ##gio , a blue aero ##sol script waltz ##es along an ad ##ob ##i terrace : ' we are ka ##os - - ultra ##s . '

reference_raw: At the top of the Via XXIV Maggio, a blue aerosol script dances along the adobi terrace: 'We are Kaos - Ultras.'

reference_spacy_tokens: At the top of the Via XXIV Maggio , a blue aerosol script dances along the adobi terrace : ' We are Kaos - Ultras . '


fn_spacy_tokens_for_baseline: Ten minutes after the tail lights of the stolen Cadillac had dwindled to nothingness up the long straight highway , Curtis pulled into the deserted forecourt of the isolated gas station .

source_bert_toks: ten minutes after the tail lights of the stolen cadillac had d ##wind ##led to nothing ##ness up the long straight highway , curtis pulled into the deserted fore ##court of the isolated gas station .

reference_raw: Ten minutes after the taillights of the stolen Cadillac had faded to nothing on the long straight road, Curtis pulled into the deserted front yard of the isolated gas station.

reference_spacy_tokens: Ten minutes after the taillights of the stolen Cadillac had faded to nothing on the long straight road , Curtis pulled into the deserted front yard of the isolated gas station .


fn_spacy_tokens_for_baseline: A European woman might at least chastise him about his drinking !

source_bert_toks: a european woman might at least cha ##stis ##e him about his drinking !

reference_raw: A European woman could at least punish him for drinking!

reference_spacy_tokens: A European woman could at least punish him for drinking !


fn_spacy_tokens_for_baseline: Raising her hands , she snatched at the hairpins which controlled her hair , releasing black curls in a cascade down her back .

source_bert_toks: raising her hands , she snatched at the hair ##pins which controlled her hair , releasing black curls in a cascade down her back .

reference_raw: She raised her hands and grabbed at the pins that controlled her hair, releasing the black curls in a cascade down her back.

reference_spacy_tokens: She raised her hands and grabbed at the pins that controlled her hair , releasing the black curls in a cascade down her back .


fn_spacy_tokens_for_baseline: Richard 's second victim , Clarence , is also taken in by the hypocrite 's feigned concern , but since the real plot against him has been done through intermediaries he may seem less blameworthy .

source_bert_toks: richard ' s second victim , clarence , is also taken in by the h ##yp ##oc ##rite ' s fei ##gned concern , but since the real plot against him has been done through inter ##media ##ries he may seem less blame ##worthy .

reference_raw: Richard's second victim, Clarence, is also taken up by the hypocrite's feigned interest, but since the real plot against him was made through intermediaries, it may seem less reproachful.

reference_spacy_tokens: Richard 's second victim , Clarence , is also taken up by the hypocrite 's feigned interest , but since the real plot against him was made through intermediaries , it may seem less reproachful .


fn_spacy_tokens_for_baseline: She cackled and rocked backwards and forwards .

source_bert_toks: she ca ##ckle ##d and rocked backwards and forwards .

reference_raw: She chuckled and rocked back and forth.

reference_spacy_tokens: She chuckled and rocked back and forth .


fn_spacy_tokens_for_baseline: Farmers would have to be 100 per cent accurate in the identification system to avoid losing out on premium payments .

source_bert_toks: farmers would have to be 100 per cent accurate in the identification system to avoid losing out on premium payments .

reference_raw: In order to avoid the loss of premium payments, farmers would have to be 100 % correct in the identification system.

reference_spacy_tokens: In order to avoid the loss of premium payments , farmers would have to be 100 % correct in the identification system .


fn_spacy_tokens_for_baseline: Ministers on alert for Maastricht showdown

source_bert_toks: ministers on alert for ma ##ast ##rich ##t showdown

reference_raw: Ministers on alert for Maastricht demonstration


fn_spacy_tokens_for_baseline: She kissed him again , slipped on her nightgown and tip - toed back to her room .

source_bert_toks: she kissed him again , slipped on her night ##go ##wn and tip - toe ##d back to her room .

reference_raw: She kissed him again, put on her nightgown, and tiptoed back into her room.

reference_spacy_tokens: She kissed him again , put on her nightgown , and tiptoed back into her room .


fn_spacy_tokens_for_baseline: 1.1 Decision - process These models analyse the buying process as a series models of sequential steps .

source_bert_toks: 1 . 1 decision - process these models anal ##yse the buying process as a series models of sequential steps .

reference_raw: 1.1 Decision-making process These models analyse the purchasing process as a series of steps.

reference_spacy_tokens: 1.1 Decision - making process These models analyse the purchasing process as a series of steps .


fn_spacy_tokens_for_baseline: The attack on the village along the road was still going on , wounded and dead Commandos were being placed against the walls of the cobbled farmyard , waiting their turn as the jeeps ferried to and fro through the village .

source_bert_toks: the attack on the village along the road was still going on , wounded and dead commandos were being placed against the walls of the cobb ##led farm ##yard , waiting their turn as the jeep ##s fe ##rrie ##d to and fr ##o through the village .

reference_raw: The attack on the village along the road continued, wounded and dead commandos pressed against the walls of the paved farmyard, waiting for their turn as the jeeps raced back and forth across the village.

reference_spacy_tokens: The attack on the village along the road continued , wounded and dead commandos pressed against the walls of the paved farmyard , waiting for their turn as the jeeps raced back and forth across the village .


fn_spacy_tokens_for_baseline: Although US and Israeli intelligence agencies continue to insist Iran maintains a stockpile of chemical weapons , no challenge inspections of Iranian facilities have been requested , and none of the allegations made regarding the stockpiling of CW can be verified in the unclassified domain .

source_bert_toks: although us and israeli intelligence agencies continue to insist iran maintains a stock ##pile of chemical weapons , no challenge inspections of iranian facilities have been requested , and none of the allegations made regarding the stock ##pi ##ling of cw can be verified in the un ##class ##ified domain .

reference_raw: While the U.S. and Israeli intelligence agencies continue to insist that Iran retains a stockpile of chemical weapons, no challenge inspections of Iranian facilities were required and none of the claims made concerning the stockpiling of CW can be verified in the non-classified area.

reference_spacy_tokens: While the U.S. and Israeli intelligence agencies continue to insist that Iran retains a stockpile of chemical weapons , no challenge inspections of Iranian facilities were required and none of the claims made concerning the stockpiling of CW can be verified in the non - classified area .


fn_spacy_tokens_for_baseline: They are an easy walk apart by the harbor road , or a longer 45 - minute hike on the scenic Peak Road .

source_bert_toks: they are an easy walk apart by the harbor road , or a longer 45 - minute hike on the scenic peak road .

reference_raw: It's an easy walk down the harbor road, or a long 45-minute hike on the Scenic Peak Road.

reference_spacy_tokens: It 's an easy walk down the harbor road , or a long 45-minute hike on the Scenic Peak Road .


fn_spacy_tokens_for_baseline: Tom Watson believes that if it were located in the middle of the course , it would not be as difficult .

source_bert_toks: tom watson believes that if it were located in the middle of the course , it would not be as difficult .

reference_raw: Tom Watson believes that it wouldn't be so difficult if it were in the middle of the road.

reference_spacy_tokens: Tom Watson believes that it would n't be so difficult if it were in the middle of the road .


fn_spacy_tokens_for_baseline: Each eye - colour treatment includes natural plant extracts such as cucumber ( to soften and moisturise the skin ) , healing calendula , and the natural sun - screen avocado .

source_bert_toks: each eye - colour treatment includes natural plant extracts such as cu ##cum ##ber ( to soft ##en and moist ##uri ##se the skin ) , healing cale ##nd ##ula , and the natural sun - screen av ##oca ##do .

reference_raw: Each eye-colour treatment includes natural plant extracts such as cucumbers (to soften and wet the skin), healing calendulas and natural sunscreen avocados.

reference_spacy_tokens: Each eye - colour treatment includes natural plant extracts such as cucumbers ( to soften and wet the skin ) , healing calendulas and natural sunscreen avocados .


fn_spacy_tokens_for_baseline: Certainly , the Colombian press is much in need of that .

source_bert_toks: certainly , the colombian press is much in need of that .

reference_raw: Of course, the Colombian press needs it a lot.

reference_spacy_tokens: Of course , the Colombian press needs it a lot .


fn_spacy_tokens_for_baseline: She was more captivating than ever .

source_bert_toks: she was more capt ##ivating than ever .

reference_raw: She was more attractive than ever.

reference_spacy_tokens: She was more attractive than ever .


fn_spacy_tokens_for_baseline: Lord Christopher nodded towards the house and then cocked an ear back to the shadowy garden .

source_bert_toks: lord christopher nodded towards the house and then cocked an ear back to the shadowy garden .

reference_raw: Lord Christopher nodded toward the house, then turned his ear back to the dark garden.

reference_spacy_tokens: Lord Christopher nodded toward the house , then turned his ear back to the dark garden .


fn_spacy_tokens_for_baseline: Rep. Tony Hall , D- Ohio , urges the United Nations to allow a freer flow of food and medicine into Iraq .

source_bert_toks: rep . tony hall , d - ohio , urges the united nations to allow a free ##r flow of food and medicine into iraq .

reference_raw: Deputy Tony Hall, D-Ohio, urges the UN to allow food and medicine to flow freely to Iraq.

reference_spacy_tokens: Deputy Tony Hall , D - Ohio , urges the UN to allow food and medicine to flow freely to Iraq .


fn_spacy_tokens_for_baseline: They were shown into cubicles with inadequate curtains , where they were told to strip completely and put on the clean towelling gowns in there .

source_bert_toks: they were shown into cubic ##les with inadequate curtains , where they were told to strip completely and put on the clean towel ##ling gown ##s in there .

reference_raw: They were escorted to cubicles with inadequate curtains, where they were told to strip completely and put on clean towels.

reference_spacy_tokens: They were escorted to cubicles with inadequate curtains , where they were told to strip completely and put on clean towels .


fn_spacy_tokens_for_baseline: ' Look , Geoffrey , ' said Deborah , deciding to have a can of Diet Coke instead .

source_bert_toks: ' look , geoffrey , ' said deborah , deciding to have a can of diet coke instead .

reference_raw: 'Look, Geoffrey,' said Deborah, choosing to take a tin of Diet Coke instead.

reference_spacy_tokens: ' Look , Geoffrey , ' said Deborah , choosing to take a tin of Diet Coke instead .


fn_spacy_tokens_for_baseline: Although Santa Barbara County Sheriff Bill Brown believes that " this fire was the result of carelessness , not criminal intent , " the county district attorney will still have to review the case .

source_bert_toks: although santa barbara county sheriff bill brown believes that " this fire was the result of careless ##ness , not criminal intent , " the county district attorney will still have to review the case .

reference_raw: Although Sheriff Bill Brown of Santa Barbara believes that "the fire was the result of indifference, not criminal intent," the district attorney will still need to examine the case.

reference_spacy_tokens: Although Sheriff Bill Brown of Santa Barbara believes that " the fire was the result of indifference , not criminal intent , " the district attorney will still need to examine the case .


fn_spacy_tokens_for_baseline: He had expected to lose his life on the track , but he passed away peacefully in his bed .

source_bert_toks: he had expected to lose his life on the track , but he passed away peacefully in his bed .

reference_raw: He expected to die on the track, but died peacefully in his bed.

reference_spacy_tokens: He expected to die on the track , but died peacefully in his bed .


fn_spacy_tokens_for_baseline: The marketing man on the other hand is full of enthusiasm for this latest onslaught on the market and most certainly does not think his new ' baby ' is at all routine .

source_bert_toks: the marketing man on the other hand is full of enthusiasm for this latest onslaught on the market and most certainly does not think his new ' baby ' is at all routine .

reference_raw: On the other hand, the marketing man is thrilled with the latest attack on the market, and he certainly doesn't think his new baby's routine.

reference_spacy_tokens: On the other hand , the marketing man is thrilled with the latest attack on the market , and he certainly does n't think his new baby 's routine .


fn_spacy_tokens_for_baseline: By the time we got there , perspiring and struggling within the crowd , it was impossible to have a thought in one 's head except to join in whatever was going on .

source_bert_toks: by the time we got there , per ##sp ##iring and struggling within the crowd , it was impossible to have a thought in one ' s head except to join in whatever was going on .

reference_raw: By the time we got there, sweating and fighting in the crowd, we couldn't think of anything in our heads except to get involved in what was happening.

reference_spacy_tokens: By the time we got there , sweating and fighting in the crowd , we could n't think of anything in our heads except to get involved in what was happening .


fn_spacy_tokens_for_baseline: Mandy brought out a make - up box , and while Charity squirmed and complained she dusted on eyeshadow and mascara and blusher and lipstick .

source_bert_toks: mandy brought out a make - up box , and while charity sq ##ui ##rmed and complained she dust ##ed on eyes ##had ##ow and mascara and blush ##er and lipstick .

reference_raw: Mandy pulled out a makeup box, and while Charity writhed and complained, she dusted her eyeshadow and mascara and blush and lipstick.

reference_spacy_tokens: Mandy pulled out a makeup box , and while Charity writhed and complained , she dusted her eyeshadow and mascara and blush and lipstick .


fn_spacy_tokens_for_baseline: Nowadays , bacon is cured by injecting fresh pork with brine , or soaking it in bring which contains permitted nitrite and nitrate preservatives .

source_bert_toks: nowadays , bacon is cured by in ##ject ##ing fresh pork with br ##ine , or soaking it in bring which contains permitted ni ##tri ##te and nitrate pre ##ser ##vati ##ves .

reference_raw: Today, bacon is healed by injecting fresh pigs with brine or soaking them with authorised nitrite and nitrate preservatives.

reference_spacy_tokens: Today , bacon is healed by injecting fresh pigs with brine or soaking them with authorised nitrite and nitrate preservatives .


fn_spacy_tokens_for_baseline: The attacks have intensified since the Colombian government began cracking down on the traffickers in August , trying to prevent their takeover of the country .

source_bert_toks: the attacks have intensified since the colombian government began cracking down on the traffic ##kers in august , trying to prevent their takeover of the country .

reference_raw: The attacks have intensified since the Colombian government started cracking down on traffickers in September, trying to stop them from taking over the country.

reference_spacy_tokens: The attacks have intensified since the Colombian government started cracking down on traffickers in September , trying to stop them from taking over the country .


fn_spacy_tokens_for_baseline: A glint of panic flashed in the boy 's eyes because he did not speak English very well .

source_bert_toks: a glint of panic flashed in the boy ' s eyes because he did not speak english very well .

reference_raw: There was a twinkle of panic in the boy's eyes, for he didn't speak English very well.

reference_spacy_tokens: There was a twinkle of panic in the boy 's eyes , for he did n't speak English very well .


fn_spacy_tokens_for_baseline: Secondly , it conjures the Wild West by virtue of its position as the middle of a line of three forts , Fort William to the south , and Fort George to the north .

source_bert_toks: secondly , it con ##jure ##s the wild west by virtue of its position as the middle of a line of three forts , fort william to the south , and fort george to the north .

reference_raw: Second, he summons the Wild West as the center of a line of three fortresses, Fort William to the south, and Fort George to the north.

reference_spacy_tokens: Second , he summons the Wild West as the center of a line of three fortresses , Fort William to the south , and Fort George to the north .


fn_spacy_tokens_for_baseline: He seemed a sinister character with his long snout and bony body , alert , watchful , suspicious .

source_bert_toks: he seemed a sinister character with his long snout and bony body , alert , watch ##ful , suspicious .

reference_raw: With his long nose and bony body, he seemed a sinister figure, alert, alert, suspicious.

reference_spacy_tokens: With his long nose and bony body , he seemed a sinister figure , alert , alert , suspicious .


fn_spacy_tokens_for_baseline: They are willing to contribute to and collaborate with the youths , often spending long hours coaxing and prompting .

source_bert_toks: they are willing to contribute to and collaborate with the youths , often spending long hours coa ##xing and prompting .

reference_raw: They are willing to contribute to and cooperate with young people, who often spend long hours of coaxing and prompting.

reference_spacy_tokens: They are willing to contribute to and cooperate with young people , who often spend long hours of coaxing and prompting .


fn_spacy_tokens_for_baseline: It is a passion that usually stays in the tower , however .

source_bert_toks: it is a passion that usually stays in the tower , however .

reference_raw: But it's a passion that usually stays in the spire.

reference_spacy_tokens: But it 's a passion that usually stays in the spire .


fn_spacy_tokens_for_baseline: But how eager he is to be rid of you , she thought , how desperate to have you out from under his roof .

source_bert_toks: but how eager he is to be rid of you , she thought , how desperate to have you out from under his roof .

reference_raw: But he can't wait to get rid of you, she thought, how desperately he wanted you out of his roof.

reference_spacy_tokens: But he ca n't wait to get rid of you , she thought , how desperately he wanted you out of his roof .


fn_spacy_tokens_for_baseline: In the early evening Hazel sought out Bigwig and together they ventured into the copse behind the warren .

source_bert_toks: in the early evening hazel sought out big ##wig and together they ventured into the cops ##e behind the warren .

reference_raw: Hazel found Bigwig in the early evening, and together they ventured into the thicket behind the corridor.

reference_spacy_tokens: Hazel found Bigwig in the early evening , and together they ventured into the thicket behind the corridor .


fn_spacy_tokens_for_baseline: The paper is fixed to a piece of board with masking tape all round and a staple in each corner .

source_bert_toks: the paper is fixed to a piece of board with mask ##ing tape all round and a staple in each corner .

reference_raw: The paper is attached to a piece of board with a camouflage tape around it and a clip in each corner.

reference_spacy_tokens: The paper is attached to a piece of board with a camouflage tape around it and a clip in each corner .


fn_spacy_tokens_for_baseline: The sexual and familial aspects of short - term cohabitation are only too well known to most social workers .

source_bert_toks: the sexual and fa ##mi ##lia ##l aspects of short - term co ##hab ##itation are only too well known to most social workers .

reference_raw: Most social workers are only too well aware of the sexual and family aspects of short-term living.

reference_spacy_tokens: Most social workers are only too well aware of the sexual and family aspects of short - term living .


fn_spacy_tokens_for_baseline: His naked riders on the beach and bare - breasted women laden with flowers and fruit were nostalgic celebrations of a vanishing world .

source_bert_toks: his naked riders on the beach and bare - breast ##ed women laden with flowers and fruit were nos ##tal ##gic celebrations of a vanishing world .

reference_raw: His naked riders on the beach, and his naked-breasted women laden with flowers and fruit, were nostalgic celebrations of the disappearing world.

reference_spacy_tokens: His naked riders on the beach , and his naked - breasted women laden with flowers and fruit , were nostalgic celebrations of the disappearing world .


fn_spacy_tokens_for_baseline: ' I was disappointed that the situation had to arise at all , ' he said .

source_bert_toks: ' i was disappointed that the situation had to arise at all , ' he said .

reference_raw: "I'm sorry the situation had to happen at all," he said.

reference_spacy_tokens: " I 'm sorry the situation had to happen at all , " he said .


fn_spacy_tokens_for_baseline: There was a horrible smell of gas as I passed the Chevron refinery before crossing the Richmond - San Rafael Bridge .

source_bert_toks: there was a horrible smell of gas as i passed the che ##vron refinery before crossing the richmond - san rafael bridge .

reference_raw: As I walked past the Chevron refinery before I crossed the Richmond-San Rafael Bridge, there was a terrible smell of gas.

reference_spacy_tokens: As I walked past the Chevron refinery before I crossed the Richmond - San Rafael Bridge , there was a terrible smell of gas .


fn_spacy_tokens_for_baseline: The band will team up with producer Michael Brook when they start work on their new album in the New Year .

source_bert_toks: the band will team up with producer michael brook when they start work on their new album in the new year .

reference_raw: When they start working on their new album in New Year's Eve, the band will join the producer Michael Brook.

reference_spacy_tokens: When they start working on their new album in New Year 's Eve , the band will join the producer Michael Brook .


fn_spacy_tokens_for_baseline: Turn to meet Him and he will break your arm .

source_bert_toks: turn to meet him and he will break your arm .

reference_raw: Turn around and meet him and he'll smash your arm.

reference_spacy_tokens: Turn around and meet him and he 'll smash your arm .


fn_spacy_tokens_for_baseline: The skills involved in drafting work , examining what has been written and thinking about what has been written in relation to the original purpose of the assignment are skills which teachers stress heavily .

source_bert_toks: the skills involved in drafting work , examining what has been written and thinking about what has been written in relation to the original purpose of the assignment are skills which teachers stress heavily .

reference_raw: The skills involved in drawing up work, examining what has been written and thinking about what has been written in relation to the original purpose of the assignment are skills that teachers have a strong emphasis on.

reference_spacy_tokens: The skills involved in drawing up work , examining what has been written and thinking about what has been written in relation to the original purpose of the assignment are skills that teachers have a strong emphasis on .


fn_spacy_tokens_for_baseline: The author is 28 , film options have already been sold , Penguin is pushing it , and all in all it 's terrific , a sophisticated literary novel that could straddle the markets .

source_bert_toks: the author is 28 , film options have already been sold , penguin is pushing it , and all in all it ' s terrific , a sophisticated literary novel that could st ##rad ##dle the markets .

reference_raw: The author is 28 years old, the movie options have been sold, Penguin is pushing it, and all in all, it's amazing, a sophisticated literary novel that can strangle the market.

reference_spacy_tokens: The author is 28 years old , the movie options have been sold , Penguin is pushing it , and all in all , it 's amazing , a sophisticated literary novel that can strangle the market .


fn_spacy_tokens_for_baseline: The buses should have the following : 1- Light armor and rocket launchers 2- Wireless equipment to report dangerous activities 3- Writing materials to jot down suspicious activities or license plate numbers 4- Sand bags around the buses to protect them from gun fire

source_bert_toks: the buses should have the following : 1 - light armor and rocket launcher ##s 2 - wireless equipment to report dangerous activities 3 - writing materials to jo ##t down suspicious activities or license plate numbers 4 - sand bags around the buses to protect them from gun fire

reference_raw: Buses should be equipped with the following: 1-Light armour and rocket launchers 2-Wireless equipment for reporting hazardous activities 3-Writing materials for recording suspicious activities or license plate 4-Sand bags around buses to protect them from gunfire.

reference_spacy_tokens: Buses should be equipped with the following : 1-Light armour and rocket launchers 2-Wireless equipment for reporting hazardous activities 3-Writing materials for recording suspicious activities or license plate 4-Sand bags around buses to protect them from gunfire .


fn_spacy_tokens_for_baseline: BM shares rise as profits climb 78 percent

source_bert_toks: b ##m shares rise as profits climb 78 percent

reference_raw: BM's shares increase as profits increase 78%

reference_spacy_tokens: BM 's shares increase as profits increase 78 %


fn_spacy_tokens_for_baseline: Later the Germans came in force and occupied many of the islands .

source_bert_toks: later the germans came in force and occupied many of the islands .

reference_raw: Later, the Germans came into force and occupied a large number of islands.

reference_spacy_tokens: Later , the Germans came into force and occupied a large number of islands .


fn_spacy_tokens_for_baseline: " Thus , " said the fat man , " your message must be distinctly urgent . "

source_bert_toks: " thus , " said the fat man , " your message must be distinctly urgent . "

reference_raw: "So," said the big man, "your message must be very urgent."

reference_spacy_tokens: " So , " said the big man , " your message must be very urgent . "


fn_spacy_tokens_for_baseline: A faint sneer of satisfaction touched the corners of his mouth .

source_bert_toks: a faint s ##neer of satisfaction touched the corners of his mouth .

reference_raw: A faint smile of satisfaction touched the corners of his mouth.

reference_spacy_tokens: A faint smile of satisfaction touched the corners of his mouth .


fn_spacy_tokens_for_baseline: And in order to achieve this end , the spirit has to dwell within a number of different entities .

source_bert_toks: and in order to achieve this end , the spirit has to dwell within a number of different entities .

reference_raw: And to achieve that end, the spirit must reside in many different entities.

reference_spacy_tokens: And to achieve that end , the spirit must reside in many different entities .


fn_spacy_tokens_for_baseline: But I doggedly believed that things would change , that they could only get better , yet when I reached the outcrop I wailed with despair .

source_bert_toks: but i dogg ##edly believed that things would change , that they could only get better , yet when i reached the out ##cr ##op i wai ##led with despair .

reference_raw: But I believed, doggedly, that things would change, that they would only improve, but when I reached the outskirts, I wailed in despair.

reference_spacy_tokens: But I believed , doggedly , that things would change , that they would only improve , but when I reached the outskirts , I wailed in despair .


fn_spacy_tokens_for_baseline: On Aug. 24 a 45-truck WFP convoy arrived in Gelib , southern Somalia , carrying 450 tonnes of food and by Sept. 2 the WFP had flown in four planeloads of food aid to Bardera .

source_bert_toks: on aug . 24 a 45 - truck w ##fp convoy arrived in gel ##ib , southern somalia , carrying 450 tonnes of food and by sept . 2 the w ##fp had flown in four plane ##load ##s of food aid to bard ##era .

reference_raw: On August 24, a 45-truck WFP convoy arrived in Gelib, South Somalia, carrying 450 tons of food, and in September 2, the WFP flew four planes of food aid to Bardera.

reference_spacy_tokens: On August 24 , a 45-truck WFP convoy arrived in Gelib , South Somalia , carrying 450 tons of food , and in September 2 , the WFP flew four planes of food aid to Bardera .


fn_spacy_tokens_for_baseline: The girls , coaxed from the cars and persuaded to sit on the bottom row of the stand , were heaped with the players ' coats and scarves and warned not to fidget .

source_bert_toks: the girls , coa ##xed from the cars and persuaded to sit on the bottom row of the stand , were heap ##ed with the players ' coats and scar ##ves and warned not to fi ##dget .

reference_raw: The girls, coaxed out of the cars and convinced to sit in the bottom row of the booth, were piled in their game jackets and scarves and warned not to move.

reference_spacy_tokens: The girls , coaxed out of the cars and convinced to sit in the bottom row of the booth , were piled in their game jackets and scarves and warned not to move .


fn_spacy_tokens_for_baseline: Lice themselves are best found by combing the hair with a detector comb .

source_bert_toks: li ##ce themselves are best found by comb ##ing the hair with a detector comb .

reference_raw: The lice itself is the best way to find it by brushing its hair with a polycomber.

reference_spacy_tokens: The lice itself is the best way to find it by brushing its hair with a polycomber .


fn_spacy_tokens_for_baseline: It is so much easier to conform to arbitrary rules imposed by someone else on the basis of age .

source_bert_toks: it is so much easier to conform to arbitrary rules imposed by someone else on the basis of age .

reference_raw: It is so much easier to comply with arbitrary rules imposed by someone else on the basis of age.

reference_spacy_tokens: It is so much easier to comply with arbitrary rules imposed by someone else on the basis of age .


fn_spacy_tokens_for_baseline: The main dangers for the well - versed record critic are threefold .

source_bert_toks: the main dangers for the well - verse ##d record critic are three ##fold .

reference_raw: The major danger to a well-recorded record critic is threefold.

reference_spacy_tokens: The major danger to a well - recorded record critic is threefold .


fn_spacy_tokens_for_baseline: This tourniquet is released before the needle is withdrawn from the vein to prevent the back - pressure which has built up from causing the blood to spurt out and form a bruise .

source_bert_toks: this tour ##ni ##quet is released before the needle is withdrawn from the vein to prevent the back - pressure which has built up from causing the blood to spur ##t out and form a bruise .

reference_raw: This tourniquet is released before the needle is removed from the vein so that the back pressure that built up does not cause blood to spill out and cause a bruise.

reference_spacy_tokens: This tourniquet is released before the needle is removed from the vein so that the back pressure that built up does not cause blood to spill out and cause a bruise .


fn_spacy_tokens_for_baseline: ' I 've created a series of paths that lead through and around , and there will be mass under - planting of natural flowers -- bluebells , snowdrops , that sort of thing .

source_bert_toks: ' i ' ve created a series of paths that lead through and around , and there will be mass under - planting of natural flowers - - blue ##bell ##s , snow ##drop ##s , that sort of thing .

reference_raw: I've created a number of paths that go through and around, and there'll be a mass underplanting of natural flowers -- blue bells, snowdrops, that sort of thing.

reference_spacy_tokens: I 've created a number of paths that go through and around , and there 'll be a mass underplanting of natural flowers -- blue bells , snowdrops , that sort of thing .


fn_spacy_tokens_for_baseline: then at least they have a chance to over the years be proven not guilty

reference_raw: at least they have the opportunity to prove their innocence over the years


fn_spacy_tokens_for_baseline: Around the walls of the Sligo library hung framed pages of a magazine named Broadsheet , dated 1903 .

source_bert_toks: around the walls of the sl ##igo library hung framed pages of a magazine named broad ##sh ##eet , dated 1903 .

reference_raw: Around the walls of the Sligo Library were framed pages of a 1903 Broadsheet magazine.

reference_spacy_tokens: Around the walls of the Sligo Library were framed pages of a 1903 Broadsheet magazine .


fn_spacy_tokens_for_baseline: Between the mounds the soil was parched .

source_bert_toks: between the mounds the soil was parc ##hed .

reference_raw: The ground was parched between the mounds.

reference_spacy_tokens: The ground was parched between the mounds .