fn_spacy_tokens_for_baseline: Such action becomes particularly distasteful when it is carried out by elected representatives .

source_bert_toks: such action becomes particularly di ##sta ##ste ##ful when it is carried out by elected representatives .

reference_raw: Such action is particularly disgusting if it is carried out by elected representatives.

reference_spacy_tokens: Such action is particularly disgusting if it is carried out by elected representatives .


fn_spacy_tokens_for_baseline: ' Yeah , ' said Camille from the sitting - room and Scarlet felt happier : all that she loved in the world was safely indoors , not roaming the streets with the dispossessed , the vengeful , the undead .

source_bert_toks: ' yeah , ' said camille from the sitting - room and scarlet felt happier : all that she loved in the world was safely indoors , not roaming the streets with the di ##sp ##oss ##essed , the ve ##nge ##ful , the undead .

reference_raw: 'Yes,' said Camille from the living room, and Scarlet felt happier: everything she loved in the world was safe inside, not wandering the streets with the dispossessed, the vengeful, the dead.

reference_spacy_tokens: ' Yes , ' said Camille from the living room , and Scarlet felt happier : everything she loved in the world was safe inside , not wandering the streets with the dispossessed , the vengeful , the dead .


fn_spacy_tokens_for_baseline: We had an altercation that soon resolved itself with me lying face - down in a damp bed of cardboard boxes at the loot of a hidden staircase .

source_bert_toks: we had an alter ##cation that soon resolved itself with me lying face - down in a damp bed of cardboard boxes at the lo ##ot of a hidden staircase .

reference_raw: We had an argument that soon resolved when I lay facedown in a wet bed of cardboard boxes at the loot of the hidden stairs.

reference_spacy_tokens: We had an argument that soon resolved when I lay facedown in a wet bed of cardboard boxes at the loot of the hidden stairs .


fn_spacy_tokens_for_baseline: Click on OK or press Return , and the name you typed in will appear in the Main Menu list .

source_bert_toks: click on ok or press return , and the name you typed in will appear in the main menu list .

reference_raw: Click OK or press Return, and the name you entered will appear in the main menu list.

reference_spacy_tokens: Click OK or press Return , and the name you entered will appear in the main menu list .


fn_spacy_tokens_for_baseline: The U.S. lawmaker got acquainted with the sufferings of the Iraqi children because of acute shortage of food and medicine as a direct result of the embargo , reported the Iraqi News Agency ( INA ) .

source_bert_toks: the u . s . law ##maker got acquainted with the suffering ##s of the iraqi children because of acute shortage of food and medicine as a direct result of the em ##bar ##go , reported the iraqi news agency ( ina ) .

reference_raw: The US legislator became aware of the suffering of Iraqi children due to an acute lack of food and medicine as a direct result of the embargo, and reported it to the Iraqi News Agency.

reference_spacy_tokens: The US legislator became aware of the suffering of Iraqi children due to an acute lack of food and medicine as a direct result of the embargo , and reported it to the Iraqi News Agency .


fn_spacy_tokens_for_baseline: Their origins stem from France where old Mr Fauchon years ago told me his forebears were Huguenots , who fled their country from a small place bearing the family name of Fauchonville .

source_bert_toks: their origins stem from france where old mr fa ##uch ##on years ago told me his fore ##be ##ars were hug ##uen ##ots , who fled their country from a small place bearing the family name of fa ##uch ##on ##ville .

reference_raw: They came from France, where old Mr. Fauchon told me years ago that his ancestors were Huguenots who had fled their country from a small place called Fauchonville.

reference_spacy_tokens: They came from France , where old Mr. Fauchon told me years ago that his ancestors were Huguenots who had fled their country from a small place called Fauchonville .


fn_spacy_tokens_for_baseline: ' Some stoutly affirmed that as Head of the Church of England he could not marry a divorced woman .

source_bert_toks: ' some stout ##ly affirmed that as head of the church of england he could not marry a divorced woman .

reference_raw: Some strongly affirmed that as head of the Church of England, he could not marry a divorcible woman.

reference_spacy_tokens: Some strongly affirmed that as head of the Church of England , he could not marry a divorcible woman .


fn_spacy_tokens_for_baseline: I 'll go to the post office in the village and telegraph the invitation . '

source_bert_toks: i ' ll go to the post office in the village and telegraph the invitation . '

reference_raw: I'm going to the village post office and telegram the invitation.'

reference_spacy_tokens: I 'm going to the village post office and telegram the invitation . '


fn_spacy_tokens_for_baseline: Otherwise Dustin was found swapping quotations with Irish actor T. P. McKenna in the bar or playing endless poker games .

source_bert_toks: otherwise dustin was found swap ##ping quota ##tions with irish actor t . p . mckenna in the bar or playing endless poker games .

reference_raw: Otherwise they found Dustin exchanging quotes with Irish actor T.P. McKenna at a bar or playing endless poker games.

reference_spacy_tokens: Otherwise they found Dustin exchanging quotes with Irish actor T.P. McKenna at a bar or playing endless poker games .


fn_spacy_tokens_for_baseline: ' I do n't mean forgery , ' she crowed triumphantly .

source_bert_toks: ' i don ' t mean forge ##ry , ' she crowe ##d triumphant ##ly .

reference_raw: "I don't mean fake," she said triumphantly.

reference_spacy_tokens: " I do n't mean fake , " she said triumphantly .


fn_spacy_tokens_for_baseline: Our first minor disagreement of this kind came when we met a large puddle on a woodland track and Skipper decided he could n't possibly get his feet wet .

source_bert_toks: our first minor disagreement of this kind came when we met a large puddle on a woodland track and skipper decided he couldn ' t possibly get his feet wet .

reference_raw: Our first minor dispute was when we met a big puddle on a forest track, and the Captain decided he couldn't get his feet wet.

reference_spacy_tokens: Our first minor dispute was when we met a big puddle on a forest track , and the Captain decided he could n't get his feet wet .


fn_spacy_tokens_for_baseline: I waited while he jumped down into the clearing and disappeared .

source_bert_toks: i waited while he jumped down into the clearing and disappeared .

reference_raw: I waited for him to leap into the clearing and disappear.

reference_spacy_tokens: I waited for him to leap into the clearing and disappear .


fn_spacy_tokens_for_baseline: It is unlikely that anyone will give full or truthful answers in an interview to questions that concern sensitive , embarrassing or possibly criminal aspects of their lives .

source_bert_toks: it is unlikely that anyone will give full or truth ##ful answers in an interview to questions that concern sensitive , embarrassing or possibly criminal aspects of their lives .

reference_raw: In an interview, it is unlikely that anyone will give full or true answers to questions relating to sensitive, embarrassing or potentially criminal aspects of their lives.

reference_spacy_tokens: In an interview , it is unlikely that anyone will give full or true answers to questions relating to sensitive , embarrassing or potentially criminal aspects of their lives .


fn_spacy_tokens_for_baseline: Memorise what each of the seven letters represents and run through the check list both during rehearsals and on E - day .

source_bert_toks: memo ##rise what each of the seven letters represents and run through the check list both during rehearsals and on e - day .

reference_raw: Remember what each of the seven letters represents and review the checklist during the test and on an electronic day.

reference_spacy_tokens: Remember what each of the seven letters represents and review the checklist during the test and on an electronic day .


fn_spacy_tokens_for_baseline: It must be noted that this latter source , cited by Anthony Cordesman , can not be independently corroborated , and firsthand data on Iranian BW agents is unavailable in open sources .

source_bert_toks: it must be noted that this latter source , cited by anthony cord ##es ##man , can not be independently co ##rro ##bor ##ated , and first ##hand data on iranian b ##w agents is unavailable in open sources .

reference_raw: It should be noted that the latter source, referred to by Anthony Cordesman, cannot be independently confirmed and that first-hand data on Iranian BW agents is not available from open sources.

reference_spacy_tokens: It should be noted that the latter source , referred to by Anthony Cordesman , can not be independently confirmed and that first - hand data on Iranian BW agents is not available from open sources .


fn_spacy_tokens_for_baseline: In this respect , it would be helpful if our political leaders were mute , rather than eloquently " concerned .

source_bert_toks: in this respect , it would be helpful if our political leaders were mute , rather than el ##o ##quent ##ly " concerned .

reference_raw: In that regard, it would be useful for our political leaders to be mute rather than eloquently concerned.

reference_spacy_tokens: In that regard , it would be useful for our political leaders to be mute rather than eloquently concerned .


fn_spacy_tokens_for_baseline: It 'd be good if the home crowd could sing a bit , if only to keep alive the myth that Leeds create an intimidating atmosphere .

source_bert_toks: it ' d be good if the home crowd could sing a bit , if only to keep alive the myth that leeds create an intimidating atmosphere .

reference_raw: It would be a good idea for the home crowd to sing a little, if only to survive the myth that Leeds creates an atmosphere of intimidation.

reference_spacy_tokens: It would be a good idea for the home crowd to sing a little , if only to survive the myth that Leeds creates an atmosphere of intimidation .


fn_spacy_tokens_for_baseline: The individual artisans ' shops are no longer here , but you can visit a silk - weaving factory , a ceramics plant , and the Foshan Folk Art Studio , where you can observe workers making Chinese lanterns , carving sculptures , painting scrolls , and cutting intricate designs in paper .

source_bert_toks: the individual artisans ' shops are no longer here , but you can visit a silk - weaving factory , a ceramics plant , and the f ##osh ##an folk art studio , where you can observe workers making chinese lanterns , carving sculptures , painting scrolls , and cutting intricate designs in paper .

reference_raw: The various craftsmen's shops aren't here anymore, but you can visit the silk-weaving factory, the ceramic factory, and the Foshan Folk Art Studio, where you can see the workers who make Chinese lanterns, carve statues, paint scrolls, and cut intricate designs on paper.

reference_spacy_tokens: The various craftsmen 's shops are n't here anymore , but you can visit the silk - weaving factory , the ceramic factory , and the Foshan Folk Art Studio , where you can see the workers who make Chinese lanterns , carve statues , paint scrolls , and cut intricate designs on paper .


fn_spacy_tokens_for_baseline: In other words , it was a kinswoman of the Bernician royal family , but one with strong Deiran connections , who interceded on this occasion for Wilfrid .

source_bert_toks: in other words , it was a kin ##sw ##oman of the bern ##icia ##n royal family , but one with strong dei ##ran connections , who inter ##cede ##d on this occasion for wil ##frid .

reference_raw: In other words, she was a relative of the Bernician royal family, but one with a strong Deiran connection, who had interceded with Wilfrid on this occasion.

reference_spacy_tokens: In other words , she was a relative of the Bernician royal family , but one with a strong Deiran connection , who had interceded with Wilfrid on this occasion .


fn_spacy_tokens_for_baseline: I lapped at the warm , rich blood ; very nice , very fresh .

source_bert_toks: i lap ##ped at the warm , rich blood ; very nice , very fresh .

reference_raw: I knocked on warm, rich blood; very sweet, very fresh.

reference_spacy_tokens: I knocked on warm , rich blood ; very sweet , very fresh .


fn_spacy_tokens_for_baseline: Two people were in the living room , a man and a woman , both in uniform , dusting the various surfaces with whitish powder .

source_bert_toks: two people were in the living room , a man and a woman , both in uniform , dustin ##g the various surfaces with whitish powder .

reference_raw: There were two people in the living room, a man and a woman, both in uniform, scouring the various surfaces with white powder.

reference_spacy_tokens: There were two people in the living room , a man and a woman , both in uniform , scouring the various surfaces with white powder .


fn_spacy_tokens_for_baseline: Sequence traces belonging to transposable element families were assembled using an aggressive strategy that resulted in composite sequences for most of the transposable elements in Release 2 . Part of the finishing effort has been to determine the sequence of each individual element .

source_bert_toks: sequence traces belonging to trans ##po ##sable element families were assembled using an aggressive strategy that resulted in composite sequences for most of the trans ##po ##sable elements in release 2 . part of the finishing effort has been to determine the sequence of each individual element .

reference_raw: The sequence marks belonging to the families of the transposable elements have been assembled using an aggressive strategy leading to composite sequences for most of the transposable elements in release 2. Part of the final effort is to determine the sequence of each individual element.

reference_spacy_tokens: The sequence marks belonging to the families of the transposable elements have been assembled using an aggressive strategy leading to composite sequences for most of the transposable elements in release 2 . Part of the final effort is to determine the sequence of each individual element .


fn_spacy_tokens_for_baseline: THE VAST majority of Scots believe moral values and the behaviour of young people have deteriorated in the last decade .

source_bert_toks: the vast majority of scots believe moral values and the behaviour of young people have deteriorated in the last decade .

reference_raw: VAST Most Scots believe that moral values and that young people's behavior has deteriorated over the last ten years.

reference_spacy_tokens: VAST Most Scots believe that moral values and that young people 's behavior has deteriorated over the last ten years .


fn_spacy_tokens_for_baseline: Dr Marshall , whose 18 cats occupy an outhouse , explained that with major damp - proofing repairs being carried out , she could not live in the house .

source_bert_toks: dr marshall , whose 18 cats occupy an out ##house , explained that with major damp - proof ##ing repairs being carried out , she could not live in the house .

reference_raw: Dr. Marshall, whose 18 cats occupy the outdoors, explained that she couldn't live in the house with major wet-resistant repairs.

reference_spacy_tokens: Dr. Marshall , whose 18 cats occupy the outdoors , explained that she could n't live in the house with major wet - resistant repairs .


fn_spacy_tokens_for_baseline: If this cycle obtains , then it is argued that government is controlled , and public policy is congruent with the wishes of the majority of the electorate for most of the time .

source_bert_toks: if this cycle obtain ##s , then it is argued that government is controlled , and public policy is cong ##ru ##ent with the wishes of the majority of the electorate for most of the time .

reference_raw: If this cycle succeeds, it is argued that government is controlled, and public policy is largely in line with the wishes of most voters.

reference_spacy_tokens: If this cycle succeeds , it is argued that government is controlled , and public policy is largely in line with the wishes of most voters .


fn_spacy_tokens_for_baseline: If you 've mastered the basics of riding and are a competent rider lusting after some unbridled adventure , saddle up for trail riding -- a trek lasting two or three days with overnight stops .

source_bert_toks: if you ' ve mastered the basics of riding and are a competent rider lust ##ing after some un ##bri ##dled adventure , saddle up for trail riding - - a trek lasting two or three days with overnight stops .

reference_raw: If you've mastered the basics of the ride, and you're a good rider who longs for some unbridled adventure, saddle up for a journey - a trip that lasts two or three days with night stops.

reference_spacy_tokens: If you 've mastered the basics of the ride , and you 're a good rider who longs for some unbridled adventure , saddle up for a journey - a trip that lasts two or three days with night stops .


fn_spacy_tokens_for_baseline: Whether the worker directs his anger outwards or inwards he is in a fix ; what can be called a ' double bind ' .

source_bert_toks: whether the worker directs his anger outward ##s or inward ##s he is in a fix ; what can be called a ' double bind ' .

reference_raw: Whether the worker directs his anger outwards or inwards, he is in a state of repair; what can be called a double bond.

reference_spacy_tokens: Whether the worker directs his anger outwards or inwards , he is in a state of repair ; what can be called a double bond .


fn_spacy_tokens_for_baseline: Iron clanged against steel .

source_bert_toks: iron clan ##ged against steel .

reference_raw: The iron clattered against steel.

reference_spacy_tokens: The iron clattered against steel .


fn_spacy_tokens_for_baseline: Or moving it to Lubbock or somewhere possibly is not the answer .

source_bert_toks: or moving it to lu ##bb ##ock or somewhere possibly is not the answer .

reference_raw: Or going to Lubbock or somewhere isn't the answer.

reference_spacy_tokens: Or going to Lubbock or somewhere is n't the answer .


fn_spacy_tokens_for_baseline: Finally we crossed a low pass and descended into the wide depression of the oasis where straggling clumps of trees and patchy cultivation marked the first springs .

source_bert_toks: finally we crossed a low pass and descended into the wide depression of the oasis where st ##rag ##gling cl ##ump ##s of trees and patch ##y cultivation marked the first springs .

reference_raw: At last we crossed a low gorge and descended into the wide depression of the oasis, where the first springs were marked by strangling clusters of trees and patchy growing.

reference_spacy_tokens: At last we crossed a low gorge and descended into the wide depression of the oasis , where the first springs were marked by strangling clusters of trees and patchy growing .


fn_spacy_tokens_for_baseline: She was roused from this reverie seconds later when he gulped the last of the juice and said , ' I know what Faye 's ' few minutes ' mean .

source_bert_toks: she was rouse ##d from this rev ##erie seconds later when he gulped the last of the juice and said , ' i know what faye ' s ' few minutes ' mean .

reference_raw: A few seconds later, when he swallowed the last of his juice and said, "I know what Faye means.

reference_spacy_tokens: A few seconds later , when he swallowed the last of his juice and said , " I know what Faye means .


fn_spacy_tokens_for_baseline: Their weight was such that the seam of his coat gaped behind his neck , his shoulders were bowed , and his front hem trailed on the ground .

source_bert_toks: their weight was such that the seam of his coat gaped behind his neck , his shoulders were bowed , and his front hem trailed on the ground .

reference_raw: Their weight was so great that the seal of his coat gaped behind his neck, his shoulders bent, and his front hem trailed to the floor.

reference_spacy_tokens: Their weight was so great that the seal of his coat gaped behind his neck , his shoulders bent , and his front hem trailed to the floor .


fn_spacy_tokens_for_baseline: They all wore serpent - like black coral bracelets as special protective amulets against snakes .

source_bert_toks: they all wore serpent - like black coral bracelet ##s as special protective amulet ##s against snakes .

reference_raw: They all wore black coral necklaces like snakes, like special protection amulets against snakes.

reference_spacy_tokens: They all wore black coral necklaces like snakes , like special protection amulets against snakes .


fn_spacy_tokens_for_baseline: ' You have guards on all the gates ? ' he inquired anxiously .

source_bert_toks: ' you have guards on all the gates ? ' he inquired anxiously .

reference_raw: "Are you guarding all the gates?" he asked anxiously.

reference_spacy_tokens: " Are you guarding all the gates ? " he asked anxiously .


fn_spacy_tokens_for_baseline: My instructor played a role like no other instructor I 've ever had I appreciate everything that Goodwill has done for me . " -- Cornell

source_bert_toks: my instructor played a role like no other instructor i ' ve ever had i appreciate everything that goodwill has done for me . " - - cornell

reference_raw: My instructor has played a role like no other instructor I've ever had, and I value everything Goodwill has done for me.

reference_spacy_tokens: My instructor has played a role like no other instructor I 've ever had , and I value everything Goodwill has done for me .


fn_spacy_tokens_for_baseline: And there were more birds at low tide , gulls sweeping low over the mud , sometimes walking on it , leaving little lines of three - toed tracks .

source_bert_toks: and there were more birds at low tide , gu ##lls sweeping low over the mud , sometimes walking on it , leaving little lines of three - toe ##d tracks .

reference_raw: And there were other birds in the low tide, seagulls sweeping low across the mud, sometimes walking on it, leaving little rows of three-toed footprints.

reference_spacy_tokens: And there were other birds in the low tide , seagulls sweeping low across the mud , sometimes walking on it , leaving little rows of three - toed footprints .


fn_spacy_tokens_for_baseline: Hong Kong has long been China 's handiest window on the West , and the city is unrivaled in its commercial know - how and managerial expertise .

source_bert_toks: hong kong has long been china ' s hand ##iest window on the west , and the city is un ##ri ##vale ##d in its commercial know - how and managerial expertise .

reference_raw: Hong Kong has been China's most beautiful window in the West for a long time, and the city is not rivaled by its commercial knowledge and managerial expertise.

reference_spacy_tokens: Hong Kong has been China 's most beautiful window in the West for a long time , and the city is not rivaled by its commercial knowledge and managerial expertise .


fn_spacy_tokens_for_baseline: They described intense shelling , artillery fire and aerial bombardment directed at civilian residences in the city as well as a campaign of kidnappings directed at the relatives of those fighting against Kadafi 's authority .

source_bert_toks: they described intense shell ##ing , artillery fire and aerial bombardment directed at civilian residences in the city as well as a campaign of kidnapping ##s directed at the relatives of those fighting against ka ##da ##fi ' s authority .

reference_raw: They described intense shelling, artillery fire, and air-bombing aimed at civilian residences in the city, as well as an abduction campaign aimed at relatives of those who fought against Kadafi's authority.

reference_spacy_tokens: They described intense shelling , artillery fire , and air - bombing aimed at civilian residences in the city , as well as an abduction campaign aimed at relatives of those who fought against Kadafi 's authority .


fn_spacy_tokens_for_baseline: She breakfasted on fried bread and bacon , and tea with four spoons of sugar , before a full turkey dinner with the other 33 residents at her nursing home in Redcar , Cleveland .

source_bert_toks: she breakfast ##ed on fried bread and bacon , and tea with four spoon ##s of sugar , before a full turkey dinner with the other 33 residents at her nursing home in red ##car , cleveland .

reference_raw: She had breakfasted with fried bread and bacon and tea with four teaspoons of sugar before a full turkey dinner with 33 other residents in her home in Redcar, Cleveland.

reference_spacy_tokens: She had breakfasted with fried bread and bacon and tea with four teaspoons of sugar before a full turkey dinner with 33 other residents in her home in Redcar , Cleveland .


fn_spacy_tokens_for_baseline: Although he is supportive of the general trend of de - hospitalising labour wards in the NHS , he dislikes what he calls the evangelism of the active birth movement .

source_bert_toks: although he is supportive of the general trend of de - hospital ##ising labour wards in the nhs , he dislike ##s what he calls the evan ##gel ##ism of the active birth movement .

reference_raw: Although he supports the general trend of de-hospitalizing NHS labor divisions, he does not like what he calls the evangelism of the active birth movement.

reference_spacy_tokens: Although he supports the general trend of de - hospitalizing NHS labor divisions , he does not like what he calls the evangelism of the active birth movement .


fn_spacy_tokens_for_baseline: " Noriega has closed every independent newspaper , radio and television station and arrested , tortured or forced into exile a long list of reporters , " the statement declared .

source_bert_toks: " nor ##ieg ##a has closed every independent newspaper , radio and television station and arrested , tortured or forced into exile a long list of reporters , " the statement declared .

reference_raw: "Noriega has shut down all independent newspapers, radio and television stations and arrested, tortured, or pushed into exile a long list of reporters," he said.

reference_spacy_tokens: " Noriega has shut down all independent newspapers , radio and television stations and arrested , tortured , or pushed into exile a long list of reporters , " he said .


fn_spacy_tokens_for_baseline: The annoyances , injustices , and setbacks from which it suffered seem small in retrospect , but they preyed on the minds of its members at the time .

source_bert_toks: the annoyance ##s , injustice ##s , and set ##backs from which it suffered seem small in retro ##sp ##ect , but they prey ##ed on the minds of its members at the time .

reference_raw: In retrospect, the resentments, injustices, and failures that made him suffer seem small, but at the time they were preying on the minds of their members.

reference_spacy_tokens: In retrospect , the resentments , injustices , and failures that made him suffer seem small , but at the time they were preying on the minds of their members .


fn_spacy_tokens_for_baseline: She started the engine and turned the jeep so that its tyres squealed , then drove back down the drive and down the pretty hillside , wanting only to be somewhere by herself to sit and mourn .

source_bert_toks: she started the engine and turned the jeep so that its tyres squealed , then drove back down the drive and down the pretty hillside , wanting only to be somewhere by herself to sit and mo ##urn .

reference_raw: She started the engine and turned the jeep around so that its tires screamed, then drove back down the driveway and down a nice hillside, wishing she could just sit there and grieve.

reference_spacy_tokens: She started the engine and turned the jeep around so that its tires screamed , then drove back down the driveway and down a nice hillside , wishing she could just sit there and grieve .


fn_spacy_tokens_for_baseline: Parents act as role models of self - sufficiency instead of dependency .

source_bert_toks: parents act as role models of self - su ##ffi ##ciency instead of dependency .

reference_raw: Parents act as models of self-sufficiency rather than dependence.

reference_spacy_tokens: Parents act as models of self - sufficiency rather than dependence .


fn_spacy_tokens_for_baseline: It routes client - server requests across networks having different protocols , such as named pipes , TCP / IP and DECnet .

source_bert_toks: it routes client - server requests across networks having different protocols , such as named pipes , tc ##p / ip and dec ##net .

reference_raw: It serves client-server requests through networks that have different protocols, e.g. named pipes, TCP/IP and DECnet.

reference_spacy_tokens: It serves client - server requests through networks that have different protocols , e.g. named pipes , TCP / IP and DECnet .


fn_spacy_tokens_for_baseline: Could she have known that you would even listen to her , that you would be King and statesman before you allowed yourself to be the vengeful husband ?

source_bert_toks: could she have known that you would even listen to her , that you would be king and statesman before you allowed yourself to be the ve ##nge ##ful husband ?

reference_raw: Would she know you'd even listen to her, that you'd be a king and a statesman before you let yourself be a revengeful husband?

reference_spacy_tokens: Would she know you 'd even listen to her , that you 'd be a king and a statesman before you let yourself be a revengeful husband ?


fn_spacy_tokens_for_baseline: As a result , the merchants were forced to limit their salvoes to one a day - and from then on , they signaled the noon hour daily for all to hear .

source_bert_toks: as a result , the merchants were forced to limit their sal ##vo ##es to one a day - and from then on , they signaled the noon hour daily for all to hear .

reference_raw: As a result, the merchants were forced to limit their volleys to one a day - and from then on they signaled noon a day for everyone to hear.

reference_spacy_tokens: As a result , the merchants were forced to limit their volleys to one a day - and from then on they signaled noon a day for everyone to hear .


fn_spacy_tokens_for_baseline: There have also been some power outages due to power lines being damaged .

source_bert_toks: there have also been some power out ##ages due to power lines being damaged .

reference_raw: There have also been some blackouts as a result of the damage to the power lines.

reference_spacy_tokens: There have also been some blackouts as a result of the damage to the power lines .


fn_spacy_tokens_for_baseline: Wynn 's demolition of the existing properties started a trend that , more than any other , describes Las Vegas at the end of the 20th century : removal of old properties in exchange for the potential of new ones .

source_bert_toks: wynn ' s demolition of the existing properties started a trend that , more than any other , describes las vegas at the end of the 20th century : removal of old properties in exchange for the potential of new ones .

reference_raw: At the end of the 20th century, Wynn's demolition of existing property began a trend which, more than anything else, describes Las Vegas: the removal of old property in return for the potential of new ones.

reference_spacy_tokens: At the end of the 20th century , Wynn 's demolition of existing property began a trend which , more than anything else , describes Las Vegas : the removal of old property in return for the potential of new ones .


fn_spacy_tokens_for_baseline: At the time of the Czechoslovakian crisis on Monday 28 September 1938 , there was a temporary evacuation of schoolchildren and hospital patients from London .

source_bert_toks: at the time of the czechoslovakia ##n crisis on monday 28 september 1938 , there was a temporary evacuation of school ##child ##ren and hospital patients from london .

reference_raw: On Monday 28 September 1938, at the time of the Czechoslovakian crisis, schoolchildren and hospital patients were temporarily evacuated from London.

reference_spacy_tokens: On Monday 28 September 1938 , at the time of the Czechoslovakian crisis , schoolchildren and hospital patients were temporarily evacuated from London .


fn_spacy_tokens_for_baseline: Several chemicals are dual - use in nature and imported under the umbrella of pesticide , petrochemical , and various pharmaceutical ventures .

source_bert_toks: several chemicals are dual - use in nature and imported under the umbrella of pest ##icide , pet ##ro ##chemical , and various pharmaceutical ventures .

reference_raw: A number of chemicals are twofold: use in nature and imported under the umbrella of pesticides, petrochemicals, and various pharmaceutical companies.

reference_spacy_tokens: A number of chemicals are twofold : use in nature and imported under the umbrella of pesticides , petrochemicals , and various pharmaceutical companies .


fn_spacy_tokens_for_baseline: It is a symptom of Manchester United 's current ailment that players like Giggs are suffering from the tension .

source_bert_toks: it is a sy ##mpt ##om of manchester united ' s current ai ##lm ##ent that players like gig ##gs are suffering from the tension .

reference_raw: It's a sign of Manchester United's current illness that players like Giggs suffer from tension.

reference_spacy_tokens: It 's a sign of Manchester United 's current illness that players like Giggs suffer from tension .


fn_spacy_tokens_for_baseline: But the government shielded consumers from the worst excesses of inflation by reducing the community charge burden , and businesses kept their price rises down to one of the lowest levels for 24 years .

source_bert_toks: but the government shielded consumers from the worst excess ##es of inflation by reducing the community charge burden , and businesses kept their price rises down to one of the lowest levels for 24 years .

reference_raw: But the government has protected consumers from the worst inflation surpluses by reducing the burden of community charges, and businesses have kept their price increases to one of the lowest levels for 24 years.

reference_spacy_tokens: But the government has protected consumers from the worst inflation surpluses by reducing the burden of community charges , and businesses have kept their price increases to one of the lowest levels for 24 years .


fn_spacy_tokens_for_baseline: Whether or not his redefinition of democracy salvages what classical theorists meant by ' democracy ' is one of the points on which his work has been most criticised .

source_bert_toks: whether or not his red ##ef ##ini ##tion of democracy salvage ##s what classical theorists meant by ' democracy ' is one of the points on which his work has been most criticised .

reference_raw: Whether his re-definition of democracy saves what classic theorists mean by "democracy" is one of the most critical aspects of his work.

reference_spacy_tokens: Whether his re - definition of democracy saves what classic theorists mean by " democracy " is one of the most critical aspects of his work .


fn_spacy_tokens_for_baseline: Her final sight of Hatherley was from the lane which skirted the park for a short distance .

source_bert_toks: her final sight of hat ##her ##ley was from the lane which skirt ##ed the park for a short distance .

reference_raw: The last thing she saw of Hatherley was from the lane around the park.

reference_spacy_tokens: The last thing she saw of Hatherley was from the lane around the park .


fn_spacy_tokens_for_baseline: The man near the table snickered and rejoined his companions , snatching the sack out of Jack 's hand as he passed .

source_bert_toks: the man near the table s ##nick ##ered and rejoined his companions , snatch ##ing the sack out of jack ' s hand as he passed .

reference_raw: The man at the table chuckled and joined his companions, snatching the bag from Jack's hand as he passed.

reference_spacy_tokens: The man at the table chuckled and joined his companions , snatching the bag from Jack 's hand as he passed .


fn_spacy_tokens_for_baseline: My son was so feeble that I thought I would lose him at birth .

source_bert_toks: my son was so fee ##ble that i thought i would lose him at birth .

reference_raw: My son was so weak, I thought I'd get rid of him when I was born.

reference_spacy_tokens: My son was so weak , I thought I 'd get rid of him when I was born .


fn_spacy_tokens_for_baseline: The Museum of History ( open Tuesday - Saturday 10 am - 6 pm , Sunday 1 - 6 pm ; closed Monday ; admission HK$10 adult , HK$5 child ) opened its new permanent collection at the end of August 2001 .

source_bert_toks: the museum of history ( open tuesday - saturday 10 am - 6 pm , sunday 1 - 6 pm ; closed monday ; admission hk $ 10 adult , hk $ 5 child ) opened its new permanent collection at the end of august 2001 .

reference_raw: At the end of August 2001, the Museum of History (open Tuesday - Saturday 10 a.m. - 6 p.m., Sunday 1 - 6 p.m.; completed Monday; admission of HK$10 adults, HK$5 children) opened a new permanent collection.

reference_spacy_tokens: At the end of August 2001 , the Museum of History ( open Tuesday - Saturday 10 a.m. - 6 p.m. , Sunday 1 - 6 p.m. ; completed Monday ; admission of HK$10 adults , HK$5 children ) opened a new permanent collection .


fn_spacy_tokens_for_baseline: Estimates vary on how soon North Korea could begin operating a uranium enrichment plant , but North Korea probably could not produce significant quantities of weapons - grade HEU until the end of the decade .

source_bert_toks: estimates vary on how soon north korea could begin operating a uranium enrichment plant , but north korea probably could not produce significant quantities of weapons - grade he ##u until the end of the decade .

reference_raw: Estimates vary as soon as North Korea can start running a uranium enrichment plant, but it is likely that North Korea will not be able to produce a significant amount of weapons-grade HEU until the decade is over.

reference_spacy_tokens: Estimates vary as soon as North Korea can start running a uranium enrichment plant , but it is likely that North Korea will not be able to produce a significant amount of weapons - grade HEU until the decade is over .


fn_spacy_tokens_for_baseline: No , that was a false hope .

source_bert_toks: no , that was a false hope .

reference_raw: No, it was a bogus hope.

reference_spacy_tokens: No , it was a bogus hope .


fn_spacy_tokens_for_baseline: She can mail the records .

source_bert_toks: she can mail the records .

reference_raw: He can send records.

reference_spacy_tokens: He can send records .


fn_spacy_tokens_for_baseline: Some of them urged that the imperfections of the creation cohere with those of the Hebrew scriptures , of which they held a low opinion .

source_bert_toks: some of them urged that the imperfect ##ions of the creation co ##her ##e with those of the hebrew scriptures , of which they held a low opinion .

reference_raw: Some called for the imperfections of creation to be consistent with those of the Hebrew scriptures, of which they had little opinion.

reference_spacy_tokens: Some called for the imperfections of creation to be consistent with those of the Hebrew scriptures , of which they had little opinion .


fn_spacy_tokens_for_baseline: What made the case stand out was the motivation for Otto 's pilfering .

source_bert_toks: what made the case stand out was the motivation for otto ' s pi ##lf ##ering .

reference_raw: What made this case stand out was the motive for Otto's plundering.

reference_spacy_tokens: What made this case stand out was the motive for Otto 's plundering .


fn_spacy_tokens_for_baseline: Both sides are permitted considerable licence to achieve their aims and in the ensuing melee , where there is little prospect of administering rules , many old scores are settled .

source_bert_toks: both sides are permitted considerable licence to achieve their aims and in the ensuing melee , where there is little prospect of administering rules , many old scores are settled .

reference_raw: Both sides have considerable licenses to achieve their objectives, and many old scores are settled in the aftermath, where there is little prospect of administering the rules.

reference_spacy_tokens: Both sides have considerable licenses to achieve their objectives , and many old scores are settled in the aftermath , where there is little prospect of administering the rules .


fn_spacy_tokens_for_baseline: It would bring about the development of an indigenous Iranian missile industry , two " wars of the cities , " and the evolution of a strategic concept concerning the military and political importance of ballistic missiles .

source_bert_toks: it would bring about the development of an indigenous iranian missile industry , two " wars of the cities , " and the evolution of a strategic concept concerning the military and political importance of ballistic missiles .

reference_raw: This would lead to the development of a domestic Iranian missile industry, two "town wars," and the development of a strategic concept on the military and political significance of ballistic missiles.

reference_spacy_tokens: This would lead to the development of a domestic Iranian missile industry , two " town wars , " and the development of a strategic concept on the military and political significance of ballistic missiles .


fn_spacy_tokens_for_baseline: He said he would wait to see if the Caliph would reward us for forcing the breach .

source_bert_toks: he said he would wait to see if the caliph would reward us for forcing the breach .

reference_raw: He said he'd wait and see if the Californians would reward us for forcing the breach.

reference_spacy_tokens: He said he 'd wait and see if the Californians would reward us for forcing the breach .


fn_spacy_tokens_for_baseline: In 1951 the words ' I 'm all right , Jack ' still meant , as they meant in the cruder wartime version , a totally reprehensible attitude towards Jack , whom you were supposed to care about .

source_bert_toks: in 1951 the words ' i ' m all right , jack ' still meant , as they meant in the crude ##r wartime version , a totally rep ##re ##hen ##sible attitude towards jack , whom you were supposed to care about .

reference_raw: In 1951, the words "I'm fine, Jack" still meant, as they meant in the cruder version of the war, a completely repulsive attitude toward Jack, whom you should have cared about.

reference_spacy_tokens: In 1951 , the words " I 'm fine , Jack " still meant , as they meant in the cruder version of the war , a completely repulsive attitude toward Jack , whom you should have cared about .


fn_spacy_tokens_for_baseline: Few people have come forward because of fear of retribution and sympathy for the militants ' cause .

source_bert_toks: few people have come forward because of fear of retribution and sympathy for the militants ' cause .

reference_raw: Few people reported for fear of retribution and compassion for the military's cause.

reference_spacy_tokens: Few people reported for fear of retribution and compassion for the military 's cause .


fn_spacy_tokens_for_baseline: Standing so close he smelt the fusty clothes and a sour whiff on the old man 's breath .

source_bert_toks: standing so close he sm ##elt the fu ##sty clothes and a sour w ##hiff on the old man ' s breath .

reference_raw: He stood so close that he could smell his fusty clothes and a sour breath on the old man's breath.

reference_spacy_tokens: He stood so close that he could smell his fusty clothes and a sour breath on the old man 's breath .


fn_spacy_tokens_for_baseline: Dexy 's used to workout together , they abstained from alcohol and drugs .

source_bert_toks: dex ##y ' s used to workout together , they abs ##tained from alcohol and drugs .

reference_raw: Dexy's used to practice together, drinking and drugs abstained.

reference_spacy_tokens: Dexy 's used to practice together , drinking and drugs abstained .


fn_spacy_tokens_for_baseline: Peter Chambers of the Hessle Bookshop , Humberside , and a member of the NBS committee , conceded that if the sale was to survive it had to be completely overhauled .

source_bert_toks: peter chambers of the hess ##le books ##hop , hum ##bers ##ide , and a member of the n ##bs committee , conceded that if the sale was to survive it had to be completely overhaul ##ed .

reference_raw: Peter Chambers of the Hessle Bookshop, Humberside, and a member of the NBS Committee admitted that if the sale were to survive, it would have to be completely revised.

reference_spacy_tokens: Peter Chambers of the Hessle Bookshop , Humberside , and a member of the NBS Committee admitted that if the sale were to survive , it would have to be completely revised .


fn_spacy_tokens_for_baseline: If the catoplebas was especially peckish it would gnaw on its own forelegs .

source_bert_toks: if the cat ##ople ##bas was especially peck ##ish it would g ##na ##w on its own fore ##leg ##s .

reference_raw: If the catoplebas had been particularly peckish, it would have gnawed on its own front legs.

reference_spacy_tokens: If the catoplebas had been particularly peckish , it would have gnawed on its own front legs .


fn_spacy_tokens_for_baseline: After all , the construction of one motor car may differ from another without affecting its performance .

source_bert_toks: after all , the construction of one motor car may differ from another without affecting its performance .

reference_raw: After all, the construction of one motor vehicle may be different from the other without affecting its performance.

reference_spacy_tokens: After all , the construction of one motor vehicle may be different from the other without affecting its performance .


fn_spacy_tokens_for_baseline: At any time of the year , if you meander into the hilltowns , your senses will be rewarded .

source_bert_toks: at any time of the year , if you mean ##der into the hill ##town ##s , your senses will be rewarded .

reference_raw: At any time of the year, if you mean to the mountain towns, your senses will be rewarded.

reference_spacy_tokens: At any time of the year , if you mean to the mountain towns , your senses will be rewarded .


fn_spacy_tokens_for_baseline: One of his forebears could have won the support of Wilfrid .

source_bert_toks: one of his fore ##be ##ars could have won the support of wil ##frid .

reference_raw: One of his ancestors might have won Wilfrid's support.

reference_spacy_tokens: One of his ancestors might have won Wilfrid 's support .


fn_spacy_tokens_for_baseline: Hasten , hasten , Dishayloo , before the globe itself shrinks to nothing !

source_bert_toks: haste ##n , haste ##n , dish ##ay ##lo ##o , before the globe itself shrink ##s to nothing !

reference_raw: Hurry, hurry, Dishayloo, before the world itself is reduced to nothing!

reference_spacy_tokens: Hurry , hurry , Dishayloo , before the world itself is reduced to nothing !


fn_spacy_tokens_for_baseline: The clouds had thickened and the moon had gone when I left her house and made my way cautiously down the slippery brick path .

source_bert_toks: the clouds had thick ##ened and the moon had gone when i left her house and made my way cautiously down the slippery brick path .

reference_raw: The clouds grew thicker, and when I left her house, the moon was gone, and I walked carefully down the slippery brick road.

reference_spacy_tokens: The clouds grew thicker , and when I left her house , the moon was gone , and I walked carefully down the slippery brick road .


fn_spacy_tokens_for_baseline: She was sporting a pair of gold hoop earrings , and her face was skilfully made up .

source_bert_toks: she was sporting a pair of gold hoop earrings , and her face was ski ##lf ##ull ##y made up .

reference_raw: She wore a pair of golden hoop earrings, and her face was crafty.

reference_spacy_tokens: She wore a pair of golden hoop earrings , and her face was crafty .


fn_spacy_tokens_for_baseline: On a subject of particular interest to

source_bert_toks: on a subject of particular interest to

reference_raw: On a subject of special interest to

reference_spacy_tokens: On a subject of special interest to


fn_spacy_tokens_for_baseline: The bitch , Rintelna the Chatelaine , was to whelp the first litter born in Australia , having been mated prior to leaving the UK .

source_bert_toks: the bitch , ri ##nte ##ln ##a the chat ##ela ##ine , was to w ##hel ##p the first litter born in australia , having been mated prior to leaving the uk .

reference_raw: That bitch, Rintelna Chatelaine, was supposed to wheeze the first litter born in Australia, who was mated before leaving the United Kingdom.

reference_spacy_tokens: That bitch , Rintelna Chatelaine , was supposed to wheeze the first litter born in Australia , who was mated before leaving the United Kingdom .


fn_spacy_tokens_for_baseline: Somewhere a victrola was squeaking .

source_bert_toks: somewhere a vic ##tro ##la was squeak ##ing .

reference_raw: There was a squeaky victrola somewhere.

reference_spacy_tokens: There was a squeaky victrola somewhere .


fn_spacy_tokens_for_baseline: Alan Ross noticed that if he encountered Minton , in street or bar , he seemed unwilling to talk unless surrounded by a bevy of young men who made serious conversation impossible .

source_bert_toks: alan ross noticed that if he encountered mint ##on , in street or bar , he seemed unwilling to talk unless surrounded by a be ##vy of young men who made serious conversation impossible .

reference_raw: Alan Ross noticed that if he met Minton on the street or in a bar, he didn't seem to want to talk unless he was surrounded by a bunch of young men who made a serious conversation impossible.

reference_spacy_tokens: Alan Ross noticed that if he met Minton on the street or in a bar , he did n't seem to want to talk unless he was surrounded by a bunch of young men who made a serious conversation impossible .


fn_spacy_tokens_for_baseline: ' I hate to bring the real world into this , but is your room - mate going to pop in at any second ? '

source_bert_toks: ' i hate to bring the real world into this , but is your room - mate going to pop in at any second ? '

reference_raw: "I don't want to bring the real world into this, but will your roommate be here any minute?"

reference_spacy_tokens: " I do n't want to bring the real world into this , but will your roommate be here any minute ? "


fn_spacy_tokens_for_baseline: Nor could he abandon his post for the moment to ensure that Boris returned below .

source_bert_toks: nor could he abandon his post for the moment to ensure that boris returned below .

reference_raw: He couldn't leave his post for a while, either, to make sure Boris came back down.

reference_spacy_tokens: He could n't leave his post for a while , either , to make sure Boris came back down .


fn_spacy_tokens_for_baseline: He was in this predicament by February 1615 when his letter to Castelli ( which in expanded form became the letter to the Grand Duchess Christina ) was examined by the Inquisition in Rome .

source_bert_toks: he was in this pre ##dic ##ament by february 161 ##5 when his letter to caste ##lli ( which in expanded form became the letter to the grand duchess christina ) was examined by the inquisition in rome .

reference_raw: He was in this situation in February 1615 when his letter to Castelli (which, in extended form, became a letter to the Grand Duchess Christina) was examined by the Inquisition in Rome.

reference_spacy_tokens: He was in this situation in February 1615 when his letter to Castelli ( which , in extended form , became a letter to the Grand Duchess Christina ) was examined by the Inquisition in Rome .


fn_spacy_tokens_for_baseline: It 's also good for sunburn and if you burn yourself .

source_bert_toks: it ' s also good for sun ##burn and if you burn yourself .

reference_raw: It's good for sunburn, too, and when you're on fire.

reference_spacy_tokens: It 's good for sunburn , too , and when you 're on fire .


fn_spacy_tokens_for_baseline: The specifications will be submitted to X / Open Co Ltd for inclusion in the Portability Guide and the standards body will also take over responsibility for the publishing , trademarking and branding of Motif specifications .

source_bert_toks: the specifications will be submitted to x / open co ltd for inclusion in the port ##ability guide and the standards body will also take over responsibility for the publishing , trademark ##ing and branding of motif specifications .

reference_raw: The specifications will be presented to X/Open Co Ltd for inclusion in the Portability Guide and the standardisation body will also assume responsibility for publishing, branding and branding the Motif specifications.

reference_spacy_tokens: The specifications will be presented to X / Open Co Ltd for inclusion in the Portability Guide and the standardisation body will also assume responsibility for publishing , branding and branding the Motif specifications .


fn_spacy_tokens_for_baseline: Macau , now the Chinese Special Economic Zone of Zhuhai , is becoming something like a boomtown as an exporter of toys , furniture , and electronics .

source_bert_toks: macau , now the chinese special economic zone of zhu ##hai , is becoming something like a boom ##town as an export ##er of toys , furniture , and electronics .

reference_raw: Macau, now Zhuhai's special economic zone in China, is becoming something like a boomtown as a toy, furniture, and electronics manufacturer.

reference_spacy_tokens: Macau , now Zhuhai 's special economic zone in China , is becoming something like a boomtown as a toy , furniture , and electronics manufacturer .


fn_spacy_tokens_for_baseline: Wash and shred the leaves ( saving one or two for garnishing ) .

source_bert_toks: wash and sh ##red the leaves ( saving one or two for ga ##rn ##ishing ) .

reference_raw: Wash and tear the leaves (saving one or two to paint).

reference_spacy_tokens: Wash and tear the leaves ( saving one or two to paint ) .


fn_spacy_tokens_for_baseline: He brushed his brown wavy hair , put on a top - hat , and went down the stairs to the street .

source_bert_toks: he brushed his brown wavy hair , put on a top - hat , and went down the stairs to the street .

reference_raw: He brushed his brown woolly hair, put on his hat, and walked down the stairs to the street.

reference_spacy_tokens: He brushed his brown woolly hair , put on his hat , and walked down the stairs to the street .


fn_spacy_tokens_for_baseline: American military commanders regard the group as a major roadblock to concluding the nine - year war in Afghanistan .

source_bert_toks: american military commanders regard the group as a major road ##block to concluding the nine - year war in afghanistan .

reference_raw: The U.S. military commanders consider this group to be the main barrier to the end of the nine-year war in Afghanistan.

reference_spacy_tokens: The U.S. military commanders consider this group to be the main barrier to the end of the nine - year war in Afghanistan .


fn_spacy_tokens_for_baseline: He noticed that no ' sir ' was appended to this question , there was no attempt to mimic respect .

source_bert_toks: he noticed that no ' sir ' was app ##ended to this question , there was no attempt to mimic respect .

reference_raw: He noticed that there was no "sir" attached to the question, no attempt to mimic respect.

reference_spacy_tokens: He noticed that there was no " sir " attached to the question , no attempt to mimic respect .


fn_spacy_tokens_for_baseline: The Prophet was insane and a remorseless killer .

source_bert_toks: the prophet was insane and a remorse ##less killer .

reference_raw: The Prophet was a madman and a ruthless murderer.

reference_spacy_tokens: The Prophet was a madman and a ruthless murderer .


fn_spacy_tokens_for_baseline: With the Egg deal , Foster became one of the few women in Hollywood with the power to green - light her own projects .

source_bert_toks: with the egg deal , foster became one of the few women in hollywood with the power to green - light her own projects .

reference_raw: With the Egg deal, Foster became one of the few women in Hollywood who had the power to light up their own projects.

reference_spacy_tokens: With the Egg deal , Foster became one of the few women in Hollywood who had the power to light up their own projects .


fn_spacy_tokens_for_baseline: Burn baby , burn : Toni Halliday contemplates the immediate immolation of whoever thought of this ' amusing ' female - torso style cigarette lighter

source_bert_toks: burn baby , burn : toni hall ##ida ##y con ##tem ##plate ##s the immediate im ##mo ##lation of whoever thought of this ' amusing ' female - torso style cigarette lighter

reference_raw: Burn baby, burn: Toni Halliday is thinking about immolating anyone who thinks of this "amusing" woman-style cigarette lighter.

reference_spacy_tokens: Burn baby , burn : Toni Halliday is thinking about immolating anyone who thinks of this " amusing " woman - style cigarette lighter .


fn_spacy_tokens_for_baseline: Satellites and cellular telephones allow us to converse instantaneously from a London street to the Australian outback .

source_bert_toks: satellites and cellular telephone ##s allow us to converse instant ##aneous ##ly from a london street to the australian out ##back .

reference_raw: Satellites and mobile phones allow us to converse immediately from London Street to the Australian outpost.

reference_spacy_tokens: Satellites and mobile phones allow us to converse immediately from London Street to the Australian outpost .


fn_spacy_tokens_for_baseline: What is the point of only taking what you need and looking after your resources for the future , if they are simply going to be swiped by somebody else ?

source_bert_toks: what is the point of only taking what you need and looking after your resources for the future , if they are simply going to be swiped by somebody else ?

reference_raw: What's the point of just taking what you need and taking care of your resources in the future when someone else is just going to replace them?

reference_spacy_tokens: What 's the point of just taking what you need and taking care of your resources in the future when someone else is just going to replace them ?


fn_spacy_tokens_for_baseline: Putting a fist , or other object , into the rectum may result in injury to the lining of this area and therefore can increase the risk of HIV transmission .

source_bert_toks: putting a fist , or other object , into the rec ##tum may result in injury to the lining of this area and therefore can increase the risk of hiv transmission .

reference_raw: The insertion of a fist or other object into the rectum may cause damage to the lining of the area and may therefore increase the likelihood of transmission of HIV.

reference_spacy_tokens: The insertion of a fist or other object into the rectum may cause damage to the lining of the area and may therefore increase the likelihood of transmission of HIV .


fn_spacy_tokens_for_baseline: It got to be a bloody bind .

source_bert_toks: it got to be a bloody bind .

reference_raw: It must be a bloody tie.

reference_spacy_tokens: It must be a bloody tie .


fn_spacy_tokens_for_baseline: It was not until 1829 that Rafael Rivera , a Mexican scout , found a spring -fed valley and dubbed it Las Vegas -- a Spanish name that leaves many modern visitors wondering exactly where " the meadows " really lay .

source_bert_toks: it was not until 1829 that rafael rivera , a mexican scout , found a spring - fed valley and dubbed it las vegas - - a spanish name that leaves many modern visitors wondering exactly where " the meadows " really lay .

reference_raw: Only in 1829 did Rafael Rivera, a Mexican explorer, find a spring-fed valley and call it Las Vegas-a Spanish name that leaves many modern guests wondering exactly where "the meadows" really lie.

reference_spacy_tokens: Only in 1829 did Rafael Rivera , a Mexican explorer , find a spring - fed valley and call it Las Vegas - a Spanish name that leaves many modern guests wondering exactly where " the meadows " really lie .


fn_spacy_tokens_for_baseline: After a shadowy introduction , the opening allegro is sharp and vehement , the slow movement shot through with unease , and the Scherzo faintly menacing in its nocturnal rustlings .

source_bert_toks: after a shadowy introduction , the opening allegro is sharp and ve ##hem ##ent , the slow movement shot through with unease , and the sc ##her ##zo faintly menacing in its nocturnal rustling ##s .

reference_raw: After a dark introduction, the opening allegro is sharp and vehement, the slow motion shot through with uneasiness, and the Scherzo is faintly threatening in the night's rustle.

reference_spacy_tokens: After a dark introduction , the opening allegro is sharp and vehement , the slow motion shot through with uneasiness , and the Scherzo is faintly threatening in the night 's rustle .


fn_spacy_tokens_for_baseline: Barney was a super person and brilliant at his scientist job , but otherwise a trifle absent - minded and generally helpless .

source_bert_toks: barney was a super person and brilliant at his scientist job , but otherwise a tri ##fle absent - minded and generally helpless .

reference_raw: Barney was a great man and brilliant at his scientific work, but otherwise a little absent-minded and generally powerless.

reference_spacy_tokens: Barney was a great man and brilliant at his scientific work , but otherwise a little absent - minded and generally powerless .


fn_spacy_tokens_for_baseline: In exchange , the United States agreed to lead an international consortium to construct two light water power reactors , and provide 500,000 tons of heavy fuel oil per year until the first reactor came online with a target date of 2003 .

source_bert_toks: in exchange , the united states agreed to lead an international consortium to construct two light water power reactors , and provide 500 , 000 tons of heavy fuel oil per year until the first reactor came online with a target date of 2003 .

reference_raw: In return, the United States decided to lead an international consortium for the construction of two light-water reactors and the provision of 500,000 tonnes of heavy fuel oil per year until the first reactor became operational on the target date of 2003.

reference_spacy_tokens: In return , the United States decided to lead an international consortium for the construction of two light - water reactors and the provision of 500,000 tonnes of heavy fuel oil per year until the first reactor became operational on the target date of 2003 .


fn_spacy_tokens_for_baseline: Gloria stared , her mouth agape , then turned to Ruth in bewilderment .

source_bert_toks: gloria stared , her mouth ag ##ape , then turned to ruth in be ##wil ##der ##ment .

reference_raw: Gloria stared, her mouth open, then turned to Ruth in confusion.

reference_spacy_tokens: Gloria stared , her mouth open , then turned to Ruth in confusion .


fn_spacy_tokens_for_baseline: I thought it right to apprise Cyril of what had happened at Muirfield , but having corresponded with the Seniors secretary , he assured me I was on course for election .

source_bert_toks: i thought it right to app ##rise cyril of what had happened at muir ##field , but having corresponded with the seniors secretary , he assured me i was on course for election .

reference_raw: I thought it was a good idea to tell Cyril what had happened in Muirfield, but after contacting the senior secretary, he assured me that I was on my way to the election.

reference_spacy_tokens: I thought it was a good idea to tell Cyril what had happened in Muirfield , but after contacting the senior secretary , he assured me that I was on my way to the election .


fn_spacy_tokens_for_baseline: ' Why should they have to look at naked women all the time ?

source_bert_toks: ' why should they have to look at naked women all the time ?

reference_raw: Why would they always have to look at nude women?

reference_spacy_tokens: Why would they always have to look at nude women ?


fn_spacy_tokens_for_baseline: But the really challenging upshot of the report was not this predictable hypocrisy .

source_bert_toks: but the really challenging ups ##hot of the report was not this predictable h ##yp ##oc ##ris ##y .

reference_raw: But it wasn't this predictable hypocrisy that made the report very difficult.

reference_spacy_tokens: But it was n't this predictable hypocrisy that made the report very difficult .


fn_spacy_tokens_for_baseline: The Bible tells us that the cruelty and impiety of the rulers of both kingdoms aroused the fury of the great Prophets .

source_bert_toks: the bible tells us that the cruelty and imp ##ie ##ty of the rulers of both kingdoms aroused the fury of the great prophets .

reference_raw: The Bible tells us that the cruelty and impudence of the rulers of both realms has aroused the wrath of the great prophets.

reference_spacy_tokens: The Bible tells us that the cruelty and impudence of the rulers of both realms has aroused the wrath of the great prophets .


fn_spacy_tokens_for_baseline: Buffalo , New York A three alarm fire at a house owned by John and Evelyn Bencinich , two of the initiators of a lawsuit filed against the Elmwood Village Hotel proposal in Buffalo , required firefighters to rescue eight cats and two dogs in Buffalo , New York today .

source_bert_toks: buffalo , new york a three alarm fire at a house owned by john and evelyn ben ##cini ##ch , two of the in ##itia ##tors of a lawsuit filed against the elm ##wood village hotel proposal in buffalo , required firefighters to rescue eight cats and two dogs in buffalo , new york today .

reference_raw: Buffalo, New York Three alarm fires in a house owned by John and Evelyn Bencinich, two instigators of a lawsuit against the proposal of the Elmwood Village Hotel in Buffalo, required firemen to rescue eight cats and two hounds today in Buffalo, New York.

reference_spacy_tokens: Buffalo , New York Three alarm fires in a house owned by John and Evelyn Bencinich , two instigators of a lawsuit against the proposal of the Elmwood Village Hotel in Buffalo , required firemen to rescue eight cats and two hounds today in Buffalo , New York .


fn_spacy_tokens_for_baseline: This means " tracking , " whose main purpose is less to permit the gifted youngsters to flourish ( though that is clearly desirable ) than to ensure that the less gifted get the necessary grounding for further study or for entering the modern world of work .

source_bert_toks: this means " tracking , " whose main purpose is less to permit the gifted young ##sters to flourish ( though that is clearly desirable ) than to ensure that the less gifted get the necessary ground ##ing for further study or for entering the modern world of work .

reference_raw: This means "tracking", the main purpose of which is less to allow gifted young people to flourish (although it is obviously desirable) than to ensure that the less gifted have the necessary grounds for further study or entry into the modern world of work.

reference_spacy_tokens: This means " tracking " , the main purpose of which is less to allow gifted young people to flourish ( although it is obviously desirable ) than to ensure that the less gifted have the necessary grounds for further study or entry into the modern world of work .


fn_spacy_tokens_for_baseline: Flake the flesh , remove the skin and evenly distribute the fish across the base of the dish .

source_bert_toks: fl ##ake the flesh , remove the skin and evenly distribute the fish across the base of the dish .

reference_raw: Flame the meat, remove the skin, and evenly distribute the fish at the bottom of the bowl.

reference_spacy_tokens: Flame the meat , remove the skin , and evenly distribute the fish at the bottom of the bowl .


fn_spacy_tokens_for_baseline: He heard single gunshots from the house , followed by the chatter of an automatic .

source_bert_toks: he heard single gunshot ##s from the house , followed by the chatter of an automatic .

reference_raw: He heard a single shot from the house, followed by the sound of an automatic.

reference_spacy_tokens: He heard a single shot from the house , followed by the sound of an automatic .


fn_spacy_tokens_for_baseline: A DRINK - DRIVER was jailed for just four months yesterday for mowing down a nine - year - old girl .

source_bert_toks: a drink - driver was jailed for just four months yesterday for mo ##wing down a nine - year - old girl .

reference_raw: Drink-Driver was arrested for only four months yesterday for cutting down a nine-year-old girl.

reference_spacy_tokens: Drink - Driver was arrested for only four months yesterday for cutting down a nine - year - old girl .


fn_spacy_tokens_for_baseline: Methylated bile acids were produced by reaction at room temperature for one hour and subsequently evaporated to dryness under nitrogen .

source_bert_toks: methyl ##ated bile acids were produced by reaction at room temperature for one hour and subsequently eva ##por ##ated to dry ##ness under nitrogen .

reference_raw: Methylated bile acids were produced by a reaction at room temperature for one hour and then vaporized to dryness under nitrogen.

reference_spacy_tokens: Methylated bile acids were produced by a reaction at room temperature for one hour and then vaporized to dryness under nitrogen .


fn_spacy_tokens_for_baseline: ' If one of my patients wants to give up a potentially curative treatment in favour of an alternative therapy , then I will try to dissuade them .

source_bert_toks: ' if one of my patients wants to give up a potentially cu ##rative treatment in favour of an alternative therapy , then i will try to di ##ss ##ua ##de them .

reference_raw: 'If one of my patients wants to give up a potential treatment for alternative therapy, I'll try to dissuade them.

reference_spacy_tokens: ' If one of my patients wants to give up a potential treatment for alternative therapy , I 'll try to dissuade them .


fn_spacy_tokens_for_baseline: Interference by iron or copper is prevented by the addition of cyanide .

source_bert_toks: interference by iron or copper is prevented by the addition of cy ##ani ##de .

reference_raw: The addition of cyanide avoids interference with iron or copper.

reference_spacy_tokens: The addition of cyanide avoids interference with iron or copper .


fn_spacy_tokens_for_baseline: Join the strips with a plain seam and fold in half lengthways with right sides facing .

source_bert_toks: join the strips with a plain seam and fold in half length ##ways with right sides facing .

reference_raw: Connect the strips with a simple seam and fold in half the lengths with the right sides facing.

reference_spacy_tokens: Connect the strips with a simple seam and fold in half the lengths with the right sides facing .


fn_spacy_tokens_for_baseline: ' In prison , you learn racism , ' said Bobby Lavender , a triple X OG , ' an Original Gang leader , at a barbecue in his brother - in - law 's back yard in south Los Angeles .

source_bert_toks: ' in prison , you learn racism , ' said bobby lavender , a triple x og , ' an original gang leader , at a barbecue in his brother - in - law ' s back yard in south los angeles .

reference_raw: 'You learn racism in prison,' said Bobby Lavender, three XOGs, the original gang leader, in the backyard of his brother-in-law in South Los Angeles.

reference_spacy_tokens: ' You learn racism in prison , ' said Bobby Lavender , three XOGs , the original gang leader , in the backyard of his brother - in - law in South Los Angeles .


fn_spacy_tokens_for_baseline: As the little rodents swarmed all over him , he swung his arm back , pointing dramatically towards the back of the bay .

source_bert_toks: as the little rodents swarm ##ed all over him , he swung his arm back , pointing dramatically towards the back of the bay .

reference_raw: He swung his hand back and pointed dramatically toward the back of the bay as the little rodents crowded around him.

reference_spacy_tokens: He swung his hand back and pointed dramatically toward the back of the bay as the little rodents crowded around him .


fn_spacy_tokens_for_baseline: They all have a view to the greater expanse of Loch Torridon from their windows , although partly obstructed by the wooded Shieldaig Island .

source_bert_toks: they all have a view to the greater expanse of loch tor ##rid ##on from their windows , although partly ob ##st ##ru ##cted by the wooded shield ##ai ##g island .

reference_raw: All of them have a view of the larger expanse of Loch Torridon from their windows, even though it is partially blocked by the forested Shieldaig Island.

reference_spacy_tokens: All of them have a view of the larger expanse of Loch Torridon from their windows , even though it is partially blocked by the forested Shieldaig Island .


fn_spacy_tokens_for_baseline: For the remainder of the meal , they chatted politely about business and exchanged city gossip .

source_bert_toks: for the remainder of the meal , they chat ##ted politely about business and exchanged city gossip .

reference_raw: For the rest of the meal, they chatted politely about the business and exchanged rumors about the town.

reference_spacy_tokens: For the rest of the meal , they chatted politely about the business and exchanged rumors about the town .


fn_spacy_tokens_for_baseline: Finally , the fourth set of rules , contained in sections 181 and 182 of the rules of practice , 10 applies to Postal Service requests for new services that it believes can not recover all their associated costs in the first full fiscal year of their operation .

source_bert_toks: finally , the fourth set of rules , contained in sections 181 and 182 of the rules of practice , 10 applies to postal service requests for new services that it believes can not recover all their associated costs in the first full fiscal year of their operation .

reference_raw: Finally, the fourth set of rules, contained in Sections 181 and 182 of the Rules of Procedure, 10 applies to postal service requests for new services which, in their view, cannot recover all the associated costs during the first complete financial year of their operation.

reference_spacy_tokens: Finally , the fourth set of rules , contained in Sections 181 and 182 of the Rules of Procedure , 10 applies to postal service requests for new services which , in their view , can not recover all the associated costs during the first complete financial year of their operation .


fn_spacy_tokens_for_baseline: He gashed his head last Saturday , but happily is smiling again .

source_bert_toks: he gas ##hed his head last saturday , but happily is smiling again .

reference_raw: He shook his head last Saturday, but he's smiling happily again.

reference_spacy_tokens: He shook his head last Saturday , but he 's smiling happily again .


fn_spacy_tokens_for_baseline: ' Is it an arranged marriage between the two of you ? ' she hazarded .

source_bert_toks: ' is it an arranged marriage between the two of you ? ' she hazard ##ed .

reference_raw: "Is this an arranged wedding between you two?" she asked.

reference_spacy_tokens: " Is this an arranged wedding between you two ? " she asked .


fn_spacy_tokens_for_baseline: A High Court judge refused to grant an injunction which would have forced publishers Methuen to remove the characters , drawn by former Daily Mirror cartoonist Griffin .

source_bert_toks: a high court judge refused to grant an injunction which would have forced publishers met ##hue ##n to remove the characters , drawn by former daily mirror cartoonist griffin .

reference_raw: The High Court judge declined to issue an order that would force the publishers of Methuen to remove the characters drawn by the former cartoonist Griffin of the Daily Mirror.

reference_spacy_tokens: The High Court judge declined to issue an order that would force the publishers of Methuen to remove the characters drawn by the former cartoonist Griffin of the Daily Mirror .


fn_spacy_tokens_for_baseline: Mr Lamont has stuck to his public spending target of £ 244.5 billion but he should have increased that .

source_bert_toks: mr lam ##ont has stuck to his public spending target of £2 ##44 . 5 billion but he should have increased that .

reference_raw: Mr. Lamont stuck to his public spending goal of 244.5 billion pounds, but he was supposed to increase it.

reference_spacy_tokens: Mr. Lamont stuck to his public spending goal of 244.5 billion pounds , but he was supposed to increase it .


fn_spacy_tokens_for_baseline: The ' feel good ' factor may only be jolted when you come to a ' Y ' junction and curse that thick rear side panel , obstructing the over - the - shoulder rear three - quarter view .

source_bert_toks: the ' feel good ' factor may only be jolted when you come to a ' y ' junction and curse that thick rear side panel , ob ##st ##ru ##cting the over - the - shoulder rear three - quarter view .

reference_raw: The 'feel good' factor can only be shaken when you reach the 'Y' intersection and curse the thick back panel that blocks the rear three-quarters view over the shoulder.

reference_spacy_tokens: The ' feel good ' factor can only be shaken when you reach the ' Y ' intersection and curse the thick back panel that blocks the rear three - quarters view over the shoulder .


fn_spacy_tokens_for_baseline: 1 . visual analysis of raw EEG traces ,

source_bert_toks: 1 . visual analysis of raw ee ##g traces ,

reference_raw: 1. visual analysis of raw EEG footprints,

reference_spacy_tokens: 1 . visual analysis of raw EEG footprints ,


fn_spacy_tokens_for_baseline: The typewriter , carbon - paper and the camera have made duplicates of important papers readily available .

source_bert_toks: the type ##writer , carbon - paper and the camera have made duplicate ##s of important papers readily available .

reference_raw: The typewriter, carbon paper and camera made copies of important documents readily available.

reference_spacy_tokens: The typewriter , carbon paper and camera made copies of important documents readily available .


fn_spacy_tokens_for_baseline: Or the barking of an excited dog , the purring of a cat , the bellow of an angry bull , the insistent buzzing of a hive of bees when disturbed .

source_bert_toks: or the barking of an excited dog , the pu ##rring of a cat , the bell ##ow of an angry bull , the insistent buzzing of a hive of bees when disturbed .

reference_raw: Or the barking of an excited dog, the purring of a cat, the roar of an angry bull, the insistent buzzing of a bee hive when it's disturbed.

reference_spacy_tokens: Or the barking of an excited dog , the purring of a cat , the roar of an angry bull , the insistent buzzing of a bee hive when it 's disturbed .


fn_spacy_tokens_for_baseline: Cunningham , 23 , remained jailed Tuesday on three counts of felonious assault and one count of aggravated assault .

source_bert_toks: cunningham , 23 , remained jailed tuesday on three counts of fe ##lon ##ious assault and one count of aggravated assault .

reference_raw: Cunningham, 23, remained in prison on Tuesday for three counts of felony assault and one count of assault.

reference_spacy_tokens: Cunningham , 23 , remained in prison on Tuesday for three counts of felony assault and one count of assault .


fn_spacy_tokens_for_baseline: It can be hoped that Spanish Prime Minister Felipe Gonzalez will draw the right conclusion from his narrow election victory Sunday .

source_bert_toks: it can be hoped that spanish prime minister felipe gonzalez will draw the right conclusion from his narrow election victory sunday .

reference_raw: It is to be hoped that Spanish Premier Felipe Gonzalez will draw the right conclusion from his narrow election victory on Sunday.

reference_spacy_tokens: It is to be hoped that Spanish Premier Felipe Gonzalez will draw the right conclusion from his narrow election victory on Sunday .


fn_spacy_tokens_for_baseline: Rufus had a bottle of red wine but he was drinking the wine out of one of Hilbert 's brandy glasses .

source_bert_toks: rufus had a bottle of red wine but he was drinking the wine out of one of hilbert ' s brandy glasses .

reference_raw: Rufus had a glass of red wine, but he drank it from one of Hilbert's brandy glasses.

reference_spacy_tokens: Rufus had a glass of red wine , but he drank it from one of Hilbert 's brandy glasses .


fn_spacy_tokens_for_baseline: The Britax Freeway ( £ 89.99 ) has a harness that adjusts to the correct fit at the touch of a button .

source_bert_toks: the brit ##ax freeway ( £ ##8 ##9 . 99 ) has a harness that adjust ##s to the correct fit at the touch of a button .

reference_raw: The British motorway (ß89.99) is equipped with a harness that adjusts to the correct fit at the touch of a button.

reference_spacy_tokens: The British motorway ( ß89.99 ) is equipped with a harness that adjusts to the correct fit at the touch of a button .


fn_spacy_tokens_for_baseline: Beneath the chandeliers of the Spanish Riding School , they display their virtuosity to the music of Mozart .

source_bert_toks: beneath the chan ##del ##iers of the spanish riding school , they display their vi ##rt ##uo ##sity to the music of mozart .

reference_raw: Under the chandeliers of the Spanish Riding School, they show their virtue to the music of Mozart.

reference_spacy_tokens: Under the chandeliers of the Spanish Riding School , they show their virtue to the music of Mozart .


fn_spacy_tokens_for_baseline: A freak wave overturned the flimsy vessels and they were left floating in the water in their lifejackets .

source_bert_toks: a freak wave overturned the fl ##im ##sy vessels and they were left floating in the water in their life ##jack ##ets .

reference_raw: A monstrous wave overturned the fragile craft, leaving them floating in the water in their life jackets.

reference_spacy_tokens: A monstrous wave overturned the fragile craft , leaving them floating in the water in their life jackets .


fn_spacy_tokens_for_baseline: The cumulative national rate of circumcision for boys by the age of 15 is almost 7 % .

source_bert_toks: the cumulative national rate of ci ##rc ##um ##cision for boys by the age of 15 is almost 7 % .

reference_raw: The cumulative national rate of circumcise for boys under 15 is close to 7%.

reference_spacy_tokens: The cumulative national rate of circumcise for boys under 15 is close to 7 % .


fn_spacy_tokens_for_baseline: He had been arraigned before the GMC twice before , both times for canvassing .

source_bert_toks: he had been ar ##rai ##gned before the gm ##c twice before , both times for canvas ##sing .

reference_raw: He had been accused twice before the GMC, twice for canvassing.

reference_spacy_tokens: He had been accused twice before the GMC , twice for canvassing .


fn_spacy_tokens_for_baseline: You 'll have to excuse me if I do n't sound too lucid at the moment , but I have stinking cold .

source_bert_toks: you ' ll have to excuse me if i don ' t sound too luc ##id at the moment , but i have stink ##ing cold .

reference_raw: You're gonna have to forgive me if I don't sound very clear right now, but I've got a smelly cold.

reference_spacy_tokens: You 're gon na have to forgive me if I do n't sound very clear right now , but I 've got a smelly cold .


fn_spacy_tokens_for_baseline: The organisers say it is not just a reaction to the recent carnage in Warrington .

source_bert_toks: the organise ##rs say it is not just a reaction to the recent carnage in warrington .

reference_raw: Organizers say it's not just a reaction to the recent massacre in Warrington.

reference_spacy_tokens: Organizers say it 's not just a reaction to the recent massacre in Warrington .


fn_spacy_tokens_for_baseline: Rourke leaned over her , straddling her like a vengeful demon .

source_bert_toks: rourke leaned over her , st ##rad ##dling her like a ve ##nge ##ful demon .

reference_raw: Rourke leaned over her, striding her like a vengeful demon.

reference_spacy_tokens: Rourke leaned over her , striding her like a vengeful demon .


fn_spacy_tokens_for_baseline: Oh hold it .

source_bert_toks: oh hold it .

reference_raw: Oh, hang on to that.

reference_spacy_tokens: Oh , hang on to that .


fn_spacy_tokens_for_baseline: The air of the house turned sour .

source_bert_toks: the air of the house turned sour .

reference_raw: The air in the house was sour.

reference_spacy_tokens: The air in the house was sour .


fn_spacy_tokens_for_baseline: The bleat of unseen sheep .

source_bert_toks: the b ##lea ##t of unseen sheep .

reference_raw: A blast of invisible sheep.

reference_spacy_tokens: A blast of invisible sheep .


fn_spacy_tokens_for_baseline: The growth that has characterized Las Vegas for nearly a century may be facing a roadblock .

source_bert_toks: the growth that has characterized las vegas for nearly a century may be facing a road ##block .

reference_raw: The development that has characterized Las Vegas for almost a century may face a roadblock.

reference_spacy_tokens: The development that has characterized Las Vegas for almost a century may face a roadblock .


fn_spacy_tokens_for_baseline: The same crusading disrespect for authority has characterized his life ever since .

source_bert_toks: the same cr ##usa ##ding di ##sr ##es ##pe ##ct for authority has characterized his life ever since .

reference_raw: Since then, his life has been characterized by the same crusading disregard for authority.

reference_spacy_tokens: Since then , his life has been characterized by the same crusading disregard for authority .


fn_spacy_tokens_for_baseline: You tell me how any of us could have chucked him over the balustrade even if the whole lot of us got together to do it .

source_bert_toks: you tell me how any of us could have chuck ##ed him over the bal ##ust ##rade even if the whole lot of us got together to do it .

reference_raw: Tell me how any of us would throw him over a balustrade, even if we all got together to do it.

reference_spacy_tokens: Tell me how any of us would throw him over a balustrade , even if we all got together to do it .


fn_spacy_tokens_for_baseline: It was you , after all , who was going on at breakfast about the perils of lapses in concentration . '

source_bert_toks: it was you , after all , who was going on at breakfast about the per ##ils of laps ##es in concentration . '

reference_raw: After all, it was you who went to breakfast about the dangers of losing focus.'

reference_spacy_tokens: After all , it was you who went to breakfast about the dangers of losing focus . '


fn_spacy_tokens_for_baseline: In an attempt to counter a threat from the Saracen Muslims , a new potent religious force from the East , the Byzantine army forcefully enlisted the men of the islands .

source_bert_toks: in an attempt to counter a threat from the sara ##cen muslims , a new potent religious force from the east , the byzantine army forcefully enlisted the men of the islands .

reference_raw: In an attempt to combat the threat of the Saracen Muslims, a new powerful religious force from the east, the Byzantine army forced the men of the islands.

reference_spacy_tokens: In an attempt to combat the threat of the Saracen Muslims , a new powerful religious force from the east , the Byzantine army forced the men of the islands .


fn_spacy_tokens_for_baseline: The umpires tried to restart the game after about 35 minutes but the Indian team again left the ground when Ravi Shastri complained the crowd was hurling stones .

source_bert_toks: the umpire ##s tried to restart the game after about 35 minutes but the indian team again left the ground when ravi sha ##st ##ri complained the crowd was hurling stones .

reference_raw: After about thirty-five minutes, the referees tried to start the game again, but the Indian team left the country when Ravi Shastri complained that the crowd was throwing rocks.

reference_spacy_tokens: After about thirty - five minutes , the referees tried to start the game again , but the Indian team left the country when Ravi Shastri complained that the crowd was throwing rocks .


fn_spacy_tokens_for_baseline: Pirate arrived with a screech of rusty Ford brakes without any acknowledgement of my huddled form sheltering by his fishboxes on the quay .

source_bert_toks: pirate arrived with a sc ##ree ##ch of rusty ford brakes without any acknowledge ##ment of my huddled form shelter ##ing by his fish ##box ##es on the quay .

reference_raw: Pirate came with a squeal of rusty Ford brakes, without acknowledging that my huddled figure was hiding behind his fishboxes on the quay.

reference_spacy_tokens: Pirate came with a squeal of rusty Ford brakes , without acknowledging that my huddled figure was hiding behind his fishboxes on the quay .


fn_spacy_tokens_for_baseline: Pickett , who was shot in the knee by the Secret Service after allegedly firing two shots outside the White House , used crutches to walk into the court .

source_bert_toks: picket ##t , who was shot in the knee by the secret service after allegedly firing two shots outside the white house , used cr ##ut ##ches to walk into the court .

reference_raw: Pickett, who was gunned down in the knee by the Secret Service after allegedly firing two rounds in front of the White House, used crutches to enter the courthouse.

reference_spacy_tokens: Pickett , who was gunned down in the knee by the Secret Service after allegedly firing two rounds in front of the White House , used crutches to enter the courthouse .


fn_spacy_tokens_for_baseline: The male rate croons a post - coital song consisting of bursts of sound between one and three seconds long that are only just above human hearing .

source_bert_toks: the male rate cr ##oons a post - co ##ital song consisting of bursts of sound between one and three seconds long that are only just above human hearing .

reference_raw: The male rate is a post-coital song consisting of a burst of sound from one to three seconds long, just above the human hearing.

reference_spacy_tokens: The male rate is a post - coital song consisting of a burst of sound from one to three seconds long , just above the human hearing .


fn_spacy_tokens_for_baseline: The patron of the living asked the architect Samuel Saunders Teulon to make a report on it .

source_bert_toks: the patron of the living asked the architect samuel saunders te ##ulo ##n to make a report on it .

reference_raw: The benefactor asked the architect, Samuel Saunders Teulon, to report.

reference_spacy_tokens: The benefactor asked the architect , Samuel Saunders Teulon , to report .


fn_spacy_tokens_for_baseline: Each legislator , after all , is only one out of 535 when it comes to national policy making .

source_bert_toks: each legislator , after all , is only one out of 53 ##5 when it comes to national policy making .

reference_raw: In the case of national policy-making, each legislature is only one out of 535.

reference_spacy_tokens: In the case of national policy - making , each legislature is only one out of 535 .


fn_spacy_tokens_for_baseline: To get things moving , Sutton skirted both the Equal Opportunities and the Pilger problem by hiring people on temporary consultancy contracts .

source_bert_toks: to get things moving , sutton skirt ##ed both the equal opportunities and the pi ##lge ##r problem by hiring people on temporary consultancy contracts .

reference_raw: In order to move things forward, Sutton avoided both the equal opportunities and the Pilger problem by hiring people on temporary counseling contracts.

reference_spacy_tokens: In order to move things forward , Sutton avoided both the equal opportunities and the Pilger problem by hiring people on temporary counseling contracts .


fn_spacy_tokens_for_baseline: All lined the route and waved their flags

source_bert_toks: all lined the route and waved their flags

reference_raw: They all lined up on the road, brandishing their flags.

reference_spacy_tokens: They all lined up on the road , brandishing their flags .


fn_spacy_tokens_for_baseline: The eyes of a killer . and the eyes , masked by heavy Health Service spectacles , of a spinster in her 81st year .

source_bert_toks: the eyes of a killer . and the eyes , masked by heavy health service spectacle ##s , of a spins ##ter in her 81 ##st year .

reference_raw: The eyes of a murderer . . . and the eyes of a spinster in his 81st year, disguised by heavy medical glasses.

reference_spacy_tokens: The eyes of a murderer . . . and the eyes of a spinster in his 81st year , disguised by heavy medical glasses .


fn_spacy_tokens_for_baseline: Special considerations : the appellant was originally put on probation with a requirement that he should reside at a probation hostel which specialised in providing treatment for young men guilty of indecent assault .

source_bert_toks: special considerations : the app ##ellant was originally put on probation with a requirement that he should reside at a probation hostel which specialised in providing treatment for young men guilty of ind ##ece ##nt assault .

reference_raw: Specific considerations: the applicant was initially placed on probation with the requirement to reside in a probationary hostel specialising in the provision of treatment for young men guilty of indignant assault.

reference_spacy_tokens: Specific considerations : the applicant was initially placed on probation with the requirement to reside in a probationary hostel specialising in the provision of treatment for young men guilty of indignant assault .


fn_spacy_tokens_for_baseline: 3- Must differenciate between who 's in the village , where relations are stronger , than it is in the city , where there 's different people with different ideas .

source_bert_toks: 3 - must differ ##encia ##te between who ' s in the village , where relations are stronger , than it is in the city , where there ' s different people with different ideas .

reference_raw: 3-It has to be a difference between who's in the country, where relationships are stronger than in the city, where there are different people with different ideas.

reference_spacy_tokens: 3-It has to be a difference between who 's in the country , where relationships are stronger than in the city , where there are different people with different ideas .


fn_spacy_tokens_for_baseline: Slowly , she mounted the stairs and went into her room and , sinking down on the bed , she began to weep .

source_bert_toks: slowly , she mounted the stairs and went into her room and , sinking down on the bed , she began to weep .

reference_raw: She climbed the stairs slowly, went to her room, and, sinking into the bed, began to cry.

reference_spacy_tokens: She climbed the stairs slowly , went to her room , and , sinking into the bed , began to cry .


fn_spacy_tokens_for_baseline: Now I just read news about death . '

source_bert_toks: now i just read news about death . '

reference_raw: And now I'm just rereading the news of death.'

reference_spacy_tokens: And now I 'm just rereading the news of death . '


fn_spacy_tokens_for_baseline: It is also the kind of libel politicians find useful , since it helps them strike a friendly posture on behalf of an important constituency .

source_bert_toks: it is also the kind of libel politicians find useful , since it helps them strike a friendly posture on behalf of an important constituency .

reference_raw: This is also the kind of libel politicians find helpful, because it helps them find a friendly position in the name of an important constituency.

reference_spacy_tokens: This is also the kind of libel politicians find helpful , because it helps them find a friendly position in the name of an important constituency .


fn_spacy_tokens_for_baseline: The United States believes that these facilities might contribute to Iran 's development of a complete nuclear fuel cycle , which would enable Iran to build nuclear weapons without importing nuclear material .

source_bert_toks: the united states believes that these facilities might contribute to iran ' s development of a complete nuclear fuel cycle , which would enable iran to build nuclear weapons without import ##ing nuclear material .

reference_raw: The United States believes that these facilities could contribute to the development of a full nuclear fuel cycle for Iran to build nuclear weapons without importing nuclear material.

reference_spacy_tokens: The United States believes that these facilities could contribute to the development of a full nuclear fuel cycle for Iran to build nuclear weapons without importing nuclear material .


fn_spacy_tokens_for_baseline: Briefly her hands left him , darting behind her neck to undo a clasp .

source_bert_toks: briefly her hands left him , darting behind her neck to undo a clasp .

reference_raw: Her hands left him briefly, darting behind her neck to unfasten the grip.

reference_spacy_tokens: Her hands left him briefly , darting behind her neck to unfasten the grip .


fn_spacy_tokens_for_baseline: The policy review concluded that the United States should seek " improved implementation of the Agreed Framework , verifiable constraints on North Korea 's missile program , a ban on missile exports , and a less threatening North Korean conventional military posture . "

source_bert_toks: the policy review concluded that the united states should seek " improved implementation of the agreed framework , ve ##ri ##fia ##ble constraints on north korea ' s missile program , a ban on missile exports , and a less threatening north korean conventional military posture . "

reference_raw: The political review concluded that the US should strive to "improve the agreed framework, verifiable restrictions on North Korea's missile program, ban on missile exports, and less threatening North Korea's conventional military position."

reference_spacy_tokens: The political review concluded that the US should strive to " improve the agreed framework , verifiable restrictions on North Korea 's missile program , ban on missile exports , and less threatening North Korea 's conventional military position . "


fn_spacy_tokens_for_baseline: The Lady of Light has the power to transform .

source_bert_toks: the lady of light has the power to transform .

reference_raw: The Lady of Light has the power to change.

reference_spacy_tokens: The Lady of Light has the power to change .