fn_spacy_tokens_for_baseline: An additional piece of evidence from the Senate : Holding other factors constant , such as incumbency advantages and regional factors , the difference between popular votes for Republican presidential and senatorial candidates in states conducting a Senate election turns out to be a positive function of how onerous the federal government 's tax burden is per state ( a progressive tax rate hits higher - income states harder ) .

source_bert_toks: an additional piece of evidence from the senate : holding other factors constant , such as inc ##umb ##ency advantages and regional factors , the difference between popular votes for republican presidential and senator ##ial candidates in states conducting a senate election turns out to be a positive function of how one ##rous the federal government ' s tax burden is per state ( a progressive tax rate hits higher - income states harder ) .

reference_raw: Another proof from the Senate: keeping other factors constant, such as incumbency benefits and regional factors, the difference between the popular votes of Republican presidential and senatorial candidates in the states holding the Senate elections proves to be a positive function of the burden of the federal government's tax burden on the state (the progressive tax rate hits higher income countries harder).

reference_spacy_tokens: Another proof from the Senate : keeping other factors constant , such as incumbency benefits and regional factors , the difference between the popular votes of Republican presidential and senatorial candidates in the states holding the Senate elections proves to be a positive function of the burden of the federal government 's tax burden on the state ( the progressive tax rate hits higher income countries harder ) .


fn_spacy_tokens_for_baseline: Behind this graceful form Martha could see her grandmother in a state of strange tension , arms folded and brows contracted in the effort of masking her feelings .

source_bert_toks: behind this graceful form martha could see her grandmother in a state of strange tension , arms folded and brows contracted in the effort of mask ##ing her feelings .

reference_raw: Behind this graceful figure, Martha could see her grandma in a strange state of tension, her arms folded and her eyebrows curled in an effort to mask her feelings.

reference_spacy_tokens: Behind this graceful figure , Martha could see her grandma in a strange state of tension , her arms folded and her eyebrows curled in an effort to mask her feelings .


fn_spacy_tokens_for_baseline: My goal in this paper is to examine this literature critically , and then use it to ascertain what the appropriate antitrust treatment of research joint ventures should be .

source_bert_toks: my goal in this paper is to examine this literature critically , and then use it to as ##cer ##tain what the appropriate anti ##trust treatment of research joint ventures should be .

reference_raw: My goal in this document is to critically review this literature and then use it to determine how appropriate antitrust treatment of research joint ventures should be.

reference_spacy_tokens: My goal in this document is to critically review this literature and then use it to determine how appropriate antitrust treatment of research joint ventures should be .


fn_spacy_tokens_for_baseline: When Sussex gentlemen and townsmen began to question the practices of the church , they found new allies in the Flemings and Frenchmen who fled for asylum in the 1540s from persecution by Catholic monarchs abroad .

source_bert_toks: when sussex gentlemen and towns ##men began to question the practices of the church , they found new allies in the fleming ##s and french ##men who fled for asylum in the 1540 ##s from persecution by catholic monarchs abroad .

reference_raw: When Sussex gentlemen and townsmen questioned the practices of the Church, they found new allies in the Flemings and French who escaped from persecution by Catholic monarchs abroad in the 1540s.

reference_spacy_tokens: When Sussex gentlemen and townsmen questioned the practices of the Church , they found new allies in the Flemings and French who escaped from persecution by Catholic monarchs abroad in the 1540s .


fn_spacy_tokens_for_baseline: Did Albion retaliate ? '

source_bert_toks: did albion re ##tal ##iate ? '

reference_raw: Did Albion get revenge?'

reference_spacy_tokens: Did Albion get revenge ? '


fn_spacy_tokens_for_baseline: She saw Gwen , who had come into the bar to consult with her manager , glance across with a very sharp look which did not waver until he 'd clumsily righted it .

source_bert_toks: she saw gwen , who had come into the bar to consult with her manager , glance across with a very sharp look which did not wave ##r until he ' d cl ##ums ##ily right ##ed it .

reference_raw: She saw Gwen, who had gone to the bar to consult with her manager, look across the room with a very sharp look that didn't waver until he awkwardly straightened it out.

reference_spacy_tokens: She saw Gwen , who had gone to the bar to consult with her manager , look across the room with a very sharp look that did n't waver until he awkwardly straightened it out .


fn_spacy_tokens_for_baseline: Since Sartre and Althusser no one has attempted a new theorization of a Marxist history .

source_bert_toks: since sar ##tre and alt ##hus ##ser no one has attempted a new theo ##rization of a marxist history .

reference_raw: Since Sartre and Althusser, no one has tried to rethink Marxist history.

reference_spacy_tokens: Since Sartre and Althusser , no one has tried to rethink Marxist history .


fn_spacy_tokens_for_baseline: The U.S. Department of Homeland Security was scheduled to break ground Monday at its National Biodefense Analysis and Countermeasures Center .

source_bert_toks: the u . s . department of homeland security was scheduled to break ground monday at its national bio ##de ##fen ##se analysis and counter ##me ##as ##ures center .

reference_raw: The U.S. Department of Interior was scheduled to break ground at the National Biodefence Analysis and Countermeasures Center on Monday.

reference_spacy_tokens: The U.S. Department of Interior was scheduled to break ground at the National Biodefence Analysis and Countermeasures Center on Monday .


fn_spacy_tokens_for_baseline: Sammy wriggled into his arms and pushed his head underneath Tom 's chin .

source_bert_toks: sammy wr ##ig ##gled into his arms and pushed his head underneath tom ' s chin .

reference_raw: Sammy wriggled in his arms and put his head under Tom's chin.

reference_spacy_tokens: Sammy wriggled in his arms and put his head under Tom 's chin .


fn_spacy_tokens_for_baseline: The man 's chamber was locked .

source_bert_toks: the man ' s chamber was locked .

reference_raw: His room was locked.

reference_spacy_tokens: His room was locked .


fn_spacy_tokens_for_baseline: Percy the park - keeper rescues the animals when their old oak tree is blown down in a storm , and the new house he builds for them is presented in a fold - away poster at the end of the book .

source_bert_toks: percy the park - keeper rescues the animals when their old oak tree is blown down in a storm , and the new house he builds for them is presented in a fold - away poster at the end of the book .

reference_raw: Percy the keeper of the park saves the animals when the old oak tree blows up in a storm, and the new house he's constructing for them is presented in a folding poster at the end of the book.

reference_spacy_tokens: Percy the keeper of the park saves the animals when the old oak tree blows up in a storm , and the new house he 's constructing for them is presented in a folding poster at the end of the book .


fn_spacy_tokens_for_baseline: Sometimes er it irritates me when they come .

source_bert_toks: sometimes er it ir ##rita ##tes me when they come .

reference_raw: Sometimes I get angry when they come.

reference_spacy_tokens: Sometimes I get angry when they come .


fn_spacy_tokens_for_baseline: Gareth Jenkins -- ' The freshest , most innovative Welsh analyst of modern rugby ' .

source_bert_toks: gareth jenkins - - ' the fresh ##est , most innovative welsh analyst of modern rugby ' .

reference_raw: Gareth Jenkins - 'Newest, most innovative Welsh Analysis of Modern Rugby'.

reference_spacy_tokens: Gareth Jenkins - ' Newest , most innovative Welsh Analysis of Modern Rugby ' .


fn_spacy_tokens_for_baseline: After five years of easy credit , the Fed has reversed course , leaving no doubt about its commitment to fighting inflation in an economy that has finally started to gain momentum .

source_bert_toks: after five years of easy credit , the fed has reversed course , leaving no doubt about its commitment to fighting inflation in an economy that has finally started to gain momentum .

reference_raw: After five years of easy credit, the Fed has reversed its course, leaving no question of its commitment to combat inflation in an economy that has finally begun to gain momentum.

reference_spacy_tokens: After five years of easy credit , the Fed has reversed its course , leaving no question of its commitment to combat inflation in an economy that has finally begun to gain momentum .


fn_spacy_tokens_for_baseline: She fumed in silence , turning her gaze towards the soothing vista of river and fields , and the brightly coloured assortment of rafts that bobbed gently on the water .

source_bert_toks: she fu ##med in silence , turning her gaze towards the soothing vista of river and fields , and the brightly coloured assortment of raft ##s that bobbed gently on the water .

reference_raw: She fumed silently, turning her eyes to the reassuring view of the rivers and fields, and the brightly colored array of rafts that bobbed gently on the water.

reference_spacy_tokens: She fumed silently , turning her eyes to the reassuring view of the rivers and fields , and the brightly colored array of rafts that bobbed gently on the water .


fn_spacy_tokens_for_baseline: Publication was stimulated by the late - nineteenth and early - twentieth - century revival of interest in folk customs , and accounts from many places throughout the British Isles and beyond are to be found in published collections , often by county .

source_bert_toks: publication was stimulated by the late - nineteenth and early - twentieth - century revival of interest in folk customs , and accounts from many places throughout the british isles and beyond are to be found in published collections , often by county .

reference_raw: The publication was stimulated by the revival of interest in folk traditions in the late nineteenth and early twentieth century, and accounts from many places across the British islands and beyond can be found in published collections, often by county.

reference_spacy_tokens: The publication was stimulated by the revival of interest in folk traditions in the late nineteenth and early twentieth century , and accounts from many places across the British islands and beyond can be found in published collections , often by county .


fn_spacy_tokens_for_baseline: The greenwoods of Sherwood fill with music and outlaws during a week of jousting , jesting , fancy dress and feasting !

source_bert_toks: the greenwood ##s of sherwood fill with music and outlaws during a week of jo ##ust ##ing , je ##sti ##ng , fancy dress and feast ##ing !

reference_raw: The green forests of Sherwood are full of music and outlaws during a week of jousts, jokes, fancy dresses and banquets!

reference_spacy_tokens: The green forests of Sherwood are full of music and outlaws during a week of jousts , jokes , fancy dresses and banquets !


fn_spacy_tokens_for_baseline: He was smallish with spectacles and an untidy moustache .

source_bert_toks: he was small ##ish with spectacle ##s and an un ##ti ##dy mo ##ust ##ache .

reference_raw: He was a small man with glasses and a loose mustache.

reference_spacy_tokens: He was a small man with glasses and a loose mustache .


fn_spacy_tokens_for_baseline: Soon after the embarrassing disclosure , the French ministry announced an inquiry into claims that Glaxo had placed numerous articles in the popular press and on television promoting its prescription - only migraine cure .

source_bert_toks: soon after the embarrassing disclosure , the french ministry announced an inquiry into claims that g ##la ##x ##o had placed numerous articles in the popular press and on television promoting its prescription - only mig ##raine cure .

reference_raw: Shortly after the embarrassing publication, the French Ministry announced an investigation into allegations that Glaxo had placed numerous articles in the popular press and on television in support of his prescription-only migraine cure.

reference_spacy_tokens: Shortly after the embarrassing publication , the French Ministry announced an investigation into allegations that Glaxo had placed numerous articles in the popular press and on television in support of his prescription - only migraine cure .


fn_spacy_tokens_for_baseline: Both the Congress Party and India 's constitution have kept the rivalry in check by standing firmly for a secular India in which the state is impartial between religions .

source_bert_toks: both the congress party and india ' s constitution have kept the rivalry in check by standing firmly for a secular india in which the state is imp ##art ##ial between religions .

reference_raw: Both the Congressional Party and the Indian Constitution have kept rivalry under control by standing firmly for a secular India where the state is unbiased among religions.

reference_spacy_tokens: Both the Congressional Party and the Indian Constitution have kept rivalry under control by standing firmly for a secular India where the state is unbiased among religions .


fn_spacy_tokens_for_baseline: Iraq says the United States and Britain hold up delivery of needed supplies , using their clout in the United Nations .

source_bert_toks: iraq says the united states and britain hold up delivery of needed supplies , using their cl ##out in the united nations .

reference_raw: Iraq claims that the United States and the United Kingdom are delaying the delivery of the necessary supplies by using their influence in the United Nations.

reference_spacy_tokens: Iraq claims that the United States and the United Kingdom are delaying the delivery of the necessary supplies by using their influence in the United Nations .


fn_spacy_tokens_for_baseline: Well , if you fancy playing your rugby in the graveyard then good luck to you .

source_bert_toks: well , if you fancy playing your rugby in the graveyard then good luck to you .

reference_raw: Well, if you want to play rugby in a cemetery, good luck.

reference_spacy_tokens: Well , if you want to play rugby in a cemetery , good luck .


fn_spacy_tokens_for_baseline: Football supporters are n't the only ones who go around en masse .

source_bert_toks: football supporters aren ' t the only ones who go around en mass ##e .

reference_raw: Football fans are not the only ones walking around en masse.

reference_spacy_tokens: Football fans are not the only ones walking around en masse .


fn_spacy_tokens_for_baseline: But how does a woman best handle that hellish and uncertain time when her husband is still shopping for the supplements ?

source_bert_toks: but how does a woman best handle that hell ##ish and uncertain time when her husband is still shopping for the supplements ?

reference_raw: But what's the best way for a woman to handle a hellish, uncertain time when her husband's still buying supplements?

reference_spacy_tokens: But what 's the best way for a woman to handle a hellish , uncertain time when her husband 's still buying supplements ?


fn_spacy_tokens_for_baseline: Everything from flamenco dancing to French theatre will take place , as well as Europe 's largest kite flying festival in Sunderland .

source_bert_toks: everything from flame ##nco dancing to french theatre will take place , as well as europe ' s largest kite flying festival in sunderland .

reference_raw: Everything from the Flamenco dance to the French Theatre will be held, and the biggest dragon-flying ceremony in Sunderland will be held in Europe.

reference_spacy_tokens: Everything from the Flamenco dance to the French Theatre will be held , and the biggest dragon - flying ceremony in Sunderland will be held in Europe .


fn_spacy_tokens_for_baseline: During that first weekend Prince Charles showed Diana around Highgrove , the 353-acre Gloucestershire home he had bought in July the same month he had started to woo her .

source_bert_toks: during that first weekend prince charles showed diana around high ##grove , the 35 ##3 - acre gloucestershire home he had bought in july the same month he had started to woo her .

reference_raw: During the first weekend, Prince Charles showed Diana around Highgrove, the 353-acre Gloucestershire house he'd bought in July of the same month he'd started courting her.

reference_spacy_tokens: During the first weekend , Prince Charles showed Diana around Highgrove , the 353-acre Gloucestershire house he 'd bought in July of the same month he 'd started courting her .


fn_spacy_tokens_for_baseline: ' The Royal Family are no different from any other family going through the strains of marriage break - up .

source_bert_toks: ' the royal family are no different from any other family going through the strains of marriage break - up .

reference_raw: The royal family is no different from any other family going through the stress of a marriage breakup.

reference_spacy_tokens: The royal family is no different from any other family going through the stress of a marriage breakup .


fn_spacy_tokens_for_baseline: Peter waved towards the cupboard .

source_bert_toks: peter waved towards the cupboard .

reference_raw: Peter gestured to the closet.

reference_spacy_tokens: Peter gestured to the closet .


fn_spacy_tokens_for_baseline: They met ; he found her company agreeable , she found him a new slogan .

source_bert_toks: they met ; he found her company agree ##able , she found him a new slogan .

reference_raw: They had met; he had found her company pleasant, and she had found him a new slogan.

reference_spacy_tokens: They had met ; he had found her company pleasant , and she had found him a new slogan .


fn_spacy_tokens_for_baseline: Obsidian is a hard , vitreous volcanic rock , which could be fashioned into tools for cutting and stabbing .

source_bert_toks: obsidian is a hard , vi ##tre ##ous volcanic rock , which could be fashioned into tools for cutting and stabbing .

reference_raw: Obsidian is a hard, vitreous volcanic rock that can be made into instruments for cutting and stabbing.

reference_spacy_tokens: Obsidian is a hard , vitreous volcanic rock that can be made into instruments for cutting and stabbing .


fn_spacy_tokens_for_baseline: The story of the Western discovery of Macau begins in 1513 when Portuguese explorer , Jorge Alvares , reached the south coast of China .

source_bert_toks: the story of the western discovery of macau begins in 151 ##3 when portuguese explorer , jorge al ##var ##es , reached the south coast of china .

reference_raw: The story about Macao's western discovery began in 1513 when Portuguese explorer Jorge Alvares arrived on the south coast.

reference_spacy_tokens: The story about Macao 's western discovery began in 1513 when Portuguese explorer Jorge Alvares arrived on the south coast .


fn_spacy_tokens_for_baseline: Locals in one area for example became accustomed to pungent odours , which can arise from the manufacture of mushroom compost if the mix is not correct , and did not complain .

source_bert_toks: locals in one area for example became accustomed to pun ##gent o ##dou ##rs , which can arise from the manufacture of mushroom com ##post if the mix is not correct , and did not complain .

reference_raw: For example, locals in one region have become accustomed to the pungent odors that may result from the production of mushroom compost if the mixture is incorrect and do not complain.

reference_spacy_tokens: For example , locals in one region have become accustomed to the pungent odors that may result from the production of mushroom compost if the mixture is incorrect and do not complain .


fn_spacy_tokens_for_baseline: Clothes were strewn on the sofa and chairs and Faustina was dragging a silver lame belt along the carpet .

source_bert_toks: clothes were strewn on the sofa and chairs and faust ##ina was dragging a silver lame belt along the carpet .

reference_raw: The couch and chairs were littered with clothes, and Faustina pulled a silver lame belt across the carpet.

reference_spacy_tokens: The couch and chairs were littered with clothes , and Faustina pulled a silver lame belt across the carpet .


fn_spacy_tokens_for_baseline: He turned down the Army 's offer to take a few months off before returning to boot camp .

source_bert_toks: he turned down the army ' s offer to take a few months off before returning to boot camp .

reference_raw: He rejected the Army's offer to take a few months off before he went back to boot camp.

reference_spacy_tokens: He rejected the Army 's offer to take a few months off before he went back to boot camp .


fn_spacy_tokens_for_baseline: During his four days in Iraq , Hall said he wanted to investigate reports from relief agencies that a quarter of Iraqi children may be suffering from chronic malnutrition .

source_bert_toks: during his four days in iraq , hall said he wanted to investigate reports from relief agencies that a quarter of iraqi children may be suffering from chronic mal ##nut ##rit ##ion .

reference_raw: During his four days in Iraq, Hall said he was going to investigate reports from relief agencies that a quarter of Iraqi children might be suffering from chronic malnutrition.

reference_spacy_tokens: During his four days in Iraq , Hall said he was going to investigate reports from relief agencies that a quarter of Iraqi children might be suffering from chronic malnutrition .


fn_spacy_tokens_for_baseline: Only a black quilted hairband pushing back her blonde hair hinted at an aristocratic connection .

source_bert_toks: only a black quilt ##ed hair ##band pushing back her blonde hair hinted at an aristocratic connection .

reference_raw: Only the black quilt of hair that brushed back her blond hair suggested an aristocratic connection.

reference_spacy_tokens: Only the black quilt of hair that brushed back her blond hair suggested an aristocratic connection .


fn_spacy_tokens_for_baseline: Although a CU may have implications for both internal and external economies of scale , the emphasis is normally placed upon the technical aspect of internal economies .

source_bert_toks: although a cu may have implications for both internal and external economies of scale , the emphasis is normally placed upon the technical aspect of internal economies .

reference_raw: Although the CU may have an impact on both internal and external economies of scale, the focus is usually on the technical aspects of the internal economy.

reference_spacy_tokens: Although the CU may have an impact on both internal and external economies of scale , the focus is usually on the technical aspects of the internal economy .


fn_spacy_tokens_for_baseline: All you did was sit round like some old colonel in an Agatha Christie book , bellowing about the country going to the dogs .

source_bert_toks: all you did was sit round like some old colonel in an agatha christie book , bell ##owing about the country going to the dogs .

reference_raw: You just sat around like an old colonel in an Agatha Christie book, screaming about the country going to the dogs.

reference_spacy_tokens: You just sat around like an old colonel in an Agatha Christie book , screaming about the country going to the dogs .


fn_spacy_tokens_for_baseline: His search for Tess took him first to Flintcomb - Ash , where he discovered she had never used her married name .

source_bert_toks: his search for tess took him first to flint ##comb - ash , where he discovered she had never used her married name .

reference_raw: His search for Tess had taken him first to Flintcomb-Ash, where he had discovered that she had never used her husband's name.

reference_spacy_tokens: His search for Tess had taken him first to Flintcomb - Ash , where he had discovered that she had never used her husband 's name .


fn_spacy_tokens_for_baseline: Lynn Bari , who was born Marjorie Schuyler Fisher on December 18th 1913 in Roanoke , Virginia , concocted her screen name from that of the actress Lynn Fontane and author James Barrie .

source_bert_toks: lynn bari , who was born marjorie sc ##hu ##yler fisher on december 18th 1913 in roanoke , virginia , con ##co ##cted her screen name from that of the actress lynn font ##ane and author james barrie .

reference_raw: Lynn Bari, born on December 18, 1913 in Roanoke, Virginia, Marjorie Schuyler Fisher, invented the screen name of Lynn Fontane and the author of James Barrie.

reference_spacy_tokens: Lynn Bari , born on December 18 , 1913 in Roanoke , Virginia , Marjorie Schuyler Fisher , invented the screen name of Lynn Fontane and the author of James Barrie .


fn_spacy_tokens_for_baseline: The girl was glued to the spot , terror - struck , pop - eyed , quivering , knowing for certain that the Day of Judgment had come for her at last .

source_bert_toks: the girl was glued to the spot , terror - struck , pop - eyed , quivering , knowing for certain that the day of judgment had come for her at last .

reference_raw: The girl was glued to the spot, frightened, pop-eyed, trembling, knowing with certainty that the Day of Judgment had finally come for her.

reference_spacy_tokens: The girl was glued to the spot , frightened , pop - eyed , trembling , knowing with certainty that the Day of Judgment had finally come for her .


fn_spacy_tokens_for_baseline: The work is preparation for Iran 's plans to install 3,000 centrifuges at the site , but so far no centrifuges have been emplaced , according to the Associated Press .

source_bert_toks: the work is preparation for iran ' s plans to install 3 , 000 cent ##ri ##fu ##ges at the site , but so far no cent ##ri ##fu ##ges have been em ##placed , according to the associated press .

reference_raw: The work is preparing Iran's plans to install 3,000 centrifuges on the site, but according to the associated press, no centrifuges have yet been replaced.

reference_spacy_tokens: The work is preparing Iran 's plans to install 3,000 centrifuges on the site , but according to the associated press , no centrifuges have yet been replaced .


fn_spacy_tokens_for_baseline: I was awakened shortly after dawn by Floss and Tibbs .

source_bert_toks: i was awakened shortly after dawn by fl ##oss and ti ##bbs .

reference_raw: Floss and Tibbs woke me up just after dawn.

reference_spacy_tokens: Floss and Tibbs woke me up just after dawn .


fn_spacy_tokens_for_baseline: The Magnolia dining room caters for the smaller appetite , with a selection of filled rolls and home - made soups .

source_bert_toks: the magnolia dining room cater ##s for the smaller appetite , with a selection of filled rolls and home - made soup ##s .

reference_raw: Magnolia canteens for a small appetite, with a selection of full rolls and home-made broths.

reference_spacy_tokens: Magnolia canteens for a small appetite , with a selection of full rolls and home - made broths .


fn_spacy_tokens_for_baseline: A very large number have been turned away and told to go back home . '

source_bert_toks: a very large number have been turned away and told to go back home . '

reference_raw: A very large number of people have been turned away and asked to return home.'

reference_spacy_tokens: A very large number of people have been turned away and asked to return home . '


fn_spacy_tokens_for_baseline: At the other extreme are those planners who compose the most thorough set of notes for their essays .

source_bert_toks: at the other extreme are those planners who compose the most thorough set of notes for their essays .

reference_raw: At the other extreme are the planners who compile the most detailed set of notes for their essays.

reference_spacy_tokens: At the other extreme are the planners who compile the most detailed set of notes for their essays .


fn_spacy_tokens_for_baseline: And suddenly she felt as stiff and cold and fragile as the champagne glass that was clutched in her shaking hand .

source_bert_toks: and suddenly she felt as stiff and cold and fragile as the champagne glass that was clutched in her shaking hand .

reference_raw: And suddenly she felt as stiff and cold and frail as a glass of champagne held in her trembling hand.

reference_spacy_tokens: And suddenly she felt as stiff and cold and frail as a glass of champagne held in her trembling hand .


fn_spacy_tokens_for_baseline: QN : Does the Defense Department want BioPort Corporation to manufacture anthrax vaccine ?

source_bert_toks: q ##n : does the defense department want bio ##port corporation to manufacture ant ##hra ##x vaccine ?

reference_raw: Does the Department of Defense want BioPort Corporation to produce anthrax vaccines?

reference_spacy_tokens: Does the Department of Defense want BioPort Corporation to produce anthrax vaccines ?


fn_spacy_tokens_for_baseline: They aspired towards the Chelsea shore , where , in the early 1960s many thousands lived with sensible occupations and adequate amounts of money .

source_bert_toks: they as ##pired towards the chelsea shore , where , in the early 1960s many thousands lived with sensible occupations and adequate amounts of money .

reference_raw: They sought the coast of Chelsea, where, in the early 1960s, thousands of people lived with reasonable occupations and a fair amount of money.

reference_spacy_tokens: They sought the coast of Chelsea , where , in the early 1960s , thousands of people lived with reasonable occupations and a fair amount of money .


fn_spacy_tokens_for_baseline: The El Rancho Vegas ( 1941 ) was the first , followed by the Last Frontier ( 1943 ) .

source_bert_toks: the el rancho vegas ( 1941 ) was the first , followed by the last frontier ( 1943 ) .

reference_raw: The first was El Rancho Vegas (1941), followed by the final frontier (1943).

reference_spacy_tokens: The first was El Rancho Vegas ( 1941 ) , followed by the final frontier ( 1943 ) .


fn_spacy_tokens_for_baseline: I am withdrawing from the race .

source_bert_toks: i am withdrawing from the race .

reference_raw: I'm pulling out of the race.

reference_spacy_tokens: I 'm pulling out of the race .


fn_spacy_tokens_for_baseline: Why have you tempted me away from religion ?

source_bert_toks: why have you tempted me away from religion ?

reference_raw: Why did you seduce me out of religion?

reference_spacy_tokens: Why did you seduce me out of religion ?


fn_spacy_tokens_for_baseline: Henry looked at himself in the kitchen mirror , as he crumpled up the other three pages of this latest missive and threw it in the swingbin .

source_bert_toks: henry looked at himself in the kitchen mirror , as he crumpled up the other three pages of this latest miss ##ive and threw it in the swing ##bin .

reference_raw: Henry looked at himself in the kitchen mirror as he crushed the other three pages of the last missive and tossed it into the swing-bin.

reference_spacy_tokens: Henry looked at himself in the kitchen mirror as he crushed the other three pages of the last missive and tossed it into the swing - bin .


fn_spacy_tokens_for_baseline: ' Great excitement was caused in Esher and the neighbouring district when it was learned late last night that an arrest had been effected in connection with the Oxshott murder .

source_bert_toks: ' great excitement was caused in es ##her and the neighbouring district when it was learned late last night that an arrest had been effect ##ed in connection with the ox ##shot ##t murder .

reference_raw: 'There was a great deal of excitement in Esher and in the neighboring district when it was discovered late last night that an arrest had been made in connection with the Oxshott murder.

reference_spacy_tokens: ' There was a great deal of excitement in Esher and in the neighboring district when it was discovered late last night that an arrest had been made in connection with the Oxshott murder .


fn_spacy_tokens_for_baseline: Friends such as Edward Clodd , who expected Hardy to be relieved by her death in 1912 , found instead that he was overcome with remorse for neglecting one whom he had once loved so well .

source_bert_toks: friends such as edward cl ##od ##d , who expected hardy to be relieved by her death in 1912 , found instead that he was overcome with remorse for neglect ##ing one whom he had once loved so well .

reference_raw: Friends like Edward Clodd, who had expected Hardy to be relieved by her death in 1912, found, instead, that he felt guilty for neglecting someone he had once loved so well.

reference_spacy_tokens: Friends like Edward Clodd , who had expected Hardy to be relieved by her death in 1912 , found , instead , that he felt guilty for neglecting someone he had once loved so well .


fn_spacy_tokens_for_baseline: However , because of the unusual nature of the case , members of the district council 's public sector housing subcommittee on management agreed to the request and agreed to assist Miss X on compassionate grounds .

source_bert_toks: however , because of the unusual nature of the case , members of the district council ' s public sector housing subcommittee on management agreed to the request and agreed to assist miss x on compassionate grounds .

reference_raw: However, due to the exceptional nature of the case, members of the Public Sector Housing Subcommittee of the District Council agreed to the request and agreed to assist Miss X for compassionate reasons.

reference_spacy_tokens: However , due to the exceptional nature of the case , members of the Public Sector Housing Subcommittee of the District Council agreed to the request and agreed to assist Miss X for compassionate reasons .


fn_spacy_tokens_for_baseline: They left the motorway at the next junction , and the busy road gave way to the outskirts of a small town .

source_bert_toks: they left the motorway at the next junction , and the busy road gave way to the outskirts of a small town .

reference_raw: They left the highway at the next intersection, and the busy road gave way to the edge of a small town.

reference_spacy_tokens: They left the highway at the next intersection , and the busy road gave way to the edge of a small town .


fn_spacy_tokens_for_baseline: The Japanese ships included a full - sized replica of the battleship Nagato which stretched over 660 ' in length and was ten storeys high .

source_bert_toks: the japanese ships included a full - sized replica of the battleship naga ##to which stretched over 660 ' in length and was ten storey ##s high .

reference_raw: The Japanese ships contained a full-size replica of the Nagato battleship, which was over 660' long and ten stories tall.

reference_spacy_tokens: The Japanese ships contained a full - size replica of the Nagato battleship , which was over 660 ' long and ten stories tall .


fn_spacy_tokens_for_baseline: Riddell quits Capital House post

source_bert_toks: rid ##dell quit ##s capital house post

reference_raw: Riddell is leaving the Capital House post


fn_spacy_tokens_for_baseline: In 1566 , they wrested Chios from the Genoese , bolstering their hold on the eastern Aegean Islands , but the Cyclades remained in Venetian hands for another generation or more -- Tinos was the last to fall in 1715 .

source_bert_toks: in 156 ##6 , they wr ##ested chi ##os from the gen ##oese , bo ##lster ##ing their hold on the eastern aegean islands , but the cy ##cl ##ades remained in venetian hands for another generation or more - - tin ##os was the last to fall in 1715 .

reference_raw: In 1566, they wrestled Chios from the Genoes and bolstered their hold on the eastern Aegean islands, but the Cyclades remained in Venetian hands for a generation or more - Tinos was the last to fall in 1715.

reference_spacy_tokens: In 1566 , they wrestled Chios from the Genoes and bolstered their hold on the eastern Aegean islands , but the Cyclades remained in Venetian hands for a generation or more - Tinos was the last to fall in 1715 .


fn_spacy_tokens_for_baseline: The club closed in the late Sixties and was later demolished to make way for the shopping centre Eldon Gardens .

source_bert_toks: the club closed in the late sixties and was later demolished to make way for the shopping centre el ##don gardens .

reference_raw: The club closed at the end of the '60s and was subsequently demolished to make way for the Eldon Gardens shopping center.

reference_spacy_tokens: The club closed at the end of the ' 60s and was subsequently demolished to make way for the Eldon Gardens shopping center .


fn_spacy_tokens_for_baseline: This plant probably was designed to replace aging plants in Volgograd and Novocheboksarsk ( Russia ) for the production of the binary agent " novichok . "

source_bert_toks: this plant probably was designed to replace aging plants in vol ##go ##grad and novo ##che ##bo ##ks ##ars ##k ( russia ) for the production of the binary agent " novi ##cho ##k . "

reference_raw: It is likely that the plant was designed to substitute the aging plants in Volgograd and Novocheboksarsk (Russia) for the production of the binary agent "Novichok ."

reference_spacy_tokens: It is likely that the plant was designed to substitute the aging plants in Volgograd and Novocheboksarsk ( Russia ) for the production of the binary agent " Novichok . "


fn_spacy_tokens_for_baseline: So beside every major town they built a castle garrisoned by loyal troops usually under the command of the local sheriff .

source_bert_toks: so beside every major town they built a castle garrison ##ed by loyal troops usually under the command of the local sheriff .

reference_raw: So, next to each major city, they built a chateau crewed by loyal soldiers, usually under the command of a local sheriff.

reference_spacy_tokens: So , next to each major city , they built a chateau crewed by loyal soldiers , usually under the command of a local sheriff .


fn_spacy_tokens_for_baseline: It 's like listening to a band suffering from perpetual memory loss , they live so relentlessly in the present .

source_bert_toks: it ' s like listening to a band suffering from perpetual memory loss , they live so relentless ##ly in the present .

reference_raw: It's like listening to a band suffering from permanent memory loss, living in the present so relentlessly.

reference_spacy_tokens: It 's like listening to a band suffering from permanent memory loss , living in the present so relentlessly .


fn_spacy_tokens_for_baseline: We agree to talk once the last bell has rung .

source_bert_toks: we agree to talk once the last bell has run ##g .

reference_raw: We agree to speak as soon as the last bell rings.

reference_spacy_tokens: We agree to speak as soon as the last bell rings .


fn_spacy_tokens_for_baseline: ' No doubt she already repents . '

source_bert_toks: ' no doubt she already rep ##ents . '

reference_raw: "There's no doubt he's already regretting it."

reference_spacy_tokens: " There 's no doubt he 's already regretting it . "


fn_spacy_tokens_for_baseline: He felt safe with Jordan , and for this reason viciously pushed all thoughts about Zambia to the back of his mind .

source_bert_toks: he felt safe with jordan , and for this reason vicious ##ly pushed all thoughts about zambia to the back of his mind .

reference_raw: He felt secure with Jordan, and for that reason he pushed all thoughts of Zambia to the back of his mind.

reference_spacy_tokens: He felt secure with Jordan , and for that reason he pushed all thoughts of Zambia to the back of his mind .


fn_spacy_tokens_for_baseline: Far above in the belfry , the huge bronze bells , mounted on wheels , swing madly through a full 360 degrees , starting and ending , surprisingly , in the inverted , or mouth - up position .

source_bert_toks: far above in the bel ##fr ##y , the huge bronze bells , mounted on wheels , swing madly through a full 360 degrees , starting and ending , surprisingly , in the inverted , or mouth - up position .

reference_raw: Far above the bells, the great bronze bells, mounted on wheels, swing madly at 360 degrees, starting and ending, surprisingly, in the inverted or mouth-up position.

reference_spacy_tokens: Far above the bells , the great bronze bells , mounted on wheels , swing madly at 360 degrees , starting and ending , surprisingly , in the inverted or mouth - up position .


fn_spacy_tokens_for_baseline: This trend has led to many more demolitions , including the Dunes ( replaced by Bellagio ) , Aladdin ( the new Aladdin ) and Sands ( Venetian ) hotels .

source_bert_toks: this trend has led to many more demolition ##s , including the dunes ( replaced by bella ##gio ) , ala ##ddin ( the new ala ##ddin ) and sands ( venetian ) hotels .

reference_raw: This trend has led to a number of further demolitions, including the Dunes (replaced by Bellagio), Aladdin (new Aladdin) and Sands (Venetian) hotels.

reference_spacy_tokens: This trend has led to a number of further demolitions , including the Dunes ( replaced by Bellagio ) , Aladdin ( new Aladdin ) and Sands ( Venetian ) hotels .


fn_spacy_tokens_for_baseline: This is simply the baseline scenario that produces a relatively stable prevalence rate over the duration of the projection , with the number of people living with HIV and the number of new infections rising slowly over time because of population growth .

source_bert_toks: this is simply the baseline scenario that produces a relatively stable prevalence rate over the duration of the projection , with the number of people living with hiv and the number of new infections rising slowly over time because of population growth .

reference_raw: This is simply a baseline scenario which generates a relatively stable prevalence rate over the projection period, with the number of HIV-infected populations and the number of new infections increasing slowly over time due to population growth.

reference_spacy_tokens: This is simply a baseline scenario which generates a relatively stable prevalence rate over the projection period , with the number of HIV - infected populations and the number of new infections increasing slowly over time due to population growth .


fn_spacy_tokens_for_baseline: Of course he would n't kiss her here in a crowded hotel foyer .

source_bert_toks: of course he wouldn ' t kiss her here in a crowded hotel foyer .

reference_raw: Of course he didn't want to kiss her in an overcrowded hotel room.

reference_spacy_tokens: Of course he did n't want to kiss her in an overcrowded hotel room .


fn_spacy_tokens_for_baseline: Some users continue to violate the conditions of hiring and discussions will take place on the desirability of restricting Saturday night hirings to known , ' reliable ' customers only .

source_bert_toks: some users continue to violate the conditions of hiring and discussions will take place on the des ##ira ##bility of restricting saturday night hiring ##s to known , ' reliable ' customers only .

reference_raw: Some users are still in breach of the hiring conditions and discussions will take place on the desirability of restricting Saturday night hiring to known, "reliable" customers only.

reference_spacy_tokens: Some users are still in breach of the hiring conditions and discussions will take place on the desirability of restricting Saturday night hiring to known , " reliable " customers only .


fn_spacy_tokens_for_baseline: The revolt itself has taken many forms , and issued in a variety of quite different conceptions of what philosophy itself is about .

source_bert_toks: the revolt itself has taken many forms , and issued in a variety of quite different conception ##s of what philosophy itself is about .

reference_raw: The rebellion itself took many forms and gave rise to different concepts of what philosophy itself was about.

reference_spacy_tokens: The rebellion itself took many forms and gave rise to different concepts of what philosophy itself was about .


fn_spacy_tokens_for_baseline: From its size , the knife must have had a very specific use and may even have been a surgical instrument .

source_bert_toks: from its size , the knife must have had a very specific use and may even have been a surgical instrument .

reference_raw: From the size of the knife, it had to be used in a very specific way, and it could even be a surgical tool.

reference_spacy_tokens: From the size of the knife , it had to be used in a very specific way , and it could even be a surgical tool .


fn_spacy_tokens_for_baseline: When a doctor 's receptionist suffered a hearing loss , she prepared by carefully noting and practising the names of patients and times of their appointments .

source_bert_toks: when a doctor ' s receptionist suffered a hearing loss , she prepared by carefully noting and pr ##act ##ising the names of patients and times of their appointments .

reference_raw: When the doctor's secretary suffered hearing loss, she prepared herself by carefully noting and practising the patient's names and times of appointment.

reference_spacy_tokens: When the doctor 's secretary suffered hearing loss , she prepared herself by carefully noting and practising the patient 's names and times of appointment .


fn_spacy_tokens_for_baseline: His climbing achievements are many , but it is his attempts on Everest which have lodged him firmly in the public consciousness .

source_bert_toks: his climbing achievements are many , but it is his attempts on everest which have lodged him firmly in the public consciousness .

reference_raw: There are many of his climbing successes, but it was his attempts at Everest that put him firmly into the public awareness.

reference_spacy_tokens: There are many of his climbing successes , but it was his attempts at Everest that put him firmly into the public awareness .


fn_spacy_tokens_for_baseline: In 1976 , 100 people were killed when another cargo jumbo jet ploughed into a crowded street in Santa Cruz , Bolivia .

source_bert_toks: in 1976 , 100 people were killed when another cargo ju ##mbo jet pl ##ough ##ed into a crowded street in santa cruz , bolivia .

reference_raw: In 1976, a hundred people were killed when another cargo jumbo jet was ploughed into a crowded avenue in Santa Cruz, Bolivia.

reference_spacy_tokens: In 1976 , a hundred people were killed when another cargo jumbo jet was ploughed into a crowded avenue in Santa Cruz , Bolivia .


fn_spacy_tokens_for_baseline: The solution had to be seeded .

source_bert_toks: the solution had to be seeded .

reference_raw: The solution must have been planted.

reference_spacy_tokens: The solution must have been planted .


fn_spacy_tokens_for_baseline: I 'm furious with her , I crave her voice and touch , and I call that love .

source_bert_toks: i ' m furious with her , i cr ##ave her voice and touch , and i call that love .

reference_raw: I'm mad at her, I want her voice and touch, and I call it love.

reference_spacy_tokens: I 'm mad at her , I want her voice and touch , and I call it love .


fn_spacy_tokens_for_baseline: Usually , by the time they have lost enough weight , they are totally fatigued !

source_bert_toks: usually , by the time they have lost enough weight , they are totally fatigue ##d !

reference_raw: Usually, when they lose enough weight, they're completely tired!

reference_spacy_tokens: Usually , when they lose enough weight , they 're completely tired !


fn_spacy_tokens_for_baseline: Good intentions and uncertainty are a not infrequent outcome or compromise .

source_bert_toks: good intentions and uncertainty are a not in ##fr ##e ##quent outcome or compromise .

reference_raw: Good intentions and uncertainties are not uncommon outcomes or compromises.

reference_spacy_tokens: Good intentions and uncertainties are not uncommon outcomes or compromises .


fn_spacy_tokens_for_baseline: Kiku 's sigh was exaggerated .

source_bert_toks: ki ##ku ' s sigh was exaggerated .

reference_raw: Kiku heaved an exaggeration.

reference_spacy_tokens: Kiku heaved an exaggeration .


fn_spacy_tokens_for_baseline: Her answer to the Dean 's famous poem on Celia 's dressing room ' is not recommended to readers of a nervous disposition ( ed ) ' ; in parts it is more disgusting than the original .

source_bert_toks: her answer to the dean ' s famous poem on celia ' s dressing room ' is not recommended to readers of a nervous disposition ( ed ) ' ; in parts it is more disgusting than the original .

reference_raw: Her response to the Dean's famous poetry in Celia's dressing room is not recommended to readers of nervous disposition (ed); in parts it is more repulsive than the original.

reference_spacy_tokens: Her response to the Dean 's famous poetry in Celia 's dressing room is not recommended to readers of nervous disposition ( ed ) ; in parts it is more repulsive than the original .


fn_spacy_tokens_for_baseline: Of course very soon his pub was full of war - mad wankers talking about sport .

source_bert_toks: of course very soon his pub was full of war - mad wan ##kers talking about sport .

reference_raw: Very soon, of course, his inn was filled with war-mad wankers talking about sport.

reference_spacy_tokens: Very soon , of course , his inn was filled with war - mad wankers talking about sport .


fn_spacy_tokens_for_baseline: QN : Are there any efforts to bring back small investors ?

source_bert_toks: q ##n : are there any efforts to bring back small investors ?

reference_raw: QN: Are there any attempts to return small investors?

reference_spacy_tokens: QN : Are there any attempts to return small investors ?


fn_spacy_tokens_for_baseline: It was both a defence of translation of the Bible and an assertion of the loyalty of the Reformers to the state .

source_bert_toks: it was both a defence of translation of the bible and an assertion of the loyalty of the reformer ##s to the state .

reference_raw: It was both a defense against the translation of the Bible and a statement that reformers were loyal to the state.

reference_spacy_tokens: It was both a defense against the translation of the Bible and a statement that reformers were loyal to the state .


fn_spacy_tokens_for_baseline: Union Pacific then consolidated its operations , eliminating the Las Vegas repair facility .

source_bert_toks: union pacific then consolidated its operations , eliminating the las vegas repair facility .

reference_raw: The Union Pacific then merged its operations and eliminated the Las Vegas Repair Facility.

reference_spacy_tokens: The Union Pacific then merged its operations and eliminated the Las Vegas Repair Facility .


fn_spacy_tokens_for_baseline: ' It does to me ! ' he said under his breath , then , after a pause , rattled the handle again , his voice softening .

source_bert_toks: ' it does to me ! ' he said under his breath , then , after a pause , rattled the handle again , his voice soft ##ening .

reference_raw: "I do!" he said breathlessly, then, after a moment's pause, clicked the handle again, and his voice softened.

reference_spacy_tokens: " I do ! " he said breathlessly , then , after a moment 's pause , clicked the handle again , and his voice softened .


fn_spacy_tokens_for_baseline: The audience ca n't help being delighted when business whizz Katherine goes skiing and breaks her leg .

source_bert_toks: the audience can ' t help being delighted when business w ##hi ##zz katherine goes skiing and breaks her leg .

reference_raw: The audience can't help but be happy when a business whistling Katherine goes skiing and breaks her leg.

reference_spacy_tokens: The audience ca n't help but be happy when a business whistling Katherine goes skiing and breaks her leg .


fn_spacy_tokens_for_baseline: Surely there are no irate girlfriends in your life any more ? '

source_bert_toks: surely there are no ira ##te girlfriends in your life any more ? '

reference_raw: Are you sure you don't have an irate friend in your life anymore?'

reference_spacy_tokens: Are you sure you do n't have an irate friend in your life anymore ? '


fn_spacy_tokens_for_baseline: Preliminary observations on Harris ( Birks , unpublished ) suggest that local glaciers may have been present during the stadial in some of the valleys around Clisham , Ullaval , Tirga Mor , and Uisgnaval More .

source_bert_toks: preliminary observations on harris ( bi ##rks , unpublished ) suggest that local glaciers may have been present during the st ##adia ##l in some of the valleys around cl ##isha ##m , ul ##lav ##al , ti ##rga mor , and ui ##sg ##na ##val more .

reference_raw: Initial comments on Harris (Birks, not published) indicate that local glaciers may have been present in certain valleys around Clisham, Ullaval, Tirga Mor, and Uisgnaval More during the stadium.

reference_spacy_tokens: Initial comments on Harris ( Birks , not published ) indicate that local glaciers may have been present in certain valleys around Clisham , Ullaval , Tirga Mor , and Uisgnaval More during the stadium .


fn_spacy_tokens_for_baseline: Gray 's wiry body was twitching with animation ; his keen eyes searched Stephen 's face for signs of agreement .

source_bert_toks: gray ' s wi ##ry body was twitching with animation ; his keen eyes searched stephen ' s face for signs of agreement .

reference_raw: Gray's wry body twitched with animation; his keen eyes searched Stephen's face for signs of approval.

reference_spacy_tokens: Gray 's wry body twitched with animation ; his keen eyes searched Stephen 's face for signs of approval .


fn_spacy_tokens_for_baseline: ' You 'd like a mental picture of what 's going on . '

source_bert_toks: ' you ' d like a mental picture of what ' s going on . '

reference_raw: "You want to get a mental picture of what's happening."

reference_spacy_tokens: " You want to get a mental picture of what 's happening . "


fn_spacy_tokens_for_baseline: He replied that he had wanted to .

source_bert_toks: he replied that he had wanted to .

reference_raw: He said he wanted to.

reference_spacy_tokens: He said he wanted to .


fn_spacy_tokens_for_baseline: For the Palestinians and the PLO , King Husayn 's announcement was a tremendous victory , for he had formally renounced the claim he had refused to concede after Rabat in 1974 .

source_bert_toks: for the palestinians and the pl ##o , king hu ##say ##n ' s announcement was a tremendous victory , for he had formally reno ##unced the claim he had refused to con ##cede after ra ##bat in 1974 .

reference_raw: For the Palestinians and the PLO, King Husayn's announcement was a huge victory, for he formally gave up what he refused to admit after Rabat in 1974.

reference_spacy_tokens: For the Palestinians and the PLO , King Husayn 's announcement was a huge victory , for he formally gave up what he refused to admit after Rabat in 1974 .


fn_spacy_tokens_for_baseline: Dinner was at 1 o'clock -- always a roasted joint with beautifully baked potatoes and very special gravy .

source_bert_toks: dinner was at 1 o ' clock - - always a roasted joint with beautifully baked potatoes and very special gr ##av ##y .

reference_raw: Dinner was at 1:00 a.m. - always a baked joint with a beautifully baked pot and a very special sauce.

reference_spacy_tokens: Dinner was at 1:00 a.m. - always a baked joint with a beautifully baked pot and a very special sauce .


fn_spacy_tokens_for_baseline: First , try dislodging the object with slaps on the back .

source_bert_toks: first , try di ##sl ##od ##ging the object with slap ##s on the back .

reference_raw: First, try to throw the object away with a slap on the back.

reference_spacy_tokens: First , try to throw the object away with a slap on the back .


fn_spacy_tokens_for_baseline: The dining room seats a maximum of 48 covers , which has tended to inhibit its use as a public restaurant during the peak season .

source_bert_toks: the dining room seats a maximum of 48 covers , which has tended to inhibit its use as a public restaurant during the peak season .

reference_raw: There are no more than 48 envelopes in the dining room, which tends to inhibit its use as a public restaurant during the peak season.

reference_spacy_tokens: There are no more than 48 envelopes in the dining room , which tends to inhibit its use as a public restaurant during the peak season .


fn_spacy_tokens_for_baseline: She took a fistful of her outside thigh and squeezed , making the flesh frown .

source_bert_toks: she took a fist ##ful of her outside thigh and squeezed , making the flesh frown .

reference_raw: She took a handful of her outer thigh and pressed it, making her body frown.

reference_spacy_tokens: She took a handful of her outer thigh and pressed it , making her body frown .


fn_spacy_tokens_for_baseline: Peter tried to detach himself from Molland as they left the solicitor 's office .

source_bert_toks: peter tried to det ##ach himself from mo ##lland as they left the solicitor ' s office .

reference_raw: When they left the lawyer's office, Peter tried to separate himself from Molland.

reference_spacy_tokens: When they left the lawyer 's office , Peter tried to separate himself from Molland .


fn_spacy_tokens_for_baseline: Near nightfall he saw his younger sister Katya come out of the kitchens into the yard , saw her empty some slops for the few chickens who scuttled about .

source_bert_toks: near nightfall he saw his younger sister katy ##a come out of the kitchens into the yard , saw her empty some sl ##ops for the few chickens who sc ##ut ##tled about .

reference_raw: Near dusk, he saw his younger sister, Katya, coming out of the kitchen and out into the garden, and saw her empty a few slops of chickens running around.

reference_spacy_tokens: Near dusk , he saw his younger sister , Katya , coming out of the kitchen and out into the garden , and saw her empty a few slops of chickens running around .


fn_spacy_tokens_for_baseline: It may perhaps be more difficult to alarm him than it would be to alarm the vulnerable persons whom the offence is principally designed to protect .

source_bert_toks: it may perhaps be more difficult to alarm him than it would be to alarm the vulnerable persons whom the offence is principally designed to protect .

reference_raw: It may be more difficult to frighten him than to alert the vulnerable persons whose main purpose of the crime is to protect.

reference_spacy_tokens: It may be more difficult to frighten him than to alert the vulnerable persons whose main purpose of the crime is to protect .


fn_spacy_tokens_for_baseline: Although many of the main ingredients for a successful first challenge from Spain are clearly in place , a question mark hangs over the afterguard of the boat .

source_bert_toks: although many of the main ingredients for a successful first challenge from spain are clearly in place , a question mark hangs over the after ##guard of the boat .

reference_raw: Although many of the main components of a successful first challenge from Spain are clearly present, the question mark hangs above the ship's rear guard.

reference_spacy_tokens: Although many of the main components of a successful first challenge from Spain are clearly present , the question mark hangs above the ship 's rear guard .


fn_spacy_tokens_for_baseline: Although fighting has moved beyond Jasenica , the clatter of machine - gun fire could still be heard as convoys of soldiers tested their weapons on farm animals grazing on the roadside .

source_bert_toks: although fighting has moved beyond jase ##nica , the cl ##atter of machine - gun fire could still be heard as convoys of soldiers tested their weapons on farm animals grazing on the roadside .

reference_raw: Though the fighting had moved beyond Jasenica, there was still the sound of machine gunfire as convoys of soldiers tested their weapons on farm animals grazing on the side of the road.

reference_spacy_tokens: Though the fighting had moved beyond Jasenica , there was still the sound of machine gunfire as convoys of soldiers tested their weapons on farm animals grazing on the side of the road .


fn_spacy_tokens_for_baseline: ' Why the hell did n't you bother to dry off the ponies ? '

source_bert_toks: ' why the hell didn ' t you bother to dry off the po ##nies ? '

reference_raw: "Why the hell didn't you bother drying up the ponies?"

reference_spacy_tokens: " Why the hell did n't you bother drying up the ponies ? "


fn_spacy_tokens_for_baseline: Isabel loved her great - grandmother 's garden , although she had never known that lady , who had expired bearing her lord a son , the present Baron 's father .

source_bert_toks: isabel loved her great - grandmother ' s garden , although she had never known that lady , who had expired bearing her lord a son , the present baron ' s father .

reference_raw: Isabel loved her great-great-grandmother's garden, though she had never known the woman who had passed away bearing her master the son of the current Baron's father.

reference_spacy_tokens: Isabel loved her great - great - grandmother 's garden , though she had never known the woman who had passed away bearing her master the son of the current Baron 's father .


fn_spacy_tokens_for_baseline: So why did she find it so difficult to ignore the mocking , taunting comments and treat them with the silent scorn they so richly deserved ?

source_bert_toks: so why did she find it so difficult to ignore the mocking , taunting comments and treat them with the silent sc ##orn they so richly deserved ?

reference_raw: Then why was it so hard for her to ignore the mocking, mocking remarks and treat them with the silent contempt they so well deserved?

reference_spacy_tokens: Then why was it so hard for her to ignore the mocking , mocking remarks and treat them with the silent contempt they so well deserved ?


fn_spacy_tokens_for_baseline: She had changed into a loose gauzy nightdress and released her hair so that it fell , witch - like , over her shoulders .

source_bert_toks: she had changed into a loose ga ##uz ##y night ##dre ##ss and released her hair so that it fell , witch - like , over her shoulders .

reference_raw: She changed into a loose, gauzy nightgown and let her hair fall, like a witch, over her shoulders.

reference_spacy_tokens: She changed into a loose , gauzy nightgown and let her hair fall , like a witch , over her shoulders .


fn_spacy_tokens_for_baseline: Libya admitted having secretly imported raw uranium and the necessary equipment to convert it for enrichment into weapons - grade material but added that the enrichment plan had been dismantled and that no highly enriched uranium had been produced over the past decade .

source_bert_toks: libya admitted having secretly imported raw uranium and the necessary equipment to convert it for enrichment into weapons - grade material but added that the enrichment plan had been dismantled and that no highly enriched uranium had been produced over the past decade .

reference_raw: Libya admits that it has secretly imported raw uranium and the necessary equipment to convert it into weapons-grade material, but adds that the enrichment plan has been dismantled and that no highly enriched uranium has been generated in the last decade.

reference_spacy_tokens: Libya admits that it has secretly imported raw uranium and the necessary equipment to convert it into weapons - grade material , but adds that the enrichment plan has been dismantled and that no highly enriched uranium has been generated in the last decade .


fn_spacy_tokens_for_baseline: From Victoria Peak , Hong Kong 's highest point , or from skyscrapers and hotels , they are especially exciting at night when the lights are on .

source_bert_toks: from victoria peak , hong kong ' s highest point , or from skyscraper ##s and hotels , they are especially exciting at night when the lights are on .

reference_raw: From Victoria Peak, the highest point in Hong Kong, or from skyscrapers and hotels, it's particularly exciting at night with the lights on.

reference_spacy_tokens: From Victoria Peak , the highest point in Hong Kong , or from skyscrapers and hotels , it 's particularly exciting at night with the lights on .


fn_spacy_tokens_for_baseline: I can thaw it out in the microwave . and I 've done a salad and jacket potatoes . "

source_bert_toks: i can tha ##w it out in the microwave . and i ' ve done a salad and jacket potatoes . "

reference_raw: I can melt it in a microwave... and make salad and coat potatoes.

reference_spacy_tokens: I can melt it in a microwave ... and make salad and coat potatoes .


fn_spacy_tokens_for_baseline: The factors which permit public bureaucracies to engage in politics are variable in their significance as between political systems .

source_bert_toks: the factors which permit public bureau ##cr ##acies to engage in politics are variable in their significance as between political systems .

reference_raw: The factors that allow public bureaucracy to engage in politics vary from one political system to another.

reference_spacy_tokens: The factors that allow public bureaucracy to engage in politics vary from one political system to another .


fn_spacy_tokens_for_baseline: He confided his second dream to me .

source_bert_toks: he con ##fide ##d his second dream to me .

reference_raw: He told me his second dream.

reference_spacy_tokens: He told me his second dream .


fn_spacy_tokens_for_baseline: Its discursive variety and complexity is one of the reasons why it imitates the social world with a verisimilitude unequalled by other literary forms .

source_bert_toks: its disc ##urs ##ive variety and complexity is one of the reasons why it im ##itate ##s the social world with a ve ##ris ##imi ##lit ##ude une ##qual ##led by other literary forms .

reference_raw: One of the reasons why it mimics the social world with a verisimility unequaled by other literary forms is its vague diversity and complexity.

reference_spacy_tokens: One of the reasons why it mimics the social world with a verisimility unequaled by other literary forms is its vague diversity and complexity .


fn_spacy_tokens_for_baseline: The awards will be presented at the House of Sport on October with each category winner receiving an engraved Wassail goblet donated by sponsors Tyrone Crystal .

source_bert_toks: the awards will be presented at the house of sport on october with each category winner receiving an engraved was ##sai ##l go ##ble ##t donated by sponsors tyrone crystal .

reference_raw: The awards will be presented in the House of Sports in October and each category winner will receive an engraved Wassail cup from sponsors Tyrone Crystal.

reference_spacy_tokens: The awards will be presented in the House of Sports in October and each category winner will receive an engraved Wassail cup from sponsors Tyrone Crystal .


fn_spacy_tokens_for_baseline: The Dorfwirt is a distinctive hotel with carved wooden balconies , and the peaceful atmosphere is totally in keeping with this relaxing resort .

source_bert_toks: the do ##rf ##wi ##rt is a distinctive hotel with carved wooden bal ##con ##ies , and the peaceful atmosphere is totally in keeping with this relaxing resort .

reference_raw: The Dorfwirt is a typical hotel with carved wooden balconies, and the peaceful atmosphere is perfectly compatible with this resting resort.

reference_spacy_tokens: The Dorfwirt is a typical hotel with carved wooden balconies , and the peaceful atmosphere is perfectly compatible with this resting resort .


fn_spacy_tokens_for_baseline: Starting with a spectacular seizure of thousands of leading brand products , the US Food and Drug Administration ( FDA ) has begun cracking down on misleading food labelling .

source_bert_toks: starting with a spectacular seizure of thousands of leading brand products , the us food and drug administration ( fda ) has begun cracking down on misleading food label ##ling .

reference_raw: The U.S. Food and Drug Administration (FDA) has started cracking down on misleading food labels, starting with a spectacular attack on thousands of leading brand products.

reference_spacy_tokens: The U.S. Food and Drug Administration ( FDA ) has started cracking down on misleading food labels , starting with a spectacular attack on thousands of leading brand products .


fn_spacy_tokens_for_baseline: The first frightening experience of a panic attack , coming ' out of the blue ' can , very often , also be their worst experience .

source_bert_toks: the first frightening experience of a panic attack , coming ' out of the blue ' can , very often , also be their worst experience .

reference_raw: The first terrifying experience of a panic attack that comes 'out of the blue' may very often also be their worst experience.

reference_spacy_tokens: The first terrifying experience of a panic attack that comes ' out of the blue ' may very often also be their worst experience .


fn_spacy_tokens_for_baseline: In the five years that followed , Iran concluded several contracts for the construction of nuclear plants and the supply of nuclear fuel : with the United States in 1974 ; Germany in 1976 ; and France in 1977 .

source_bert_toks: in the five years that followed , iran concluded several contracts for the construction of nuclear plants and the supply of nuclear fuel : with the united states in 1974 ; germany in 1976 ; and france in 1977 .

reference_raw: In the following five years, Iran entered into a number of contracts for the construction of nuclear power plants and the supply of nuclear fuel: with the United States in 1974; with Germany in 1976; and with France in 1977.

reference_spacy_tokens: In the following five years , Iran entered into a number of contracts for the construction of nuclear power plants and the supply of nuclear fuel : with the United States in 1974 ; with Germany in 1976 ; and with France in 1977 .


fn_spacy_tokens_for_baseline: The expected production of 3.6 million units of electricity annually would create much - needed income for the maintenance of the estate .

source_bert_toks: the expected production of 3 . 6 million units of electricity annually would create much - needed income for the maintenance of the estate .

reference_raw: The expected generation of 3,6 million units of electricity per year would generate much-needed revenue for the maintenance of the estate.

reference_spacy_tokens: The expected generation of 3,6 million units of electricity per year would generate much - needed revenue for the maintenance of the estate .


fn_spacy_tokens_for_baseline: Meditating regularly is probably the simplest way of expanding your consciousness , finding inner peace , and tuning into your higher guidance .

source_bert_toks: med ##itating regularly is probably the simplest way of expanding your consciousness , finding inner peace , and tuning into your higher guidance .

reference_raw: Regular meditation is probably the easiest way to expand your consciousness, find inner peace, and tune in to your higher leadership.

reference_spacy_tokens: Regular meditation is probably the easiest way to expand your consciousness , find inner peace , and tune in to your higher leadership .


fn_spacy_tokens_for_baseline: Defying Saudi Arabia 's ban on political demonstrations during the haj , Iranian pilgrims held a rally outside Mecca in which they denounced America for the catastrophes facing the Islamic world .

source_bert_toks: def ##ying saudi arabia ' s ban on political demonstrations during the ha ##j , iranian pilgrims held a rally outside mecca in which they denounced america for the catastrophe ##s facing the islamic world .

reference_raw: When Iranian pilgrims resisted Saudi Arabia's ban on political demonstrations during the Haj, they held a rally outside Mecca in which they condemned America for the disasters faced by the Islamic world.

reference_spacy_tokens: When Iranian pilgrims resisted Saudi Arabia 's ban on political demonstrations during the Haj , they held a rally outside Mecca in which they condemned America for the disasters faced by the Islamic world .


fn_spacy_tokens_for_baseline: Melissa recounted briefly the exchanges on the way to the belvedere and the altercation over the book .

source_bert_toks: melissa recounted briefly the exchanges on the way to the bel ##ved ##ere and the alter ##cation over the book .

reference_raw: Melissa gave a brief account of the exchanges on the way to the Belvedere and the argument over the book.

reference_spacy_tokens: Melissa gave a brief account of the exchanges on the way to the Belvedere and the argument over the book .


fn_spacy_tokens_for_baseline: It was here that Joe Carr demolished the American Bob Cochran for the last of his three victories in 1960 , and a warm welcome awaits Joe , an historic triumph .

source_bert_toks: it was here that joe carr demolished the american bob cochran for the last of his three victories in 1960 , and a warm welcome await ##s joe , an historic triumph .

reference_raw: This is where Joe Carr destroyed the American Bob Cochran for the last of his three victories in 1960, and a warm welcome awaits Joe, a historic triumph.

reference_spacy_tokens: This is where Joe Carr destroyed the American Bob Cochran for the last of his three victories in 1960 , and a warm welcome awaits Joe , a historic triumph .


fn_spacy_tokens_for_baseline: Both men no doubt were vexed by the unorthodoxy of their own birthplaces .

source_bert_toks: both men no doubt were ve ##xed by the uno ##rth ##od ##ox ##y of their own birthplace ##s .

reference_raw: There was no doubt that the two men had been poisoned by the unorthodoxy of their birthplaces.

reference_spacy_tokens: There was no doubt that the two men had been poisoned by the unorthodoxy of their birthplaces .


fn_spacy_tokens_for_baseline: Re - inflation is achieved by removing the air through an underwater seal drain ( chest drain ) .

source_bert_toks: re - inflation is achieved by removing the air through an underwater seal drain ( chest drain ) .

reference_raw: Reinflation is achieved by air removal by means of an underwater seal drain (chest drain).

reference_spacy_tokens: Reinflation is achieved by air removal by means of an underwater seal drain ( chest drain ) .


fn_spacy_tokens_for_baseline: A high court judge has halted the trial of two veteran peace campaigners accused of springing soviet spy George Blake from prison in 1966 .

source_bert_toks: a high court judge has halted the trial of two veteran peace campaign ##ers accused of spring ##ing soviet spy george blake from prison in 1966 .

reference_raw: The Supreme Court judge stopped the trial of two veteran peace campaigners charged with the springing of Soviet spy George Blake from prison in 1966.

reference_spacy_tokens: The Supreme Court judge stopped the trial of two veteran peace campaigners charged with the springing of Soviet spy George Blake from prison in 1966 .


fn_spacy_tokens_for_baseline: Additional pressures from arriving miners pushed the missionaries ' plight beyond recovery .

source_bert_toks: additional pressures from arriving miners pushed the missionaries ' plight beyond recovery .

reference_raw: The additional pressure from the coming miners pushed the missionaries out of recovery.

reference_spacy_tokens: The additional pressure from the coming miners pushed the missionaries out of recovery .


fn_spacy_tokens_for_baseline: She was clammy with sweat , and her arms and shoulders ached with tugging and heaving .

source_bert_toks: she was cl ##am ##my with sweat , and her arms and shoulders ached with tugging and heaving .

reference_raw: She was sweaty, her arms and shoulders aching with tugs and pulls.

reference_spacy_tokens: She was sweaty , her arms and shoulders aching with tugs and pulls .


fn_spacy_tokens_for_baseline: Up to 30 armed men had commandeered a bus and were driving it towards Zanderij airport near the Surinamese capital , Paramaribo , according to Mr Haakmat .

source_bert_toks: up to 30 armed men had command ##eer ##ed a bus and were driving it towards za ##nder ##ij airport near the suriname ##se capital , para ##mar ##ib ##o , according to mr ha ##ak ##mat .

reference_raw: According to Mr. Haakmat, up to thirty armed men commanded the bus and drove it to Zanderij Airport near the Surinamese capital, Paramaribo.

reference_spacy_tokens: According to Mr. Haakmat , up to thirty armed men commanded the bus and drove it to Zanderij Airport near the Surinamese capital , Paramaribo .


fn_spacy_tokens_for_baseline: As he recited familiar words , Jaq puzzled why he had really been detailed to be present on Stalinvast during its purge .

source_bert_toks: as he recited familiar words , ja ##q puzzled why he had really been detailed to be present on stalin ##vas ##t during its purge .

reference_raw: As Jaq recited the familiar words, he wondered why he had been in fact detailed about his presence on Stalinvast during his cleansing.

reference_spacy_tokens: As Jaq recited the familiar words , he wondered why he had been in fact detailed about his presence on Stalinvast during his cleansing .


fn_spacy_tokens_for_baseline: His neck looked thicker , as if he 'd put weight on , and the greasy blonde hair was a few inches longer .

source_bert_toks: his neck looked thicker , as if he ' d put weight on , and the greasy blonde hair was a few inches longer .

reference_raw: His neck was thicker, as if he had put on weight, and his greasy blond hair was a few inches longer.

reference_spacy_tokens: His neck was thicker , as if he had put on weight , and his greasy blond hair was a few inches longer .


fn_spacy_tokens_for_baseline: There is one particularly hilarious moment when three people meet in an alley and one tries to sell the other two a cervical smear in a bottle allegedly from the great Madonna herself .

source_bert_toks: there is one particularly hilarious moment when three people meet in an alley and one tries to sell the other two a cervical sm ##ear in a bottle allegedly from the great madonna herself .

reference_raw: There's one particularly funny moment when three people meet in an alley and one tries to sell the other two a cervical stain in a bottle supposedly from the great Madonna herself.

reference_spacy_tokens: There 's one particularly funny moment when three people meet in an alley and one tries to sell the other two a cervical stain in a bottle supposedly from the great Madonna herself .


fn_spacy_tokens_for_baseline: The most important of these are the Natanz uranium enrichment plant ( comprising a pilot - and commercial - scale fuel enrichment facility ) , a fuel fabrication plant at Esfahan , a uranium metal purification and casting laboratory , and a 40 MW heavy water research reactor ( IR - 40 ) in Arak .

source_bert_toks: the most important of these are the nat ##an ##z uranium enrichment plant ( comprising a pilot - and commercial - scale fuel enrichment facility ) , a fuel fabrication plant at es ##fahan , a uranium metal purification and casting laboratory , and a 40 mw heavy water research reactor ( ir - 40 ) in ara ##k .

reference_raw: The most important are the Natanz uranium enrichment facility (which consists of a pilot-and commercial-scale fuel enrichment facility), the Esfahan Fuel Factory, the uranium metal purification and casting laboratory, and the 40 MW heavy water research reactor (IR-40) in Arak.

reference_spacy_tokens: The most important are the Natanz uranium enrichment facility ( which consists of a pilot - and commercial - scale fuel enrichment facility ) , the Esfahan Fuel Factory , the uranium metal purification and casting laboratory , and the 40 MW heavy water research reactor ( IR-40 ) in Arak .


fn_spacy_tokens_for_baseline: Nevertheless , the presence of a gene in one nematode species ( such as Meloidogyne ) but its absence in another ( such as C. elegans ) might merely reflect a gene loss in the latter lineage .

source_bert_toks: nevertheless , the presence of a gene in one ne ##mat ##ode species ( such as mel ##oid ##ogy ##ne ) but its absence in another ( such as c . el ##egan ##s ) might merely reflect a gene loss in the latter lineage .

reference_raw: However, the presence of a gene in one nematode species (e.g. meloidogyne) but its lack in another (e.g. C. elegans) could only reflect the loss of genes in the second line.

reference_spacy_tokens: However , the presence of a gene in one nematode species ( e.g. meloidogyne ) but its lack in another ( e.g. C. elegans ) could only reflect the loss of genes in the second line .


fn_spacy_tokens_for_baseline: The efforts of probation and social services were praised , whilst lawyers were not exempted from charges of racial prejudice .

source_bert_toks: the efforts of probation and social services were praised , whilst lawyers were not exempt ##ed from charges of racial prejudice .

reference_raw: Efforts of probation and social services were commended, while lawyers were not exempt from charges of racial prejudice.

reference_spacy_tokens: Efforts of probation and social services were commended , while lawyers were not exempt from charges of racial prejudice .


fn_spacy_tokens_for_baseline: Those of you looking for adventure can shoot the rapids , Indiana Jones style , on the thrilling Congo River Rapids .

source_bert_toks: those of you looking for adventure can shoot the rapids , indiana jones style , on the thrilling congo river rapids .

reference_raw: Those of you who seek adventure can shoot fast Indiana Jones on the exciting Congo River Rapids.

reference_spacy_tokens: Those of you who seek adventure can shoot fast Indiana Jones on the exciting Congo River Rapids .


fn_spacy_tokens_for_baseline: Only one of the rockets detonated , sending smoke billowing into the lobby of the luxury hotel .

source_bert_toks: only one of the rockets detonated , sending smoke bill ##owing into the lobby of the luxury hotel .

reference_raw: Only one missile exploded and blew smoke into the lobby of the luxury hotel.

reference_spacy_tokens: Only one missile exploded and blew smoke into the lobby of the luxury hotel .


fn_spacy_tokens_for_baseline: Continue and take the first left after the flyover into Westminster Way .

source_bert_toks: continue and take the first left after the fly ##over into westminster way .

reference_raw: Go ahead and take the first left after the flight to Westminster Way.

reference_spacy_tokens: Go ahead and take the first left after the flight to Westminster Way .


fn_spacy_tokens_for_baseline: I threw a box of matches at him .

source_bert_toks: i threw a box of matches at him .

reference_raw: I threw a matchbox at him.

reference_spacy_tokens: I threw a matchbox at him .


fn_spacy_tokens_for_baseline: Lili could see Stan Valance arguing with Zimmer .

source_bert_toks: lil ##i could see stan val ##ance arguing with z ##im ##mer .

reference_raw: Lili saw Stan Valance fighting with Zimmer.

reference_spacy_tokens: Lili saw Stan Valance fighting with Zimmer .


fn_spacy_tokens_for_baseline: The report also suggests a range of options for saving Central Asia 's second major inland sea .

source_bert_toks: the report also suggests a range of options for saving central asia ' s second major inland sea .

reference_raw: The report also proposes a number of options to save the second main inland waterway in Central Asia.

reference_spacy_tokens: The report also proposes a number of options to save the second main inland waterway in Central Asia .


fn_spacy_tokens_for_baseline: The fellow 's smugness and unnecessary familiarity with Mala made me dislike him at once .

source_bert_toks: the fellow ' s smug ##ness and unnecessary familiarity with mala made me dislike him at once .

reference_raw: The man's smugness and unnecessarily familiarity with Mala made me hate him at once.

reference_spacy_tokens: The man 's smugness and unnecessarily familiarity with Mala made me hate him at once .


fn_spacy_tokens_for_baseline: Germany outstripped Britain for the first time as the largest contributor last year .

source_bert_toks: germany outs ##trip ##ped britain for the first time as the largest contributor last year .

reference_raw: Germany surpassed Britain for the first time last year as the biggest contributor.

reference_spacy_tokens: Germany surpassed Britain for the first time last year as the biggest contributor .


fn_spacy_tokens_for_baseline: At last I had avenged the ghost of my father .

source_bert_toks: at last i had avenge ##d the ghost of my father .

reference_raw: I finally got revenge for my father's ghost.

reference_spacy_tokens: I finally got revenge for my father 's ghost .


fn_spacy_tokens_for_baseline: In her first school she had been considered outstanding at maths , and had obtained six grade As in her nine O levels .

source_bert_toks: in her first school she had been considered outstanding at math ##s , and had obtained six grade as in her nine o levels .

reference_raw: In her first school, she was considered to be an excellent math teacher, and she got six grades like her nine O grades.

reference_spacy_tokens: In her first school , she was considered to be an excellent math teacher , and she got six grades like her nine O grades .


fn_spacy_tokens_for_baseline: Lough Neagh , Lough Erne and the sea inlets are popular for boating activities .

source_bert_toks: lough ne ##agh , lough er ##ne and the sea inlet ##s are popular for boating activities .

reference_raw: Lough Neagh, Lough Erne and the sea entrances are popular for shipping activities.

reference_spacy_tokens: Lough Neagh , Lough Erne and the sea entrances are popular for shipping activities .


fn_spacy_tokens_for_baseline: Every evening throughout 1922 a band of youths from the colony volunteered to guard the local stretch of the main road into Poltava .

source_bert_toks: every evening throughout 1922 a band of youths from the colony volunteered to guard the local stretch of the main road into pol ##ta ##va .

reference_raw: Every night in 1922, a group of young people from the colony volunteered to patrol the local section of the main road to Poltava.

reference_spacy_tokens: Every night in 1922 , a group of young people from the colony volunteered to patrol the local section of the main road to Poltava .


fn_spacy_tokens_for_baseline: The big news , though , was that Richard and Hudson had moved into their new flat .

source_bert_toks: the big news , though , was that richard and hudson had moved into their new flat .

reference_raw: But the big news was that Richard and Hudson had moved into their new apartment.

reference_spacy_tokens: But the big news was that Richard and Hudson had moved into their new apartment .


fn_spacy_tokens_for_baseline: Suddenly the sea was sparkling and the golf course a glittering green .

source_bert_toks: suddenly the sea was sparkling and the golf course a glittering green .

reference_raw: Suddenly the sea shimmered, and the golf course was glistening green.

reference_spacy_tokens: Suddenly the sea shimmered , and the golf course was glistening green .


fn_spacy_tokens_for_baseline: The owner of industrial tools worth thousands of pounds went bankrupt when he lost these tools of his trade .

source_bert_toks: the owner of industrial tools worth thousands of pounds went bankrupt when he lost these tools of his trade .

reference_raw: The owner of a thousand-pound industrial instrument failed when he lost the tools of his business.

reference_spacy_tokens: The owner of a thousand - pound industrial instrument failed when he lost the tools of his business .


fn_spacy_tokens_for_baseline: It was not until 1829 that Rafael Rivera , a Mexican scout , found a spring -fed valley and dubbed it Las Vegas -- a Spanish name that leaves many modern visitors wondering exactly where " the meadows " really lay .

source_bert_toks: it was not until 1829 that rafael rivera , a mexican scout , found a spring - fed valley and dubbed it las vegas - - a spanish name that leaves many modern visitors wondering exactly where " the meadows " really lay .

reference_raw: It wasn't until 1829 that Rafael Rivera, a Mexican explorer, found a spring-fed vale and called it Las Vegas-a Spanish name that left many modern visitors wondering exactly where "the meadows" were.

reference_spacy_tokens: It was n't until 1829 that Rafael Rivera , a Mexican explorer , found a spring - fed vale and called it Las Vegas - a Spanish name that left many modern visitors wondering exactly where " the meadows " were .


fn_spacy_tokens_for_baseline: The value of this announcement as a ' confidence - building ' measure is severely undermined by statements issued during Baker 's visit by hardline Housing Minister Ariel Sharon promising increased Jewish settlement in the occupied territories .

source_bert_toks: the value of this announcement as a ' confidence - building ' measure is severely undermine ##d by statements issued during baker ' s visit by hard ##line housing minister ariel sharon promising increased jewish settlement in the occupied territories .

reference_raw: The value of this announcement as a confidence-building measure is seriously compromised by statements made during Baker's visit by hardline housing minister Ariel Sharon promising to increase Jewish settlement in the occupied territories.

reference_spacy_tokens: The value of this announcement as a confidence - building measure is seriously compromised by statements made during Baker 's visit by hardline housing minister Ariel Sharon promising to increase Jewish settlement in the occupied territories .


fn_spacy_tokens_for_baseline: Athens water supplies ' at all - time low '

source_bert_toks: athens water supplies ' at all - time low '

reference_raw: Athens's water supply is always down.'

reference_spacy_tokens: Athens 's water supply is always down . '


fn_spacy_tokens_for_baseline: The bear was in front of this woman and half - squatting , its paws raised , in the attitude of a begging dog .

source_bert_toks: the bear was in front of this woman and half - squat ##ting , its paws raised , in the attitude of a begging dog .

reference_raw: The bear stood before the woman, half-squatting, paws raised, like a begging dog.

reference_spacy_tokens: The bear stood before the woman , half - squatting , paws raised , like a begging dog .


fn_spacy_tokens_for_baseline: The young IBM salesman ( he works for IBM , not the store , although his name badge does not say so ) is more forthcoming on Amstrad .

source_bert_toks: the young ibm salesman ( he works for ibm , not the store , although his name badge does not say so ) is more forthcoming on am ##stra ##d .

reference_raw: A young IBM salesman (works for IBM, not a shop, even if his name tag doesn't say so) is more forthcoming on Amstrad.

reference_spacy_tokens: A young IBM salesman ( works for IBM , not a shop , even if his name tag does n't say so ) is more forthcoming on Amstrad .


fn_spacy_tokens_for_baseline: The expectation that God would reward the righteous in this world ran parallel to the less attractive expectation that He would punish the unrighteous .

source_bert_toks: the expectation that god would reward the righteous in this world ran parallel to the less attractive expectation that he would punish the un ##right ##eous .

reference_raw: The expectation that God would repay the righteous in this world coincided with the less attractive expectation that he would punish the unjust.

reference_spacy_tokens: The expectation that God would repay the righteous in this world coincided with the less attractive expectation that he would punish the unjust .


fn_spacy_tokens_for_baseline: By the end of the 13th century , they began their first raids on the Aegean Islands .

source_bert_toks: by the end of the 13th century , they began their first raids on the aegean islands .

reference_raw: By the end of the 13th century, the Aegean Islands were first invaded.

reference_spacy_tokens: By the end of the 13th century , the Aegean Islands were first invaded .


fn_spacy_tokens_for_baseline: George 's freedom had disappeared when Lennie 's Aunt Clara had died .

source_bert_toks: george ' s freedom had disappeared when len ##nie ' s aunt clara had died .

reference_raw: When Lennie's aunt Clara died, George's freedom vanished.

reference_spacy_tokens: When Lennie 's aunt Clara died , George 's freedom vanished .


fn_spacy_tokens_for_baseline: The Chicheley - Smythes have bought an absolutely super villa in Sardinia and say we could rent it if we 'd like to .

source_bert_toks: the chi ##chel ##ey - smyth ##es have bought an absolutely super villa in sardinia and say we could rent it if we ' d like to .

reference_raw: The Chicheley-Smythes bought a super villa in Sardinia and said we could borrow it if we wanted.

reference_spacy_tokens: The Chicheley - Smythes bought a super villa in Sardinia and said we could borrow it if we wanted .


fn_spacy_tokens_for_baseline: Take the obvious path at the rear of the churchyard and follow it down until you reach the valley road .

source_bert_toks: take the obvious path at the rear of the churchyard and follow it down until you reach the valley road .

reference_raw: Take the clear path at the back of the churchyard and follow it until you reach the valley road.

reference_spacy_tokens: Take the clear path at the back of the churchyard and follow it until you reach the valley road .


fn_spacy_tokens_for_baseline: Maybe they left by the tunnel he was on about . well , maybe Brett coulda gotten out that way too . "

source_bert_toks: maybe they left by the tunnel he was on about . well , maybe brett could ##a gotten out that way too . "

reference_raw: Maybe they'd gone down the tunnel he'd been in about . . . well, maybe Brett would have gotten out that way, too.'

reference_spacy_tokens: Maybe they 'd gone down the tunnel he 'd been in about . . . well , maybe Brett would have gotten out that way , too . '


fn_spacy_tokens_for_baseline: She hobbled to the window and looked down .

source_bert_toks: she ho ##bbled to the window and looked down .

reference_raw: She limped to the window and looked down.

reference_spacy_tokens: She limped to the window and looked down .


fn_spacy_tokens_for_baseline: A man in the long robe of a clerk or scribe bent over the injured baron .

source_bert_toks: a man in the long robe of a clerk or scribe bent over the injured baron .

reference_raw: A man in the long robes of a clerk or a scribe leaned over the wounded Baron.

reference_spacy_tokens: A man in the long robes of a clerk or a scribe leaned over the wounded Baron .


fn_spacy_tokens_for_baseline: When he was about 12 he managed to acquire a pair of roller - skates .

source_bert_toks: when he was about 12 he managed to acquire a pair of roller - skate ##s .

reference_raw: When he was about 12, he managed to get two roller skates.

reference_spacy_tokens: When he was about 12 , he managed to get two roller skates .


fn_spacy_tokens_for_baseline: EARLY yesterday morning , the increasingly squalid West German embassy in Prague finally disgorged its cargo of more than 4,000 dirty , dazed and exhausted East German emigrants .

source_bert_toks: early yesterday morning , the increasingly sq ##ual ##id west german embassy in prague finally di ##sg ##org ##ed its cargo of more than 4 , 000 dirty , dazed and exhausted east german emi ##grants .

reference_raw: Early yesterday morning, the increasingly squalid West German embassy in Prague finally unloaded over 4,000 dirty, dazed, and exhausted East German immigrants.

reference_spacy_tokens: Early yesterday morning , the increasingly squalid West German embassy in Prague finally unloaded over 4,000 dirty , dazed , and exhausted East German immigrants .


fn_spacy_tokens_for_baseline: No manager can depend solely on information generated internally in the organization ; external information , often unpredictable in occurrence or impact , is critical .

source_bert_toks: no manager can depend solely on information generated internally in the organization ; external information , often unpredictable in occurrence or impact , is critical .

reference_raw: No manager may rely solely on information generated internally by the organisation; external information, often unpredictable in occurrence or impact, is critical.

reference_spacy_tokens: No manager may rely solely on information generated internally by the organisation ; external information , often unpredictable in occurrence or impact , is critical .


fn_spacy_tokens_for_baseline: This is just to permit shedding a few initial pounds to provide motivation and hope , along with the feeling that one is able to achieve success .

source_bert_toks: this is just to permit shed ##ding a few initial pounds to provide motivation and hope , along with the feeling that one is able to achieve success .

reference_raw: It is only to allow the shedding of a few initial pounds to provide motivation and hope, together with the feeling that one can succeed.

reference_spacy_tokens: It is only to allow the shedding of a few initial pounds to provide motivation and hope , together with the feeling that one can succeed .


fn_spacy_tokens_for_baseline: He mainly collected Italian and Flemish paintings of the 16 and 17C and it appears that some of the paintings were bought from the Kunstkammer of Emperor Rudolf II .

source_bert_toks: he mainly collected italian and flemish paintings of the 16 and 17 ##c and it appears that some of the paintings were bought from the kunst ##kam ##mer of emperor rudolf ii .

reference_raw: He collected mainly Italian and Flemish images from 16C and 17C, and it appears that some of them were purchased from Emperor Rudolf II's Kunstkammer.

reference_spacy_tokens: He collected mainly Italian and Flemish images from 16C and 17C , and it appears that some of them were purchased from Emperor Rudolf II 's Kunstkammer .


fn_spacy_tokens_for_baseline: Some wore breastplates , greaves and other pieces of armour , all carried swords and daggers , with shields slung round their necks .

source_bert_toks: some wore breast ##plate ##s , greaves and other pieces of armour , all carried swords and daggers , with shields slung round their necks .

reference_raw: Some wore breastplates, graves, and other armour, all carried swords and daggers, shields slung around their necks.

reference_spacy_tokens: Some wore breastplates , graves , and other armour , all carried swords and daggers , shields slung around their necks .