fn_spacy_tokens_for_baseline: They are the weapons of the weak against the might of the strong .

source_bert_toks: they are the weapons of the weak against the might of the strong .

reference_raw: They are the weapons of the weak against the power of the strong.

reference_spacy_tokens: They are the weapons of the weak against the power of the strong .


fn_spacy_tokens_for_baseline: Eventually Friedmaier is captured by the occupying forces , tortured and killed , but not before his silent suffering has earned him redemption .

source_bert_toks: eventually fried ##ma ##ier is captured by the occupying forces , tortured and killed , but not before his silent suffering has earned him redemption .

reference_raw: In the end, Friedmaier was taken by the occupying forces, tortured and killed, but not before his silent suffering earned his salvation.

reference_spacy_tokens: In the end , Friedmaier was taken by the occupying forces , tortured and killed , but not before his silent suffering earned his salvation .


fn_spacy_tokens_for_baseline: She said a third man being sought by the police had telephoned a Kirkby inspector and said he was sure the case would end because witnesses were not brave enough to give evidence .

source_bert_toks: she said a third man being sought by the police had telephone ##d a kirk ##by inspector and said he was sure the case would end because witnesses were not brave enough to give evidence .

reference_raw: She said that the third man the police were looking for had called the Kirkby inspector and said that he was certain that the case would end because the witnesses weren't brave enough to testify.

reference_spacy_tokens: She said that the third man the police were looking for had called the Kirkby inspector and said that he was certain that the case would end because the witnesses were n't brave enough to testify .


fn_spacy_tokens_for_baseline: There were no pavements in the little village of Samana , four or five miles from the complex , and chickens and goats wandered idly along the dirt roads , scavenging for scraps .

source_bert_toks: there were no pavement ##s in the little village of sam ##ana , four or five miles from the complex , and chickens and goats wandered id ##ly along the dirt roads , sc ##ave ##nging for scrap ##s .

reference_raw: There were no sidewalks in the small village of Samana, four or five miles from the complex, and chickens and goats wandered idly along the dirt roads, searching for scraps.

reference_spacy_tokens: There were no sidewalks in the small village of Samana , four or five miles from the complex , and chickens and goats wandered idly along the dirt roads , searching for scraps .


fn_spacy_tokens_for_baseline: Once she had seen Harry again , she would know if she 'd only imagined that special magic between them .

source_bert_toks: once she had seen harry again , she would know if she ' d only imagined that special magic between them .

reference_raw: When she saw Harry again, she would know if she could only imagine the strange spell between them.

reference_spacy_tokens: When she saw Harry again , she would know if she could only imagine the strange spell between them .


fn_spacy_tokens_for_baseline: Second , if the key assumption is valid , Democrats should have lower attendance rates on roll - call votes than Republicans do to the extent that such votes reflect national policy making and that participating in such votes takes away from the time a legislator could otherwise devote to local benefit - seeking .

source_bert_toks: second , if the key assumption is valid , democrats should have lower attendance rates on roll - call votes than republicans do to the extent that such votes reflect national policy making and that participating in such votes takes away from the time a legislator could otherwise devote to local benefit - seeking .

reference_raw: Secondly, if the key assumption is valid, Democrats should have a lower rate of participation in roll-call votes than the Republicans do, to the extent that such votes reflect national policy-making and that participation in such votes is taken away from the time when the legislature would otherwise have been able to devote itself to local benefit-seeking.

reference_spacy_tokens: Secondly , if the key assumption is valid , Democrats should have a lower rate of participation in roll - call votes than the Republicans do , to the extent that such votes reflect national policy - making and that participation in such votes is taken away from the time when the legislature would otherwise have been able to devote itself to local benefit - seeking .


fn_spacy_tokens_for_baseline: On the other hand , the electromagnetic and weak forces , which are not asymptotically free , get stronger at high energies .

source_bert_toks: on the other hand , the electromagnetic and weak forces , which are not as ##ym ##pt ##otic ##ally free , get stronger at high energies .

reference_raw: Electromagnetic and weak forces, on the other hand, that are not asymptotically free, grow stronger with high energy.

reference_spacy_tokens: Electromagnetic and weak forces , on the other hand , that are not asymptotically free , grow stronger with high energy .


fn_spacy_tokens_for_baseline: As she slopped about in the cooling water , Jess pondered over this peculiarity .

source_bert_toks: as she sl ##opped about in the cooling water , jess pondered over this peculiar ##ity .

reference_raw: Jess thought about this strangeness as she swerved around in the cooling water.

reference_spacy_tokens: Jess thought about this strangeness as she swerved around in the cooling water .


fn_spacy_tokens_for_baseline: She wanted to be noticed in all her finery and as she walked up the aisle she kept stopping to give a little cough on the back of her hand and looking from side to side .

source_bert_toks: she wanted to be noticed in all her finer ##y and as she walked up the aisle she kept stopping to give a little cough on the back of her hand and looking from side to side .

reference_raw: She wanted to be noticed in all the goodness, and as she walked down the aisle, she stopped to cough at the back of her hand and looked from side to side.

reference_spacy_tokens: She wanted to be noticed in all the goodness , and as she walked down the aisle , she stopped to cough at the back of her hand and looked from side to side .


fn_spacy_tokens_for_baseline: Uh , and if they see adults doing some other things they we , accuse them for , uh , they figure that this is cool .

source_bert_toks: uh , and if they see adults doing some other things they we , accuse them for , uh , they figure that this is cool .

reference_raw: Uh, and if they see grown-ups doing other things, they're gonna blame them for, uh, they think it's okay.

reference_spacy_tokens: Uh , and if they see grown - ups doing other things , they 're gon na blame them for , uh , they think it 's okay .


fn_spacy_tokens_for_baseline: Behind Grenadier Guards and lines of marching constables , coaches carried the sheriffs and other officials , their horses decked with black ribbons .

source_bert_toks: behind gr ##ena ##dier guards and lines of marching constable ##s , coaches carried the sheriff ##s and other officials , their horses deck ##ed with black ribbons .

reference_raw: Behind the Grenadier Guards and the ranks of the marching constables, the coaches carried the sheriffs and other clerks, their horses wrapped in black ribbons.

reference_spacy_tokens: Behind the Grenadier Guards and the ranks of the marching constables , the coaches carried the sheriffs and other clerks , their horses wrapped in black ribbons .


fn_spacy_tokens_for_baseline: Water is then fed into the hopper and the dilute liquid fed into the sprayer .

source_bert_toks: water is then fed into the hopper and the dil ##ute liquid fed into the spray ##er .

reference_raw: The water is then fed into the bottle and the diluted liquid is fed into the sprayer.

reference_spacy_tokens: The water is then fed into the bottle and the diluted liquid is fed into the sprayer .


fn_spacy_tokens_for_baseline: On September 11 , 2001 , nineteen Al Qa'ida terrorists hijacked four commercial aircraft and flew three of them into the World Trade Center and the Pentagon ; the fourth crashed into a field in Shanksville , Pennsylvania .

source_bert_toks: on september 11 , 2001 , nineteen al q ##a ' ida terrorists hi ##jack ##ed four commercial aircraft and flew three of them into the world trade center and the pentagon ; the fourth crashed into a field in shan ##ks ##ville , pennsylvania .

reference_raw: On September 11, 2001, 19 Al Qa'ida terrorists hijacked four commercial planes and flew three of them to the World Trade Center and the Pentagon; the fourth hit a field in Shanksville, Pennsylvania.

reference_spacy_tokens: On September 11 , 2001 , 19 Al Qa'ida terrorists hijacked four commercial planes and flew three of them to the World Trade Center and the Pentagon ; the fourth hit a field in Shanksville , Pennsylvania .


fn_spacy_tokens_for_baseline: The aim of the group , it was claimed , was to organize ' an armed uprising to topple the free democratic system and the capitalist economy ' .

source_bert_toks: the aim of the group , it was claimed , was to organize ' an armed uprising to top ##ple the free democratic system and the capitalist economy ' .

reference_raw: It was said that the group's goal was to organize an armed rebellion to overthrow a free democratic system and a capitalist economy.

reference_spacy_tokens: It was said that the group 's goal was to organize an armed rebellion to overthrow a free democratic system and a capitalist economy .


fn_spacy_tokens_for_baseline: Macau 's own cuisine is a combination of Chinese flavors with the flavors imported from Portugal , Brazil , and Africa .

source_bert_toks: macau ' s own cuisine is a combination of chinese flavors with the flavors imported from portugal , brazil , and africa .

reference_raw: Macau's own kitchen combines China's flavours with those imported from Portugal, Brazil, and Africa.

reference_spacy_tokens: Macau 's own kitchen combines China 's flavours with those imported from Portugal , Brazil , and Africa .


fn_spacy_tokens_for_baseline: It troubled Eline how nearly she had betrayed all her instincts and gone to Will 's bed , it was foolishness , she saw that now , no good could come of being unfaithful to her marriage vows .

source_bert_toks: it troubled eli ##ne how nearly she had betrayed all her instincts and gone to will ' s bed , it was foolish ##ness , she saw that now , no good could come of being un ##fa ##ith ##ful to her marriage vows .

reference_raw: It bothered Eline that she had almost betrayed all her instincts and gone to Will's bed, that was foolish; she could see that now there was no good in being unfaithful to her promises of marriage.

reference_spacy_tokens: It bothered Eline that she had almost betrayed all her instincts and gone to Will 's bed , that was foolish ; she could see that now there was no good in being unfaithful to her promises of marriage .


fn_spacy_tokens_for_baseline: His solicitor , David Watson , applied for a two week adjournment and Hodkinson was remanded on unconditional bail until June 29 .

source_bert_toks: his solicitor , david watson , applied for a two week ad ##jou ##rn ##ment and ho ##d ##kins ##on was re ##man ##ded on un ##con ##ditional bail until june 29 .

reference_raw: His lawyer, David Watson, requested a two-week adjournment, and Hodkinson was released on unconditional parole until June 29th.

reference_spacy_tokens: His lawyer , David Watson , requested a two - week adjournment , and Hodkinson was released on unconditional parole until June 29th .


fn_spacy_tokens_for_baseline: Whole cities have been created in the New Territories , although the unimaginative architecture of these towns has been criticized .

source_bert_toks: whole cities have been created in the new territories , although the un ##ima ##gina ##tive architecture of these towns has been criticized .

reference_raw: All cities were built in the new territories, but the unimaginative architecture of these cities was criticized.

reference_spacy_tokens: All cities were built in the new territories , but the unimaginative architecture of these cities was criticized .


fn_spacy_tokens_for_baseline: Maintenance and expansion of Sino - Iranian relations naturally constitutes an important component of Chinese strategy in extending its influence to the region .

source_bert_toks: maintenance and expansion of sino - iranian relations naturally constitutes an important component of chinese strategy in extending its influence to the region .

reference_raw: Maintaining and expanding Sino-Iran relations is, of course, an important part of China's strategy in extending its influence to the region.

reference_spacy_tokens: Maintaining and expanding Sino - Iran relations is , of course , an important part of China 's strategy in extending its influence to the region .


fn_spacy_tokens_for_baseline: While walking the Pennine Way I cooled my feet in the beck before continuing south to Airton and Gargrave .

source_bert_toks: while walking the penn ##ine way i cooled my feet in the beck before continuing south to air ##ton and ga ##rg ##rave .

reference_raw: I chilled my feet on the beck as I walked down the Pennine Road, then continued south toward Airton and Gargrave.

reference_spacy_tokens: I chilled my feet on the beck as I walked down the Pennine Road , then continued south toward Airton and Gargrave .


fn_spacy_tokens_for_baseline: Each of these , in turn , holds a Skeleton , with its arms manacled to the floor .

source_bert_toks: each of these , in turn , holds a skeleton , with its arms mana ##cle ##d to the floor .

reference_raw: Each of them, on the other hand, is holding a skeleton, hands clasped to the floor.

reference_spacy_tokens: Each of them , on the other hand , is holding a skeleton , hands clasped to the floor .


fn_spacy_tokens_for_baseline: The terrifying flame - throwers had now largely become suicide weapons , an immediate target the moment they appeared in the open .

source_bert_toks: the terrifying flame - throw ##ers had now largely become suicide weapons , an immediate target the moment they appeared in the open .

reference_raw: The frightful fire-throwers were now mostly suicide weapons, an immediate target the moment they appeared in the open.

reference_spacy_tokens: The frightful fire - throwers were now mostly suicide weapons , an immediate target the moment they appeared in the open .


fn_spacy_tokens_for_baseline: The Kadafi and Ibrahim families are part of the same small tribe , which has enjoyed considerable privileges during Kadafi 's 42-year reign .

source_bert_toks: the ka ##da ##fi and ibrahim families are part of the same small tribe , which has enjoyed considerable privileges during ka ##da ##fi ' s 42 - year reign .

reference_raw: The Kadafi and Ibrahim families belong to the same small tribe that enjoyed considerable privileges during Kadafi's 42-year reign.

reference_spacy_tokens: The Kadafi and Ibrahim families belong to the same small tribe that enjoyed considerable privileges during Kadafi 's 42-year reign .


fn_spacy_tokens_for_baseline: MG Rover is on the brink of collapse after Britain refused to provide $ 100 million in emergency funding and component suppliers withdrew their support , forcing the car - maker to halt production .

source_bert_toks: mg rover is on the brink of collapse after britain refused to provide $ 100 million in emergency funding and component suppliers withdrew their support , forcing the car - maker to halt production .

reference_raw: MG Rover is on the verge of collapse when Britain refuses to provide $100 million in emergency financing, and parts suppliers withdraw their support, forcing the car manufacturer to stop production.

reference_spacy_tokens: MG Rover is on the verge of collapse when Britain refuses to provide $ 100 million in emergency financing , and parts suppliers withdraw their support , forcing the car manufacturer to stop production .


fn_spacy_tokens_for_baseline: A three - inch ribbon of snow , sideways up , is balanced on the telephone wires until , now and then , a bird lets on them , and ten or twenty yards fall like droppings into the street .

source_bert_toks: a three - inch ribbon of snow , sideways up , is balanced on the telephone wires until , now and then , a bird lets on them , and ten or twenty yards fall like dropping ##s into the street .

reference_raw: A three-inch strip of snow, side by side, is balanced on the telephone wires until a bird occasionally lets it down, and ten or twenty yards fall like a drop in the street.

reference_spacy_tokens: A three - inch strip of snow , side by side , is balanced on the telephone wires until a bird occasionally lets it down , and ten or twenty yards fall like a drop in the street .


fn_spacy_tokens_for_baseline: Alison Harrington was blunt and outspoken , but she was only articulating what would , when the news was bruited abroad , be a tacit consensus .

source_bert_toks: alison harrington was blunt and outspoken , but she was only art ##ic ##ulating what would , when the news was br ##uit ##ed abroad , be a ta ##cit consensus .

reference_raw: Alison Harrington was rude and open-minded, but she was merely expressing what would have been a tacit consensus if the news had been brutished abroad.

reference_spacy_tokens: Alison Harrington was rude and open - minded , but she was merely expressing what would have been a tacit consensus if the news had been brutished abroad .


fn_spacy_tokens_for_baseline: The maid took the plate from her mistress as if it were hot .

source_bert_toks: the maid took the plate from her mistress as if it were hot .

reference_raw: The maid snatched the plate from her lover like it was hot.

reference_spacy_tokens: The maid snatched the plate from her lover like it was hot .


fn_spacy_tokens_for_baseline: This will guard the installation against the risk of an electrical fire caused by current leaking to earth , and will cut off the power in the event of anyone touching something live when they should n't .

source_bert_toks: this will guard the installation against the risk of an electrical fire caused by current leaking to earth , and will cut off the power in the event of anyone touching something live when they shouldn ' t .

reference_raw: This will protect the installation from the risk of electrical fire caused by the current leaking to the ground, and it will shut down the power in case someone touches something alive when it should not.

reference_spacy_tokens: This will protect the installation from the risk of electrical fire caused by the current leaking to the ground , and it will shut down the power in case someone touches something alive when it should not .


fn_spacy_tokens_for_baseline: On top of a hill in the center of the city , it 's approached by a grand staircase .

source_bert_toks: on top of a hill in the center of the city , it ' s approached by a grand staircase .

reference_raw: At the top of a mountain in the middle of the city, a large staircase approaches.

reference_spacy_tokens: At the top of a mountain in the middle of the city , a large staircase approaches .


fn_spacy_tokens_for_baseline: On 23 June 1996 , the Sunday Telegraph reported about a " secret multi - million - pound deal with the Indian government which will supply banned materials used to manufacture poison gas . "

source_bert_toks: on 23 june 1996 , the sunday telegraph reported about a " secret multi - million - pound deal with the indian government which will supply banned materials used to manufacture poison gas . "

reference_raw: On 23 June 1996, the Sunday Telegraph announced a "secret multi-million-pound deal with the Government of India to supply prohibited materials used for the production of toxic gas."

reference_spacy_tokens: On 23 June 1996 , the Sunday Telegraph announced a " secret multi - million - pound deal with the Government of India to supply prohibited materials used for the production of toxic gas . "


fn_spacy_tokens_for_baseline: While several Iranian leaders felt that developing a CW program would counteract the Iraqi threat and prove to be a strong deterrent , others within the clerical Islamic regime publicly condemned any use of chemicals on moral grounds , calling them un - Islamic .

source_bert_toks: while several iranian leaders felt that developing a cw program would counter ##act the iraqi threat and prove to be a strong deter ##rent , others within the clerical islamic regime publicly condemned any use of chemicals on moral grounds , calling them un - islamic .

reference_raw: While some Iranian leaders felt that the development of a CW program would counter the Iraqi threat and prove a strong deterrent, others in the clerical Islamic regime publicly condemned any use of chemicals for moral reasons and called them un-Islamic.

reference_spacy_tokens: While some Iranian leaders felt that the development of a CW program would counter the Iraqi threat and prove a strong deterrent , others in the clerical Islamic regime publicly condemned any use of chemicals for moral reasons and called them un - Islamic .


fn_spacy_tokens_for_baseline: " What are you suggesting ?

source_bert_toks: " what are you suggesting ?

reference_raw: "What do you mean by that?"

reference_spacy_tokens: " What do you mean by that ? "


fn_spacy_tokens_for_baseline: This centre , contracted out to Queen Elizabeth 's Foundation for Disabled People by Kent SSD , can offer considerable advantages to any physically disabled person .

source_bert_toks: this centre , contracted out to queen elizabeth ' s foundation for disabled people by kent ss ##d , can offer considerable advantages to any physically disabled person .

reference_raw: This center, contracted by Kent SSD to the Queen Elizabeth Foundation for Disabilities, can offer significant benefits to anyone with disabilities.

reference_spacy_tokens: This center , contracted by Kent SSD to the Queen Elizabeth Foundation for Disabilities , can offer significant benefits to anyone with disabilities .


fn_spacy_tokens_for_baseline: Like Mr Lyle at St Genevieve , Lord Valentine clearly wishes the people ' constantly and visibly to comprehend that Property is their protector and their friend ' .

source_bert_toks: like mr lyle at st genevieve , lord valentine clearly wishes the people ' constantly and visibly to comprehend that property is their protector and their friend ' .

reference_raw: Like Mr. Lyle at St. Genevieve, Lord Valentine clearly wishes people to "continuously and visibly understand that Property is their protector and friend."

reference_spacy_tokens: Like Mr. Lyle at St. Genevieve , Lord Valentine clearly wishes people to " continuously and visibly understand that Property is their protector and friend . "


fn_spacy_tokens_for_baseline: Mr Perl denied making the remarks but the tribunal found against him .

source_bert_toks: mr per ##l denied making the remarks but the tribunal found against him .

reference_raw: Mr. Perl refused to make a comment, but the court held it against him.

reference_spacy_tokens: Mr. Perl refused to make a comment , but the court held it against him .


fn_spacy_tokens_for_baseline: A final warning ought not to be worded vaguely .

source_bert_toks: a final warning ought not to be word ##ed vaguely .

reference_raw: The last warning should not be indistinctly formulated.

reference_spacy_tokens: The last warning should not be indistinctly formulated .


fn_spacy_tokens_for_baseline: ' We will go back to the note which was handed in to Garcia upon the evening of his death .

source_bert_toks: ' we will go back to the note which was handed in to garcia upon the evening of his death .

reference_raw: Let's go back to the note that was given to Garcia the night he died.

reference_spacy_tokens: Let 's go back to the note that was given to Garcia the night he died .


fn_spacy_tokens_for_baseline: Mr Foxon himself was attacked with a crowbar at the same site just last week and the firm has had to double its guard at the retail park .

source_bert_toks: mr fox ##on himself was attacked with a crow ##bar at the same site just last week and the firm has had to double its guard at the retail park .

reference_raw: Last week, Mr. Foxon himself was assaulted by a crowbar in the same place, and the company had to double its guard in a retail park.

reference_spacy_tokens: Last week , Mr. Foxon himself was assaulted by a crowbar in the same place , and the company had to double its guard in a retail park .


fn_spacy_tokens_for_baseline: I have very great pleasure in introducing our lecturer , my friend and colleague Professor Learner , who is professor of English in this university .

source_bert_toks: i have very great pleasure in introducing our lecturer , my friend and colleague professor learn ##er , who is professor of english in this university .

reference_raw: It is my great pleasure to introduce to you our teacher, my friend and colleague, Professor Learner, who is a professor of English at this university.

reference_spacy_tokens: It is my great pleasure to introduce to you our teacher , my friend and colleague , Professor Learner , who is a professor of English at this university .


fn_spacy_tokens_for_baseline: The NATO force said it was looking into allegations of an unspecified number of civilian casualties caused by its troops Thursday during an ' air - to - ground engagement ' in Kapisa province , northeast of the capital , Kabul .

source_bert_toks: the nato force said it was looking into allegations of an unspecified number of civilian casualties caused by its troops thursday during an ' air - to - ground engagement ' in ka ##pis ##a province , northeast of the capital , kabul .

reference_raw: NATO said they were investigating allegations of unspecified civilian casualties caused by their troops on Thursdays and air-to-ground attacks in Kapisa Province, northeast of the capital city of Kabul.

reference_spacy_tokens: NATO said they were investigating allegations of unspecified civilian casualties caused by their troops on Thursdays and air - to - ground attacks in Kapisa Province , northeast of the capital city of Kabul .


fn_spacy_tokens_for_baseline: A little white cutter with red sails was coming in towards the moored boats .

source_bert_toks: a little white cutter with red sails was coming in towards the moore ##d boats .

reference_raw: A small white cutter with red sails approached the docked boats.

reference_spacy_tokens: A small white cutter with red sails approached the docked boats .


fn_spacy_tokens_for_baseline: People rationalize by saying there will be a time to catch up with important relationships ( spouses , children , friends ) later .

source_bert_toks: people rational ##ize by saying there will be a time to catch up with important relationships ( spouse ##s , children , friends ) later .

reference_raw: People rationalise by saying that important relationships (spouses, children, friends) will come to an end later.

reference_spacy_tokens: People rationalise by saying that important relationships ( spouses , children , friends ) will come to an end later .


fn_spacy_tokens_for_baseline: It was dead from shock before Creggan had started a single beat of his wings to rise again over the lake .

source_bert_toks: it was dead from shock before cr ##eg ##gan had started a single beat of his wings to rise again over the lake .

reference_raw: He died of shock before Creggan began to lift his wings once more over the lake.

reference_spacy_tokens: He died of shock before Creggan began to lift his wings once more over the lake .


fn_spacy_tokens_for_baseline: There is no quick fix to defeat terrorism in Northern Ireland .

source_bert_toks: there is no quick fix to defeat terrorism in northern ireland .

reference_raw: In Northern Ireland, there is no rapid fix for the defeat of terrorists.

reference_spacy_tokens: In Northern Ireland , there is no rapid fix for the defeat of terrorists .


fn_spacy_tokens_for_baseline: Disconnection studies in split - brain patients supported this conclusion , showing that the left hemisphere is sufficient for language .

source_bert_toks: disco ##nne ##ction studies in split - brain patients supported this conclusion , showing that the left hemisphere is sufficient for language .

reference_raw: Disconnection studies in patients with split brain support this conclusion and show that the left hemisphere is adequate for the language.

reference_spacy_tokens: Disconnection studies in patients with split brain support this conclusion and show that the left hemisphere is adequate for the language .


fn_spacy_tokens_for_baseline: He rushed inside without saying anything , slamming the door behind him .

source_bert_toks: he rushed inside without saying anything , slamming the door behind him .

reference_raw: Without saying anything, he hurried in and slammed the door behind him.

reference_spacy_tokens: Without saying anything , he hurried in and slammed the door behind him .


fn_spacy_tokens_for_baseline: This was decided at the two - day meeting of the India - US Joint Working Group on Counterterrorim , which ended today .

source_bert_toks: this was decided at the two - day meeting of the india - us joint working group on counter ##ter ##ror ##im , which ended today .

reference_raw: This was decided at the two-day meeting of the Indian Joint Working Party on Counterterrorism, which ended today.

reference_spacy_tokens: This was decided at the two - day meeting of the Indian Joint Working Party on Counterterrorism , which ended today .


fn_spacy_tokens_for_baseline: With some methods a particular species will appear totally devoid of a particular capacity yet , with others , a startling level of ability can be revealed .

source_bert_toks: with some methods a particular species will appear totally devoid of a particular capacity yet , with others , a startling level of ability can be revealed .

reference_raw: With some methods, a particular species will appear to be completely devoid of any specific capacity, but with others, a surprising level of capacity can be revealed.

reference_spacy_tokens: With some methods , a particular species will appear to be completely devoid of any specific capacity , but with others , a surprising level of capacity can be revealed .


fn_spacy_tokens_for_baseline: He was shortish and wiry , had a straight thin moustache and I guessed he was anywhere between 40 and 45 .

source_bert_toks: he was short ##ish and wi ##ry , had a straight thin mo ##ust ##ache and i guessed he was anywhere between 40 and 45 .

reference_raw: He was short and wry, with a straight, thin mustache, and I guessed he was somewhere between forty and forty-five.

reference_spacy_tokens: He was short and wry , with a straight , thin mustache , and I guessed he was somewhere between forty and forty - five .


fn_spacy_tokens_for_baseline: They like roosting on telegraph poles .

source_bert_toks: they like ro ##ost ##ing on telegraph poles .

reference_raw: They love to roost on telegraph poles.

reference_spacy_tokens: They love to roost on telegraph poles .


fn_spacy_tokens_for_baseline: Jos did n't reply for a moment .

source_bert_toks: jo ##s didn ' t reply for a moment .

reference_raw: Jos did not answer for a moment.

reference_spacy_tokens: Jos did not answer for a moment .


fn_spacy_tokens_for_baseline: On 19 March the major central banks renounced the commitment to maintain their exchange rates within a band of + 2.25 per cent with respect to the dollar .

source_bert_toks: on 19 march the major central banks reno ##unced the commitment to maintain their exchange rates within a band of + 2 . 25 per cent with respect to the dollar .

reference_raw: On 19 March, the main central banks gave up their commitment to maintain their exchange rates in the range of + 2,25 % for the dollar.

reference_spacy_tokens: On 19 March , the main central banks gave up their commitment to maintain their exchange rates in the range of + 2,25 % for the dollar .


fn_spacy_tokens_for_baseline: His hand closed over grass which was instantly torn from the soft earth and his boots were dislodged from their precarious footholds .

source_bert_toks: his hand closed over grass which was instantly torn from the soft earth and his boots were di ##sl ##od ##ged from their pre ##car ##ious foot ##hold ##s .

reference_raw: His hand closed over the grass, which was immediately torn from the soft ground, and his boots were removed from their uncertain footholds.

reference_spacy_tokens: His hand closed over the grass , which was immediately torn from the soft ground , and his boots were removed from their uncertain footholds .


fn_spacy_tokens_for_baseline: The scenery is dramatic -- a breathtaking mixture of strange volcanic deserts and lush vegetation -- a landscape dominated by the snow - capped peak of a dormant volcano , Mount Teide .

source_bert_toks: the scenery is dramatic - - a breath ##taking mixture of strange volcanic deserts and lush vegetation - - a landscape dominated by the snow - capped peak of a dormant volcano , mount te ##ide .

reference_raw: The scenery is dramatic - a breathtaking mixture of strange volcanic deserts and lush vegetation - a landscape dominated by the snow-covered top of the dormant volcano, Mount Teide.

reference_spacy_tokens: The scenery is dramatic - a breathtaking mixture of strange volcanic deserts and lush vegetation - a landscape dominated by the snow - covered top of the dormant volcano , Mount Teide .


fn_spacy_tokens_for_baseline: Above all , his dislike of women developed into a hatred .

source_bert_toks: above all , his dislike of women developed into a hatred .

reference_raw: Above all, his hatred of women had developed into hatred.

reference_spacy_tokens: Above all , his hatred of women had developed into hatred .


fn_spacy_tokens_for_baseline: Cuts are not common in karate competition though , on occasions , a cut eyelid may be caused by the opponent 's long toenails .

source_bert_toks: cuts are not common in karate competition though , on occasions , a cut eye ##lid may be caused by the opponent ' s long toe ##nail ##s .

reference_raw: Cuts are not common in karate competitions, although sometimes the eyelids can be caused by the opponent's long nails.

reference_spacy_tokens: Cuts are not common in karate competitions , although sometimes the eyelids can be caused by the opponent 's long nails .


fn_spacy_tokens_for_baseline: History was taught by a whiskery professor who thundered about the Origin and Destiny of Imperial Britain .

source_bert_toks: history was taught by a w ##his ##ker ##y professor who thunder ##ed about the origin and destiny of imperial britain .

reference_raw: Historics were taught by a bearded professor who thundered over Imperial Britain's origin and destiny.

reference_spacy_tokens: Historics were taught by a bearded professor who thundered over Imperial Britain 's origin and destiny .


fn_spacy_tokens_for_baseline: I moored the boat , got out , collected the rods from the shore , and turned back up the loch .

source_bert_toks: i moore ##d the boat , got out , collected the rods from the shore , and turned back up the loch .

reference_raw: I anchored the boat, got out, picked up the poles from the shore, and turned back to the loch.

reference_spacy_tokens: I anchored the boat , got out , picked up the poles from the shore , and turned back to the loch .


fn_spacy_tokens_for_baseline: For dessert opt for one of Sainsbury 's wonderful frozen gateaux .

source_bert_toks: for dessert opt for one of sai ##ns ##bury ' s wonderful frozen gate ##aux .

reference_raw: Desperate has chosen one of Sainsbury's beautiful frozen gateaux.

reference_spacy_tokens: Desperate has chosen one of Sainsbury 's beautiful frozen gateaux .


fn_spacy_tokens_for_baseline: Some indefatigable climbers will want to go up to the top of the nine - story pink pagoda for a panoramic view .

source_bert_toks: some ind ##ef ##ati ##ga ##ble climb ##ers will want to go up to the top of the nine - story pink pagoda for a pan ##ora ##mic view .

reference_raw: Some of the indefatigable climbers would want to go to the top of the nine-story rosy pagodas for a panoramic view.

reference_spacy_tokens: Some of the indefatigable climbers would want to go to the top of the nine - story rosy pagodas for a panoramic view .


fn_spacy_tokens_for_baseline: Charles Lang Freer assembled a superb collection of Chinese , Japanese , Korean and South Asian paintings , screens , calligraphy , ceramics , sculpture and decorative arts .

source_bert_toks: charles lang free ##r assembled a superb collection of chinese , japanese , korean and south asian paintings , screens , call ##igraphy , ceramics , sculpture and decorative arts .

reference_raw: Charles Lang Freer has compiled an excellent collection of Chinese, Japanese, Korean and South Asian paintings, screens, calligraphy, ceramics, statues and decorative arts.

reference_spacy_tokens: Charles Lang Freer has compiled an excellent collection of Chinese , Japanese , Korean and South Asian paintings , screens , calligraphy , ceramics , statues and decorative arts .


fn_spacy_tokens_for_baseline: According to Tass , no less , the town was terrorised by visitors from outer space -- small - headed hominoids about 12 ft tall who landed their flying saucer in the local park and then went walkabout .

source_bert_toks: according to ta ##ss , no less , the town was terror ##ised by visitors from outer space - - small - headed ho ##min ##oids about 12 ##ft tall who landed their flying sauce ##r in the local park and then went walk ##ab ##out .

reference_raw: According to Tass, the city was terrorized by visitors from space, small-headed hominoids about twelve feet tall who landed their flying saucer in a local park and then walked around.

reference_spacy_tokens: According to Tass , the city was terrorized by visitors from space , small - headed hominoids about twelve feet tall who landed their flying saucer in a local park and then walked around .


fn_spacy_tokens_for_baseline: By Thursday heavy , grey clouds enshrouded the city and the queue at the central bus station snaked in and out of piles of colourful bags , trusty , slightly outdated skis and laughing Czechs of every age .

source_bert_toks: by thursday heavy , grey clouds en ##sh ##roud ##ed the city and the queue at the central bus station snake ##d in and out of piles of colourful bags , trust ##y , slightly outdated ski ##s and laughing czech ##s of every age .

reference_raw: By Thursday, the city was surrounded by heavy gray clouds, and the front of the central bus station was creeping in and out of piles of colorful sacks, trusty, slightly outdated skis, and laughing Czechs of all ages.

reference_spacy_tokens: By Thursday , the city was surrounded by heavy gray clouds , and the front of the central bus station was creeping in and out of piles of colorful sacks , trusty , slightly outdated skis , and laughing Czechs of all ages .


fn_spacy_tokens_for_baseline: When the piece of meat dropped from the fork everyone at the table exploded into laughter except the Colonel , who said , ' Nessy ! behave yourself . '

source_bert_toks: when the piece of meat dropped from the fork everyone at the table exploded into laughter except the colonel , who said , ' ness ##y ! behave yourself . '

reference_raw: As the piece of meat fell from the fork, everyone at the table burst into laughter, except for the colonel, who said, "Nessy! Behave yourself."

reference_spacy_tokens: As the piece of meat fell from the fork , everyone at the table burst into laughter , except for the colonel , who said , " Nessy ! Behave yourself . "


fn_spacy_tokens_for_baseline: Previously organised along functional lines , Bow Valley ( in which British Gas has a 54 % stake ) restructured into separate business units , each an autonomous profit centre .

source_bert_toks: previously organised along functional lines , bow valley ( in which british gas has a 54 % stake ) rest ##ructured into separate business units , each an autonomous profit centre .

reference_raw: Previously organised along functional lines, Bow Valley (where British Gas holds 54% of the shares) was converted into separate business units, each of which is an independent profit centre.

reference_spacy_tokens: Previously organised along functional lines , Bow Valley ( where British Gas holds 54 % of the shares ) was converted into separate business units , each of which is an independent profit centre .


fn_spacy_tokens_for_baseline: Furthermore , the Polish nobility that had led the national movement in Marx 's time had yielded power in Poland to a new rising capitalist class and settled for privileges guaranteed by the Tsar .

source_bert_toks: furthermore , the polish nobility that had led the national movement in marx ' s time had yielded power in poland to a new rising capitalist class and settled for privileges guaranteed by the tsar .

reference_raw: Moreover, the Polish nobility that led the Marx national movement gave power to a new growing capitalist class in Poland and settled for the privileges guaranteed by the Tsar.

reference_spacy_tokens: Moreover , the Polish nobility that led the Marx national movement gave power to a new growing capitalist class in Poland and settled for the privileges guaranteed by the Tsar .


fn_spacy_tokens_for_baseline: That , investigators believe , helps explain the ferocity of half a dozen female militants in the group .

source_bert_toks: that , investigators believe , helps explain the fe ##rocity of half a dozen female militants in the group .

reference_raw: This, according to investigators, helps explain the ferocity of a half-dozen female militia in the group.

reference_spacy_tokens: This , according to investigators , helps explain the ferocity of a half - dozen female militia in the group .


fn_spacy_tokens_for_baseline: I hope that the Minister of State will respond positively to my criticisms .

source_bert_toks: i hope that the minister of state will respond positively to my criticisms .

reference_raw: I hope the Foreign Minister responds positively to my critics.

reference_spacy_tokens: I hope the Foreign Minister responds positively to my critics .


fn_spacy_tokens_for_baseline: Frankly , I found Frankenstein about as absorbing as shiny bog - roll -- this sort of flickscreen platformer went out with Jet Set Willy !

source_bert_toks: frankly , i found frankenstein about as absorbing as shiny bog - roll - - this sort of flick ##screen platform ##er went out with jet set willy !

reference_raw: To tell you the truth, I found Frankenstein about as obsessive as a shiny bog-roll - that kind of flick-screen platformer went out with Jet Set Willy!

reference_spacy_tokens: To tell you the truth , I found Frankenstein about as obsessive as a shiny bog - roll - that kind of flick - screen platformer went out with Jet Set Willy !


fn_spacy_tokens_for_baseline: With over 180 colour photographs the cook should inspire you to really make the most of containers .

source_bert_toks: with over 180 colour photographs the cook should inspire you to really make the most of containers .

reference_raw: With more than 180 color photographs, the cook should encourage you to actually make the most of the containers.

reference_spacy_tokens: With more than 180 color photographs , the cook should encourage you to actually make the most of the containers .


fn_spacy_tokens_for_baseline: For a second or two Ben knelt there in front of him threateningly , his whole body tensed as if to act .

source_bert_toks: for a second or two ben knelt there in front of him threatening ##ly , his whole body tensed as if to act .

reference_raw: Ben dropped to his knees for a moment or two menacingly before him, his whole body tensed as if to act.

reference_spacy_tokens: Ben dropped to his knees for a moment or two menacingly before him , his whole body tensed as if to act .


fn_spacy_tokens_for_baseline: I imagine it would be virtually impossible to sneak up on an owl .

source_bert_toks: i imagine it would be virtually impossible to sneak up on an owl .

reference_raw: I imagine it's almost impossible to creep up on an owl.

reference_spacy_tokens: I imagine it 's almost impossible to creep up on an owl .


fn_spacy_tokens_for_baseline: In this aspect the world 's values find expression in the driving lust for power , wealth , and sexual indulgence .

source_bert_toks: in this aspect the world ' s values find expression in the driving lust for power , wealth , and sexual ind ##ul ##gence .

reference_raw: In this respect, world values find expression in a driven desire for power, wealth, and sexual indulgence.

reference_spacy_tokens: In this respect , world values find expression in a driven desire for power , wealth , and sexual indulgence .


fn_spacy_tokens_for_baseline: The gouged rock shimmers with crystals .

source_bert_toks: the go ##uge ##d rock shi ##mmer ##s with crystals .

reference_raw: The gouged stone glitters with crystals.

reference_spacy_tokens: The gouged stone glitters with crystals .


fn_spacy_tokens_for_baseline: Effluent discharges are often made inconspicuous by buildings or the frequent disappearance of the watercourse into culverts .

source_bert_toks: e ##ff ##lu ##ent discharge ##s are often made inc ##ons ##pic ##uous by buildings or the frequent disappearance of the water ##co ##urse into cu ##lver ##ts .

reference_raw: Effluent discharges are often inconspicuously caused by buildings or frequently disappearing watercourses into culverts.

reference_spacy_tokens: Effluent discharges are often inconspicuously caused by buildings or frequently disappearing watercourses into culverts .


fn_spacy_tokens_for_baseline: Thus 7 × 50 indicates a magnification of 7 , with each object - glass 50 millimetres across ; 12 × 50 gives a magnification of 12 , again with 50-mm object - glasses , and so on .

source_bert_toks: thus 7 × 50 indicates a mag ##ni ##fication of 7 , with each object - glass 50 millimetres across ; 12 × 50 gives a mag ##ni ##fication of 12 , again with 50 - mm object - glasses , and so on .

reference_raw: Thus, 7 × 50 indicates an increase of 7, with each glass of 50 mm in diameter; 12 × 50 gives an increase of 12, again with 50 mm object glasses, etc.

reference_spacy_tokens: Thus , 7 × 50 indicates an increase of 7 , with each glass of 50 mm in diameter ; 12 × 50 gives an increase of 12 , again with 50 mm object glasses , etc .


fn_spacy_tokens_for_baseline: The guests were crowding slowly past the wedded couple , kissing them , shaking their hands .

source_bert_toks: the guests were crowd ##ing slowly past the wed ##ded couple , kissing them , shaking their hands .

reference_raw: The guests gathered slowly around the married couple, kissed them, and shook hands.

reference_spacy_tokens: The guests gathered slowly around the married couple , kissed them , and shook hands .


fn_spacy_tokens_for_baseline: But still there was a chronic shortage of trained crews .

source_bert_toks: but still there was a chronic shortage of trained crews .

reference_raw: But there was still a long-term shortage of trained crews.

reference_spacy_tokens: But there was still a long - term shortage of trained crews .


fn_spacy_tokens_for_baseline: and uh then we moved here even when we knew we were being transferred here we became Cowboy fans

source_bert_toks: and uh then we moved here even when we knew we were being transferred here we became cowboy fans

reference_raw: and then we moved in here, even though we knew we were being moved here, we became Cowboy fans.

reference_spacy_tokens: and then we moved in here , even though we knew we were being moved here , we became Cowboy fans .


fn_spacy_tokens_for_baseline: The Antarctic ozone ' hole ' in the stratosphere that splashed across the headlines in 1988 , has continued to grow and is now the size of the USA .

source_bert_toks: the antarctic ozone ' hole ' in the st ##rat ##osphere that splashed across the headlines in 1988 , has continued to grow and is now the size of the usa .

reference_raw: The Antarctic ozone "hole" in the stratosphere, which spread over the headlines in 1988, continued to grow and is now the size of the United States.

reference_spacy_tokens: The Antarctic ozone " hole " in the stratosphere , which spread over the headlines in 1988 , continued to grow and is now the size of the United States .


fn_spacy_tokens_for_baseline: Having a clubfoot , he walked with the help of two steel sticks , but sat smiling behind the piano , always unruffled and courteous , and greeting clients by playing their favourite tunes .

source_bert_toks: having a club ##foot , he walked with the help of two steel sticks , but sat smiling behind the piano , always un ##ruff ##led and court ##eous , and greeting clients by playing their favourite tunes .

reference_raw: He had a clubfoot and was walking with two steel canes, but he sat smiling at the piano, always unruffled and polite, and greeted his clients with his favorite tunes.

reference_spacy_tokens: He had a clubfoot and was walking with two steel canes , but he sat smiling at the piano , always unruffled and polite , and greeted his clients with his favorite tunes .


fn_spacy_tokens_for_baseline: A hatchet murder a few days ago : a man named Abbot chopped up a wealthy landowner , his wife and his two women staff , then he cut his own wrists .

source_bert_toks: a hatch ##et murder a few days ago : a man named abbot chopped up a wealthy landowner , his wife and his two women staff , then he cut his own wrists .

reference_raw: A couple of days ago, a man named Abbot chopped up a rich landowner, his wife and two female employees, and then slit his wrists.

reference_spacy_tokens: A couple of days ago , a man named Abbot chopped up a rich landowner , his wife and two female employees , and then slit his wrists .


fn_spacy_tokens_for_baseline: She was respected by everyone she worked with and was brilliant at the job .

source_bert_toks: she was respected by everyone she worked with and was brilliant at the job .

reference_raw: Everyone she worked with respected her, and she was great at it.

reference_spacy_tokens: Everyone she worked with respected her , and she was great at it .


fn_spacy_tokens_for_baseline: Threat Number Three sobered Henry up slightly , though his mother and Noreen , flanking him on each side like two prison warders , had n't said a word since Eunice had opened her mouth .

source_bert_toks: threat number three sober ##ed henry up slightly , though his mother and nor ##een , flanking him on each side like two prison ward ##ers , hadn ' t said a word since eun ##ice had opened her mouth .

reference_raw: Threat number three sobered Henry a little, though his mother and Noreen, flanking him on both sides like two prison guards, had not said a word since Eunice's mouth had begun.

reference_spacy_tokens: Threat number three sobered Henry a little , though his mother and Noreen , flanking him on both sides like two prison guards , had not said a word since Eunice 's mouth had begun .


fn_spacy_tokens_for_baseline: Whether in the long term this will lead to a permanent increase in output , or whether it will simply lead to higher prices , is again a fiercely debated question .

source_bert_toks: whether in the long term this will lead to a permanent increase in output , or whether it will simply lead to higher prices , is again a fiercely debated question .

reference_raw: Whether this will lead to a sustained rise in production in the long term, or simply lead to higher prices, is once again a fiercely debated question.

reference_spacy_tokens: Whether this will lead to a sustained rise in production in the long term , or simply lead to higher prices , is once again a fiercely debated question .


fn_spacy_tokens_for_baseline: She bore it with a little smile of amusement that began to enrage me .

source_bert_toks: she bore it with a little smile of amusement that began to en ##rage me .

reference_raw: She bore him with a smile of amusement that made me angry.

reference_spacy_tokens: She bore him with a smile of amusement that made me angry .


fn_spacy_tokens_for_baseline: She purchases three tins of dog food at 46p each and a box of Miaow Krunchies at 96p .

source_bert_toks: she purchases three tin ##s of dog food at 46 ##p each and a box of mia ##ow k ##run ##chi ##es at 96 ##p .

reference_raw: He buys three cans of dog food at 46 p.m. and a box of Miaow Krunchies at 96 p.m.


fn_spacy_tokens_for_baseline: She was wearing her rouge and bright red lipstick again , and the childish plaits were gone from her hair .

source_bert_toks: she was wearing her rouge and bright red lipstick again , and the childish pl ##ai ##ts were gone from her hair .

reference_raw: She was wearing her pink and bright red lipstick again, and the plaits of a child had gone out of her hair.

reference_spacy_tokens: She was wearing her pink and bright red lipstick again , and the plaits of a child had gone out of her hair .


fn_spacy_tokens_for_baseline: It might have been more depressing if I had been otherwise ready to leave .

source_bert_toks: it might have been more de ##pressing if i had been otherwise ready to leave .

reference_raw: It would have been a lot more oppressive if I'd been prepared to leave.

reference_spacy_tokens: It would have been a lot more oppressive if I 'd been prepared to leave .


fn_spacy_tokens_for_baseline: Maxim pressed the entryphone bell for Winkelmann and waited until a man 's voice rasped : ' Bitte ? '

source_bert_toks: maxim pressed the entry ##phone bell for wink ##elman ##n and waited until a man ' s voice rasped : ' bit ##te ? '

reference_raw: Maxim pressed Winkelmann's doorbell and waited for the man's voice to growl: "Bitt?"

reference_spacy_tokens: Maxim pressed Winkelmann 's doorbell and waited for the man 's voice to growl : " Bitt ? "


fn_spacy_tokens_for_baseline: Later utilitarians like Jeremy Bentham and James Mill proposed various forms of birth control .

source_bert_toks: later ut ##ili ##tarian ##s like jeremy bent ##ham and james mill proposed various forms of birth control .

reference_raw: Later, utilitarians like Jeremy Bentham and James Mill suggested different forms of contraception.

reference_spacy_tokens: Later , utilitarians like Jeremy Bentham and James Mill suggested different forms of contraception .


fn_spacy_tokens_for_baseline: The effect of later switching is folded into the interpretation .

source_bert_toks: the effect of later switching is folded into the interpretation .

reference_raw: The effect of a later change is included in the interpretation.

reference_spacy_tokens: The effect of a later change is included in the interpretation .


fn_spacy_tokens_for_baseline: Yet , increasingly , arguments about the effects of privatisation on the state 's finances , rather than discussion about the appropriate role of the state , have come to the fore as the revenue gained from asset sales has become sizeable .

source_bert_toks: yet , increasingly , arguments about the effects of pri ##vati ##sation on the state ' s finances , rather than discussion about the appropriate role of the state , have come to the fore as the revenue gained from asset sales has become size ##able .

reference_raw: But, more and more, arguments about the impact of privatisation on the public finances, rather than discussing the appropriate role of the State, have come to the fore, as the proceeds from the sale of assets have become significant.

reference_spacy_tokens: But , more and more , arguments about the impact of privatisation on the public finances , rather than discussing the appropriate role of the State , have come to the fore , as the proceeds from the sale of assets have become significant .


fn_spacy_tokens_for_baseline: Primary Function : Education , development of post - graduate studies , expansion of industrial and academic links , and establishment of new research laboratories .

source_bert_toks: primary function : education , development of post - graduate studies , expansion of industrial and academic links , and establishment of new research laboratories .

reference_raw: Primary function: education, post development - graduate studies, extension of industrial and academic connections and creation of new research laboratories.

reference_spacy_tokens: Primary function : education , post development - graduate studies , extension of industrial and academic connections and creation of new research laboratories .


fn_spacy_tokens_for_baseline: All the adults pronounced the name of Balmoral with a unique excitement ; the cousins were soberly proud of their duty to play with the royal children .

source_bert_toks: all the adults pronounced the name of bal ##moral with a unique excitement ; the cousins were sober ##ly proud of their duty to play with the royal children .

reference_raw: The name of Balmoral was spoken by all the adults, and the cousins were soberly proud of their duty to play with the royal children.

reference_spacy_tokens: The name of Balmoral was spoken by all the adults , and the cousins were soberly proud of their duty to play with the royal children .


fn_spacy_tokens_for_baseline: For a few years chimpanzees raised in human households learn as well as human infants of the same age , but they soon reach the limit of their ability and are rapidly overtaken by human youngsters .

source_bert_toks: for a few years chi ##mp ##an ##zee ##s raised in human households learn as well as human infants of the same age , but they soon reach the limit of their ability and are rapidly over ##taken by human young ##sters .

reference_raw: For several years, chimpanzees raised in human households learn as well as human children of the same age, but soon reach the limit of their ability and are quickly overcome by human youth.

reference_spacy_tokens: For several years , chimpanzees raised in human households learn as well as human children of the same age , but soon reach the limit of their ability and are quickly overcome by human youth .


fn_spacy_tokens_for_baseline: They built many impressive churches during the term of the first Latin Kingdom of Jerusalem , but in 1187 they were driven out by Muslim forces under the great warrior Saladin .

source_bert_toks: they built many impressive churches during the term of the first latin kingdom of jerusalem , but in 118 ##7 they were driven out by muslim forces under the great warrior salad ##in .

reference_raw: During the first Latin kingdom of Jerusalem, they built a number of impressive churches, but in 1187 they were driven out by Muslim forces under the great warrior Saladin.

reference_spacy_tokens: During the first Latin kingdom of Jerusalem , they built a number of impressive churches , but in 1187 they were driven out by Muslim forces under the great warrior Saladin .


fn_spacy_tokens_for_baseline: It ca n't help that he is fretting about possessions when he should be worrying about the state of his marriage .

source_bert_toks: it can ' t help that he is fr ##etti ##ng about possessions when he should be worrying about the state of his marriage .

reference_raw: It's not his fault he's worried about property when he's worried about the state of his marriage.

reference_spacy_tokens: It 's not his fault he 's worried about property when he 's worried about the state of his marriage .


fn_spacy_tokens_for_baseline: Bullets fizz through the air in Sarajevo .

source_bert_toks: bullets fi ##zz through the air in sarajevo .

reference_raw: The bullets are flying in Sarajevo.

reference_spacy_tokens: The bullets are flying in Sarajevo .


fn_spacy_tokens_for_baseline: For elements where a level of achievement other than fully successful has been assigned , the rating official must describe the executive 's achievements on additional pages .

source_bert_toks: for elements where a level of achievement other than fully successful has been assigned , the rating official must describe the executive ' s achievements on additional pages .

reference_raw: In the case of elements that have been assigned a level of success other than full success, the rating officer shall describe the performance of the manager on other pages.

reference_spacy_tokens: In the case of elements that have been assigned a level of success other than full success , the rating officer shall describe the performance of the manager on other pages .


fn_spacy_tokens_for_baseline: Some of the stone vases were partially coated with gold leaf .

source_bert_toks: some of the stone vase ##s were partially coated with gold leaf .

reference_raw: Some of the stone vases were partially covered with golden leaves.

reference_spacy_tokens: Some of the stone vases were partially covered with golden leaves .


fn_spacy_tokens_for_baseline: When the sun began to sink and the evening grew cold , they stripped their clothes from the thorn trees , collected together their pans and bamboo brooms and set out across the bridge for home .

source_bert_toks: when the sun began to sink and the evening grew cold , they stripped their clothes from the thorn trees , collected together their pan ##s and bamboo broom ##s and set out across the bridge for home .

reference_raw: As the sun began to sink and the evening cooled, they removed their clothes from the thorn trees, gathered their pans and bamboo brooms together, and crossed the bridge to their homes.

reference_spacy_tokens: As the sun began to sink and the evening cooled , they removed their clothes from the thorn trees , gathered their pans and bamboo brooms together , and crossed the bridge to their homes .


fn_spacy_tokens_for_baseline: In temperate parts of the world , there are two kinds of anurans : those with smooth moist skins which we call frogs , and those with dryer more warty skins , the toads .

source_bert_toks: in temperate parts of the world , there are two kinds of an ##ura ##ns : those with smooth moist skins which we call frogs , and those with dry ##er more war ##ty skins , the toad ##s .

reference_raw: There are two kinds of anurans in temperate parts of the world: the ones with smooth wet skins called frogs, and the ones with dryer, warier skins, toads.

reference_spacy_tokens: There are two kinds of anurans in temperate parts of the world : the ones with smooth wet skins called frogs , and the ones with dryer , warier skins , toads .


fn_spacy_tokens_for_baseline: The king and his part had a feast at the edge of the forest .

source_bert_toks: the king and his part had a feast at the edge of the forest .

reference_raw: The King and his part were banqueting at the edge of the forest.

reference_spacy_tokens: The King and his part were banqueting at the edge of the forest .


fn_spacy_tokens_for_baseline: The bearers looked embarrassed and tried to get her to go .

source_bert_toks: the bearer ##s looked embarrassed and tried to get her to go .

reference_raw: The bearers looked ashamed and tried to make her leave.

reference_spacy_tokens: The bearers looked ashamed and tried to make her leave .


fn_spacy_tokens_for_baseline: " I 've got through my grant plus £ 500 of my savings this term , " bragged Chris Singh , a first - year communications and media student with no regrets .

source_bert_toks: " i ' ve got through my grant plus £5 ##00 of my savings this term , " bragg ##ed chris singh , a first - year communications and media student with no regrets .

reference_raw: "I got my grant plus five hundred pounds of savings this semester," said Chris Singh, a first-year communications and media student with no regrets.

reference_spacy_tokens: " I got my grant plus five hundred pounds of savings this semester , " said Chris Singh , a first - year communications and media student with no regrets .


fn_spacy_tokens_for_baseline: It is dark outside and I button my jacket .

source_bert_toks: it is dark outside and i button my jacket .

reference_raw: It's dark out there, and I'm putting on my jacket.

reference_spacy_tokens: It 's dark out there , and I 'm putting on my jacket .


fn_spacy_tokens_for_baseline: For a man to spread his cloak over a woman showed acquisition of that woman .

source_bert_toks: for a man to spread his cloak over a woman showed acquisition of that woman .

reference_raw: For the man to spread his cloak over the woman to show that he had taken the woman.

reference_spacy_tokens: For the man to spread his cloak over the woman to show that he had taken the woman .


fn_spacy_tokens_for_baseline: During the meal a great spider crawled on to the table cloth and I went to kill it with the leg of chicken I was gnawing , but Benjamin stopped me .

source_bert_toks: during the meal a great spider crawled on to the table cloth and i went to kill it with the leg of chicken i was g ##na ##wing , but benjamin stopped me .

reference_raw: During the meal, a large spider climbed onto the tablecloth, and I went to kill him with a chicken leg that I chewed, but Benjamin stopped me.

reference_spacy_tokens: During the meal , a large spider climbed onto the tablecloth , and I went to kill him with a chicken leg that I chewed , but Benjamin stopped me .


fn_spacy_tokens_for_baseline: Although the majority of the CW stockpile in the North may not be of the more sophisticated and lethal nerve agent variety , it may contain a large quantity of casualty agents such as mustard , phosgene , and Lewisite , all compounds that are relatively easy to manufacture .

source_bert_toks: although the majority of the cw stock ##pile in the north may not be of the more sophisticated and lethal nerve agent variety , it may contain a large quantity of casualty agents such as mustard , ph ##os ##gen ##e , and lewis ##ite , all compounds that are relatively easy to manufacture .

reference_raw: While most of the CW stockpiles in the north may not be of a more sophisticated and lethal type of nerve agent, it may contain a large number of victims, such as mustard, phosgene, and Lewisite, all compounds that are relatively easy to produce.

reference_spacy_tokens: While most of the CW stockpiles in the north may not be of a more sophisticated and lethal type of nerve agent , it may contain a large number of victims , such as mustard , phosgene , and Lewisite , all compounds that are relatively easy to produce .


fn_spacy_tokens_for_baseline: Help from China and North Korea , however , was not limited to conventional weaponry .

source_bert_toks: help from china and north korea , however , was not limited to conventional weaponry .

reference_raw: But assistance from China and North Korea was not limited to conventional weapons.

reference_spacy_tokens: But assistance from China and North Korea was not limited to conventional weapons .


fn_spacy_tokens_for_baseline: In addition to thousands of artillery rounds , hundreds of forward deployed Scud - B , Frog-5 and Frog-7 missiles , plus about 30 Scud - C missiles could be armed with chemical warheads .

source_bert_toks: in addition to thousands of artillery rounds , hundreds of forward deployed sc ##ud - b , frog - 5 and frog - 7 missiles , plus about 30 sc ##ud - c missiles could be armed with chemical war ##heads .

reference_raw: In addition to thousands of artillery missiles, hundreds of Scud-B, Frog-5, and Frog-7 missiles, plus about 30 Scud-C missiles, could be armed with chemical warheads.

reference_spacy_tokens: In addition to thousands of artillery missiles , hundreds of Scud - B , Frog-5 , and Frog-7 missiles , plus about 30 Scud - C missiles , could be armed with chemical warheads .


fn_spacy_tokens_for_baseline: The timber roof of an outbuilding was destroyed when a steamcleaner caught fire at Dixon 's Garage , Guisborough Road , Nunthorpe , at 12.30pm yesterday .

source_bert_toks: the timber roof of an out ##building was destroyed when a steam ##cle ##ane ##r caught fire at dixon ' s garage , gui ##sboro ##ugh road , nun ##thorpe , at 12 . 30 ##pm yesterday .

reference_raw: The wooden roof of the building was destroyed when a steam cleaner fired at 12:30 last night in Dixon's garage, Guisborough Road, Nunthorpe.

reference_spacy_tokens: The wooden roof of the building was destroyed when a steam cleaner fired at 12:30 last night in Dixon 's garage , Guisborough Road , Nunthorpe .


fn_spacy_tokens_for_baseline: If Elisabeth condemned the municipality for not having commemorated a remarkable Danish woman , she blamed Holberg , Blicher , J.P.

source_bert_toks: if elisabeth condemned the municipality for not having commemorated a remarkable danish woman , she blamed ho ##lberg , b ##liche ##r , j . p .

reference_raw: If Elizabeth condemned the city for not remembering a remarkable Danish woman, she blamed Holberg, Blicher, and J.P.

reference_spacy_tokens: If Elizabeth condemned the city for not remembering a remarkable Danish woman , she blamed Holberg , Blicher , and J.P.


fn_spacy_tokens_for_baseline: He banged the table with his fist and the glasses jumped and the drink spilled .

source_bert_toks: he banged the table with his fist and the glasses jumped and the drink spilled .

reference_raw: He slammed his fist against the table and the glasses jumped and the drink poured out.

reference_spacy_tokens: He slammed his fist against the table and the glasses jumped and the drink poured out .


fn_spacy_tokens_for_baseline: As he entered the study to which Lord Westbourne had retired , Westbourne simply waved an impatient hand , hardly bothering to turn round from the desk at the sound of Rose 's voice .

source_bert_toks: as he entered the study to which lord west ##bourne had retired , west ##bourne simply waved an impatient hand , hardly bothering to turn round from the desk at the sound of rose ' s voice .

reference_raw: When he entered the office where Lord Westbourne had retired, Westbourne simply waved a hand impatiently, hardly bothering to turn away from the table at the sound of Rose's voice.

reference_spacy_tokens: When he entered the office where Lord Westbourne had retired , Westbourne simply waved a hand impatiently , hardly bothering to turn away from the table at the sound of Rose 's voice .


fn_spacy_tokens_for_baseline: He lunged forward , tore the wooden leg out of Fabio 's hand and sent it hurtling across the room into a glass case of pink plaster hearts .

source_bert_toks: he lunged forward , tore the wooden leg out of fabio ' s hand and sent it hurt ##ling across the room into a glass case of pink plaster hearts .

reference_raw: He leapt forward, tore the wooden leg from Fabio's hand, and sent it scurrying across the room into a glass case of pink plaster hearts.

reference_spacy_tokens: He leapt forward , tore the wooden leg from Fabio 's hand , and sent it scurrying across the room into a glass case of pink plaster hearts .


fn_spacy_tokens_for_baseline: To keep our analysis fairly simple in this chapter , we adhere to the definitions given above and ignore the complications created by durable consumer goods .

source_bert_toks: to keep our analysis fairly simple in this chapter , we adhere to the definitions given above and ignore the complications created by durable consumer goods .

reference_raw: In order to keep our analysis relatively simple in this chapter, we follow the definitions set out above and ignore the complications created by durable consumer goods.

reference_spacy_tokens: In order to keep our analysis relatively simple in this chapter , we follow the definitions set out above and ignore the complications created by durable consumer goods .


fn_spacy_tokens_for_baseline: Demonstrators were angered by a government announcement in February that King Taufa'ahau Tupou IV had agreed to amend the law , thereby giving Tongan citizenship to 426 foreigners who had bought Tongan passports .

source_bert_toks: demonstrators were angered by a government announcement in february that king tau ##fa ' ah ##au tu ##po ##u iv had agreed to amend the law , thereby giving tonga ##n citizenship to 42 ##6 foreigners who had bought tonga ##n passports .

reference_raw: The protestors were outraged by the government's announcement in February that King Taufa'ahau Tupou IV had agreed to change the law, giving Tongan citizenship to the 426 aliens who purchased Tongan passports.

reference_spacy_tokens: The protestors were outraged by the government 's announcement in February that King Taufa'ahau Tupou IV had agreed to change the law , giving Tongan citizenship to the 426 aliens who purchased Tongan passports .


fn_spacy_tokens_for_baseline: Men were piling his furniture on to a cart in the street .

source_bert_toks: men were pi ##ling his furniture on to a cart in the street .

reference_raw: The men piled their furniture on a wagon in the street.

reference_spacy_tokens: The men piled their furniture on a wagon in the street .


fn_spacy_tokens_for_baseline: Its programmes include work experience , careers lessons and mock interviews .

source_bert_toks: its programmes include work experience , careers lessons and mock interviews .

reference_raw: Its programmes include work experience, career lessons and derisive interviews.

reference_spacy_tokens: Its programmes include work experience , career lessons and derisive interviews .


fn_spacy_tokens_for_baseline: We make the most of this and scoot off to the hospital .

source_bert_toks: we make the most of this and sc ##oot off to the hospital .

reference_raw: Let's make the most of it and go to the hospital.

reference_spacy_tokens: Let 's make the most of it and go to the hospital .


fn_spacy_tokens_for_baseline: If you have any queries about the help you may get , ask at the hospital .

source_bert_toks: if you have any que ##ries about the help you may get , ask at the hospital .

reference_raw: If you have any questions about how much help you can get, ask the hospital.

reference_spacy_tokens: If you have any questions about how much help you can get , ask the hospital .


fn_spacy_tokens_for_baseline: This will add a real feeling of ' audio depth ' to the recording .

source_bert_toks: this will add a real feeling of ' audio depth ' to the recording .

reference_raw: This adds a real sense of "audio-deep" to the tape.

reference_spacy_tokens: This adds a real sense of " audio - deep " to the tape .


fn_spacy_tokens_for_baseline: Mr Doug Henderson , Labour 's trade and industry spokesman , made the accusation after discussing the Jaguar deal with Mr Derek Barron , chairman of Ford of Britain .

source_bert_toks: mr doug henderson , labour ' s trade and industry spokesman , made the accusation after discussing the jaguar deal with mr derek barron , chairman of ford of britain .

reference_raw: Mr Doug Henderson, Labour Trade and Industry Speaker, made the charge after discussing the Jaguar agreement with Mr Derek Barron, President of Ford of Britain.

reference_spacy_tokens: Mr Doug Henderson , Labour Trade and Industry Speaker , made the charge after discussing the Jaguar agreement with Mr Derek Barron , President of Ford of Britain .


fn_spacy_tokens_for_baseline: My paternal grandfather was a petty officer who , after keeping Edward the Seventh 's Royal Yacht spick and span -- his trade was painter -- died early from an illness acquired at the Defence of Ladysmith .

source_bert_toks: my paternal grandfather was a petty officer who , after keeping edward the seventh ' s royal yacht sp ##ick and span - - his trade was painter - - died early from an illness acquired at the defence of lady ##smith .

reference_raw: My father's grandfather was a petty officer who, after keeping Edward the Seventh's Royal Yacht spicy and span-his shop was a painter-had died early from a disease acquired in Ladysmith's defense.

reference_spacy_tokens: My father 's grandfather was a petty officer who , after keeping Edward the Seventh 's Royal Yacht spicy and span - his shop was a painter - had died early from a disease acquired in Ladysmith 's defense .


fn_spacy_tokens_for_baseline: There was a handle at the side of the organ and sometimes Mr Bobby Hughes , stepson of Mr Alfred Shortt , acted as organ - blower .

source_bert_toks: there was a handle at the side of the organ and sometimes mr bobby hughes , steps ##on of mr alfred short ##t , acted as organ - blow ##er .

reference_raw: There was a handle on the side of the organ, and sometimes Mr. Bobby Hughes, Mr. Alfred Shortt's stepfather, acted like an organ blower.

reference_spacy_tokens: There was a handle on the side of the organ , and sometimes Mr. Bobby Hughes , Mr. Alfred Shortt 's stepfather , acted like an organ blower .


fn_spacy_tokens_for_baseline: This cannon , too , had been fired a great deal and although its muzzle had shown no distortion Harry had an uneasy feeling that it might soon be about to burst .

source_bert_toks: this cannon , too , had been fired a great deal and although its muzzle had shown no distortion harry had an uneasy feeling that it might soon be about to burst .

reference_raw: The gun had been shot a lot, too, and though its muzzle showed no deformation, Harry had an uneasy feeling that it was about to explode.

reference_spacy_tokens: The gun had been shot a lot , too , and though its muzzle showed no deformation , Harry had an uneasy feeling that it was about to explode .


fn_spacy_tokens_for_baseline: Then if she ca n't keep up payments she risks losing her home , as thousands of families have done .

source_bert_toks: then if she can ' t keep up payments she risks losing her home , as thousands of families have done .

reference_raw: Then, if he can't continue to pay, he risks losing his home, as hundreds of families have.

reference_spacy_tokens: Then , if he ca n't continue to pay , he risks losing his home , as hundreds of families have .


fn_spacy_tokens_for_baseline: God , I could use some dope ; I need to mellow out , I need to calm down .

source_bert_toks: god , i could use some do ##pe ; i need to mel ##low out , i need to calm down .

reference_raw: God, I could use some drugs; I have to melt, I have to calm down.

reference_spacy_tokens: God , I could use some drugs ; I have to melt , I have to calm down .


fn_spacy_tokens_for_baseline: IAEA chief ElBaradei has asserted that there is no reason to believe Syria was a client of A.Q. Khan 's nuclear proliferation network .

source_bert_toks: ia ##ea chief el ##bara ##de ##i has asserted that there is no reason to believe syria was a client of a . q . khan ' s nuclear proliferation network .

reference_raw: The head of the IAEA ElBaradei claims that there are no grounds to believe that Syria is a client of the nuclear proliferation network of A.Q. Khan.

reference_spacy_tokens: The head of the IAEA ElBaradei claims that there are no grounds to believe that Syria is a client of the nuclear proliferation network of A.Q. Khan .


fn_spacy_tokens_for_baseline: The New York jury deliberated for four days before acquitting Noseir of Kahane 's assassination .

source_bert_toks: the new york jury deliberate ##d for four days before ac ##qui ##tting nose ##ir of ka ##hane ' s assassination .

reference_raw: The New York jury took four days to clear Noseir of Kahane's murder.

reference_spacy_tokens: The New York jury took four days to clear Noseir of Kahane 's murder .


fn_spacy_tokens_for_baseline: ' No doubt about it , the guy was a fink and a hoodlum , ' I said , ' and worse . '

source_bert_toks: ' no doubt about it , the guy was a fin ##k and a hood ##lum , ' i said , ' and worse . '

reference_raw: "There's no doubt he was a nail and a hoodlum," I said, "and worse."

reference_spacy_tokens: " There 's no doubt he was a nail and a hoodlum , " I said , " and worse . "


fn_spacy_tokens_for_baseline: So they sent in four coachmen who stood with whips extended between them to hold back the mob .

source_bert_toks: so they sent in four coach ##men who stood with whip ##s extended between them to hold back the mob .

reference_raw: So they sent in four carriages, standing with whips outstretched among them, to hold back the crowd.

reference_spacy_tokens: So they sent in four carriages , standing with whips outstretched among them , to hold back the crowd .


fn_spacy_tokens_for_baseline: Haavikko was sitting in Wang Ti 's kitchen , Kao Chen 's two - year - old daughter , Ch'iang Hsin , snuggled in his lap .

source_bert_toks: ha ##avi ##kko was sitting in wang ti ' s kitchen , ka ##o chen ' s two - year - old daughter , ch ' ian ##g hs ##in , snuggled in his lap .

reference_raw: Haavikko sat in Wang Ti's galley, holding Kao Chen's two-year-old daughter, Ch'iang Hsin in his lap.

reference_spacy_tokens: Haavikko sat in Wang Ti 's galley , holding Kao Chen 's two - year - old daughter , Ch'iang Hsin in his lap .


fn_spacy_tokens_for_baseline: When he told Mrs Race , she clouted the boy across the face and her remark became one of our family jokes : ' I would n't care , I wanted it for the lamp . '

source_bert_toks: when he told mrs race , she cl ##out ##ed the boy across the face and her remark became one of our family jokes : ' i wouldn ' t care , i wanted it for the lamp . '

reference_raw: When he said it to Mrs. Race, she covered the boy in the face, and her remark became one of our family jokes: "I don't care, I want it for a lamp."

reference_spacy_tokens: When he said it to Mrs. Race , she covered the boy in the face , and her remark became one of our family jokes : " I do n't care , I want it for a lamp . "


fn_spacy_tokens_for_baseline: Maria is one of the many examples of the younger generation who has become politically involved against the regime through her participation in a Christian community .

source_bert_toks: maria is one of the many examples of the younger generation who has become politically involved against the regime through her participation in a christian community .

reference_raw: Maria is one of many examples of the younger generation who, by participating in the Christian community, has become politically involved in the regime.

reference_spacy_tokens: Maria is one of many examples of the younger generation who , by participating in the Christian community , has become politically involved in the regime .


fn_spacy_tokens_for_baseline: Peat and water were still flowing into the underground roadways from the subsidence and attempts to block the exposed entrance to the workings were having no success .

source_bert_toks: peat and water were still flowing into the underground roadway ##s from the sub ##side ##nce and attempts to block the exposed entrance to the workings were having no success .

reference_raw: Peat and water were still streaming down the subterranean roads, and attempts to block the unprotected entrance to the works had been unsuccessful.

reference_spacy_tokens: Peat and water were still streaming down the subterranean roads , and attempts to block the unprotected entrance to the works had been unsuccessful .


fn_spacy_tokens_for_baseline: Perhaps success gets boring for the really talented because that 's not how Susan Stokes remembers it .

source_bert_toks: perhaps success gets boring for the really talented because that ' s not how susan stokes remembers it .

reference_raw: Maybe success is dull for really talented people because Susan Stokes doesn't remember it that way.

reference_spacy_tokens: Maybe success is dull for really talented people because Susan Stokes does n't remember it that way .


fn_spacy_tokens_for_baseline: Once her baby was born , then she 'd never be alone again .

source_bert_toks: once her baby was born , then she ' d never be alone again .

reference_raw: Once her baby's born, she won't be alone again.

reference_spacy_tokens: Once her baby 's born , she wo n't be alone again .


fn_spacy_tokens_for_baseline: Having finished , she descends a little way down the twig and then lays another batch .

source_bert_toks: having finished , she descends a little way down the t ##wig and then lays another batch .

reference_raw: When he's done, he goes down a little way down the branch and then puts down another batch.

reference_spacy_tokens: When he 's done , he goes down a little way down the branch and then puts down another batch .


fn_spacy_tokens_for_baseline: The surface of the ocean has become a very dangerous place without air defenses , such as carrier - based fighters that can prevent hostile aircraft or vessels from approaching close enough to launch their deadly missiles .

source_bert_toks: the surface of the ocean has become a very dangerous place without air defenses , such as carrier - based fighters that can prevent hostile aircraft or vessels from approaching close enough to launch their deadly missiles .

reference_raw: Without air defences, the surface of the ocean has become a very dangerous place, such as carrier fighters, which can prevent enemy aircraft or vessels from coming close enough to launch their deadly missiles.

reference_spacy_tokens: Without air defences , the surface of the ocean has become a very dangerous place , such as carrier fighters , which can prevent enemy aircraft or vessels from coming close enough to launch their deadly missiles .


fn_spacy_tokens_for_baseline: The hordes of people who attended Hoover Dam 's 1935 dedication set the city 's now - formidable public relations machine into action .

source_bert_toks: the horde ##s of people who attended hoover dam ' s 1935 dedication set the city ' s now - formidable public relations machine into action .

reference_raw: The hordes of people who attended Hoover Dam's dedication in 1935 set the city's now-formed public-relations device in motion.

reference_spacy_tokens: The hordes of people who attended Hoover Dam 's dedication in 1935 set the city 's now - formed public - relations device in motion .


fn_spacy_tokens_for_baseline: Have to find him yon old folkery with the picture - window looking on to the stand of immemorial beeches , the dingle dell , the plashing brook , the wishing - well , the verdant sward .

source_bert_toks: have to find him yo ##n old folk ##ery with the picture - window looking on to the stand of im ##me ##mori ##al beech ##es , the ding ##le dell , the pl ##ashi ##ng brook , the wishing - well , the ve ##rdan ##t sw ##ard .

reference_raw: I need to find him a yon old folkery with a picture window looking at a stand of immemorial beeches, a dingle valley, a flopping stream, a wish-well, a verdant sward.

reference_spacy_tokens: I need to find him a yon old folkery with a picture window looking at a stand of immemorial beeches , a dingle valley , a flopping stream , a wish - well , a verdant sward .


fn_spacy_tokens_for_baseline: She felt , abruptly , as if she were screaming silently inside .

source_bert_toks: she felt , abruptly , as if she were screaming silently inside .

reference_raw: Suddenly she felt as if she were shouting in silence.

reference_spacy_tokens: Suddenly she felt as if she were shouting in silence .


fn_spacy_tokens_for_baseline: ' Laura found the new formalities extremely annoying .

source_bert_toks: ' laura found the new formal ##ities extremely annoying .

reference_raw: Laura found the new formalities extremely unpleasant.

reference_spacy_tokens: Laura found the new formalities extremely unpleasant .


fn_spacy_tokens_for_baseline: It was n't the sort of thing he would have put on the wall next to his bed but it was a lot more acceptable than Mr Pilkington in a black cowl .

source_bert_toks: it wasn ' t the sort of thing he would have put on the wall next to his bed but it was a lot more acceptable than mr pi ##lk ##ington in a black cow ##l .

reference_raw: It wasn't something he'd put on the wall beside his bed, but it was far more acceptable than Mr. Pilkington in a black hood.

reference_spacy_tokens: It was n't something he 'd put on the wall beside his bed , but it was far more acceptable than Mr. Pilkington in a black hood .


fn_spacy_tokens_for_baseline: They ate in silence , listening to the murmured conversation and occasional laughs of their comrades .

source_bert_toks: they ate in silence , listening to the murmured conversation and occasional laughs of their comrades .

reference_raw: They ate in silence, listening to the muttering conversations and occasionally laughing of their comrades.

reference_spacy_tokens: They ate in silence , listening to the muttering conversations and occasionally laughing of their comrades .


fn_spacy_tokens_for_baseline: Maidstone had become quite abusive at this , swearing at Franco in English , Italian and Neapolitan dialect .

source_bert_toks: maids ##tone had become quite abusive at this , swearing at franco in english , italian and ne ##ap ##oli ##tan dialect .

reference_raw: Maidstone was quite rude about it, cursing Franco in English, Italian, and Neapolitan dialects.

reference_spacy_tokens: Maidstone was quite rude about it , cursing Franco in English , Italian , and Neapolitan dialects .


fn_spacy_tokens_for_baseline: A £ 2 m TV campaign backed by presenter Anne Diamond , whose son Sebastian was a cot death victim two years ago , has resulted in a fall from 912 deaths in 1991 to 456 last year .

source_bert_toks: a £2 ##m tv campaign backed by presenter anne diamond , whose son sebastian was a cot death victim two years ago , has resulted in a fall from 91 ##2 deaths in 1991 to 45 ##6 last year .

reference_raw: The 2 million-dollar television campaign supported by the presenter Anne Diamond, whose son Sebastian was the victim of the death of a cot two years ago, led to a decrease from 912 deaths in 1991 to 456 last year.

reference_spacy_tokens: The 2 million - dollar television campaign supported by the presenter Anne Diamond , whose son Sebastian was the victim of the death of a cot two years ago , led to a decrease from 912 deaths in 1991 to 456 last year .


fn_spacy_tokens_for_baseline: Mick and me must drive them all there .

source_bert_toks: mick and me must drive them all there .

reference_raw: Mick and I have to take them all there.

reference_spacy_tokens: Mick and I have to take them all there .


fn_spacy_tokens_for_baseline: The treaty requires 90 - day notice before a withdrawal , but North Korea claims this is not necessary since Pyongyang already declared its intention to withdraw in 1993 , only to " suspend its intention withdraw "

source_bert_toks: the treaty requires 90 - day notice before a withdrawal , but north korea claims this is not necessary since p ##yon ##gy ##ang already declared its intention to withdraw in 1993 , only to " suspend its intention withdraw "

reference_raw: The contract requires a 90-day notice before a recall, but North Korea claims that it is not necessary because Pyongyang has already announced its intention to withdraw in 1993, only to "suspend its intention to withdraw"

reference_spacy_tokens: The contract requires a 90-day notice before a recall , but North Korea claims that it is not necessary because Pyongyang has already announced its intention to withdraw in 1993 , only to " suspend its intention to withdraw "


fn_spacy_tokens_for_baseline: " Our employees and those of our subcontractors work safely every day and that 's why we are honored with these awards , " said Westinghouse Anniston Project Manager Bob Love .

source_bert_toks: " our employees and those of our sub ##con ##tra ##ctors work safely every day and that ' s why we are honored with these awards , " said west ##ing ##house ann ##isto ##n project manager bob love .

reference_raw: "Our employees and our sub-contractors work securely every day, and that's why we're honored by the awards," Bob Love Project Manager Westinghouse Anniston said.

reference_spacy_tokens: " Our employees and our sub - contractors work securely every day , and that 's why we 're honored by the awards , " Bob Love Project Manager Westinghouse Anniston said .


fn_spacy_tokens_for_baseline: These fish exclusively inhabit the very top layer of the aquarium , they will take the usual food but it is important they receive some freeze - dried or frozen tubifex or bloodworm .

source_bert_toks: these fish exclusively inhabit the very top layer of the aquarium , they will take the usual food but it is important they receive some freeze - dried or frozen tub ##ife ##x or blood ##worm .

reference_raw: These fish exclusively inhabit the very upper layer of the aquarium and take the usual food, but it is important that they receive some frozen or frozen tubifex or bloodworms.

reference_spacy_tokens: These fish exclusively inhabit the very upper layer of the aquarium and take the usual food , but it is important that they receive some frozen or frozen tubifex or bloodworms .


fn_spacy_tokens_for_baseline: ' I absolutely loathe grey gloves , as you well know by now !

source_bert_toks: ' i absolutely lo ##ath ##e grey gloves , as you well know by now !

reference_raw: I absolutely hate gray gloves, as you know!

reference_spacy_tokens: I absolutely hate gray gloves , as you know !


fn_spacy_tokens_for_baseline: It took quite a while to get the boys admitted to everyone 's satisfaction , and I was beginning to think I was n't going to get my test typed up for Form Four English .

source_bert_toks: it took quite a while to get the boys admitted to everyone ' s satisfaction , and i was beginning to think i wasn ' t going to get my test typed up for form four english .

reference_raw: It took me a long time for the boys to accept to everyone's satisfaction, and I was beginning to think I wouldn't have my test written for Form Four English.

reference_spacy_tokens: It took me a long time for the boys to accept to everyone 's satisfaction , and I was beginning to think I would n't have my test written for Form Four English .


fn_spacy_tokens_for_baseline: Cottages -- even one described as decayed -- rented for 3s . 4d . , houses and tenements for 6s . 8d . and 11s . 8d .

source_bert_toks: cottages - - even one described as decay ##ed - - rented for 3 ##s . 4 ##d . , houses and ten ##ement ##s for 6 ##s . 8 ##d . and 11 ##s . 8 ##d .

reference_raw: Cottages - even one described as decomposing - leased for 3s. 4d, houses and tenements for 6s. 8d. and 11s.

reference_spacy_tokens: Cottages - even one described as decomposing - leased for 3s . 4d , houses and tenements for 6s . 8d . and 11s .


fn_spacy_tokens_for_baseline: The climate here can best be described as " changeable " and yet the sudden shifts from light to dark , sunshine to shower , are part of the city 's magic .

source_bert_toks: the climate here can best be described as " change ##able " and yet the sudden shifts from light to dark , sunshine to shower , are part of the city ' s magic .

reference_raw: The climate here is best known as "changeable", but the sudden shift from light to darkness, sun to shower, is part of the city's magic.

reference_spacy_tokens: The climate here is best known as " changeable " , but the sudden shift from light to darkness , sun to shower , is part of the city 's magic .


fn_spacy_tokens_for_baseline: The object is to promote stem growth in the desired direction line , but this will not be achieved if , as sometimes happens , a dormant eye emerges as two or three buds , or as not infrequently occurs on too weakly pruned stems , growth emerges in a completely wrong direction from lower buds .

source_bert_toks: the object is to promote stem growth in the desired direction line , but this will not be achieved if , as sometimes happens , a dormant eye emerges as two or three buds , or as not in ##fr ##e ##quent ##ly occurs on too weakly pr ##une ##d stems , growth emerges in a completely wrong direction from lower buds .

reference_raw: The aim is to encourage stems to grow in the desired direction, but this will not be achieved if, as is sometimes the case, a dormant eye emerges as two or three buds, or because it is not often found on too weakly pruned stems, it emerges from the lower buds in a completely wrong direction.

reference_spacy_tokens: The aim is to encourage stems to grow in the desired direction , but this will not be achieved if , as is sometimes the case , a dormant eye emerges as two or three buds , or because it is not often found on too weakly pruned stems , it emerges from the lower buds in a completely wrong direction .


fn_spacy_tokens_for_baseline: Western intelligence suspected that Pakistan , which many estimated had succeeded in manufacturing a nuclear bomb in 1986 , provided Iran with nuclear assistance .

source_bert_toks: western intelligence suspected that pakistan , which many estimated had succeeded in manufacturing a nuclear bomb in 1986 , provided iran with nuclear assistance .

reference_raw: Western intelligence suspected that Pakistan, many estimated to have succeeded in producing a nuclear bomb in 1986, provided nuclear assistance to Iran.

reference_spacy_tokens: Western intelligence suspected that Pakistan , many estimated to have succeeded in producing a nuclear bomb in 1986 , provided nuclear assistance to Iran .


fn_spacy_tokens_for_baseline: It is also likely that the ads for the more expensive and unusual products will be of greater general interest than those for the cheap day - to - day items : it is quite tempting to study in detail an ad for an expensive car , or browse through the ' houses for sale ' columns , even if you aspire only as far as a second - hand Escort and have no intention of moving house within the next 10 years .

source_bert_toks: it is also likely that the ads for the more expensive and unusual products will be of greater general interest than those for the cheap day - to - day items : it is quite tempting to study in detail an ad for an expensive car , or brows ##e through the ' houses for sale ' columns , even if you as ##pire only as far as a second - hand escort and have no intention of moving house within the next 10 years .

reference_raw: It is also likely that commercials for more expensive and unusual products will be of greater public interest than those for cheap everyday items: it is quite attractive to study in detail an ad for an expensive car, or to browse through the columns of "houses for sale", even if you wish only for a second-hand Escort and do not intend to move home for the next ten years.

reference_spacy_tokens: It is also likely that commercials for more expensive and unusual products will be of greater public interest than those for cheap everyday items : it is quite attractive to study in detail an ad for an expensive car , or to browse through the columns of " houses for sale " , even if you wish only for a second - hand Escort and do not intend to move home for the next ten years .


fn_spacy_tokens_for_baseline: Our last prayer is to thank God the creator of the universe .

source_bert_toks: our last prayer is to thank god the creator of the universe .

reference_raw: Our final prayer is to thank God the Creator of the Universe.

reference_spacy_tokens: Our final prayer is to thank God the Creator of the Universe .