fn_spacy_tokens_for_baseline: This question echoes those regarding sustainable development raised by the opponents of gold mining in the west of Ireland and by opponents of Merrell Dow in east Cork .

source_bert_toks: this question echoes those regarding sustainable development raised by the opponents of gold mining in the west of ireland and by opponents of mer ##rell dow in east cork .

reference_raw: This question echoes the issue of sustainable development raised by the opposition to gold mining in the west of Ireland and by the opposition to Merrell Dow in the east of Cork.

reference_spacy_tokens: This question echoes the issue of sustainable development raised by the opposition to gold mining in the west of Ireland and by the opposition to Merrell Dow in the east of Cork .


fn_spacy_tokens_for_baseline: The physician , a Muslim from India , made no protest to the Mutawas , but he was incensed at the role he was forced to play .

source_bert_toks: the physician , a muslim from india , made no protest to the mu ##ta ##was , but he was incense ##d at the role he was forced to play .

reference_raw: The doctor, a Moslem from India, did not protest against the Mutawas, but he was enthusiastic about the role he had to play.

reference_spacy_tokens: The doctor , a Moslem from India , did not protest against the Mutawas , but he was enthusiastic about the role he had to play .


fn_spacy_tokens_for_baseline: And your thesis topic is ' The Role of Illegal Narcotics Trafficking in the Lebanese Political Crisis ' . '

source_bert_toks: and your thesis topic is ' the role of illegal narcotics trafficking in the lebanese political crisis ' . '

reference_raw: And your thesis theme is "The role of illegal drug trafficking in Lebanon's political crisis."

reference_spacy_tokens: And your thesis theme is " The role of illegal drug trafficking in Lebanon 's political crisis . "


fn_spacy_tokens_for_baseline: In this field , Iran 's research is concentrated in creating genes that produce toxins against insect pests ; improving the biological resistance of plants ; formulating new pesticides ; improving techniques of spraying or otherwise disseminating pesticides ; investigating the effects on native plant species after they have been introduced to various pests and diseases ; preventing the production of mycotoxins in crops ; producing plant viruses and their corresponding antiserums for an antiserum bank ; and manufacturing pheromones and hormones to combat arthropods that harm Iran 's agricultural industry .

source_bert_toks: in this field , iran ' s research is concentrated in creating genes that produce toxin ##s against insect pest ##s ; improving the biological resistance of plants ; formula ##ting new pest ##icides ; improving techniques of spraying or otherwise di ##sse ##minating pest ##icides ; investigating the effects on native plant species after they have been introduced to various pest ##s and diseases ; preventing the production of my ##cot ##ox ##ins in crops ; producing plant viruses and their corresponding anti ##ser ##ums for an anti ##ser ##um bank ; and manufacturing ph ##ero ##mon ##es and hormones to combat art ##hr ##op ##ods that harm iran ' s agricultural industry .

reference_raw: In this area, Iran's research focuses on the creation of genes that produce toxins against insect pests; the improvement of plant bioresistance; the formulation of new pesticides; the improvement of methods of spraying or other dissemination of pesticides; the investigation of the effects on native plant species after their introduction on different pests and illnesses; the prevention of the production of mycotoxins in crops; the production of plant viruses and their corresponding antis for antis. and the production of pheromones and hormones to fight arthropods that harm the agricultural sector of Iran.

reference_spacy_tokens: In this area , Iran 's research focuses on the creation of genes that produce toxins against insect pests ; the improvement of plant bioresistance ; the formulation of new pesticides ; the improvement of methods of spraying or other dissemination of pesticides ; the investigation of the effects on native plant species after their introduction on different pests and illnesses ; the prevention of the production of mycotoxins in crops ; the production of plant viruses and their corresponding antis for antis . and the production of pheromones and hormones to fight arthropods that harm the agricultural sector of Iran .


fn_spacy_tokens_for_baseline: Anne made a good recovery from her illness and three weeks later was back in circulation .

source_bert_toks: anne made a good recovery from her illness and three weeks later was back in circulation .

reference_raw: Anna recovered well from her illness and was back in circulation three weeks later.

reference_spacy_tokens: Anna recovered well from her illness and was back in circulation three weeks later .


fn_spacy_tokens_for_baseline: But he was as cunning as he was cruel , and at the first whisper of coming trouble he had secretly conveyed his treasures aboard a ship which was manned by devoted adherents .

source_bert_toks: but he was as cunning as he was cruel , and at the first whisper of coming trouble he had secretly conveyed his treasures aboard a ship which was manned by devoted adherents .

reference_raw: But he was as cunning as he was cruel, and at the first whisper of the coming trouble he secretly conveyed his treasures to a vessel manned by loyal followers.

reference_spacy_tokens: But he was as cunning as he was cruel , and at the first whisper of the coming trouble he secretly conveyed his treasures to a vessel manned by loyal followers .


fn_spacy_tokens_for_baseline: At last , thanks to safer sex , it is almost trendy to admit to self - abuse so long as porn had nothing to do with it .

source_bert_toks: at last , thanks to safer sex , it is almost trend ##y to admit to self - abuse so long as porn had nothing to do with it .

reference_raw: Finally, thanks to safer sex, it's almost a trend to admit self-abuse while porn has nothing to do with it.

reference_spacy_tokens: Finally , thanks to safer sex , it 's almost a trend to admit self - abuse while porn has nothing to do with it .


fn_spacy_tokens_for_baseline: When she heard that a particular decision had not yet been implemented she telexed Moira , complaining : ' BA would be very annoyed if he heard it had not been done . '

source_bert_toks: when she heard that a particular decision had not yet been implemented she tel ##ex ##ed moi ##ra , complaining : ' ba would be very annoyed if he heard it had not been done . '

reference_raw: When she heard that a decision had not yet been made, she called Moira and complained, "BA would be very upset to hear that it had not been done."

reference_spacy_tokens: When she heard that a decision had not yet been made , she called Moira and complained , " BA would be very upset to hear that it had not been done . "


fn_spacy_tokens_for_baseline: Mr Palumbo assembled a formidable team of architects and planners .

source_bert_toks: mr pal ##umb ##o assembled a formidable team of architects and planners .

reference_raw: Mr. Palumbo has put together a formidable team of architects and planners.

reference_spacy_tokens: Mr. Palumbo has put together a formidable team of architects and planners .


fn_spacy_tokens_for_baseline: ' This way , you get to do both , ' he reasoned with galling unconcern .

source_bert_toks: ' this way , you get to do both , ' he reasoned with gall ##ing un ##con ##cer ##n .

reference_raw: 'That way you can do both,' he said, gauntly unconcerned.

reference_spacy_tokens: ' That way you can do both , ' he said , gauntly unconcerned .


fn_spacy_tokens_for_baseline: As they left the turn the French paddled off at a tangent and tried to run the Romanians into the landing pontoon in front of all the VIPs .

source_bert_toks: as they left the turn the french paddle ##d off at a tangent and tried to run the romanian ##s into the landing pont ##oon in front of all the vip ##s .

reference_raw: When they left the turn, the French padded away with a tangent and tried to drive the Romanians to the landing pontoon in front of all the VIPs.

reference_spacy_tokens: When they left the turn , the French padded away with a tangent and tried to drive the Romanians to the landing pontoon in front of all the VIPs .


fn_spacy_tokens_for_baseline: There has been an explosion in the number of seminaries in Brazil .

source_bert_toks: there has been an explosion in the number of seminar ##ies in brazil .

reference_raw: There's been an outburst in the number of seminars in Brazil.

reference_spacy_tokens: There 's been an outburst in the number of seminars in Brazil .


fn_spacy_tokens_for_baseline: She gasped as he yanked her closer .

source_bert_toks: she gasped as he yanked her closer .

reference_raw: She gasped as he pulled her closer.

reference_spacy_tokens: She gasped as he pulled her closer .


fn_spacy_tokens_for_baseline: " That he did foully murder and commit the most dreadful homicides . "

source_bert_toks: " that he did foul ##ly murder and commit the most dreadful homicide ##s . "

reference_raw: "That he'd committed foul murder and committed the worst murders."

reference_spacy_tokens: " That he 'd committed foul murder and committed the worst murders . "


fn_spacy_tokens_for_baseline: For Mrs Whitehouse , this radical theology constituted a new moral orthodoxy , and one which , in an inaccurate paraphrasing of John Robinson 's argument , it was believed that ' God is Dead ' .

source_bert_toks: for mrs white ##house , this radical theology constituted a new moral orthodoxy , and one which , in an inaccurate para ##ph ##ras ##ing of john robinson ' s argument , it was believed that ' god is dead ' .

reference_raw: For Mrs. Whitehouse, this radical theology was a new moral orthodoxy, and one that, in the imprecise paraphrase of John Robinson's argument, was believed to be "God is dead."

reference_spacy_tokens: For Mrs. Whitehouse , this radical theology was a new moral orthodoxy , and one that , in the imprecise paraphrase of John Robinson 's argument , was believed to be " God is dead . "


fn_spacy_tokens_for_baseline: In a province rife with rebellion and retaliation , the execution in Jerusalem of yet another religious leader from the Galilee did not by itself have an immediate effect on history .

source_bert_toks: in a province ri ##fe with rebellion and retaliation , the execution in jerusalem of yet another religious leader from the galilee did not by itself have an immediate effect on history .

reference_raw: In a province of rebellion and retaliation, the execution of another Galilee religious commander in Jerusalem had no immediate effect on history.

reference_spacy_tokens: In a province of rebellion and retaliation , the execution of another Galilee religious commander in Jerusalem had no immediate effect on history .


fn_spacy_tokens_for_baseline: The population on the peak is deformed by the rapid accumulation of mutations and diuses away from the peak into the lowlands of poor fitness .

source_bert_toks: the population on the peak is def ##or ##med by the rapid accumulation of mutations and di ##uses away from the peak into the lowlands of poor fitness .

reference_raw: The population at the peak is deformed by a fast accumulation of mutations and diuses from the peak to the lowlands of poor fitness.

reference_spacy_tokens: The population at the peak is deformed by a fast accumulation of mutations and diuses from the peak to the lowlands of poor fitness .


fn_spacy_tokens_for_baseline: Its most obvious difficulties have been lack of scale and disappointing growth .

source_bert_toks: its most obvious difficulties have been lack of scale and disappointing growth .

reference_raw: The most obvious problems were lack of scale and unsatisfactory growth.

reference_spacy_tokens: The most obvious problems were lack of scale and unsatisfactory growth .


fn_spacy_tokens_for_baseline: Dennis winked unpleasantly as they walked back to the stables .

source_bert_toks: dennis winked unpleasant ##ly as they walked back to the stables .

reference_raw: Dennis blinked uncomfortably as they returned to the stables.

reference_spacy_tokens: Dennis blinked uncomfortably as they returned to the stables .


fn_spacy_tokens_for_baseline: After the wildflowers blossomed in March , they journeyed south along the lush Wallowa valley to gather wild roots like kouse and camas .

source_bert_toks: after the wild ##flower ##s blossom ##ed in march , they journey ##ed south along the lush wall ##owa valley to gather wild roots like ko ##use and cam ##as .

reference_raw: When the wildflowers blossomed in March, they traveled south along the lush valley of Wallowa to gather wild roots like kouse and camas.

reference_spacy_tokens: When the wildflowers blossomed in March , they traveled south along the lush valley of Wallowa to gather wild roots like kouse and camas .


fn_spacy_tokens_for_baseline: Grimma told him about events in the quarry -- the fight with the humans , and the stealing of Jekub the earth - mover to escape .

source_bert_toks: grimm ##a told him about events in the quarry - - the fight with the humans , and the stealing of je ##ku ##b the earth - move ##r to escape .

reference_raw: Grimma had told him about what had happened in the quarry, the fight with the people, and the theft of Jekub the Earth-mover to escape.

reference_spacy_tokens: Grimma had told him about what had happened in the quarry , the fight with the people , and the theft of Jekub the Earth - mover to escape .


fn_spacy_tokens_for_baseline: Mr Dostam keeps a token force of fighters in Kabul , sometimes supporting Mr Masoud , sometimes opposing him , depending which way the wind is blowing .

source_bert_toks: mr dos ##tam keeps a token force of fighters in kabul , sometimes supporting mr mas ##oud , sometimes opposing him , depending which way the wind is blowing .

reference_raw: Mr. Dostam retains a symbolic force of warriors in Kabul, sometimes supporting Mr. Masoud, sometimes opposing him, depending on which direction the wind blows.

reference_spacy_tokens: Mr. Dostam retains a symbolic force of warriors in Kabul , sometimes supporting Mr. Masoud , sometimes opposing him , depending on which direction the wind blows .


fn_spacy_tokens_for_baseline: The irony is that Blake is fit to play , his convalescence helped by a stream of get - well wishes - many from Peterborough fans .

source_bert_toks: the irony is that blake is fit to play , his con ##vale ##sc ##ence helped by a stream of get - well wishes - many from peterborough fans .

reference_raw: The irony was that Blake was fit to play, and his recovery was helped by a stream of good wishes, many from Peterborough fans.

reference_spacy_tokens: The irony was that Blake was fit to play , and his recovery was helped by a stream of good wishes , many from Peterborough fans .


fn_spacy_tokens_for_baseline: The Taliban painted the assault in Jalalabad as a success , claiming to have killed dozens of coalition troops .

source_bert_toks: the taliban painted the assault in ja ##lal ##abad as a success , claiming to have killed dozens of coalition troops .

reference_raw: The Taliban drew a successful attack in Jalalabad, claiming to have killed dozens of coalition troops.

reference_spacy_tokens: The Taliban drew a successful attack in Jalalabad , claiming to have killed dozens of coalition troops .


fn_spacy_tokens_for_baseline: His celebration after Ronnie Whelan had scored a simple equaliser was the perfect demonstration of how close his Liverpool team had come to elimination from the FA Cup .

source_bert_toks: his celebration after ronnie w ##hel ##an had scored a simple equal ##iser was the perfect demonstration of how close his liverpool team had come to elimination from the fa cup .

reference_raw: His celebration after Ronnie Whelan scored a simple equaliser was a perfect demonstration of how close his Liverpool team had been to getting out of the FA Cup.

reference_spacy_tokens: His celebration after Ronnie Whelan scored a simple equaliser was a perfect demonstration of how close his Liverpool team had been to getting out of the FA Cup .


fn_spacy_tokens_for_baseline: Delta Five , from Compsoft , is a multi - user database designed specifically with this type of task in mind .

source_bert_toks: delta five , from com ##ps ##oft , is a multi - user database designed specifically with this type of task in mind .

reference_raw: Delta Five, from Compsoft, is a multi-user database dedicated specifically to this type of task.

reference_spacy_tokens: Delta Five , from Compsoft , is a multi - user database dedicated specifically to this type of task .


fn_spacy_tokens_for_baseline: The artist must undertake to act reasonably at all times if offered fair advice by his or her manager .

source_bert_toks: the artist must undertake to act reasonably at all times if offered fair advice by his or her manager .

reference_raw: If the artist offers fair advice from his manager, he must commit himself to acting reasonably at all times.

reference_spacy_tokens: If the artist offers fair advice from his manager , he must commit himself to acting reasonably at all times .


fn_spacy_tokens_for_baseline: Glass had been earning some money by transcribing Ravi Shankar 's score for the film , Chappacqua .

source_bert_toks: glass had been earning some money by trans ##cr ##ib ##ing ravi shankar ' s score for the film , cha ##ppa ##c ##qua .

reference_raw: Glass made some money by rewriting Ravi Shankar's record for the movie, Chappacqua.

reference_spacy_tokens: Glass made some money by rewriting Ravi Shankar 's record for the movie , Chappacqua .


fn_spacy_tokens_for_baseline: She delighted the crown by riding to a victory in her class , Princess Anne 's popular win was on Columbus , owned by the Queen , in the intermediate Class A.

source_bert_toks: she delighted the crown by riding to a victory in her class , princess anne ' s popular win was on columbus , owned by the queen , in the intermediate class a .

reference_raw: She pleased the crown by riding to victory in her class, and Princess Anne's favorite victory was on Columbus, which was the queen's own, in middle class A.

reference_spacy_tokens: She pleased the crown by riding to victory in her class , and Princess Anne 's favorite victory was on Columbus , which was the queen 's own , in middle class A.


fn_spacy_tokens_for_baseline: This group of French youngsters show their appreciation .

source_bert_toks: this group of french young ##sters show their appreciation .

reference_raw: This group of French young people show their gratitude.

reference_spacy_tokens: This group of French young people show their gratitude .


fn_spacy_tokens_for_baseline: It called on all sections of society , including the armed forces , to join a patriotic movement ' to stop the chain reaction of disastrous disintegration ' .

source_bert_toks: it called on all sections of society , including the armed forces , to join a patriotic movement ' to stop the chain reaction of disastrous di ##sin ##te ##gration ' .

reference_raw: He called on all parts of society, including the armed forces, to join the patriotic movement to stop the chain reaction of catastrophic disintegration.

reference_spacy_tokens: He called on all parts of society , including the armed forces , to join the patriotic movement to stop the chain reaction of catastrophic disintegration .


fn_spacy_tokens_for_baseline: I was physically ill the day before I met her because I was so nervous !

source_bert_toks: i was physically ill the day before i met her because i was so nervous !

reference_raw: The day before I met her, I was physically sick because I was so tense!

reference_spacy_tokens: The day before I met her , I was physically sick because I was so tense !


fn_spacy_tokens_for_baseline: All the quality papers led with an assessment of Too Long a Winter , and marvelled at the astonishing life led by this old lady with the gleaming white hair in that frozen lonely Yorkshire dale .

source_bert_toks: all the quality papers led with an assessment of too long a winter , and marvel ##led at the astonishing life led by this old lady with the gleaming white hair in that frozen lonely yorkshire dale .

reference_raw: All the quality papers led by the evaluation of Too Long a Winter and marveled at the amazing life led by the old woman with the glittering white hair in the frozen, lonely Yorkshire valley.

reference_spacy_tokens: All the quality papers led by the evaluation of Too Long a Winter and marveled at the amazing life led by the old woman with the glittering white hair in the frozen , lonely Yorkshire valley .


fn_spacy_tokens_for_baseline: Holman is critical of the 1975 Children Act for taking no cognisance of the link between child separation and poverty .

source_bert_toks: holm ##an is critical of the 1975 children act for taking no co ##gni ##san ##ce of the link between child separation and poverty .

reference_raw: Holman criticises the Children's Act of 1975 for not recognising the link between child separation and poverty.

reference_spacy_tokens: Holman criticises the Children 's Act of 1975 for not recognising the link between child separation and poverty .


fn_spacy_tokens_for_baseline: In a final bid to stop the bulldozers destroying their shacks , the women of this illegal squatter community stripped to the waist .

source_bert_toks: in a final bid to stop the bull ##do ##zers destroying their shack ##s , the women of this illegal squat ##ter community stripped to the waist .

reference_raw: In the final bid to stop the bulldozers from destroying their huts, the women of this illegal squatter community were stripped to the waist.

reference_spacy_tokens: In the final bid to stop the bulldozers from destroying their huts , the women of this illegal squatter community were stripped to the waist .


fn_spacy_tokens_for_baseline: Automotive products accounted for 25 % of February 's total , compared with about 22 % in January .

source_bert_toks: automotive products accounted for 25 % of february ' s total , compared with about 22 % in january .

reference_raw: Automotive products accounted for 25 % of the sum of February, compared to around 22 % in January.

reference_spacy_tokens: Automotive products accounted for 25 % of the sum of February , compared to around 22 % in January .


fn_spacy_tokens_for_baseline: ' Most of the radioactive nuclides would have decayed to stable atoms before they could possibly be released to the environment by the slow corrosion process . '

source_bert_toks: ' most of the radioactive nu ##cl ##ides would have decay ##ed to stable atoms before they could possibly be released to the environment by the slow corrosion process . '

reference_raw: "Most radioactive nuclides would dissolve into stable atoms before they could be released into the environment by a slow corrosion process."

reference_spacy_tokens: " Most radioactive nuclides would dissolve into stable atoms before they could be released into the environment by a slow corrosion process . "


fn_spacy_tokens_for_baseline: The boys had been out on their bikes with a friend when they saw two men shooting into the brook .

source_bert_toks: the boys had been out on their bikes with a friend when they saw two men shooting into the brook .

reference_raw: The boys were riding bikes with a friend when they saw two men shooting in a stream.

reference_spacy_tokens: The boys were riding bikes with a friend when they saw two men shooting in a stream .


fn_spacy_tokens_for_baseline: Violette , armed only with a sten sub - machine - gun , covered her companions ' retreat through standing corn for twenty minutes until she had no more ammunition , and was taken prisoner .

source_bert_toks: violet ##te , armed only with a ste ##n sub - machine - gun , covered her companions ' retreat through standing corn for twenty minutes until she had no more ammunition , and was taken prisoner .

reference_raw: Violette, armed only with a sten submachine weapon, had covered her companions' withdrawal with standing corn for twenty minutes, until she had no more ammunition, and had been captured.

reference_spacy_tokens: Violette , armed only with a sten submachine weapon , had covered her companions ' withdrawal with standing corn for twenty minutes , until she had no more ammunition , and had been captured .


fn_spacy_tokens_for_baseline: It confirmed , and I had long suspected as much , that bream do in fact have a leader .

source_bert_toks: it confirmed , and i had long suspected as much , that br ##ea ##m do in fact have a leader .

reference_raw: It confirmed, and I've known for a long time, that the cream actually has a leader.

reference_spacy_tokens: It confirmed , and I 've known for a long time , that the cream actually has a leader .


fn_spacy_tokens_for_baseline: Members of a trade regularly brought together in workplace or community could acknowledge regular leaders and develop and insist on customary work practices without embedding any of this in formal regulations and procedures .

source_bert_toks: members of a trade regularly brought together in workplace or community could acknowledge regular leaders and develop and insist on customary work practices without em ##bed ##ding any of this in formal regulations and procedures .

reference_raw: Members of a business that is regularly brought together in the workplace or in the community could recognise regular leaders and develop and insist on normal working practices, without including any of this in formal regulations and procedures.

reference_spacy_tokens: Members of a business that is regularly brought together in the workplace or in the community could recognise regular leaders and develop and insist on normal working practices , without including any of this in formal regulations and procedures .


fn_spacy_tokens_for_baseline: So far as his own understanding of Jesus himself was concerned , however , Baur resembled Biedermann : Jesus was the exemplary embodiment of an ' idea ' .

source_bert_toks: so far as his own understanding of jesus himself was concerned , however , ba ##ur resembled bi ##ede ##rman ##n : jesus was the exemplary em ##bo ##diment of an ' idea ' .

reference_raw: But as for his own understanding of Jesus, Baur reminded him of Biedermann: Jesus was an example of an idea.

reference_spacy_tokens: But as for his own understanding of Jesus , Baur reminded him of Biedermann : Jesus was an example of an idea .


fn_spacy_tokens_for_baseline: Its job was to listen to the endless babble of East German and Russian radio chit - chat from across the border .

source_bert_toks: its job was to listen to the endless ba ##bble of east german and russian radio chi ##t - chat from across the border .

reference_raw: His job was to hear the endless chatter of East German and Russian radio chatter from across the border.

reference_spacy_tokens: His job was to hear the endless chatter of East German and Russian radio chatter from across the border .


fn_spacy_tokens_for_baseline: Dana fended her off , stalking past her into the living - room .

source_bert_toks: dana fen ##ded her off , stalking past her into the living - room .

reference_raw: Dana pushed her away and walked past her into the living room.

reference_spacy_tokens: Dana pushed her away and walked past her into the living room .


fn_spacy_tokens_for_baseline: These bare poles are all that remains of the jungle that the lake drowned as the waters rose behind the dam .

source_bert_toks: these bare poles are all that remains of the jungle that the lake drowned as the waters rose behind the dam .

reference_raw: These barren poles are all that's left of the jungle that the lake drowned when the water came up behind the dam.

reference_spacy_tokens: These barren poles are all that 's left of the jungle that the lake drowned when the water came up behind the dam .


fn_spacy_tokens_for_baseline: During the Cold War , for example , the United States and the Soviet Union each supported sub - national groups engaged in proxy wars .

source_bert_toks: during the cold war , for example , the united states and the soviet union each supported sub - national groups engaged in proxy wars .

reference_raw: During the Cold War, for example, the United States and the Soviet Union have all encouraged sub-national groups involved in proxy wars.

reference_spacy_tokens: During the Cold War , for example , the United States and the Soviet Union have all encouraged sub - national groups involved in proxy wars .


fn_spacy_tokens_for_baseline: The public bar had filled considerably and the general clatter of laughter and bustle all added to the good feeling of anticipation which was beginning to invade Yanto .

source_bert_toks: the public bar had filled considerably and the general cl ##atter of laughter and bust ##le all added to the good feeling of anticipation which was beginning to invade yan ##to .

reference_raw: The public bar was full, and the general sound of laughter and noise added to the good sense of anticipation that had begun to attack Yanto.

reference_spacy_tokens: The public bar was full , and the general sound of laughter and noise added to the good sense of anticipation that had begun to attack Yanto .


fn_spacy_tokens_for_baseline: Though it was initially named the Rapid Reaction Force , an internal U.N. memo went out and posters were printed up last week calling it simply the reaction force .

source_bert_toks: though it was initially named the rapid reaction force , an internal u . n . memo went out and posters were printed up last week calling it simply the reaction force .

reference_raw: Although originally referred to as the Rapid Reaction Force, the internal UN memo went out, and the posters were published last week, calling it simply a reaction force.

reference_spacy_tokens: Although originally referred to as the Rapid Reaction Force , the internal UN memo went out , and the posters were published last week , calling it simply a reaction force .


fn_spacy_tokens_for_baseline: Although the foreign ministry was apparently in favor of participating in the regime , the military was opposed , and Kim Chong Il apparently sided with the latter .

source_bert_toks: although the foreign ministry was apparently in favor of participating in the regime , the military was opposed , and kim chong il apparently sided with the latter .

reference_raw: Though the Ministry of Foreign Affairs seemed to be in favour of participating in the regime, the army was against it, and Kim Chong II seemed to be on the other hand.

reference_spacy_tokens: Though the Ministry of Foreign Affairs seemed to be in favour of participating in the regime , the army was against it , and Kim Chong II seemed to be on the other hand .


fn_spacy_tokens_for_baseline: They 're also pretty peeved at what they see as the Ministry of Agriculture 's failure to represent their interests adequately in Brussels .

source_bert_toks: they ' re also pretty pee ##ved at what they see as the ministry of agriculture ' s failure to represent their interests adequately in brussels .

reference_raw: They are also very concerned about what they see as a lack of adequate representation of their interests by the Ministry of Agriculture in Brussels.

reference_spacy_tokens: They are also very concerned about what they see as a lack of adequate representation of their interests by the Ministry of Agriculture in Brussels .


fn_spacy_tokens_for_baseline: The Yuppies presage the New Age .

source_bert_toks: the yu ##pp ##ies pre ##sa ##ge the new age .

reference_raw: The Yuppies are prescribing a new age.

reference_spacy_tokens: The Yuppies are prescribing a new age .


fn_spacy_tokens_for_baseline: They reached Catte Street and Corbett decided they should stay in the tavern where they had stabled their horses .

source_bert_toks: they reached cat ##te street and corbett decided they should stay in the tavern where they had stable ##d their horses .

reference_raw: They reached Catte Street and Corbett decided to stay in the pub where the horses had been stabilized.

reference_spacy_tokens: They reached Catte Street and Corbett decided to stay in the pub where the horses had been stabilized .


fn_spacy_tokens_for_baseline: He realised he was spooking himself unnecessarily and mentally kicked his own shin .

source_bert_toks: he realised he was sp ##ook ##ing himself un ##ne ##ces ##sari ##ly and mentally kicked his own shin .

reference_raw: He realized that he was trying to scare himself and kicked his own shin inwardly.

reference_spacy_tokens: He realized that he was trying to scare himself and kicked his own shin inwardly .


fn_spacy_tokens_for_baseline: The structure of a dolphin flipper resembles the bone structure of an arm and hand with lingers , and a dolphin still has pelvic bones and remains of hipbones that once held limbs .

source_bert_toks: the structure of a dolphin flip ##per resembles the bone structure of an arm and hand with linger ##s , and a dolphin still has pe ##l ##vic bones and remains of hip ##bone ##s that once held limbs .

reference_raw: The structure of the dolphin fin is similar to the bone structure of the arm and arm with the lingerie, and the dolphin still has the pelvic bones and the remains of the hipbones that once held the limbs.

reference_spacy_tokens: The structure of the dolphin fin is similar to the bone structure of the arm and arm with the lingerie , and the dolphin still has the pelvic bones and the remains of the hipbones that once held the limbs .


fn_spacy_tokens_for_baseline: These events led directly to Carter 's most testing challenge when in November 1979 a gang of young Muslim revolutionaries stormed the American embassy in Tehran and seized about 100 Americans .

source_bert_toks: these events led directly to carter ' s most testing challenge when in november 1979 a gang of young muslim revolutionaries stormed the american embassy in tehran and seized about 100 americans .

reference_raw: These events led directly to Carter's greatest test challenge when, in November 1979, a group of young Muslim revolutionaries invaded the U.S. embassy in Tehran and captured about a hundred Americans.

reference_spacy_tokens: These events led directly to Carter 's greatest test challenge when , in November 1979 , a group of young Muslim revolutionaries invaded the U.S. embassy in Tehran and captured about a hundred Americans .


fn_spacy_tokens_for_baseline: Readers Packs come in an easy - to - store form and can be shelved just like a book .

source_bert_toks: readers packs come in an easy - to - store form and can be she ##lved just like a book .

reference_raw: Readers Packs come in easy-to-store form and can be stacked in the same way as a book.

reference_spacy_tokens: Readers Packs come in easy - to - store form and can be stacked in the same way as a book .


fn_spacy_tokens_for_baseline: The alliance became known as the Delian League .

source_bert_toks: the alliance became known as the del ##ian league .

reference_raw: The Alliance has become known as the Delian Union.

reference_spacy_tokens: The Alliance has become known as the Delian Union .


fn_spacy_tokens_for_baseline: The JVP , fighting to overthrow the government for the past two - and - a - half years , did not respect the ceasefire , first imposed by the government for 72 hours on 27 September .

source_bert_toks: the j ##v ##p , fighting to overthrow the government for the past two - and - a - half years , did not respect the ceasefire , first imposed by the government for 72 hours on 27 september .

reference_raw: The JVP, which fought for the last two and a half years to bring down the government, failed to comply with the truce that the government first imposed for 72 hours on 27 September.

reference_spacy_tokens: The JVP , which fought for the last two and a half years to bring down the government , failed to comply with the truce that the government first imposed for 72 hours on 27 September .


fn_spacy_tokens_for_baseline: ' They 've forecast terrible weather .

source_bert_toks: ' they ' ve forecast terrible weather .

reference_raw: 'They predict terrible weather.

reference_spacy_tokens: ' They predict terrible weather .


fn_spacy_tokens_for_baseline: The rest of the year , life goes on at its accustomed pace : rickety machines chugging in two - man factories , children in school uniforms being ferried home to houseboats , and the old fishermen stirring shrimp paste .

source_bert_toks: the rest of the year , life goes on at its accustomed pace : rick ##ety machines chu ##gging in two - man factories , children in school uniforms being fe ##rrie ##d home to house ##boats , and the old fishermen stirring shrimp paste .

reference_raw: Life goes on for the rest of the year at the usual rate: rickety machines chugging in two-man factories, children in school uniforms being ferried home to houseboats, and old fishermen mixing shrimp paste.

reference_spacy_tokens: Life goes on for the rest of the year at the usual rate : rickety machines chugging in two - man factories , children in school uniforms being ferried home to houseboats , and old fishermen mixing shrimp paste .


fn_spacy_tokens_for_baseline: Not even the screams of the wounded and the moans of the dying broke the hush .

source_bert_toks: not even the screams of the wounded and the moans of the dying broke the hush .

reference_raw: The silence was not broken by the screams of the wounded and the groans of the dying.

reference_spacy_tokens: The silence was not broken by the screams of the wounded and the groans of the dying .


fn_spacy_tokens_for_baseline: Mr Stanton has some worthy thoughts on how to ensure the safety and soundness of these shadowy leviathans .

source_bert_toks: mr stanton has some worthy thoughts on how to ensure the safety and sound ##ness of these shadowy levi ##athan ##s .

reference_raw: Mr. Stanton has some good ideas about how to make these dark leviathans safe and sound.

reference_spacy_tokens: Mr. Stanton has some good ideas about how to make these dark leviathans safe and sound .


fn_spacy_tokens_for_baseline: He went forward , trees whispering behind him , the face with its knotted eyes lurching in his arms .

source_bert_toks: he went forward , trees whispering behind him , the face with its knotted eyes lu ##rch ##ing in his arms .

reference_raw: He stepped forward, the trees rustling behind him, and his face, his eyes narrowed in his arms.

reference_spacy_tokens: He stepped forward , the trees rustling behind him , and his face , his eyes narrowed in his arms .


fn_spacy_tokens_for_baseline: The old gentleman looked at him with an expression of dislike .

source_bert_toks: the old gentleman looked at him with an expression of dislike .

reference_raw: The old man looked at him with a look of displeasure.

reference_spacy_tokens: The old man looked at him with a look of displeasure .


fn_spacy_tokens_for_baseline: Ricci sat slouched in his chair , holding his Stradivarius , and nodded to me to start .

source_bert_toks: ric ##ci sat sl ##ou ##ched in his chair , holding his st ##rad ##ivar ##ius , and nodded to me to start .

reference_raw: Ricci sat slumped back in his chair, holding his Stradivarius, and motioned for me to begin.

reference_spacy_tokens: Ricci sat slumped back in his chair , holding his Stradivarius , and motioned for me to begin .


fn_spacy_tokens_for_baseline: There was no longer any carpet underfoot -- merely drugget , a material he recalled from nineteenth - century novels dealing with servants ' quarters .

source_bert_toks: there was no longer any carpet under ##foot - - merely drug ##get , a material he recalled from nineteenth - century novels dealing with servants ' quarters .

reference_raw: There was no carpet beneath his feet, just a drugget, the stuff he remembered from the nineteenth-century novels about the servants' quarters.

reference_spacy_tokens: There was no carpet beneath his feet , just a drugget , the stuff he remembered from the nineteenth - century novels about the servants ' quarters .


fn_spacy_tokens_for_baseline: ' Oh , Luke , ' she groaned , her eyes still closed and the tormenting vision still vivid on her mind .

source_bert_toks: ' oh , luke , ' she groaned , her eyes still closed and the torment ##ing vision still vivid on her mind .

reference_raw: 'Ah, Luke,' she moaned, her eyes still closed, her tortured vision still alive.

reference_spacy_tokens: ' Ah , Luke , ' she moaned , her eyes still closed , her tortured vision still alive .


fn_spacy_tokens_for_baseline: Pyongyang agreed to " suspend " its withdrawal while talks continued with Washington , but claimed to have a special status in regard to its nuclear safeguards commitments .

source_bert_toks: p ##yon ##gy ##ang agreed to " suspend " its withdrawal while talks continued with washington , but claimed to have a special status in regard to its nuclear safeguard ##s commitments .

reference_raw: Pyongyang agreed to "suspend" his withdrawal while the talks continued with Washington, but claimed that he had a special status with respect to his nuclear security obligations.

reference_spacy_tokens: Pyongyang agreed to " suspend " his withdrawal while the talks continued with Washington , but claimed that he had a special status with respect to his nuclear security obligations .


fn_spacy_tokens_for_baseline: There have been cases , fortunately rare , where children have been indecently assaulted at school by parent helpers .

source_bert_toks: there have been cases , fortunately rare , where children have been ind ##ece ##ntly assaulted at school by parent help ##ers .

reference_raw: There were cases, fortunately rare, where children were rudely attacked by parents' helpers in school.

reference_spacy_tokens: There were cases , fortunately rare , where children were rudely attacked by parents ' helpers in school .


fn_spacy_tokens_for_baseline: Apart from the possibility of injuring their teeth quite badly by trying to gnaw them , there is also the distinct likelihood that some will be swallowed , causing an intestinal blockage .

source_bert_toks: apart from the possibility of injuring their teeth quite badly by trying to g ##na ##w them , there is also the distinct likelihood that some will be swallowed , causing an int ##estinal block ##age .

reference_raw: In addition to the possibility of getting their teeth hurt quite badly by trying to bite them, there is also a clear chance that some of them will be swallowed, causing an intestinal blockage.

reference_spacy_tokens: In addition to the possibility of getting their teeth hurt quite badly by trying to bite them , there is also a clear chance that some of them will be swallowed , causing an intestinal blockage .


fn_spacy_tokens_for_baseline: AMMAN , Jordan ( AP ) U.S. Representative Tony Hall arrived in Jordan on Saturday en route to Iraq , where he is expected to look into the plight of Iraqis after nearly 10 years of U.N. trade sanctions .

source_bert_toks: amman , jordan ( ap ) u . s . representative tony hall arrived in jordan on saturday en route to iraq , where he is expected to look into the plight of iraqi ##s after nearly 10 years of u . n . trade sanctions .

reference_raw: AMMAN, Jordan (AP) US representative Tony Hall arrived in Jordan on Saturday on his way to Iraq, where he is expected to look into the situation of Iraqis after almost 10 years of UN trade penalties.

reference_spacy_tokens: AMMAN , Jordan ( AP ) US representative Tony Hall arrived in Jordan on Saturday on his way to Iraq , where he is expected to look into the situation of Iraqis after almost 10 years of UN trade penalties .


fn_spacy_tokens_for_baseline: On official tests , the Turbo Diesel betters the normally aspirated ZX Diesel with 65.7mpg as compared with 64.2mpg at a constant 56 mph .

source_bert_toks: on official tests , the turbo diesel better ##s the normally as ##pi ##rated z ##x diesel with 65 . 7 ##mp ##g as compared with 64 . 2 ##mp ##g at a constant 56 ##mp ##h .

reference_raw: On official tests, Turbo Diesel improves the normally aspirated ZX Diesel with 65.7mpg compared to 64.2mpg with a constant 56mph.

reference_spacy_tokens: On official tests , Turbo Diesel improves the normally aspirated ZX Diesel with 65.7mpg compared to 64.2mpg with a constant 56 mph .


fn_spacy_tokens_for_baseline: Intrigued , Tallis left the old man for a while and ventured through the intervening wood .

source_bert_toks: intrigued , tall ##is left the old man for a while and ventured through the intervening wood .

reference_raw: Intriguingly, Tallis left the old man for a moment and risked his way through the wood.

reference_spacy_tokens: Intriguingly , Tallis left the old man for a moment and risked his way through the wood .


fn_spacy_tokens_for_baseline: The one with Bill Dean aka Harry Cross on the cover

source_bert_toks: the one with bill dean aka harry cross on the cover

reference_raw: The one on the cover with Bill Dean a.k.a. Harry Cross.

reference_spacy_tokens: The one on the cover with Bill Dean a.k.a . Harry Cross .


fn_spacy_tokens_for_baseline: She smiled , her jaw aching from the effort of holding back the tears .

source_bert_toks: she smiled , her jaw aching from the effort of holding back the tears .

reference_raw: She smiled, and her jaw hurt as she tried to hold back her tears.

reference_spacy_tokens: She smiled , and her jaw hurt as she tried to hold back her tears .


fn_spacy_tokens_for_baseline: She rose , tripping round the table as if Benjamin had asked her for a dance .

source_bert_toks: she rose , trip ##ping round the table as if benjamin had asked her for a dance .

reference_raw: She stood up and stumbled around the table, as if Benjamin had asked her to dance.

reference_spacy_tokens: She stood up and stumbled around the table , as if Benjamin had asked her to dance .


fn_spacy_tokens_for_baseline: Rodriguez thought they must all look like big , hairless teddy - bears romping over the dunes .

source_bert_toks: rodriguez thought they must all look like big , hair ##less teddy - bears rom ##ping over the dunes .

reference_raw: Rodriguez thought that they must all look like large, hairless bears roaming over the dunes.

reference_spacy_tokens: Rodriguez thought that they must all look like large , hairless bears roaming over the dunes .


fn_spacy_tokens_for_baseline: About 20 firemen , many wearing breathing apparatus , tackled the blaze at Manor House Farm , North Otterington , near Northallerton .

source_bert_toks: about 20 fire ##men , many wearing breathing apparatus , tackled the blaze at manor house farm , north otter ##ington , near north ##alle ##rton .

reference_raw: About twenty firefighters, many of them wearing breathing machines, fought the fire at the Manor House farm in North Otterington near Northallerton.

reference_spacy_tokens: About twenty firefighters , many of them wearing breathing machines , fought the fire at the Manor House farm in North Otterington near Northallerton .


fn_spacy_tokens_for_baseline: Whichever , I have to warn that the use of the names of the months in describing food is no longer permitted by EEC regulations .

source_bert_toks: whichever , i have to warn that the use of the names of the months in describing food is no longer permitted by ee ##c regulations .

reference_raw: However, I must warn you that the use of the names of the months in the description of foodstuffs is no longer allowed by the EEC regulations.

reference_spacy_tokens: However , I must warn you that the use of the names of the months in the description of foodstuffs is no longer allowed by the EEC regulations .


fn_spacy_tokens_for_baseline: But Great - Aunt Alicia had always been famous for her absurdities .

source_bert_toks: but great - aunt alicia had always been famous for her absurd ##ities .

reference_raw: But great aunt Alicia was always famous for her preposterousness.

reference_spacy_tokens: But great aunt Alicia was always famous for her preposterousness .


fn_spacy_tokens_for_baseline: The chef makes tasty bread rolls and grows his own herbs .

source_bert_toks: the chef makes ta ##sty bread rolls and grows his own herbs .

reference_raw: Chef makes delicious bread rolls and grows his own herbs.

reference_spacy_tokens: Chef makes delicious bread rolls and grows his own herbs .


fn_spacy_tokens_for_baseline: The rest of the females will butt him .. until his liver is pulverised . '

source_bert_toks: the rest of the females will butt him . . until his liver is pu ##lver ##ised . '

reference_raw: The other women will assimilate him . . . until his liver is crushed.'

reference_spacy_tokens: The other women will assimilate him . . . until his liver is crushed . '


fn_spacy_tokens_for_baseline: These include specialist drugs , such as erythropoietin and growth hormone , being moved from hospital to primary care , mostly because hospitals are cash limited and primary care budgets are not .

source_bert_toks: these include specialist drugs , such as er ##yt ##hr ##op ##oi ##eti ##n and growth hormone , being moved from hospital to primary care , mostly because hospitals are cash limited and primary care budgets are not .

reference_raw: These include specialised drugs, such as erythropoietin and growth hormone, which are transferred from the infirmary to primary care, mainly due to the lack of cash and the lack of primary care budgets.

reference_spacy_tokens: These include specialised drugs , such as erythropoietin and growth hormone , which are transferred from the infirmary to primary care , mainly due to the lack of cash and the lack of primary care budgets .


fn_spacy_tokens_for_baseline: We went together to Lantau , and travelled on a really hair - raising bus journey to a Buddhist monastery in the mountains .

source_bert_toks: we went together to lan ##ta ##u , and travelled on a really hair - raising bus journey to a buddhist monastery in the mountains .

reference_raw: We went to Lantau together and took a really hairy bus trip to a Buddhist monastery in the mountains.

reference_spacy_tokens: We went to Lantau together and took a really hairy bus trip to a Buddhist monastery in the mountains .


fn_spacy_tokens_for_baseline: I begin with a rather trivial example .

source_bert_toks: i begin with a rather trivial example .

reference_raw: I'm starting with a rather small example.

reference_spacy_tokens: I 'm starting with a rather small example .


fn_spacy_tokens_for_baseline: Poindexter 's conviction was quashed in a split two - to - one judgement on the grounds that the recollection of trial witnesses had been tainted by testimony which he had given before Congress under immunity in 1987 .

source_bert_toks: po ##ind ##ex ##ter ' s conviction was qu ##ash ##ed in a split two - to - one judgement on the grounds that the rec ##oll ##ection of trial witnesses had been tainted by testimony which he had given before congress under immunity in 1987 .

reference_raw: Poindexter's sentence was quashed by a split two-to-one judgment on the ground that the memory of the witnesses in the trial was corrupted by the testimony he gave to Congress in 1987 under immunity.

reference_spacy_tokens: Poindexter 's sentence was quashed by a split two - to - one judgment on the ground that the memory of the witnesses in the trial was corrupted by the testimony he gave to Congress in 1987 under immunity .


fn_spacy_tokens_for_baseline: After he got home to Scotland he would write about Elsie , perhaps not just for the paper but for himself too .

source_bert_toks: after he got home to scotland he would write about elsie , perhaps not just for the paper but for himself too .

reference_raw: When he got back to Scotland, he'd say something about Elsie, maybe not just because of the newspaper, but because of himself.

reference_spacy_tokens: When he got back to Scotland , he 'd say something about Elsie , maybe not just because of the newspaper , but because of himself .


fn_spacy_tokens_for_baseline: Pat LaCrosse asked me to send this information inviting you to join the Georgia O'Keeffe Circle of the Indianapolis Museum of Art 's Second Century Society ( SCS ) .

source_bert_toks: pat lacrosse asked me to send this information inviting you to join the georgia o ' ke ##ef ##fe circle of the indianapolis museum of art ' s second century society ( sc ##s ) .

reference_raw: Pat LaCrosse has asked me to send you this information in order to join the Georgia O'Keeffe Circle of the Indianapolis Museum of Arts in the Second Century Society.

reference_spacy_tokens: Pat LaCrosse has asked me to send you this information in order to join the Georgia O'Keeffe Circle of the Indianapolis Museum of Arts in the Second Century Society .


fn_spacy_tokens_for_baseline: He was hospitalized again on April 3 in a Soviet military hospital outside Berlin .

source_bert_toks: he was hospitalized again on april 3 in a soviet military hospital outside berlin .

reference_raw: On April 3rd, he was re-instituted at a Soviet military hospital outside Berlin.

reference_spacy_tokens: On April 3rd , he was re - instituted at a Soviet military hospital outside Berlin .


fn_spacy_tokens_for_baseline: The way the International Cricket Council ducked the issue whether Pakistan 's fast bowlers were doctoring the ball would have shamed Pontius Pilate .

source_bert_toks: the way the international cricket council ducked the issue whether pakistan ' s fast bowler ##s were doctor ##ing the ball would have shame ##d pont ##ius pi ##late .

reference_raw: The way the International Cricket Council avoided the question of whether Pakistan's fast bowlers doctored the ball would shame Pontius Pilate.

reference_spacy_tokens: The way the International Cricket Council avoided the question of whether Pakistan 's fast bowlers doctored the ball would shame Pontius Pilate .


fn_spacy_tokens_for_baseline: Between the stones , the girls saw a small heap of coal .

source_bert_toks: between the stones , the girls saw a small heap of coal .

reference_raw: The girls saw a small pile of coal between the rocks.

reference_spacy_tokens: The girls saw a small pile of coal between the rocks .


fn_spacy_tokens_for_baseline: The main thing to cut is saturated fat which can cause high blood cholesterol levels , leading to clogged up arteries and potentially a heart attack or stroke .

source_bert_toks: the main thing to cut is saturated fat which can cause high blood cho ##les ##terol levels , leading to cl ##og ##ged up arteries and potentially a heart attack or stroke .

reference_raw: The most important thing to cut is saturated fat, which can cause high levels of cholesterol in the blood, leading to a clogging of the arteries and possibly a heart attack or stroke.

reference_spacy_tokens: The most important thing to cut is saturated fat , which can cause high levels of cholesterol in the blood , leading to a clogging of the arteries and possibly a heart attack or stroke .


fn_spacy_tokens_for_baseline: Having handed her suitcase up to Tucker , she clambered ashore and retrieved it from him .

source_bert_toks: having handed her suitcase up to tucker , she cl ##am ##bered ashore and retrieved it from him .

reference_raw: When she handed the suitcase to Tucker, she climbed ashore and took it from him.

reference_spacy_tokens: When she handed the suitcase to Tucker , she climbed ashore and took it from him .


fn_spacy_tokens_for_baseline: Presentations were later made at Afternoon Parties but these too were discontinued in 1958 .

source_bert_toks: presentations were later made at afternoon parties but these too were discontinued in 1958 .

reference_raw: The presentations were later made at the afternoon parties, but they were also suspended in 1958.

reference_spacy_tokens: The presentations were later made at the afternoon parties , but they were also suspended in 1958 .


fn_spacy_tokens_for_baseline: Allen called it the " first intergalactic screw - up . "

source_bert_toks: allen called it the " first inter ##gal ##actic screw - up . "

reference_raw: Allen called it "the first intergalactic failure."

reference_spacy_tokens: Allen called it " the first intergalactic failure . "


fn_spacy_tokens_for_baseline: " [ Saddam ] , being a parolee , is not in a position to determine who his parole officer will be . "

source_bert_toks: " [ saddam ] , being a parole ##e , is not in a position to determine who his parole officer will be . "

reference_raw: "As a probationary official, [Saddam] can't decide who his curator will be."

reference_spacy_tokens: " As a probationary official , [ Saddam ] ca n't decide who his curator will be . "


fn_spacy_tokens_for_baseline: Left alone , she admired Katarina 's beautiful jewelled brocade dress beneath the heavy wool cape .

source_bert_toks: left alone , she admired kata ##rina ' s beautiful jewel ##led bro ##cade dress beneath the heavy wool cape .

reference_raw: Left alone, she admired Katarina's beautiful, jewelled brocade dress under a heavy wool cloak.

reference_spacy_tokens: Left alone , she admired Katarina 's beautiful , jewelled brocade dress under a heavy wool cloak .


fn_spacy_tokens_for_baseline: Jake rose to his feet , smiling , throwing off his anger like a mantle .

source_bert_toks: jake rose to his feet , smiling , throwing off his anger like a mantle .

reference_raw: Jake stood up, smiled, and dropped his anger like a cloak.

reference_spacy_tokens: Jake stood up , smiled , and dropped his anger like a cloak .


fn_spacy_tokens_for_baseline: This is vintage Saddam : over the past 21 years he has swung between killing Iraqi Kurds and offering them more self - rule than the Kurds in Turkey , Iran or Syria can dream of .

source_bert_toks: this is vintage saddam : over the past 21 years he has swung between killing iraqi ku ##rds and offering them more self - rule than the ku ##rds in turkey , iran or syria can dream of .

reference_raw: This is Vintage Saddam: in the last 21 years, he's gone from killing Iraqi Kurds to offering them more self-rule than the Kurds in Turkey, Iran, or Syria can imagine.

reference_spacy_tokens: This is Vintage Saddam : in the last 21 years , he 's gone from killing Iraqi Kurds to offering them more self - rule than the Kurds in Turkey , Iran , or Syria can imagine .


fn_spacy_tokens_for_baseline: It publishes just a picture of the Italian ' Pendolino ' referring to it as a ' prototype ' in the caption .

source_bert_toks: it publishes just a picture of the italian ' pen ##do ##lino ' referring to it as a ' prototype ' in the capt ##ion .

reference_raw: It only publishes a photo of the Italian "Pendolino" that says "prototype" on the label.

reference_spacy_tokens: It only publishes a photo of the Italian " Pendolino " that says " prototype " on the label .


fn_spacy_tokens_for_baseline: Another place of worship was built in 1828 for the Methodists but as attendances dwindled in the 1970s it was decided to share with Christ church , a facility which made economic sense .

source_bert_toks: another place of worship was built in 1828 for the methodist ##s but as attendance ##s d ##wind ##led in the 1970s it was decided to share with christ church , a facility which made economic sense .

reference_raw: Another place of worship was built for the Methodists in 1828, but as attendance diminished in the 1970s, it was decided to share with the Church of Christ, a device that made economic sense.

reference_spacy_tokens: Another place of worship was built for the Methodists in 1828 , but as attendance diminished in the 1970s , it was decided to share with the Church of Christ , a device that made economic sense .


fn_spacy_tokens_for_baseline: He saw Maud once in the Kurfurstendamm , eating alone in a cafe and looking a little desolate , with a stack of coins already piled beside her plate although her meal had only just come .

source_bert_toks: he saw maud once in the ku ##rf ##urst ##end ##am ##m , eating alone in a cafe and looking a little des ##olate , with a stack of coins already piled beside her plate although her meal had only just come .

reference_raw: Once he saw Maud in the Kurfurstendamm, eating alone in a coffee shop, looking a little deserted, with a pile of coins stacked beside her plate, though her food had just arrived.

reference_spacy_tokens: Once he saw Maud in the Kurfurstendamm , eating alone in a coffee shop , looking a little deserted , with a pile of coins stacked beside her plate , though her food had just arrived .


fn_spacy_tokens_for_baseline: His resignation was followed by the expulsion from the Communist Party of its former leader , Mr Milos Jakes .

source_bert_toks: his resignation was followed by the expulsion from the communist party of its former leader , mr milos jake ##s .

reference_raw: His resignation was followed by the removal of his former leader, Mr. Milos Jakes, from the Communist Party.

reference_spacy_tokens: His resignation was followed by the removal of his former leader , Mr. Milos Jakes , from the Communist Party .


fn_spacy_tokens_for_baseline: On each landing , opposite the lift - shaft , the poster with the enormous face gazed from the wall .

source_bert_toks: on each landing , opposite the lift - shaft , the poster with the enormous face gazed from the wall .

reference_raw: On each landing, across from the elevator shaft, a poster with a huge face looked out from the wall.

reference_spacy_tokens: On each landing , across from the elevator shaft , a poster with a huge face looked out from the wall .


fn_spacy_tokens_for_baseline: As the numbers of records increase , the problem of waiting for a reply to a query until the whole of a serial file has been searched increases in proportion , and eventually this delay becomes unacceptable .

source_bert_toks: as the numbers of records increase , the problem of waiting for a reply to a query until the whole of a serial file has been searched increases in proportion , and eventually this delay becomes unacceptable .

reference_raw: As the number of records grows, the problem of waiting for the answer to the question until the entire serial file is searched increases in proportion, and in the end, the delay becomes unacceptable.

reference_spacy_tokens: As the number of records grows , the problem of waiting for the answer to the question until the entire serial file is searched increases in proportion , and in the end , the delay becomes unacceptable .


fn_spacy_tokens_for_baseline: Our afternoon lessons began at a quarter - to - two , and if the express did not run on time , I ran the risk of being late for roll call .

source_bert_toks: our afternoon lessons began at a quarter - to - two , and if the express did not run on time , i ran the risk of being late for roll call .

reference_raw: Our afternoon class started at a quarter to two, and if the express didn't run on time, I risked being delayed for a roll call.

reference_spacy_tokens: Our afternoon class started at a quarter to two , and if the express did n't run on time , I risked being delayed for a roll call .


fn_spacy_tokens_for_baseline: Barefoot , she padded into her cramped kitchen and took a can of Coke from the refrigerator .

source_bert_toks: barefoot , she padded into her cramped kitchen and took a can of coke from the refrigerator .

reference_raw: Barefoot, she padded into her cramped kitchen and took a tin of Coke out of the fridge.

reference_spacy_tokens: Barefoot , she padded into her cramped kitchen and took a tin of Coke out of the fridge .


fn_spacy_tokens_for_baseline: Stephen shrugged his shoulders .

source_bert_toks: stephen shrugged his shoulders .

reference_raw: Stephen shook his head.

reference_spacy_tokens: Stephen shook his head .


fn_spacy_tokens_for_baseline: They need only position themselves near a company 's satellite dish and wait .

source_bert_toks: they need only position themselves near a company ' s satellite dish and wait .

reference_raw: All they need to do is sit close to the company's satellite dish and wait.

reference_spacy_tokens: All they need to do is sit close to the company 's satellite dish and wait .


fn_spacy_tokens_for_baseline: Snacks , salads , and a four- or five - course dinner using fresh and local produce and home - grown herbs and vegetables are provided .

source_bert_toks: snacks , salad ##s , and a four - or five - course dinner using fresh and local produce and home - grown herbs and vegetables are provided .

reference_raw: Snacks, lettuces and a four- or five-course meal with fresh and local products and home-grown plants and vegetables are available.

reference_spacy_tokens: Snacks , lettuces and a four- or five - course meal with fresh and local products and home - grown plants and vegetables are available .


fn_spacy_tokens_for_baseline: Go out and treat yourself to a new revealing swimsuit so you have got something to aim for .

source_bert_toks: go out and treat yourself to a new revealing swim ##suit so you have got something to aim for .

reference_raw: Go out and treat yourself to a new revealing bathing suit, so you have something to aim for.

reference_spacy_tokens: Go out and treat yourself to a new revealing bathing suit , so you have something to aim for .


fn_spacy_tokens_for_baseline: Bratby was intrigued by Minton and soon after he got to know him painted a huge picture on paper , entitled ' Homage to John Minton ' .

source_bert_toks: brat ##by was intrigued by mint ##on and soon after he got to know him painted a huge picture on paper , entitled ' homage to john mint ##on ' .

reference_raw: Bratby was fascinated by Minton, and soon after he met him, he drew a large picture on paper called "Homage to John Minton."

reference_spacy_tokens: Bratby was fascinated by Minton , and soon after he met him , he drew a large picture on paper called " Homage to John Minton . "


fn_spacy_tokens_for_baseline: This time his kiss was a little more forceful , it lasted longer , and she felt the first light outbreak of heat on his skin .

source_bert_toks: this time his kiss was a little more forceful , it lasted longer , and she felt the first light outbreak of heat on his skin .

reference_raw: This time his kiss was stronger, it took longer, and she could feel the first light of the heat on his skin.

reference_spacy_tokens: This time his kiss was stronger , it took longer , and she could feel the first light of the heat on his skin .


fn_spacy_tokens_for_baseline: To take a single indicative example that this might be so we can turn our attention to a star cluster named by the ancient Greeks the Pleiades , or Seven Sisters .

source_bert_toks: to take a single indicative example that this might be so we can turn our attention to a star cluster named by the ancient greeks the pl ##eia ##des , or seven sisters .

reference_raw: Take one illustration that it could be so that we can turn our attention to a cluster of stars named by the ancient Greeks, the Pleiades, or the Seven Sisters.

reference_spacy_tokens: Take one illustration that it could be so that we can turn our attention to a cluster of stars named by the ancient Greeks , the Pleiades , or the Seven Sisters .


fn_spacy_tokens_for_baseline: Being unwritten , the constitution also encourages a piecemeal approach to politics ; an approach that gives little protection against a determined , authoritarian state .

source_bert_toks: being un ##written , the constitution also encourages a piece ##me ##al approach to politics ; an approach that gives little protection against a determined , authoritarian state .

reference_raw: Since the Constitution is not written, it also promotes a partial approach to politics; an approach that provides little protection against a determined and authoritative state.

reference_spacy_tokens: Since the Constitution is not written , it also promotes a partial approach to politics ; an approach that provides little protection against a determined and authoritative state .


fn_spacy_tokens_for_baseline: The couple were in the Caribbean when Soviet President Mikhail Gorbachev was deposed in an abortive coup .

source_bert_toks: the couple were in the caribbean when soviet president mikhail go ##rba ##chev was deposed in an ab ##ort ##ive coup .

reference_raw: The couple were in the Caribbean when Soviet President Mikhail Gorbachev was arrested in an abortive coup.

reference_spacy_tokens: The couple were in the Caribbean when Soviet President Mikhail Gorbachev was arrested in an abortive coup .


fn_spacy_tokens_for_baseline: As for drinks , there would be silvery twirled urns of tea on tap for the grown - ups and milk or fresh lemonade for the young .

source_bert_toks: as for drinks , there would be silvery t ##wi ##rled ur ##ns of tea on tap for the grown - ups and milk or fresh lemon ##ade for the young .

reference_raw: In the case of beverages, there would be silvery twirled tea on the tap for adults and milk, or fresh lemonade for the young.

reference_spacy_tokens: In the case of beverages , there would be silvery twirled tea on the tap for adults and milk , or fresh lemonade for the young .


fn_spacy_tokens_for_baseline: However , much younger and very tender spring lamb traditionally comes into the shops for the Easter weekend .

source_bert_toks: however , much younger and very tender spring lamb traditionally comes into the shops for the easter weekend .

reference_raw: But for Easter weekends, much younger and very tender spring sheep traditionally come to the stores.

reference_spacy_tokens: But for Easter weekends , much younger and very tender spring sheep traditionally come to the stores .


fn_spacy_tokens_for_baseline: As a scientist by training , I see an interesting similarity between the way in which knowledge is developed in science and in educational research .

source_bert_toks: as a scientist by training , i see an interesting similarity between the way in which knowledge is developed in science and in educational research .

reference_raw: As a trained scientist, I see an interesting analogy between the way knowledge is developed in science and in educational research.

reference_spacy_tokens: As a trained scientist , I see an interesting analogy between the way knowledge is developed in science and in educational research .


fn_spacy_tokens_for_baseline: Kevin Walsh scored three times for Sandon ( Billy Hardacre ) in their 4 - 2 win at Croxteth RBL , while in division one , Etnaward ( Franny Hyland 2 , Simon Connolly ) defeated Flat Iron 3 - 1 .

source_bert_toks: kevin walsh scored three times for sand ##on ( billy hard ##ac ##re ) in their 4 - 2 win at cr ##ox ##tet ##h rb ##l , while in division one , et ##na ##ward ( fran ##ny h ##yla ##nd 2 , simon connolly ) defeated flat iron 3 - 1 .

reference_raw: Kevin Walsh scored three times for Sandon (Billy Hardacre) in his four-and-two victory at Croxteth RBL, and Etnaward (Franny Hyland 2, Simon Connolly) defeated Flat Iron 3-1 in Division 1.

reference_spacy_tokens: Kevin Walsh scored three times for Sandon ( Billy Hardacre ) in his four - and - two victory at Croxteth RBL , and Etnaward ( Franny Hyland 2 , Simon Connolly ) defeated Flat Iron 3 - 1 in Division 1 .


fn_spacy_tokens_for_baseline: Still with your arms straight , flex your hands and cross your arms low in front of you , hands together .

source_bert_toks: still with your arms straight , flex your hands and cross your arms low in front of you , hands together .

reference_raw: Still with your arms straight, bend your hands and fold your arms low in front of you, hands together.

reference_spacy_tokens: Still with your arms straight , bend your hands and fold your arms low in front of you , hands together .


fn_spacy_tokens_for_baseline: That is to say , a system could not be cognisant unless it appreciated how intentional changes in its perceptions were constrained by reality .

source_bert_toks: that is to say , a system could not be co ##gni ##sant unless it appreciated how intentional changes in its perceptions were constrained by reality .

reference_raw: That is, the system cannot be cognisable unless it appreciates how deliberate changes in its perceptions are limited to reality.

reference_spacy_tokens: That is , the system can not be cognisable unless it appreciates how deliberate changes in its perceptions are limited to reality .


fn_spacy_tokens_for_baseline: 2429 Marienburg secedes from the Empire after the Burgomeisters collude with Emperor Dieter IV to secure their independence in return for Marienburger gold .

source_bert_toks: 242 ##9 marie ##nburg sec ##edes from the empire after the bu ##rgo ##meister ##s col ##lu ##de with emperor dieter iv to secure their independence in return for marie ##nburg ##er gold .

reference_raw: 2429 Marienburg withdrew from the Imperium after the Burgomeisters met with Emperor Dieter IV to secure their independence in exchange for the gold of Marienburger.

reference_spacy_tokens: 2429 Marienburg withdrew from the Imperium after the Burgomeisters met with Emperor Dieter IV to secure their independence in exchange for the gold of Marienburger .


fn_spacy_tokens_for_baseline: He felt strange being with someone like me who was open with him yet did n't want to be involved .

source_bert_toks: he felt strange being with someone like me who was open with him yet didn ' t want to be involved .

reference_raw: It was a strange feeling to be with someone like me who was honest with him and still didn't want to get involved.

reference_spacy_tokens: It was a strange feeling to be with someone like me who was honest with him and still did n't want to get involved .


fn_spacy_tokens_for_baseline: Persuade this rogue Devlin to return with you .

source_bert_toks: persuade this rogue devlin to return with you .

reference_raw: Convince that rogue Devlin to come back with you.

reference_spacy_tokens: Convince that rogue Devlin to come back with you .


fn_spacy_tokens_for_baseline: About 7,000 Philippine soldiers have been deployed to Basilan in a major offensive , but the 800-strong Abu Sayyaf has eluded capture for months after starting a wave of kidnappings last May.

source_bert_toks: about 7 , 000 philippine soldiers have been deployed to basil ##an in a major offensive , but the 800 - strong abu say ##ya ##f has el ##uded capture for months after starting a wave of kidnapping ##s last may .

reference_raw: About 7,000 Filipino soldiers were deployed to Basilan in a major attack, but the 800-strong Abu Sayyaf escaped captivity for months after the launch of the kidnapping wave last May.

reference_spacy_tokens: About 7,000 Filipino soldiers were deployed to Basilan in a major attack , but the 800-strong Abu Sayyaf escaped captivity for months after the launch of the kidnapping wave last May.


fn_spacy_tokens_for_baseline: Unfortunately , her husband could not reconcile himself to having married a commoner and even taught their sons to be disrespectful to her when they were young .

source_bert_toks: unfortunately , her husband could not reconcile himself to having married a common ##er and even taught their sons to be di ##sr ##es ##pe ##ct ##ful to her when they were young .

reference_raw: Unfortunately, her husband couldn't accept marrying a commoner, and he even taught his sons to be rude to her when they were young.

reference_spacy_tokens: Unfortunately , her husband could n't accept marrying a commoner , and he even taught his sons to be rude to her when they were young .


fn_spacy_tokens_for_baseline: A framework of this nature will incorporate emotional and existential components of pain , as well as the sensory aspects .

source_bert_toks: a framework of this nature will incorporate emotional and existent ##ial components of pain , as well as the sensory aspects .

reference_raw: This framework will include emotional and existential components of pain and sensory aspects.

reference_spacy_tokens: This framework will include emotional and existential components of pain and sensory aspects .


fn_spacy_tokens_for_baseline: Two youths chased each other around a pile of rucksacks and their girls were shrill in encouragement .

source_bert_toks: two youths chased each other around a pile of ru ##cks ##ack ##s and their girls were shrill in encouragement .

reference_raw: The two young men hunted each other around the pile of packs, and their girls were keenly cheered.

reference_spacy_tokens: The two young men hunted each other around the pile of packs , and their girls were keenly cheered .


fn_spacy_tokens_for_baseline: Where ' spontaneous ' pro - government rallies break out just as busloads of journalists escorted by the government arrive in a town .

source_bert_toks: where ' spontaneous ' pro - government rallies break out just as bus ##load ##s of journalists escorted by the government arrive in a town .

reference_raw: Where spontaneous pro-government rallies begin as the busload of journalists escorted by the government arrives in the city.

reference_spacy_tokens: Where spontaneous pro - government rallies begin as the busload of journalists escorted by the government arrives in the city .


fn_spacy_tokens_for_baseline: Eve , 23 , who plays a striker in a men 's team in a BBC drama , said the Chelsea and QPR fans were ' disgusting ' .

source_bert_toks: eve , 23 , who plays a striker in a men ' s team in a bbc drama , said the chelsea and q ##pr fans were ' disgusting ' .

reference_raw: Eve, 23, who was a striker on the men's team in the BBC drama, said that Chelsea and QPR fans were "disgusting."

reference_spacy_tokens: Eve , 23 , who was a striker on the men 's team in the BBC drama , said that Chelsea and QPR fans were " disgusting . "


fn_spacy_tokens_for_baseline: Thus a powerful lexicon is achieved , a storehouse of colour and shape in which repetition , augmentation and alteration become important devices .

source_bert_toks: thus a powerful lexi ##con is achieved , a store ##house of colour and shape in which repetition , aug ##ment ##ation and alteration become important devices .

reference_raw: This leads to a strong lexicon, a warehouse of colour and shape, in which repeating, augmenting and changing become important devices.

reference_spacy_tokens: This leads to a strong lexicon , a warehouse of colour and shape , in which repeating , augmenting and changing become important devices .


fn_spacy_tokens_for_baseline: The Army 's chemical weapons incinerator has passed a milestone , the destruction of 5 million pounds of GB nerve agent .

source_bert_toks: the army ' s chemical weapons inc ##iner ##ator has passed a milestone , the destruction of 5 million pounds of gb nerve agent .

reference_raw: The Army's chemical-weapons incinerator has passed a milestone, destroying five million pounds of GB nerve agent.

reference_spacy_tokens: The Army 's chemical - weapons incinerator has passed a milestone , destroying five million pounds of GB nerve agent .


fn_spacy_tokens_for_baseline: She wanted to cry , but it was too horrible for crying .

source_bert_toks: she wanted to cry , but it was too horrible for crying .

reference_raw: She wanted to cry, but it was too bad to cry.

reference_spacy_tokens: She wanted to cry , but it was too bad to cry .


fn_spacy_tokens_for_baseline: The children shuffled left and right on their bottoms to let him pass .

source_bert_toks: the children shuffled left and right on their bottoms to let him pass .

reference_raw: The children moved left and right to the bottom to let him pass.

reference_spacy_tokens: The children moved left and right to the bottom to let him pass .


fn_spacy_tokens_for_baseline: When Goblin casualties are taken any odd Goblins are always removed first , leaving as many complete pairs as possible .

source_bert_toks: when goblin casualties are taken any odd goblin ##s are always removed first , leaving as many complete pairs as possible .

reference_raw: With the loss of the Goblins, every strange Goblin is always removed first, leaving as many full pairs as possible.

reference_spacy_tokens: With the loss of the Goblins , every strange Goblin is always removed first , leaving as many full pairs as possible .


fn_spacy_tokens_for_baseline: But Sunday Life photographer DARREN KIDD captured the unique atmosphere of last Sunday 's show in Cork -- a permanent souvenir of the garage band that conquered the world .

source_bert_toks: but sunday life photographer darren kidd captured the unique atmosphere of last sunday ' s show in cork - - a permanent so ##uven ##ir of the garage band that conquered the world .

reference_raw: But on Sunday life photographer Darren Kidd captured the unique atmosphere of last Sunday's show in Cork - the permanent souvenir of the garage band that had taken over the world.

reference_spacy_tokens: But on Sunday life photographer Darren Kidd captured the unique atmosphere of last Sunday 's show in Cork - the permanent souvenir of the garage band that had taken over the world .


fn_spacy_tokens_for_baseline: Usually silent away from breeding grounds , where male has a loud harsh bark and a deep hoot , and female a higher - pitched bark .

source_bert_toks: usually silent away from breeding grounds , where male has a loud harsh bark and a deep ho ##ot , and female a higher - pitched bark .

reference_raw: Mostly quiet away from the breeding grounds, where the male has a high-pitched yelp and a deep hoot, and the female has a high-pitched yelp.

reference_spacy_tokens: Mostly quiet away from the breeding grounds , where the male has a high - pitched yelp and a deep hoot , and the female has a high - pitched yelp .


fn_spacy_tokens_for_baseline: As you approach the border , you can glimpse the skyscrapers of Shenzhen .

source_bert_toks: as you approach the border , you can glimpse the skyscraper ##s of shenzhen .

reference_raw: As you approach the frontier, you can see Shenzhen's skyscrapers.

reference_spacy_tokens: As you approach the frontier , you can see Shenzhen 's skyscrapers .


fn_spacy_tokens_for_baseline: That is , the underlying holdings of serious reference works , older classics , local history and other works of more than ephemeral interest would fall to such a low level that most readers ' questions and serious enquiries could not be answered without outside help .

source_bert_toks: that is , the underlying holdings of serious reference works , older classics , local history and other works of more than ep ##hem ##eral interest would fall to such a low level that most readers ' questions and serious en ##qui ##ries could not be answered without outside help .

reference_raw: This means that the underlying holdings of serious reference works, older classics, local history and other works of more than fleeting interest would be so low that most readers' questions and serious questions could not be answered without external assistance.

reference_spacy_tokens: This means that the underlying holdings of serious reference works , older classics , local history and other works of more than fleeting interest would be so low that most readers ' questions and serious questions could not be answered without external assistance .


fn_spacy_tokens_for_baseline: In its pages can be found linguistic traces of the former rivalry between Boer and Briton , the naming practices of the Khoi and San ( Hottentot and Bushman in former terms ) , racial conflict ( derogatory terms like Boer , Kaffir , and Hottentot each have more than a page devoted to them ) , the political discourse of the apartheid regime , and the counter - discourse of the resistance movements .

source_bert_toks: in its pages can be found linguistic traces of the former rivalry between boer and brit ##on , the naming practices of the k ##ho ##i and san ( hot ##ten ##to ##t and bush ##man in former terms ) , racial conflict ( der ##oga ##tory terms like boer , ka ##ffi ##r , and hot ##ten ##to ##t each have more than a page devoted to them ) , the political discourse of the apartheid regime , and the counter - discourse of the resistance movements .

reference_raw: Language clues to the former rivalry between Boer and Briton can be found on its website, Khoi and San naming practices (Hottentot and Bushman in former terms), racial conflicts (derogatory terms such as Boer, Kaffir, and Hottentot each have more than one page dedicated to them), political discourse of the apartheid regime, and counter-resistance movements.

reference_spacy_tokens: Language clues to the former rivalry between Boer and Briton can be found on its website , Khoi and San naming practices ( Hottentot and Bushman in former terms ) , racial conflicts ( derogatory terms such as Boer , Kaffir , and Hottentot each have more than one page dedicated to them ) , political discourse of the apartheid regime , and counter - resistance movements .


fn_spacy_tokens_for_baseline: Reporting from Tripoli , Libya NATO officials admitted Sunday that the alliance was probably responsible for an airstrike in a densely populated Tripoli neighborhood that Libyan authorities said killed nine people and injured 18 .

source_bert_toks: reporting from tripoli , libya nato officials admitted sunday that the alliance was probably responsible for an airs ##tri ##ke in a densely populated tripoli neighborhood that libyan authorities said killed nine people and injured 18 .

reference_raw: News from Tripoli, Libyan NATO officials admitted on Sunday that the Alliance was likely to cause an air strike in a densely populated Tripoli area that the Libyan authorities said killed nine people and injured 18 people.

reference_spacy_tokens: News from Tripoli , Libyan NATO officials admitted on Sunday that the Alliance was likely to cause an air strike in a densely populated Tripoli area that the Libyan authorities said killed nine people and injured 18 people .


fn_spacy_tokens_for_baseline: Earlier I said that on the whole our food was not bad : salads , fruits and nuts were plentiful but I had taken on my parent 's tastes .

source_bert_toks: earlier i said that on the whole our food was not bad : salad ##s , fruits and nuts were pl ##ent ##iful but i had taken on my parent ' s tastes .

reference_raw: I used to say we didn't eat bad all the time: salads, fruits and nuts were a lot, but I took my parents' taste.

reference_spacy_tokens: I used to say we did n't eat bad all the time : salads , fruits and nuts were a lot , but I took my parents ' taste .


fn_spacy_tokens_for_baseline: Some of the sailors and I managed to get a boat into the water , and we rowed away to look for land .

source_bert_toks: some of the sailors and i managed to get a boat into the water , and we rowe ##d away to look for land .

reference_raw: Some sailors and I managed to get the boat into the water, and we rowed off to find land.

reference_spacy_tokens: Some sailors and I managed to get the boat into the water , and we rowed off to find land .


fn_spacy_tokens_for_baseline: Therefore , it is important to adopt following : 1- The parking lot should be 50 meters away from the fence .

source_bert_toks: therefore , it is important to adopt following : 1 - the parking lot should be 50 meters away from the fence .

reference_raw: It is therefore important to adopt the following: 1- The parking lot should be 50 metres from the fence.

reference_spacy_tokens: It is therefore important to adopt the following : 1- The parking lot should be 50 metres from the fence .


fn_spacy_tokens_for_baseline: Three hours into their shifts , Leon and a co - worker have already rattled off 1,991 answers .

source_bert_toks: three hours into their shifts , leon and a co - worker have already rattled off 1 , 99 ##1 answers .

reference_raw: Three hours into their shift, Leon and his colleague had already knocked out 1991 responses.

reference_spacy_tokens: Three hours into their shift , Leon and his colleague had already knocked out 1991 responses .


fn_spacy_tokens_for_baseline: When land had been apportioned , each family built their own dwelling .

source_bert_toks: when land had been app ##ort ##ioned , each family built their own dwelling .

reference_raw: When the land was divided, each family built its own home.

reference_spacy_tokens: When the land was divided , each family built its own home .


fn_spacy_tokens_for_baseline: Instead she sipped on several cups of reviving , strong black coffee , and chewed listlessly on a piece of cardboard masquerading as toast .

source_bert_toks: instead she sipped on several cups of rev ##iving , strong black coffee , and chewed list ##lessly on a piece of cardboard mas ##que ##rad ##ing as toast .

reference_raw: Instead, she drank a few cups of fresh, strong black coffee and chewed indifferently on a piece of cardboard masquerading as toast.

reference_spacy_tokens: Instead , she drank a few cups of fresh , strong black coffee and chewed indifferently on a piece of cardboard masquerading as toast .


fn_spacy_tokens_for_baseline: In my new proximity to him I was able to see that his hands were neither wrinkled , nor dotted with liverish spots .

source_bert_toks: in my new proximity to him i was able to see that his hands were neither wrinkled , nor dotted with liver ##ish spots .

reference_raw: In my new nearness, I could see that his hands were not wrinkled or dotted with liver spots.

reference_spacy_tokens: In my new nearness , I could see that his hands were not wrinkled or dotted with liver spots .


fn_spacy_tokens_for_baseline: THE Italian agriculture minister , Gianni Fontana , yesterday resigned from the government after being targeted by a corruption probe .

source_bert_toks: the italian agriculture minister , gia ##nni fontana , yesterday resigned from the government after being targeted by a corruption probe .

reference_raw: The Italian Minister of Agriculture, Gianni Fontana, resigned yesterday after being targeted by a corruption drone.

reference_spacy_tokens: The Italian Minister of Agriculture , Gianni Fontana , resigned yesterday after being targeted by a corruption drone .


fn_spacy_tokens_for_baseline: One of the city 's deputy mayors was shot dead by assailants in 2010 as he knelt in prayer in a local mosque .

source_bert_toks: one of the city ' s deputy mayors was shot dead by ass ##ail ##ants in 2010 as he knelt in prayer in a local mosque .

reference_raw: One of the city's deputy mayors was shot in 2010 by attackers while kneeling in prayer at the local mosque.

reference_spacy_tokens: One of the city 's deputy mayors was shot in 2010 by attackers while kneeling in prayer at the local mosque .


fn_spacy_tokens_for_baseline: He built his shed which , made as it was of old floorboards from a couple of hovels that had been empty for years , resembled a shack .

source_bert_toks: he built his shed which , made as it was of old floor ##boards from a couple of hove ##ls that had been empty for years , resembled a shack .

reference_raw: He built a hut that looked like a hut, built like old floorboards from a pair of huts that had been empty for years.

reference_spacy_tokens: He built a hut that looked like a hut , built like old floorboards from a pair of huts that had been empty for years .


fn_spacy_tokens_for_baseline: I leave Darius shuffling in the litter while I ease up to the bedroom and try on a smile like when the pink Panther gets caught in a scrape .

source_bert_toks: i leave darius shuffling in the litter while i ease up to the bedroom and try on a smile like when the pink panther gets caught in a scrape .

reference_raw: I leave Darius shuffling in the litter while I ease into the bedroom and try to smile like a pink panther caught in a scratch.

reference_spacy_tokens: I leave Darius shuffling in the litter while I ease into the bedroom and try to smile like a pink panther caught in a scratch .


fn_spacy_tokens_for_baseline: Polish historians blame Lloyd George for the unstable and unworkable arrangements imposed on Danzig ; they emphasise , quite rightly , his hostility to the Poles and his susceptibility to German pleas .

source_bert_toks: polish historians blame lloyd george for the unstable and un ##work ##able arrangements imposed on danzig ; they emphasis ##e , quite right ##ly , his hostility to the poles and his su ##sc ##ept ##ibility to german pleas .

reference_raw: Polish historians blame Lloyd George for the unstable and unworkable arrangements imposed on Danzig; they rightly point out that he was hostile to the Poles and that he was sensitive to German demands.

reference_spacy_tokens: Polish historians blame Lloyd George for the unstable and unworkable arrangements imposed on Danzig ; they rightly point out that he was hostile to the Poles and that he was sensitive to German demands .


fn_spacy_tokens_for_baseline: Putting the volumes aside , Greg tried to consider the personality they evoked as a whole .

source_bert_toks: putting the volumes aside , greg tried to consider the personality they ev ##oked as a whole .

reference_raw: Greg put the volumes aside and tried to think of the personality they had created as a whole.

reference_spacy_tokens: Greg put the volumes aside and tried to think of the personality they had created as a whole .


fn_spacy_tokens_for_baseline: Must I fake an interest in your mind -- ? '

source_bert_toks: must i fake an interest in your mind - - ? '

reference_raw: Do I have to pretend to care about you -?'

reference_spacy_tokens: Do I have to pretend to care about you - ? '


fn_spacy_tokens_for_baseline: Monica and her baby are living in one shitty room , with no place she can cook or anything .

source_bert_toks: monica and her baby are living in one shitty room , with no place she can cook or anything .

reference_raw: Monica and her kid live in the same fucking room where she can't cook or anything.

reference_spacy_tokens: Monica and her kid live in the same fucking room where she ca n't cook or anything .


fn_spacy_tokens_for_baseline: " He 's such an incredible person and was such an incredible athlete .

source_bert_toks: " he ' s such an incredible person and was such an incredible athlete .

reference_raw: "He's a wonderful man, and he's a wonderful athlete."

reference_spacy_tokens: " He 's a wonderful man , and he 's a wonderful athlete . "


fn_spacy_tokens_for_baseline: The best of the human figures are lithe and graceful with slender necks and delicate hands .

source_bert_toks: the best of the human figures are lit ##he and graceful with slender necks and delicate hands .

reference_raw: The best human beings are slender and graceful, with slender necks and delicate hands.

reference_spacy_tokens: The best human beings are slender and graceful , with slender necks and delicate hands .


fn_spacy_tokens_for_baseline: The deep water channel needs care because of the dozens of stranded / fallen trees .

source_bert_toks: the deep water channel needs care because of the dozens of stranded / fallen trees .

reference_raw: A deep-water canal needs to be taken care of, due to scores of stranded/fallen trees.

reference_spacy_tokens: A deep - water canal needs to be taken care of , due to scores of stranded / fallen trees .


fn_spacy_tokens_for_baseline: Their lungs rasped from the effort , the rain trickled down their foreheads to mix with the sweat , their energy gone .

source_bert_toks: their lungs rasped from the effort , the rain trickle ##d down their forehead ##s to mix with the sweat , their energy gone .

reference_raw: Their lungs rasped with the effort, and the rain ran down their foreheads to mingle with sweat, and their energy was gone.

reference_spacy_tokens: Their lungs rasped with the effort , and the rain ran down their foreheads to mingle with sweat , and their energy was gone .


fn_spacy_tokens_for_baseline: In August 1536 he was condemned as a heretic , publicly stripped of the vestments of priesthood , and handed over to the secular authorities .

source_bert_toks: in august 153 ##6 he was condemned as a here ##tic , publicly stripped of the vest ##ments of priesthood , and handed over to the secular authorities .

reference_raw: In August 1536, he was sentenced as a heretic, publicly stripped of priesthood, and handed over to the secular authorities.

reference_spacy_tokens: In August 1536 , he was sentenced as a heretic , publicly stripped of priesthood , and handed over to the secular authorities .


fn_spacy_tokens_for_baseline: Chavis and Farrakhan both argue that Christianity and the nation are incompatible , and many predict that the 49 - year - old Chavis will ultimately succeed Farrakhan .

source_bert_toks: cha ##vis and far ##rak ##han both argue that christianity and the nation are incompatible , and many predict that the 49 - year - old cha ##vis will ultimately succeed far ##rak ##han .

reference_raw: Chavis and Farrakhan argue that Christianity and the nation are incompatible, and many predict that the 49-year-old Chavis will ultimately be the successor of Farrakhan.

reference_spacy_tokens: Chavis and Farrakhan argue that Christianity and the nation are incompatible , and many predict that the 49-year - old Chavis will ultimately be the successor of Farrakhan .


fn_spacy_tokens_for_baseline: Or Bonanza could have figured she was better out of the way .

source_bert_toks: or bon ##anza could have figured she was better out of the way .

reference_raw: Or Bonanza might think she'd be better off.

reference_spacy_tokens: Or Bonanza might think she 'd be better off .


fn_spacy_tokens_for_baseline: He dared to criticise the leader outright .

source_bert_toks: he dared to critic ##ise the leader outright .

reference_raw: He ventured to criticize the leader.

reference_spacy_tokens: He ventured to criticize the leader .


fn_spacy_tokens_for_baseline: Even more controversially , the APA wants changes in how violent offenders , who have been acquitted in court but committed to mental institutions , are assessed .

source_bert_toks: even more controversial ##ly , the ap ##a wants changes in how violent offenders , who have been acquitted in court but committed to mental institutions , are assessed .

reference_raw: More controversially, the APA wants to change the assessment of violent offenders who have been acquitted in court but who have been devolved to mental institutions.

reference_spacy_tokens: More controversially , the APA wants to change the assessment of violent offenders who have been acquitted in court but who have been devolved to mental institutions .


fn_spacy_tokens_for_baseline: All prices are correct at time of printing .

source_bert_toks: all prices are correct at time of printing .

reference_raw: All prices are right at the time of printing.

reference_spacy_tokens: All prices are right at the time of printing .


fn_spacy_tokens_for_baseline: The vapour might condense and fall on the slopes as a new sort of lubricant snow .

source_bert_toks: the va ##pour might conde ##nse and fall on the slopes as a new sort of lu ##bri ##can ##t snow .

reference_raw: The steam could thicken and fall down the slopes like a new kind of lubricant snow.

reference_spacy_tokens: The steam could thicken and fall down the slopes like a new kind of lubricant snow .