fn_spacy_tokens_for_baseline: Before long Bill Clinton , who is keen on grand visions , may rediscover these ideas and start trying to apply them once more to the global economy .

source_bert_toks: before long bill clinton , who is keen on grand visions , may red ##is ##co ##ver these ideas and start trying to apply them once more to the global economy .

reference_raw: Before long, Bill Clinton, who is keen on grand visions, may rediscover these ideas and try to apply them again to the world economics.

reference_spacy_tokens: Before long , Bill Clinton , who is keen on grand visions , may rediscover these ideas and try to apply them again to the world economics .


fn_spacy_tokens_for_baseline: Keep positioning yourself in the correct line while turning your own centre - line towards the opponent .

source_bert_toks: keep positioning yourself in the correct line while turning your own centre - line towards the opponent .

reference_raw: Keep your place in the right line while you turn your center line to your opponent.

reference_spacy_tokens: Keep your place in the right line while you turn your center line to your opponent .


fn_spacy_tokens_for_baseline: It was a command , not a suggestion , and , though she resented being ordered about , she crossed and knelt beside him .

source_bert_toks: it was a command , not a suggestion , and , though she resented being ordered about , she crossed and knelt beside him .

reference_raw: It was an order, not a suggestion, and though she didn't like to be ordered around, she crossed to her knees beside him.

reference_spacy_tokens: It was an order , not a suggestion , and though she did n't like to be ordered around , she crossed to her knees beside him .


fn_spacy_tokens_for_baseline: The extremity of these awful judgements against the moral deterioration of the British people , and the enormous vision of chaos and disorder which they conjure up , suggest the need for a cautious organisation of our thought and feeling as we approach these matters .

source_bert_toks: the ex ##tre ##mity of these awful judgement ##s against the moral deterioration of the british people , and the enormous vision of chaos and disorder which they con ##jure up , suggest the need for a cautious organisation of our thought and feeling as we approach these matters .

reference_raw: The extremeness of these terrible judgments against the moral degradation of the British people, and the enormous vision of chaos and chaos they conjure up, suggest that we should organise our thoughts and feelings carefully as we approach them.

reference_spacy_tokens: The extremeness of these terrible judgments against the moral degradation of the British people , and the enormous vision of chaos and chaos they conjure up , suggest that we should organise our thoughts and feelings carefully as we approach them .


fn_spacy_tokens_for_baseline: In 1991 at Wimbledon , it was another pigtailed predator , 15year - old American Jennifer Capriati , who dashed her hopes .

source_bert_toks: in 1991 at wimbledon , it was another pig ##tail ##ed predator , 15 ##year - old american jennifer cap ##ria ##ti , who dashed her hopes .

reference_raw: In 1991, in Wimbledon, another pig-tailed predator, a 15-year-old American Jennifer Capriati, dashed her hopes.

reference_spacy_tokens: In 1991 , in Wimbledon , another pig - tailed predator , a 15-year - old American Jennifer Capriati , dashed her hopes .


fn_spacy_tokens_for_baseline: He was so pissed he did n't notice .

source_bert_toks: he was so pissed he didn ' t notice .

reference_raw: He was so angry that he hadn't noticed.

reference_spacy_tokens: He was so angry that he had n't noticed .


fn_spacy_tokens_for_baseline: He emptied his cup and set it down on the table .

source_bert_toks: he emptied his cup and set it down on the table .

reference_raw: He drained his cup and put it on the table.

reference_spacy_tokens: He drained his cup and put it on the table .


fn_spacy_tokens_for_baseline: The knight ignored his niece 's furious look .

source_bert_toks: the knight ignored his niece ' s furious look .

reference_raw: The knight paid no attention to the angry expression on his nephew's face.

reference_spacy_tokens: The knight paid no attention to the angry expression on his nephew 's face .


fn_spacy_tokens_for_baseline: Wren 's grief - stricken mother gives all her daughter 's possessions to Luna .

source_bert_toks: wren ' s grief - stricken mother gives all her daughter ' s possessions to luna .

reference_raw: Wren's grieving mother gave Luna all of her daughter's possessions.

reference_spacy_tokens: Wren 's grieving mother gave Luna all of her daughter 's possessions .


fn_spacy_tokens_for_baseline: Unemployed , homeless and with a prison record , Jerry now faced going back to prison for failure to pay child support .

source_bert_toks: unemployed , homeless and with a prison record , jerry now faced going back to prison for failure to pay child support .

reference_raw: Unemployed, homeless, and with a prison record, Jerry was facing his return to prison for failing to pay child support.

reference_spacy_tokens: Unemployed , homeless , and with a prison record , Jerry was facing his return to prison for failing to pay child support .


fn_spacy_tokens_for_baseline: Iris washed her hands and filled the kettle .

source_bert_toks: iris washed her hands and filled the kettle .

reference_raw: Iris cleaned her hands and filled the pot.

reference_spacy_tokens: Iris cleaned her hands and filled the pot .


fn_spacy_tokens_for_baseline: Yearning for a drink to ease her parched throat , Polly moistened her lips with the tip of her tongue .

source_bert_toks: yearning for a drink to ease her parc ##hed throat , polly moist ##ened her lips with the tip of her tongue .

reference_raw: Polly tried to drink to ease her dry throat and moistened her lips with the tip of her tongue.

reference_spacy_tokens: Polly tried to drink to ease her dry throat and moistened her lips with the tip of her tongue .


fn_spacy_tokens_for_baseline: But , in the long years of policy revision and image revitalisation , Labour has not found another , effective way of voicing these changed realities .

source_bert_toks: but , in the long years of policy revision and image rev ##ital ##isation , labour has not found another , effective way of vo ##icing these changed realities .

reference_raw: However, in years of political revision and revitalisation, Labour has found no other effective way to express these changed realities.

reference_spacy_tokens: However , in years of political revision and revitalisation , Labour has found no other effective way to express these changed realities .


fn_spacy_tokens_for_baseline: The Manor kitchen has an enormous Tudor fireplace with the original oak beam .

source_bert_toks: the manor kitchen has an enormous tudor fireplace with the original oak beam .

reference_raw: There's a huge Tudor fireplace in the Manor kitchen with the original oak beam.

reference_spacy_tokens: There 's a huge Tudor fireplace in the Manor kitchen with the original oak beam .


fn_spacy_tokens_for_baseline: That procedure uses per capita income estimates generated from Federal Government projections of income and population growth , and applies three different income elasticities for mortality , severe morbidity , and light symptom effects .

source_bert_toks: that procedure uses per capita income estimates generated from federal government projections of income and population growth , and applies three different income elastic ##ities for mortality , severe mor ##bid ##ity , and light sy ##mpt ##om effects .

reference_raw: This procedure uses per capita income estimates from federal government estimates of income and population growth and uses three different income elasticities for mortality, serious morbidity and mild symptoms.

reference_spacy_tokens: This procedure uses per capita income estimates from federal government estimates of income and population growth and uses three different income elasticities for mortality , serious morbidity and mild symptoms .


fn_spacy_tokens_for_baseline: The treaty on foreign policy carries with it more than a commitment to co - ordinate our policies .

source_bert_toks: the treaty on foreign policy carries with it more than a commitment to co - or ##dina ##te our policies .

reference_raw: The foreign policy agreement has more to do with it than a commitment to coordinate our policies.

reference_spacy_tokens: The foreign policy agreement has more to do with it than a commitment to coordinate our policies .


fn_spacy_tokens_for_baseline: This older informal economy now co - exists with the more vibrant drug economy .

source_bert_toks: this older informal economy now co - exists with the more vibrant drug economy .

reference_raw: This older informal economy now co-exists with a more dynamic drug economy.

reference_spacy_tokens: This older informal economy now co - exists with a more dynamic drug economy .


fn_spacy_tokens_for_baseline: Extending the U. S. troop presence also would be unpopular with some supporters of President Obama , who had pledged to abide by the timetable for withdrawing U. S. forces .

source_bert_toks: extending the u . s . troop presence also would be unpopular with some supporters of president obama , who had pledged to ab ##ide by the timetable for withdrawing u . s . forces .

reference_raw: Extending the presence of U.S. troops would also be unpopular to some of President Obama's supporters, who promised to follow the schedule for the withdrawal of U.S. troops.

reference_spacy_tokens: Extending the presence of U.S. troops would also be unpopular to some of President Obama 's supporters , who promised to follow the schedule for the withdrawal of U.S. troops .


fn_spacy_tokens_for_baseline: Marine officers have long been worried that Iraq 's deadly insurgency could prompt such a reaction by combat teams .

source_bert_toks: marine officers have long been worried that iraq ' s deadly insurgency could prompt such a reaction by combat teams .

reference_raw: Marine officers have long feared that Iraq's deadly rebellion might prompt such a response from combat teams.

reference_spacy_tokens: Marine officers have long feared that Iraq 's deadly rebellion might prompt such a response from combat teams .


fn_spacy_tokens_for_baseline: In this field , Iran 's research is concentrated in creating genes that produce toxins against insect pests ; improving the biological resistance of plants ; formulating new pesticides ; improving techniques of spraying or otherwise disseminating pesticides ; investigating the effects on native plant species after they have been introduced to various pests and diseases ; preventing the production of mycotoxins in crops ; producing plant viruses and their corresponding antiserums for an antiserum bank ; and manufacturing pheromones and hormones to combat arthropods that harm Iran 's agricultural industry .

source_bert_toks: in this field , iran ' s research is concentrated in creating genes that produce toxin ##s against insect pest ##s ; improving the biological resistance of plants ; formula ##ting new pest ##icides ; improving techniques of spraying or otherwise di ##sse ##minating pest ##icides ; investigating the effects on native plant species after they have been introduced to various pest ##s and diseases ; preventing the production of my ##cot ##ox ##ins in crops ; producing plant viruses and their corresponding anti ##ser ##ums for an anti ##ser ##um bank ; and manufacturing ph ##ero ##mon ##es and hormones to combat art ##hr ##op ##ods that harm iran ' s agricultural industry .

reference_raw: In this area, Iran's research focuses on the creation of genes that produce toxins against insect pests; the improvement of plant bioresistance; the formulation of new pesticides; the improvement of methods of spraying or otherwise spreading pesticides; the investigation of the effects on native plant species after their introduction on different pests and diseases; the prevention of the production of mycotoxins in crops; the production of plant viruses and their corresponding antis for antis. and the production of pheromones and hormones to fight arthropods that harm the agricultural sector of Iran.

reference_spacy_tokens: In this area , Iran 's research focuses on the creation of genes that produce toxins against insect pests ; the improvement of plant bioresistance ; the formulation of new pesticides ; the improvement of methods of spraying or otherwise spreading pesticides ; the investigation of the effects on native plant species after their introduction on different pests and diseases ; the prevention of the production of mycotoxins in crops ; the production of plant viruses and their corresponding antis for antis . and the production of pheromones and hormones to fight arthropods that harm the agricultural sector of Iran .


fn_spacy_tokens_for_baseline: A member of European Parliament who grew up in Teesdale has announced her engagement to a top businessman .

source_bert_toks: a member of european parliament who grew up in tee ##sdale has announced her engagement to a top businessman .

reference_raw: A member of the European Parliament who grew up in Teesdale announced that she was engaged to a top businessman.

reference_spacy_tokens: A member of the European Parliament who grew up in Teesdale announced that she was engaged to a top businessman .


fn_spacy_tokens_for_baseline: Icelandic Poppies ( P. nudicaule ) are perennials best treated as biennials sown in July and planted out in the autumn for flowering from early Spring .

source_bert_toks: icelandic pop ##pies ( p . nu ##dic ##au ##le ) are perennial ##s best treated as biennial ##s so ##wn in july and planted out in the autumn for flowering from early spring .

reference_raw: The Icelandic poppies (P. nudicaule) are the last years best treated as biennials planted in July and planted in autumn for flowering from the beginning of spring.

reference_spacy_tokens: The Icelandic poppies ( P. nudicaule ) are the last years best treated as biennials planted in July and planted in autumn for flowering from the beginning of spring .


fn_spacy_tokens_for_baseline: In December 2002 , an Italian newspaper cited an Iraqi officer who asserted that Syria had allowed Iraq to store its weapons of mass destruction in Syria research centers .

source_bert_toks: in december 2002 , an italian newspaper cited an iraqi officer who asserted that syria had allowed iraq to store its weapons of mass destruction in syria research centers .

reference_raw: In December 2002, an Italian newspaper cited an Iraqi officer claiming that Syria allowed Iraq to store its weapons of mass destruction in Syrian research centres.

reference_spacy_tokens: In December 2002 , an Italian newspaper cited an Iraqi officer claiming that Syria allowed Iraq to store its weapons of mass destruction in Syrian research centres .


fn_spacy_tokens_for_baseline: Diego Maradona of Argentina carried not just his team but the aspirations of a poor , struggling nation on his broad shoulders .

source_bert_toks: diego mara ##don ##a of argentina carried not just his team but the aspirations of a poor , struggling nation on his broad shoulders .

reference_raw: Diego Maradona of Argentina carried on his broad shoulders not only his team, but the ambitions of a poor, struggling country.

reference_spacy_tokens: Diego Maradona of Argentina carried on his broad shoulders not only his team , but the ambitions of a poor , struggling country .


fn_spacy_tokens_for_baseline: The DART ( Dublin Area Rapid Transit ) runs north and south along the coast .

source_bert_toks: the dart ( dublin area rapid transit ) runs north and south along the coast .

reference_raw: The DART (Dublin Area Rapid Transit) runs north and south on the coastline.

reference_spacy_tokens: The DART ( Dublin Area Rapid Transit ) runs north and south on the coastline .


fn_spacy_tokens_for_baseline: Hence the importance of repentance , faith , baptism into the messianic community , and the reception of God 's offer of forgiveness and the Holy Spirit .

source_bert_toks: hence the importance of rep ##ent ##ance , faith , baptism into the mess ##iani ##c community , and the reception of god ' s offer of forgiveness and the holy spirit .

reference_raw: Therefore, the importance of penance, faith, christening in the Messian community, and acceptance of God's offer of forgiveness and the Holy Ghost.

reference_spacy_tokens: Therefore , the importance of penance , faith , christening in the Messian community , and acceptance of God 's offer of forgiveness and the Holy Ghost .


fn_spacy_tokens_for_baseline: In conclusion it should be noted that power already exists to utilise delegated legislation to go a good deal of the way along the road proposed by the Royal Commission .

source_bert_toks: in conclusion it should be noted that power already exists to ut ##ilis ##e delegate ##d legislation to go a good deal of the way along the road proposed by the royal commission .

reference_raw: Finally, it must be pointed out that there is already a power to use delegated legislation for a long journey along the road proposed by the Royal Commission.

reference_spacy_tokens: Finally , it must be pointed out that there is already a power to use delegated legislation for a long journey along the road proposed by the Royal Commission .


fn_spacy_tokens_for_baseline: ' We bought our homes on Barratt 's Candleford Estate because we wanted to retire to a quiet cul - de - sac in peaceful surroundings ' said a resident .

source_bert_toks: ' we bought our homes on barr ##att ' s candle ##ford estate because we wanted to retire to a quiet cu ##l - de - sac in peaceful surroundings ' said a resident .

reference_raw: 'We bought a house in Barratt's Candleford Estate because we wanted to go to a peaceful dead end in a peaceful environment,' said the resident.

reference_spacy_tokens: ' We bought a house in Barratt 's Candleford Estate because we wanted to go to a peaceful dead end in a peaceful environment , ' said the resident .


fn_spacy_tokens_for_baseline: A spokesman said the 56-year - old singer pianist had flu .

source_bert_toks: a spokesman said the 56 - year - old singer pianist had flu .

reference_raw: One of the spokesmen said that a 56-year-old singer piano player had influenza.

reference_spacy_tokens: One of the spokesmen said that a 56-year - old singer piano player had influenza .


fn_spacy_tokens_for_baseline: She liked his masculinity and his vigour .

source_bert_toks: she liked his mas ##cu ##lini ##ty and his vi ##go ##ur .

reference_raw: She liked his manhood and vigor.

reference_spacy_tokens: She liked his manhood and vigor .


fn_spacy_tokens_for_baseline: In return , the Reagan team , when in government , would supply weapons and spare parts to Iran for use in its war against Iraq .

source_bert_toks: in return , the reagan team , when in government , would supply weapons and spare parts to iran for use in its war against iraq .

reference_raw: In return, Reagan's team, when in government, will provide Iran with arms and spare parts for use in its war against Iraq.

reference_spacy_tokens: In return , Reagan 's team , when in government , will provide Iran with arms and spare parts for use in its war against Iraq .


fn_spacy_tokens_for_baseline: In relation to stress , regular exercise increases the circulation which in turn increases oxygen levels in the blood and activates the hormonal system ( the endocrine glands ) .

source_bert_toks: in relation to stress , regular exercise increases the circulation which in turn increases oxygen levels in the blood and activate ##s the ho ##rm ##onal system ( the end ##oc ##rine glands ) .

reference_raw: In terms of stress, regular exercise enhances circulation, which in turn raises the level of oxygen in the blood and activates the hormonal system (endocrine glands).

reference_spacy_tokens: In terms of stress , regular exercise enhances circulation , which in turn raises the level of oxygen in the blood and activates the hormonal system ( endocrine glands ) .


fn_spacy_tokens_for_baseline: But it is in sight of that abbey , ' the calm light and shadow , the ancient steadfast forms ' , that Gwendolen makes her confession to Deronda .

source_bert_toks: but it is in sight of that abbey , ' the calm light and shadow , the ancient ste ##ad ##fast forms ' , that gwen ##do ##len makes her confession to der ##onda .

reference_raw: But it is in the eyes of this abbey, "silent light and shadow, ancient fixed forms", that Gwendolen confesses to Deronda.

reference_spacy_tokens: But it is in the eyes of this abbey , " silent light and shadow , ancient fixed forms " , that Gwendolen confesses to Deronda .


fn_spacy_tokens_for_baseline: The upper surface of the body is formed by a thin sheet that cloaks the internal organs and is appropriately called the mantle .

source_bert_toks: the upper surface of the body is formed by a thin sheet that cloak ##s the internal organs and is appropriately called the mantle .

reference_raw: The upper surface of the body is made up of a thin sheet which covers the internal organs and is appropriately referred to as the mantle.

reference_spacy_tokens: The upper surface of the body is made up of a thin sheet which covers the internal organs and is appropriately referred to as the mantle .


fn_spacy_tokens_for_baseline: ' A firearm was discharged and people cowered behind walls , under tables and in the toilets .

source_bert_toks: ' a firearm was discharged and people cow ##ered behind walls , under tables and in the toilets .

reference_raw: The gun was fired, and people crouched behind the walls, under the tables, and in the bathrooms.

reference_spacy_tokens: The gun was fired , and people crouched behind the walls , under the tables , and in the bathrooms .


fn_spacy_tokens_for_baseline: This being typed in a standing position .

source_bert_toks: this being typed in a standing position .

reference_raw: This is written in a standstill.

reference_spacy_tokens: This is written in a standstill .


fn_spacy_tokens_for_baseline: Next time a prospective buyer comes to view , make sure the kitchen is scented with the soft fragrance of vanilla ( the cooking kind ) .

source_bert_toks: next time a prospective buyer comes to view , make sure the kitchen is scented with the soft fragrance of vanilla ( the cooking kind ) .

reference_raw: Next time a potential buyer comes into view, make sure the kitchen smells of vanilla (the kind of cooking).

reference_spacy_tokens: Next time a potential buyer comes into view , make sure the kitchen smells of vanilla ( the kind of cooking ) .


fn_spacy_tokens_for_baseline: I sat in my cell expecting to be called out for execution at any moment .

source_bert_toks: i sat in my cell expecting to be called out for execution at any moment .

reference_raw: I was sitting in my room, waiting to be called for execution at any moment.

reference_spacy_tokens: I was sitting in my room , waiting to be called for execution at any moment .


fn_spacy_tokens_for_baseline: I personally always thought it was a risk to pin the image of Microsoft on just one man -- at AOL , for example , there was a conscious effort to develop other " characters , " for lack of a better word .

source_bert_toks: i personally always thought it was a risk to pin the image of microsoft on just one man - - at ao ##l , for example , there was a conscious effort to develop other " characters , " for lack of a better word .

reference_raw: Personally, I've always thought it was risky to pin Microsoft's image on one person - in AOL, for example, there was a conscious effort to develop other "characters" for lack of a better term.

reference_spacy_tokens: Personally , I 've always thought it was risky to pin Microsoft 's image on one person - in AOL , for example , there was a conscious effort to develop other " characters " for lack of a better term .


fn_spacy_tokens_for_baseline: And it was a little later that same night that his lordship said with some gravity , shaking his head : ' I fought that war to preserve justice in this world .

source_bert_toks: and it was a little later that same night that his lordship said with some gravity , shaking his head : ' i fought that war to preserve justice in this world .

reference_raw: And a little later that night, his lordship said with a certain gravity and shook his head, "I fought this battle to preserve justice in the world.

reference_spacy_tokens: And a little later that night , his lordship said with a certain gravity and shook his head , " I fought this battle to preserve justice in the world .


fn_spacy_tokens_for_baseline: No sooner had Katherine helped herself than a maid appeared with a silver platter heaped with pancakes .

source_bert_toks: no sooner had katherine helped herself than a maid appeared with a silver platt ##er heap ##ed with pancakes .

reference_raw: Katherine didn't help herself until a maid appeared with a silver plate full of pancakes.

reference_spacy_tokens: Katherine did n't help herself until a maid appeared with a silver plate full of pancakes .


fn_spacy_tokens_for_baseline: A BRITISH tourist was repeatedly raped on a South African beach , just one week after the savage murders of Elizabeth Over and Julie Godwin .

source_bert_toks: a british tourist was repeatedly raped on a south african beach , just one week after the savage murders of elizabeth over and julie god ##win .

reference_raw: Only a week after Elizabeth Over and Julie Godwin were brutally murdered, a British tourist was repeatedly violated on a beach in South Africa.

reference_spacy_tokens: Only a week after Elizabeth Over and Julie Godwin were brutally murdered , a British tourist was repeatedly violated on a beach in South Africa .


fn_spacy_tokens_for_baseline: In this case the seller will not be in breach of the terms implied by section 12 provided that before the contract was made he disclosed to the buyer the existence of the lien .

source_bert_toks: in this case the seller will not be in breach of the terms implied by section 12 provided that before the contract was made he disclosed to the buyer the existence of the lie ##n .

reference_raw: In such a case, the seller does not infringe the conditions laid down in Article 12, provided that, prior to the conclusion of the contract, he informs the buyer of the existence of the lien.

reference_spacy_tokens: In such a case , the seller does not infringe the conditions laid down in Article 12 , provided that , prior to the conclusion of the contract , he informs the buyer of the existence of the lien .


fn_spacy_tokens_for_baseline: " My ashes , " he wheezed , " scatter them over the plains of Narazel , where I was born , and frolicked through the blackberry fields . "

source_bert_toks: " my ashes , " he w ##hee ##zed , " sc ##atter them over the plains of nara ##zel , where i was born , and fr ##olic ##ked through the blackberry fields . "

reference_raw: "My ashes," he wheezed, "screw them across the plains of Narazel, where I was born, and flew through the fields of blackberry."

reference_spacy_tokens: " My ashes , " he wheezed , " screw them across the plains of Narazel , where I was born , and flew through the fields of blackberry . "


fn_spacy_tokens_for_baseline: Arnold lifted his head and looked hopefully .

source_bert_toks: arnold lifted his head and looked hopefully .

reference_raw: Arnold looked up hopefully.

reference_spacy_tokens: Arnold looked up hopefully .


fn_spacy_tokens_for_baseline: The heat haze rose from the ground as he flagellated himself with a cat o ' nine chains .

source_bert_toks: the heat haze rose from the ground as he flag ##ella ##ted himself with a cat o ' nine chains .

reference_raw: Heat haze rose from the ground as he brandished himself with a cat's nine chains.

reference_spacy_tokens: Heat haze rose from the ground as he brandished himself with a cat 's nine chains .


fn_spacy_tokens_for_baseline: For , in his endeavour to secure their support , William Clito began his reign by issuing charters to Bruges , Ghent , Aire , and St Omer .

source_bert_toks: for , in his endeavour to secure their support , william clit ##o began his reign by issuing charters to br ##uge ##s , ghent , air ##e , and st om ##er .

reference_raw: For William Clito, in an effort to secure their support, began his reign by issuing charters to Bruges, Ghent, Aire, and St Omer.

reference_spacy_tokens: For William Clito , in an effort to secure their support , began his reign by issuing charters to Bruges , Ghent , Aire , and St Omer .


fn_spacy_tokens_for_baseline: U. S. authorities say the men were ' enemy combatants ' who enlisted to fight with Islamic militants .

source_bert_toks: u . s . authorities say the men were ' enemy combatants ' who enlisted to fight with islamic militants .

reference_raw: According to the U.S. authorities, the men were enemy fighters who enlisted to fight Islamic militants.

reference_spacy_tokens: According to the U.S. authorities , the men were enemy fighters who enlisted to fight Islamic militants .


fn_spacy_tokens_for_baseline: ' Is this connected with the other business ? ' he asked .

source_bert_toks: ' is this connected with the other business ? ' he asked .

reference_raw: "Does it have anything to do with other matters?" he asked.

reference_spacy_tokens: " Does it have anything to do with other matters ? " he asked .


fn_spacy_tokens_for_baseline: ' It was crucial for us to secure this contract .

source_bert_toks: ' it was crucial for us to secure this contract .

reference_raw: 'It was essential that we secure the treaty.

reference_spacy_tokens: ' It was essential that we secure the treaty .


fn_spacy_tokens_for_baseline: Meanwhile , Iran has also developed short - range artillery rockets and is producing the Scud - B and the Scud - C -- called the Shehab-1 and Shehab-2 , respectively .

source_bert_toks: meanwhile , iran has also developed short - range artillery rockets and is producing the sc ##ud - b and the sc ##ud - c - - called the she ##hab - 1 and she ##hab - 2 , respectively .

reference_raw: Meanwhile, Iran has also developed short-range artillery missiles and is making Scud-B and Scud-C-called Shehab-1 and Shehab-2.

reference_spacy_tokens: Meanwhile , Iran has also developed short - range artillery missiles and is making Scud - B and Scud - C - called Shehab-1 and Shehab-2 .


fn_spacy_tokens_for_baseline: When asked by Xinhua if there is any plan for him to meet Iraq officials , he said " I have not been asked to meet any top Iraqi officials .

source_bert_toks: when asked by xi ##nh ##ua if there is any plan for him to meet iraq officials , he said " i have not been asked to meet any top iraqi officials .

reference_raw: If Xinhua asked if he had a plan to meet with Iraqi officials, he said, "I wasn't asked to meet any of the top Iraqi officials.

reference_spacy_tokens: If Xinhua asked if he had a plan to meet with Iraqi officials , he said , " I was n't asked to meet any of the top Iraqi officials .


fn_spacy_tokens_for_baseline: The cubes can be added to soups and sauces or thawed for use in puddings and cakes .

source_bert_toks: the cube ##s can be added to soup ##s and sauce ##s or tha ##wed for use in pudding ##s and cakes .

reference_raw: Cubes may be added to soups and sauces or melted for use in puddings and cakes.

reference_spacy_tokens: Cubes may be added to soups and sauces or melted for use in puddings and cakes .


fn_spacy_tokens_for_baseline: This subject - matter permitted long runs which were no more difficult to create than broadcasts .

source_bert_toks: this subject - matter permitted long runs which were no more difficult to create than broadcasts .

reference_raw: The subject-matter allowed for a long period of time, which was not more difficult to create than broadcasts.

reference_spacy_tokens: The subject - matter allowed for a long period of time , which was not more difficult to create than broadcasts .


fn_spacy_tokens_for_baseline: Sister Cooney sensed that he was about to confide something that he might later regret .

source_bert_toks: sister co ##oney sensed that he was about to con ##fide something that he might later regret .

reference_raw: Sister Cooney felt she was going to tell him something he might regret later.

reference_spacy_tokens: Sister Cooney felt she was going to tell him something he might regret later .


fn_spacy_tokens_for_baseline: The two rooms adjoined .

source_bert_toks: the two rooms ad ##jo ##ined .

reference_raw: The two rooms were adjacent.

reference_spacy_tokens: The two rooms were adjacent .


fn_spacy_tokens_for_baseline: The most troublesome period concerned the budget in 1981 , when Jim Prior , peter Walker , and Sir Ian Gilmour were so opposed to its deflationary thrust that they considered resigning .

source_bert_toks: the most troubles ##ome period concerned the budget in 1981 , when jim prior , peter walker , and sir ian gil ##mour were so opposed to its def ##lation ##ary thrust that they considered resigning .

reference_raw: The most difficult period was the budget of 1981, when Jim Prior, Peter Walker, and Sir Ian Gilmour were so opposed to his deflationary thrust that they considered resigning.

reference_spacy_tokens: The most difficult period was the budget of 1981 , when Jim Prior , Peter Walker , and Sir Ian Gilmour were so opposed to his deflationary thrust that they considered resigning .


fn_spacy_tokens_for_baseline: ROCK - BOTTOM Leigh have signed Australian forward John Elias from Sydney side Balmain .

source_bert_toks: rock - bottom leigh have signed australian forward john elias from sydney side bal ##main .

reference_raw: ROCK-BOTTOM Leigh has subscribed to the Australian front John Elias of Sydney's side of Balmain.

reference_spacy_tokens: ROCK - BOTTOM Leigh has subscribed to the Australian front John Elias of Sydney 's side of Balmain .


fn_spacy_tokens_for_baseline: This study primarily related to stress and to the use of alcohol and illicit drugs .

source_bert_toks: this study primarily related to stress and to the use of alcohol and illicit drugs .

reference_raw: The study mainly concerned stress and the use of alcohol and illegal drugs.

reference_spacy_tokens: The study mainly concerned stress and the use of alcohol and illegal drugs .


fn_spacy_tokens_for_baseline: ' That calf has been poisoned . '

source_bert_toks: ' that calf has been poisoned . '

reference_raw: "The calf was intoxicated."

reference_spacy_tokens: " The calf was intoxicated . "


fn_spacy_tokens_for_baseline: ' One side of the face was badly mauled .

source_bert_toks: ' one side of the face was badly ma ##uled .

reference_raw: One side of his face was badly crippled.

reference_spacy_tokens: One side of his face was badly crippled .


fn_spacy_tokens_for_baseline: Somewhere in the distance a dog barked mournfully .

source_bert_toks: somewhere in the distance a dog barked mo ##urn ##fully .

reference_raw: Somewhere in the distance, a dog snapped mournfully.

reference_spacy_tokens: Somewhere in the distance , a dog snapped mournfully .


fn_spacy_tokens_for_baseline: She blabbed to the Press and they hounded me until I left the country .

source_bert_toks: she b ##lab ##bed to the press and they hound ##ed me until i left the country .

reference_raw: She spoke to the press, and they hunted me down until I left the country.

reference_spacy_tokens: She spoke to the press , and they hunted me down until I left the country .


fn_spacy_tokens_for_baseline: ' We did not , I believe , encounter a setting where Arthur Andersen did something to allow us to cook the books , or to misstate earnings , or something of that nature , ' he said .

source_bert_toks: ' we did not , i believe , encounter a setting where arthur andersen did something to allow us to cook the books , or to miss ##tate earnings , or something of that nature , ' he said .

reference_raw: 'I don't think we've come across a place where Arthur Andersen has done something that will allow us to boil a novel, or misstate a profit, or something like that,' he said.

reference_spacy_tokens: ' I do n't think we 've come across a place where Arthur Andersen has done something that will allow us to boil a novel , or misstate a profit , or something like that , ' he said .


fn_spacy_tokens_for_baseline: By the time they reached the catamaran Trent would have wagered the charter fee on one guess at the man 's profession .

source_bert_toks: by the time they reached the cat ##ama ##ran trent would have wage ##red the charter fee on one guess at the man ' s profession .

reference_raw: By the time they got to the Catamaran Trent, he'd bet a charter fee on one guess at his profession.

reference_spacy_tokens: By the time they got to the Catamaran Trent , he 'd bet a charter fee on one guess at his profession .


fn_spacy_tokens_for_baseline: Thirdly , they could progressively develop programmes of recurrent or continuing education for mature adults who wish to alternate work with education .

source_bert_toks: third ##ly , they could progressively develop programmes of rec ##urrent or continuing education for mature adults who wish to alternate work with education .

reference_raw: Third, they could gradually develop recurring or continuing education programmes for adults wishing to work alternatively in education.

reference_spacy_tokens: Third , they could gradually develop recurring or continuing education programmes for adults wishing to work alternatively in education .


fn_spacy_tokens_for_baseline: Predatory habits are typical , and many species have specialized clutching appendages , or stinging organs .

source_bert_toks: predatory habits are typical , and many species have specialized clutching app ##end ##ages , or stinging organs .

reference_raw: Predatory habits are typical, and many species have specialized attachments or stabbing organs.

reference_spacy_tokens: Predatory habits are typical , and many species have specialized attachments or stabbing organs .


fn_spacy_tokens_for_baseline: The legal advisers to the managers should agree with the investors ' lawyers at an early stage exactly what is required to satisfy the conditions .

source_bert_toks: the legal advisers to the managers should agree with the investors ' lawyers at an early stage exactly what is required to satisfy the conditions .

reference_raw: At an early stage, the legal advisers of the managers should agree exactly what is necessary to meet the conditions with the legal advisers of the investors.

reference_spacy_tokens: At an early stage , the legal advisers of the managers should agree exactly what is necessary to meet the conditions with the legal advisers of the investors .


fn_spacy_tokens_for_baseline: He also found peace there and renewed an old pleasure , by boating at Lugano where he met Hesse .

source_bert_toks: he also found peace there and renewed an old pleasure , by boating at lu ##gano where he met hesse .

reference_raw: There, too, he found peace and renewed his old pleasure by sailing in Lugano, where he had met Hesse.

reference_spacy_tokens: There , too , he found peace and renewed his old pleasure by sailing in Lugano , where he had met Hesse .


fn_spacy_tokens_for_baseline: He was frequently deceitful , as in his deliberate misrepresentations to his crew of the speed of their daily voyage .

source_bert_toks: he was frequently dec ##eit ##ful , as in his deliberate mis ##re ##pres ##entation ##s to his crew of the speed of their daily voyage .

reference_raw: He was often deceitful, as was his intentional misrepresentation of the speed of their daily journey to his crew.

reference_spacy_tokens: He was often deceitful , as was his intentional misrepresentation of the speed of their daily journey to his crew .


fn_spacy_tokens_for_baseline: This action worsened the emerging crisis because the random placement of the spent fuel rods in a temporary storage pond compromised the IAEA 's capacity to reconstruct the operational history of the reactor , which could have been used in efforts to account for the discrepancies in Pyongyang 's reported plutonium reprocessing .

source_bert_toks: this action worsened the emerging crisis because the random placement of the spent fuel rods in a temporary storage pond compromised the ia ##ea ' s capacity to rec ##ons ##truct the operational history of the reactor , which could have been used in efforts to account for the disc ##re ##pan ##cies in p ##yon ##gy ##ang ' s reported pluto ##nium rep ##ro ##ces ##sing .

reference_raw: This action aggravated the emerging crisis, as the random placement of spent fuel rods in a temporary storage pond undermined the ability of the IAEA to reconstruct the operational history of the reactor, which could be used to explain the discrepancies in Pyongyang's reported plutonium processing.

reference_spacy_tokens: This action aggravated the emerging crisis , as the random placement of spent fuel rods in a temporary storage pond undermined the ability of the IAEA to reconstruct the operational history of the reactor , which could be used to explain the discrepancies in Pyongyang 's reported plutonium processing .


fn_spacy_tokens_for_baseline: Fairbanks found that when sea level first began to rise as the ice sheets melted , 17,000 years ago , it did so at a rate of about 4 mm per year .

source_bert_toks: fairbanks found that when sea level first began to rise as the ice sheets melted , 17 , 000 years ago , it did so at a rate of about 4 ##mm per year .

reference_raw: Fairbanks found that the first time the sea level began to rise as the ice sheets dissolved, 17,000 years ago, it did so at about 4 mm a year.

reference_spacy_tokens: Fairbanks found that the first time the sea level began to rise as the ice sheets dissolved , 17,000 years ago , it did so at about 4 mm a year .


fn_spacy_tokens_for_baseline: Take an example : Mrs. Jones telephones her coal merchant asking him to deliver six bags of coal .

source_bert_toks: take an example : mrs . jones telephone ##s her coal merchant asking him to deliver six bags of coal .

reference_raw: Take an example: Mrs. Jones calls her coal merchant and asks him to deliver six sacks of coal.

reference_spacy_tokens: Take an example : Mrs. Jones calls her coal merchant and asks him to deliver six sacks of coal .


fn_spacy_tokens_for_baseline: Centralization and bureaucratization were historically closely linked to the growth of a monetized economy , which provided the fiscal resources for the rise of absolutist states in seventeenth- and eighteenth - century Europe .

source_bert_toks: central ##ization and bureau ##crat ##ization were historically closely linked to the growth of a mon ##eti ##zed economy , which provided the fiscal resources for the rise of abs ##ol ##uti ##st states in seventeenth - and eighteenth - century europe .

reference_raw: Centralization and bureaucratization have historically been closely associated with the growth of a monetized economy, providing fiscal resources for the rise of absolutist countries in Europe in the 17th and 18th century.

reference_spacy_tokens: Centralization and bureaucratization have historically been closely associated with the growth of a monetized economy , providing fiscal resources for the rise of absolutist countries in Europe in the 17th and 18th century .


fn_spacy_tokens_for_baseline: Troops in Thailand have broken - up anti - government protests shooting rifles into the air .

source_bert_toks: troops in thailand have broken - up anti - government protests shooting rifles into the air .

reference_raw: Troops in Thailand have broken down anti-government protests firing guns into the air.

reference_spacy_tokens: Troops in Thailand have broken down anti - government protests firing guns into the air .


fn_spacy_tokens_for_baseline: With enough chips and a large enough training set , it could in principle recognise any class of retinal images with absolute confidence .

source_bert_toks: with enough chips and a large enough training set , it could in principle recognise any class of re ##tina ##l images with absolute confidence .

reference_raw: With enough chips and a large enough set of training, he could, in principle, recognize any class of retinal images with absolute certainty.

reference_spacy_tokens: With enough chips and a large enough set of training , he could , in principle , recognize any class of retinal images with absolute certainty .


fn_spacy_tokens_for_baseline: ' What I do n't see is what it has to do with the verdict on Dandy . '

source_bert_toks: ' what i don ' t see is what it has to do with the verdict on dan ##dy . '

reference_raw: "I don't know what that has to do with Dandy's sentence."

reference_spacy_tokens: " I do n't know what that has to do with Dandy 's sentence . "


fn_spacy_tokens_for_baseline: Conversely , there are the majority of unsuccessful schools , and we know which efforts at educational reform are doomed beforehand .

source_bert_toks: conversely , there are the majority of unsuccessful schools , and we know which efforts at educational reform are doomed beforehand .

reference_raw: On the other hand, most failed schools exist, and we know which attempts to reform education are lost in advance.

reference_spacy_tokens: On the other hand , most failed schools exist , and we know which attempts to reform education are lost in advance .


fn_spacy_tokens_for_baseline: He satisfied himself with a few words of hurried consultation during a House of Commons debate .

source_bert_toks: he satisfied himself with a few words of hurried consultation during a house of commons debate .

reference_raw: During the debate of the House of Commons, he contented himself with a few words of quick consultation.

reference_spacy_tokens: During the debate of the House of Commons , he contented himself with a few words of quick consultation .


fn_spacy_tokens_for_baseline: Figure 5illustrates the relationship between adjusted p values and the number of genes being tested .

source_bert_toks: figure 5 ##ill ##ust ##rates the relationship between adjusted p values and the number of genes being tested .

reference_raw: Figure 5 illustrates the relationship between the adjusted p values and the quantity of genes tested.

reference_spacy_tokens: Figure 5 illustrates the relationship between the adjusted p values and the quantity of genes tested .


fn_spacy_tokens_for_baseline: Only the solidity of the flesh she touched was very far from being imaginary .

source_bert_toks: only the solid ##ity of the flesh she touched was very far from being imaginary .

reference_raw: Only the solidity of the body she touched could not be imagined.

reference_spacy_tokens: Only the solidity of the body she touched could not be imagined .


fn_spacy_tokens_for_baseline: Although Lewis had read Kafka and Virginia Woolf , the virtues of Proust or D. H. Lawrence or T. S. Eliot were virtues he delighted in being unable to see .

source_bert_toks: although lewis had read ka ##fk ##a and virginia woolf , the virtues of pro ##ust or d . h . lawrence or t . s . eliot were virtues he delighted in being unable to see .

reference_raw: Although Lewis had read Kafka and Virginia Woolf, the virtues of Proust, D.H. Lawrence, or T.S. Eliot were the virtues he had enjoyed not seeing.

reference_spacy_tokens: Although Lewis had read Kafka and Virginia Woolf , the virtues of Proust , D.H. Lawrence , or T.S. Eliot were the virtues he had enjoyed not seeing .


fn_spacy_tokens_for_baseline: Some people alleged a bias towards the Conservatives , while others alleged a bias against the Conservatives , for example .

source_bert_toks: some people alleged a bias towards the conservatives , while others alleged a bias against the conservatives , for example .

reference_raw: Some people claimed to be prejudiced against the conservatives, while others claimed to be prejudiced against the conservatives.

reference_spacy_tokens: Some people claimed to be prejudiced against the conservatives , while others claimed to be prejudiced against the conservatives .


fn_spacy_tokens_for_baseline: They are entrusted with the task of tracking down the movement of strangers who are approaching the location .

source_bert_toks: they are entrusted with the task of tracking down the movement of strangers who are approaching the location .

reference_raw: Their mission is to monitor the movement of aliens approaching the site.

reference_spacy_tokens: Their mission is to monitor the movement of aliens approaching the site .


fn_spacy_tokens_for_baseline: In the final assault on May 9 , police blew a hole in a wall surrounding the guerrilla - controlled area .

source_bert_toks: in the final assault on may 9 , police blew a hole in a wall surrounding the guerrilla - controlled area .

reference_raw: In the last attack on May 9th, the police blew a hole in the wall around the guerrilla-controlled area.

reference_spacy_tokens: In the last attack on May 9th , the police blew a hole in the wall around the guerrilla - controlled area .


fn_spacy_tokens_for_baseline: Witnesses in Berridale Avenue in Baillieston , where the attack took place , said the two men , both wearing balaclavas , hurled flaming bottles through one of the van 's windows .

source_bert_toks: witnesses in be ##rri ##dale avenue in bail ##liest ##on , where the attack took place , said the two men , both wearing bala ##cl ##ava ##s , hurled flaming bottles through one of the van ' s windows .

reference_raw: Witnesses on Berridale Avenue, Baillieston, where the attack occurred, said that the two men, both in balaclavas, threw burning bottles through the window of the van.

reference_spacy_tokens: Witnesses on Berridale Avenue , Baillieston , where the attack occurred , said that the two men , both in balaclavas , threw burning bottles through the window of the van .


fn_spacy_tokens_for_baseline: The four month old girls were treated in hospital for smoke inhalation but later allowed home .

source_bert_toks: the four month old girls were treated in hospital for smoke in ##hala ##tion but later allowed home .

reference_raw: The four-month-old girls were treated in the hospital to inhale smoke, but later they were allowed to go home.

reference_spacy_tokens: The four - month - old girls were treated in the hospital to inhale smoke , but later they were allowed to go home .


fn_spacy_tokens_for_baseline: Indeed , in many respects , Ireland was equalled only by Byzantium .

source_bert_toks: indeed , in many respects , ireland was equal ##led only by by ##zan ##tium .

reference_raw: In fact, only Byzantium equalized Ireland in many respects.

reference_spacy_tokens: In fact , only Byzantium equalized Ireland in many respects .


fn_spacy_tokens_for_baseline: Mr Gardiner said that while he was in Gloucester prison in 1988 , he recieved packages of cannabis posted by his estranged wife Maggie .

source_bert_toks: mr gardiner said that while he was in gloucester prison in 1988 , he rec ##ie ##ved packages of cannabis posted by his estranged wife maggie .

reference_raw: Mr. Gardiner said that while he was in Gloucester Prison in 1988, he received parcels of cannabis sent by his alien wife, Maggie.

reference_spacy_tokens: Mr. Gardiner said that while he was in Gloucester Prison in 1988 , he received parcels of cannabis sent by his alien wife , Maggie .


fn_spacy_tokens_for_baseline: Provided that the need of slipping is spotted straight away , it should never be necessary to side - slip close to the ground .

source_bert_toks: provided that the need of slipping is spotted straight away , it should never be necessary to side - slip close to the ground .

reference_raw: If the need to slip is immediately observed, it should never be necessary to slip sideways near the ground.

reference_spacy_tokens: If the need to slip is immediately observed , it should never be necessary to slip sideways near the ground .


fn_spacy_tokens_for_baseline: A celebrated writer of fairy stories , Perrault was also a collaborator of Colbert 's , and the man who prevented Bernini from realising his projected facade for the Louvre .

source_bert_toks: a celebrated writer of fairy stories , per ##ra ##ult was also a collaborator of colbert ' s , and the man who prevented bern ##ini from realising his projected facade for the louvre .

reference_raw: Perrault, the famous writer of fairy tales, was also Colbert's co-worker, and the man who had prevented Bernini from realising his projected face for the Louvre.

reference_spacy_tokens: Perrault , the famous writer of fairy tales , was also Colbert 's co - worker , and the man who had prevented Bernini from realising his projected face for the Louvre .


fn_spacy_tokens_for_baseline: The outer room contained two wash - hand basins with a paper towel dispenser and , to the left of the door , a long Formica - covered counter with a glass above it which apparently served as a dressing - table .

source_bert_toks: the outer room contained two wash - hand basins with a paper towel di ##sp ##ense ##r and , to the left of the door , a long form ##ica - covered counter with a glass above it which apparently served as a dressing - table .

reference_raw: There were two washbasins in the outer room with a paper towel pump and, to the left of the door, a long, Formica-covered counter with a glass above it that seemed to serve as a dressing table.

reference_spacy_tokens: There were two washbasins in the outer room with a paper towel pump and , to the left of the door , a long , Formica - covered counter with a glass above it that seemed to serve as a dressing table .


fn_spacy_tokens_for_baseline: A serious article discussed the problems of recruitment .

source_bert_toks: a serious article discussed the problems of recruitment .

reference_raw: The issue of recruitment was dealt with in a serious article.

reference_spacy_tokens: The issue of recruitment was dealt with in a serious article .


fn_spacy_tokens_for_baseline: But the fracas at Worthing was merely an instance of the civil disorder promised by the BUF in its new phase .

source_bert_toks: but the fra ##cas at worth ##ing was merely an instance of the civil disorder promised by the bu ##f in its new phase .

reference_raw: But Worthing's franchises were just an example of the civil disorder promised by the BUF in its new phase.

reference_spacy_tokens: But Worthing 's franchises were just an example of the civil disorder promised by the BUF in its new phase .


fn_spacy_tokens_for_baseline: She gave a tiny strangled gasp and shuddered , feeling the waves of shock coursing along her veins .

source_bert_toks: she gave a tiny strangled gasp and shuddered , feeling the waves of shock co ##urs ##ing along her veins .

reference_raw: She gave a small, choked breath and shivered, feeling the waves of shock coursing through her veins.

reference_spacy_tokens: She gave a small , choked breath and shivered , feeling the waves of shock coursing through her veins .


fn_spacy_tokens_for_baseline: On May 27 , declares the press release for James Whitaker 's new book , ' a major news story is going to break concerning the marriage of the Prince and Princess of Wales . '

source_bert_toks: on may 27 , declares the press release for james whitaker ' s new book , ' a major news story is going to break concerning the marriage of the prince and princess of wales . '

reference_raw: On May 27, he announces a press release for James Whitaker's new book, "a major news story about the marriage of the Prince and Princess of Wales will be broken."

reference_spacy_tokens: On May 27 , he announces a press release for James Whitaker 's new book , " a major news story about the marriage of the Prince and Princess of Wales will be broken . "


fn_spacy_tokens_for_baseline: Led by American captain Tony Hanson they eventually lost before a capacity crowd .

source_bert_toks: led by american captain tony hanson they eventually lost before a capacity crowd .

reference_raw: In the end, under the command of U.S. Commander Tony Hanson, they lost in front of the capacity crowd.

reference_spacy_tokens: In the end , under the command of U.S. Commander Tony Hanson , they lost in front of the capacity crowd .


fn_spacy_tokens_for_baseline: The United States responded in December 2002 by suspending heavy oil shipments , and North Korea then retaliated by lifting the freeze on its nuclear facilities , expelling IAEA inspectors monitoring that freeze , and announcing its withdrawal from the NPT on 10 January 2003 .

source_bert_toks: the united states responded in december 2002 by suspend ##ing heavy oil shipments , and north korea then re ##tal ##iated by lifting the freeze on its nuclear facilities , ex ##pel ##ling ia ##ea inspectors monitoring that freeze , and announcing its withdrawal from the np ##t on 10 january 2003 .

reference_raw: The United States responded in December 2002 by suspending heavy oil shipments, and North Korea subsequently retaliated by abolishing the freezing of its nuclear facilities, expelling the IAEA inspectors to monitor the freezing and announcing its withdrawal from the NPT on 10 January 2003.

reference_spacy_tokens: The United States responded in December 2002 by suspending heavy oil shipments , and North Korea subsequently retaliated by abolishing the freezing of its nuclear facilities , expelling the IAEA inspectors to monitor the freezing and announcing its withdrawal from the NPT on 10 January 2003 .


fn_spacy_tokens_for_baseline: This created a pattern seen today throughout the Aegean of a small port ( skala ) which serves an inland settlement or chora , making it easier to protect the island from attack .

source_bert_toks: this created a pattern seen today throughout the aegean of a small port ( ska ##la ) which serves an inland settlement or cho ##ra , making it easier to protect the island from attack .

reference_raw: This created a pattern seen today throughout the Aegean of a small port (skala) serving an inland village or chora, which facilitates the protection of the island from attack.

reference_spacy_tokens: This created a pattern seen today throughout the Aegean of a small port ( skala ) serving an inland village or chora , which facilitates the protection of the island from attack .


fn_spacy_tokens_for_baseline: The fact that Coleman was also said to have been ' terminated ' further underlined the notion of his unreliability by suggesting that , even as a snitch , he was not to be believed .

source_bert_toks: the fact that coleman was also said to have been ' terminated ' further under ##lined the notion of his un ##rel ##ia ##bility by suggesting that , even as a s ##ni ##tch , he was not to be believed .

reference_raw: The fact that Coleman was also said to be "terminated" further underscored the notion of his unreliability by suggesting that he could not be trusted, even as a rat.

reference_spacy_tokens: The fact that Coleman was also said to be " terminated " further underscored the notion of his unreliability by suggesting that he could not be trusted , even as a rat .


fn_spacy_tokens_for_baseline: Selected by MaryAnn Stevens , the Academy 's Librarian and Head of Education , and Christopher Lloyd , Surveyor of the Queen 's Pictures , it comprises seventy - one pictures , but no pastels nor drawings .

source_bert_toks: selected by mary ##ann stevens , the academy ' s librarian and head of education , and christopher lloyd , surveyor of the queen ' s pictures , it comprises seventy - one pictures , but no paste ##ls nor drawings .

reference_raw: Selected by Mary Ann Stevens, Academy Librarian and Head of Education, and Christopher Lloyd, Queen's Image Researcher, there are seventy-one paintings, but no pastels or drawings.

reference_spacy_tokens: Selected by Mary Ann Stevens , Academy Librarian and Head of Education , and Christopher Lloyd , Queen 's Image Researcher , there are seventy - one paintings , but no pastels or drawings .


fn_spacy_tokens_for_baseline: Fancy flogging you just because you sliced the legs off the general .

source_bert_toks: fancy fl ##og ##ging you just because you sliced the legs off the general .

reference_raw: Fancy whipped you just because you cut off the General's legs.

reference_spacy_tokens: Fancy whipped you just because you cut off the General 's legs .


fn_spacy_tokens_for_baseline: Simultaneously , Turkish forces seized the port of Batum , but were subsequently expelled by Red Army detachments .

source_bert_toks: simultaneously , turkish forces seized the port of bat ##um , but were subsequently expelled by red army detachments .

reference_raw: At the same time, the Turkish forces seized the port of Batum, but were subsequently deported by the Red Army.

reference_spacy_tokens: At the same time , the Turkish forces seized the port of Batum , but were subsequently deported by the Red Army .


fn_spacy_tokens_for_baseline: In the interest of minimizing opposition to his initiative , he allowed rumours to circulate in army circles to the effect that the speech had been aimed primarily at the UN which was about to debate the war .

source_bert_toks: in the interest of mini ##mi ##zing opposition to his initiative , he allowed rumours to ci ##rc ##ulate in army circles to the effect that the speech had been aimed primarily at the un which was about to debate the war .

reference_raw: In order to minimise opposition to his initiative, he allowed rumors to spread in military circles that the speech was aimed primarily at the UN, which was about to discuss the war.

reference_spacy_tokens: In order to minimise opposition to his initiative , he allowed rumors to spread in military circles that the speech was aimed primarily at the UN , which was about to discuss the war .


fn_spacy_tokens_for_baseline: Islamists will set off dirty bomb , spy bosses believe

source_bert_toks: islamist ##s will set off dirty bomb , spy bosses believe

reference_raw: The Islamists are going to detonate a dirty bomb, the spy bosses believe

reference_spacy_tokens: The Islamists are going to detonate a dirty bomb , the spy bosses believe


fn_spacy_tokens_for_baseline: For Beccaria 's conception of punishing purely in proportion to harm done failed to distinguish between ' crimes ' committed intentionally , under duress or provocation , or even by accident .

source_bert_toks: for becca ##ria ' s conception of punish ##ing purely in proportion to harm done failed to distinguish between ' crimes ' committed intentionally , under du ##ress or pro ##vocation , or even by accident .

reference_raw: Because Beccaria's idea of punishing only in proportion to the damage done did not make a distinction between "crimes" committed intentionally, under duress or provocation, or even by accident.

reference_spacy_tokens: Because Beccaria 's idea of punishing only in proportion to the damage done did not make a distinction between " crimes " committed intentionally , under duress or provocation , or even by accident .


fn_spacy_tokens_for_baseline: Apart from perturbation in Washington concerning the uncertain consequences of border clashes , the political and economic situation in South Korea gave rise to additional anxiety .

source_bert_toks: apart from per ##tur ##bation in washington concerning the uncertain consequences of border clashes , the political and economic situation in south korea gave rise to additional anxiety .

reference_raw: In addition to the turmoil in Washington regarding the uncertain consequences of border conflicts, the political and economic situation in South Korea has led to further concern.

reference_spacy_tokens: In addition to the turmoil in Washington regarding the uncertain consequences of border conflicts , the political and economic situation in South Korea has led to further concern .


fn_spacy_tokens_for_baseline: The application of particular methods can be hampered by cultural effects in a densely populated country like Britain .

source_bert_toks: the application of particular methods can be hampered by cultural effects in a densely populated country like britain .

reference_raw: In a densely populated country such as the United Kingdom, the use of specific methods may be hindered by cultural effects.

reference_spacy_tokens: In a densely populated country such as the United Kingdom , the use of specific methods may be hindered by cultural effects .


fn_spacy_tokens_for_baseline: Does Mr Evans - Pritchard think that torture is so rare in Guatemala that her story is an improbable concoction ?

source_bert_toks: does mr evans - pri ##tch ##ard think that torture is so rare in guatemala that her story is an imp ##ro ##ba ##ble con ##co ##ction ?

reference_raw: Does Mr. Evans-Pritchard think torture is so rare in Guatemala that her story is unlikely to be concocted?

reference_spacy_tokens: Does Mr. Evans - Pritchard think torture is so rare in Guatemala that her story is unlikely to be concocted ?


fn_spacy_tokens_for_baseline: You wanted Dinah as an attraction for your theatre ; you denied her any life of her own .

source_bert_toks: you wanted dinah as an attraction for your theatre ; you denied her any life of her own .

reference_raw: You wanted Dinah to be an attraction to your theater; you refused her any life of her own.

reference_spacy_tokens: You wanted Dinah to be an attraction to your theater ; you refused her any life of her own .


fn_spacy_tokens_for_baseline: Then a hunted look dribbled into his eyes .

source_bert_toks: then a hunted look dr ##ib ##bled into his eyes .

reference_raw: Then a hunted look came into his eyes.

reference_spacy_tokens: Then a hunted look came into his eyes .


fn_spacy_tokens_for_baseline: Maudie Mycroft could see she was wasting her time seeking sympathy from the women and she picked up her shopping bag .

source_bert_toks: maud ##ie my ##croft could see she was wasting her time seeking sympathy from the women and she picked up her shopping bag .

reference_raw: Maudie Mycroft saw that she was wasting her time looking for sympathy from the women, and picked up her shopping bag.

reference_spacy_tokens: Maudie Mycroft saw that she was wasting her time looking for sympathy from the women , and picked up her shopping bag .


fn_spacy_tokens_for_baseline: He squatted opposite us in the open doorway and lit a cigarette .

source_bert_toks: he squat ##ted opposite us in the open doorway and lit a cigarette .

reference_raw: He crouched across from us in the open doorway and lit a cigarette.

reference_spacy_tokens: He crouched across from us in the open doorway and lit a cigarette .


fn_spacy_tokens_for_baseline: Take the case of a floppy disk drive 's sudden failure to read a disk when previously it had shown no proclivity to such failing .

source_bert_toks: take the case of a floppy disk drive ' s sudden failure to read a disk when previously it had shown no pro ##cl ##ivity to such failing .

reference_raw: Take a case where a disk drive suddenly fails to read the disk if it has not previously shown a tendency to such a failure.

reference_spacy_tokens: Take a case where a disk drive suddenly fails to read the disk if it has not previously shown a tendency to such a failure .


fn_spacy_tokens_for_baseline: We have teamed up with Phonogram records to fly you and a guest to the States and put you up in a swanky hotel for a week 's luxury holiday .

source_bert_toks: we have teamed up with ph ##ono ##gram records to fly you and a guest to the states and put you up in a swan ##ky hotel for a week ' s luxury holiday .

reference_raw: We've teamed up Phonogram records to take you and your guest to the U.S. and put you in a swanky hotel for a week's luxurious vacation.

reference_spacy_tokens: We 've teamed up Phonogram records to take you and your guest to the U.S. and put you in a swanky hotel for a week 's luxurious vacation .


fn_spacy_tokens_for_baseline: Economic development since independence was severely handicapped by sabotage and political strife .

source_bert_toks: economic development since independence was severely handicapped by sabotage and political strife .

reference_raw: Economic development since independence has been severely undermined by sabotage and political struggle.

reference_spacy_tokens: Economic development since independence has been severely undermined by sabotage and political struggle .


fn_spacy_tokens_for_baseline: The Turks lost a short war with Italy , and were forced to relinquish the Dodecanese islands to the Italians .

source_bert_toks: the turks lost a short war with italy , and were forced to re ##lin ##qui ##sh the dod ##eca ##nese islands to the italians .

reference_raw: The Turks lost a brief war with Italy and were forced to surrender the islands of Dodecan to the Italians.

reference_spacy_tokens: The Turks lost a brief war with Italy and were forced to surrender the islands of Dodecan to the Italians .


fn_spacy_tokens_for_baseline: The Administration is trying to decide whether Saddam Hussein has WMD .

source_bert_toks: the administration is trying to decide whether saddam hussein has w ##md .

reference_raw: The administration is attempting to determine whether Saddam Hussein has a weapon of mass destruction.

reference_spacy_tokens: The administration is attempting to determine whether Saddam Hussein has a weapon of mass destruction .


fn_spacy_tokens_for_baseline: Goldstein was born on Sept. 23 , 1922 , in Denver and died in Chicago on June 20 , 1944 .

source_bert_toks: goldstein was born on sept . 23 , 1922 , in denver and died in chicago on june 20 , 1944 .

reference_raw: Goldstein was born on September 23, 1922, in Denver, and was killed on June 20, 1944 in Chicago.

reference_spacy_tokens: Goldstein was born on September 23 , 1922 , in Denver , and was killed on June 20 , 1944 in Chicago .


fn_spacy_tokens_for_baseline: Melt the jelly , leave to cool and drizzle over the cream .

source_bert_toks: melt the jelly , leave to cool and dr ##iz ##zle over the cream .

reference_raw: Dissolve the jelly, leave it cool and drizzle on the cream.

reference_spacy_tokens: Dissolve the jelly , leave it cool and drizzle on the cream .


fn_spacy_tokens_for_baseline: He was educated at the North London Collegiate School , and studied medicine for one year at St Francis Xavier College , Bruges .

source_bert_toks: he was educated at the north london collegiate school , and studied medicine for one year at st francis xavier college , br ##uge ##s .

reference_raw: He had been educated at the North London College of Collegiates and had been in medical school for a year at the University of St. Francis Xavier, Bruges.

reference_spacy_tokens: He had been educated at the North London College of Collegiates and had been in medical school for a year at the University of St. Francis Xavier , Bruges .


fn_spacy_tokens_for_baseline: It may be due to two or more separate odours , emanating from two or more works , combining to give rise to a statutory nuisance .

source_bert_toks: it may be due to two or more separate o ##dou ##rs , em ##ana ##ting from two or more works , combining to give rise to a statutory nu ##isance .

reference_raw: It can be caused by two or more different odours, originating from two or more works, which combine to cause legal inconvenience.

reference_spacy_tokens: It can be caused by two or more different odours , originating from two or more works , which combine to cause legal inconvenience .


fn_spacy_tokens_for_baseline: Gunner Paul Johnson was impaled by a fence post -- and lived to tell the tale .

source_bert_toks: gunner paul johnson was imp ##ale ##d by a fence post - - and lived to tell the tale .

reference_raw: Gunner Paul Johnson was trapped in a fence post - and lived to tell the story.

reference_spacy_tokens: Gunner Paul Johnson was trapped in a fence post - and lived to tell the story .


fn_spacy_tokens_for_baseline: Syria 's co - operation with Western countries during the Gulf War aroused some media speculation over the possibility of a future Israeli - Syrian peace agreement .

source_bert_toks: syria ' s co - operation with western countries during the gulf war aroused some media speculation over the possibility of a future israeli - syrian peace agreement .

reference_raw: Syria's cooperation with Western countries during the Gulf War has caused some media speculation about the possibility of a future peace agreement between Israel and Syria.

reference_spacy_tokens: Syria 's cooperation with Western countries during the Gulf War has caused some media speculation about the possibility of a future peace agreement between Israel and Syria .


fn_spacy_tokens_for_baseline: In the next paper Morwenna Griffiths also addresses the question of the relation between the rational and the non - rational .

source_bert_toks: in the next paper mor ##wen ##na griffiths also addresses the question of the relation between the rational and the non - rational .

reference_raw: Morwenna Griffiths also deals with the question of the relationship between the rational and the unreasonable.

reference_spacy_tokens: Morwenna Griffiths also deals with the question of the relationship between the rational and the unreasonable .


fn_spacy_tokens_for_baseline: Although clad with armor to withstand bullets from an AK-47 , the vehicle could be damaged or destroyed while detonating a large roadside bomb .

source_bert_toks: although clad with armor to withstand bullets from an ak - 47 , the vehicle could be damaged or destroyed while det ##ona ##ting a large roadside bomb .

reference_raw: Though clad in armor to withstand AK-47 bullets, the vehicle may have been damaged or destroyed by the explosion of a large roadside bomb.

reference_spacy_tokens: Though clad in armor to withstand AK-47 bullets , the vehicle may have been damaged or destroyed by the explosion of a large roadside bomb .


fn_spacy_tokens_for_baseline: We transiently expressed several cDNAs in mammalian cells , then assayed both cell lysates and conditioned medium in a Schwann cell proliferation assay .

source_bert_toks: we transient ##ly expressed several cd ##nas in mammalian cells , then ass ##ay ##ed both cell l ##ys ##ates and conditioned medium in a sc ##hwa ##nn cell proliferation ass ##ay .

reference_raw: We temporarily expressed several cDNAs in mammalian cells, then tested both cell lysates and conditioned media in the Schwann cell proliferation test.

reference_spacy_tokens: We temporarily expressed several cDNAs in mammalian cells , then tested both cell lysates and conditioned media in the Schwann cell proliferation test .


fn_spacy_tokens_for_baseline: Despite President Clinton 's widely reported refusal to rule out the use of ground troops , the Times continued to portray him as a wimp .

source_bert_toks: despite president clinton ' s widely reported refusal to rule out the use of ground troops , the times continued to portray him as a wi ##mp .

reference_raw: Despite President Clinton's widespread refusal to exclude the use of ground troops, the Times still portrayed him as a weak man.

reference_spacy_tokens: Despite President Clinton 's widespread refusal to exclude the use of ground troops , the Times still portrayed him as a weak man .


fn_spacy_tokens_for_baseline: The catering business itself is regulated by various Acts of Parliament which impose duties and standards of conduct that must be observed .

source_bert_toks: the catering business itself is regulated by various acts of parliament which impose duties and standards of conduct that must be observed .

reference_raw: The catering industry itself is governed by various acts of the European Parliament which lay down the obligations and standards of conduct to be complied with.

reference_spacy_tokens: The catering industry itself is governed by various acts of the European Parliament which lay down the obligations and standards of conduct to be complied with .


fn_spacy_tokens_for_baseline: His contrition amazed her .

source_bert_toks: his con ##tri ##tion amazed her .

reference_raw: She was surprised by his remorse.

reference_spacy_tokens: She was surprised by his remorse .


fn_spacy_tokens_for_baseline: In the mining villages . can be found both deference and powerless resistance .

source_bert_toks: in the mining villages . can be found both def ##erence and powerless resistance .

reference_raw: Deference and helpless resistance can be found in mining villages.

reference_spacy_tokens: Deference and helpless resistance can be found in mining villages .


fn_spacy_tokens_for_baseline: Others , such as those into an assault on youths in Holloway and into the ' crime - fixing ' charges against Kent police , almost failed on account of a lack of sufficient police co - operation .

source_bert_toks: others , such as those into an assault on youths in holloway and into the ' crime - fixing ' charges against kent police , almost failed on account of a lack of sufficient police co - operation .

reference_raw: Others, like the ones who attacked young people in Holloway and the criminal charges against the Kent police, nearly failed because of a lack of police cooperation.

reference_spacy_tokens: Others , like the ones who attacked young people in Holloway and the criminal charges against the Kent police , nearly failed because of a lack of police cooperation .


fn_spacy_tokens_for_baseline: THE TODAY - sponsored team of climbers hopes to make a unique dash to the summit of Everest within a week .

source_bert_toks: the today - sponsored team of climb ##ers hopes to make a unique dash to the summit of everest within a week .

reference_raw: Today's crew of climbers hopes to make a unique dash to the top of Everest in a week.

reference_spacy_tokens: Today 's crew of climbers hopes to make a unique dash to the top of Everest in a week .


fn_spacy_tokens_for_baseline: In sum , at both the federal and state government levels at least part of the seemingly irrational behavior voters display in the voting booth may have an exceedingly rational explanation .

source_bert_toks: in sum , at both the federal and state government levels at least part of the seemingly irrational behavior voters display in the voting booth may have an exceeding ##ly rational explanation .

reference_raw: In short, at the federal and state level, at least part of the seemingly irrational behaviour of voters in the voting booth may have an extremely rational explanation.

reference_spacy_tokens: In short , at the federal and state level , at least part of the seemingly irrational behaviour of voters in the voting booth may have an extremely rational explanation .


fn_spacy_tokens_for_baseline: Oh yeah , i 've got the dog and two kids waiting here .

source_bert_toks: oh yeah , i ' ve got the dog and two kids waiting here .

reference_raw: Yeah, there's a dog and two children waiting for me.

reference_spacy_tokens: Yeah , there 's a dog and two children waiting for me .


fn_spacy_tokens_for_baseline: Steve , who was sitting next to John , got down in Rome .

source_bert_toks: steve , who was sitting next to john , got down in rome .

reference_raw: Steve, seated beside John, went to Rome.

reference_spacy_tokens: Steve , seated beside John , went to Rome .


fn_spacy_tokens_for_baseline: They aimed for higher status jobs and felt humiliated when they were unemployed .

source_bert_toks: they aimed for higher status jobs and felt humiliated when they were unemployed .

reference_raw: They were aiming for higher-ranking jobs, and when they were unemployed, they felt embarrassed.

reference_spacy_tokens: They were aiming for higher - ranking jobs , and when they were unemployed , they felt embarrassed .


fn_spacy_tokens_for_baseline: Ruth touched her temple , feeling the bruise where Adam had hit her .

source_bert_toks: ruth touched her temple , feeling the bruise where adam had hit her .

reference_raw: Ruth touched her forehead and felt the bruise where Adam had struck her.

reference_spacy_tokens: Ruth touched her forehead and felt the bruise where Adam had struck her .


fn_spacy_tokens_for_baseline: She hated Lamb , who was his favourite writer , and once terrified the class by saying so by mistake .

source_bert_toks: she hated lamb , who was his favourite writer , and once terrified the class by saying so by mistake .

reference_raw: She hated Lamb, who was his favorite writer, and she had once frightened the class by mistake.

reference_spacy_tokens: She hated Lamb , who was his favorite writer , and she had once frightened the class by mistake .


fn_spacy_tokens_for_baseline: The pony poked his head out of the half - door and fixed a sullen stare on his mistress .

source_bert_toks: the pony poked his head out of the half - door and fixed a sul ##len stare on his mistress .

reference_raw: The pony poked his head out of the half-door and looked sullenly at his mistress.

reference_spacy_tokens: The pony poked his head out of the half - door and looked sullenly at his mistress .


fn_spacy_tokens_for_baseline: Privileged characters in eighteenth - century fiction do not share Dorothea 's discomforting sense that the poor are another species , as remote from their experience , as incomprehensible , as an African tribe .

source_bert_toks: privileged characters in eighteenth - century fiction do not share dorothea ' s discomfort ##ing sense that the poor are another species , as remote from their experience , as inc ##omp ##re ##hen ##sible , as an african tribe .

reference_raw: The privileged figures of eighteenth-century fiction do not share Dorothea's unpleasant feeling that the poor are a different species, as far away from their experience and as incomprehensible as the African tribe.

reference_spacy_tokens: The privileged figures of eighteenth - century fiction do not share Dorothea 's unpleasant feeling that the poor are a different species , as far away from their experience and as incomprehensible as the African tribe .


fn_spacy_tokens_for_baseline: The perplexed driver took him to a police station -- which then contacted Steve .

source_bert_toks: the per ##plex ##ed driver took him to a police station - - which then contacted steve .

reference_raw: The confused driver took him to the police station - and then he got in touch with Steve.

reference_spacy_tokens: The confused driver took him to the police station - and then he got in touch with Steve .


fn_spacy_tokens_for_baseline: Other therapeutic agents well known to adversely affect serum lipid levels include oestrogen - containing oral contraceptives , androgens , and moderate dosage of corticosteroid therapy .

source_bert_toks: other therapeutic agents well known to adverse ##ly affect serum lip ##id levels include o ##est ##rogen - containing oral contra ##ceptive ##s , and ##rogen ##s , and moderate dos ##age of co ##rti ##cos ##ter ##oid therapy .

reference_raw: Other medicinal products known to have a negative effect on serum lipids include oestrogen-containing oral contraceptives, androgens, and a moderate dose of corticosteroid therapy.

reference_spacy_tokens: Other medicinal products known to have a negative effect on serum lipids include oestrogen - containing oral contraceptives , androgens , and a moderate dose of corticosteroid therapy .


fn_spacy_tokens_for_baseline: " Four Aberdeen Proving Ground employees were taken to a local hospital yesterday after a report of a chemical leak , the third incident in about a week during which workers were at risk of exposure to lethal substances at the Army base in Harford County .

source_bert_toks: " four aberdeen proving ground employees were taken to a local hospital yesterday after a report of a chemical leak , the third incident in about a week during which workers were at risk of exposure to lethal substances at the army base in ha ##rford county .

reference_raw: "Four Aberdeen Proving Ground personnel were taken to a local hospital yesterday after a chemical leak was reported, the third accident in about a week during which workers at Harford County Army base were exposed to lethal substances.

reference_spacy_tokens: " Four Aberdeen Proving Ground personnel were taken to a local hospital yesterday after a chemical leak was reported , the third accident in about a week during which workers at Harford County Army base were exposed to lethal substances .


fn_spacy_tokens_for_baseline: He makes a just estimate of Scott 's poetry and then acclaims the novels .

source_bert_toks: he makes a just estimate of scott ' s poetry and then acclaim ##s the novels .

reference_raw: He's making a fair estimate of Scott's poetry, and then he's acknowledging the novels.

reference_spacy_tokens: He 's making a fair estimate of Scott 's poetry , and then he 's acknowledging the novels .


fn_spacy_tokens_for_baseline: Houses could be glimpsed within the hillside vegetation , villas of stone or wooden slats , painted in startling shades of aquamarine and lime , rust red and canary yellow .

source_bert_toks: houses could be glimpse ##d within the hillside vegetation , villas of stone or wooden sl ##ats , painted in startling shades of aqua ##marine and lime , rust red and canary yellow .

reference_raw: Houses were visible in the hillside vegetation, villas of stone or wooden slats, drawn in surprising shades of aquamarine and lime, rusty red and canary-yellow.

reference_spacy_tokens: Houses were visible in the hillside vegetation , villas of stone or wooden slats , drawn in surprising shades of aquamarine and lime , rusty red and canary - yellow .


fn_spacy_tokens_for_baseline: A civilian with the grey wool skull cap of the Svan people , from the high glens of Georgia , jumped up to help .

source_bert_toks: a civilian with the grey wool skull cap of the sv ##an people , from the high glen ##s of georgia , jumped up to help .

reference_raw: From the high glens of Georgia, a civilian with a gray wool skullcap of the Svans jumped to his aid.

reference_spacy_tokens: From the high glens of Georgia , a civilian with a gray wool skullcap of the Svans jumped to his aid .


fn_spacy_tokens_for_baseline: She would not think of the pitiful remains in the corner .

source_bert_toks: she would not think of the pit ##iful remains in the corner .

reference_raw: She wouldn't think about the pathetic remains in the corner.

reference_spacy_tokens: She would n't think about the pathetic remains in the corner .


fn_spacy_tokens_for_baseline: Wexford wiped his brow with his handkerchief and , following Camb 's example , began to fan himself with the morning paper .

source_bert_toks: wexford wiped his brow with his handkerchief and , following cam ##b ' s example , began to fan himself with the morning paper .

reference_raw: Wexford wiped his forehead with his handkerchief and, following Camb's example, began fanning his morning paper.

reference_spacy_tokens: Wexford wiped his forehead with his handkerchief and , following Camb 's example , began fanning his morning paper .


fn_spacy_tokens_for_baseline: Adam folded up the pieces of paper , walked quickly over to the bookcase and inserted them alongside the original letter in the Bible seconds before Lawrence put his head round the door .

source_bert_toks: adam folded up the pieces of paper , walked quickly over to the book ##case and inserted them alongside the original letter in the bible seconds before lawrence put his head round the door .

reference_raw: Adam folded up the pieces of paper, went quickly to the library, and put them together with the original letter in the Bible a few seconds before Lawrence put his head around the door.

reference_spacy_tokens: Adam folded up the pieces of paper , went quickly to the library , and put them together with the original letter in the Bible a few seconds before Lawrence put his head around the door .


fn_spacy_tokens_for_baseline: He continued to read voraciously throughout the 1790s , and there seems no reason to doubt Coleridge ' s belief that Wordsworth was eminently equipped to write philosophical poetry .

source_bert_toks: he continued to read vo ##rac ##iously throughout the 1790 ##s , and there seems no reason to doubt cole ##ridge ' s belief that words ##worth was eminent ##ly equipped to write philosophical poetry .

reference_raw: Throughout the 1790s, he read vigorously, and there seems to be no reason to doubt Coleridge's belief that Wordsworth was eminently equipped to write philosophical poems.

reference_spacy_tokens: Throughout the 1790s , he read vigorously , and there seems to be no reason to doubt Coleridge 's belief that Wordsworth was eminently equipped to write philosophical poems .


fn_spacy_tokens_for_baseline: Thiercelin , to whom first impressions were important , sensed that beneath the gushing stream of words she was not altogether at ease .

source_bert_toks: th ##ier ##cel ##in , to whom first impressions were important , sensed that beneath the gus ##hing stream of words she was not altogether at ease .

reference_raw: Thiercelin, whose first impressions were important, felt that she was not quite at ease under the gust of words.

reference_spacy_tokens: Thiercelin , whose first impressions were important , felt that she was not quite at ease under the gust of words .


fn_spacy_tokens_for_baseline: One hundred firemen tackled the blaze .

source_bert_toks: one hundred fire ##men tackled the blaze .

reference_raw: A hundred firefighters fought the fire.

reference_spacy_tokens: A hundred firefighters fought the fire .


fn_spacy_tokens_for_baseline: She packed her mail in the saddlebag .

source_bert_toks: she packed her mail in the saddle ##bag .

reference_raw: She put her mail in her saddlebag.

reference_spacy_tokens: She put her mail in her saddlebag .


fn_spacy_tokens_for_baseline: She 'd stripped to her stockings and garter belt , and carried a high stool centre stage .

source_bert_toks: she ' d stripped to her stockings and ga ##rter belt , and carried a high stool centre stage .

reference_raw: She undressed herself to her socks and garter belt and carried a high stool-centre stage.

reference_spacy_tokens: She undressed herself to her socks and garter belt and carried a high stool - centre stage .


fn_spacy_tokens_for_baseline: A saw - handled flintlock duelling pistol by T. Mortimer & Son , lacking ramrod and with a broken cock , still managed to reach £ 1,450 .

source_bert_toks: a saw - handled flint ##lock duel ##ling pistol by t . mortimer & son , lacking ram ##rod and with a broken cock , still managed to reach £1 , 450 .

reference_raw: T. Mortimer & Son's saw-handled flintlock-fighting pistol, missing ramrod and with a shattered cock, still managed to reach 1,450 pounds.

reference_spacy_tokens: T. Mortimer & Son 's saw - handled flintlock - fighting pistol , missing ramrod and with a shattered cock , still managed to reach 1,450 pounds .


fn_spacy_tokens_for_baseline: The portiere barked some instructions at the boy and made Sandison to understand that Aldo would see to it that the letter got posted .

source_bert_toks: the port ##iere barked some instructions at the boy and made sand ##ison to understand that aldo would see to it that the letter got posted .

reference_raw: The portiere snapped instructions at the boy, forcing Sandison to understand that Aldo would see to it that the letter was sent.

reference_spacy_tokens: The portiere snapped instructions at the boy , forcing Sandison to understand that Aldo would see to it that the letter was sent .


fn_spacy_tokens_for_baseline: She glanced down , dusting the dirt from the pebble off her hands , wondering how to answer such an unanswerable question .

source_bert_toks: she glanced down , dustin ##g the dirt from the pe ##bble off her hands , wondering how to answer such an una ##ns ##wer ##able question .

reference_raw: She looked down and brushed the dirt from the stone from her hands, wondering how to answer such an unanswerable question.

reference_spacy_tokens: She looked down and brushed the dirt from the stone from her hands , wondering how to answer such an unanswerable question .


fn_spacy_tokens_for_baseline: For similar reasons , hijackings involving aircraft , ships and cars are not uncommon .

source_bert_toks: for similar reasons , hi ##jack ##ings involving aircraft , ships and cars are not uncommon .

reference_raw: For similar reasons, kidnappings involving aircraft, ships and vehicles are not uncommon.

reference_spacy_tokens: For similar reasons , kidnappings involving aircraft , ships and vehicles are not uncommon .


fn_spacy_tokens_for_baseline: His face was agonized and he was trying to tell me something .

source_bert_toks: his face was ago ##ni ##zed and he was trying to tell me something .

reference_raw: His face was hurt, and he tried to say something to me.

reference_spacy_tokens: His face was hurt , and he tried to say something to me .


fn_spacy_tokens_for_baseline: The jacket can be mixed and matched with trousers and short , pleated skirts , and the skirt with tunic shapes , shirts or jackets of different lengths .

source_bert_toks: the jacket can be mixed and matched with trousers and short , plea ##ted skirts , and the skirt with tunic shapes , shirts or jackets of different lengths .

reference_raw: The jacket may be mixed and matched with trousers and short, pleated kilts, and a jacket with the shape of a tunic, shirt or jacket of different lengths.

reference_spacy_tokens: The jacket may be mixed and matched with trousers and short , pleated kilts , and a jacket with the shape of a tunic , shirt or jacket of different lengths .


fn_spacy_tokens_for_baseline: I 'll freeze the hand and cauterise the wound .

source_bert_toks: i ' ll freeze the hand and ca ##uter ##ise the wound .

reference_raw: I'm going to ice my hand and cauterize the wound.

reference_spacy_tokens: I 'm going to ice my hand and cauterize the wound .


fn_spacy_tokens_for_baseline: For example , Walter Laqueur , a terrorism specialist at the Center for Strategic and International Studies in Washington , D.C. , defines terrorism as : " The sub - state application of violence or threatened violence intended to sow panic in a society , to weaken or even overthrow the incumbents , and to bring about political change . "

source_bert_toks: for example , walter la ##que ##ur , a terrorism specialist at the center for strategic and international studies in washington , d . c . , defines terrorism as : " the sub - state application of violence or threatened violence intended to so ##w panic in a society , to weaken or even overthrow the incumbent ##s , and to bring about political change . "

reference_raw: For example, Walter Laqueur, a terrorist specialist at the Center for Strategic and International Studies in Washington, Washington, D.C., defines terrorism as: "A sub-state application of violence or threat of violence aimed at sowing panic in society, weakening or even overthrowing incumbents, and bringing about political transition."

reference_spacy_tokens: For example , Walter Laqueur , a terrorist specialist at the Center for Strategic and International Studies in Washington , Washington , D.C. , defines terrorism as : " A sub - state application of violence or threat of violence aimed at sowing panic in society , weakening or even overthrowing incumbents , and bringing about political transition . "


fn_spacy_tokens_for_baseline: One minister was miffed yesterday when he found his seat occupied by a journalist talking to a fellow cabinet member before the meeting began .

source_bert_toks: one minister was mi ##ffed yesterday when he found his seat occupied by a journalist talking to a fellow cabinet member before the meeting began .

reference_raw: One of the ministers was misplaced yesterday when he found himself occupied by a journalist who was talking to a fellow cabinet member before the meeting began.

reference_spacy_tokens: One of the ministers was misplaced yesterday when he found himself occupied by a journalist who was talking to a fellow cabinet member before the meeting began .


fn_spacy_tokens_for_baseline: " Leonard . " whimpered Hannah Dooley .

source_bert_toks: " leonard . " whimpered hannah doo ##ley .

reference_raw: "Leonard," Hannah Dooley whined.

reference_spacy_tokens: " Leonard , " Hannah Dooley whined .


fn_spacy_tokens_for_baseline: Causes , like the other conditions which enter into causal circumstances , are at bottom conceived by us to be certain spatio - temporal items , individual properties .

source_bert_toks: causes , like the other conditions which enter into causal circumstances , are at bottom conceived by us to be certain spat ##io - temporal items , individual properties .

reference_raw: Causes, like other conditions that come into causation, are at the very least designed by us to be certain spatial-temporal items, individual properties.

reference_spacy_tokens: Causes , like other conditions that come into causation , are at the very least designed by us to be certain spatial - temporal items , individual properties .


fn_spacy_tokens_for_baseline: There are important dissimilarities between the United States and Britain in terms of geography , demography , and social history .

source_bert_toks: there are important di ##ssi ##mi ##lar ##ities between the united states and britain in terms of geography , demo ##graphy , and social history .

reference_raw: There are significant differences between the United States and the United Kingdom in terms of geography, demographics and social history.

reference_spacy_tokens: There are significant differences between the United States and the United Kingdom in terms of geography , demographics and social history .


fn_spacy_tokens_for_baseline: The Secretary of State is also prone to make pronouncements which can be highly relevant , especially on appeal .

source_bert_toks: the secretary of state is also prone to make pro ##no ##unce ##ments which can be highly relevant , especially on appeal .

reference_raw: The Secretary of State also has a tendency to make a statement that may be very important, particularly in the context of an appeal.

reference_spacy_tokens: The Secretary of State also has a tendency to make a statement that may be very important , particularly in the context of an appeal .


fn_spacy_tokens_for_baseline: Drawing a large invited audience of , the debate was chaired by Hugh Rossi , former chairman of the House of Commons Environmental Committee and now a consultant with Wimpey Environmental .

source_bert_toks: drawing a large invited audience of , the debate was chaired by hugh rossi , former chairman of the house of commons environmental committee and now a consultant with wi ##mp ##ey environmental .

reference_raw: Hugh Rossi, former chairman of the House of Commons Environmental Committee, and now a consultant with Wimpey Environmental, led the debate.

reference_spacy_tokens: Hugh Rossi , former chairman of the House of Commons Environmental Committee , and now a consultant with Wimpey Environmental , led the debate .