fn_spacy_tokens_for_baseline: Requirements of joining AL QAEDA : 1 - Abiding by AL QAEDA rules , its beliefs and objectives as previously mentioned 2 - Obedience to the leaders in charge as much as possible , without disobeying Islamic rules 3 - No connection between AL QAEDA membership and any other Islamic group 4 - Maintain secrecy in work - related issues 5- Physically healthy ( except in administrative work ) 6- The candidate should not be in question when it comes to religion , integrity or his morality 7- Reciting the pledge of AL - QAEDA .

source_bert_toks: requirements of joining al qaeda : 1 - ab ##idi ##ng by al qaeda rules , its beliefs and objectives as previously mentioned 2 - obedience to the leaders in charge as much as possible , without di ##so ##bey ##ing islamic rules 3 - no connection between al qaeda membership and any other islamic group 4 - maintain secrecy in work - related issues 5 - physically healthy ( except in administrative work ) 6 - the candidate should not be in question when it comes to religion , integrity or his morality 7 - rec ##iting the pledge of al - qaeda .

reference_raw: Requests for membership of AL QAEDA: 1 - Abiding by the rules of the AL QAEDA, its beliefs and objectives as set out above 2 - Obedience to the leaders responsible, as far as possible, without violating Islamic rules 3 - No link between AL QAEDA and any other Islamic group 4 - Keeping secrets on work-related matters 5- Physically sound (excluding administrative work) 6- in terms of religion, integrity or morality 7-Reciting AL-QAEDA's promise.

reference_spacy_tokens: Requests for membership of AL QAEDA : 1 - Abiding by the rules of the AL QAEDA , its beliefs and objectives as set out above 2 - Obedience to the leaders responsible , as far as possible , without violating Islamic rules 3 - No link between AL QAEDA and any other Islamic group 4 - Keeping secrets on work - related matters 5- Physically sound ( excluding administrative work ) 6- in terms of religion , integrity or morality 7-Reciting AL - QAEDA 's promise .


fn_spacy_tokens_for_baseline: With earache children may screech out , can not keep still with the pain and may be violently excited by it .

source_bert_toks: with ear ##ache children may sc ##ree ##ch out , can not keep still with the pain and may be violently excited by it .

reference_raw: With earache, children can scream, they can't keep up with the pain, and they can be violently aroused by it.

reference_spacy_tokens: With earache , children can scream , they ca n't keep up with the pain , and they can be violently aroused by it .


fn_spacy_tokens_for_baseline: The crisis arose eventually over another matter , when Ken exerted successful moral pressure on one of William 's Dutch courtiers to marry the Princess 's maid of honour whom he had seduced .

source_bert_toks: the crisis arose eventually over another matter , when ken ex ##erted successful moral pressure on one of william ' s dutch court ##iers to marry the princess ' s maid of honour whom he had seduce ##d .

reference_raw: Finally, the crisis had arisen on another matter, when Ken had put a successful moral constraint on one of William's Dutch courtiers to marry the Princess's maid of honor he had seduced.

reference_spacy_tokens: Finally , the crisis had arisen on another matter , when Ken had put a successful moral constraint on one of William 's Dutch courtiers to marry the Princess 's maid of honor he had seduced .


fn_spacy_tokens_for_baseline: QN : Did a U.S. official claim that Libya is developing chemical , biological or nuclear weapons ?

source_bert_toks: q ##n : did a u . s . official claim that libya is developing chemical , biological or nuclear weapons ?

reference_raw: QN: Has the US official argued that Libya is developing chemical, biological or nuclear weapons?

reference_spacy_tokens: QN : Has the US official argued that Libya is developing chemical , biological or nuclear weapons ?


fn_spacy_tokens_for_baseline: When Doyle was finally conducted through , and seated across the table from the lag , Moss said gruffly , ' Well ? '

source_bert_toks: when doyle was finally conducted through , and seated across the table from the la ##g , moss said gruff ##ly , ' well ? '

reference_raw: When Doyle was finally finished and seated across the table from the lag, Moss said gruffly, "Well?"

reference_spacy_tokens: When Doyle was finally finished and seated across the table from the lag , Moss said gruffly , " Well ? "


fn_spacy_tokens_for_baseline: They cause illness or death within minutes to hours after exposure .

source_bert_toks: they cause illness or death within minutes to hours after exposure .

reference_raw: They induce disease or death within minutes to hours of exposure.

reference_spacy_tokens: They induce disease or death within minutes to hours of exposure .


fn_spacy_tokens_for_baseline: ' I suppose I had better go , to keep an eye on you , ' Ratagan said absently , but he was grinning .

source_bert_toks: ' i suppose i had better go , to keep an eye on you , ' rat ##aga ##n said absently , but he was grinning .

reference_raw: 'I think I should go and watch you,' Ratagan said absently, but he smiled.

reference_spacy_tokens: ' I think I should go and watch you , ' Ratagan said absently , but he smiled .


fn_spacy_tokens_for_baseline: Reaching the village across the sea of dazzling snow was impossible by motor cycle , and often difficult on foot .

source_bert_toks: reaching the village across the sea of dazzling snow was impossible by motor cycle , and often difficult on foot .

reference_raw: It was impossible to get to the village across a sea of blinding snow, and often difficult to walk.

reference_spacy_tokens: It was impossible to get to the village across a sea of blinding snow , and often difficult to walk .


fn_spacy_tokens_for_baseline: ' If we did n't all turn into disgusting lumps of decaying meat , men would be even more arrogant than they are .

source_bert_toks: ' if we didn ' t all turn into disgusting lump ##s of decay ##ing meat , men would be even more arrogant than they are .

reference_raw: 'If we hadn't all turned into disgusting pieces of rotting flesh, men would have been even more arrogant than they were.

reference_spacy_tokens: ' If we had n't all turned into disgusting pieces of rotting flesh , men would have been even more arrogant than they were .


fn_spacy_tokens_for_baseline: The Daily Telegraph reports that US scientists have ( for some reason best known to themselves ) succeeded in making water run uphill .

source_bert_toks: the daily telegraph reports that us scientists have ( for some reason best known to themselves ) succeeded in making water run up ##hill .

reference_raw: The Daily Telegraph reports that American scientists (for some reason best known to them) managed to make the water go uphill.

reference_spacy_tokens: The Daily Telegraph reports that American scientists ( for some reason best known to them ) managed to make the water go uphill .


fn_spacy_tokens_for_baseline: Coming up on News Night Tonight , cooking a turkey is fine . ( ( Appearing ) ) in one is n't .

source_bert_toks: coming up on news night tonight , cooking a turkey is fine . ( ( appearing ) ) in one isn ' t .

reference_raw: Coming to News Tonight, cooking a turkey is fine. (Appearing) in one of them, it's not.

reference_spacy_tokens: Coming to News Tonight , cooking a turkey is fine . ( Appearing ) in one of them , it 's not .


fn_spacy_tokens_for_baseline: ' Left what ? ' he yelled over the noise of the engine and the wind .

source_bert_toks: ' left what ? ' he yelled over the noise of the engine and the wind .

reference_raw: "What's left?" he shouted over the sound of the engine and the wind.

reference_spacy_tokens: " What 's left ? " he shouted over the sound of the engine and the wind .


fn_spacy_tokens_for_baseline: Landsat-4 obtains data with two sensors .

source_bert_toks: lands ##at - 4 obtain ##s data with two sensors .

reference_raw: Landsat-4 is receiving data from two sensors.

reference_spacy_tokens: Landsat-4 is receiving data from two sensors .


fn_spacy_tokens_for_baseline: She threw her sister an apprehensive glance but was reassured to see she was smiling .

source_bert_toks: she threw her sister an app ##re ##hen ##sive glance but was reassured to see she was smiling .

reference_raw: She gave her sister a worried look, but she was relieved to see that she was smiling.

reference_spacy_tokens: She gave her sister a worried look , but she was relieved to see that she was smiling .


fn_spacy_tokens_for_baseline: Police stations , ICPC and the EFCC , all these commissions were in support of investigating my case and helped me out of the pains .

source_bert_toks: police stations , ic ##pc and the e ##fc ##c , all these commissions were in support of investigating my case and helped me out of the pains .

reference_raw: The police stations, the ICPC and the EFCC, all those commissions, they've been supporting my case and they've been assisting me through the pain.

reference_spacy_tokens: The police stations , the ICPC and the EFCC , all those commissions , they 've been supporting my case and they 've been assisting me through the pain .


fn_spacy_tokens_for_baseline: She had been halfway through wallpapering one room when the pull of the sun had grown too strong to resist a second longer .

source_bert_toks: she had been halfway through wall ##paper ##ing one room when the pull of the sun had grown too strong to resist a second longer .

reference_raw: She was in the middle of a wall-papering room when the pull of the sun was too strong to resist a second longer.

reference_spacy_tokens: She was in the middle of a wall - papering room when the pull of the sun was too strong to resist a second longer .


fn_spacy_tokens_for_baseline: I got ta go to New York .

source_bert_toks: i gotta go to new york .

reference_raw: I have to get to New York.

reference_spacy_tokens: I have to get to New York .


fn_spacy_tokens_for_baseline: Thus the machine automatically differentiates between an incoming fax signal and voice call and will respond accordingly .

source_bert_toks: thus the machine automatically differentiate ##s between an incoming fa ##x signal and voice call and will respond accordingly .

reference_raw: The machine thus automatically distinguishes between an incoming fax signal and a voice call and responds accordingly.

reference_spacy_tokens: The machine thus automatically distinguishes between an incoming fax signal and a voice call and responds accordingly .


fn_spacy_tokens_for_baseline: In the Syrian town of Suwaida , a French force of 3,000 troops was routed by Druze militiamen who then advanced on Damascus .

source_bert_toks: in the syrian town of su ##wai ##da , a french force of 3 , 000 troops was routed by dr ##uze militia ##men who then advanced on damascus .

reference_raw: In the Syrian city of Suwaida, a French force of 3,000 troops was directed by Druze militiamen, who then made their way to Damascus.

reference_spacy_tokens: In the Syrian city of Suwaida , a French force of 3,000 troops was directed by Druze militiamen , who then made their way to Damascus .


fn_spacy_tokens_for_baseline: A narrow matching fabric belt covers the gently elasticated waistband , and can be alternated with belts of your own for a contrasting effect .

source_bert_toks: a narrow matching fabric belt covers the gently elastic ##ated waistband , and can be alternate ##d with belts of your own for a contrasting effect .

reference_raw: A narrow matching cloth belt covers the slightly elasticated belt and may be replaced by your own belts for contrast.

reference_spacy_tokens: A narrow matching cloth belt covers the slightly elasticated belt and may be replaced by your own belts for contrast .


fn_spacy_tokens_for_baseline: However , because they can not compete in two competitions , the winner or runner - up in tomorrow 's final will secure a spot in next season 's European Cup Winners ' Cup .

source_bert_toks: however , because they can not compete in two competitions , the winner or runner - up in tomorrow ' s final will secure a spot in next season ' s european cup winners ' cup .

reference_raw: However, since they cannot compete in two contests, the winner or runner of tomorrow's finals will secure a spot for the next season's European Cup winners.

reference_spacy_tokens: However , since they can not compete in two contests , the winner or runner of tomorrow 's finals will secure a spot for the next season 's European Cup winners .


fn_spacy_tokens_for_baseline: ' Dee and Kelley have been shadowing us ever since we left my office .

source_bert_toks: ' dee and kelley have been shadow ##ing us ever since we left my office .

reference_raw: Dee and Kelley have been watching us since we left my office.

reference_spacy_tokens: Dee and Kelley have been watching us since we left my office .


fn_spacy_tokens_for_baseline: Then he thought he was being pampered , so he moved into a dirty hovel , ' where he lay on straw like a beast ' .

source_bert_toks: then he thought he was being pam ##per ##ed , so he moved into a dirty hove ##l , ' where he lay on straw like a beast ' .

reference_raw: Then he thought he was spoiled, so he moved to the filthy hut, where he lay on the straw like an animal.

reference_spacy_tokens: Then he thought he was spoiled , so he moved to the filthy hut , where he lay on the straw like an animal .


fn_spacy_tokens_for_baseline: 3- Entrances to the towers should be totally camouflaged .

source_bert_toks: 3 - entrances to the towers should be totally camouflage ##d .

reference_raw: 3-The entrances to the towers must be completely masked.

reference_spacy_tokens: 3-The entrances to the towers must be completely masked .


fn_spacy_tokens_for_baseline: Is Chatterbox alone in thinking there is something strange and even disgusting about Stephanopoulos ' eager show of independence from the president ?

source_bert_toks: is chatter ##box alone in thinking there is something strange and even disgusting about stephan ##op ##oulos ' eager show of independence from the president ?

reference_raw: Is Chatterbox the only one who believes that Stephanopoulos' eager display of independence from the president is something strange, even disgusting?

reference_spacy_tokens: Is Chatterbox the only one who believes that Stephanopoulos ' eager display of independence from the president is something strange , even disgusting ?


fn_spacy_tokens_for_baseline: The exterior is notable for its diamond pane windows , deep second - story overhang , and massive chimneys .

source_bert_toks: the exterior is notable for its diamond pan ##e windows , deep second - story over ##hang , and massive chimneys .

reference_raw: The exterior is notable for the diamond panels, the deep second-story overhang, and the massive chimneys.

reference_spacy_tokens: The exterior is notable for the diamond panels , the deep second - story overhang , and the massive chimneys .


fn_spacy_tokens_for_baseline: The issue was that the receivers had sufficient liquid assets to pay themselves and then terminate the receivership if they only paid themselves the amount of remuneration which B and L thought was due to them .

source_bert_toks: the issue was that the receivers had sufficient liquid assets to pay themselves and then terminate the receivers ##hip if they only paid themselves the amount of re ##mun ##eration which b and l thought was due to them .

reference_raw: The problem was that the receivers had enough liquid property to pay for themselves and then put an end to the receivership if they paid only the amount of remuneration that B and L considered to be due to them.

reference_spacy_tokens: The problem was that the receivers had enough liquid property to pay for themselves and then put an end to the receivership if they paid only the amount of remuneration that B and L considered to be due to them .


fn_spacy_tokens_for_baseline: ' I was frantic that they 'd found out about the flat , where she lived .

source_bert_toks: ' i was frantic that they ' d found out about the flat , where she lived .

reference_raw: I was desperate to find out about the apartment where she lived.

reference_spacy_tokens: I was desperate to find out about the apartment where she lived .


fn_spacy_tokens_for_baseline: At last , dripping wet , with water sparkling like jewels on her cheeks and forehead , and rivulets running from her hair , she stepped from the last stone on to the bank .

source_bert_toks: at last , dripping wet , with water sparkling like jewels on her cheeks and forehead , and ri ##vu ##lets running from her hair , she stepped from the last stone on to the bank .

reference_raw: Finally, dripping wet, water glistening like jewels on her cheeks and forehead, and rivulets running from her hair, she stepped from the last stone to the shore.

reference_spacy_tokens: Finally , dripping wet , water glistening like jewels on her cheeks and forehead , and rivulets running from her hair , she stepped from the last stone to the shore .


fn_spacy_tokens_for_baseline: ' You may be sure , ' said Jared Tunstall , ' that if ever I do go bankrupt I should certainly die of grief , or of mortification at such a turn .

source_bert_toks: ' you may be sure , ' said jared tun ##sta ##ll , ' that if ever i do go bankrupt i should certainly die of grief , or of mort ##ification at such a turn .

reference_raw: 'You can be sure,' said Jared Tunstall, 'that if I ever fail, I should surely die of grief or grief at such a turn.

reference_spacy_tokens: ' You can be sure , ' said Jared Tunstall , ' that if I ever fail , I should surely die of grief or grief at such a turn .


fn_spacy_tokens_for_baseline: Within a few days the Slovene peasants of the Krka valley between Novo Mesto and the Croatian border had also risen .

source_bert_toks: within a few days the slovene peasants of the k ##rka valley between novo me ##sto and the croatian border had also risen .

reference_raw: In a few days, the Slovenian peasants from the Krka Vale between Novo Mesto and the Croatian border also rose.

reference_spacy_tokens: In a few days , the Slovenian peasants from the Krka Vale between Novo Mesto and the Croatian border also rose .


fn_spacy_tokens_for_baseline: Secondly , asking relatives for help can undermine the moral base on which relations with kin are built .

source_bert_toks: secondly , asking relatives for help can undermine the moral base on which relations with kin are built .

reference_raw: Second, asking relatives for help may weaken the moral basis on which relationships with relatives are built.

reference_spacy_tokens: Second , asking relatives for help may weaken the moral basis on which relationships with relatives are built .


fn_spacy_tokens_for_baseline: Spanish cricket wishes to join the ICC , and their application for affiliate membership was submitted in October 1991 , supported by Zimbabwe , Argentina , Denmark and USA , for consideration at the July 1992 meeting .

source_bert_toks: spanish cricket wishes to join the icc , and their application for affiliate membership was submitted in october 1991 , supported by zimbabwe , argentina , denmark and usa , for consideration at the july 1992 meeting .

reference_raw: The Spanish cricket wishes to join the International Criminal Court and their application for membership was made in October 1991 with the support of Zimbabwe, Argentina, Denmark and the United States for consideration at the July 1992 meeting.

reference_spacy_tokens: The Spanish cricket wishes to join the International Criminal Court and their application for membership was made in October 1991 with the support of Zimbabwe , Argentina , Denmark and the United States for consideration at the July 1992 meeting .


fn_spacy_tokens_for_baseline: ' You said something last week about ' gambolling in the countryside ' .

source_bert_toks: ' you said something last week about ' ga ##mbo ##lling in the countryside ' .

reference_raw: 'Last week, you said something about playing in the country.'

reference_spacy_tokens: ' Last week , you said something about playing in the country . '


fn_spacy_tokens_for_baseline: Merchandise imports , however , rose 5.1 % from January , almost twice the pace of exports , to $ 29.1 billion .

source_bert_toks: merchandise imports , however , rose 5 . 1 % from january , almost twice the pace of exports , to $ 29 . 1 billion .

reference_raw: However, since January, trade imports have increased by 5.1%, almost double the rate of imports, to $29.1 billion.

reference_spacy_tokens: However , since January , trade imports have increased by 5.1 % , almost double the rate of imports , to $ 29.1 billion .


fn_spacy_tokens_for_baseline: Whilst his companion 's back was turned , Tuppe swiped one of his sausages and thrust it into his mouth .

source_bert_toks: whilst his companion ' s back was turned , tu ##ppe swiped one of his sausage ##s and thrust it into his mouth .

reference_raw: While his companion turned his back, Tuppe took one of the sausages and stuck it in his mouth.

reference_spacy_tokens: While his companion turned his back , Tuppe took one of the sausages and stuck it in his mouth .


fn_spacy_tokens_for_baseline: Not to do so however is to run the risk of giving inappropriate treatment to different subjects within the same interest category .

source_bert_toks: not to do so however is to run the risk of giving inappropriate treatment to different subjects within the same interest category .

reference_raw: This does not mean, however, that there is a danger that different subjects in the same interest category may be treated inappropriately.

reference_spacy_tokens: This does not mean , however , that there is a danger that different subjects in the same interest category may be treated inappropriately .


fn_spacy_tokens_for_baseline: The key to healing the divisions in man 's nature which produce the tension between active and contemplative life is love , only realised in playing the game of faith that this is true .

source_bert_toks: the key to healing the divisions in man ' s nature which produce the tension between active and con ##tem ##pl ##ative life is love , only realised in playing the game of faith that this is true .

reference_raw: The key to curing the division of human nature that creates the tension between active and contemplative life is love, which is only realized by playing the game of faith that it is true.

reference_spacy_tokens: The key to curing the division of human nature that creates the tension between active and contemplative life is love , which is only realized by playing the game of faith that it is true .


fn_spacy_tokens_for_baseline: Or , still in New York , there is Peter Yates ' The House On Carroll Street ( Virgin ) , a gripping suspense story set against the background of the McCarthy inquisition .

source_bert_toks: or , still in new york , there is peter yates ' the house on carroll street ( virgin ) , a gripping suspense story set against the background of the mccarthy inquisition .

reference_raw: Or, still in New York, there's Peter Yates' House on Carroll Street (Virgin), a tight story set against the background of the McCarthy Inquisition.

reference_spacy_tokens: Or , still in New York , there 's Peter Yates ' House on Carroll Street ( Virgin ) , a tight story set against the background of the McCarthy Inquisition .


fn_spacy_tokens_for_baseline: Winston turned a switch and the voice sank somewhat , though the words were still distinguishable .

source_bert_toks: winston turned a switch and the voice sank somewhat , though the words were still distinguish ##able .

reference_raw: Winston turned the switch, and his voice dropped a little, though the words were still indistinguishable.

reference_spacy_tokens: Winston turned the switch , and his voice dropped a little , though the words were still indistinguishable .


fn_spacy_tokens_for_baseline: The remedy of using tough policing is merely tackling the symptoms of the disorder , and is liable to exacerbate the underlying malaise .

source_bert_toks: the remedy of using tough policing is merely tack ##ling the symptoms of the disorder , and is liable to ex ##ace ##rba ##te the underlying mala ##ise .

reference_raw: The treatment of hard police is limited to addressing the symptoms of the disease and may exacerbate the underlying malaise.

reference_spacy_tokens: The treatment of hard police is limited to addressing the symptoms of the disease and may exacerbate the underlying malaise .


fn_spacy_tokens_for_baseline: The People 's Will , their most effective organization , drew the conclusion that the supreme goal must be to shake the regime by assassinating the tsar .

source_bert_toks: the people ' s will , their most effective organization , drew the conclusion that the supreme goal must be to shake the regime by assassin ##ating the tsar .

reference_raw: The People's will, their most effective organization, has come to the conclusion that the ultimate goal must be to shake the regime by killing the Czar.

reference_spacy_tokens: The People 's will , their most effective organization , has come to the conclusion that the ultimate goal must be to shake the regime by killing the Czar .


fn_spacy_tokens_for_baseline: Am advised to let the School Meals Organizer deal with it .

source_bert_toks: am advised to let the school meals organizer deal with it .

reference_raw: I suggest you let the school food organizer handle this.

reference_spacy_tokens: I suggest you let the school food organizer handle this .


fn_spacy_tokens_for_baseline: At one point , as the ancient taxi manoeuvred a particularly narrow twisting stretch of road , she found herself gazing into a steep - sided gorge .

source_bert_toks: at one point , as the ancient taxi man ##oe ##u ##vre ##d a particularly narrow twisting stretch of road , she found herself gazing into a steep - sided gorge .

reference_raw: At one point, as the old cab maneuvered a particularly narrow stretch of road, she found herself staring into a steep-sided ravine.

reference_spacy_tokens: At one point , as the old cab maneuvered a particularly narrow stretch of road , she found herself staring into a steep - sided ravine .


fn_spacy_tokens_for_baseline: The officer had dismounted from the grey horse which was skittering nervously at the road s edge .

source_bert_toks: the officer had dismounted from the grey horse which was ski ##ttering nervously at the road s edge .

reference_raw: The officer disembarked from a gray horse that skittered nervously at the edge of the road.

reference_spacy_tokens: The officer disembarked from a gray horse that skittered nervously at the edge of the road .


fn_spacy_tokens_for_baseline: Three youths in denim stared at her for a while before swaggering toward the beach .

source_bert_toks: three youths in denim stared at her for a while before sw ##agger ##ing toward the beach .

reference_raw: The three young men in denim stared at her for a moment, then swerved toward the beach.

reference_spacy_tokens: The three young men in denim stared at her for a moment , then swerved toward the beach .


fn_spacy_tokens_for_baseline: ' Hiya , American sojer johnny , ' she cooed .

source_bert_toks: ' hi ##ya , american so ##jer johnny , ' she co ##oed .

reference_raw: "Hello, American Sojer Johnny," she said.

reference_spacy_tokens: " Hello , American Sojer Johnny , " she said .


fn_spacy_tokens_for_baseline: The films were shot during the day .

source_bert_toks: the films were shot during the day .

reference_raw: Films were taken during the day.

reference_spacy_tokens: Films were taken during the day .


fn_spacy_tokens_for_baseline: The charioteer is the nearest , but he is earlier and surely from another school , a man , and wearing a different , lighter garment .

source_bert_toks: the chariot ##eer is the nearest , but he is earlier and surely from another school , a man , and wearing a different , lighter garment .

reference_raw: The charioter's the closest, but he's from a different school, a man, and he's wearing a different, lighter suit.

reference_spacy_tokens: The charioter 's the closest , but he 's from a different school , a man , and he 's wearing a different , lighter suit .


fn_spacy_tokens_for_baseline: There are many successful schools scattered throughout this nation , some of them in the poorest of ghettos , and they are all sending us the same message .

source_bert_toks: there are many successful schools scattered throughout this nation , some of them in the poor ##est of ghetto ##s , and they are all sending us the same message .

reference_raw: There's a lot of successful schools all over the country, some of them in the most miserable ghettos, and they're sending us the same message.

reference_spacy_tokens: There 's a lot of successful schools all over the country , some of them in the most miserable ghettos , and they 're sending us the same message .


fn_spacy_tokens_for_baseline: It was as if all Scots wore the kilt , or all Cockneys dressed as Pearlies .

source_bert_toks: it was as if all scots wore the ki ##lt , or all cock ##ney ##s dressed as pearl ##ies .

reference_raw: It was as if all the Scots were wearing a skirt, or all the Cockneys dressed as Pearlies.

reference_spacy_tokens: It was as if all the Scots were wearing a skirt , or all the Cockneys dressed as Pearlies .


fn_spacy_tokens_for_baseline: I knotted a headscarf round my throat so savagely I nearly choked myself , and crept -- I had to creep , because of Mavis -- downstairs and out into the fog .

source_bert_toks: i knotted a heads ##car ##f round my throat so savage ##ly i nearly choked myself , and crept - - i had to creep , because of ma ##vis - - downstairs and out into the fog .

reference_raw: I wrapped the scarf around my neck so fiercely that I almost suffocated myself, and crept - for Mavis' sake, I had to sneak down and out into the mist.

reference_spacy_tokens: I wrapped the scarf around my neck so fiercely that I almost suffocated myself , and crept - for Mavis ' sake , I had to sneak down and out into the mist .


fn_spacy_tokens_for_baseline: As Yeremi followed him , he breathed in the dust of death , motes from the pulverized bones .

source_bert_toks: as yer ##emi followed him , he breathed in the dust of death , mo ##tes from the pu ##lver ##ized bones .

reference_raw: He breathed in the dust of death as Yeremi followed him, mottles of broken bones.

reference_spacy_tokens: He breathed in the dust of death as Yeremi followed him , mottles of broken bones .


fn_spacy_tokens_for_baseline: This meant that foreign facilities were more modern and efficient than any plants in America , and therefore were able to export a more competitive product .

source_bert_toks: this meant that foreign facilities were more modern and efficient than any plants in america , and therefore were able to export a more competitive product .

reference_raw: This meant that foreign facilities were more modern and efficient than any other plant in the United States and could therefore export a more competitive product.

reference_spacy_tokens: This meant that foreign facilities were more modern and efficient than any other plant in the United States and could therefore export a more competitive product .


fn_spacy_tokens_for_baseline: At Goodwill , it is the hard work of staff and those who benefit from our services that produces the kind of inspiring results I see every day : A Goodwill staff member addresses a group of welfare recipients : " You can earn the money to support yourself and your family , " she says .

source_bert_toks: at goodwill , it is the hard work of staff and those who benefit from our services that produces the kind of inspiring results i see every day : a goodwill staff member addresses a group of welfare recipients : " you can earn the money to support yourself and your family , " she says .

reference_raw: In Goodwill, it is the hardship of employees and those who benefit from our services that produce the same inspirational results that I see every day: a Goodwill employee addresses a group of social beneficiaries: "You can make money to support yourself and your family," he says.

reference_spacy_tokens: In Goodwill , it is the hardship of employees and those who benefit from our services that produce the same inspirational results that I see every day : a Goodwill employee addresses a group of social beneficiaries : " You can make money to support yourself and your family , " he says .


fn_spacy_tokens_for_baseline: Dieters often feel that high - fat , high - sugar foods are so bad that they should be totally eliminated from a healthy eating plan .

source_bert_toks: dieter ##s often feel that high - fat , high - sugar foods are so bad that they should be totally eliminated from a healthy eating plan .

reference_raw: Dieters often think that high-fat, high-sugar food is so bad that it should be completely excluded from a healthy eating plan.

reference_spacy_tokens: Dieters often think that high - fat , high - sugar food is so bad that it should be completely excluded from a healthy eating plan .


fn_spacy_tokens_for_baseline: MANY years ago a renowned brewer claimed that his brews outshone others because he squeezed his hops ' until the oil ran dry ' .

source_bert_toks: many years ago a renowned brewer claimed that his brew ##s outs ##hone others because he squeezed his hop ##s ' until the oil ran dry ' .

reference_raw: Many years ago, a famous brewer claimed that his beers outsmart others because he squeezed his hops until the oil was dry.

reference_spacy_tokens: Many years ago , a famous brewer claimed that his beers outsmart others because he squeezed his hops until the oil was dry .


fn_spacy_tokens_for_baseline: Yeah , we were also er notified of a , a liaison meeting called by the District Council .

source_bert_toks: yeah , we were also er notified of a , a liaison meeting called by the district council .

reference_raw: Yeah, we've also been er-informed about a contact meeting called by the district council.

reference_spacy_tokens: Yeah , we 've also been er - informed about a contact meeting called by the district council .


fn_spacy_tokens_for_baseline: He studies the floor .

source_bert_toks: he studies the floor .

reference_raw: She's looking at the floor.

reference_spacy_tokens: She 's looking at the floor .


fn_spacy_tokens_for_baseline: I discovered the Messiah when I was sixteen years old and I was overwhelmed by the sheer beauty and grandeur of Handel 's enduring masterpiece .

source_bert_toks: i discovered the messiah when i was sixteen years old and i was overwhelmed by the sheer beauty and grande ##ur of handel ' s enduring masterpiece .

reference_raw: When I was sixteen, I discovered the Messiah and was overwhelmed by the sheer beauty and grandeur of Handel's lasting masterpiece.

reference_spacy_tokens: When I was sixteen , I discovered the Messiah and was overwhelmed by the sheer beauty and grandeur of Handel 's lasting masterpiece .


fn_spacy_tokens_for_baseline: He hammered again , pulling off his mask , and shouting .

source_bert_toks: he hammered again , pulling off his mask , and shouting .

reference_raw: He hammered again, pulled off his face, and screamed.

reference_spacy_tokens: He hammered again , pulled off his face , and screamed .


fn_spacy_tokens_for_baseline: He had settled himself comfortably on the floor , to the astonished glances of some guests , her beautiful skirts rustling as he leant against them .

source_bert_toks: he had settled himself comfortably on the floor , to the astonished glances of some guests , her beautiful skirts rustling as he lean ##t against them .

reference_raw: He sat down comfortably on the floor, to the astonished looks of some of the guests, and her beautiful skirts rattled as he leaned against them.

reference_spacy_tokens: He sat down comfortably on the floor , to the astonished looks of some of the guests , and her beautiful skirts rattled as he leaned against them .


fn_spacy_tokens_for_baseline: The exodus appeared to reflect Croat efforts to purge Muslims from Croat - controlled districts ahead of a possible agreement to divide the Bosnia into Croat , Serb and Muslim ministates .

source_bert_toks: the exodus appeared to reflect cr ##oat efforts to purge muslims from cr ##oat - controlled districts ahead of a possible agreement to divide the bosnia into cr ##oat , serb and muslim mini ##sta ##tes .

reference_raw: The exodus seemed to reflect Croatia's efforts to clear Muslims from the Croat-controlled precincts before any agreement to divide Bosnia into Croatian, Serbian and Muslim ministates could be reached.

reference_spacy_tokens: The exodus seemed to reflect Croatia 's efforts to clear Muslims from the Croat - controlled precincts before any agreement to divide Bosnia into Croatian , Serbian and Muslim ministates could be reached .


fn_spacy_tokens_for_baseline: He saw service in the Baltic Republics and earned a special commendation for his analysis of the situation among the ethnic groups .

source_bert_toks: he saw service in the baltic republics and earned a special commendation for his analysis of the situation among the ethnic groups .

reference_raw: He had seen service in the Baltic republics and had been given special credit for his analysis of the situation between ethnic groups.

reference_spacy_tokens: He had seen service in the Baltic republics and had been given special credit for his analysis of the situation between ethnic groups .


fn_spacy_tokens_for_baseline: Clumps of sturdy weed grew wherever they could take a firm hold .

source_bert_toks: cl ##ump ##s of sturdy weed grew wherever they could take a firm hold .

reference_raw: Clumps of solid grass grew where they could hold on tight.

reference_spacy_tokens: Clumps of solid grass grew where they could hold on tight .


fn_spacy_tokens_for_baseline: Zimm 's arms hung loosely by his sides , the fingers alternately stretching and relaxing .

source_bert_toks: z ##im ##m ' s arms hung loosely by his sides , the fingers alternately stretching and relaxing .

reference_raw: Zimm's arms were loose at his hips, his fingers flexing and relaxing.

reference_spacy_tokens: Zimm 's arms were loose at his hips , his fingers flexing and relaxing .


fn_spacy_tokens_for_baseline: Tony Greenbank told Paul Ross of its most salient features and Paul worked out its locality .

source_bert_toks: tony green ##bank told paul ross of its most sal ##ient features and paul worked out its locality .

reference_raw: Tony Greenbank had told Paul Ross about his most salty features, and Paul had worked out his location.

reference_spacy_tokens: Tony Greenbank had told Paul Ross about his most salty features , and Paul had worked out his location .


fn_spacy_tokens_for_baseline: Three - quarters were able to distinguish between the T - shirts and pick out the one with their body scent on .

source_bert_toks: three - quarters were able to distinguish between the t - shirts and pick out the one with their body scent on .

reference_raw: Three-quarters were able to distinguish the shirts and pick the one with the smell of the body on it.

reference_spacy_tokens: Three - quarters were able to distinguish the shirts and pick the one with the smell of the body on it .


fn_spacy_tokens_for_baseline: ' He says the whole army is unsettled because it 's known that Famagusta will never give up while it expects a relieving ship to arrive .

source_bert_toks: ' he says the whole army is un ##sett ##led because it ' s known that fa ##ma ##gus ##ta will never give up while it expects a re ##lie ##ving ship to arrive .

reference_raw: 'He says the entire army is concerned, for it is known that Famagusta will never surrender until it expects the rescue ship to arrive.

reference_spacy_tokens: ' He says the entire army is concerned , for it is known that Famagusta will never surrender until it expects the rescue ship to arrive .


fn_spacy_tokens_for_baseline: When we were four and five we had to sleep in the afternoons on long mats made of shiny grass that left ribbing marks on our skin .

source_bert_toks: when we were four and five we had to sleep in the afternoons on long mats made of shiny grass that left rib ##bing marks on our skin .

reference_raw: When we were four and five years old, we had to go to bed in the afternoon on long mats of shiny grass that left ribbing marks on our skin.

reference_spacy_tokens: When we were four and five years old , we had to go to bed in the afternoon on long mats of shiny grass that left ribbing marks on our skin .


fn_spacy_tokens_for_baseline: I bet the studio execs are really kicking themselves that they did n't book those 5,000 theaters . "

source_bert_toks: i bet the studio ex ##ec ##s are really kicking themselves that they didn ' t book those 5 , 000 theaters . "

reference_raw: I'll bet the studio executives are really digging that they haven't reserved the 5,000 theaters.

reference_spacy_tokens: I 'll bet the studio executives are really digging that they have n't reserved the 5,000 theaters .


fn_spacy_tokens_for_baseline: Stephanopoulos is cashing in without even going through the minimal motions of holding himself accountable for misleading the country .

source_bert_toks: stephan ##op ##oulos is cash ##ing in without even going through the minimal motions of holding himself accountable for misleading the country .

reference_raw: Stephanopoulos cashes in without going through the minimal movements of holding himself responsible for deceiving the country.

reference_spacy_tokens: Stephanopoulos cashes in without going through the minimal movements of holding himself responsible for deceiving the country .


fn_spacy_tokens_for_baseline: It slides about , and slips under the water .

source_bert_toks: it slides about , and slips under the water .

reference_raw: He slips around and slips under the water.

reference_spacy_tokens: He slips around and slips under the water .


fn_spacy_tokens_for_baseline: It 's also a city of the imagination , reinvented and reappraised in the literature of its exiles .

source_bert_toks: it ' s also a city of the imagination , rein ##vent ##ed and re ##app ##rai ##sed in the literature of its exiles .

reference_raw: It is also a city of imagination, re-invented and re-appraised in the books of its exiles.

reference_spacy_tokens: It is also a city of imagination , re - invented and re - appraised in the books of its exiles .


fn_spacy_tokens_for_baseline: According to the Sunday Telegraph , Melli Agrochemicals negotiated the deal on behalf of the Iranian regime .

source_bert_toks: according to the sunday telegraph , mel ##li ag ##ro ##chemical ##s negotiated the deal on behalf of the iranian regime .

reference_raw: According to the Sunday telegraph, Melli Agrochemicals negotiated an agreement on behalf of the Iranian regime.

reference_spacy_tokens: According to the Sunday telegraph , Melli Agrochemicals negotiated an agreement on behalf of the Iranian regime .


fn_spacy_tokens_for_baseline: WordPerfect has responded angrily to Microsoft claims that a clear majority of users prefer Word for Windows over WordPerfect .

source_bert_toks: word ##per ##fect has responded angrily to microsoft claims that a clear majority of users prefer word for windows over word ##per ##fect .

reference_raw: WordPerfect reacted angrily to Microsoft's claim that a clear majority of users favour Word over WordPerfect.

reference_spacy_tokens: WordPerfect reacted angrily to Microsoft 's claim that a clear majority of users favour Word over WordPerfect .


fn_spacy_tokens_for_baseline: A genuine higher education is unsettling ; it is not meant to be a cosy experience .

source_bert_toks: a genuine higher education is un ##sett ##ling ; it is not meant to be a co ##sy experience .

reference_raw: Real higher education is disturbing; it should not be a cosy experience.

reference_spacy_tokens: Real higher education is disturbing ; it should not be a cosy experience .


fn_spacy_tokens_for_baseline: The next dog of great influence was Adoram Jamie of Elthor , bred by Michael Quinney and imported by Dr Wayne Welch .

source_bert_toks: the next dog of great influence was ad ##ora ##m jamie of el ##thor , bred by michael quinn ##ey and imported by dr wayne welch .

reference_raw: Another great influence dog was Adoram Jamie of Elthor, raised by Michael Quinney and brought in by Dr. Wayne Welch.

reference_spacy_tokens: Another great influence dog was Adoram Jamie of Elthor , raised by Michael Quinney and brought in by Dr. Wayne Welch .


fn_spacy_tokens_for_baseline: Nelson 's had just issued a short book of mine on Turkey , and he scrutinized it with care , holding it high up and bending back the spine as if to test its durability .

source_bert_toks: nelson ' s had just issued a short book of mine on turkey , and he sc ##rut ##ini ##zed it with care , holding it high up and bending back the spine as if to test its du ##ra ##bility .

reference_raw: Nelson had just published my short book about Turkey, and he examined it carefully, holding it high and bending his back as if to test its permanence.

reference_spacy_tokens: Nelson had just published my short book about Turkey , and he examined it carefully , holding it high and bending his back as if to test its permanence .


fn_spacy_tokens_for_baseline: Since the early 1970s , however , catches have dwindled from 100 tonnes at peak season , to 50 tonnes .

source_bert_toks: since the early 1970s , however , catches have d ##wind ##led from 100 tonnes at peak season , to 50 tonnes .

reference_raw: However, since the beginning of the 1970s, catches have decreased from 100 tonnes in the peak season to 50 tonnes.

reference_spacy_tokens: However , since the beginning of the 1970s , catches have decreased from 100 tonnes in the peak season to 50 tonnes .


fn_spacy_tokens_for_baseline: At first I could not understand -- but then when she had , whispering , explained properly , I was filled with a desolate , despairing horror .

source_bert_toks: at first i could not understand - - but then when she had , whispering , explained properly , i was filled with a des ##olate , despair ##ing horror .

reference_raw: I didn't understand it at first - but when she whispered and explained it properly, I was filled with a bleak, desperate terror.

reference_spacy_tokens: I did n't understand it at first - but when she whispered and explained it properly , I was filled with a bleak , desperate terror .


fn_spacy_tokens_for_baseline: In July 1941 the British and the Russians demanded the expulsion of all German agents and influence .

source_bert_toks: in july 1941 the british and the russians demanded the expulsion of all german agents and influence .

reference_raw: In July 1941, the British and Russians demanded that all German agents and influence be removed.

reference_spacy_tokens: In July 1941 , the British and Russians demanded that all German agents and influence be removed .


fn_spacy_tokens_for_baseline: Instead she takes part in his piracy and gains meaning for life , before she helps him escape .

source_bert_toks: instead she takes part in his piracy and gains meaning for life , before she helps him escape .

reference_raw: Instead, he participates in his pirates, gaining meaning for the rest of his life, before he helps him escape.

reference_spacy_tokens: Instead , he participates in his pirates , gaining meaning for the rest of his life , before he helps him escape .


fn_spacy_tokens_for_baseline: He gave a feeble chuckle , and clutched his ribs with his left hand .

source_bert_toks: he gave a fee ##ble chuckle , and clutched his ribs with his left hand .

reference_raw: He laughed weakly and gripped his ribs with his left hand.

reference_spacy_tokens: He laughed weakly and gripped his ribs with his left hand .


fn_spacy_tokens_for_baseline: A year ago a man tried to abduct him while he was doing his early morning paper round .

source_bert_toks: a year ago a man tried to abd ##uc ##t him while he was doing his early morning paper round .

reference_raw: A year ago, a man tried to kidnap him while doing his morning paper round.

reference_spacy_tokens: A year ago , a man tried to kidnap him while doing his morning paper round .


fn_spacy_tokens_for_baseline: Among other things , this would have engendered the tradition of Herod 's Massacre of the Innocents .

source_bert_toks: among other things , this would have eng ##end ##ered the tradition of hero ##d ' s massacre of the innocent ##s .

reference_raw: Among other things, it would add to the tradition of Herod's innocent massacre.

reference_spacy_tokens: Among other things , it would add to the tradition of Herod 's innocent massacre .


fn_spacy_tokens_for_baseline: One of the patients roomed with the war casualties because there was no other space for him .

source_bert_toks: one of the patients room ##ed with the war casualties because there was no other space for him .

reference_raw: One of the patients was surrounded by war victims, because there was no place for him.

reference_spacy_tokens: One of the patients was surrounded by war victims , because there was no place for him .


fn_spacy_tokens_for_baseline: A key uncertainty is how ongoing military modernization efforts will ultimately reshape China 's strategic nuclear capabilities , but U.S. deployments of missile defenses are likely to be a key variable .

source_bert_toks: a key uncertainty is how ongoing military modernization efforts will ultimately res ##ha ##pe china ' s strategic nuclear capabilities , but u . s . deployment ##s of missile defenses are likely to be a key variable .

reference_raw: The main uncertainty is how the ongoing military modernisation efforts will ultimately transform China's strategic nuclear capabilities, but the US use of missile defense is likely to be a key variable.

reference_spacy_tokens: The main uncertainty is how the ongoing military modernisation efforts will ultimately transform China 's strategic nuclear capabilities , but the US use of missile defense is likely to be a key variable .


fn_spacy_tokens_for_baseline: ' I 'm going to find the nearest policeman , ' she informed him in an icy voice .

source_bert_toks: ' i ' m going to find the nearest policeman , ' she informed him in an icy voice .

reference_raw: "I'll find the nearest cop," she said coldly.

reference_spacy_tokens: " I 'll find the nearest cop , " she said coldly .


fn_spacy_tokens_for_baseline: She stared at her watch .

source_bert_toks: she stared at her watch .

reference_raw: She looked at her wristwatch.

reference_spacy_tokens: She looked at her wristwatch .


fn_spacy_tokens_for_baseline: Borden has added a new grade to its range of bottle labelling adhesives .

source_bert_toks: bo ##rden has added a new grade to its range of bottle label ##ling ad ##hesive ##s .

reference_raw: Borden added a new grade to the range of bottle label glues.

reference_spacy_tokens: Borden added a new grade to the range of bottle label glues .


fn_spacy_tokens_for_baseline: They were ordinary chaps who deliberately sold themselves short right down to their weedy name , an idea that still attaches itself to anything on the label .

source_bert_toks: they were ordinary cha ##ps who deliberately sold themselves short right down to their weed ##y name , an idea that still attache ##s itself to anything on the label .

reference_raw: They were regular guys who deliberately sold themselves short to their weedy name, an idea that was still attached to everything on the label.

reference_spacy_tokens: They were regular guys who deliberately sold themselves short to their weedy name , an idea that was still attached to everything on the label .


fn_spacy_tokens_for_baseline: Punjabi militants have been waging the attacks on behalf of their Taliban and Al Qaeda allies , government officials say , hoping to erode popular backing for military operations in Waziristan .

source_bert_toks: punjabi militants have been wa ##ging the attacks on behalf of their taliban and al qaeda allies , government officials say , hoping to er ##ode popular backing for military operations in wa ##zi ##rist ##an .

reference_raw: The Punjabi militants have waged attacks on behalf of their Taliban and al-Qaeda allies, government officials say, in the hopes of eroding popular support for military activities in Waziristan.

reference_spacy_tokens: The Punjabi militants have waged attacks on behalf of their Taliban and al - Qaeda allies , government officials say , in the hopes of eroding popular support for military activities in Waziristan .


fn_spacy_tokens_for_baseline: McEnroe , who lost a tough match with Stefano Pescosolido , 7 - 6 1 - 6 6 - 4 , said he was losing his mental edge .

source_bert_toks: mc ##en ##ro ##e , who lost a tough match with stefano pe ##sco ##sol ##ido , 7 - 6 1 - 6 6 - 4 , said he was losing his mental edge .

reference_raw: McEnroe, who had no match for Stefano Pescosolido, 7-6 1-6 6-4, said he was out of his mind.

reference_spacy_tokens: McEnroe , who had no match for Stefano Pescosolido , 7 - 6 1 - 6 6 - 4 , said he was out of his mind .


fn_spacy_tokens_for_baseline: But her gaze edged upwards , taking in the long , muscular legs and narrow hips , the broad chest in its businesslike white shirt .

source_bert_toks: but her gaze edged upwards , taking in the long , muscular legs and narrow hips , the broad chest in its business ##like white shirt .

reference_raw: But she looked up, taking on her long, muscular legs and narrow hips, the broad breast of her business-like white shirt.

reference_spacy_tokens: But she looked up , taking on her long , muscular legs and narrow hips , the broad breast of her business - like white shirt .


fn_spacy_tokens_for_baseline: A government report of Sept. 27 found that millions of litres of radioactive water were seeping out of leaky tanks at Kozloduy , which provided around 40 per cent of Bulgaria 's electricity .

source_bert_toks: a government report of sept . 27 found that millions of litres of radioactive water were see ##ping out of leak ##y tanks at ko ##z ##lo ##du ##y , which provided around 40 per cent of bulgaria ' s electricity .

reference_raw: The government report of September 27 found that millions of litres of radioactive water were leaking from leaky tanks in Kozloduy, providing about 40 percent of Bulgaria's electricity.

reference_spacy_tokens: The government report of September 27 found that millions of litres of radioactive water were leaking from leaky tanks in Kozloduy , providing about 40 percent of Bulgaria 's electricity .


fn_spacy_tokens_for_baseline: Bill Brown , who carried his bat for 206 not out through Australia 's innings in the 1938 Lord 's Test , celebrates his 80th birthday on July 31 .

source_bert_toks: bill brown , who carried his bat for 206 not out through australia ' s innings in the 1938 lord ' s test , celebrates his 80 ##th birthday on july 31 .

reference_raw: Bill Brown, who carried his bat for 206, not through the Australian shift at the 1938 Lord's Test, celebrates his 80th birthday on the 31st of July.

reference_spacy_tokens: Bill Brown , who carried his bat for 206 , not through the Australian shift at the 1938 Lord 's Test , celebrates his 80th birthday on the 31st of July .


fn_spacy_tokens_for_baseline: His enormous arm went over Rory 's head , the empty pint pot hanging in the smoke above the counter .

source_bert_toks: his enormous arm went over rory ' s head , the empty pin ##t pot hanging in the smoke above the counter .

reference_raw: He put a huge hand over Rory's head, and a hollow pint pot hung in the smoke above the counter.

reference_spacy_tokens: He put a huge hand over Rory 's head , and a hollow pint pot hung in the smoke above the counter .


fn_spacy_tokens_for_baseline: Interactive Voice Processor costs from £ 40,000 for a six - port system , which Bellamy claims is good value compared with the cost of employing six staff just to answer the phone .

source_bert_toks: interactive voice processor costs from £ ##40 , 000 for a six - port system , which bellamy claims is good value compared with the cost of employing six staff just to answer the phone .

reference_raw: The interactive voice processor costs up to £40,000 for a six-port system, which Bellamy claims is a good price compared to the cost of employing six employees just to pick up the phone.

reference_spacy_tokens: The interactive voice processor costs up to £ 40,000 for a six - port system , which Bellamy claims is a good price compared to the cost of employing six employees just to pick up the phone .


fn_spacy_tokens_for_baseline: But when the cheering rebel convoy roared into town Saturday afternoon , the tribesmen raised their arms in welcome and gave the victory sign .

source_bert_toks: but when the cheering rebel convoy roared into town saturday afternoon , the tribes ##men raised their arms in welcome and gave the victory sign .

reference_raw: But when the cheering rebel convoy thundered into the city on Saturday afternoon, the natives raised their arms in greeting and gave a sign of victory.

reference_spacy_tokens: But when the cheering rebel convoy thundered into the city on Saturday afternoon , the natives raised their arms in greeting and gave a sign of victory .


fn_spacy_tokens_for_baseline: The daily detonations have severely curtailed civilian traffic and interfered with convoys in northern Babil .

source_bert_toks: the daily det ##ona ##tions have severely curt ##ailed civilian traffic and interfered with convoys in northern ba ##bil .

reference_raw: Day-to-day explosions have severely reduced civilian traffic and interfered with convoys in the north of Babil.

reference_spacy_tokens: Day - to - day explosions have severely reduced civilian traffic and interfered with convoys in the north of Babil .


fn_spacy_tokens_for_baseline: Let us expurgate from the immaturity of our environmental thought , that essence of crepuscular darkness which our sciolism leads us to extrapolate into quotidian existence .

source_bert_toks: let us ex ##pur ##gate from the im ##mat ##urity of our environmental thought , that essence of cr ##ep ##us ##cular darkness which our sci ##olis ##m leads us to extra ##pol ##ate into quo ##ti ##dian existence .

reference_raw: Let's get rid of the immaturity of our environmental thoughts, the essence of crepuscular darkness that our sciolism leads us to extrapolate to quotidian existence.

reference_spacy_tokens: Let 's get rid of the immaturity of our environmental thoughts , the essence of crepuscular darkness that our sciolism leads us to extrapolate to quotidian existence .


fn_spacy_tokens_for_baseline: I stayed in the darkness vomiting as the ship veered wildly through the troughs of high waves .

source_bert_toks: i stayed in the darkness vomiting as the ship ve ##ered wildly through the trough ##s of high waves .

reference_raw: I stayed in the dark and vomited as the boat swerved wildly through the waves.

reference_spacy_tokens: I stayed in the dark and vomited as the boat swerved wildly through the waves .


fn_spacy_tokens_for_baseline: All the women had really great shoes .

source_bert_toks: all the women had really great shoes .

reference_raw: All women had really good boots.

reference_spacy_tokens: All women had really good boots .


fn_spacy_tokens_for_baseline: " What you would get , in all probability , is a big bang , a big splash , but very little gas , " Milton Leitenberg , of the University of Maryland , told United Press International .

source_bert_toks: " what you would get , in all probability , is a big bang , a big splash , but very little gas , " milton lei ##tenberg , of the university of maryland , told united press international .

reference_raw: "What you'd probably get is a big bang, a big splash, but very little gas," Milton Leitenberg, Maryland College, told United Press International.

reference_spacy_tokens: " What you 'd probably get is a big bang , a big splash , but very little gas , " Milton Leitenberg , Maryland College , told United Press International .


fn_spacy_tokens_for_baseline: And I find that my father , who was old too , at the time substituted for the father and I have an excellent relationship with my son !

source_bert_toks: and i find that my father , who was old too , at the time substituted for the father and i have an excellent relationship with my son !

reference_raw: And I found out that my father, who was also old, had been replaced by my father, and that I had a great relationship with my son!

reference_spacy_tokens: And I found out that my father , who was also old , had been replaced by my father , and that I had a great relationship with my son !


fn_spacy_tokens_for_baseline: I put on my kilt , picked up my bagpipes , clambered aboard the truck , and we were off to the beach .

source_bert_toks: i put on my ki ##lt , picked up my bag ##pipe ##s , cl ##am ##bered aboard the truck , and we were off to the beach .

reference_raw: I pulled on my kilt, picked up my pipes, climbed into the car, and went to the beach.

reference_spacy_tokens: I pulled on my kilt , picked up my pipes , climbed into the car , and went to the beach .


fn_spacy_tokens_for_baseline: Constantinople was taken by Crusader forces in 1204 , and they stripped the city of many of its finest treasures -- which now grace the public buildings of Venice -- although a large consignment of books and manuscripts was transferred to the monastery at Patmos before the city fell .

source_bert_toks: constantinople was taken by crusader forces in 120 ##4 , and they stripped the city of many of its finest treasures - - which now grace the public buildings of venice - - although a large con ##si ##gn ##ment of books and manuscripts was transferred to the monastery at pat ##mos before the city fell .

reference_raw: Constantinople was captured by the Crusader forces in 1204 and stripped the city of many of its finest treasures - which now grace the public buildings of Venice - though a large shipment of books and manuscripts had been transferred to the convent in Patmos before the collapse of the city.

reference_spacy_tokens: Constantinople was captured by the Crusader forces in 1204 and stripped the city of many of its finest treasures - which now grace the public buildings of Venice - though a large shipment of books and manuscripts had been transferred to the convent in Patmos before the collapse of the city .


fn_spacy_tokens_for_baseline: As expected , the Labour administration pushed through the rises in spite of opposition from the Tory and Scottish National Party groups .

source_bert_toks: as expected , the labour administration pushed through the rises in spite of opposition from the tory and scottish national party groups .

reference_raw: The Labour Administration, as expected, has pushed the rise despite resistance from the Tory and Scottish National Party groups.

reference_spacy_tokens: The Labour Administration , as expected , has pushed the rise despite resistance from the Tory and Scottish National Party groups .


fn_spacy_tokens_for_baseline: They were sage young people and got on with Christopher .

source_bert_toks: they were sage young people and got on with christopher .

reference_raw: They were wise young people, and they got along with Christopher.

reference_spacy_tokens: They were wise young people , and they got along with Christopher .


fn_spacy_tokens_for_baseline: This closure is only momentary because of the differentiating action of the coupling components capacitor C6 and resistor R21 , and the rest of the circuit is then activated in the way already explained .

source_bert_toks: this closure is only momentary because of the different ##iating action of the coupling components cap ##ac ##itor c ##6 and resist ##or r ##21 , and the rest of the circuit is then activated in the way already explained .

reference_raw: This closure is only temporary due to the differentiation of the coupling components capacitor C6 and resistor R21 and the rest of the circuit is then activated as explained above.

reference_spacy_tokens: This closure is only temporary due to the differentiation of the coupling components capacitor C6 and resistor R21 and the rest of the circuit is then activated as explained above .


fn_spacy_tokens_for_baseline: The night air amplified the snort and splash of animals and I was very grateful for the orange glow of the fire through the canvas walls of the tent .

source_bert_toks: the night air amplified the snort and splash of animals and i was very grateful for the orange glow of the fire through the canvas walls of the tent .

reference_raw: The night air increased the noise and splash of animals, and I was grateful for the orange glow of the fire through the canvas walls of the tent.

reference_spacy_tokens: The night air increased the noise and splash of animals , and I was grateful for the orange glow of the fire through the canvas walls of the tent .


fn_spacy_tokens_for_baseline: St. Denis said police learned some of the group 's beliefs --- including the notions of an Antichrist and voyaging to a planet in another solar system --- by interviewing some of the sect 's ex - members .

source_bert_toks: st . denis said police learned some of the group ' s beliefs - - - including the notions of an anti ##christ and vo ##ya ##ging to a planet in another solar system - - - by interviewing some of the sect ' s ex - members .

reference_raw: St. Dennis said that the police had learned some of the group's beliefs - including the idea of an antichrist and travel to a planet in another solar system - by interviewing some of the former members of the sect.

reference_spacy_tokens: St. Dennis said that the police had learned some of the group 's beliefs - including the idea of an antichrist and travel to a planet in another solar system - by interviewing some of the former members of the sect .


fn_spacy_tokens_for_baseline: We all trooped up to the altar , behind which your Berlin friends discovered a mysterious opening .

source_bert_toks: we all troop ##ed up to the altar , behind which your berlin friends discovered a mysterious opening .

reference_raw: We all went to the altar where your Berlin friends discovered a mysterious opening.

reference_spacy_tokens: We all went to the altar where your Berlin friends discovered a mysterious opening .


fn_spacy_tokens_for_baseline: We used to have a family of martins nesting directly over our front porch , just under my bedroom window .

source_bert_toks: we used to have a family of martins nesting directly over our front porch , just under my bedroom window .

reference_raw: We had a family of Martins nesting right above the front porch, right in front of my bedroom window.

reference_spacy_tokens: We had a family of Martins nesting right above the front porch , right in front of my bedroom window .


fn_spacy_tokens_for_baseline: Ramsay MacDonald told the House of Commons in 1924 that ' Coalitions are detestable , are dishonest ' .

source_bert_toks: ramsay macdonald told the house of commons in 1924 that ' coalition ##s are det ##est ##able , are dish ##ones ##t ' .

reference_raw: Ramsay MacDonald told the House of Commons in 1924 that coalitions are disgusting and dishonest.

reference_spacy_tokens: Ramsay MacDonald told the House of Commons in 1924 that coalitions are disgusting and dishonest .


fn_spacy_tokens_for_baseline: He glanced over at the plates of smoked salmon .

source_bert_toks: he glanced over at the plates of smoked salmon .

reference_raw: He looked at the smoked salmon plates.

reference_spacy_tokens: He looked at the smoked salmon plates .


fn_spacy_tokens_for_baseline: Which , in retrospect , said a lot for her common sense ; but a lady was still required and because our daughter was there , my wife Ann was dragooned into duty .

source_bert_toks: which , in retro ##sp ##ect , said a lot for her common sense ; but a lady was still required and because our daughter was there , my wife ann was drag ##oon ##ed into duty .

reference_raw: Which, in retrospect, told me a great deal about her sanity; but a lady was still needed, and since she was there, my wife, Ann, had been dragged into the service.

reference_spacy_tokens: Which , in retrospect , told me a great deal about her sanity ; but a lady was still needed , and since she was there , my wife , Ann , had been dragged into the service .


fn_spacy_tokens_for_baseline: Horses wo n't be airsick all over your lap ; they do n't drone on about overbooked hotels , or insist on playing Scrabble to pass the time .

source_bert_toks: horses won ' t be airs ##ick all over your lap ; they don ' t drone on about over ##book ##ed hotels , or insist on playing sc ##ra ##bble to pass the time .

reference_raw: Horses don't get airsick all over your lap, they don't buzz around overbooked hotels, and they don't insist on playing Scrabble to pass the time.

reference_spacy_tokens: Horses do n't get airsick all over your lap , they do n't buzz around overbooked hotels , and they do n't insist on playing Scrabble to pass the time .


fn_spacy_tokens_for_baseline: The sides of the creek are covered with mature trees .

source_bert_toks: the sides of the creek are covered with mature trees .

reference_raw: The sides of the stream are covered with ripe trees.

reference_spacy_tokens: The sides of the stream are covered with ripe trees .


fn_spacy_tokens_for_baseline: They gazed in wonder at this goddess , and suddenly even the boil on her nose was no longer a blemish but a badge of courage .

source_bert_toks: they gazed in wonder at this goddess , and suddenly even the boil on her nose was no longer a b ##lem ##ish but a badge of courage .

reference_raw: They stared at the goddess in astonishment, and all of a sudden the cooking on her nose was no longer a blemish, but a badge of courage.

reference_spacy_tokens: They stared at the goddess in astonishment , and all of a sudden the cooking on her nose was no longer a blemish , but a badge of courage .


fn_spacy_tokens_for_baseline: Looking up you would see an alluring smidgen of sky through the spiky branches .

source_bert_toks: looking up you would see an all ##uring sm ##idge ##n of sky through the sp ##ik ##y branches .

reference_raw: If you look up, you'll see a seductive smidge of sky through the spicy branches.

reference_spacy_tokens: If you look up , you 'll see a seductive smidge of sky through the spicy branches .


fn_spacy_tokens_for_baseline: Mr Hinks became a member of the council of the Law Society , which was quite an accolade for the firm , and he is believed to be the only Darlington solicitor to be honoured in this way .

source_bert_toks: mr hi ##nk ##s became a member of the council of the law society , which was quite an acc ##ola ##de for the firm , and he is believed to be the only darlington solicitor to be honoured in this way .

reference_raw: Mr. Hinks has become a member of the Council of the Law Society, which has been quite an insult to the company, and he is believed to be the only lawyer in Darlington who can be honored in this way.

reference_spacy_tokens: Mr. Hinks has become a member of the Council of the Law Society , which has been quite an insult to the company , and he is believed to be the only lawyer in Darlington who can be honored in this way .


fn_spacy_tokens_for_baseline: She hissed at Ariel to make him leave , and Ariel would wave him to keep his distance ; Jack did not mind .

source_bert_toks: she hissed at ariel to make him leave , and ariel would wave him to keep his distance ; jack did not mind .

reference_raw: She sizzled at Ariel to force him to leave, and Ariel waved him away; Jack didn't mind.

reference_spacy_tokens: She sizzled at Ariel to force him to leave , and Ariel waved him away ; Jack did n't mind .


fn_spacy_tokens_for_baseline: Although the cost of research is undoubtedly cheaper in the developing world due to relatively low researcher salaries , overhead and other work standards , these factors do not explain the substantial increase in the number of publications per amount of money allocated to research and development in Latin America , particularly from 1995 until 2000 ( Figure 2 ) .

source_bert_toks: although the cost of research is undoubtedly cheaper in the developing world due to relatively low researcher salaries , overhead and other work standards , these factors do not explain the substantial increase in the number of publications per amount of money allocated to research and development in latin america , particularly from 1995 until 2000 ( figure 2 ) .

reference_raw: Although research costs are undoubtedly cheaper in the developing world due to relatively low wages of researchers, overheads and other working standards, these factors do not account for the significant increase in the number of publications per amount allocated to R&D in Latin America, in particular between 1995 and 2000 (Figure 2).

reference_spacy_tokens: Although research costs are undoubtedly cheaper in the developing world due to relatively low wages of researchers , overheads and other working standards , these factors do not account for the significant increase in the number of publications per amount allocated to R&D in Latin America , in particular between 1995 and 2000 ( Figure 2 ) .


fn_spacy_tokens_for_baseline: Stephanie was fetched away , divested of her gown , arranged on a hard high couch under a cellular blanket .

source_bert_toks: stephanie was fetch ##ed away , dive ##sted of her gown , arranged on a hard high couch under a cellular blanket .

reference_raw: Stephanie was taken away, stripped of her robe, and placed on a hard, high couch under a cellular blanket.

reference_spacy_tokens: Stephanie was taken away , stripped of her robe , and placed on a hard , high couch under a cellular blanket .


fn_spacy_tokens_for_baseline: Unfortunately many were trade union members who lost their jobs and have not retained their union membership so have been lost to our organization .

source_bert_toks: unfortunately many were trade union members who lost their jobs and have not retained their union membership so have been lost to our organization .

reference_raw: Unfortunately, many of them were union members who lost their jobs and didn't keep their union members, so we lost our organization.

reference_spacy_tokens: Unfortunately , many of them were union members who lost their jobs and did n't keep their union members , so we lost our organization .


fn_spacy_tokens_for_baseline: Moreover , when taking into account the amount of research money available to researchers , Latin America actually out - published the United States and Canada by the year 2000 ( Figure 2 ) .

source_bert_toks: moreover , when taking into account the amount of research money available to researchers , latin america actually out - published the united states and canada by the year 2000 ( figure 2 ) .

reference_raw: In addition, given the amount of research funding available to researchers, Latin America actually outsourced the United States and Canada in 2000 (Figure 2).

reference_spacy_tokens: In addition , given the amount of research funding available to researchers , Latin America actually outsourced the United States and Canada in 2000 ( Figure 2 ) .


fn_spacy_tokens_for_baseline: Representatives of one group told us that their members ' ability to properly gather and protect computer - related evidence had facilitated law enforcement investigations , thus limiting the time and resources that the victim and the law enforcement officers needed to carry out an investigation .

source_bert_toks: representatives of one group told us that their members ' ability to properly gather and protect computer - related evidence had facilitated law enforcement investigations , thus limiting the time and resources that the victim and the law enforcement officers needed to carry out an investigation .

reference_raw: Representatives of one group have informed us that the ability of their members to properly collect and protect computer evidence has facilitated law enforcement investigations, thus limiting the time and resources that the victim and the police need to conduct investigations.

reference_spacy_tokens: Representatives of one group have informed us that the ability of their members to properly collect and protect computer evidence has facilitated law enforcement investigations , thus limiting the time and resources that the victim and the police need to conduct investigations .


fn_spacy_tokens_for_baseline: A pallid sun appeared like a nosy neighbour spying from behind lace curtains .

source_bert_toks: a pal ##lid sun appeared like a nos ##y neighbour spying from behind lace curtains .

reference_raw: The pale sun looked like a nosy neighbor watching from behind the lace curtains.

reference_spacy_tokens: The pale sun looked like a nosy neighbor watching from behind the lace curtains .


fn_spacy_tokens_for_baseline: I had my cape over my shoulder and a milk bottle .

source_bert_toks: i had my cape over my shoulder and a milk bottle .

reference_raw: I had a coat over my shoulder and a bottle of milk.

reference_spacy_tokens: I had a coat over my shoulder and a bottle of milk .


fn_spacy_tokens_for_baseline: He rose abruptly , and began to walk the wide chamber with his wine cup dangled lightly between his fingers , a habit of his when he was thoughtful .

source_bert_toks: he rose abruptly , and began to walk the wide chamber with his wine cup dan ##gled lightly between his fingers , a habit of his when he was thoughtful .

reference_raw: He got up suddenly and walked through the wide room, his wine cup dangling lightly between his fingers, which was his custom when he was thoughtful.

reference_spacy_tokens: He got up suddenly and walked through the wide room , his wine cup dangling lightly between his fingers , which was his custom when he was thoughtful .


fn_spacy_tokens_for_baseline: Gradually she swung back into her easy , loose stride .

source_bert_toks: gradually she swung back into her easy , loose stride .

reference_raw: Gradually she turned back to her easy, relaxed step.

reference_spacy_tokens: Gradually she turned back to her easy , relaxed step .


fn_spacy_tokens_for_baseline: When I saw the pictures of 880 and the Bay Bridge , I began to cry .

source_bert_toks: when i saw the pictures of 880 and the bay bridge , i began to cry .

reference_raw: When I saw the photos of 880 and the Bay Bridge, I started to cry.

reference_spacy_tokens: When I saw the photos of 880 and the Bay Bridge , I started to cry .


fn_spacy_tokens_for_baseline: Because the cornea is avascular , it needs to respire directly from the atmosphere .

source_bert_toks: because the corn ##ea is ava ##scu ##lar , it needs to res ##pire directly from the atmosphere .

reference_raw: Since the cornea is avascular, it has to breathe directly out of the atmosphere.

reference_spacy_tokens: Since the cornea is avascular , it has to breathe directly out of the atmosphere .


fn_spacy_tokens_for_baseline: If you 're feeling up to it , push on along the Mist Trail , past Emerald Pool , to Nevada Fall , and you 'll begin to lose the crowds .

source_bert_toks: if you ' re feeling up to it , push on along the mist trail , past emerald pool , to nevada fall , and you ' ll begin to lose the crowds .

reference_raw: If you feel like it, push along the Mist Trail, past the Emerald Pool, into the Fall of Nevada, and you'll start missing the crowds.

reference_spacy_tokens: If you feel like it , push along the Mist Trail , past the Emerald Pool , into the Fall of Nevada , and you 'll start missing the crowds .


fn_spacy_tokens_for_baseline: Because Shenzhen is much cheaper than Hong Kong , it is a popular weekend destination for Hong Kong 's Chinese , who come to relax , dine in its resorts , and play golf - Shenzhen hosted the World Cup of Golf in 1995 .

source_bert_toks: because shenzhen is much cheaper than hong kong , it is a popular weekend destination for hong kong ' s chinese , who come to relax , din ##e in its resorts , and play golf - shenzhen hosted the world cup of golf in 1995 .

reference_raw: Since Shenzhen is much cheaper than Hong Kong, it is a favorite weekend destination for the Chinese of Hong Kong, who come to relax and have dinner at their resorts and play golf - Shenzhen hosted the World Golf Cup in 1995.

reference_spacy_tokens: Since Shenzhen is much cheaper than Hong Kong , it is a favorite weekend destination for the Chinese of Hong Kong , who come to relax and have dinner at their resorts and play golf - Shenzhen hosted the World Golf Cup in 1995 .


fn_spacy_tokens_for_baseline: Since 1997 , the South Korean government has insisted that the DPRK join the CWC , to no avail .

source_bert_toks: since 1997 , the south korean government has insisted that the d ##pr ##k join the cw ##c , to no avail .

reference_raw: Since 1997, the Government of South Korea has insisted that the DPRK accede to the Convention in vain.

reference_spacy_tokens: Since 1997 , the Government of South Korea has insisted that the DPRK accede to the Convention in vain .


fn_spacy_tokens_for_baseline: The history of a castle on this site dates back to 1231 when a stone castle , or more likely a fortified manor was built by Robert de Tattershall .

source_bert_toks: the history of a castle on this site dates back to 123 ##1 when a stone castle , or more likely a fortified manor was built by robert de ta ##tters ##hall .

reference_raw: The history of the castle on this site dates back to 1231 when Robert de Tattershall built a stone castle, or more likely a fortified mansion.

reference_spacy_tokens: The history of the castle on this site dates back to 1231 when Robert de Tattershall built a stone castle , or more likely a fortified mansion .


fn_spacy_tokens_for_baseline: He had to convince them . '

source_bert_toks: he had to convince them . '

reference_raw: He must have persuaded them.'

reference_spacy_tokens: He must have persuaded them . '


fn_spacy_tokens_for_baseline: From 1900 von Koerber 's government set out on a programme of economic and cultural modernization .

source_bert_toks: from 1900 von ko ##er ##ber ' s government set out on a programme of economic and cultural modernization .

reference_raw: Since 1900 von Koerber's government has embarked on a program of economic and cultural modernisation.

reference_spacy_tokens: Since 1900 von Koerber 's government has embarked on a program of economic and cultural modernisation .


fn_spacy_tokens_for_baseline: Nancy and the maid had to de - louse half of them .

source_bert_toks: nancy and the maid had to de - lou ##se half of them .

reference_raw: Nancy and the maid must have killed half of them.

reference_spacy_tokens: Nancy and the maid must have killed half of them .


fn_spacy_tokens_for_baseline: Items in the tests are not selected on the basis of how well they discriminate among students , i.e. they are not norm - referenced .

source_bert_toks: items in the tests are not selected on the basis of how well they disc ##rim ##inate among students , i . e . they are not norm - referenced .

reference_raw: Test items are not selected on the basis of the degree of discrimination between students, i.e. they are not standard-referenced.

reference_spacy_tokens: Test items are not selected on the basis of the degree of discrimination between students , i.e. they are not standard - referenced .


fn_spacy_tokens_for_baseline: You used to be such a sweet old - fashioned thing last year , ' she simpered sarcastically .

source_bert_toks: you used to be such a sweet old - fashioned thing last year , ' she sim ##per ##ed sarcastically .

reference_raw: You were so sweet, old-fashioned last year," she said sarcastically.

reference_spacy_tokens: You were so sweet , old - fashioned last year , " she said sarcastically .


fn_spacy_tokens_for_baseline: Though the tenor part was originally missing , it has been faithfully restored by analogy with the motet to make a glorious addition to the recorded repertory of Tallis 's music .

source_bert_toks: though the tenor part was originally missing , it has been faithful ##ly restored by analogy with the mo ##tet to make a glorious addition to the recorded repertory of tall ##is ' s music .

reference_raw: Although the tenor part was initially missing, it was reconstructed faithfully, by analogy with the motet, to make a famous addition to the recorded repertoire of Tallis's music.

reference_spacy_tokens: Although the tenor part was initially missing , it was reconstructed faithfully , by analogy with the motet , to make a famous addition to the recorded repertoire of Tallis 's music .


fn_spacy_tokens_for_baseline: He propelled her away from him and Robyn struggled to stay upright .

source_bert_toks: he propelled her away from him and robyn struggled to stay upright .

reference_raw: He pushed her away from him, and Robyn tried to stay upright.

reference_spacy_tokens: He pushed her away from him , and Robyn tried to stay upright .


fn_spacy_tokens_for_baseline: There she had been rudely thrown upon the hard ground and had been forced to defend herself .

source_bert_toks: there she had been rude ##ly thrown upon the hard ground and had been forced to defend herself .

reference_raw: There she was rudely thrown on hard ground and forced to defend herself.

reference_spacy_tokens: There she was rudely thrown on hard ground and forced to defend herself .


fn_spacy_tokens_for_baseline: This appears when a holiday firm either itself generates , or is absorbed into a sequence of activities parallel to its own business .

source_bert_toks: this appears when a holiday firm either itself generates , or is absorbed into a sequence of activities parallel to its own business .

reference_raw: This occurs when a holiday company either creates itself or is absorbed in a series of activities parallel to its own business.

reference_spacy_tokens: This occurs when a holiday company either creates itself or is absorbed in a series of activities parallel to its own business .


fn_spacy_tokens_for_baseline: The alliance became known as the Delian League .

source_bert_toks: the alliance became known as the del ##ian league .

reference_raw: The Ally has become known as the Delian League.

reference_spacy_tokens: The Ally has become known as the Delian League .


fn_spacy_tokens_for_baseline: When you 've botched a job a dozen times you do n't hang around waiting to try one more time , you abandon it .

source_bert_toks: when you ' ve bot ##ched a job a dozen times you don ' t hang around waiting to try one more time , you abandon it .

reference_raw: If you've screwed up a job a dozen times, you don't hang around and wait to try it again, you leave it.

reference_spacy_tokens: If you 've screwed up a job a dozen times , you do n't hang around and wait to try it again , you leave it .


fn_spacy_tokens_for_baseline: At the age of fourteen , Alexei Gismondi was hardly adept at self - revelation .

source_bert_toks: at the age of fourteen , alexei gi ##smo ##ndi was hardly adept at self - revelation .

reference_raw: When Alexei Gismondi was fourteen, he was barely capable of revealing himself.

reference_spacy_tokens: When Alexei Gismondi was fourteen , he was barely capable of revealing himself .


fn_spacy_tokens_for_baseline: Mike dried his hands on the tea - towel .

source_bert_toks: mike dried his hands on the tea - towel .

reference_raw: Mike wiped his hands on his tea towel.

reference_spacy_tokens: Mike wiped his hands on his tea towel .


fn_spacy_tokens_for_baseline: A similar threat faced Lough Foyle , Londonderry , where the Culmore tip was encroaching on mudflats offering a winter home to hundreds of whooper swans migrating from Greenland .

source_bert_toks: a similar threat faced lough f ##oy ##le , london ##der ##ry , where the cu ##lm ##ore tip was en ##cr ##oa ##ching on mud ##fl ##ats offering a winter home to hundreds of who ##oper swans migrating from greenland .

reference_raw: A similar threat was faced by Lough Foyle in London, where Culmore's tip lay in mud flats offering a winter home to hundreds of whooper swans migrating from Greenland.

reference_spacy_tokens: A similar threat was faced by Lough Foyle in London , where Culmore 's tip lay in mud flats offering a winter home to hundreds of whooper swans migrating from Greenland .


fn_spacy_tokens_for_baseline: North Korea had proposed signing a ' peace and good neighbourliness treaty ' with Japan , with which it was technically still at war , to include an apology from Japan for its colonial rule .

source_bert_toks: north korea had proposed signing a ' peace and good neighbour ##liness treaty ' with japan , with which it was technically still at war , to include an apology from japan for its colonial rule .

reference_raw: North Korea has proposed to sign a "Peace and Good Neighborhood Agreement" with Japan, with which it is technically still at war, to include an apology from Japan for its colonial rule.

reference_spacy_tokens: North Korea has proposed to sign a " Peace and Good Neighborhood Agreement " with Japan , with which it is technically still at war , to include an apology from Japan for its colonial rule .


fn_spacy_tokens_for_baseline: There they sold half their animals , bought goods with the proceeds , loaded them onto the remaining animals and returned to Kufra , resuming the annual north - south movement .

source_bert_toks: there they sold half their animals , bought goods with the proceeds , loaded them onto the remaining animals and returned to ku ##fra , res ##uming the annual north - south movement .

reference_raw: There they sold half the animals, bought the goods with the proceeds, put them on the remaining animals, and returned to Kufra to resume the annual north-south movement.

reference_spacy_tokens: There they sold half the animals , bought the goods with the proceeds , put them on the remaining animals , and returned to Kufra to resume the annual north - south movement .


fn_spacy_tokens_for_baseline: In the winter of 1976 , Rod Johnstone , who started out as a schoolteacher before taking up naval architecture , designed and built the first J/24 in his garage .

source_bert_toks: in the winter of 1976 , rod johnstone , who started out as a school ##teacher before taking up naval architecture , designed and built the first j / 24 in his garage .

reference_raw: In the winter of 1976, Rod Johnston, who started as a teacher before he took up naval architecture, designed and built the first J/24 in his garage.

reference_spacy_tokens: In the winter of 1976 , Rod Johnston , who started as a teacher before he took up naval architecture , designed and built the first J/24 in his garage .


fn_spacy_tokens_for_baseline: ' They discovered him a year ago , ' said Miss Burnet , who had sat up and was now intently following the conversation .

source_bert_toks: ' they discovered him a year ago , ' said miss burn ##et , who had sat up and was now intently following the conversation .

reference_raw: 'It's been discovered a year since,' said Miss Burnet, who had sat down and was watching the conversation intently.

reference_spacy_tokens: ' It 's been discovered a year since , ' said Miss Burnet , who had sat down and was watching the conversation intently .


fn_spacy_tokens_for_baseline: " When I finally made up my mind to leave , I had a restraining order put against him and that was $ 50 but that was $ 50 well spent to me , " said Bunzy , 40 . "

source_bert_toks: " when i finally made up my mind to leave , i had a restraining order put against him and that was $ 50 but that was $ 50 well spent to me , " said bun ##zy , 40 . "

reference_raw: "When I finally decided to leave, I had an injunction against him, and it was fifty dollars, but it was fifty dollars well spent on me," Bunzy said, forty years old.

reference_spacy_tokens: " When I finally decided to leave , I had an injunction against him , and it was fifty dollars , but it was fifty dollars well spent on me , " Bunzy said , forty years old .


fn_spacy_tokens_for_baseline: After the Islamic Revolution , however , many leading nuclear scientists left the country , and in the 1990 , the AEOI reportedly employed " around 200 scientists and 2,000 personnel engaged in nuclear research . "

source_bert_toks: after the islamic revolution , however , many leading nuclear scientists left the country , and in the 1990 , the ae ##oi reportedly employed " around 200 scientists and 2 , 000 personnel engaged in nuclear research . "

reference_raw: However, following the Islamic Revolution, many of the leading nuclear scientists left the country, and in 1990 the AEOI reportedly employed "around 200 scientists and 2,000 nuclear research personnel."

reference_spacy_tokens: However , following the Islamic Revolution , many of the leading nuclear scientists left the country , and in 1990 the AEOI reportedly employed " around 200 scientists and 2,000 nuclear research personnel . "


fn_spacy_tokens_for_baseline: The Mail reports that ' Furious left wingers plunged their knives into Neil Kinnock last night . '

source_bert_toks: the mail reports that ' furious left winger ##s plunged their knives into neil kin ##nock last night . '

reference_raw: According to the mail, "Furious left wingers stabbed Neil Kinnock with knives last night."

reference_spacy_tokens: According to the mail , " Furious left wingers stabbed Neil Kinnock with knives last night . "


fn_spacy_tokens_for_baseline: If they are not , we are likely to interpret this somehow : as rudeness perhaps , or deafness , or lack of attention .

source_bert_toks: if they are not , we are likely to interpret this somehow : as rude ##ness perhaps , or deaf ##ness , or lack of attention .

reference_raw: If it isn't, we'll probably understand it in some way: rudeness, maybe deafness, or lack of attention.

reference_spacy_tokens: If it is n't , we 'll probably understand it in some way : rudeness , maybe deafness , or lack of attention .


fn_spacy_tokens_for_baseline: At first I thought it was a party but afterwards realised that they had just dropped in .

source_bert_toks: at first i thought it was a party but afterwards realised that they had just dropped in .

reference_raw: At first I thought it was a party, but then I realized they'd just stopped by.

reference_spacy_tokens: At first I thought it was a party , but then I realized they 'd just stopped by .


fn_spacy_tokens_for_baseline: Meanwhile , the contents of their briefcase had been quietly photocopied .

source_bert_toks: meanwhile , the contents of their briefcase had been quietly photo ##co ##pie ##d .

reference_raw: In the meantime, the contents of their suitcase were quietly copied.

reference_spacy_tokens: In the meantime , the contents of their suitcase were quietly copied .


fn_spacy_tokens_for_baseline: And smart investors see future sales soaring , thanks to the Duchess of York 's poolside antics .

source_bert_toks: and smart investors see future sales soaring , thanks to the duchess of york ' s pools ##ide antics .

reference_raw: And smart investors see future sales rising, thanks to the Duchess of York Poolside Antics.

reference_spacy_tokens: And smart investors see future sales rising , thanks to the Duchess of York Poolside Antics .


fn_spacy_tokens_for_baseline: He has a trendy haircut and wears a dangling earring , but his accent is like his father 's .

source_bert_toks: he has a trend ##y hair ##cut and wears a dangling ear ##ring , but his accent is like his father ' s .

reference_raw: His hair is trendy and he wears a dangling earring, but his accent is like his father's.

reference_spacy_tokens: His hair is trendy and he wears a dangling earring , but his accent is like his father 's .


fn_spacy_tokens_for_baseline: John and his friend then began to fight back and were gaining the upper hand when the police intervened slamming them up against a wall with their arms pinned behind their backs .

source_bert_toks: john and his friend then began to fight back and were gaining the upper hand when the police intervened slamming them up against a wall with their arms pinned behind their backs .

reference_raw: John and his friend fought back and were gaining the upper hand when the police intervened, hammering them against the wall with their hands clasped behind their backs.

reference_spacy_tokens: John and his friend fought back and were gaining the upper hand when the police intervened , hammering them against the wall with their hands clasped behind their backs .


fn_spacy_tokens_for_baseline: Close by the doorway two boys clash cymbals , hard so they hit together squarely , hollow full against cupped hollow .

source_bert_toks: close by the doorway two boys clash cy ##mba ##ls , hard so they hit together square ##ly , hollow full against cupped hollow .

reference_raw: Near the door, two boys hit the cymbals, hard enough to strike at each other squarely, a hollow filled with cupped hollows.

reference_spacy_tokens: Near the door , two boys hit the cymbals , hard enough to strike at each other squarely , a hollow filled with cupped hollows .


fn_spacy_tokens_for_baseline: A video recorder was stolen during a burglary at a house in Woodcrest Road , Darlington , on Thursday .

source_bert_toks: a video recorder was stolen during a bu ##rg ##lary at a house in wood ##crest road , darlington , on thursday .

reference_raw: A video recorder was stolen during a break-in at a house on Woodcrest Road, Darlington, on Thursday.

reference_spacy_tokens: A video recorder was stolen during a break - in at a house on Woodcrest Road , Darlington , on Thursday .


fn_spacy_tokens_for_baseline: This leads to premature wear and plumes of blue smoke spewing from the exhaust .

source_bert_toks: this leads to premature wear and plume ##s of blue smoke sp ##ew ##ing from the exhaust .

reference_raw: This leads to premature wear and plumes of blue smoke spilling out of the exhaust.

reference_spacy_tokens: This leads to premature wear and plumes of blue smoke spilling out of the exhaust .


fn_spacy_tokens_for_baseline: Standing by the water 's edge , Laura glanced nervously about her , but there appeared to be no sign of Ross .

source_bert_toks: standing by the water ' s edge , laura glanced nervously about her , but there appeared to be no sign of ross .

reference_raw: Laura, standing at the rim of the water, looked around nervously, but there was no sign of Ross.

reference_spacy_tokens: Laura , standing at the rim of the water , looked around nervously , but there was no sign of Ross .


fn_spacy_tokens_for_baseline: ' He seems to think I 'm there to obey his commands ! ' ;

source_bert_toks: ' he seems to think i ' m there to obey his commands ! ' ;

reference_raw: 'He thinks I'm here to follow his orders!'

reference_spacy_tokens: ' He thinks I 'm here to follow his orders ! '