fn_spacy_tokens_for_baseline: Leonora refused to be consoled .

source_bert_toks: leon ##ora refused to be console ##d .

reference_raw: Leonora refused to be comforted.

reference_spacy_tokens: Leonora refused to be comforted .


fn_spacy_tokens_for_baseline: God said " turmoil is greater than murder " , and for those devils , their danger is greater than who rapes , or rob and steal money or land .

source_bert_toks: god said " turmoil is greater than murder " , and for those devils , their danger is greater than who rape ##s , or rob and steal money or land .

reference_raw: God said, "Turmoil is greater than murder," and for these devils, their peril is greater than those who rape or rob or steal money or land.

reference_spacy_tokens: God said , " Turmoil is greater than murder , " and for these devils , their peril is greater than those who rape or rob or steal money or land .


fn_spacy_tokens_for_baseline: Under the deal , India will build a sophisticate chemical plant at Qazvin , which will be used produce phosphorous pentasulfide , a dual - use chemical that could be used to produce chemical weapons .

source_bert_toks: under the deal , india will build a so ##phi ##stic ##ate chemical plant at q ##az ##vin , which will be used produce ph ##os ##ph ##orous pen ##tas ##ulf ##ide , a dual - use chemical that could be used to produce chemical weapons .

reference_raw: According to the agreement, India will build a sophisticated chemical plant in Qazvin to produce phosphorous pentasulfide, a dual-use chemical that may be used in the manufacture of chemical weapons.

reference_spacy_tokens: According to the agreement , India will build a sophisticated chemical plant in Qazvin to produce phosphorous pentasulfide , a dual - use chemical that may be used in the manufacture of chemical weapons .


fn_spacy_tokens_for_baseline: I had sent her a copy of my memoir , but her noncommittal letter of thanks had given no indication of whether she had read it .

source_bert_toks: i had sent her a copy of my memoir , but her non ##com ##mit ##tal letter of thanks had given no indication of whether she had read it .

reference_raw: I sent her a copy of my memory, but her noncommittal thank-you letter didn't tell her if she'd read it.

reference_spacy_tokens: I sent her a copy of my memory , but her noncommittal thank - you letter did n't tell her if she 'd read it .


fn_spacy_tokens_for_baseline: The display can be further extended by incorporating 2 large photo panels : again this depends on the size of the venue .

source_bert_toks: the display can be further extended by incorporating 2 large photo panels : again this depends on the size of the venue .

reference_raw: The display may be further expanded by including two large photo panels: once again, it is dependent on the size of the location.

reference_spacy_tokens: The display may be further expanded by including two large photo panels : once again , it is dependent on the size of the location .


fn_spacy_tokens_for_baseline: Northern Telecom -- itself a large Microsoft user -- says it has a prior claim to the initials and has told Microsoft it ca nt use the moniker .

source_bert_toks: northern telecom - - itself a large microsoft user - - says it has a prior claim to the initials and has told microsoft it can ##t use the moniker .

reference_raw: Northern Telecom - itself a large Microsoft user - says it has a prior right to the initials and tells Microsoft that it cannot use the moniker.

reference_spacy_tokens: Northern Telecom - itself a large Microsoft user - says it has a prior right to the initials and tells Microsoft that it can not use the moniker .


fn_spacy_tokens_for_baseline: Here , arched bridges , pagodas , fish ponds , and stands of bamboo create the mood of a timeless Chinese painting .

source_bert_toks: here , arched bridges , pagoda ##s , fish ponds , and stands of bamboo create the mood of a timeless chinese painting .

reference_raw: Here, arched bridges, pagodas, fish ponds, and bamboo stands create the mood of a timeless painting in China.

reference_spacy_tokens: Here , arched bridges , pagodas , fish ponds , and bamboo stands create the mood of a timeless painting in China .


fn_spacy_tokens_for_baseline: He seemed to be drawing her willing body towards his again , but this time she remembered her vow to resist him .

source_bert_toks: he seemed to be drawing her willing body towards his again , but this time she remembered her vow to resist him .

reference_raw: He seemed to draw her willing body back to him, but this time she remembered her promise to resist him.

reference_spacy_tokens: He seemed to draw her willing body back to him , but this time she remembered her promise to resist him .


fn_spacy_tokens_for_baseline: Paul Williams , 28 , of Sedgebrook Grove , Hull , and Shaun Williams , 24 , of Fellstone Close , Hull , were given unconditional bail .

source_bert_toks: paul williams , 28 , of se ##dge ##brook grove , hull , and shaun williams , 24 , of fell ##stone close , hull , were given un ##con ##ditional bail .

reference_raw: Paul Williams, 28 years old, of Sedgebrook Grove, Hull, and Shaun Williams, 24 years old, of Fellstone Close, Hull, has been granted unrestricted parole.

reference_spacy_tokens: Paul Williams , 28 years old , of Sedgebrook Grove , Hull , and Shaun Williams , 24 years old , of Fellstone Close , Hull , has been granted unrestricted parole .


fn_spacy_tokens_for_baseline: Several islands and Greek city - states agreed to work together , and created a treasury to fund their plans , which was held on the island of Delos .

source_bert_toks: several islands and greek city - states agreed to work together , and created a treasury to fund their plans , which was held on the island of del ##os .

reference_raw: Several islands and Greek states agreed to cooperate and set up a treasury to finance their plans that were held on the island of Delos.

reference_spacy_tokens: Several islands and Greek states agreed to cooperate and set up a treasury to finance their plans that were held on the island of Delos .


fn_spacy_tokens_for_baseline: These steps into a wider world were part of a great process of expansion by western Europe that had already been going on for decades .

source_bert_toks: these steps into a wider world were part of a great process of expansion by western europe that had already been going on for decades .

reference_raw: These steps to the wider world were part of the great Western European enlargement process, which has been taking place for decades.

reference_spacy_tokens: These steps to the wider world were part of the great Western European enlargement process , which has been taking place for decades .


fn_spacy_tokens_for_baseline: Many of the bone - headed ceratopsians could swim with their front feet pawing the lake bed like hippos , both buoyed up and cooled by the water .

source_bert_toks: many of the bone - headed ce ##rat ##ops ##ians could swim with their front feet paw ##ing the lake bed like hip ##po ##s , both bu ##oy ##ed up and cooled by the water .

reference_raw: Many of the bone-headed ceratopsians could swim with their front legs pawing at the bottom of the lake like hippos, both buoyed up and chilled by the water.

reference_spacy_tokens: Many of the bone - headed ceratopsians could swim with their front legs pawing at the bottom of the lake like hippos , both buoyed up and chilled by the water .


fn_spacy_tokens_for_baseline: On its whistle - stop tour of the Pacific his Floating Island -- an Oahu with propellers -- found Polynesian gentlemen in waistcoats and wing - collars instead of savages in feathers .

source_bert_toks: on its whistle - stop tour of the pacific his floating island - - an o ##ahu with propellers - - found poly ##nesian gentlemen in waist ##coat ##s and wing - collar ##s instead of savage ##s in feathers .

reference_raw: His floating island, an Oahu with propellers, found Polynesian gentlemen in vests and wing collars instead of savages in feathers, on a whistling tour of the Pacific.

reference_spacy_tokens: His floating island , an Oahu with propellers , found Polynesian gentlemen in vests and wing collars instead of savages in feathers , on a whistling tour of the Pacific .


fn_spacy_tokens_for_baseline: He kept being sick when I fed him . '

source_bert_toks: he kept being sick when i fed him . '

reference_raw: He was still ill when I fed him.'

reference_spacy_tokens: He was still ill when I fed him . '


fn_spacy_tokens_for_baseline: It was erected originally in 1493 , an important building reflecting the wealth of the city .

source_bert_toks: it was erected originally in 149 ##3 , an important building reflecting the wealth of the city .

reference_raw: Originally built in 1493, an important building reflecting the city's wealth.

reference_spacy_tokens: Originally built in 1493 , an important building reflecting the city 's wealth .


fn_spacy_tokens_for_baseline: Although the foreign ministry was apparently in favor of participating in the regime , the military was opposed , and Kim Chong Il apparently sided with the latter .

source_bert_toks: although the foreign ministry was apparently in favor of participating in the regime , the military was opposed , and kim chong il apparently sided with the latter .

reference_raw: Though the Ministry of Foreign Affairs seemed to be in favour of participating in the regime, the army was against it, and Kim Chong II seemed to be on the other side.

reference_spacy_tokens: Though the Ministry of Foreign Affairs seemed to be in favour of participating in the regime , the army was against it , and Kim Chong II seemed to be on the other side .


fn_spacy_tokens_for_baseline: ' Some who drive car bombs do n't know they are going to blow up .

source_bert_toks: ' some who drive car bombs don ' t know they are going to blow up .

reference_raw: 'Some who drive car bombs don't know they're gonna explode.

reference_spacy_tokens: ' Some who drive car bombs do n't know they 're gon na explode .


fn_spacy_tokens_for_baseline: This brought together in a simplified form a number of remedies obtainable from a Divisional Court of the Queen 's Bench Division consisting of two or three judges .

source_bert_toks: this brought together in a simplified form a number of re ##med ##ies obtain ##able from a divisional court of the queen ' s bench division consisting of two or three judges .

reference_raw: It combines, in a simplified form, a number of appeals available from a divisional court of the Queen's Bench Division, composed of two or three judges.

reference_spacy_tokens: It combines , in a simplified form , a number of appeals available from a divisional court of the Queen 's Bench Division , composed of two or three judges .


fn_spacy_tokens_for_baseline: The lurking menace of those few sinister lines hung over her like a sentence of doom , an ominous harbinger of death and destruction .

source_bert_toks: the lurking menace of those few sinister lines hung over her like a sentence of doom , an ominous ha ##rbin ##ger of death and destruction .

reference_raw: The lurking threat of the few ominous lines hung over her like a sentence of doom, a sinister swordsman of death and destruction.

reference_spacy_tokens: The lurking threat of the few ominous lines hung over her like a sentence of doom , a sinister swordsman of death and destruction .


fn_spacy_tokens_for_baseline: She ordered a snowball , and fumbled in her bag for the price of it .

source_bert_toks: she ordered a snow ##ball , and fumbled in her bag for the price of it .

reference_raw: She ordered a snowball and rummaged in her bag for the price.

reference_spacy_tokens: She ordered a snowball and rummaged in her bag for the price .


fn_spacy_tokens_for_baseline: A willow green wicker armchair takes on a whole new look when a collection of pretty floral covered cushions and a deep frill are added .

source_bert_toks: a willow green wi ##cker armchair takes on a whole new look when a collection of pretty floral covered cushions and a deep fr ##ill are added .

reference_raw: The willow-green wicker chair takes on a whole new look when a series of beautiful flower-covered pillows and deep frills are added.

reference_spacy_tokens: The willow - green wicker chair takes on a whole new look when a series of beautiful flower - covered pillows and deep frills are added .


fn_spacy_tokens_for_baseline: I smuggled his booze into the hospital .

source_bert_toks: i smug ##gled his boo ##ze into the hospital .

reference_raw: I snuck his booze into the hospital.

reference_spacy_tokens: I snuck his booze into the hospital .


fn_spacy_tokens_for_baseline: ' At that point Prince Philip told his wife that their eldest son was unsuitable to become monarch in the foreseeable future -- if ever , ' says a senior royal insider . '

source_bert_toks: ' at that point prince philip told his wife that their eldest son was unsuitable to become monarch in the fore ##see ##able future - - if ever , ' says a senior royal insider . '

reference_raw: "At that moment, Prince Philip told his wife that their eldest son was not fit to become a ruler in the near future - if ever," says the high-ranking insider."

reference_spacy_tokens: " At that moment , Prince Philip told his wife that their eldest son was not fit to become a ruler in the near future - if ever , " says the high - ranking insider . "


fn_spacy_tokens_for_baseline: Few traditional ancestral halls remain in China since the anti - historical destruction during the Cultural Revolution , so these New Territories ancestral halls are rare survivors .

source_bert_toks: few traditional ancestral halls remain in china since the anti - historical destruction during the cultural revolution , so these new territories ancestral halls are rare survivors .

reference_raw: Since the anti-historical destruction of the cultural revolution, there are few traditions of ancestral halls in China, so these New Territorial Halls are rare survivors.

reference_spacy_tokens: Since the anti - historical destruction of the cultural revolution , there are few traditions of ancestral halls in China , so these New Territorial Halls are rare survivors .


fn_spacy_tokens_for_baseline: Mitsotakis 's sensitivity on the issue of his family 's political involvement was seen to reflect his desire to avoid charges of unethical conduct by his government , the issue which had effectively brought down his ( socialist ) predecessor Andreas Papandreou .

source_bert_toks: mit ##so ##ta ##kis ' s sensitivity on the issue of his family ' s political involvement was seen to reflect his desire to avoid charges of une ##thic ##al conduct by his government , the issue which had effectively brought down his ( socialist ) predecessor andreas papa ##nd ##re ##ou .

reference_raw: Mitsotakis' sensitivity to the question of his family's political involvement was seen as a reflection of his desire to avoid accusations of unethic behavior by his government, a question that effectively destroyed his (socialist) predecessor Andreas Papandreou.

reference_spacy_tokens: Mitsotakis ' sensitivity to the question of his family 's political involvement was seen as a reflection of his desire to avoid accusations of unethic behavior by his government , a question that effectively destroyed his ( socialist ) predecessor Andreas Papandreou .


fn_spacy_tokens_for_baseline: Woman are more likely to be frank about the primacy of personal relationships .

source_bert_toks: woman are more likely to be frank about the prima ##cy of personal relationships .

reference_raw: Women are more likely to be honest about the primacy of personal relationships.

reference_spacy_tokens: Women are more likely to be honest about the primacy of personal relationships .


fn_spacy_tokens_for_baseline: Fourth : Defending the Location Plan .

source_bert_toks: fourth : defending the location plan .

reference_raw: Fourth, I'm protecting the location plan.

reference_spacy_tokens: Fourth , I 'm protecting the location plan .


fn_spacy_tokens_for_baseline: They also knew that the arrested men were respectable and law - abiding and they were highly indignant when they heard that an official spokesman had smeared them with the suggestion of criminal activities .

source_bert_toks: they also knew that the arrested men were respectable and law - ab ##idi ##ng and they were highly ind ##ignant when they heard that an official spokesman had smeared them with the suggestion of criminal activities .

reference_raw: They also knew that the arrested men were respectable and law-abiding, and that they were highly outraged when they heard that the official spokesman had dirtyed them with the idea of criminal activity.

reference_spacy_tokens: They also knew that the arrested men were respectable and law - abiding , and that they were highly outraged when they heard that the official spokesman had dirtyed them with the idea of criminal activity .


fn_spacy_tokens_for_baseline: Both have contended with disease and suffering , and have been seen as near - saints by a grateful and admiring public .

source_bert_toks: both have contend ##ed with disease and suffering , and have been seen as near - saints by a grateful and admiring public .

reference_raw: They both contended with disease and suffering, and the grateful and admirable public viewed them as almost saints.

reference_spacy_tokens: They both contended with disease and suffering , and the grateful and admirable public viewed them as almost saints .


fn_spacy_tokens_for_baseline: Then , standing over the desk , she typed : ' Welcome home , Rob .

source_bert_toks: then , standing over the desk , she typed : ' welcome home , rob .

reference_raw: Then she stood at the table and wrote, "Welcome home, Rob.

reference_spacy_tokens: Then she stood at the table and wrote , " Welcome home , Rob .


fn_spacy_tokens_for_baseline: His assertion is that our ancestors were too stupid to have created the most impressive of surviving ancient architectural and artistic works .

source_bert_toks: his assertion is that our ancestors were too stupid to have created the most impressive of surviving ancient architectural and artistic works .

reference_raw: He claims that our ancestors were too stupid to make the most impressive of the survival of ancient architectural and artistic works.

reference_spacy_tokens: He claims that our ancestors were too stupid to make the most impressive of the survival of ancient architectural and artistic works .


fn_spacy_tokens_for_baseline: The varying shapes contribute to the individual character and flavour of the whisky produced , and are crucial to the wide range of whiskies enjoyed by connoisseurs the world over .

source_bert_toks: the varying shapes contribute to the individual character and flavour of the whisky produced , and are crucial to the wide range of w ##his ##kie ##s enjoyed by con ##no ##isse ##urs the world over .

reference_raw: Various shapes contribute to the individual character and taste of the whisky produced and are essential for the wide range of whiskeys enjoyed by experts throughout the world.

reference_spacy_tokens: Various shapes contribute to the individual character and taste of the whisky produced and are essential for the wide range of whiskeys enjoyed by experts throughout the world .


fn_spacy_tokens_for_baseline: He came back with two glasses of beer and handed one to Ellis .

source_bert_toks: he came back with two glasses of beer and handed one to ellis .

reference_raw: He returned with two beers and handed one to Ellis.

reference_spacy_tokens: He returned with two beers and handed one to Ellis .


fn_spacy_tokens_for_baseline: The overhead strip lights glinted in the blackness of his eyes .

source_bert_toks: the overhead strip lights glint ##ed in the blackness of his eyes .

reference_raw: The overhead strip lights gleamed in the blackness of his eyes.

reference_spacy_tokens: The overhead strip lights gleamed in the blackness of his eyes .


fn_spacy_tokens_for_baseline: Like everyone else , I deplore and condemn this killing , as all right - thinking people must .

source_bert_toks: like everyone else , i de ##pl ##ore and condemn this killing , as all right - thinking people must .

reference_raw: Like everyone else, I regret and condemn this murder, as all right-thinking people have to.

reference_spacy_tokens: Like everyone else , I regret and condemn this murder , as all right - thinking people have to .


fn_spacy_tokens_for_baseline: What 's more , if the St Louis was forced to unload its cargo of degenerates and criminals back in Hamburg , this would prove that the world 's supposed concern was mere hypocrisy .

source_bert_toks: what ' s more , if the st louis was forced to un ##load its cargo of de ##gen ##erate ##s and criminals back in hamburg , this would prove that the world ' s supposed concern was mere h ##yp ##oc ##ris ##y .

reference_raw: More importantly, if the St. Louis were forced to unload its cargo of perverts and criminals in Hamburg, it would prove that the world's supposed interest was hypocrisy.

reference_spacy_tokens: More importantly , if the St. Louis were forced to unload its cargo of perverts and criminals in Hamburg , it would prove that the world 's supposed interest was hypocrisy .


fn_spacy_tokens_for_baseline: Barry Jones , a north Londoner , was loquacious but less confident .

source_bert_toks: barry jones , a north london ##er , was lo ##qua ##cious but less confident .

reference_raw: Barry Jones, a North Londoner, was liquefied but less confident.

reference_spacy_tokens: Barry Jones , a North Londoner , was liquefied but less confident .


fn_spacy_tokens_for_baseline: In my day , we were instructed that frost never hurt a baby yet , and if the baby cried it must be mastered .

source_bert_toks: in my day , we were instructed that frost never hurt a baby yet , and if the baby cried it must be mastered .

reference_raw: In my day, we were told that frost had never harmed a child, and when a child wept, we had to control it.

reference_spacy_tokens: In my day , we were told that frost had never harmed a child , and when a child wept , we had to control it .


fn_spacy_tokens_for_baseline: The work of research associates and assistants is carried out under supervision , sometimes as part of a research team .

source_bert_toks: the work of research associates and assistants is carried out under supervision , sometimes as part of a research team .

reference_raw: The work of research partners and assistants is supervised, sometimes as part of a research team.

reference_spacy_tokens: The work of research partners and assistants is supervised , sometimes as part of a research team .


fn_spacy_tokens_for_baseline: Opposite was the site of the Royal Palace lived in by the kings of Bohemia from the Hussite Wars in 1419 , until King Vladislav reasserting the rights of kingship in 1484 , returned to the castle .

source_bert_toks: opposite was the site of the royal palace lived in by the kings of bohemia from the hu ##ssi ##te wars in 141 ##9 , until king vlad ##islav re ##asse ##rting the rights of kings ##hip in 148 ##4 , returned to the castle .

reference_raw: Opposite was the place where the Kings of Bohemia lived from the Hussite Wars in 1419, until King Vladislav returned to the castle in 1484.

reference_spacy_tokens: Opposite was the place where the Kings of Bohemia lived from the Hussite Wars in 1419 , until King Vladislav returned to the castle in 1484 .


fn_spacy_tokens_for_baseline: He sees the Livesey case as a simple robbery , because our friend Parks 's cab was involved in a bank snatch , some time ago .

source_bert_toks: he sees the lives ##ey case as a simple robbery , because our friend parks ' s cab was involved in a bank snatch , some time ago .

reference_raw: He sees the Livesey case as a simple robbery, because our friend Parks' taxi was involved in a bank robbery a while back.

reference_spacy_tokens: He sees the Livesey case as a simple robbery , because our friend Parks ' taxi was involved in a bank robbery a while back .


fn_spacy_tokens_for_baseline: And today the American people are going to see a little bit of light .

source_bert_toks: and today the american people are going to see a little bit of light .

reference_raw: And today, America's people will see some light.

reference_spacy_tokens: And today , America 's people will see some light .


fn_spacy_tokens_for_baseline: He swept the magazine into a drawer , then carried the tea mug over to the sink where he emptied it .

source_bert_toks: he swept the magazine into a drawer , then carried the tea mug over to the sink where he emptied it .

reference_raw: He swept the magazine into a drawer and carried the cup of tea to the sink, where he emptied it.

reference_spacy_tokens: He swept the magazine into a drawer and carried the cup of tea to the sink , where he emptied it .


fn_spacy_tokens_for_baseline: Perhaps , for instance , educational programmes for parents of disabled or ill children might be evaluated to see if reducing any over - involved or overcritical parenting styles reduces the child 's later risk of schizophrenia .

source_bert_toks: perhaps , for instance , educational programmes for parents of disabled or ill children might be evaluated to see if reducing any over - involved or over ##cr ##itical parenting styles reduces the child ' s later risk of schizophrenia .

reference_raw: For example, educational programmes for parents of disabled or ill children could be assessed to determine whether the reduction of any over-involved or over-critical parenting style reduces the child's later risk of schizophrenia.

reference_spacy_tokens: For example , educational programmes for parents of disabled or ill children could be assessed to determine whether the reduction of any over - involved or over - critical parenting style reduces the child 's later risk of schizophrenia .


fn_spacy_tokens_for_baseline: I will now donate the money to charity .

source_bert_toks: i will now donate the money to charity .

reference_raw: Now I'm going to give the money to charity.

reference_spacy_tokens: Now I 'm going to give the money to charity .


fn_spacy_tokens_for_baseline: On 8 March 1996 , the Washington Post reported , " US intelligence officials have concluded that companies in China are providing Iran with several virtually complete factories suited for making deadly poison gases , " and that Iranian " military - related organizations " are buying from China glass - lined vessels for mixing precursors , special air - filtration equipment , and the technology to manufacture these items and others indigenously .

source_bert_toks: on 8 march 1996 , the washington post reported , " us intelligence officials have concluded that companies in china are providing iran with several virtually complete factories suited for making deadly poison gases , " and that iranian " military - related organizations " are buying from china glass - lined vessels for mixing precursor ##s , special air - fi ##lt ##ration equipment , and the technology to manufacture these items and others indigenous ##ly .

reference_raw: On 8 March 1996, the Washington Post announced, "U.S. intelligence officials have concluded that companies in China provide Iran with a number of virtually complete factories suitable for the production of lethal toxic gases," and that Iran's "military-related organizations" purchase from Chinese glass-lined vessels for the mixing of precursors, special air-filtration equipment, and technology for the production of such items and other indigenous products.

reference_spacy_tokens: On 8 March 1996 , the Washington Post announced , " U.S. intelligence officials have concluded that companies in China provide Iran with a number of virtually complete factories suitable for the production of lethal toxic gases , " and that Iran 's " military - related organizations " purchase from Chinese glass - lined vessels for the mixing of precursors , special air - filtration equipment , and technology for the production of such items and other indigenous products .


fn_spacy_tokens_for_baseline: ' One occasionally sees a comment regarding cut - rate estate agency prices ; however , this is usually for a reason , either buying business or desperation .

source_bert_toks: ' one occasionally sees a comment regarding cut - rate estate agency prices ; however , this is usually for a reason , either buying business or desperation .

reference_raw: 'Sometimes, one sees a remark about the price of a cut-rate real estate agency, but it is usually for a reason that buys a business or despair.

reference_spacy_tokens: ' Sometimes , one sees a remark about the price of a cut - rate real estate agency , but it is usually for a reason that buys a business or despair .


fn_spacy_tokens_for_baseline: The till snatchers struck at the North - Eastern Coop in Commercial Street , Coxhoe , south of Durham City , on Thursday evening .

source_bert_toks: the till snatch ##ers struck at the north - eastern coop in commercial street , cox ##hoe , south of durham city , on thursday evening .

reference_raw: On Thursday night, the till thieves hit the Northeast Coop on Commercial Street, Coxhoe, south of Durham City.

reference_spacy_tokens: On Thursday night , the till thieves hit the Northeast Coop on Commercial Street , Coxhoe , south of Durham City .


fn_spacy_tokens_for_baseline: In the south west of Alaska , the volcanic chain picks up again strongly , and swings out to sea to form the long arcs of the Aleutian and Kurile Islands .

source_bert_toks: in the south west of alaska , the volcanic chain picks up again strongly , and swings out to sea to form the long arcs of the ale ##uti ##an and ku ##ril ##e islands .

reference_raw: In the southwest of Alaska, the volcanic chain rises again strongly and swerves toward the sea to form the long arches of the Aleutian and Kurile Islands.

reference_spacy_tokens: In the southwest of Alaska , the volcanic chain rises again strongly and swerves toward the sea to form the long arches of the Aleutian and Kurile Islands .


fn_spacy_tokens_for_baseline: Another erring headsman , Meister Hans , guilty of treason , suffered the indignity of being decapitated by his own assistant in 1479 .

source_bert_toks: another er ##ring heads ##man , mei ##ster hans , guilty of treason , suffered the ind ##ign ##ity of being dec ##ap ##itated by his own assistant in 147 ##9 .

reference_raw: Another errand leader, Meister Hans, guilty of treachery, was indignantly decapitated by his own assistant in 1479.

reference_spacy_tokens: Another errand leader , Meister Hans , guilty of treachery , was indignantly decapitated by his own assistant in 1479 .


fn_spacy_tokens_for_baseline: She added something for the panel to remember her by -- sheer seamed black tights with black and grey checked flat shoes and , on the lapel of her jacket , a blue glass antique brooch .

source_bert_toks: she added something for the panel to remember her by - - sheer seam ##ed black tight ##s with black and grey checked flat shoes and , on the lap ##el of her jacket , a blue glass antique bro ##och .

reference_raw: She added something to the panel to memorize her by: sheer black stockings, black-and-gray checked flat boots, and a blue-glass antique brooch on the lapel of her jacket.

reference_spacy_tokens: She added something to the panel to memorize her by : sheer black stockings , black - and - gray checked flat boots , and a blue - glass antique brooch on the lapel of her jacket .


fn_spacy_tokens_for_baseline: But as they seized her by the mantle , she shook it from her shoulders , folded two of her children in her arms and floated away through a window , never more to be seen by her husband and the two children she had left behind .

source_bert_toks: but as they seized her by the mantle , she shook it from her shoulders , folded two of her children in her arms and floated away through a window , never more to be seen by her husband and the two children she had left behind .

reference_raw: But when she was seized by the cloak, she shook it off her shoulders, folded the two children in her arms, and floated out the window, never to be seen again by her husband and the two children she had left behind.

reference_spacy_tokens: But when she was seized by the cloak , she shook it off her shoulders , folded the two children in her arms , and floated out the window , never to be seen again by her husband and the two children she had left behind .


fn_spacy_tokens_for_baseline: Steam in a vegetable steamer over boiling water for 5 minutes .

source_bert_toks: steam in a vegetable steamer over boiling water for 5 minutes .

reference_raw: Stream for five minutes in a vegetable vapour over boiling water.

reference_spacy_tokens: Stream for five minutes in a vegetable vapour over boiling water .


fn_spacy_tokens_for_baseline: Perhaps the cat was killing to satisfy hunger .

source_bert_toks: perhaps the cat was killing to satisfy hunger .

reference_raw: Maybe the cat killed to satisfy starvation.

reference_spacy_tokens: Maybe the cat killed to satisfy starvation .


fn_spacy_tokens_for_baseline: We are not so lucky , because our kidneys can not produce such a high concentration of salt in urine .

source_bert_toks: we are not so lucky , because our kidney ##s can not produce such a high concentration of salt in urine .

reference_raw: We're not so happy because our kidneys can't produce so much salt in the urine.

reference_spacy_tokens: We 're not so happy because our kidneys ca n't produce so much salt in the urine .


fn_spacy_tokens_for_baseline: Unlike a normal congregation they can reach out a hand , twirl a knob and obliterate the message .

source_bert_toks: unlike a normal congregation they can reach out a hand , t ##wi ##rl a knob and ob ##lite ##rate the message .

reference_raw: Unlike a regular congregation, they can reach out, twist the button, and erase the message.

reference_spacy_tokens: Unlike a regular congregation , they can reach out , twist the button , and erase the message .


fn_spacy_tokens_for_baseline: The high cheekbones , ' he ran his finger from her chin to just below the eye .

source_bert_toks: the high cheekbones , ' he ran his finger from her chin to just below the eye .

reference_raw: High cheekbones," he ran a finger from her jaw to just below the eye.

reference_spacy_tokens: High cheekbones , " he ran a finger from her jaw to just below the eye .


fn_spacy_tokens_for_baseline: I adored being with them .

source_bert_toks: i adored being with them .

reference_raw: I loved being with them.

reference_spacy_tokens: I loved being with them .


fn_spacy_tokens_for_baseline: At various points the text is misleading - for instance , ' if a child is born stillborn , a baptism must be carried out . by a senior nurse or a Catholic nurse . '

source_bert_toks: at various points the text is misleading - for instance , ' if a child is born still ##born , a baptism must be carried out . by a senior nurse or a catholic nurse . '

reference_raw: The text is misleading at various points - for example, 'if the child is stillborn, the baptism must be carried out by the older sister or the Catholic nurse.'

reference_spacy_tokens: The text is misleading at various points - for example , ' if the child is stillborn , the baptism must be carried out by the older sister or the Catholic nurse . '


fn_spacy_tokens_for_baseline: Older people were much more impressed by politicians ' energy than were younger people .

source_bert_toks: older people were much more impressed by politicians ' energy than were younger people .

reference_raw: The older people were more impressed with the power of politicians than with the younger ones.

reference_spacy_tokens: The older people were more impressed with the power of politicians than with the younger ones .


fn_spacy_tokens_for_baseline: Asik became angry as he thought of all the people in his village who could have been saved by the fruit in the lorry which had just passed him , throwing up bucketfuls of dust into his face .

source_bert_toks: as ##ik became angry as he thought of all the people in his village who could have been saved by the fruit in the lo ##rry which had just passed him , throwing up bucket ##ful ##s of dust into his face .

reference_raw: Asik was angry, thinking of all the people in his village who might have been rescued by the fruit of the truck that had just passed him, and throwing buckets of dust in his face.

reference_spacy_tokens: Asik was angry , thinking of all the people in his village who might have been rescued by the fruit of the truck that had just passed him , and throwing buckets of dust in his face .


fn_spacy_tokens_for_baseline: Switching to the smaller barriers in 1987 has proved child 's play for the sweetheart from Chigwell ever since .

source_bert_toks: switching to the smaller barriers in 1987 has proved child ' s play for the sweetheart from chi ##g ##well ever since .

reference_raw: Since then, the transition to smaller barriers in 1987 has proven to be a kid's game for Chigwell's sweetheart.

reference_spacy_tokens: Since then , the transition to smaller barriers in 1987 has proven to be a kid 's game for Chigwell 's sweetheart .


fn_spacy_tokens_for_baseline: All dishes are served with a choice of garlic bread , jacket potato , new potatoes or french fries .

source_bert_toks: all dishes are served with a choice of garlic bread , jacket potato , new potatoes or french fries .

reference_raw: All meals are served with a selection of garlic sandwiches, jacket potatoes, fresh potatoes or French fries.

reference_spacy_tokens: All meals are served with a selection of garlic sandwiches , jacket potatoes , fresh potatoes or French fries .


fn_spacy_tokens_for_baseline: Here are some sample questions and answers ; as you can see , they do n't know much , and lack the mental equipment for intuitive or imaginative leaps .

source_bert_toks: here are some sample questions and answers ; as you can see , they don ' t know much , and lack the mental equipment for intuitive or imaginative leaps .

reference_raw: Here's a few sample questions and answers; as you can see, they don't know much, and they don't have the mental gear for intuitive or imaginational leaps.

reference_spacy_tokens: Here 's a few sample questions and answers ; as you can see , they do n't know much , and they do n't have the mental gear for intuitive or imaginational leaps .


fn_spacy_tokens_for_baseline: The company consists of a home brewed pack of writer / performers , and their unique blend of poignant humour with mad zane .

source_bert_toks: the company consists of a home brew ##ed pack of writer / performers , and their unique blend of po ##ignant humour with mad zane .

reference_raw: The company consists of a homemade package of writers/performers and their unique mixture of poignant humor and mad zane.

reference_spacy_tokens: The company consists of a homemade package of writers / performers and their unique mixture of poignant humor and mad zane .


fn_spacy_tokens_for_baseline: What happened to it then would depend on the prevailing attraction of reprocessing at Sellafield , especially the cost .

source_bert_toks: what happened to it then would depend on the prevailing attraction of rep ##ro ##ces ##sing at sell ##af ##ield , especially the cost .

reference_raw: What happened to him would then depend on the predominant attractiveness of processing in Sellafield, in particular the price.

reference_spacy_tokens: What happened to him would then depend on the predominant attractiveness of processing in Sellafield , in particular the price .


fn_spacy_tokens_for_baseline: Remove the foil and cook for a further 50 to 10 min , until the cheese has melted and the trout is cooked .

source_bert_toks: remove the foil and cook for a further 50 to 10 min , until the cheese has melted and the trout is cooked .

reference_raw: Remove the foil and cook for another 50 to 10 minutes until the cheese is dissolved and the trout is cooked.

reference_spacy_tokens: Remove the foil and cook for another 50 to 10 minutes until the cheese is dissolved and the trout is cooked .


fn_spacy_tokens_for_baseline: Yeah we 've got a bag of potatoes .

source_bert_toks: yeah we ' ve got a bag of potatoes .

reference_raw: Yes, we have a sack of potatoes.

reference_spacy_tokens: Yes , we have a sack of potatoes .


fn_spacy_tokens_for_baseline: The linked subjects of ethology and sociobiology are cases in point .

source_bert_toks: the linked subjects of et ##hol ##ogy and socio ##biology are cases in point .

reference_raw: The related themes of ethology and sociobiology are the cases in point.

reference_spacy_tokens: The related themes of ethology and sociobiology are the cases in point .


fn_spacy_tokens_for_baseline: One evening , perched in his landing window , he shot towards my wife with an air rifle and I reported him to the police .

source_bert_toks: one evening , perched in his landing window , he shot towards my wife with an air rifle and i reported him to the police .

reference_raw: One night, sitting in the landing window, he fired a gun at my wife, and I reported him to the police.

reference_spacy_tokens: One night , sitting in the landing window , he fired a gun at my wife , and I reported him to the police .


fn_spacy_tokens_for_baseline: Streamline Graded Readers encourage students in their language learning and help them to gain confidence in their ability .

source_bert_toks: stream ##line graded readers encourage students in their language learning and help them to gain confidence in their ability .

reference_raw: Streamline Graded readers encourage students to learn their language and help them gain trust in their abilities.

reference_spacy_tokens: Streamline Graded readers encourage students to learn their language and help them gain trust in their abilities .


fn_spacy_tokens_for_baseline: In fact , the only men in the Chamber who seemed entirely sober were the Prime Minister and Halifax , his Foreign Secretary .

source_bert_toks: in fact , the only men in the chamber who seemed entirely sober were the prime minister and halifax , his foreign secretary .

reference_raw: As a matter of fact, the only men in the chamber who seemed to be completely sobriety were the Prime Minister and Halifax, his Secretary of State.

reference_spacy_tokens: As a matter of fact , the only men in the chamber who seemed to be completely sobriety were the Prime Minister and Halifax , his Secretary of State .


fn_spacy_tokens_for_baseline: She did n't seem at all bothered that Gloria and Dot would have to go trudging off to another hospital somewhere else to find him .

source_bert_toks: she didn ' t seem at all bothered that gloria and dot would have to go tr ##ud ##ging off to another hospital somewhere else to find him .

reference_raw: She didn't seem to mind that Gloria and Dot would have to wander off to another hospital to find him.

reference_spacy_tokens: She did n't seem to mind that Gloria and Dot would have to wander off to another hospital to find him .


fn_spacy_tokens_for_baseline: Under the surface of an everyday conversation a duel of two astute minds was taking place .

source_bert_toks: under the surface of an everyday conversation a duel of two as ##tute minds was taking place .

reference_raw: There was a fight under the surface of the daily conversation between two keen minds.

reference_spacy_tokens: There was a fight under the surface of the daily conversation between two keen minds .


fn_spacy_tokens_for_baseline: When the mistake was discovered , they tried to put all the blame onto the innocent parties -- the importers and the farmers -- who have been landed with these cattle .

source_bert_toks: when the mistake was discovered , they tried to put all the blame onto the innocent parties - - the import ##ers and the farmers - - who have been landed with these cattle .

reference_raw: When the mistake was discovered, they tried to implicate innocent parties - importers and farmers - who had landed with these cattle.

reference_spacy_tokens: When the mistake was discovered , they tried to implicate innocent parties - importers and farmers - who had landed with these cattle .


fn_spacy_tokens_for_baseline: Hong Kong has two major racetracks as well as an intensive off - track betting system , and on weekends the ferries to Macau are crowded with people on their way to the casinos .

source_bert_toks: hong kong has two major racetrack ##s as well as an intensive off - track betting system , and on weekends the ferries to macau are crowded with people on their way to the casinos .

reference_raw: Hong Kong has two main racetracks and a high-speed off-track betting system, and on weekends the ferries to Macau are full of people on their way to the casinos.

reference_spacy_tokens: Hong Kong has two main racetracks and a high - speed off - track betting system , and on weekends the ferries to Macau are full of people on their way to the casinos .


fn_spacy_tokens_for_baseline: Gozitan legend says that a giantess built the temples single - handed , suckling her baby at the same time .

source_bert_toks: go ##zi ##tan legend says that a giant ##ess built the temples single - handed , suck ##ling her baby at the same time .

reference_raw: According to Gozitan legend, the giantess built the temples with one hand and breast-feeded her child at the same time.

reference_spacy_tokens: According to Gozitan legend , the giantess built the temples with one hand and breast - feeded her child at the same time .


fn_spacy_tokens_for_baseline: The hum of conversation in the lounge sounded restrained as Lee approached the door .

source_bert_toks: the hum of conversation in the lounge sounded restrained as lee approached the door .

reference_raw: When Lee came to the door, the buzz of conversation in the living room sounded restrained.

reference_spacy_tokens: When Lee came to the door , the buzz of conversation in the living room sounded restrained .


fn_spacy_tokens_for_baseline: Some pictures were taken by a nameless photographer .

source_bert_toks: some pictures were taken by a name ##less photographer .

reference_raw: Some photos were taken by an unnamed photographer.

reference_spacy_tokens: Some photos were taken by an unnamed photographer .


fn_spacy_tokens_for_baseline: For instance , it 's the custom to beat the wife .

source_bert_toks: for instance , it ' s the custom to beat the wife .

reference_raw: It's a habit, for example, to defeat a woman.

reference_spacy_tokens: It 's a habit , for example , to defeat a woman .


fn_spacy_tokens_for_baseline: One American died in the bomb blasts in Kampala at a rugby club and an Ethiopian restaurant , locations where people had gathered to watch the soccer World Cup final .

source_bert_toks: one american died in the bomb blasts in kam ##pala at a rugby club and an ethiopian restaurant , locations where people had gathered to watch the soccer world cup final .

reference_raw: One American died in a Kampala bombing at a rugby club and an Ethiopian restaurant where people gathered to watch the finals of the World Cup.

reference_spacy_tokens: One American died in a Kampala bombing at a rugby club and an Ethiopian restaurant where people gathered to watch the finals of the World Cup .


fn_spacy_tokens_for_baseline: With press - ups you lie on your stomach on the floor and , keeping your back straight , you push your body upwards so that your arms are straight and your body is supported on your toes and hands .

source_bert_toks: with press - ups you lie on your stomach on the floor and , keeping your back straight , you push your body upwards so that your arms are straight and your body is supported on your toes and hands .

reference_raw: With push-ups, you lie on the floor on your stomach and, while holding your back straight, push your body up so that your arms are straight and your body is supported by your fingers and hands.

reference_spacy_tokens: With push - ups , you lie on the floor on your stomach and , while holding your back straight , push your body up so that your arms are straight and your body is supported by your fingers and hands .


fn_spacy_tokens_for_baseline: 1- Choosing mountainous locations , preferably 1 - 3 hours from main cities , which have water resources .

source_bert_toks: 1 - choosing mountainous locations , prefer ##ably 1 - 3 hours from main cities , which have water resources .

reference_raw: 1- Choosing mountain sites, preferably 1-3 hours from major cities with water resources.

reference_spacy_tokens: 1- Choosing mountain sites , preferably 1 - 3 hours from major cities with water resources .


fn_spacy_tokens_for_baseline: After being ignored by streams of tight - lipped Brits , the Goldsmiths graduate finally amassed almost 400 portraits , a selection of which are on display at the Marconi Gallery in Milan this month .

source_bert_toks: after being ignored by streams of tight - lip ##ped brit ##s , the goldsmith ##s graduate finally amassed almost 400 portraits , a selection of which are on display at the marco ##ni gallery in milan this month .

reference_raw: After being ignored by the streams of tight-lipped Brits, the Goldsmiths finally assembled nearly 400 portraits, a selection of which will be displayed this month at the Marconi Gallery in Milan.

reference_spacy_tokens: After being ignored by the streams of tight - lipped Brits , the Goldsmiths finally assembled nearly 400 portraits , a selection of which will be displayed this month at the Marconi Gallery in Milan .


fn_spacy_tokens_for_baseline: The Pentagon 's summary said an enemy ambush had triggered an intense , 20-minute firefight .

source_bert_toks: the pentagon ' s summary said an enemy ambush had triggered an intense , 20 - minute fire ##fight .

reference_raw: According to the Pentagon summary, an enemy attack triggered an intense, 20-minute firefight.

reference_spacy_tokens: According to the Pentagon summary , an enemy attack triggered an intense , 20-minute firefight .


fn_spacy_tokens_for_baseline: However , Aetna 's employee benefits division , which includes its group health insurance operations , posted a 34 % profit gain to $ 106 million .

source_bert_toks: however , ae ##t ##na ' s employee benefits division , which includes its group health insurance operations , posted a 34 % profit gain to $ 106 million .

reference_raw: However, the employee benefit division of Aetna, including its group health insurance activities, posted a profit of 34% to $106 million.

reference_spacy_tokens: However , the employee benefit division of Aetna , including its group health insurance activities , posted a profit of 34 % to $ 106 million .


fn_spacy_tokens_for_baseline: VETERAN ravers Macca and Garry Glitter are caught rehearsing their new karaoke double - act .

source_bert_toks: veteran rave ##rs mac ##ca and garry glitter are caught re ##hear ##sing their new kara ##oke double - act .

reference_raw: Veteran ravers Macca and Gary Glitter are caught practicing their new karaoke double act.

reference_spacy_tokens: Veteran ravers Macca and Gary Glitter are caught practicing their new karaoke double act .


fn_spacy_tokens_for_baseline: The male is able to detect this sound with an eardrum at the base of his antennae , which vibrate in sympathy with this one frequency , and so fly towards her .

source_bert_toks: the male is able to detect this sound with an ear ##drum at the base of his antennae , which vi ##brate in sympathy with this one frequency , and so fly towards her .

reference_raw: The male can pick up the sound with an eardrum at the base of his antennae, vibrating in sympathy with this one frequency, and so he's flying toward it.

reference_spacy_tokens: The male can pick up the sound with an eardrum at the base of his antennae , vibrating in sympathy with this one frequency , and so he 's flying toward it .


fn_spacy_tokens_for_baseline: But the clear intelligence failure which let Gen Noriega escape , to organise what could prove to be a prolonged guerrilla resistance , threatens to turn this latest military adventure into a political embarrassment .

source_bert_toks: but the clear intelligence failure which let gen nor ##ieg ##a escape , to organise what could prove to be a prolonged guerrilla resistance , threatens to turn this latest military adventure into a political embarrassment .

reference_raw: But the obvious intelligence failure that allowed Gen Noriega to escape and organize what might turn out to be a long-term guerrilla resistance threatens to turn this latest military adventure into a political embarrassment.

reference_spacy_tokens: But the obvious intelligence failure that allowed Gen Noriega to escape and organize what might turn out to be a long - term guerrilla resistance threatens to turn this latest military adventure into a political embarrassment .


fn_spacy_tokens_for_baseline: In contrast , when the target is a word , both letter and word detectors will be activated .

source_bert_toks: in contrast , when the target is a word , both letter and word detectors will be activated .

reference_raw: On the other hand, if the target is a word, both the letter detectors and the word detectors become active.

reference_spacy_tokens: On the other hand , if the target is a word , both the letter detectors and the word detectors become active .


fn_spacy_tokens_for_baseline: Hitler 's Germany taught solely as a series of brutal persecutions and bloody deeds soon galls .

source_bert_toks: hitler ' s germany taught solely as a series of brutal persecution ##s and bloody deeds soon gall ##s .

reference_raw: Hitler's Germany was taught only as a series of brutal persecutions and bloody deeds.

reference_spacy_tokens: Hitler 's Germany was taught only as a series of brutal persecutions and bloody deeds .


fn_spacy_tokens_for_baseline: Mr Blakey seized the dogs by their collars .

source_bert_toks: mr blake ##y seized the dogs by their collar ##s .

reference_raw: Mr. Blakey grabbed the dogs by the collars.

reference_spacy_tokens: Mr. Blakey grabbed the dogs by the collars .


fn_spacy_tokens_for_baseline: The original chapel collapsed and was rebuilt in 1863 - 4 .

source_bert_toks: the original chapel collapsed and was rebuilt in 1863 - 4 .

reference_raw: The original church collapsed and was rebuilt in 1863-4.

reference_spacy_tokens: The original church collapsed and was rebuilt in 1863 - 4 .


fn_spacy_tokens_for_baseline: Trophoblast cells derived from normal placentae differentiated into large syncytial clusters in the presence of PhR without E2 supplementation .

source_bert_toks: tr ##op ##ho ##bla ##st cells derived from normal place ##nta ##e differentiated into large sync ##yt ##ial clusters in the presence of ph ##r without e ##2 supplement ##ation .

reference_raw: Trophoblast cells derived from regular placentae have been distinguished by large syncytial clusters in the presence of PHR without E2 supplementation.

reference_spacy_tokens: Trophoblast cells derived from regular placentae have been distinguished by large syncytial clusters in the presence of PHR without E2 supplementation .


fn_spacy_tokens_for_baseline: It 's a bit stupid to have all these doors open you know ?

source_bert_toks: it ' s a bit stupid to have all these doors open you know ?

reference_raw: It's a little silly having all these doors open, you know?

reference_spacy_tokens: It 's a little silly having all these doors open , you know ?


fn_spacy_tokens_for_baseline: Her brothers and sisters , sisters - in - law , all the clan dodged the ricocheting missiles , clustered in the corners , watched with appalled glee .

source_bert_toks: her brothers and sisters , sisters - in - law , all the clan dodged the rico ##chet ##ing missiles , clustered in the corners , watched with appalled glee .

reference_raw: Her brothers and sisters, sisters-in-law, all clans avoided the ricocheting rockets, clustered around the corners, watching with appalled joy.

reference_spacy_tokens: Her brothers and sisters , sisters - in - law , all clans avoided the ricocheting rockets , clustered around the corners , watching with appalled joy .


fn_spacy_tokens_for_baseline: Union Pacific then consolidated its operations , eliminating the Las Vegas repair facility .

source_bert_toks: union pacific then consolidated its operations , eliminating the las vegas repair facility .

reference_raw: Union Pacific subsequently consolidated its operations and eliminated the Las Vegas Repair Facility.

reference_spacy_tokens: Union Pacific subsequently consolidated its operations and eliminated the Las Vegas Repair Facility .


fn_spacy_tokens_for_baseline: In normal circumstances the suggestion that a contracting party can rely on his own breach to establish consideration is distinctly unattractive .

source_bert_toks: in normal circumstances the suggestion that a contracting party can rely on his own breach to establish consideration is distinctly una ##tt ##ractive .

reference_raw: In normal circumstances, the proposal that a contracting party may rely on its own infringement in order to demonstrate consideration is clearly unattractive.

reference_spacy_tokens: In normal circumstances , the proposal that a contracting party may rely on its own infringement in order to demonstrate consideration is clearly unattractive .


fn_spacy_tokens_for_baseline: There is minimal danger of everybody being dragged in if one person falls into a crevasse , and sophisticated rescue methods can be substituted by sheer manpower on the surface .

source_bert_toks: there is minimal danger of everybody being dragged in if one person falls into a cr ##eva ##sse , and sophisticated rescue methods can be substituted by sheer manpower on the surface .

reference_raw: There's a minimal risk that everyone will be dragged in if one person falls into a crack, and sophisticated life-saving methods can be replaced by pure manpower on the surface.

reference_spacy_tokens: There 's a minimal risk that everyone will be dragged in if one person falls into a crack , and sophisticated life - saving methods can be replaced by pure manpower on the surface .


fn_spacy_tokens_for_baseline: He did n't dare switch his light back on , and he banged into some shelves in the darkness .

source_bert_toks: he didn ' t dare switch his light back on , and he banged into some shelves in the darkness .

reference_raw: Not daring to turn on the light again, he slammed into some of the shelves in the dark.

reference_spacy_tokens: Not daring to turn on the light again , he slammed into some of the shelves in the dark .


fn_spacy_tokens_for_baseline: The new Libyan leadership , supported by Western intelligence agencies , has mounted a manhunt for Kadafi that is focusing on the vast Sahara desert regions near Libya 's borders with Niger and Algeria .

source_bert_toks: the new libyan leadership , supported by western intelligence agencies , has mounted a man ##hun ##t for ka ##da ##fi that is focusing on the vast sahara desert regions near libya ' s borders with niger and algeria .

reference_raw: The new Libyan leadership, supported by Western intelligence agencies, has launched a search for Kadafi, focusing on the vast Sahara desert areas near the Libyan border with Niger and Algeria.

reference_spacy_tokens: The new Libyan leadership , supported by Western intelligence agencies , has launched a search for Kadafi , focusing on the vast Sahara desert areas near the Libyan border with Niger and Algeria .


fn_spacy_tokens_for_baseline: If supplies are not reaching the people who need them , Hall said , he wanted to find out whether the United Nations or relief agencies needed to handle things differently , or whether " Iraq needs to get out of the way and let us do the job . "

source_bert_toks: if supplies are not reaching the people who need them , hall said , he wanted to find out whether the united nations or relief agencies needed to handle things differently , or whether " iraq needs to get out of the way and let us do the job . "

reference_raw: If the supplies don't reach the people who want them, Hall said, he wants to know if the UN or relief agencies have to deal with things differently, or if "Iraq has to stay out of the way and let us do our job."

reference_spacy_tokens: If the supplies do n't reach the people who want them , Hall said , he wants to know if the UN or relief agencies have to deal with things differently , or if " Iraq has to stay out of the way and let us do our job . "


fn_spacy_tokens_for_baseline: But the soldiers did not go to the top of Dona Marta , where the drug lords and their henchmen are known to stockpile most of their weapons and drugs .

source_bert_toks: but the soldiers did not go to the top of dona marta , where the drug lords and their hen ##ch ##men are known to stock ##pile most of their weapons and drugs .

reference_raw: But the soldiers did not go to the top of Dona Marta, where drug lords and their minions were known to store most of their weapons and drugs.

reference_spacy_tokens: But the soldiers did not go to the top of Dona Marta , where drug lords and their minions were known to store most of their weapons and drugs .


fn_spacy_tokens_for_baseline: standing terrified by the door , I saw an officer lean forward on his horse and hit a neighbour with his truncheon above the eyes , heard the blow like the thump of wood on a swede turnip .

source_bert_toks: standing terrified by the door , i saw an officer lean forward on his horse and hit a neighbour with his tr ##un ##cheon above the eyes , heard the blow like the thump of wood on a sw ##ede turn ##ip .

reference_raw: Standing in the doorway, startled, I saw the officer lean forward on his horse and hit the neighbor with a club above his eyes, heard the sound of a blow like a hammering of wood on a swede turnip.

reference_spacy_tokens: Standing in the doorway , startled , I saw the officer lean forward on his horse and hit the neighbor with a club above his eyes , heard the sound of a blow like a hammering of wood on a swede turnip .


fn_spacy_tokens_for_baseline: In the aftermath of its losses in the Six Day War , Syria felt that it needed broader support from the international community to guard against Israeli acts of aggression .

source_bert_toks: in the aftermath of its losses in the six day war , syria felt that it needed broader support from the international community to guard against israeli acts of aggression .

reference_raw: Following its losses during the Six-Day War, Syria considered that it needed wider support from the international community to protect against Israeli aggression.

reference_spacy_tokens: Following its losses during the Six - Day War , Syria considered that it needed wider support from the international community to protect against Israeli aggression .


fn_spacy_tokens_for_baseline: His casket , carried from the Cathedral on the shoulders of infantrymen , was covered by a Maori cloak , on which was placed a sword and a soldier 's ' lemon - squeezer ' hat .

source_bert_toks: his casket , carried from the cathedral on the shoulders of infantry ##men , was covered by a maori cloak , on which was placed a sword and a soldier ' s ' lemon - squeeze ##r ' hat .

reference_raw: His coffin, worn from the cathedral on the shoulders of the infantrymen, was covered with a Maori cloak with a sword and a soldier's 'lemon-squeezer' hat.

reference_spacy_tokens: His coffin , worn from the cathedral on the shoulders of the infantrymen , was covered with a Maori cloak with a sword and a soldier 's ' lemon - squeezer ' hat .


fn_spacy_tokens_for_baseline: Approximately 140 persons , including fire - fighters from several fire departments , and personnel from the Civil Defence and the Home Guard are working to curtail the fire .

source_bert_toks: approximately 140 persons , including fire - fighters from several fire departments , and personnel from the civil defence and the home guard are working to curt ##ail the fire .

reference_raw: Around 140 people are working to reduce the fire, among them firefighters from several fire departments and civil protection and the Home Guard staff.

reference_spacy_tokens: Around 140 people are working to reduce the fire , among them firefighters from several fire departments and civil protection and the Home Guard staff .


fn_spacy_tokens_for_baseline: Between 1970 and 1984 , Latin America 's foreign debt mushroomed from $ 21 billion to $ 360 billion , the bulk of it owed to Western banks .

source_bert_toks: between 1970 and 1984 , latin america ' s foreign debt mushroom ##ed from $ 21 billion to $ 360 billion , the bulk of it owed to western banks .

reference_raw: Between 1970 and 1984, Latin America's foreign debt sped from $21 billion to $360 billion, most of which was owed to Western banks.

reference_spacy_tokens: Between 1970 and 1984 , Latin America 's foreign debt sped from $ 21 billion to $ 360 billion , most of which was owed to Western banks .


fn_spacy_tokens_for_baseline: Edward still prevaricated , but at the Parliament of March 1299 the magnates extorted further concessions by the threat of armed force .

source_bert_toks: edward still pre ##var ##icated , but at the parliament of march 129 ##9 the magnate ##s ex ##tort ##ed further concessions by the threat of armed force .

reference_raw: Edward was still prevaricating, but in the parliament of March 1299, the magnates were blackmailing other compromises with the threat of armed forces.

reference_spacy_tokens: Edward was still prevaricating , but in the parliament of March 1299 , the magnates were blackmailing other compromises with the threat of armed forces .


fn_spacy_tokens_for_baseline: Standing at the depot at Main and Fremont streets , railroad officials auctioned 1200 lots they had subdivided from forty square blocks of desert scrub .

source_bert_toks: standing at the depot at main and fremont streets , railroad officials auction ##ed 1200 lots they had subdivided from forty square blocks of desert scrub .

reference_raw: Standing in a warehouse on the streets of Main and Fremont, the railroad clerks auctioned 1,200 lots, divided from forty square blocks of desert scrub.

reference_spacy_tokens: Standing in a warehouse on the streets of Main and Fremont , the railroad clerks auctioned 1,200 lots , divided from forty square blocks of desert scrub .


fn_spacy_tokens_for_baseline: I got a nice letter back .

source_bert_toks: i got a nice letter back .

reference_raw: I've received a lovely letter.

reference_spacy_tokens: I 've received a lovely letter .


fn_spacy_tokens_for_baseline: Her ears stung with the booming echo of the shot .

source_bert_toks: her ears stung with the booming echo of the shot .

reference_raw: The booming echo of the gunshot echoed in her ears.

reference_spacy_tokens: The booming echo of the gunshot echoed in her ears .


fn_spacy_tokens_for_baseline: Windmills and tidal barrages ( and perhaps wave power ) are regarded as having promise even if the former do spoil landscapes and the latter ruin the mudflats on which ducks and wading birds feed .

source_bert_toks: windmill ##s and tidal barrage ##s ( and perhaps wave power ) are regarded as having promise even if the former do spoil landscapes and the latter ruin the mud ##fl ##ats on which ducks and wadi ##ng birds feed .

reference_raw: Windmills and tidal barrages (and possibly wave power) are considered to be promising, even if the first destroys the landscape and the second destroys the mud flats on which ducks and wading birds feed.

reference_spacy_tokens: Windmills and tidal barrages ( and possibly wave power ) are considered to be promising , even if the first destroys the landscape and the second destroys the mud flats on which ducks and wading birds feed .


fn_spacy_tokens_for_baseline: But there were important differences between America and Russia in the Middle East and other areas of the Third World in 1970 , the year in which Brandt signed non - aggression treaties with the USSR and Poland .

source_bert_toks: but there were important differences between america and russia in the middle east and other areas of the third world in 1970 , the year in which brandt signed non - aggression treaties with the ussr and poland .

reference_raw: However, in 1970, when Brandt signed non-aggression agreements with the USSR and Poland, there were significant differences between America and Russia in the Middle East and other parts of the Third World.

reference_spacy_tokens: However , in 1970 , when Brandt signed non - aggression agreements with the USSR and Poland , there were significant differences between America and Russia in the Middle East and other parts of the Third World .


fn_spacy_tokens_for_baseline: Communication will have failed if the listener does not discover which platform the train leaves from or how to load the program into the computer .

source_bert_toks: communication will have failed if the listener does not discover which platform the train leaves from or how to load the program into the computer .

reference_raw: Communication will fail if the listener does not find out which platform the train is leaving or how to download the program into the computer.

reference_spacy_tokens: Communication will fail if the listener does not find out which platform the train is leaving or how to download the program into the computer .


fn_spacy_tokens_for_baseline: Nor does it rely principally on my experience in classrooms , though I have been , briefly , a secondary schoolteacher and have been visiting schools and working with young people in a variety of ways on and off for the last sixteen years .

source_bert_toks: nor does it rely principally on my experience in classrooms , though i have been , briefly , a secondary school ##teacher and have been visiting schools and working with young people in a variety of ways on and off for the last sixteen years .

reference_raw: Nor does it rely primarily on my experience in classrooms, although I have been a secondary teacher for a short period of time and have been visiting schools and working with young people in various ways over the past sixteen years.

reference_spacy_tokens: Nor does it rely primarily on my experience in classrooms , although I have been a secondary teacher for a short period of time and have been visiting schools and working with young people in various ways over the past sixteen years .


fn_spacy_tokens_for_baseline: The same tenacious vanity which enabled him to survive the next nine years of penury wrecked his chances of succeeding as a writer .

source_bert_toks: the same ten ##acious vanity which enabled him to survive the next nine years of pen ##ury wrecked his chances of succeeding as a writer .

reference_raw: The same tenacious vanity that had allowed him to survive the next nine years of penury had ruined his chances of success as a writer.

reference_spacy_tokens: The same tenacious vanity that had allowed him to survive the next nine years of penury had ruined his chances of success as a writer .


fn_spacy_tokens_for_baseline: His ridicule was such that Tindle destroyed the painting there and then .

source_bert_toks: his rid ##ic ##ule was such that tin ##dle destroyed the painting there and then .

reference_raw: His mockery was such that Tindle destroyed the painting here and there.

reference_spacy_tokens: His mockery was such that Tindle destroyed the painting here and there .


fn_spacy_tokens_for_baseline: ' You 're maddening me are n't you Aggie ?

source_bert_toks: ' you ' re madden ##ing me aren ' t you ag ##gie ?

reference_raw: 'You're mad at me, aren't you, Aggie?

reference_spacy_tokens: ' You 're mad at me , are n't you , Aggie ?


fn_spacy_tokens_for_baseline: I can hate , just as other designers can do , but there is also the question of education ; to be mean to people who can not answer you back .

source_bert_toks: i can hate , just as other designers can do , but there is also the question of education ; to be mean to people who can not answer you back .

reference_raw: I can hate you as much as other designers can, but there's also a question of education, being rude to people who can't answer you back.

reference_spacy_tokens: I can hate you as much as other designers can , but there 's also a question of education , being rude to people who ca n't answer you back .


fn_spacy_tokens_for_baseline: The assessment of oral skills is considered as important as the assessment of other skills

source_bert_toks: the assessment of oral skills is considered as important as the assessment of other skills

reference_raw: Evaluation of oral skills is considered as important as evaluation of other skills


fn_spacy_tokens_for_baseline: Many of those anomalies were identified by my colleagues at the very outset of the poll tax escapade .

source_bert_toks: many of those an ##oma ##lies were identified by my colleagues at the very outset of the poll tax es ##cap ##ade .

reference_raw: Many of these anomalies were detected by my colleagues at the very beginning of the tax escapade.

reference_spacy_tokens: Many of these anomalies were detected by my colleagues at the very beginning of the tax escapade .


fn_spacy_tokens_for_baseline: In addition , it can be exercised where , during antecedent negotiations , there were oral representations made irrespective of whether they were concluded on or off business premises ( s67 ) .

source_bert_toks: in addition , it can be exercised where , during ant ##ece ##dent negotiations , there were oral representations made ir ##res ##pe ##ctive of whether they were concluded on or off business premises ( s ##6 ##7 ) .

reference_raw: It may also be used if, in the course of the preliminary negotiations, oral representations were made, irrespective of whether they were concluded at or outside the premises of the undertaking (s67).

reference_spacy_tokens: It may also be used if , in the course of the preliminary negotiations , oral representations were made , irrespective of whether they were concluded at or outside the premises of the undertaking ( s67 ) .


fn_spacy_tokens_for_baseline: Experts advise that sunscreens should be reapplied on a hourly basis ( a dollop of cream about the size of a grape is a good guideline for your face ) .

source_bert_toks: experts advise that suns ##creen ##s should be re ##app ##lie ##d on a hourly basis ( a doll ##op of cream about the size of a grape is a good guide ##line for your face ) .

reference_raw: Experts recommend that sunscreens should be used every hour (a dollop of cream the size of a grape is a good guide for your face).

reference_spacy_tokens: Experts recommend that sunscreens should be used every hour ( a dollop of cream the size of a grape is a good guide for your face ) .


fn_spacy_tokens_for_baseline: At invisible signals they dropped into trees , then rose again to stream upwards , circle , and resettle .

source_bert_toks: at invisible signals they dropped into trees , then rose again to stream upwards , circle , and reset ##tle .

reference_raw: They dropped into the trees at invisible signals, then rose again and flowed up, circled, and resettled.

reference_spacy_tokens: They dropped into the trees at invisible signals , then rose again and flowed up , circled , and resettled .


fn_spacy_tokens_for_baseline: Hawke 's visit to the United Kingdom on June 20 - 23 was aimed at reinvigorating relations between the UK and Australia , both leading members of the Commonwealth with strong historical ties .

source_bert_toks: hawke ' s visit to the united kingdom on june 20 - 23 was aimed at rein ##vi ##gor ##ating relations between the uk and australia , both leading members of the commonwealth with strong historical ties .

reference_raw: The purpose of Hawke's visit to the United Kingdom on June 20-23 was to restore relations between the United Kingdom and Australia, both leading members of the Community with strong historical ties.

reference_spacy_tokens: The purpose of Hawke 's visit to the United Kingdom on June 20 - 23 was to restore relations between the United Kingdom and Australia , both leading members of the Community with strong historical ties .


fn_spacy_tokens_for_baseline: He put on his raincoat and hat , opened the case and found the steel - rimmed spectacles which he carried in there for safety .

source_bert_toks: he put on his rain ##coat and hat , opened the case and found the steel - rim ##med spectacle ##s which he carried in there for safety .

reference_raw: He put on his cape and hat, opened his briefcase, and found the steel-rimmed glasses he was wearing for safety.

reference_spacy_tokens: He put on his cape and hat , opened his briefcase , and found the steel - rimmed glasses he was wearing for safety .


fn_spacy_tokens_for_baseline: But then the man wanted to try some town driving . he pulled over on Brantwood Rise , got the gun from his briefcase , and escaped with the vehicle , worth twenty seven thousand pounds .

source_bert_toks: but then the man wanted to try some town driving . he pulled over on brant ##wood rise , got the gun from his briefcase , and escaped with the vehicle , worth twenty seven thousand pounds .

reference_raw: But then the man wanted to try to drive a city . . . he stopped at Brantwood Rise, took the gun out of his briefcase, and ran away with a car worth twenty-seven thousand pounds.

reference_spacy_tokens: But then the man wanted to try to drive a city . . . he stopped at Brantwood Rise , took the gun out of his briefcase , and ran away with a car worth twenty - seven thousand pounds .


fn_spacy_tokens_for_baseline: The storms that threatened to pluck him from the summit where he stood barely rippled the grey waters of the lakes that were strung like pearls along the centre of the grassland far below .

source_bert_toks: the storms that threatened to pl ##uck him from the summit where he stood barely rippled the grey waters of the lakes that were strung like pearls along the centre of the grassland far below .

reference_raw: The storms that threatened to pluck him from the top, where he stood, barely rippled the gray waters of the pools, which lay like pearls in the middle of the grassland far below.

reference_spacy_tokens: The storms that threatened to pluck him from the top , where he stood , barely rippled the gray waters of the pools , which lay like pearls in the middle of the grassland far below .


fn_spacy_tokens_for_baseline: At about this time Peter Barlow was promoting the idea of a network of underground railways as the solution to London 's street - traffic problems .

source_bert_toks: at about this time peter barlow was promoting the idea of a network of underground railways as the solution to london ' s street - traffic problems .

reference_raw: By this time, Peter Barlow had been promoting the idea of a network of underground railroads as a solution to London's street traffic problems.

reference_spacy_tokens: By this time , Peter Barlow had been promoting the idea of a network of underground railroads as a solution to London 's street traffic problems .


fn_spacy_tokens_for_baseline: Friends have been devastated by the shooting .

source_bert_toks: friends have been devastated by the shooting .

reference_raw: Friends were destroyed by the shooting.

reference_spacy_tokens: Friends were destroyed by the shooting .


fn_spacy_tokens_for_baseline: Watch the fantan dealer for a few minutes and you 'll almost be an expert : It 's simply a matter of how many odd buttons are left after he has divided a pile of them into groups of four .

source_bert_toks: watch the fan ##tan dealer for a few minutes and you ' ll almost be an expert : it ' s simply a matter of how many odd buttons are left after he has divided a pile of them into groups of four .

reference_raw: Keep an eye on the fantan dealer for a few minutes, and you're almost a specialist: it's just a matter of how many strange buttons are left after he's divided a bunch of them into groups of four.

reference_spacy_tokens: Keep an eye on the fantan dealer for a few minutes , and you 're almost a specialist : it 's just a matter of how many strange buttons are left after he 's divided a bunch of them into groups of four .


fn_spacy_tokens_for_baseline: At that moment there sounded the unmistakable click of the key turning in the front door .

source_bert_toks: at that moment there sounded the unmistakable click of the key turning in the front door .

reference_raw: At that moment there was the unmistakable snap of a key that turned in the front door.

reference_spacy_tokens: At that moment there was the unmistakable snap of a key that turned in the front door .


fn_spacy_tokens_for_baseline: The palm groves were full of brick kilns and trails of black smoke snaked between the trees .

source_bert_toks: the palm groves were full of brick ki ##ln ##s and trails of black smoke snake ##d between the trees .

reference_raw: The palm groves were filled with brick furnaces and black smoke trailed through the trees.

reference_spacy_tokens: The palm groves were filled with brick furnaces and black smoke trailed through the trees .


fn_spacy_tokens_for_baseline: Marcel Poirier , whose fleet of taxis constantly crisscrosses Paris , saw no impact .

source_bert_toks: marcel po ##iri ##er , whose fleet of taxis constantly cr ##iss ##cross ##es paris , saw no impact .

reference_raw: Marcel Poirier, whose fleet of taxis crosses Paris all the time, saw no impact.

reference_spacy_tokens: Marcel Poirier , whose fleet of taxis crosses Paris all the time , saw no impact .


fn_spacy_tokens_for_baseline: So , if you were to create tens of thousands of ready - mades per year , that would become extremely monotonous and irritating .

source_bert_toks: so , if you were to create tens of thousands of ready - made ##s per year , that would become extremely mono ##ton ##ous and irritating .

reference_raw: So if you created tens of thousands of prepared products a year, it would be very monotonous and annoying.

reference_spacy_tokens: So if you created tens of thousands of prepared products a year , it would be very monotonous and annoying .


fn_spacy_tokens_for_baseline: With an involuntary yell of alarm she tumbled forward and sprawled full length in the muddy water .

source_bert_toks: with an involuntary yell of alarm she tumbled forward and sprawled full length in the muddy water .

reference_raw: With an involuntary cry of alarm, she rolled forward and stretched out in the muddy water.

reference_spacy_tokens: With an involuntary cry of alarm , she rolled forward and stretched out in the muddy water .


fn_spacy_tokens_for_baseline: It would have been a richer joy -- but , indeed , as I so often tell you , I delight to picture you in a childlike serenity .

source_bert_toks: it would have been a richer joy - - but , indeed , as i so often tell you , i delight to picture you in a child ##like ser ##enity .

reference_raw: It would be a much richer joy - but, as I've often told you, I like to imagine you as a child's peace.

reference_spacy_tokens: It would be a much richer joy - but , as I 've often told you , I like to imagine you as a child 's peace .


fn_spacy_tokens_for_baseline: On Boxing Day she put a short note through Doris 's door with her little bit of news and positively ran back home , feeling suddenly young again and full of energy .

source_bert_toks: on boxing day she put a short note through doris ' s door with her little bit of news and positively ran back home , feeling suddenly young again and full of energy .

reference_raw: On Boxing Day, she slipped a brief message through Doris's door with a little news and ran back home positively, feeling suddenly young again and full of energy.

reference_spacy_tokens: On Boxing Day , she slipped a brief message through Doris 's door with a little news and ran back home positively , feeling suddenly young again and full of energy .


fn_spacy_tokens_for_baseline: Such was the austerity of his habits that it never entered his head himself to have any kind of formal dinner in which I could join .

source_bert_toks: such was the aus ##ter ##ity of his habits that it never entered his head himself to have any kind of formal dinner in which i could join .

reference_raw: It was the austerity of his custom that he had never thought of having a formal dinner in which I could join him.

reference_spacy_tokens: It was the austerity of his custom that he had never thought of having a formal dinner in which I could join him .


fn_spacy_tokens_for_baseline: The Bush administration has mounted a concerted campaign to get quick Congressional approval for the India - US nuclear deal , with the White House declaring it the president 's " top priority " amid a few contrary voices heard in the legislature .

source_bert_toks: the bush administration has mounted a concert ##ed campaign to get quick congressional approval for the india - us nuclear deal , with the white house declaring it the president ' s " top priority " amid a few contrary voices heard in the legislature .

reference_raw: The Bush administration has embarked on a coordinated campaign to obtain a rapid Congressional endorsement of the India-U.S. nuclear agreement, and the White House has declared it the president's "top priority" among several opposite voices heard by the legislator.

reference_spacy_tokens: The Bush administration has embarked on a coordinated campaign to obtain a rapid Congressional endorsement of the India - U.S. nuclear agreement , and the White House has declared it the president 's " top priority " among several opposite voices heard by the legislator .


fn_spacy_tokens_for_baseline: These ' Kerr ' black holes rotate at a constant rate , their size and shape depending only on their mass and rate of rotation .

source_bert_toks: these ' kerr ' black holes rotate at a constant rate , their size and shape depending only on their mass and rate of rotation .

reference_raw: These are Kerr's black holes turning at a constant rate, their size and shape depending only on their mass and rate of rotation.

reference_spacy_tokens: These are Kerr 's black holes turning at a constant rate , their size and shape depending only on their mass and rate of rotation .


fn_spacy_tokens_for_baseline: No record of his early life has survived but it is known that his father was executioner of the German town of Bamberg .

source_bert_toks: no record of his early life has survived but it is known that his father was execution ##er of the german town of bam ##berg .

reference_raw: There was no record of his early life, but his father was known to have been executed in the German city of Bamberg.

reference_spacy_tokens: There was no record of his early life , but his father was known to have been executed in the German city of Bamberg .


fn_spacy_tokens_for_baseline: Your brain needs oxygen and that means you should breathe plenty of fresh air .

source_bert_toks: your brain needs oxygen and that means you should breathe plenty of fresh air .

reference_raw: Your brain needs oxygen, which means you have to take a lot of fresh air.

reference_spacy_tokens: Your brain needs oxygen , which means you have to take a lot of fresh air .


fn_spacy_tokens_for_baseline: On 1/31 , the Iranian deputy Foreign Minister for EuroAmerican Affairs rejects claims Iran had purchased nuclear weapons ( 7162 ) .

source_bert_toks: on 1 / 31 , the iranian deputy foreign minister for euro ##ame ##rica ##n affairs rejects claims iran had purchased nuclear weapons ( 71 ##6 ##2 ) .

reference_raw: On 1/31, the Deputy Minister of Foreign Affairs of Iran rejects the claim that Iran bought nuclear weapons (7162).

reference_spacy_tokens: On 1/31 , the Deputy Minister of Foreign Affairs of Iran rejects the claim that Iran bought nuclear weapons ( 7162 ) .


fn_spacy_tokens_for_baseline: Unemployed , homeless and with a prison record , Jerry now faced going back to prison for failure to pay child support .

source_bert_toks: unemployed , homeless and with a prison record , jerry now faced going back to prison for failure to pay child support .

reference_raw: Unemployed, homeless, and with a prison record, Jerry was now facing a return to prison for failing to pay child support.

reference_spacy_tokens: Unemployed , homeless , and with a prison record , Jerry was now facing a return to prison for failing to pay child support .


fn_spacy_tokens_for_baseline: Staring back at him , aware of how still he was holding himself , she exclaimed weakly , ' Oh , Leo , could does n't even enter into it .

source_bert_toks: staring back at him , aware of how still he was holding himself , she exclaimed weakly , ' oh , leo , could doesn ' t even enter into it .

reference_raw: She looked at him, aware that he was still holding on, and cried weakly, "Oh, Leo, he can't even enter.

reference_spacy_tokens: She looked at him , aware that he was still holding on , and cried weakly , " Oh , Leo , he ca n't even enter .


fn_spacy_tokens_for_baseline: Other birds you could see along this stretch include oystercatchers with their black and white plumage , bright orange bills and piping call , black headed gulls , kestrels and of course mute swans .

source_bert_toks: other birds you could see along this stretch include oyster ##cat ##chers with their black and white plumage , bright orange bills and pip ##ing call , black headed gu ##lls , ke ##strel ##s and of course mute swans .

reference_raw: The other birds you can see on this stretch are oyster-catchers with black-and-white feathers, bright orange notes and pipe calls, black-headed gulls, kestrels, and, of course, mute swans.

reference_spacy_tokens: The other birds you can see on this stretch are oyster - catchers with black - and - white feathers , bright orange notes and pipe calls , black - headed gulls , kestrels , and , of course , mute swans .


fn_spacy_tokens_for_baseline: Although he was forbidden to get out of bed he sneaked over every evening and peeped out , unable to resist looking .

source_bert_toks: although he was forbidden to get out of bed he sneak ##ed over every evening and pee ##ped out , unable to resist looking .

reference_raw: Even though he was forbidden to get out of bed, he crept over every night and peered out, unable to resist looking.

reference_spacy_tokens: Even though he was forbidden to get out of bed , he crept over every night and peered out , unable to resist looking .


fn_spacy_tokens_for_baseline: Then Kim strewed the contents of drawers , toy boxes , magazine racks and book shelves over the floor .

source_bert_toks: then kim st ##rew ##ed the contents of drawers , toy boxes , magazine racks and book shelves over the floor .

reference_raw: Then Kim smeared the contents of drawers, toy boxes, magazine racks, and bookshelves on the floor.

reference_spacy_tokens: Then Kim smeared the contents of drawers , toy boxes , magazine racks , and bookshelves on the floor .


fn_spacy_tokens_for_baseline: Mr Hussein is driven only by paranoia and a powerful lust to survive .

source_bert_toks: mr hussein is driven only by paranoia and a powerful lust to survive .

reference_raw: Mr. Hussein is driven only by paranoia and a strong desire for survival.

reference_spacy_tokens: Mr. Hussein is driven only by paranoia and a strong desire for survival .


fn_spacy_tokens_for_baseline: Perhaps Louis was also stung by the threatened negation of his own youthful exploits on the March .

source_bert_toks: perhaps louis was also stung by the threatened ne ##gation of his own youthful exploits on the march .

reference_raw: Perhaps Louis had also been stabbed by the threat of negating his own youthful exploits on March.

reference_spacy_tokens: Perhaps Louis had also been stabbed by the threat of negating his own youthful exploits on March .


fn_spacy_tokens_for_baseline: She was surprised how bare the gardens had become , except for the lopsided apple tree in the lower orchard whose branches still carried a crop of apples shimmering like tiny brassy moons .

source_bert_toks: she was surprised how bare the gardens had become , except for the lo ##ps ##ided apple tree in the lower orchard whose branches still carried a crop of apples shimmering like tiny brass ##y moons .

reference_raw: She was surprised at how barren the gardens had become, except for the lopsided apple tree in the lower orchard, whose branches still carried a crop of apples that glittered like tiny brassy moons.

reference_spacy_tokens: She was surprised at how barren the gardens had become , except for the lopsided apple tree in the lower orchard , whose branches still carried a crop of apples that glittered like tiny brassy moons .


fn_spacy_tokens_for_baseline: Their behaviour must also be frequent or serious enough to justify attempts to alter it by deliberate management action .

source_bert_toks: their behaviour must also be frequent or serious enough to justify attempts to alter it by deliberate management action .

reference_raw: Their behaviour must also be sufficiently common or serious to justify attempts to change it by deliberate management measures.

reference_spacy_tokens: Their behaviour must also be sufficiently common or serious to justify attempts to change it by deliberate management measures .


fn_spacy_tokens_for_baseline: ' Dear Silas , ' Doreen cooed .

source_bert_toks: ' dear silas , ' do ##reen co ##oed .

reference_raw: 'Dear Silas,' said Doreen.

reference_spacy_tokens: ' Dear Silas , ' said Doreen .


fn_spacy_tokens_for_baseline: The 40-minute programmes , shot in a London studio with live dancers and bands , are hosted by lad about London ( and Janet Street - Porter - pal ) Normski .

source_bert_toks: the 40 - minute programmes , shot in a london studio with live dancers and bands , are hosted by lad about london ( and janet street - porter - pal ) norms ##ki .

reference_raw: A 40-minute program, filmed in a London studio with live dancers and bands, is hosted by a boy from London (and Janet Street-Porter-Pal) Normski.

reference_spacy_tokens: A 40-minute program , filmed in a London studio with live dancers and bands , is hosted by a boy from London ( and Janet Street - Porter - Pal ) Normski .


fn_spacy_tokens_for_baseline: This realization led to several white calico garments ; fulsome petticoats , frilled blouses and fancy nightdresses being the most obvious , all of them generous with material .

source_bert_toks: this realization led to several white cal ##ico garments ; fu ##ls ##ome pet ##tic ##oat ##s , fr ##ille ##d blouse ##s and fancy night ##dre ##sse ##s being the most obvious , all of them generous with material .

reference_raw: This knowledge led to a number of white calico suits; the most obvious were many petticoats, frilled blouses, and fancy nightgowns, all of which were generous with material.

reference_spacy_tokens: This knowledge led to a number of white calico suits ; the most obvious were many petticoats , frilled blouses , and fancy nightgowns , all of which were generous with material .


fn_spacy_tokens_for_baseline: " Not everyone in Calcutta , or India for that matter , is unanimous in praising the nun , whose organization was able to raise millions of dollars worldwide but made virtually no significant changes in the social structure of this collapsing city 's poor neighborhoods .

source_bert_toks: " not everyone in calcutta , or india for that matter , is unanimous in praising the nun , whose organization was able to raise millions of dollars worldwide but made virtually no significant changes in the social structure of this collapsing city ' s poor neighborhoods .

reference_raw: "Not everyone in Calcutta, or India, has unanimously praised a nun whose organization has been able to raise millions of dollars around the world, but has made virtually no significant changes in the social structure of the miserable neighborhoods of this crumbling city.

reference_spacy_tokens: " Not everyone in Calcutta , or India , has unanimously praised a nun whose organization has been able to raise millions of dollars around the world , but has made virtually no significant changes in the social structure of the miserable neighborhoods of this crumbling city .


fn_spacy_tokens_for_baseline: Pulling on a sweater and wrapping my long kilt around me , I made my way towards Sheikha Grandmother 's house .

source_bert_toks: pulling on a sweater and wrapping my long ki ##lt around me , i made my way towards sheikh ##a grandmother ' s house .

reference_raw: I pulled on my sweater and wrapped my long skirt around me and headed for Sheikh's grandmother's house.

reference_spacy_tokens: I pulled on my sweater and wrapped my long skirt around me and headed for Sheikh 's grandmother 's house .


fn_spacy_tokens_for_baseline: Negotiations in Moscow between Russian and German intelligence services on bilateral co - operation against terrorism and drug - smuggling were reported on Oct. 19 .

source_bert_toks: negotiations in moscow between russian and german intelligence services on bilateral co - operation against terrorism and drug - smuggling were reported on oct . 19 .

reference_raw: Negotiations in Moscow between Russian and German intelligence services on bilateral cooperation against terrorism and drug smuggling have been reported on October 19th.

reference_spacy_tokens: Negotiations in Moscow between Russian and German intelligence services on bilateral cooperation against terrorism and drug smuggling have been reported on October 19th .


fn_spacy_tokens_for_baseline: To my knowledge , no one has yet addressed the relationship between topic and theme in topic - prominent languages .

source_bert_toks: to my knowledge , no one has yet addressed the relationship between topic and theme in topic - prominent languages .

reference_raw: As far as I know, the relationship between the subject and theme has not yet been discussed in the thematic languages.

reference_spacy_tokens: As far as I know , the relationship between the subject and theme has not yet been discussed in the thematic languages .


fn_spacy_tokens_for_baseline: ' When they arrive , the car is suddenly detonated by remote control .

source_bert_toks: ' when they arrive , the car is suddenly detonated by remote control .

reference_raw: 'When they arrive, the car suddenly explodes with a remote control.

reference_spacy_tokens: ' When they arrive , the car suddenly explodes with a remote control .