fn_spacy_tokens_for_baseline: On 19 December 2003 , Libyan leader Col . Muammar Qadhafi publicly confirmed his commitment to disclose and dismantle WMD programs in his country following a nine - month period of negotiations with US and UK authorities .

source_bert_toks: on 19 december 2003 , libyan leader col . mu ##am ##mar q ##ad ##ha ##fi publicly confirmed his commitment to disclose and di ##sman ##tle w ##md programs in his country following a nine - month period of negotiations with us and uk authorities .

reference_raw: On 19 December 2003, Libyan leader Colonel Muammar Qadhafi publicly confirmed his commitment to the publication and dismantling of weapons of mass destruction programmes within his country after a nine-month period of negotiations with the authorities of the United States and the United Kingdom.

reference_spacy_tokens: On 19 December 2003 , Libyan leader Colonel Muammar Qadhafi publicly confirmed his commitment to the publication and dismantling of weapons of mass destruction programmes within his country after a nine - month period of negotiations with the authorities of the United States and the United Kingdom .


fn_spacy_tokens_for_baseline: From what we saw , the damage caused by those erratic infidels ( Tribes Sheiks , The Islamic Party ) is more dangerous than the Shiites and the peaceful police as people call them .

source_bert_toks: from what we saw , the damage caused by those erratic in ##fide ##ls ( tribes she ##ik ##s , the islamic party ) is more dangerous than the shi ##ites and the peaceful police as people call them .

reference_raw: From what we've seen, the damage caused by these unreliable infidels (the Tribe Sheiks, the Islamic Party) is more perilous than the Shiites and the peaceful police, as people call it.

reference_spacy_tokens: From what we 've seen , the damage caused by these unreliable infidels ( the Tribe Sheiks , the Islamic Party ) is more perilous than the Shiites and the peaceful police , as people call it .


fn_spacy_tokens_for_baseline: Nevertheless , numerous misconceptions persist about the nature of CBW terrorism -- in particular , how easy it would be for terrorists to produce and employ such weapons .

source_bert_toks: nevertheless , numerous mis ##con ##ception ##s persist about the nature of cb ##w terrorism - - in particular , how easy it would be for terrorists to produce and employ such weapons .

reference_raw: However, there are still a number of misunderstandings about the nature of CBW terrorism - especially how easily it would be for terrorists to produce and use such weapons.

reference_spacy_tokens: However , there are still a number of misunderstandings about the nature of CBW terrorism - especially how easily it would be for terrorists to produce and use such weapons .


fn_spacy_tokens_for_baseline: The traditional Qing Dynasty style of the mansion is enlivened by a few Western touches : a Baroque - style ceiling and stained glass above the doorways , showing the builder 's up - to - date attitude at the time of construction .

source_bert_toks: the traditional qing dynasty style of the mansion is en ##li ##ven ##ed by a few western touches : a baroque - style ceiling and stained glass above the doorway ##s , showing the builder ' s up - to - date attitude at the time of construction .

reference_raw: A few Western touches enlive the traditional Qing Dynasty style of the mansion: a baroque-style ceiling and stained glass above the door, showing the builder's up-to-date attitude during construction.

reference_spacy_tokens: A few Western touches enlive the traditional Qing Dynasty style of the mansion : a baroque - style ceiling and stained glass above the door , showing the builder 's up - to - date attitude during construction .


fn_spacy_tokens_for_baseline: Join back neckband seam ( this will be in the centre of the back ) .

source_bert_toks: join back neck ##band seam ( this will be in the centre of the back ) .

reference_raw: Join the back seam of the neck band (this will be in the middle of the back).

reference_spacy_tokens: Join the back seam of the neck band ( this will be in the middle of the back ) .


fn_spacy_tokens_for_baseline: But I wanted something to remember her by , so I just picked up a pair of scissors that were lying around and cut off a lock of her hair .

source_bert_toks: but i wanted something to remember her by , so i just picked up a pair of scissors that were lying around and cut off a lock of her hair .

reference_raw: But I wanted something to remember her by, so I picked up a pair of scissors that lay around and cut off a strand of her hair.

reference_spacy_tokens: But I wanted something to remember her by , so I picked up a pair of scissors that lay around and cut off a strand of her hair .


fn_spacy_tokens_for_baseline: Prize systems could be designed to be fairly similar to the current system , with big payoffs for successful entrepreneurs , but even with this approach , there would be huge opportunities to improve welfare .

source_bert_toks: prize systems could be designed to be fairly similar to the current system , with big pay ##offs for successful entrepreneurs , but even with this approach , there would be huge opportunities to improve welfare .

reference_raw: Award systems could be designed to be quite similar to the current system, with large payoffs for prosperous entrepreneurs, but even with this approach, there would be huge opportunities for better well-being.

reference_spacy_tokens: Award systems could be designed to be quite similar to the current system , with large payoffs for prosperous entrepreneurs , but even with this approach , there would be huge opportunities for better well - being .


fn_spacy_tokens_for_baseline: More than once she woke to see Ben standing silently there in the half dark , staring at them .

source_bert_toks: more than once she woke to see ben standing silently there in the half dark , staring at them .

reference_raw: She awoke more than once and saw Ben standing quietly in the half-dark, staring at them.

reference_spacy_tokens: She awoke more than once and saw Ben standing quietly in the half - dark , staring at them .


fn_spacy_tokens_for_baseline: ' It is like a glass of dirty water .

source_bert_toks: ' it is like a glass of dirty water .

reference_raw: 'It's like a jar of filthy water.

reference_spacy_tokens: ' It 's like a jar of filthy water .


fn_spacy_tokens_for_baseline: His shouts echoed around the cylinder formed by the walls .

source_bert_toks: his shouts echoed around the cylinder formed by the walls .

reference_raw: His screams reverberated around the wall-shaped cylinder.

reference_spacy_tokens: His screams reverberated around the wall - shaped cylinder .


fn_spacy_tokens_for_baseline: Improved export control laws and enforcement have addressed many ( but not all ) concerns about nuclear and chemical weapons - related proliferation .

source_bert_toks: improved export control laws and enforcement have addressed many ( but not all ) concerns about nuclear and chemical weapons - related proliferation .

reference_raw: Improved export control legislation and enforcement have addressed a number of (but not all) concerns about nuclear and chemical weapons - related dissemination.

reference_spacy_tokens: Improved export control legislation and enforcement have addressed a number of ( but not all ) concerns about nuclear and chemical weapons - related dissemination .


fn_spacy_tokens_for_baseline: Involuntary manslaughter is unlawful homicide without malice aforethought .

source_bert_toks: involuntary mans ##lau ##ght ##er is unlawful homicide without malice af ##ore ##th ##ough ##t .

reference_raw: Involuntary murder is an illegal murder without prejudice.

reference_spacy_tokens: Involuntary murder is an illegal murder without prejudice .


fn_spacy_tokens_for_baseline: Nobody inside the movement was permitted to acquire enough power or a high enough profile to challenge de Gaulle successfully .

source_bert_toks: nobody inside the movement was permitted to acquire enough power or a high enough profile to challenge de gaulle successfully .

reference_raw: No one within the movement was allowed to gain enough power or a high enough profile to successfully challenge de Gaulle.

reference_spacy_tokens: No one within the movement was allowed to gain enough power or a high enough profile to successfully challenge de Gaulle .


fn_spacy_tokens_for_baseline: The appellant had not been required to surrender to the Central Criminal Court and the question of granting bail did not arise .

source_bert_toks: the app ##ellant had not been required to surrender to the central criminal court and the question of granting bail did not arise .

reference_raw: The appellant was not required to surrender to the Central Criminal Court and the issue of bail was not raised.

reference_spacy_tokens: The appellant was not required to surrender to the Central Criminal Court and the issue of bail was not raised .


fn_spacy_tokens_for_baseline: She most feared what people thought of her , and imagined that they talked constantly about her behind her back .

source_bert_toks: she most feared what people thought of her , and imagined that they talked constantly about her behind her back .

reference_raw: She was most afraid of what people thought of her, and imagined that they were always talking about her behind her back.

reference_spacy_tokens: She was most afraid of what people thought of her , and imagined that they were always talking about her behind her back .


fn_spacy_tokens_for_baseline: Scott 's Captain Waverley , as a southern Whig , is momentarily infatuated with the Jacobite Highlands , but he returns south and is pardoned for his treason .

source_bert_toks: scott ' s captain wave ##rley , as a southern whig , is momentarily in ##fat ##uated with the jacobite highlands , but he returns south and is pardon ##ed for his treason .

reference_raw: Scott's Captain Waverley, a Southern Whig, is in love with the Jacobite Highlands for a while, but he returns south and is forgiven for his betrayal.

reference_spacy_tokens: Scott 's Captain Waverley , a Southern Whig , is in love with the Jacobite Highlands for a while , but he returns south and is forgiven for his betrayal .


fn_spacy_tokens_for_baseline: Can you think of anybody offhand ?

source_bert_toks: can you think of anybody off ##hand ?

reference_raw: Do you have any idea who's out of hand?

reference_spacy_tokens: Do you have any idea who 's out of hand ?


fn_spacy_tokens_for_baseline: It was as if he was their sovereign and they his subjects .

source_bert_toks: it was as if he was their sovereign and they his subjects .

reference_raw: It's like he's their ruler and they're his subjects.

reference_spacy_tokens: It 's like he 's their ruler and they 're his subjects .


fn_spacy_tokens_for_baseline: ' Oh , you need n't worry about them , ' the Doctor reassured her overconfidently .

source_bert_toks: ' oh , you need ##n ' t worry about them , ' the doctor reassured her over ##con ##fide ##ntly .

reference_raw: "Oh, you don't have to worry about them," the doctor assured her with too much confidence.

reference_spacy_tokens: " Oh , you do n't have to worry about them , " the doctor assured her with too much confidence .


fn_spacy_tokens_for_baseline: The similarity of outlook which marked the views of Maxse , a man who Hutcheson shows to have been , temperamentally if not socially , a quintessential outsider , and Bridgeman , the quintessential insider , is significant .

source_bert_toks: the similarity of outlook which marked the views of max ##se , a man who hut ##ches ##on shows to have been , temperament ##ally if not socially , a qui ##ntes ##sen ##tial outsider , and bridge ##man , the qui ##ntes ##sen ##tial insider , is significant .

reference_raw: The similarity of the outlook that marked Maxse's views, a man who Hutcheson proved to be a quintessential outsider, temperamentally, if not socially, and Bridgeman, a quintessential insider, is significant.

reference_spacy_tokens: The similarity of the outlook that marked Maxse 's views , a man who Hutcheson proved to be a quintessential outsider , temperamentally , if not socially , and Bridgeman , a quintessential insider , is significant .


fn_spacy_tokens_for_baseline: A cardboard dispenser unit was produced for distribution at various types of outlets throughout Wales .

source_bert_toks: a cardboard di ##sp ##ense ##r unit was produced for distribution at various types of outlets throughout wales .

reference_raw: A cardboard dispensing unit has been produced for distribution in different types of outlets throughout Wales.

reference_spacy_tokens: A cardboard dispensing unit has been produced for distribution in different types of outlets throughout Wales .


fn_spacy_tokens_for_baseline: Firefighters tackle blazes at farm and empty house

source_bert_toks: firefighters tackle blaze ##s at farm and empty house

reference_raw: Firefighters fight fires in farms and empty houses


fn_spacy_tokens_for_baseline: Jack nodded a few times to himself .

source_bert_toks: jack nodded a few times to himself .

reference_raw: Jack shook his head several times.

reference_spacy_tokens: Jack shook his head several times .


fn_spacy_tokens_for_baseline: Behind them , housewives now pack .38s in Gucci handbags , learn to train Rottweilers in close attack work and sign up with security firms such as Armed Response .

source_bert_toks: behind them , house ##wives now pack . 38 ##s in gu ##cci hand ##bags , learn to train rot ##t ##weiler ##s in close attack work and sign up with security firms such as armed response .

reference_raw: Behind them, housewives now wrap up .38s in Gucci purses, learn how to train Rottweilers in close-on assault, and sign up with security firms like the Armed Response.

reference_spacy_tokens: Behind them , housewives now wrap up .38s in Gucci purses , learn how to train Rottweilers in close - on assault , and sign up with security firms like the Armed Response .


fn_spacy_tokens_for_baseline: But in the end she settled for a pair of thick black stockings that she said would have to do .

source_bert_toks: but in the end she settled for a pair of thick black stockings that she said would have to do .

reference_raw: In the end, however, she settled for a pair of thick black tights, which she said would have to do.

reference_spacy_tokens: In the end , however , she settled for a pair of thick black tights , which she said would have to do .


fn_spacy_tokens_for_baseline: [ Mississippi ] National Guard Prepares For Hurricane Season [ and Chemical Terrorism ]

source_bert_toks: [ mississippi ] national guard prepares for hurricane season [ and chemical terrorism ]

reference_raw: [Missippi] National Guard preparations for the hurricane season [and chemical terrorism]

reference_spacy_tokens: [ Missippi ] National Guard preparations for the hurricane season [ and chemical terrorism ]


fn_spacy_tokens_for_baseline: Naturally , if the ions attract the electrons the converse is true as well , i.e. owing to the magnetic force on the electrons , there is also an inward force upon the ions .

source_bert_toks: naturally , if the ions attract the electrons the converse is true as well , i . e . owing to the magnetic force on the electrons , there is also an inward force upon the ions .

reference_raw: Of course, when ions attract electrons, the converse is also true, i.e. because of the magnetic power of the electrons, there is also an inward power on the ions.

reference_spacy_tokens: Of course , when ions attract electrons , the converse is also true , i.e. because of the magnetic power of the electrons , there is also an inward power on the ions .


fn_spacy_tokens_for_baseline: The Iraqi authorities on Nov. 24 released the South African - born British businessman , Ian Richter , imprisoned in Iraq since July 1986 and convicted in February 1987 of bribery and forgery charges .

source_bert_toks: the iraqi authorities on nov . 24 released the south african - born british businessman , ian richter , imprisoned in iraq since july 1986 and convicted in february 1987 of bribery and forge ##ry charges .

reference_raw: On November 24, the Iraqi authorities released a South African-born British businessman, Ian Richter, who has been imprisoned in Iraq since July 1986 and sentenced to bribery and counterfeiting in February 1987.

reference_spacy_tokens: On November 24 , the Iraqi authorities released a South African - born British businessman , Ian Richter , who has been imprisoned in Iraq since July 1986 and sentenced to bribery and counterfeiting in February 1987 .


fn_spacy_tokens_for_baseline: The strong beat and earthy lyrics seem to symbolize and celebrate the character of this young and lively country .

source_bert_toks: the strong beat and earth ##y lyrics seem to symbol ##ize and celebrate the character of this young and lively country .

reference_raw: Strong rhythms and earthly texts seem to symbolize and celebrate the character of this new and living country.

reference_spacy_tokens: Strong rhythms and earthly texts seem to symbolize and celebrate the character of this new and living country .


fn_spacy_tokens_for_baseline: Alan obliged with a debut goal in the 5 - 0 rout of Manchester United , one of the Palace matches which will live forever in the memories of those who saw us demolish the Old Trafford outfit .

source_bert_toks: alan obliged with a debut goal in the 5 - 0 ro ##ut of manchester united , one of the palace matches which will live forever in the memories of those who saw us demo ##lish the old trafford outfit .

reference_raw: Alan had committed himself to a debut goal on the 5-0 route of Manchester United, one of the palace matches that would live forever in the memory of those who saw us destroy Old Trafford's clothes.

reference_spacy_tokens: Alan had committed himself to a debut goal on the 5 - 0 route of Manchester United , one of the palace matches that would live forever in the memory of those who saw us destroy Old Trafford 's clothes .


fn_spacy_tokens_for_baseline: All right , all right , you can have Sundays off .

source_bert_toks: all right , all right , you can have sundays off .

reference_raw: Okay, okay, you can take the day off.

reference_spacy_tokens: Okay , okay , you can take the day off .


fn_spacy_tokens_for_baseline: His insight , however , was achieved in a theological work discussing the relationship between ' spirit ' and air .

source_bert_toks: his insight , however , was achieved in a theological work discussing the relationship between ' spirit ' and air .

reference_raw: But his insight had been achieved in the theological work that debated the relationship between "spirit" and air.

reference_spacy_tokens: But his insight had been achieved in the theological work that debated the relationship between " spirit " and air .


fn_spacy_tokens_for_baseline: Rachel carried on fighting , hoarse gasps coming from her throat .

source_bert_toks: rachel carried on fighting , hoarse gasps coming from her throat .

reference_raw: Rachel continued to fight, her throat gusting hoarsely.

reference_spacy_tokens: Rachel continued to fight , her throat gusting hoarsely .


fn_spacy_tokens_for_baseline: ' No need to worry about me , I can take care of myself , ' Penny said , reaching nervously for a paper cup of wine .

source_bert_toks: ' no need to worry about me , i can take care of myself , ' penny said , reaching nervously for a paper cup of wine .

reference_raw: "You don't have to worry about me, I can take care of myself," Penny said, reaching nervously for a glass of wine.

reference_spacy_tokens: " You do n't have to worry about me , I can take care of myself , " Penny said , reaching nervously for a glass of wine .


fn_spacy_tokens_for_baseline: Short of declaring Iran in violation of the NPT , the IAEA Director - General Mohamed ElBaradei stated , " Iran has failed to meet its obligations under its Safeguards Agreement " and criticized Iran for not being transparent with the construction of its nuclear - related facilities and import of nuclear material .

source_bert_toks: short of declaring iran in violation of the np ##t , the ia ##ea director - general mohamed el ##bara ##de ##i stated , " iran has failed to meet its obligations under its safeguard ##s agreement " and criticized iran for not being transparent with the construction of its nuclear - related facilities and import of nuclear material .

reference_raw: The Director of the IAEA - General Mohamed ElBaradei said, "Iran has failed to fulfil its obligations under the Safeguards Agreement" and criticized Iran for lack of transparency in the construction of its nuclear-related equipment and the import of nuclear material.

reference_spacy_tokens: The Director of the IAEA - General Mohamed ElBaradei said , " Iran has failed to fulfil its obligations under the Safeguards Agreement " and criticized Iran for lack of transparency in the construction of its nuclear - related equipment and the import of nuclear material .


fn_spacy_tokens_for_baseline: Elections may help produce the personnel at the apex of government but they tell us little about likely public policy .

source_bert_toks: elections may help produce the personnel at the apex of government but they tell us little about likely public policy .

reference_raw: Elections can help create staff at the top of the government, but they don't tell us much about likely public policy.

reference_spacy_tokens: Elections can help create staff at the top of the government , but they do n't tell us much about likely public policy .


fn_spacy_tokens_for_baseline: The gay scene was pubs and clubs full of role - playing lesbians into ' butch ' or ' femme ' and was just as alienating as the straight world .

source_bert_toks: the gay scene was pubs and clubs full of role - playing lesbian ##s into ' butch ' or ' femme ' and was just as alien ##ating as the straight world .

reference_raw: Gay scenes were pubs and clubs full of role-playing lesbians in "butch" or "femme", and they were just as estranged as the heterosexual world.

reference_spacy_tokens: Gay scenes were pubs and clubs full of role - playing lesbians in " butch " or " femme " , and they were just as estranged as the heterosexual world .


fn_spacy_tokens_for_baseline: He had expected to be given the rooms furnished by the College .

source_bert_toks: he had expected to be given the rooms furnished by the college .

reference_raw: He expected to get a suite furnished by the university.

reference_spacy_tokens: He expected to get a suite furnished by the university .


fn_spacy_tokens_for_baseline: Her long flaxen hair was coiled up in a thick plait at the top of her head .

source_bert_toks: her long fl ##ax ##en hair was coiled up in a thick pl ##ai ##t at the top of her head .

reference_raw: Her long, flaxy hair was curled up in a thick patch at the top of her head.

reference_spacy_tokens: Her long , flaxy hair was curled up in a thick patch at the top of her head .


fn_spacy_tokens_for_baseline: Consequently , executives investigate alternative means , including law avoidance , evasion , and violation and pursue them if they are evaluated as superior to other available strictly legitimate alternatives .

source_bert_toks: consequently , executives investigate alternative means , including law avoidance , eva ##sion , and violation and pursue them if they are evaluated as superior to other available strictly legitimate alternatives .

reference_raw: As a result, executives examine alternative means, such as law evasion, evasion and violation, and pursue them when they are assessed as superior to other strictly legitimate alternatives available.

reference_spacy_tokens: As a result , executives examine alternative means , such as law evasion , evasion and violation , and pursue them when they are assessed as superior to other strictly legitimate alternatives available .


fn_spacy_tokens_for_baseline: His work , therefore , is especially valuable for our purpose .

source_bert_toks: his work , therefore , is especially valuable for our purpose .

reference_raw: So his work is of particular value to us.

reference_spacy_tokens: So his work is of particular value to us .


fn_spacy_tokens_for_baseline: His works travel the world , reproduced on postcards , posters and any medium which does not actually detract from the artist 's intention .

source_bert_toks: his works travel the world , reproduced on post ##cards , posters and any medium which does not actually det ##rac ##t from the artist ' s intention .

reference_raw: His work travels around the world, reproductions on postcards, posters, and other media that don't really detract from the artist's intentions.

reference_spacy_tokens: His work travels around the world , reproductions on postcards , posters , and other media that do n't really detract from the artist 's intentions .


fn_spacy_tokens_for_baseline: She gasped as he yanked her closer .

source_bert_toks: she gasped as he yanked her closer .

reference_raw: She let out a breath as he pulled her closer.

reference_spacy_tokens: She let out a breath as he pulled her closer .


fn_spacy_tokens_for_baseline: ' If the manual was lying in the BMW , I think some hint of the elation of the police would have come through on the intercepts .

source_bert_toks: ' if the manual was lying in the bmw , i think some hint of the el ##ation of the police would have come through on the intercept ##s .

reference_raw: 'If the manual was in the BMW, I think there'd be a hint of elating the police on intercepts.

reference_spacy_tokens: ' If the manual was in the BMW , I think there 'd be a hint of elating the police on intercepts .


fn_spacy_tokens_for_baseline: He also sold the XYZ-11 , the key part necessary for the trigger .

source_bert_toks: he also sold the x ##y ##z - 11 , the key part necessary for the trigger .

reference_raw: He also sold XYZ-11, an essential part of the trigger.

reference_spacy_tokens: He also sold XYZ-11 , an essential part of the trigger .


fn_spacy_tokens_for_baseline: Its critics say that even if the waves do not lap over the runway , exorbitant landing fees will frustrate Osaka 's ambitions to displace Seoul as an airline hub for East Asia .

source_bert_toks: its critics say that even if the waves do not lap over the runway , ex ##or ##bit ##ant landing fees will fr ##ust ##rate osaka ' s ambitions to di ##sp ##lace seoul as an airline hub for east asia .

reference_raw: Its critics say that even if the waves don't roll over the runway, excessive landing charges will destroy Osaka's ambition to displace Seoul as a hub for East Asia.

reference_spacy_tokens: Its critics say that even if the waves do n't roll over the runway , excessive landing charges will destroy Osaka 's ambition to displace Seoul as a hub for East Asia .


fn_spacy_tokens_for_baseline: ' We d'Urbervilles do n't sell our horses for cat 's meat ! ' he insisted .

source_bert_toks: ' we d ' ur ##ber ##ville ##s don ' t sell our horses for cat ' s meat ! ' he insisted .

reference_raw: 'We d'Urbervilles do not sell our horses for cat meat!' he said.

reference_spacy_tokens: ' We d'Urbervilles do not sell our horses for cat meat ! ' he said .


fn_spacy_tokens_for_baseline: I did it so vigorously , however , that I slightly cut my lower lip on the edge of the hard black instrument .

source_bert_toks: i did it so vigorously , however , that i slightly cut my lower lip on the edge of the hard black instrument .

reference_raw: But I did it with such force that I bit my lower lip at the edge of the hard black instrument.

reference_spacy_tokens: But I did it with such force that I bit my lower lip at the edge of the hard black instrument .


fn_spacy_tokens_for_baseline: Contestants will line up at the Blundellsands Hotel , Crosby , at 8 am on Sunday and will then parade through the city centre before setting off on their cross - Channel jaunt .

source_bert_toks: contestants will line up at the blu ##nde ##lls ##ands hotel , crosby , at 8 ##am on sunday and will then parade through the city centre before setting off on their cross - channel ja ##unt .

reference_raw: The contestants will be lined up at the Blundellsands Hotel, Crosby, at 8 a.m. on Sunday, and then they'll be marching through the center of the city before they start their cross-channel jaunt.

reference_spacy_tokens: The contestants will be lined up at the Blundellsands Hotel , Crosby , at 8 a.m. on Sunday , and then they 'll be marching through the center of the city before they start their cross - channel jaunt .


fn_spacy_tokens_for_baseline: After that the Bruces could renew their struggle for the throne .

source_bert_toks: after that the bruce ##s could renew their struggle for the throne .

reference_raw: Then the Bruces could resume their struggle for the throne.

reference_spacy_tokens: Then the Bruces could resume their struggle for the throne .


fn_spacy_tokens_for_baseline: The gulf between theory and practice , which can so easily thwart real progress at such meetings , was not in evidence here .

source_bert_toks: the gulf between theory and practice , which can so easily th ##wart real progress at such meetings , was not in evidence here .

reference_raw: There was no evidence in this case of a gap between theory and practice, which could easily defeat real progress in such meetings.

reference_spacy_tokens: There was no evidence in this case of a gap between theory and practice , which could easily defeat real progress in such meetings .


fn_spacy_tokens_for_baseline: Late Sunday , Israeli armored personnel carriers briefly entered the West Bank city of Ramallah after shots were fired at an Israeli driving to a nearby settlement , an army spokeswoman said .

source_bert_toks: late sunday , israeli armored personnel carriers briefly entered the west bank city of rama ##llah after shots were fired at an israeli driving to a nearby settlement , an army spoke ##sw ##oman said .

reference_raw: At the end of Sunday, Israeli armored personnel carriers entered the West Bank city of Ramallah shortly after the shooting of an Israeli driving into a nearby village, a military spokesman said.

reference_spacy_tokens: At the end of Sunday , Israeli armored personnel carriers entered the West Bank city of Ramallah shortly after the shooting of an Israeli driving into a nearby village , a military spokesman said .


fn_spacy_tokens_for_baseline: Church and manse were erected in 1860 , and a school soon afterwards .

source_bert_toks: church and mans ##e were erected in 1860 , and a school soon afterwards .

reference_raw: The church and mansion were built in 1860, and soon after the school.

reference_spacy_tokens: The church and mansion were built in 1860 , and soon after the school .


fn_spacy_tokens_for_baseline: But whether or not it is a completely accurate report of what actually happened is perhaps not the point .

source_bert_toks: but whether or not it is a completely accurate report of what actually happened is perhaps not the point .

reference_raw: But if it's a complete report of what really happened, maybe it's not the point.

reference_spacy_tokens: But if it 's a complete report of what really happened , maybe it 's not the point .


fn_spacy_tokens_for_baseline: I do not consider that Dicey 's beliefs on the nature of political authority can be , or should be , divorced from his conception of legal sovereignty .

source_bert_toks: i do not consider that dice ##y ' s beliefs on the nature of political authority can be , or should be , divorced from his conception of legal sovereignty .

reference_raw: I don't think Dicey's faith in the nature of political authority can or should be dissociated from his notion of legal sovereignty.

reference_spacy_tokens: I do n't think Dicey 's faith in the nature of political authority can or should be dissociated from his notion of legal sovereignty .


fn_spacy_tokens_for_baseline: These are the crumpled remains of a car which ploughed through a hedge and into the side of a house in Reddings Road in Cheltenham .

source_bert_toks: these are the crumpled remains of a car which pl ##ough ##ed through a hedge and into the side of a house in redding ##s road in cheltenham .

reference_raw: These are the crumpled remains of a car that plowed through the hedge to the side of a house on Reddings Road in Cheltenham.

reference_spacy_tokens: These are the crumpled remains of a car that plowed through the hedge to the side of a house on Reddings Road in Cheltenham .


fn_spacy_tokens_for_baseline: ' But how can President Aquino overhaul the leadership of the armed forces after she has already commended them for putting down the coup ? ' asks a congressman and former military officer , Mr Bonifacio Gillego .

source_bert_toks: ' but how can president aquino overhaul the leadership of the armed forces after she has already commended them for putting down the coup ? ' asks a congressman and former military officer , mr bon ##if ##acio gill ##ego .

reference_raw: "But how can President Aquino change the leadership of the armed forces when he's already praised them for putting down the coup?" asks the congressman and former military officer, Mr. Bonifacio Gillego.

reference_spacy_tokens: " But how can President Aquino change the leadership of the armed forces when he 's already praised them for putting down the coup ? " asks the congressman and former military officer , Mr. Bonifacio Gillego .


fn_spacy_tokens_for_baseline: Schreier sets a brisk but effective tempo here and the horn and bassoons with continuo are first - rate .

source_bert_toks: sc ##hre ##ier sets a brisk but effective tempo here and the horn and bass ##oons with con ##tin ##uo are first - rate .

reference_raw: Schreier sets a fast but efficient pace here, and the horn and bassoon with the continuum are first-class.

reference_spacy_tokens: Schreier sets a fast but efficient pace here , and the horn and bassoon with the continuum are first - class .


fn_spacy_tokens_for_baseline: You might say that Stephanopoulos helped invent the philander - protection techniques that seem to have made Clinton so overconfident of his ability to not get caught .

source_bert_toks: you might say that stephan ##op ##oulos helped in ##vent the phil ##ander - protection techniques that seem to have made clinton so over ##con ##fide ##nt of his ability to not get caught .

reference_raw: You could say that Stephanopoulos helped devise a philander-protection technique that seemed to make Clinton so overconfident about his ability not to get caught.

reference_spacy_tokens: You could say that Stephanopoulos helped devise a philander - protection technique that seemed to make Clinton so overconfident about his ability not to get caught .


fn_spacy_tokens_for_baseline: The move to comprehensive schools in the sixties and seventies led to a broadening of the ability range facing language teachers in British schools .

source_bert_toks: the move to comprehensive schools in the sixties and seventies led to a broad ##ening of the ability range facing language teachers in british schools .

reference_raw: The transition to complex schools in the '60s and '70s resulted in a widening of the range of skills faced by language teachers in British schools.

reference_spacy_tokens: The transition to complex schools in the ' 60s and ' 70s resulted in a widening of the range of skills faced by language teachers in British schools .


fn_spacy_tokens_for_baseline: On March 17 , Mamedov appointed Rakhim Gasiyev as Defence Minister .

source_bert_toks: on march 17 , ma ##med ##ov appointed ra ##kh ##im gas ##iy ##ev as defence minister .

reference_raw: On the 17th of March, Mamedov nominated Rakhim Gasiyev as Secretary of Defense.

reference_spacy_tokens: On the 17th of March , Mamedov nominated Rakhim Gasiyev as Secretary of Defense .


fn_spacy_tokens_for_baseline: This should effectively see off any disease which it appears the Regal Tang is suffering from .

source_bert_toks: this should effectively see off any disease which it appears the regal tang is suffering from .

reference_raw: This should effectively eliminate any disease that the Regal Tang appears to be experiencing.

reference_spacy_tokens: This should effectively eliminate any disease that the Regal Tang appears to be experiencing .


fn_spacy_tokens_for_baseline: It was at Olivier 's suggestion that producer Irving Asher cast Peter Finch in the male lead , while Vivien Leigh decided to ignore her husband 's advice and accepted Paramount 's offer .

source_bert_toks: it was at olivier ' s suggestion that producer irving asher cast peter finch in the male lead , while vi ##vie ##n leigh decided to ignore her husband ' s advice and accepted paramount ' s offer .

reference_raw: At Olivier's suggestion, the producer Irving Asher put Peter Finch in charge, while Vivien Leigh decided to ignore her husband's advice and accepted Paramount's offer.

reference_spacy_tokens: At Olivier 's suggestion , the producer Irving Asher put Peter Finch in charge , while Vivien Leigh decided to ignore her husband 's advice and accepted Paramount 's offer .


fn_spacy_tokens_for_baseline: The gradual withdrawal of traditional home help services in favour of personal assistance is well documented and easily understood .

source_bert_toks: the gradual withdrawal of traditional home help services in favour of personal assistance is well documented and easily understood .

reference_raw: The phasing-out of traditional home-aid services for personal assistance is well documented and easily understood.

reference_spacy_tokens: The phasing - out of traditional home - aid services for personal assistance is well documented and easily understood .


fn_spacy_tokens_for_baseline: He allegedly made the perfect crime boast at his club in the St James area of the West End , when he paid Risdon .

source_bert_toks: he allegedly made the perfect crime bo ##ast at his club in the st james area of the west end , when he paid ri ##sd ##on .

reference_raw: Supposedly, when he paid Risdon, he made a perfect crime bragging at his club in the St. James area of the West End.

reference_spacy_tokens: Supposedly , when he paid Risdon , he made a perfect crime bragging at his club in the St. James area of the West End .


fn_spacy_tokens_for_baseline: Tonight I 'll strap Roukoube to my front , and put you on my back , and we 're going to leave , we 're going to step out of this place .

source_bert_toks: tonight i ' ll strap ro ##uk ##ou ##be to my front , and put you on my back , and we ' re going to leave , we ' re going to step out of this place .

reference_raw: Tonight, I'm gonna tie Roukoube to the front, put you on my back, and we're gonna leave, and we're gonna get out of here.

reference_spacy_tokens: Tonight , I 'm gon na tie Roukoube to the front , put you on my back , and we 're gon na leave , and we 're gon na get out of here .


fn_spacy_tokens_for_baseline: Skin the peppers by roasting over a gas flame or under the grill until the skin blisters black .

source_bert_toks: skin the peppers by roast ##ing over a gas flame or under the grill until the skin b ##list ##ers black .

reference_raw: Skin the peppers by baking above the gas flame or under the barbecue until the skin blisters black.

reference_spacy_tokens: Skin the peppers by baking above the gas flame or under the barbecue until the skin blisters black .


fn_spacy_tokens_for_baseline: The northernmost point in Macau is the frontier between two contrasting worlds .

source_bert_toks: the northernmost point in macau is the frontier between two contrasting worlds .

reference_raw: The northmost point in Macao is the border between two contrasting worlds.

reference_spacy_tokens: The northmost point in Macao is the border between two contrasting worlds .


fn_spacy_tokens_for_baseline: The French boy nudged Joseph as a tall , white - haired Moi who was obviously the village chieftain slowly descended the stepped tree trunk that led from his hut to the ground .

source_bert_toks: the french boy nudged joseph as a tall , white - haired moi who was obviously the village chieftain slowly descended the stepped tree trunk that led from his hut to the ground .

reference_raw: The French boy nudged Joseph as a tall, white-haired Moi, who seemed to be the chief of the village, walked slowly down the stepped trunk of a tree that led from his hut to the floor.

reference_spacy_tokens: The French boy nudged Joseph as a tall , white - haired Moi , who seemed to be the chief of the village , walked slowly down the stepped trunk of a tree that led from his hut to the floor .


fn_spacy_tokens_for_baseline: Well on Wednesday she sat in the ward waiting to be brought home .

source_bert_toks: well on wednesday she sat in the ward waiting to be brought home .

reference_raw: She was sitting in the department on Wednesday, waiting for someone to take her home.

reference_spacy_tokens: She was sitting in the department on Wednesday , waiting for someone to take her home .


fn_spacy_tokens_for_baseline: The Frenchwoman who was the major politician of the 1550s was therefore deeply in tune with two centuries of Scottish political tradition .

source_bert_toks: the french ##woman who was the major politician of the 1550 ##s was therefore deeply in tune with two centuries of scottish political tradition .

reference_raw: The French woman, who was the main politician of the 1550s, was therefore deeply in tune with the two centuries of Scottish political tradition.

reference_spacy_tokens: The French woman , who was the main politician of the 1550s , was therefore deeply in tune with the two centuries of Scottish political tradition .


fn_spacy_tokens_for_baseline: The saleswoman went over to a rack of ankle - length cottons in different colours .

source_bert_toks: the sales ##woman went over to a rack of ankle - length cotton ##s in different colours .

reference_raw: The salesman walked over to the ankle-length rack in various colors.

reference_spacy_tokens: The salesman walked over to the ankle - length rack in various colors .


fn_spacy_tokens_for_baseline: The slaughter in Colombia was very much on the minds of 450 editors and publishers from Latin America , the United States , the Caribbean and Canada attending the 45th general assembly of the Inter - American Press Association in Monterrey , Mexico , this week .

source_bert_toks: the slaughter in colombia was very much on the minds of 450 editors and publishers from latin america , the united states , the caribbean and canada attending the 45th general assembly of the inter - american press association in monterrey , mexico , this week .

reference_raw: In Colombia, 450 publishers and publishers from Latin America, the United States, the Caribbean and Canada attended the 45th general meeting of the Inter-American Press Association in Monterrey, Mexico this week.

reference_spacy_tokens: In Colombia , 450 publishers and publishers from Latin America , the United States , the Caribbean and Canada attended the 45th general meeting of the Inter - American Press Association in Monterrey , Mexico this week .


fn_spacy_tokens_for_baseline: I was obsessed with being flat - chested and unglamorous and I used to harp on about how he must be hankering for someone more glamorous . '

source_bert_toks: i was obsessed with being flat - chest ##ed and un ##gl ##amo ##rous and i used to harp on about how he must be hank ##ering for someone more g ##lam ##orous . '

reference_raw: I was obsessed with being flat-chested and unglamorous, and I kept harping on how he had to hang out with someone more charming.'

reference_spacy_tokens: I was obsessed with being flat - chested and unglamorous , and I kept harping on how he had to hang out with someone more charming . '


fn_spacy_tokens_for_baseline: After he had gone , Cassie went to the kitchen to run cold water over her arm and to bathe her cheek .

source_bert_toks: after he had gone , cassie went to the kitchen to run cold water over her arm and to bath ##e her cheek .

reference_raw: When he left, Cassie went into the kitchen, ran cold water over her arm, and washed her face.

reference_spacy_tokens: When he left , Cassie went into the kitchen , ran cold water over her arm , and washed her face .


fn_spacy_tokens_for_baseline: Interviewed by a Left - wing British journalist and television producer , Felix Greene , Ho declared : ' You have seen the country .

source_bert_toks: interviewed by a left - wing british journalist and television producer , felix greene , ho declared : ' you have seen the country .

reference_raw: Interviewed by a left-wing British journalist and television manufacturer, Felix Greene, Ho said, "You've seen the country.

reference_spacy_tokens: Interviewed by a left - wing British journalist and television manufacturer , Felix Greene , Ho said , " You 've seen the country .


fn_spacy_tokens_for_baseline: When the Soviet Union collapsed in December 1991 , Kazakhstan inherited 1,410 nuclear warheads and the Semipalatinsk nuclear weapon test site .

source_bert_toks: when the soviet union collapsed in december 1991 , kazakhstan inherited 1 , 410 nuclear war ##heads and the semi ##pala ##tin ##sk nuclear weapon test site .

reference_raw: At the time of the collapse of the Soviet Union in December 1991, Kazakhstan inherited 1,410 atomic warheads and a test site for Semipalatinsk.

reference_spacy_tokens: At the time of the collapse of the Soviet Union in December 1991 , Kazakhstan inherited 1,410 atomic warheads and a test site for Semipalatinsk .


fn_spacy_tokens_for_baseline: In acute cases , the babies are born addicted to cocaine .

source_bert_toks: in acute cases , the babies are born addicted to cocaine .

reference_raw: In acute cases, children are born cocaine-dependent.

reference_spacy_tokens: In acute cases , children are born cocaine - dependent .


fn_spacy_tokens_for_baseline: The peace which ended this episode was not concluded until 1669 .

source_bert_toks: the peace which ended this episode was not concluded until 166 ##9 .

reference_raw: The peace that ended this episode came to an end in 1669.

reference_spacy_tokens: The peace that ended this episode came to an end in 1669 .


fn_spacy_tokens_for_baseline: The struggle against the drug lords in Colombia will be a near thing .

source_bert_toks: the struggle against the drug lords in colombia will be a near thing .

reference_raw: Fighting drug lords in Colombia will be close.

reference_spacy_tokens: Fighting drug lords in Colombia will be close .


fn_spacy_tokens_for_baseline: At the back of his premises he owned a used - car lot which faced on a less fashionable avenue , and here he sold second - hand cars , trucks and motorboats .

source_bert_toks: at the back of his premises he owned a used - car lot which faced on a less fashionable avenue , and here he sold second - hand cars , trucks and motor ##boats .

reference_raw: He had a used-car lot in the back of his apartment, facing a less fashionable street, and here he sold used cars, trucks, and motorboats.

reference_spacy_tokens: He had a used - car lot in the back of his apartment , facing a less fashionable street , and here he sold used cars , trucks , and motorboats .


fn_spacy_tokens_for_baseline: ' I 'm gratified to find you so concerned for my welfare , Li Yuan .

source_bert_toks: ' i ' m gr ##ati ##fied to find you so concerned for my welfare , li yuan .

reference_raw: 'I'm glad you're so concerned about my well-being, Li Yuan.

reference_spacy_tokens: ' I 'm glad you 're so concerned about my well - being , Li Yuan .


fn_spacy_tokens_for_baseline: China possesses nuclear weapons , a range of ballistic missile capabilities , and the ability to develop chemical and biological weapons .

source_bert_toks: china possesses nuclear weapons , a range of ballistic missile capabilities , and the ability to develop chemical and biological weapons .

reference_raw: China has nuclear weapons, a number of ballistic missile capabilities, and the ability to develop chemical and biological weapons.

reference_spacy_tokens: China has nuclear weapons , a number of ballistic missile capabilities , and the ability to develop chemical and biological weapons .


fn_spacy_tokens_for_baseline: On the other hand , Ceolred 's attack on Ine demonstrated the harsher reality of that desire for military prestige and territorial aggrandizement which is the more constant feature of Anglo - Saxon political history in this period .

source_bert_toks: on the other hand , ceo ##lr ##ed ' s attack on in ##e demonstrated the harsh ##er reality of that desire for military prestige and territorial ag ##gra ##ndi ##ze ##ment which is the more constant feature of anglo - saxon political history in this period .

reference_raw: On the other hand, Ceolred's attack on Ine has shown that this desire for military prestige and territorial aggression is a more permanent feature of Anglo-Saxon political history during this period.

reference_spacy_tokens: On the other hand , Ceolred 's attack on Ine has shown that this desire for military prestige and territorial aggression is a more permanent feature of Anglo - Saxon political history during this period .


fn_spacy_tokens_for_baseline: When the kettle boiled , she made two cups of instant coffee .

source_bert_toks: when the kettle boiled , she made two cups of instant coffee .

reference_raw: She cooked two cups of instant coffee as the kettle boiled.

reference_spacy_tokens: She cooked two cups of instant coffee as the kettle boiled .


fn_spacy_tokens_for_baseline: Some anorexics combine fasting with occasional binges , followed by self - induced purging or vomiting .

source_bert_toks: some an ##ore ##xi ##cs combine fast ##ing with occasional bing ##es , followed by self - induced pu ##rg ##ing or vomiting .

reference_raw: Some anorexics associate fasting with occasional beings, followed by self-induced cleansing or vomiting.

reference_spacy_tokens: Some anorexics associate fasting with occasional beings , followed by self - induced cleansing or vomiting .


fn_spacy_tokens_for_baseline: This will radically alter the use of videoconferencing .

source_bert_toks: this will radically alter the use of video ##con ##fer ##en ##cing .

reference_raw: This will radically change the use of videoconferencing.

reference_spacy_tokens: This will radically change the use of videoconferencing .


fn_spacy_tokens_for_baseline: But it was one of the twins , in fluffy pyjamas , who flitted across the landing like a moth , eyes half - shut under the electric light .

source_bert_toks: but it was one of the twins , in fluffy p ##y ##ja ##mas , who fl ##itte ##d across the landing like a moth , eyes half - shut under the electric light .

reference_raw: But he was one of the twins, in their fluffy pajamas, flying over the landing like a moth, their eyes half closed in the electric light.

reference_spacy_tokens: But he was one of the twins , in their fluffy pajamas , flying over the landing like a moth , their eyes half closed in the electric light .


fn_spacy_tokens_for_baseline: ' We 've bin nabbed ! ' he gasped out to Frankie .

source_bert_toks: ' we ' ve bin na ##bbed ! ' he gasped out to frankie .

reference_raw: 'Bin nabbed!' he said to Frankie.

reference_spacy_tokens: ' Bin nabbed ! ' he said to Frankie .


fn_spacy_tokens_for_baseline: The final day of this particular stream then looks at entrepreneurship in IT .

source_bert_toks: the final day of this particular stream then looks at entrepreneurship in it .

reference_raw: The last day of this particular stream will then look at business in IT.

reference_spacy_tokens: The last day of this particular stream will then look at business in IT .


fn_spacy_tokens_for_baseline: At Monterrey , publisher Luis Gabriel Cano , although shaken by the murders , issued a statement saying : " We will not cease our fight against drug trafficking .

source_bert_toks: at monterrey , publisher luis gabriel can ##o , although shaken by the murders , issued a statement saying : " we will not cease our fight against drug trafficking .

reference_raw: In Monterrey, publisher Luis Gabriel Cano, though shaken by the murders, issued a statement saying, "We will not stop fighting drug trafficking.

reference_spacy_tokens: In Monterrey , publisher Luis Gabriel Cano , though shaken by the murders , issued a statement saying , " We will not stop fighting drug trafficking .


fn_spacy_tokens_for_baseline: The war drums throbbed , a muffled , far - carrying , never - ceasing sound that thrilled me to the core ; the five - foot trumpets brayed .

source_bert_toks: the war drums throbbed , a muffled , far - carrying , never - ce ##asi ##ng sound that thrilled me to the core ; the five - foot trumpets bray ##ed .

reference_raw: The war drums were throbbing, a muffled, distant, never-ending sound that excited me to the core; the five-foot pipes were braying.

reference_spacy_tokens: The war drums were throbbing , a muffled , distant , never - ending sound that excited me to the core ; the five - foot pipes were braying .


fn_spacy_tokens_for_baseline: In the years after the Twenty - One Demands Japanese governments tended to adopt a more indirect approach in their attempts to exert Japanese influence in China .

source_bert_toks: in the years after the twenty - one demands japanese governments tended to adopt a more indirect approach in their attempts to ex ##ert japanese influence in china .

reference_raw: In the years following the twenty-one demand, Japanese governments tended to take a more indirect approach in their attempts to exert Japanese power in China.

reference_spacy_tokens: In the years following the twenty - one demand , Japanese governments tended to take a more indirect approach in their attempts to exert Japanese power in China .


fn_spacy_tokens_for_baseline: Jaq wished that he himself could slumber .

source_bert_toks: ja ##q wished that he himself could sl ##umber .

reference_raw: Jaq wished he could sleep himself.

reference_spacy_tokens: Jaq wished he could sleep himself .


fn_spacy_tokens_for_baseline: I refuse to be mollified with coffee .

source_bert_toks: i refuse to be mo ##lli ##fied with coffee .

reference_raw: I refuse to be comforted by coffee.

reference_spacy_tokens: I refuse to be comforted by coffee .


fn_spacy_tokens_for_baseline: And finally the Danube dances past Vienna , home of the waltz , great composers and superb cream cakes !

source_bert_toks: and finally the danube dances past vienna , home of the waltz , great composers and superb cream cakes !

reference_raw: And finally, Danube is dancing around Vienna, home of a waltz, big composers and delicious cream cakes!

reference_spacy_tokens: And finally , Danube is dancing around Vienna , home of a waltz , big composers and delicious cream cakes !


fn_spacy_tokens_for_baseline: Here , a small clump of scarlet tulips brings a disproportionate flash of brilliance to a spring dalliance of Daphne mezereum , muscari , erythronium and Magnolia stellata

source_bert_toks: here , a small cl ##ump of scarlet tu ##lip ##s brings a di ##sp ##rop ##ort ##ion ##ate flash of brilliance to a spring dal ##lian ##ce of daphne me ##zer ##eum , mu ##sca ##ri , er ##yt ##hr ##oni ##um and magnolia stella ##ta

reference_raw: Here, a small cluster of scarlet tulips brings a disproportionate flash of brightness to the spring dalliance of Daphne Mezereum, Muscari, Erythronium and Magnolia stellata.

reference_spacy_tokens: Here , a small cluster of scarlet tulips brings a disproportionate flash of brightness to the spring dalliance of Daphne Mezereum , Muscari , Erythronium and Magnolia stellata .


fn_spacy_tokens_for_baseline: In Italy , that means cloth from Biella , an ageing industrial town crumbling into the River Cervo on the edge of the Piedmontese Alps northwest of Milan .

source_bert_toks: in italy , that means cloth from bi ##ella , an age ##ing industrial town crumbling into the river ce ##r ##vo on the edge of the piedmont ##ese alps northwest of milan .

reference_raw: In Italy, this means the fabric of Biella, an aging industrial city crumbling into the Cervo River on the edge of the Piedmontese Alps north-west of Milan.

reference_spacy_tokens: In Italy , this means the fabric of Biella , an aging industrial city crumbling into the Cervo River on the edge of the Piedmontese Alps north - west of Milan .


fn_spacy_tokens_for_baseline: The implications of this astonished me .

source_bert_toks: the implications of this astonished me .

reference_raw: I was surprised by the consequences.

reference_spacy_tokens: I was surprised by the consequences .


fn_spacy_tokens_for_baseline: Pascoe sighed as he took his sodden riding mac off the radiator .

source_bert_toks: pas ##coe sighed as he took his so ##dden riding mac off the ra ##dia ##tor .

reference_raw: Pascoe sighed and removed his wet riding mac from the radiator.

reference_spacy_tokens: Pascoe sighed and removed his wet riding mac from the radiator .


fn_spacy_tokens_for_baseline: He had on ripped jeans , a sweatshirt and an old pair of training shoes .

source_bert_toks: he had on ripped jeans , a sweatshirt and an old pair of training shoes .

reference_raw: He was wearing torn jeans, a sweatshirt, and an old pair of training boots.

reference_spacy_tokens: He was wearing torn jeans , a sweatshirt , and an old pair of training boots .


fn_spacy_tokens_for_baseline: He slanted her a thoughtfully challenging look .

source_bert_toks: he slant ##ed her a thoughtfully challenging look .

reference_raw: He gave her a thoughtful, challenging glance.

reference_spacy_tokens: He gave her a thoughtful , challenging glance .


fn_spacy_tokens_for_baseline: The court cleared Novodvorskaya of a separate charge of ' insulting the honour and dignity of the USSR President ' .

source_bert_toks: the court cleared novo ##d ##vor ##skaya of a separate charge of ' insulting the honour and dignity of the ussr president ' .

reference_raw: The court exonerated Novodvorskaya from a separate charge of insulting the honor and dignity of the President of the USSR.

reference_spacy_tokens: The court exonerated Novodvorskaya from a separate charge of insulting the honor and dignity of the President of the USSR .


fn_spacy_tokens_for_baseline: These bunkers were constructed in 1966 for the express purpose of preventing Nicklaus from taking this route .

source_bert_toks: these bunker ##s were constructed in 1966 for the express purpose of preventing nick ##laus from taking this route .

reference_raw: They were built in 1966 to prevent Nicklaus from taking that route.

reference_spacy_tokens: They were built in 1966 to prevent Nicklaus from taking that route .


fn_spacy_tokens_for_baseline: He immediately chartered a plane to take him to Paris the next day and made his meeting .

source_bert_toks: he immediately chartered a plane to take him to paris the next day and made his meeting .

reference_raw: Instantly, he hired a plane to take him to Paris the next day and made an appointment.

reference_spacy_tokens: Instantly , he hired a plane to take him to Paris the next day and made an appointment .


fn_spacy_tokens_for_baseline: Third , it seems that most adults are predisposed to respond to infants as social beings , and they are prepared to spend a considerable amount of time and energy in establishing a degree of social rapport .

source_bert_toks: third , it seems that most adults are pre ##dis ##posed to respond to infants as social beings , and they are prepared to spend a considerable amount of time and energy in establishing a degree of social rap ##port .

reference_raw: Third, most adults appear to be ready to respond to infants as social beings and are ready to spend a considerable amount of time and energy on establishing a certain level of social relationship.

reference_spacy_tokens: Third , most adults appear to be ready to respond to infants as social beings and are ready to spend a considerable amount of time and energy on establishing a certain level of social relationship .


fn_spacy_tokens_for_baseline: Considerable though the distance was across the metropolis , I sensed that the cultural and historical boundaries we traversed were of far greater significance .

source_bert_toks: considerable though the distance was across the metropolis , i sensed that the cultural and historical boundaries we traversed were of far greater significance .

reference_raw: Considerable though the distance was beyond the metropolis, I felt that the cultural and historical boundaries we crossed were far more important.

reference_spacy_tokens: Considerable though the distance was beyond the metropolis , I felt that the cultural and historical boundaries we crossed were far more important .


fn_spacy_tokens_for_baseline: Kylie is cool and she is in control .

source_bert_toks: kylie is cool and she is in control .

reference_raw: Kylie's fine, and she's got it under control.

reference_spacy_tokens: Kylie 's fine , and she 's got it under control .


fn_spacy_tokens_for_baseline: Just to the east of the financial district , Wan Chai was once an area of sleazy clubs and topless bars ; this was the setting for The World of Suzy Wong .

source_bert_toks: just to the east of the financial district , wan cha ##i was once an area of sl ##ea ##zy clubs and top ##less bars ; this was the setting for the world of suzy wong .

reference_raw: Just east of the financial precinct, Wan Chai had once been an area of sleazy clubs and topless bars; this was the setting for the world of Suzy Wong.

reference_spacy_tokens: Just east of the financial precinct , Wan Chai had once been an area of sleazy clubs and topless bars ; this was the setting for the world of Suzy Wong .


fn_spacy_tokens_for_baseline: It is important to eat enough to prevent you from feeling hungry between meals .

source_bert_toks: it is important to eat enough to prevent you from feeling hungry between meals .

reference_raw: It's important to eat enough to keep you from starving between meals.

reference_spacy_tokens: It 's important to eat enough to keep you from starving between meals .


fn_spacy_tokens_for_baseline: ' Important to whom -- to Master Peachey ? " demanded Anne , thereby suggesting that she held the opinions of their tutor in contempt . ' ' T IS certainly of no importance to myself -- and I 'd wager't is of no importance to Prince Edward either .

source_bert_toks: ' important to whom - - to master peach ##ey ? " demanded anne , thereby suggesting that she held the opinions of their tutor in contempt . ' ' t is certainly of no importance to myself - - and i ' d wage ##r ' t is of no importance to prince edward either .

reference_raw: 'Important to whom - to Master Peachey?' asked Anne, suggesting that she held her teacher's opinions in contempt.' ''I'm sure it doesn't matter to me - and I bet Prince Edward doesn't care.

reference_spacy_tokens: ' Important to whom - to Master Peachey ? ' asked Anne , suggesting that she held her teacher 's opinions in contempt . ' ' ' I 'm sure it does n't matter to me - and I bet Prince Edward does n't care .


fn_spacy_tokens_for_baseline: When David was Adam 's age he 'd taken to lighting joss sticks in his bedroom and anointing himself with patchouli , assuming that it disguised the faint but unmistakeable musty - sweet aroma that was exuded from his pores and lingered in the atmosphere .

source_bert_toks: when david was adam ' s age he ' d taken to lighting jo ##ss sticks in his bedroom and an ##oint ##ing himself with patch ##ou ##li , assuming that it disguised the faint but un ##mist ##ake ##able must ##y - sweet aroma that was ex ##uded from his por ##es and lingered in the atmosphere .

reference_raw: When David was Adam's age, he had taken to lighting joss sticks in his bedroom and anointing himself with patchouli, assuming that he masked the faint but unmistakable, musty-sweet aroma that had come out of his pores and lingered in the atmosphere.

reference_spacy_tokens: When David was Adam 's age , he had taken to lighting joss sticks in his bedroom and anointing himself with patchouli , assuming that he masked the faint but unmistakable , musty - sweet aroma that had come out of his pores and lingered in the atmosphere .


fn_spacy_tokens_for_baseline: I get a sickening feeling in my stomach .

source_bert_toks: i get a sick ##ening feeling in my stomach .

reference_raw: I feel sick in my stomach.

reference_spacy_tokens: I feel sick in my stomach .


fn_spacy_tokens_for_baseline: Both they and Felco achieve their cut by curved blades that slice with a scimitar - like action .

source_bert_toks: both they and fe ##lco achieve their cut by curved blades that slice with a sci ##mit ##ar - like action .

reference_raw: Both he and Felco achieve their incision with curved blades that slice with scimitar-like action.

reference_spacy_tokens: Both he and Felco achieve their incision with curved blades that slice with scimitar - like action .


fn_spacy_tokens_for_baseline: They had fetched him for Christmas and he was staying on for the New Year .

source_bert_toks: they had fetch ##ed him for christmas and he was staying on for the new year .

reference_raw: They brought him for Christmas, and he stayed for New Year's Eve.

reference_spacy_tokens: They brought him for Christmas , and he stayed for New Year 's Eve .


fn_spacy_tokens_for_baseline: The Trustee referred him to the Blue Triangle where he consulted Goodwill 's Career Academy staff for job search assistance .

source_bert_toks: the trustee referred him to the blue triangle where he consulted goodwill ' s career academy staff for job search assistance .

reference_raw: The administrator recommended him to the Blue Triangle, where he consulted the staff of Goodwill's Career Academy to help him find a job.

reference_spacy_tokens: The administrator recommended him to the Blue Triangle , where he consulted the staff of Goodwill 's Career Academy to help him find a job .


fn_spacy_tokens_for_baseline: The expert 's advantage is in his easy access to the evidence and in his better ability to grasp its significance .

source_bert_toks: the expert ' s advantage is in his easy access to the evidence and in his better ability to grasp its significance .

reference_raw: The advantage of an expert is that he has easy access to the evidence and that he is better able to understand its meaning.

reference_spacy_tokens: The advantage of an expert is that he has easy access to the evidence and that he is better able to understand its meaning .


fn_spacy_tokens_for_baseline: ' I 'm gratified , ' said Mr Stanforth , with only the mildest irony , ' that your judgement agrees with mine .

source_bert_toks: ' i ' m gr ##ati ##fied , ' said mr stan ##forth , with only the mild ##est irony , ' that your judgement agrees with mine .

reference_raw: "I am grateful," said Mr. Stanforth, with only the mildest irony, "that your judgment is in agreement with mine.

reference_spacy_tokens: " I am grateful , " said Mr. Stanforth , with only the mildest irony , " that your judgment is in agreement with mine .


fn_spacy_tokens_for_baseline: Then she saw Gazzer , stamping about like a loony , feet flying in all directions .

source_bert_toks: then she saw ga ##zz ##er , stamp ##ing about like a lo ##ony , feet flying in all directions .

reference_raw: Then she saw Gazzer stumbling around like a madman, his feet flying in all directions.

reference_spacy_tokens: Then she saw Gazzer stumbling around like a madman , his feet flying in all directions .


fn_spacy_tokens_for_baseline: Famous brand names include Coca Cola , Biro and Hoover , all of which have become synonymous with certain categories of products , whether produced by them or by their competitors .

source_bert_toks: famous brand names include coca cola , bi ##ro and hoover , all of which have become synonymous with certain categories of products , whether produced by them or by their competitors .

reference_raw: The famous trademarks include Coca Cola, Biro and Hoover, all of which have become synonymous with certain categories of products, whether manufactured by them or by their competitors.

reference_spacy_tokens: The famous trademarks include Coca Cola , Biro and Hoover , all of which have become synonymous with certain categories of products , whether manufactured by them or by their competitors .


fn_spacy_tokens_for_baseline: To some extent , it broke new ground by placing emphasis on organic wastes , such as food scraps and garden litter , which make up over half of all household waste .

source_bert_toks: to some extent , it broke new ground by placing emphasis on organic waste ##s , such as food scrap ##s and garden litter , which make up over half of all household waste .

reference_raw: To a certain extent, it has broken new soils by placing emphasis on organic waste, such as food waste and garden litter, which account for more than half of all household waste.

reference_spacy_tokens: To a certain extent , it has broken new soils by placing emphasis on organic waste , such as food waste and garden litter , which account for more than half of all household waste .


fn_spacy_tokens_for_baseline: When you and I help somebody find a job , one more person joins the ranks of tax payers , fewer tax dollars are spent on public assistance and businesses gain another consumer .

source_bert_toks: when you and i help somebody find a job , one more person joins the ranks of tax pay ##ers , fewer tax dollars are spent on public assistance and businesses gain another consumer .

reference_raw: If we help someone find a job, one more person will join the taxpayers' ranks, less tax dollars will be spent on public aid, and businesses will get another consumer.

reference_spacy_tokens: If we help someone find a job , one more person will join the taxpayers ' ranks , less tax dollars will be spent on public aid , and businesses will get another consumer .


fn_spacy_tokens_for_baseline: The inherited immunodeficiency disease leucocyte adhesion deficiency is characterised by pronounced granulocytosis , lack of pus formation , mobilisation of neutrophils and monocytes to inflammatory sites , severe gingivitis , and recurrent or progressive soft tissue infections .

source_bert_toks: the inherited im ##mun ##ode ##fi ##ciency disease le ##uc ##oc ##yte ad ##hesion deficiency is characterised by pronounced gran ##ulo ##cy ##tosis , lack of pu ##s formation , mob ##ilis ##ation of ne ##ut ##rop ##hil ##s and mono ##cytes to inflammatory sites , severe gin ##gi ##vi ##tis , and rec ##urrent or progressive soft tissue infections .

reference_raw: Leucocyte adhesion deficiency is characterised by severe granulocytosis, lack of pus formation, mobilisation of neutrophils and monocytes to inflammatory sites, severe gingivitis, and repeated or progressive soft tissue infections.

reference_spacy_tokens: Leucocyte adhesion deficiency is characterised by severe granulocytosis , lack of pus formation , mobilisation of neutrophils and monocytes to inflammatory sites , severe gingivitis , and repeated or progressive soft tissue infections .


fn_spacy_tokens_for_baseline: With each blast came a drizzle of hot stinging ash , which settled on our eyelashes and blistered their roots .

source_bert_toks: with each blast came a dr ##iz ##zle of hot stinging ash , which settled on our eyelashes and b ##list ##ered their roots .

reference_raw: With each blast came a drizzle of hot ash that settled on our eyelashes and blistered their roots.

reference_spacy_tokens: With each blast came a drizzle of hot ash that settled on our eyelashes and blistered their roots .


fn_spacy_tokens_for_baseline: A Central Management Committee was set up for the Government legal service and , as senior Government lawyer , it fell to Ware to be chairman of this and to become head of the parallel Legal Career Service .

source_bert_toks: a central management committee was set up for the government legal service and , as senior government lawyer , it fell to ware to be chairman of this and to become head of the parallel legal career service .

reference_raw: A central management committee for the legal service of the government was established and, as a senior legal representative of the government, it fell to Ware to chair it and become the head of the parallel legal service.

reference_spacy_tokens: A central management committee for the legal service of the government was established and , as a senior legal representative of the government , it fell to Ware to chair it and become the head of the parallel legal service .


fn_spacy_tokens_for_baseline: The Co Armagh men were boating on Lough Lannagh in Co Mayo at the time .

source_bert_toks: the co armagh men were boating on lough lan ##na ##gh in co mayo at the time .

reference_raw: At that time, the men of Co Armagh sailed on Lough Lannagh in Co Mayo.

reference_spacy_tokens: At that time , the men of Co Armagh sailed on Lough Lannagh in Co Mayo .


fn_spacy_tokens_for_baseline: Last night had been a glorious voyage of discovery to a new land , revealing wonders never dreamt of .

source_bert_toks: last night had been a glorious voyage of discovery to a new land , revealing wonders never dream ##t of .

reference_raw: Last night was a glorious journey of discovery to a new country, revealing wonders that had never dreamt of.

reference_spacy_tokens: Last night was a glorious journey of discovery to a new country , revealing wonders that had never dreamt of .


fn_spacy_tokens_for_baseline: Because stigmas mirror culture and society , they are in constant flux , and therefore the answers to these two questions continue to elude social scientists ' ( Ainsley et al . ,

source_bert_toks: because stigma ##s mirror culture and society , they are in constant flux , and therefore the answers to these two questions continue to el ##ude social scientists ' ( ain ##sley et al . ,

reference_raw: Since stigmas reflect culture and society, they are in constant flux, so the answers to these two questions are still missing the social scientists (Ainsley et al.

reference_spacy_tokens: Since stigmas reflect culture and society , they are in constant flux , so the answers to these two questions are still missing the social scientists ( Ainsley et al .


fn_spacy_tokens_for_baseline: they do n't add anything what about you

source_bert_toks: they don ' t add anything what about you

reference_raw: they don't say anything about you.

reference_spacy_tokens: they do n't say anything about you .


fn_spacy_tokens_for_baseline: This traumatic experience had such a shattering effect on the porter that he left London Transport for good , swearing never to visit Covent Garden Station again .

source_bert_toks: this traumatic experience had such a shattering effect on the porter that he left london transport for good , swearing never to visit covent garden station again .

reference_raw: The traumatized experience had such a devastating effect on the porter that he had left London Transport once and for all, swearing that he would never visit Covent Garden Station again.

reference_spacy_tokens: The traumatized experience had such a devastating effect on the porter that he had left London Transport once and for all , swearing that he would never visit Covent Garden Station again .


fn_spacy_tokens_for_baseline: Because she was beautiful , with her flaxen blonde hair tumbling down her back and those unusual dark eyes and eyebrows that gave her a look of the exotic .

source_bert_toks: because she was beautiful , with her fl ##ax ##en blonde hair tumbling down her back and those unusual dark eyes and eyebrows that gave her a look of the exotic .

reference_raw: Because she was beautiful, with flaxy blond hair tumbling down her back and those unusually dark eyes and eyebrows that made her look exotic.

reference_spacy_tokens: Because she was beautiful , with flaxy blond hair tumbling down her back and those unusually dark eyes and eyebrows that made her look exotic .


fn_spacy_tokens_for_baseline: In our series , the mean age was higher ( 63 years ) , and the male to female ratio was lower ( 3.1:1 ) than reported , but still indicated a male predominance .

source_bert_toks: in our series , the mean age was higher ( 63 years ) , and the male to female ratio was lower ( 3 . 1 : 1 ) than reported , but still indicated a male pre ##dom ##ina ##nce .

reference_raw: In our series, the average age was greater (63 years) and the male/female ratio was lower (3.1:1) than reported, but still indicated male predominance.

reference_spacy_tokens: In our series , the average age was greater ( 63 years ) and the male / female ratio was lower ( 3.1:1 ) than reported , but still indicated male predominance .


fn_spacy_tokens_for_baseline: Such situations might include the routine repeat purchase of washing up liquid , sweets or cigarettes .

source_bert_toks: such situations might include the routine repeat purchase of washing up liquid , sweets or cigarettes .

reference_raw: Such situations may include routine re-buying of liquids, sweets or cigarettes.

reference_spacy_tokens: Such situations may include routine re - buying of liquids , sweets or cigarettes .


fn_spacy_tokens_for_baseline: Try smearing the spanner jaws with light oil , then dipping them in fine sand .

source_bert_toks: try sm ##earing the span ##ner jaws with light oil , then dipping them in fine sand .

reference_raw: See if you can smear the spanner's jaws with light oil and then dip them in fine sand.

reference_spacy_tokens: See if you can smear the spanner 's jaws with light oil and then dip them in fine sand .


fn_spacy_tokens_for_baseline: The sergeant considered , shrugged and gestured for the old man 's papers .

source_bert_toks: the sergeant considered , shrugged and gestured for the old man ' s papers .

reference_raw: The sergeant thought about it, shrugged, and motioned for the old man's papers.

reference_spacy_tokens: The sergeant thought about it , shrugged , and motioned for the old man 's papers .


fn_spacy_tokens_for_baseline: What frightens you most about London ?

source_bert_toks: what fright ##ens you most about london ?

reference_raw: What scares you the most about London?

reference_spacy_tokens: What scares you the most about London ?


fn_spacy_tokens_for_baseline: A soft white muslin that , when Tsu Ma knelt and gently brushed it with his fingertips , reminded him strangely of springtime and the smell of young girls .

source_bert_toks: a soft white mu ##slin that , when ts ##u ma knelt and gently brushed it with his fingertips , reminded him strangely of spring ##time and the smell of young girls .

reference_raw: A soft white muslin that reminded him strangely of springtime and the smell of young girls as Tsu Ma knelt and gently brushed it with his fingers.

reference_spacy_tokens: A soft white muslin that reminded him strangely of springtime and the smell of young girls as Tsu Ma knelt and gently brushed it with his fingers .


fn_spacy_tokens_for_baseline: I 've got notes to write up and Madame Gebrec 's book to read . '

source_bert_toks: i ' ve got notes to write up and madame ge ##bre ##c ' s book to read . '

reference_raw: I have to take notes and read Madame Gebrec's book.'

reference_spacy_tokens: I have to take notes and read Madame Gebrec 's book . '


fn_spacy_tokens_for_baseline: Unlike the strongmen who fell to street demonstrations in Tunisia and Egypt , Kadafi all but launched a war against his country 's civilian population to maintain control of the oil - rich nation .

source_bert_toks: unlike the strong ##men who fell to street demonstrations in tunisia and egypt , ka ##da ##fi all but launched a war against his country ' s civilian population to maintain control of the oil - rich nation .

reference_raw: Unlike the Fortress who had fallen to street protests in Tunisia and Egypt, Kadafi had all but launched a war against the civilian population of his country in order to maintain control of the oil-rich nation.

reference_spacy_tokens: Unlike the Fortress who had fallen to street protests in Tunisia and Egypt , Kadafi had all but launched a war against the civilian population of his country in order to maintain control of the oil - rich nation .


fn_spacy_tokens_for_baseline: ' The cursed and criminal Bush admits defeat ' Baghdad Radio gloated .

source_bert_toks: ' the cursed and criminal bush admits defeat ' baghdad radio g ##lo ##ated .

reference_raw: 'Accursed and criminal Bush admits defeat,' said Baghdad Radio.

reference_spacy_tokens: ' Accursed and criminal Bush admits defeat , ' said Baghdad Radio .


fn_spacy_tokens_for_baseline: Some sort of warped vengeance for him being your mistress 's previous lover ? '

source_bert_toks: some sort of warped vengeance for him being your mistress ' s previous lover ? '

reference_raw: Some kind of twisted revenge for being the previous lover of your mistress?'

reference_spacy_tokens: Some kind of twisted revenge for being the previous lover of your mistress ? '


fn_spacy_tokens_for_baseline: And this Republican led Senate intelligence committee refuses to even ask the hard questions about the misinformation -

source_bert_toks: and this republican led senate intelligence committee refuses to even ask the hard questions about the mis ##in ##form ##ation -

reference_raw: And this Republican presided over the Senate Secret Service Committee refuses to ask hard questions about misinformation -


fn_spacy_tokens_for_baseline: ' Nicolo , ' she sputtered , ' you -- you -- '

source_bert_toks: ' nico ##lo , ' she sp ##uttered , ' you - - you - - '

reference_raw: "Nicolo," she said, "you -- you --"

reference_spacy_tokens: " Nicolo , " she said , " you -- you -- "


fn_spacy_tokens_for_baseline: A model of the new £ 11 million building , which will have 43 kilometres of shelving , was unveiled yesterday by the Scottish minister of state , Lord Fraser .

source_bert_toks: a model of the new £1 ##1 million building , which will have 43 kilometres of she ##lving , was unveiled yesterday by the scottish minister of state , lord fraser .

reference_raw: Yesterday, the Scottish Minister of State, Lord Fraser, revealed a model of a new £11 million building with 43 kilometers of shelves.

reference_spacy_tokens: Yesterday , the Scottish Minister of State , Lord Fraser , revealed a model of a new £ 11 million building with 43 kilometers of shelves .


fn_spacy_tokens_for_baseline: The interior is a comfortable amalgam of Chinese and Western design , with an impressive main lobby .

source_bert_toks: the interior is a comfortable ama ##lga ##m of chinese and western design , with an impressive main lobby .

reference_raw: The interior is a comfortable amalgam of Chinese and Western design, with a formidable main hall.

reference_spacy_tokens: The interior is a comfortable amalgam of Chinese and Western design , with a formidable main hall .


fn_spacy_tokens_for_baseline: Just to the east of these mills is the now derelict Waulk Mill cottage .

source_bert_toks: just to the east of these mills is the now derelict wa ##ul ##k mill cottage .

reference_raw: There's a now abandoned house in Waulk Mill just south of the mills.

reference_spacy_tokens: There 's a now abandoned house in Waulk Mill just south of the mills .


fn_spacy_tokens_for_baseline: The most obvious tactical use of chemical weapons by the DPRK would be to terrorize South Korean civilians .

source_bert_toks: the most obvious tactical use of chemical weapons by the d ##pr ##k would be to terror ##ize south korean civilians .

reference_raw: The most obvious tactical use of chemical weapons by the People's Republic of Korea would be the terror of South Korean civilians.

reference_spacy_tokens: The most obvious tactical use of chemical weapons by the People 's Republic of Korea would be the terror of South Korean civilians .


fn_spacy_tokens_for_baseline: Or drive south from Ramsey to Douglas on a road that snakes upwards into the collar of cloud that rests on the shoulders of Snaefell , the highest mountain on Man .

source_bert_toks: or drive south from ramsey to douglas on a road that snakes upwards into the collar of cloud that rests on the shoulders of s ##nae ##fell , the highest mountain on man .

reference_raw: Or go south from Ramsey to Douglas on a road that serpents into the collar of a cloud that rests on the shoulders of Snaefell, the highest mountain on Man.

reference_spacy_tokens: Or go south from Ramsey to Douglas on a road that serpents into the collar of a cloud that rests on the shoulders of Snaefell , the highest mountain on Man .


fn_spacy_tokens_for_baseline: Mortars are shorter , heavier weapons than cannons , designed to lob an explosive shell high into the air so that it drops down on the target from the sky .

source_bert_toks: mortar ##s are shorter , heavier weapons than cannons , designed to lo ##b an explosive shell high into the air so that it drops down on the target from the sky .

reference_raw: The mortars are smaller, heavier weapons than the cannons, designed to lob an explosive shell high in the air, so that it falls from the sky to the target.

reference_spacy_tokens: The mortars are smaller , heavier weapons than the cannons , designed to lob an explosive shell high in the air , so that it falls from the sky to the target .


fn_spacy_tokens_for_baseline: Profound technological developments have already critically restructured the economies of developed societies from the production of things to the production of knowledge .

source_bert_toks: profound technological developments have already critically rest ##ructured the economies of developed societies from the production of things to the production of knowledge .

reference_raw: Deep technological developments have already critically shifted the economies of developed societies from the production of things to the production of knowledge.

reference_spacy_tokens: Deep technological developments have already critically shifted the economies of developed societies from the production of things to the production of knowledge .


fn_spacy_tokens_for_baseline: If supplies are not reaching the people who need them , Hall said , he wanted to find out whether the United Nations or relief agencies needed to handle things differently , or whether " Iraq needs to get out of the way and let us do the job . "

source_bert_toks: if supplies are not reaching the people who need them , hall said , he wanted to find out whether the united nations or relief agencies needed to handle things differently , or whether " iraq needs to get out of the way and let us do the job . "

reference_raw: If the supplies don't reach the people who need them, Hall said, he wants to know if the UN or the relief services need to deal with things differently, or if "Iraq needs to get out of the way and let us do our job."

reference_spacy_tokens: If the supplies do n't reach the people who need them , Hall said , he wants to know if the UN or the relief services need to deal with things differently , or if " Iraq needs to get out of the way and let us do our job . "


fn_spacy_tokens_for_baseline: At sea the larger Chinese fleet rapidly yielded dominance to a better trained and up - to - date Japanese counterpart .

source_bert_toks: at sea the larger chinese fleet rapidly yielded dominance to a better trained and up - to - date japanese counterpart .

reference_raw: At sea, the larger Chinese fleet quickly surrendered dominance to a better-trained and modern Japanese counterpart.

reference_spacy_tokens: At sea , the larger Chinese fleet quickly surrendered dominance to a better - trained and modern Japanese counterpart .


fn_spacy_tokens_for_baseline: In a few days time we 'll be sitting him on top of a bonfire and standing around in the cold night while we light up the sky with loads of colour .

source_bert_toks: in a few days time we ' ll be sitting him on top of a bonfire and standing around in the cold night while we light up the sky with loads of colour .

reference_raw: In a few days, we'll put him on the fire and stand here in the cold night while we light the sky with a lot of color.

reference_spacy_tokens: In a few days , we 'll put him on the fire and stand here in the cold night while we light the sky with a lot of color .


fn_spacy_tokens_for_baseline: It is nice for teachers to think they are engaged in " personality development " and even nicer to minimize those irksome tests with often disappointing results .

source_bert_toks: it is nice for teachers to think they are engaged in " personality development " and even nice ##r to minimize those ir ##ks ##ome tests with often disappointing results .

reference_raw: It's nice for teachers to think that they're involved in the development of personality, and even better to minimise these irksome tests with often unsatisfactory results.

reference_spacy_tokens: It 's nice for teachers to think that they 're involved in the development of personality , and even better to minimise these irksome tests with often unsatisfactory results .


fn_spacy_tokens_for_baseline: Relatively late discontinuation of treatment could be a reason for the unfavourable outcome in some cases .

source_bert_toks: relatively late disco ##nti ##nu ##ation of treatment could be a reason for the un ##fa ##vo ##urable outcome in some cases .

reference_raw: In some cases, a relative delay in discontinuing treatment may be a reason for a negative outcome.

reference_spacy_tokens: In some cases , a relative delay in discontinuing treatment may be a reason for a negative outcome .


fn_spacy_tokens_for_baseline: ' I was working in the BBC pensions department and had short - lived aspirations of getting into TV .

source_bert_toks: ' i was working in the bbc pensions department and had short - lived aspirations of getting into tv .

reference_raw: I worked in the BBC pension department, and I had short-lived ambitions to get on TV.

reference_spacy_tokens: I worked in the BBC pension department , and I had short - lived ambitions to get on TV .


fn_spacy_tokens_for_baseline: After all , it was a home - made outfit she first wore as a 14-year - old .

source_bert_toks: after all , it was a home - made outfit she first wore as a 14 - year - old .

reference_raw: It was, after all, a homemade dress she had worn when she was 14.

reference_spacy_tokens: It was , after all , a homemade dress she had worn when she was 14 .


fn_spacy_tokens_for_baseline: Marbles and granites were imported and the building was embellished with appropriate statuary and ornamentation .

source_bert_toks: marble ##s and granite ##s were imported and the building was em ##bell ##ished with appropriate stat ##uary and or ##name ##ntation .

reference_raw: Marbles and granites have been imported and the building has been decorated with appropriate statues and ornaments.

reference_spacy_tokens: Marbles and granites have been imported and the building has been decorated with appropriate statues and ornaments .


fn_spacy_tokens_for_baseline: He or she is urban , trendy and affluent .

source_bert_toks: he or she is urban , trend ##y and affluent .

reference_raw: It's urban, trendy and rich.

reference_spacy_tokens: It 's urban , trendy and rich .


fn_spacy_tokens_for_baseline: The Welsh Office are proposing the construction of a bypass to Crickhowell , an attractive small town to the east of the Park .

source_bert_toks: the welsh office are proposing the construction of a bypass to cr ##ick ##how ##ell , an attractive small town to the east of the park .

reference_raw: The Welsh Office is proposing the construction of a by-pass to Crickhowell, an attractive little town east of the park.

reference_spacy_tokens: The Welsh Office is proposing the construction of a by - pass to Crickhowell , an attractive little town east of the park .


fn_spacy_tokens_for_baseline: It was not because he would be embarrassed if Mrs. Hennessy knew he had a girl staying there , he told himself .

source_bert_toks: it was not because he would be embarrassed if mrs . hen ##nessy knew he had a girl staying there , he told himself .

reference_raw: It wasn't because he'd be ashamed if Mrs. Hennessy knew she had a girlfriend, he thought.

reference_spacy_tokens: It was n't because he 'd be ashamed if Mrs. Hennessy knew she had a girlfriend , he thought .


fn_spacy_tokens_for_baseline: Despite her entreaties he had been ' determined to go and go that day ' .

source_bert_toks: despite her en ##tre ##ati ##es he had been ' determined to go and go that day ' .

reference_raw: Despite her efforts, he was 'decided to go and go that day'.

reference_spacy_tokens: Despite her efforts , he was ' decided to go and go that day ' .


fn_spacy_tokens_for_baseline: To differentiate , one might say that Persians held the British more responsible for Iran 's misfortunes , but the Russians were more feared .

source_bert_toks: to differentiate , one might say that persians held the british more responsible for iran ' s mis ##fort ##unes , but the russians were more feared .

reference_raw: To make a distinction, it could be said that the Persians held the British more responsible for the disasters of Iran, but the Russians were more afraid.

reference_spacy_tokens: To make a distinction , it could be said that the Persians held the British more responsible for the disasters of Iran , but the Russians were more afraid .


fn_spacy_tokens_for_baseline: Confront your fears by asking yourself what practical steps you would be taking if you were feeling motivated -- make a list and do them .

source_bert_toks: confront your fears by asking yourself what practical steps you would be taking if you were feeling motivated - - make a list and do them .

reference_raw: Face your fears by asking yourself what practical steps you'd take if you felt motivated - make a list and do it.

reference_spacy_tokens: Face your fears by asking yourself what practical steps you 'd take if you felt motivated - make a list and do it .


fn_spacy_tokens_for_baseline: The fire brigade reappeared , bringing them some council inspector , who obviously wanted to evacuate the house .

source_bert_toks: the fire brigade reappeared , bringing them some council inspector , who obviously wanted to evacuate the house .

reference_raw: The fire brigade reappeared, bringing in a council inspector who apparently wanted to leave the house.

reference_spacy_tokens: The fire brigade reappeared , bringing in a council inspector who apparently wanted to leave the house .


fn_spacy_tokens_for_baseline: Susan was initially upset about not being allowed to have a nappy but mother 's persistence and confidence was quickly communicated to Susan and within three days she was happily using the lavatory to pass a motion .

source_bert_toks: susan was initially upset about not being allowed to have a nap ##py but mother ' s persistence and confidence was quickly communicated to susan and within three days she was happily using the lava ##tory to pass a motion .

reference_raw: Susan was initially angry that she wasn't allowed to take a nap, but her mother's persistence and self-confidence were quickly communicated to Susan, and in three days she was happy to use the toilet to make a move.

reference_spacy_tokens: Susan was initially angry that she was n't allowed to take a nap , but her mother 's persistence and self - confidence were quickly communicated to Susan , and in three days she was happy to use the toilet to make a move .


fn_spacy_tokens_for_baseline: Iraqi guerrillas have used weapons that range from World War II - era rockets arrayed in donkey carts to sophisticated antiaircraft missiles .

source_bert_toks: iraqi guerrillas have used weapons that range from world war ii - era rockets array ##ed in donkey carts to sophisticated anti ##air ##craft missiles .

reference_raw: The Iraqi guerillas used weapons ranging from World War II missiles loaded in donkey carts to sophisticated anti-aircraft missiles.

reference_spacy_tokens: The Iraqi guerillas used weapons ranging from World War II missiles loaded in donkey carts to sophisticated anti - aircraft missiles .


fn_spacy_tokens_for_baseline: For jazz and blues clubs in Krakow , try U Muniaka ( ul . Florianska 3 ) , Klub Indigo ( ul . Florianska 26 ) , and Klinika 35 ( ul . w. Tomasza 35 ) .

source_bert_toks: for jazz and blues clubs in krakow , try u mu ##nia ##ka ( ul . florian ##ska 3 ) , k ##lub indigo ( ul . florian ##ska 26 ) , and k ##lini ##ka 35 ( ul . w . tomas ##za 35 ) .

reference_raw: For jazz and blues clubs in Krakow, use U Muniaka (ul. Florianska 3), Klub Indigo (ul. Florianska 26) and Klinika 35 (ul. w. Tomasza 35).

reference_spacy_tokens: For jazz and blues clubs in Krakow , use U Muniaka ( ul . Florianska 3 ) , Klub Indigo ( ul . Florianska 26 ) and Klinika 35 ( ul . w. Tomasza 35 ) .


fn_spacy_tokens_for_baseline: Czechoslovakia is the chief manufacturer of nuclear power equipment and uranium in Eastern Europe and ambitious plans are in hand to increase generating capacity to 10,500 MW a year by 1990 .

source_bert_toks: czechoslovakia is the chief manufacturer of nuclear power equipment and uranium in eastern europe and ambitious plans are in hand to increase generating capacity to 10 , 500 mw a year by 1990 .

reference_raw: Czechoslovakia is the main producer of nuclear power plants and uranium in Eastern Europe and ambitious plans are underway to increase production capacity to 10 500 MW per year by 1990.

reference_spacy_tokens: Czechoslovakia is the main producer of nuclear power plants and uranium in Eastern Europe and ambitious plans are underway to increase production capacity to 10 500 MW per year by 1990 .


fn_spacy_tokens_for_baseline: The worry of monetary problems , marketing uncertainties , the weather , etc . , all contributed to the mental fatigue mentioned by quite a number .

source_bert_toks: the worry of monetary problems , marketing uncertain ##ties , the weather , etc . , all contributed to the mental fatigue mentioned by quite a number .

reference_raw: Fears of money problems, marketing uncertainty, weather, etc. have all contributed to the mental weariness mentioned by many.

reference_spacy_tokens: Fears of money problems , marketing uncertainty , weather , etc . have all contributed to the mental weariness mentioned by many .


fn_spacy_tokens_for_baseline: The woman stood in the hallway for a moment like a blind person unsure of her direction .

source_bert_toks: the woman stood in the hallway for a moment like a blind person unsure of her direction .

reference_raw: For a moment the woman stood in the corridor like a blind man who wasn't sure where she was going.

reference_spacy_tokens: For a moment the woman stood in the corridor like a blind man who was n't sure where she was going .