fn_spacy_tokens_for_baseline: The program appeared to begin as a peaceful one , but whatever Kim 's original intentions , the Cuban Missile Crisis may have prompted initiation of a dedicated nuclear weapons program .

source_bert_toks: the program appeared to begin as a peaceful one , but whatever kim ' s original intentions , the cuban missile crisis may have prompted initiation of a dedicated nuclear weapons program .

reference_raw: The program seemed peaceful, but whatever Kim's original intentions, the Cuban missile crisis might have triggered a dedicated nuclear-weapons program.

reference_spacy_tokens: The program seemed peaceful , but whatever Kim 's original intentions , the Cuban missile crisis might have triggered a dedicated nuclear - weapons program .


fn_spacy_tokens_for_baseline: A key turned in a lock , and as he passed in there was a curious scuffling noise from within .

source_bert_toks: a key turned in a lock , and as he passed in there was a curious sc ##uf ##fl ##ing noise from within .

reference_raw: The key turned in the lock, and there was a strange scuffling sound from the inside as he passed.

reference_spacy_tokens: The key turned in the lock , and there was a strange scuffling sound from the inside as he passed .


fn_spacy_tokens_for_baseline: ' Now listen , ' Witcher addressed the crowd .

source_bert_toks: ' now listen , ' witch ##er addressed the crowd .

reference_raw: 'Listen to me now,' Witcher said to the crowd.

reference_spacy_tokens: ' Listen to me now , ' Witcher said to the crowd .


fn_spacy_tokens_for_baseline: She then had a delectable mushroom soup -- and for the main course she chose something that was entirely new to her .

source_bert_toks: she then had a del ##ect ##able mushroom soup - - and for the main course she chose something that was entirely new to her .

reference_raw: Then she had a delicious sponge soup - and, for the main course, she had chosen something entirely new to her.

reference_spacy_tokens: Then she had a delicious sponge soup - and , for the main course , she had chosen something entirely new to her .


fn_spacy_tokens_for_baseline: The insurer has started processing claims from the Northern California earthquake nearly two weeks ago .

source_bert_toks: the ins ##urer has started processing claims from the northern california earthquake nearly two weeks ago .

reference_raw: Nearly two weeks ago, the insurer began processing claims from the Northern California quake.

reference_spacy_tokens: Nearly two weeks ago , the insurer began processing claims from the Northern California quake .


fn_spacy_tokens_for_baseline: If the terrain is undulating it is also important to peg the net tight to the ground in the bottom of the hollows for otherwise rabbits will escape beneath the net .

source_bert_toks: if the terrain is und ##ulating it is also important to peg the net tight to the ground in the bottom of the hollow ##s for otherwise rabbits will escape beneath the net .

reference_raw: When the terrain rolls, it is also important to stick the net firmly to the ground at the bottom of the hollows, because otherwise rabbits escape under the net.

reference_spacy_tokens: When the terrain rolls , it is also important to stick the net firmly to the ground at the bottom of the hollows , because otherwise rabbits escape under the net .


fn_spacy_tokens_for_baseline: By winning the election , Major has entered phase two of his premiership .

source_bert_toks: by winning the election , major has entered phase two of his premiership .

reference_raw: By winning the election, the major stepped into the second stage of his premiership.

reference_spacy_tokens: By winning the election , the major stepped into the second stage of his premiership .


fn_spacy_tokens_for_baseline: His rise to power ushered in the Hellenistic period .

source_bert_toks: his rise to power ushered in the hellenistic period .

reference_raw: His rise in power was used in the Hellenist era.

reference_spacy_tokens: His rise in power was used in the Hellenist era .


fn_spacy_tokens_for_baseline: In practice , it ends up being equated with a " self - expression " that encourages the youngsters ' " self - esteem .

source_bert_toks: in practice , it ends up being e ##qua ##ted with a " self - expression " that encourages the young ##sters ' " self - esteem .

reference_raw: In practice, it ends with a "self-expression" that promotes "self-respect" for young people.

reference_spacy_tokens: In practice , it ends with a " self - expression " that promotes " self - respect " for young people .


fn_spacy_tokens_for_baseline: In the latest quarter , Aetna had a $ 23 million loss on its auto / homeowners line , compared with earnings of $ 33 million last year .

source_bert_toks: in the latest quarter , ae ##t ##na had a $ 23 million loss on its auto / home ##own ##ers line , compared with earnings of $ 33 million last year .

reference_raw: In the last quarter, Aetna had a $23 million loss on its auto/homeowner line, compared to a $33 million profit last year.

reference_spacy_tokens: In the last quarter , Aetna had a $ 23 million loss on its auto / homeowner line , compared to a $ 33 million profit last year .


fn_spacy_tokens_for_baseline: Each night the Falcons depart from over 130 major market areas , jetting packages to a computerised sorting centre at Memphis , where they are sorted at the rate of 10,000 per hour .

source_bert_toks: each night the falcons depart from over 130 major market areas , jett ##ing packages to a computer ##ised sorting centre at memphis , where they are sorted at the rate of 10 , 000 per hour .

reference_raw: Every night, the Falcons depart from more than 130 major market areas, sending packages to an electronic sorting centre in Memphis, where they are sorted at 10,000 an hour.

reference_spacy_tokens: Every night , the Falcons depart from more than 130 major market areas , sending packages to an electronic sorting centre in Memphis , where they are sorted at 10,000 an hour .


fn_spacy_tokens_for_baseline: The eight - wheeled vehicles , developed to fill a gap between infantry soldiers driving Humvees and tanks , is the Army 's next step in becoming a future fighting force .

source_bert_toks: the eight - wheeled vehicles , developed to fill a gap between infantry soldiers driving hum ##ve ##es and tanks , is the army ' s next step in becoming a future fighting force .

reference_raw: Eight-wheeled vehicles, designed to fill the gap between infantry soldiers driving Humvees and reservoirs, are the next step for the army to become a future fighting force.

reference_spacy_tokens: Eight - wheeled vehicles , designed to fill the gap between infantry soldiers driving Humvees and reservoirs , are the next step for the army to become a future fighting force .


fn_spacy_tokens_for_baseline: New construction is everywhere , the streets buzz , traffic is increasingly congested , and in the frenetic pace of rush hour everyone in Dublin seems intent on changing places with everyone else .

source_bert_toks: new construction is everywhere , the streets buzz , traffic is increasingly cong ##ested , and in the fr ##ene ##tic pace of rush hour everyone in dublin seems intent on changing places with everyone else .

reference_raw: New buildings are everywhere, streets are buzzing, traffic is getting more and more crowded, and at the frantic speed of rush hour, everyone in Dublin seems to want to switch places with everyone else.

reference_spacy_tokens: New buildings are everywhere , streets are buzzing , traffic is getting more and more crowded , and at the frantic speed of rush hour , everyone in Dublin seems to want to switch places with everyone else .


fn_spacy_tokens_for_baseline: In silence Baynes led the way to the sink and held forward his candle .

source_bert_toks: in silence bay ##nes led the way to the sink and held forward his candle .

reference_raw: Baynes led them to the sink in silence and held out the candle.

reference_spacy_tokens: Baynes led them to the sink in silence and held out the candle .


fn_spacy_tokens_for_baseline: The conditions under which these several perceptions are differentially elicited can be studied by the technique of ' apparent movement " , wherein two stimuli or input - arrays are presented successively to the visual system and subjects are asked to report what they see .

source_bert_toks: the conditions under which these several perceptions are differential ##ly eli ##cite ##d can be studied by the technique of ' apparent movement " , wherein two stimuli or input - arrays are presented successively to the visual system and subjects are asked to report what they see .

reference_raw: The conditions under which these multiple perceptions are differentially elicited can be studied using the "appreciative motion" technique, where two stimuli or input fields are presented consecutively to the visual system and objects are asked to report what they see.

reference_spacy_tokens: The conditions under which these multiple perceptions are differentially elicited can be studied using the " appreciative motion " technique , where two stimuli or input fields are presented consecutively to the visual system and objects are asked to report what they see .


fn_spacy_tokens_for_baseline: ' It 's very good of you to do it , ' Merrill said slowly .

source_bert_toks: ' it ' s very good of you to do it , ' merrill said slowly .

reference_raw: 'I'm glad you did,' said Merrill slowly.

reference_spacy_tokens: ' I 'm glad you did , ' said Merrill slowly .


fn_spacy_tokens_for_baseline: At that moment the coffee arrived , and as Luce opened a pack of sugar and stirred it in he remarked , ' I see you 're engaged , Miss Weston . '

source_bert_toks: at that moment the coffee arrived , and as luce opened a pack of sugar and stirred it in he remarked , ' i see you ' re engaged , miss weston . '

reference_raw: That's when the coffee arrived, and when Luce opened the sugar packet and stirred it, he said, "I see you're engaged, Miss Weston."

reference_spacy_tokens: That 's when the coffee arrived , and when Luce opened the sugar packet and stirred it , he said , " I see you 're engaged , Miss Weston . "


fn_spacy_tokens_for_baseline: In a sort of dream I remember being half - led , halfcarried to the carriage ; in the same state I was conveyed to the train .

source_bert_toks: in a sort of dream i remember being half - led , half ##car ##ried to the carriage ; in the same state i was conveyed to the train .

reference_raw: I remember in a dream that I was half led, half carried to a carriage; in the same condition I was taken to a train.

reference_spacy_tokens: I remember in a dream that I was half led , half carried to a carriage ; in the same condition I was taken to a train .


fn_spacy_tokens_for_baseline: Jonathan fluttered his hands in the air .

source_bert_toks: jonathan fluttered his hands in the air .

reference_raw: Jonathan waved his hands.

reference_spacy_tokens: Jonathan waved his hands .


fn_spacy_tokens_for_baseline: Iran 's extensive CW program is allegedly masked using its sophisticated pharmaceutical and agro - industrial companies as plausible cover .

source_bert_toks: iran ' s extensive cw program is allegedly masked using its sophisticated pharmaceutical and ag ##ro - industrial companies as plausible cover .

reference_raw: Iran's large-scale CW program is supposedly masked by its sophisticated pharmaceutical and agro-industrial corporations as a credible cover.

reference_spacy_tokens: Iran 's large - scale CW program is supposedly masked by its sophisticated pharmaceutical and agro - industrial corporations as a credible cover .


fn_spacy_tokens_for_baseline: The Blue Guide lists almost 20 museums , churches and galleries within a circular area about half a mile across .

source_bert_toks: the blue guide lists almost 20 museums , churches and galleries within a circular area about half a mile across .

reference_raw: The Blue Guide lists nearly 20 museums, churches and galleries in a circle about half a mile in diameter.

reference_spacy_tokens: The Blue Guide lists nearly 20 museums , churches and galleries in a circle about half a mile in diameter .


fn_spacy_tokens_for_baseline: If they had held it , as they should , over the Patriarch 's head , it might have kept the dew from settling on his mitre .

source_bert_toks: if they had held it , as they should , over the patriarch ' s head , it might have kept the dew from settling on his mit ##re .

reference_raw: If they held him, as they should, over the Patriarch's head, it would prevent the dew from settling on his miter.

reference_spacy_tokens: If they held him , as they should , over the Patriarch 's head , it would prevent the dew from settling on his miter .


fn_spacy_tokens_for_baseline: A century ago , when the region was inhabited by Indians and rough pioneers , the Everglades -- or ' grassy waters ' to the Indians -- encompassed a 250-mile - long system of lakes , marshes and rivers .

source_bert_toks: a century ago , when the region was inhabited by indians and rough pioneers , the ever ##gl ##ades - - or ' grassy waters ' to the indians - - encompassed a 250 - mile - long system of lakes , marshes and rivers .

reference_raw: A hundred years ago, when the region was populated by Indians and rough pioneers, the Everglades - or the 'grassy waters' of Indians - covered a 250-mile-long system of lakes, swamps, and rivers.

reference_spacy_tokens: A hundred years ago , when the region was populated by Indians and rough pioneers , the Everglades - or the ' grassy waters ' of Indians - covered a 250-mile - long system of lakes , swamps , and rivers .


fn_spacy_tokens_for_baseline: Liverpool City Council last year sacked hundreds of G M B members .

source_bert_toks: liverpool city council last year sacked hundreds of g m b members .

reference_raw: Liverpool City Council sacked 100 GMB members last year.

reference_spacy_tokens: Liverpool City Council sacked 100 GMB members last year .


fn_spacy_tokens_for_baseline: The Tanners lived next door ter the stables till Will Tanner got the sack .

source_bert_toks: the tanner ##s lived next door ter the stables till will tanner got the sack .

reference_raw: The Tanners lived next door to the barn until Will Tanner got the bag.

reference_spacy_tokens: The Tanners lived next door to the barn until Will Tanner got the bag .


fn_spacy_tokens_for_baseline: The economic report dismisses claims that America is unusually profligate in its energy use .

source_bert_toks: the economic report dismiss ##es claims that america is unusually prof ##liga ##te in its energy use .

reference_raw: The economic report rejects the claim that America is unusually proficient in its energy use.

reference_spacy_tokens: The economic report rejects the claim that America is unusually proficient in its energy use .


fn_spacy_tokens_for_baseline: QN : Does Iran intend to build a nuclear reactor ?

source_bert_toks: q ##n : does iran intend to build a nuclear reactor ?

reference_raw: QN: Is Iran planning to build a nuclear reactor?

reference_spacy_tokens: QN : Is Iran planning to build a nuclear reactor ?


fn_spacy_tokens_for_baseline: Stephen King wrote the book and the screenplay , but heavy - handed direction kills what little life there is in this tale of a cursed Indian burial ground and demonic possessed pussies .

source_bert_toks: stephen king wrote the book and the screenplay , but heavy - handed direction kills what little life there is in this tale of a cursed indian burial ground and demonic possessed pu ##ssi ##es .

reference_raw: Stephen King wrote a book and a script, but a heavy-handed direction kills what little life there is in the story of an accursed Indian burial ground and demonic pussies.

reference_spacy_tokens: Stephen King wrote a book and a script , but a heavy - handed direction kills what little life there is in the story of an accursed Indian burial ground and demonic pussies .


fn_spacy_tokens_for_baseline: Libya almost certainly will keep its chemical warfare program as long as Qadhafi remains in power .

source_bert_toks: libya almost certainly will keep its chemical warfare program as long as q ##ad ##ha ##fi remains in power .

reference_raw: Libya will almost certainly maintain its chemical warfare program as long as Qadhafi remains in power.

reference_spacy_tokens: Libya will almost certainly maintain its chemical warfare program as long as Qadhafi remains in power .


fn_spacy_tokens_for_baseline: Reports on the armed conflict in the former Yugoslavia , however , suggest not only that rape and the sexual abuse of women have been carried out on a massive scale , but that it has been systematic and organised .

source_bert_toks: reports on the armed conflict in the former yugoslavia , however , suggest not only that rape and the sexual abuse of women have been carried out on a massive scale , but that it has been systematic and organised .

reference_raw: However, the reports on the armed conflict in the former Yugoslavia indicate not only that rape and sexual exploitation of women have taken place on a massive scale, but also that it is systematic and organised.

reference_spacy_tokens: However , the reports on the armed conflict in the former Yugoslavia indicate not only that rape and sexual exploitation of women have taken place on a massive scale , but also that it is systematic and organised .


fn_spacy_tokens_for_baseline: ' That Finn , Mauno Sarin , you asked me to handle when he arrived here , said Ed had been garrotted before someone threw him into the harbour , ' Carver commented .

source_bert_toks: ' that finn , ma ##uno sar ##in , you asked me to handle when he arrived here , said ed had been ga ##rro ##tted before someone threw him into the harbour , ' carver commented .

reference_raw: 'The Finn, Mauno Sarin, you asked me to take care of him when he got here, said that Ed was garroted before he was thrown into the harbor,' said Carver.

reference_spacy_tokens: ' The Finn , Mauno Sarin , you asked me to take care of him when he got here , said that Ed was garroted before he was thrown into the harbor , ' said Carver .


fn_spacy_tokens_for_baseline: Apply foundation over your lips and then powder to give a good base for your lipstick .

source_bert_toks: apply foundation over your lips and then powder to give a good base for your lipstick .

reference_raw: Apply the base to your lips and then the powder to provide a good basis for your lipstick.

reference_spacy_tokens: Apply the base to your lips and then the powder to provide a good basis for your lipstick .


fn_spacy_tokens_for_baseline: They were relaxed and puffing on cigarettes ; it was clear that any responsibility for the inert procession which now crocodiled back out of the village failed to bother them .

source_bert_toks: they were relaxed and puff ##ing on cigarettes ; it was clear that any responsibility for the in ##ert procession which now crocodile ##d back out of the village failed to bother them .

reference_raw: They were relaxed and smoking cigarettes; it was clear that any responsibility for the inert procession that was now crocodiling back from the village had not bothered them.

reference_spacy_tokens: They were relaxed and smoking cigarettes ; it was clear that any responsibility for the inert procession that was now crocodiling back from the village had not bothered them .


fn_spacy_tokens_for_baseline: Strangely , as they soar ever upwards , the balloons take on a mushroom - shape as if there 's been a nuclear explosion beneath .

source_bert_toks: strangely , as they so ##ar ever upwards , the balloons take on a mushroom - shape as if there ' s been a nuclear explosion beneath .

reference_raw: Oddly, as they rise ever higher, the balloons assume the shape of a fungus, like a nuclear explosion beneath it.

reference_spacy_tokens: Oddly , as they rise ever higher , the balloons assume the shape of a fungus , like a nuclear explosion beneath it .


fn_spacy_tokens_for_baseline: Just to starboard of the companion is the navigating station .

source_bert_toks: just to starboard of the companion is the na ##vi ##gating station .

reference_raw: There's a navigating station just to the right of the companion.

reference_spacy_tokens: There 's a navigating station just to the right of the companion .


fn_spacy_tokens_for_baseline: I can read and I can write but I ca n't tie a shoelace

source_bert_toks: i can read and i can write but i can ' t tie a shoe ##lace

reference_raw: I can read and write, but I can't tie a lace.

reference_spacy_tokens: I can read and write , but I ca n't tie a lace .


fn_spacy_tokens_for_baseline: With the death of Garcia , the pursuit might cease , since such a death might frighten others from the task .

source_bert_toks: with the death of garcia , the pursuit might cease , since such a death might fright ##en others from the task .

reference_raw: With Garcia's death, the pursuit could be stopped, for such a death could frighten others of the task.

reference_spacy_tokens: With Garcia 's death , the pursuit could be stopped , for such a death could frighten others of the task .


fn_spacy_tokens_for_baseline: She sat on the sofa still , pulling the folds of the silk wrap over her bare belly , her thighs .

source_bert_toks: she sat on the sofa still , pulling the folds of the silk wrap over her bare belly , her thighs .

reference_raw: She sat motionless on the couch, pulling the folds of the silk cover over her bare belly and thighs.

reference_spacy_tokens: She sat motionless on the couch , pulling the folds of the silk cover over her bare belly and thighs .


fn_spacy_tokens_for_baseline: While Byzantine land was being divided , there was no one in control of the seas , so pirates raided towns on many of the islands .

source_bert_toks: while byzantine land was being divided , there was no one in control of the seas , so pirates raided towns on many of the islands .

reference_raw: During the division of Byzantine lands, no one could control the seas, so pirates raided cities on a number of islands.

reference_spacy_tokens: During the division of Byzantine lands , no one could control the seas , so pirates raided cities on a number of islands .


fn_spacy_tokens_for_baseline: His stumpy , yellowed silver moustache rides proudly over his camel - like sneer as he strides to the back of the bar , probably to renegotiate his olive and yoghurt contracts with the owner .

source_bert_toks: his stump ##y , yellow ##ed silver mo ##ust ##ache rides proudly over his camel - like s ##neer as he strides to the back of the bar , probably to rene ##go ##tia ##te his olive and yo ##gh ##urt contracts with the owner .

reference_raw: His stumpy, yellow-silver mustache rides proudly over his camel-like grin as he walks to the back of the bar, presumably to renegotiate his olive and yogurt contracts with the owner.

reference_spacy_tokens: His stumpy , yellow - silver mustache rides proudly over his camel - like grin as he walks to the back of the bar , presumably to renegotiate his olive and yogurt contracts with the owner .


fn_spacy_tokens_for_baseline: ' It 's unheard of for a religious Order to dwell in a tent or wagon .

source_bert_toks: ' it ' s un ##heard of for a religious order to dwell in a tent or wagon .

reference_raw: 'It's unheard of for a religious order to live in a tent or a wagon.

reference_spacy_tokens: ' It 's unheard of for a religious order to live in a tent or a wagon .


fn_spacy_tokens_for_baseline: Hollies were dying on the granite outcrop of Charnwood Forest in Leicestershire .

source_bert_toks: ho ##llie ##s were dying on the granite out ##cr ##op of char ##n ##wood forest in leicestershire .

reference_raw: The hollies were dying at the granite extremity of the Charnwood Forest in Leicestershire.

reference_spacy_tokens: The hollies were dying at the granite extremity of the Charnwood Forest in Leicestershire .


fn_spacy_tokens_for_baseline: When Czechoslovakia was in terminal crisis she raised money from the Royal Institute of British Architects to bring back a planeload of children from Prague .

source_bert_toks: when czechoslovakia was in terminal crisis she raised money from the royal institute of british architects to bring back a plane ##load of children from prague .

reference_raw: When Czechoslovakia was in a terminal crisis, it raised money from the Royal Institute of British Architects to bring back a cargo of children from Prague.

reference_spacy_tokens: When Czechoslovakia was in a terminal crisis , it raised money from the Royal Institute of British Architects to bring back a cargo of children from Prague .


fn_spacy_tokens_for_baseline: It aims to compete with the likes of BMW and Audi as the company moves upmarket .

source_bert_toks: it aims to compete with the likes of bmw and audi as the company moves up ##market .

reference_raw: As the company moves to the market, it aims to compete with similar BMW and Audi.

reference_spacy_tokens: As the company moves to the market , it aims to compete with similar BMW and Audi .


fn_spacy_tokens_for_baseline: Common behaviors will include a forward cruise and turning mechanism , procedures to determine the orientation towards nest and the distance from the nest when outside , in - nest navigation , an escape function for when objects are detected or bumped into , object identification and gripping , a generic algorithm for pheromone plume and chemical trail following , and the identification of other ants .

source_bert_toks: common behaviors will include a forward cruise and turning mechanism , procedures to determine the orientation towards nest and the distance from the nest when outside , in - nest navigation , an escape function for when objects are detected or bumped into , object identification and gripping , a generic algorithm for ph ##ero ##mon ##e plume and chemical trail following , and the identification of other ants .

reference_raw: Common behaviour will include a forward navigation and turning mechanism, procedures for determining the direction to the nest and the distance from the nest when outdoors, in-nest navigation, an escape feature for when objects are detected or hit, object identification and grip, a general algorithm for pheromone plumes and chemical footprints followed, and the identification of other ants.

reference_spacy_tokens: Common behaviour will include a forward navigation and turning mechanism , procedures for determining the direction to the nest and the distance from the nest when outdoors , in - nest navigation , an escape feature for when objects are detected or hit , object identification and grip , a general algorithm for pheromone plumes and chemical footprints followed , and the identification of other ants .


fn_spacy_tokens_for_baseline: Capering through contemporary photography like a mummer gatecrashing the court ball , Jo Spence showed up all the medium 's conceits .

source_bert_toks: cape ##ring through contemporary photography like a mum ##mer gate ##cr ##ashi ##ng the court ball , jo spence showed up all the medium ' s con ##ce ##its .

reference_raw: Jo Spence, poking through contemporary photography like a mummer jamming a court ball, showed all of the media's conceits.

reference_spacy_tokens: Jo Spence , poking through contemporary photography like a mummer jamming a court ball , showed all of the media 's conceits .


fn_spacy_tokens_for_baseline: There are different schools of thought on the motivations behind Pyongyang 's nuclear weapons program .

source_bert_toks: there are different schools of thought on the motivation ##s behind p ##yon ##gy ##ang ' s nuclear weapons program .

reference_raw: There are different schools of thought about the motives behind Pyongyang's nuclear weapons program.

reference_spacy_tokens: There are different schools of thought about the motives behind Pyongyang 's nuclear weapons program .


fn_spacy_tokens_for_baseline: But the most tragic movement of population was one of emigration into Lebanon by the victims of the first European Holocaust , the Armenians .

source_bert_toks: but the most tragic movement of population was one of emigration into lebanon by the victims of the first european holocaust , the armenians .

reference_raw: But the most tragic population movement was one of the victims of the first European holocaust, the Armenians, emigrated to Lebanon.

reference_spacy_tokens: But the most tragic population movement was one of the victims of the first European holocaust , the Armenians , emigrated to Lebanon .


fn_spacy_tokens_for_baseline: On 4 July the army of Jerusalem was annihilated .

source_bert_toks: on 4 july the army of jerusalem was ann ##ih ##ila ##ted .

reference_raw: On July 4th, the army of Jerusalem was destroyed.

reference_spacy_tokens: On July 4th , the army of Jerusalem was destroyed .


fn_spacy_tokens_for_baseline: Collecting a large army , he marched it across the width of northern India , supported on his flank by a flotilla of ships advancing slowly down the Ganges .

source_bert_toks: collecting a large army , he marched it across the width of northern india , supported on his flank by a flotilla of ships advancing slowly down the gang ##es .

reference_raw: He gathered up a large army and marched it across northern India, flanked by a fleet of ships moving slowly through the Ganges.

reference_spacy_tokens: He gathered up a large army and marched it across northern India , flanked by a fleet of ships moving slowly through the Ganges .


fn_spacy_tokens_for_baseline: The lies , omissions , and distortions which used to characterise historical research and teaching have come to an end and , with every day , honesty about the past is capturing more territory .

source_bert_toks: the lies , om ##iss ##ions , and distortion ##s which used to character ##ise historical research and teaching have come to an end and , with every day , honesty about the past is capturing more territory .

reference_raw: The lies, omissions, and deformities that were used to characterize historical research and teaching are over, and with each day, integrity about the past captures more territory.

reference_spacy_tokens: The lies , omissions , and deformities that were used to characterize historical research and teaching are over , and with each day , integrity about the past captures more territory .


fn_spacy_tokens_for_baseline: ' Aesthetics ' in these exploratory notes is not confined to art , not even to ' art as a whole ' .

source_bert_toks: ' aesthetics ' in these ex ##pl ##ora ##tory notes is not confined to art , not even to ' art as a whole ' .

reference_raw: "Aesthetics" in these research notes is not limited to art, not even to art as a whole."

reference_spacy_tokens: " Aesthetics " in these research notes is not limited to art , not even to art as a whole . "


fn_spacy_tokens_for_baseline: Also Wednesday , Libya said a British airstrike had hit its major Sarir oil field and damaged a pipeline connecting the deposit to the Mediterranean port of Hariga .

source_bert_toks: also wednesday , libya said a british airs ##tri ##ke had hit its major sar ##ir oil field and damaged a pipeline connecting the deposit to the mediterranean port of hari ##ga .

reference_raw: On Wednesday, Libya also reported that the main Sarir oil field had been hit by a British airport and damaged the pipeline linking the deposit to the Mediterranean port of Hariga.

reference_spacy_tokens: On Wednesday , Libya also reported that the main Sarir oil field had been hit by a British airport and damaged the pipeline linking the deposit to the Mediterranean port of Hariga .


fn_spacy_tokens_for_baseline: All marble used in the west at this time had to be imported from the Greek islands , so it was husbanded .

source_bert_toks: all marble used in the west at this time had to be imported from the greek islands , so it was husband ##ed .

reference_raw: All the marble used in the west at the time had to be imported from the Greek islands, so it was married.

reference_spacy_tokens: All the marble used in the west at the time had to be imported from the Greek islands , so it was married .


fn_spacy_tokens_for_baseline: Then they walked away , humbled and dejected .

source_bert_toks: then they walked away , humble ##d and de ##jected .

reference_raw: Then they left, humiliated and humiliated.

reference_spacy_tokens: Then they left , humiliated and humiliated .


fn_spacy_tokens_for_baseline: The Group operates a number of pension schemes worldwide , the principal schemes being those in the United Kingdom , which are of the defined benefits type .

source_bert_toks: the group operates a number of pension schemes worldwide , the principal schemes being those in the united kingdom , which are of the defined benefits type .

reference_raw: The group has several pension schemes throughout the world, the main schemes being those in the United Kingdom, which are defined benefit types.

reference_spacy_tokens: The group has several pension schemes throughout the world , the main schemes being those in the United Kingdom , which are defined benefit types .


fn_spacy_tokens_for_baseline: When Rebekah , Potiphar 's wife , or Tamar uses a piece of attire for their own personal ends , they do not create a gratuitous disturbance in the order of things .

source_bert_toks: when re ##bek ##ah , pot ##ip ##har ' s wife , or tam ##ar uses a piece of attire for their own personal ends , they do not create a gr ##at ##uit ##ous disturbance in the order of things .

reference_raw: When Rebecca, Potiphar's wife, or Tamar use a piece of clothing for their own personal purposes, they don't create a gratuitous disorder in the order of things.

reference_spacy_tokens: When Rebecca , Potiphar 's wife , or Tamar use a piece of clothing for their own personal purposes , they do n't create a gratuitous disorder in the order of things .


fn_spacy_tokens_for_baseline: I hope that both Stagecoach and Strathtay will be successful .

source_bert_toks: i hope that both stagecoach and st ##rath ##ta ##y will be successful .

reference_raw: I hope Stagecoach and Strathtay succeed.

reference_spacy_tokens: I hope Stagecoach and Strathtay succeed .


fn_spacy_tokens_for_baseline: We were driven along the tree and flower lined expressway into ' Lion City ' as Singapore is known .

source_bert_toks: we were driven along the tree and flower lined expressway into ' lion city ' as singapore is known .

reference_raw: They drove us along a tree and a flower lined highway to "Lion City", as Singapore is known.

reference_spacy_tokens: They drove us along a tree and a flower lined highway to " Lion City " , as Singapore is known .


fn_spacy_tokens_for_baseline: The two incidents drew sharp criticism from Israeli human rights activists , who raised concerns of a pattern of recklessness in the army 's pursuit of Palestinian fugitives in the West Bank and Gaza Strip .

source_bert_toks: the two incidents drew sharp criticism from israeli human rights activists , who raised concerns of a pattern of reckless ##ness in the army ' s pursuit of palestinian fugitive ##s in the west bank and gaza strip .

reference_raw: Both incidents led to a sharp criticism from Israeli human rights activists, who expressed concerns about a pattern of negligence in the military's pursuit of Palestinian refugees in the West Bank and Gaza Strip.

reference_spacy_tokens: Both incidents led to a sharp criticism from Israeli human rights activists , who expressed concerns about a pattern of negligence in the military 's pursuit of Palestinian refugees in the West Bank and Gaza Strip .


fn_spacy_tokens_for_baseline: ' A handsome boy , as you say , ' pouted Anne .

source_bert_toks: ' a handsome boy , as you say , ' po ##uted anne .

reference_raw: 'Beautiful boy, as you say,' said Anne.

reference_spacy_tokens: ' Beautiful boy , as you say , ' said Anne .


fn_spacy_tokens_for_baseline: The Central Council of Church Bell Ringers , a sort of parliament of ringing groups , aims to improve relations with vicars , says John C. Baldwin , president .

source_bert_toks: the central council of church bell ring ##ers , a sort of parliament of ringing groups , aims to improve relations with vicar ##s , says john c . baldwin , president .

reference_raw: According to John C. Baldwin, President, the Central Council of Church Bell Ringers, a kind of parliament of ringing groups, seeks to improve relations with the priests.

reference_spacy_tokens: According to John C. Baldwin , President , the Central Council of Church Bell Ringers , a kind of parliament of ringing groups , seeks to improve relations with the priests .


fn_spacy_tokens_for_baseline: This man has been seen since the crime , for he was detected and pursued by Constable Walters on the same evening , when he had the audacity to revisit Wisteria Lodge .

source_bert_toks: this man has been seen since the crime , for he was detected and pursued by constable walters on the same evening , when he had the au ##da ##city to rev ##isi ##t wi ##ster ##ia lodge .

reference_raw: This man has been seen since the crime, for he was discovered and pursued by Constable Walters on the same night, when he had the courage to revisit Wisteria Lodge.

reference_spacy_tokens: This man has been seen since the crime , for he was discovered and pursued by Constable Walters on the same night , when he had the courage to revisit Wisteria Lodge .


fn_spacy_tokens_for_baseline: The tesserae would be further split or fragmented on site , as required .

source_bert_toks: the tess ##era ##e would be further split or fragmented on site , as required .

reference_raw: If necessary, the testerae will be further broken down or broken down on the spot.

reference_spacy_tokens: If necessary , the testerae will be further broken down or broken down on the spot .


fn_spacy_tokens_for_baseline: Visitors are welcome to visit the 24 - hectare ( 60 - acre ) establishment , and may sample the end product , Lantau tea .

source_bert_toks: visitors are welcome to visit the 24 - hectare ( 60 - acre ) establishment , and may sample the end product , lan ##ta ##u tea .

reference_raw: Visitors are welcome to visit 24-ha (60-acre) premises and can take samples of the final product, Lantau tea.

reference_spacy_tokens: Visitors are welcome to visit 24-ha ( 60-acre ) premises and can take samples of the final product , Lantau tea .


fn_spacy_tokens_for_baseline: We slanted across the river , the wind carrying us against the current , and coasted up the far bank .

source_bert_toks: we slant ##ed across the river , the wind carrying us against the current , and coast ##ed up the far bank .

reference_raw: We slanted across the river, and the wind carried us against the current, and shored on the far shore.

reference_spacy_tokens: We slanted across the river , and the wind carried us against the current , and shored on the far shore .


fn_spacy_tokens_for_baseline: In that time more than 1.2 million jobs have been created and the official jobless rate has been pushed below 17 % from 21 % .

source_bert_toks: in that time more than 1 . 2 million jobs have been created and the official job ##less rate has been pushed below 17 % from 21 % .

reference_raw: Over 1.2 million jobs were created during this period and the official unemployment rate was reduced to less than 17% from 21%.

reference_spacy_tokens: Over 1.2 million jobs were created during this period and the official unemployment rate was reduced to less than 17 % from 21 % .


fn_spacy_tokens_for_baseline: She was too exhausted to resist and showed them into the living room .

source_bert_toks: she was too exhausted to resist and showed them into the living room .

reference_raw: Too exhausted to resist, she led them into the sitting-room.

reference_spacy_tokens: Too exhausted to resist , she led them into the sitting - room .


fn_spacy_tokens_for_baseline: It may be that fascination with the problems of why palatable insects are brightly coloured has caused us to overlook Darwin 's problems of why unpalatable insects are brightly coloured in the first place .

source_bert_toks: it may be that fascination with the problems of why pal ##atable insects are brightly coloured has caused us to overlook darwin ' s problems of why un ##pala ##table insects are brightly coloured in the first place .

reference_raw: Perhaps the fascination with the problem of why palatable insects are brightly colored has caused us to overlook Darwin's problem of why non-palatable insects are brightly colored.

reference_spacy_tokens: Perhaps the fascination with the problem of why palatable insects are brightly colored has caused us to overlook Darwin 's problem of why non - palatable insects are brightly colored .


fn_spacy_tokens_for_baseline: But the mulatto 's heart was with it , and he was driven back to it next day , when , on reconnoitering through the window , he found policeman Walters in possession .

source_bert_toks: but the mu ##lat ##to ' s heart was with it , and he was driven back to it next day , when , on rec ##on ##no ##iter ##ing through the window , he found policeman walters in possession .

reference_raw: But the mulatt's heart was with him, and he was pushed back to it the next day, when, after exploring through the window, he found Officer Walters in his possession.

reference_spacy_tokens: But the mulatt 's heart was with him , and he was pushed back to it the next day , when , after exploring through the window , he found Officer Walters in his possession .


fn_spacy_tokens_for_baseline: Iraq has accused the U.S. , which vehemently opposes the lifting of the sanctions against Iraq , of using the sanctions as a tool to contain the Iraqi regime headed by President Saddam Hussein .

source_bert_toks: iraq has accused the u . s . , which ve ##hem ##ently opposes the lifting of the sanctions against iraq , of using the sanctions as a tool to contain the iraqi regime headed by president saddam hussein .

reference_raw: Iraq has accused the United States, which strongly opposes the abolition of sanctions against Iraq, of using sanctions as a tool to contain the Iraqi regime under President Saddam Hussein.

reference_spacy_tokens: Iraq has accused the United States , which strongly opposes the abolition of sanctions against Iraq , of using sanctions as a tool to contain the Iraqi regime under President Saddam Hussein .


fn_spacy_tokens_for_baseline: Housing is scarce and public services -- the court system , schools , mail service , telephone network and the highways -- are in disgraceful condition .

source_bert_toks: housing is scarce and public services - - the court system , schools , mail service , telephone network and the highways - - are in disgrace ##ful condition .

reference_raw: Housing is scarce, and public services - the court system, schools, postal services, telephone networks and roads - are in a state of shame.

reference_spacy_tokens: Housing is scarce , and public services - the court system , schools , postal services , telephone networks and roads - are in a state of shame .


fn_spacy_tokens_for_baseline: One day at the beach , they encountered a beautiful blonde starlet called Lila Leeds , something of a Lana Turner lookalike .

source_bert_toks: one day at the beach , they encountered a beautiful blonde star ##let called lila leeds , something of a lana turner look ##ali ##ke .

reference_raw: One day, on the beach, they met a beautiful blond starlet named Lila Leeds, like a Lana Turner.

reference_spacy_tokens: One day , on the beach , they met a beautiful blond starlet named Lila Leeds , like a Lana Turner .


fn_spacy_tokens_for_baseline: Season both with salt , freshly milled pepper , mace or nutmeg , cayenne , lemon juice .

source_bert_toks: season both with salt , freshly mill ##ed pepper , mace or nut ##me ##g , ca ##yen ##ne , lemon juice .

reference_raw: Season with salt, freshly ground pepper, mace or nutmeg, cayenne and lemon juice.

reference_spacy_tokens: Season with salt , freshly ground pepper , mace or nutmeg , cayenne and lemon juice .


fn_spacy_tokens_for_baseline: Or is she merely a prisoner ?

source_bert_toks: or is she merely a prisoner ?

reference_raw: Or is he just an inmate?

reference_spacy_tokens: Or is he just an inmate ?


fn_spacy_tokens_for_baseline: In December 2002 , Spanish and American naval forces intercepted a North Korean ship loaded with Scud missiles , but then allowed the ship to proceed to deliver the missiles to Yemen .

source_bert_toks: in december 2002 , spanish and american naval forces intercepted a north korean ship loaded with sc ##ud missiles , but then allowed the ship to proceed to deliver the missiles to yemen .

reference_raw: In December 2002, the Spanish and U.S. Navy intercepted a North Korean ship loaded with Scud missiles, but then allowed it to continue to deliver the missiles to Yemen.

reference_spacy_tokens: In December 2002 , the Spanish and U.S. Navy intercepted a North Korean ship loaded with Scud missiles , but then allowed it to continue to deliver the missiles to Yemen .


fn_spacy_tokens_for_baseline: There are many stories of refugees who arrived with nothing in their pockets , set up a small sidewalk stall , worked diligently until they had their own store , and then expanded it into a modest chain .

source_bert_toks: there are many stories of refugees who arrived with nothing in their pockets , set up a small sidewalk stall , worked dil ##igen ##tly until they had their own store , and then expanded it into a modest chain .

reference_raw: There's a lot of stories about refugees who come in with nothing in their pockets, set up a small walkway stall, worked hard until they had a shop of their own, and then expanded it to a meagre string.

reference_spacy_tokens: There 's a lot of stories about refugees who come in with nothing in their pockets , set up a small walkway stall , worked hard until they had a shop of their own , and then expanded it to a meagre string .


fn_spacy_tokens_for_baseline: Her head hung listlessly upon her breast , but as she raised it and turned her dull eyes upon us I saw that her pupils were dark dots in the centre of the broad gray iris .

source_bert_toks: her head hung list ##lessly upon her breast , but as she raised it and turned her dull eyes upon us i saw that her pupils were dark dots in the centre of the broad gray iris .

reference_raw: Her head hung indifferently on her chest, but when she lifted it and turned her dull eyes on us, I could see that her pupils were dark dots in the center of the wide gray iris.

reference_spacy_tokens: Her head hung indifferently on her chest , but when she lifted it and turned her dull eyes on us , I could see that her pupils were dark dots in the center of the wide gray iris .


fn_spacy_tokens_for_baseline: Nambudiri men may cohabit with Nayar women ; Nayar men may never cohabit with Nambudiri women .

source_bert_toks: nam ##bu ##di ##ri men may co ##hab ##it with nay ##ar women ; nay ##ar men may never co ##hab ##it with nam ##bu ##di ##ri women .

reference_raw: Nambudiri men can live with Nayar women; Nayar men can never live with Nambudiri women.

reference_spacy_tokens: Nambudiri men can live with Nayar women ; Nayar men can never live with Nambudiri women .


fn_spacy_tokens_for_baseline: In return , the Turks violently put down every insurrection , including the massacre on Chios , when 22,000 people were slaughtered .

source_bert_toks: in return , the turks violently put down every insurrection , including the massacre on chi ##os , when 22 , 000 people were slaughtered .

reference_raw: In return, the Turks forced down every rebellion, including the massacre on Chios, when 22,000 people were killed.

reference_spacy_tokens: In return , the Turks forced down every rebellion , including the massacre on Chios , when 22,000 people were killed .


fn_spacy_tokens_for_baseline: If this does not help , the doctor may be able to give an injection to dry up secretions and make the noise less upsetting .

source_bert_toks: if this does not help , the doctor may be able to give an injection to dry up secret ##ions and make the noise less upset ##ting .

reference_raw: If this does not help, your doctor may give you an injection to desiccate the secretions and reduce the noise.

reference_spacy_tokens: If this does not help , your doctor may give you an injection to desiccate the secretions and reduce the noise .


fn_spacy_tokens_for_baseline: The United States imposed sanctions in May , citing Syria 's pursuit of WMD programs as one of the reasons for this step .

source_bert_toks: the united states imposed sanctions in may , citing syria ' s pursuit of w ##md programs as one of the reasons for this step .

reference_raw: In May, the United States imposed sanctions, citing Syria's search for weapons of mass destruction programmes as one of the reasons for this action.

reference_spacy_tokens: In May , the United States imposed sanctions , citing Syria 's search for weapons of mass destruction programmes as one of the reasons for this action .


fn_spacy_tokens_for_baseline: His postcard was drawn from a bulging bagful of entries -- nearly all of them correct -- after the closing date .

source_bert_toks: his post ##card was drawn from a bulging bag ##ful of entries - - nearly all of them correct - - after the closing date .

reference_raw: His postcard was drawn from a bulging bag full of items - almost all correct - after the end of the day.

reference_spacy_tokens: His postcard was drawn from a bulging bag full of items - almost all correct - after the end of the day .


fn_spacy_tokens_for_baseline: Their governess is a Miss Burnet , an Englishwoman of forty or thereabouts .

source_bert_toks: their govern ##ess is a miss burn ##et , an english ##woman of forty or there ##ab ##outs .

reference_raw: Their governess is Miss Burnet, an English woman in her 40s or so.

reference_spacy_tokens: Their governess is Miss Burnet , an English woman in her 40s or so .


fn_spacy_tokens_for_baseline: Canada 's merchandise exports and imports posted increases in February as automobile assembly lines stepped up production after shutdowns in January .

source_bert_toks: canada ' s merchandise exports and imports posted increases in february as automobile assembly lines stepped up production after shut ##down ##s in january .

reference_raw: Canada's exports and imports increased in February as the car assembly lines increased production after the closure in January.

reference_spacy_tokens: Canada 's exports and imports increased in February as the car assembly lines increased production after the closure in January .


fn_spacy_tokens_for_baseline: " They had several metres still to go when it became too hot and we had to evacuate them because it would have endangered them . "

source_bert_toks: " they had several metres still to go when it became too hot and we had to evacuate them because it would have endangered them . "

reference_raw: "They had a few more meters to go when it got too hot, and we had to evacuate them because they'd be in danger."

reference_spacy_tokens: " They had a few more meters to go when it got too hot , and we had to evacuate them because they 'd be in danger . "


fn_spacy_tokens_for_baseline: Ten shirt - sleeved ringers stand in a circle , one foot ahead of the other in a prize - fighter 's stance , each pulling a rope that disappears through a small hole in the high ceiling of the ringing chamber .

source_bert_toks: ten shirt - sleeve ##d ring ##ers stand in a circle , one foot ahead of the other in a prize - fighter ' s stance , each pulling a rope that disappears through a small hole in the high ceiling of the ringing chamber .

reference_raw: Ten shirt-sleeved ringers stand in a circle, one foot ahead of the other in the position of the prize-fighter, each pulling a rope that disappears through a small hole in the high ceiling of the ringing room.

reference_spacy_tokens: Ten shirt - sleeved ringers stand in a circle , one foot ahead of the other in the position of the prize - fighter , each pulling a rope that disappears through a small hole in the high ceiling of the ringing room .


fn_spacy_tokens_for_baseline: In whales , the digits are longer in the hand and the hindlimb has disappeared .

source_bert_toks: in whales , the digits are longer in the hand and the hind ##lim ##b has disappeared .

reference_raw: In whales, the numbers are longer in hand, and the rear limb is gone.

reference_spacy_tokens: In whales , the numbers are longer in hand , and the rear limb is gone .


fn_spacy_tokens_for_baseline: The publishers in Monterrey command no battalions , but they agreed to express their outrage with editorials in today 's editions .

source_bert_toks: the publishers in monterrey command no battalions , but they agreed to express their outrage with editorial ##s in today ' s editions .

reference_raw: The editors of Monterrey do not command any banners, but they have agreed to express their indignation with the editorials of today's issue.

reference_spacy_tokens: The editors of Monterrey do not command any banners , but they have agreed to express their indignation with the editorials of today 's issue .


fn_spacy_tokens_for_baseline: I 've got enough grass in my stomach for a bit .

source_bert_toks: i ' ve got enough grass in my stomach for a bit .

reference_raw: I have enough weed in my stomach for a while.

reference_spacy_tokens: I have enough weed in my stomach for a while .


fn_spacy_tokens_for_baseline: Nicky Haslam is generally acknowledged as a superb story - teller , who judges his audience beautifully .

source_bert_toks: nicky has ##lam is generally acknowledged as a superb story - teller , who judges his audience beautifully .

reference_raw: Nicky Haslam is generally recognised as a great storyteller, who judges his audience beautifully.

reference_spacy_tokens: Nicky Haslam is generally recognised as a great storyteller , who judges his audience beautifully .


fn_spacy_tokens_for_baseline: Although CBW agents are not nearly as destructive as nuclear weapons , they are much easier and cheaper to acquire .

source_bert_toks: although cb ##w agents are not nearly as destructive as nuclear weapons , they are much easier and cheaper to acquire .

reference_raw: Although CBW agents are not nearly as devastating as nuclear weapons, they are much simpler and cheaper to obtain.

reference_spacy_tokens: Although CBW agents are not nearly as devastating as nuclear weapons , they are much simpler and cheaper to obtain .


fn_spacy_tokens_for_baseline: Cells were treated with chemicals for 30 min at 37 ? C or as stated and then incubated for the indicated times before isolation of total RNA .

source_bert_toks: cells were treated with chemicals for 30 min at 37 ? c or as stated and then inc ##uba ##ted for the indicated times before isolation of total rna .

reference_raw: The cells were processed with chemicals for 30 minutes at 37 ?C or as indicated, and then incubated for the indicated period prior to total RNA insulation.

reference_spacy_tokens: The cells were processed with chemicals for 30 minutes at 37 ? C or as indicated , and then incubated for the indicated period prior to total RNA insulation .


fn_spacy_tokens_for_baseline: For the Rover P4 there 's ' A solid car if you do n't mind buying a quart of oil a week ' .

source_bert_toks: for the rover p ##4 there ' s ' a solid car if you don ' t mind buying a qu ##art of oil a week ' .

reference_raw: There's a solid car for Rover P4, if you don't mind buying a liter of oil a week.

reference_spacy_tokens: There 's a solid car for Rover P4 , if you do n't mind buying a liter of oil a week .


fn_spacy_tokens_for_baseline: The sleeves of his pale blue shirt were rolled up over his muscly forearms .

source_bert_toks: the sleeves of his pale blue shirt were rolled up over his mu ##sc ##ly forearms .

reference_raw: The sleeves of his pale blue shirt rolled over his muscular arms.

reference_spacy_tokens: The sleeves of his pale blue shirt rolled over his muscular arms .


fn_spacy_tokens_for_baseline: If the Tory Anglicans were going to lose the argument about the transfer of the Crown , they were determined to ensure that the Church would be safe under a Calvinist successor .

source_bert_toks: if the tory anglican ##s were going to lose the argument about the transfer of the crown , they were determined to ensure that the church would be safe under a calvin ##ist successor .

reference_raw: If the Tory Anglicans lost their fight over the transfer of the crown, they were determined to make sure the Church was safe under a Calvinist successor.

reference_spacy_tokens: If the Tory Anglicans lost their fight over the transfer of the crown , they were determined to make sure the Church was safe under a Calvinist successor .


fn_spacy_tokens_for_baseline: But then the Japanese government swung into action .

source_bert_toks: but then the japanese government swung into action .

reference_raw: But then the Japanese government went into action.

reference_spacy_tokens: But then the Japanese government went into action .


fn_spacy_tokens_for_baseline: But in practice , this would be far too costly in time , personnel and resources .

source_bert_toks: but in practice , this would be far too costly in time , personnel and resources .

reference_raw: In practice, however, it would have been too expensive in time, staff and resources.

reference_spacy_tokens: In practice , however , it would have been too expensive in time , staff and resources .


fn_spacy_tokens_for_baseline: Holmes pointed to the wattles on the severed head .

source_bert_toks: holmes pointed to the watt ##les on the severed head .

reference_raw: Holmes gestured at the wattles on his severed head.

reference_spacy_tokens: Holmes gestured at the wattles on his severed head .


fn_spacy_tokens_for_baseline: During his stay in Iraq , he will visit several places , including hospitals and schools , in Baghdad and southern Iraq , where the U.S. and Britain imposed a no - fly zone , with the claimed aim of protecting Shi'ite Muslims from possible attacks by Iraqi government .

source_bert_toks: during his stay in iraq , he will visit several places , including hospitals and schools , in baghdad and southern iraq , where the u . s . and britain imposed a no - fly zone , with the claimed aim of protecting shi ' it ##e muslims from possible attacks by iraqi government .

reference_raw: During his stay in Iraq, he will visit several places, including hospitals and schools, in Baghdad and South Iraq, where the United States and the United Kingdom have imposed a no-fly zone in order to protect Shi'ite Muslims from possible attacks by the Iraqi government.

reference_spacy_tokens: During his stay in Iraq , he will visit several places , including hospitals and schools , in Baghdad and South Iraq , where the United States and the United Kingdom have imposed a no - fly zone in order to protect Shi'ite Muslims from possible attacks by the Iraqi government .


fn_spacy_tokens_for_baseline: The Second Temple was finished in 515 b.c . , but much of the city still lay in ruins .

source_bert_toks: the second temple was finished in 51 ##5 b . c . , but much of the city still lay in ruins .

reference_raw: The second temple was completed in 515 B.C., but most of the city was still in ruins.

reference_spacy_tokens: The second temple was completed in 515 B.C. , but most of the city was still in ruins .


reference_raw: Holmes pointed to the wattles on his cut-off head.

reference_spacy_tokens: Holmes pointed to the wattles on his cut - off head .


fn_spacy_tokens_for_baseline: Post - SD delta power was compared to baseline during the first hour of spontaneous sleep subsequent to SD , while NREMS amount and bout duration ( Table 2 ) were compared over 12 hours ( ZT6-ZT18 ) , in accordance with the distinct dynamics of the compensatory responses of these variables to SD [ 57]. NREMS bouts were defined as periods of NREMS initiated by three consecutive 10 - second epochs of NREMS and terminated by three consecutive epochs not classified as NREMS .

source_bert_toks: post - sd delta power was compared to baseline during the first hour of spontaneous sleep subsequent to sd , while nr ##em ##s amount and bout duration ( table 2 ) were compared over 12 hours ( z ##t ##6 - z ##t ##18 ) , in accordance with the distinct dynamics of the com ##pen ##sat ##ory responses of these variables to sd [ 57 ] . nr ##em ##s bouts were defined as periods of nr ##em ##s initiated by three consecutive 10 - second epoch ##s of nr ##em ##s and terminated by three consecutive epoch ##s not classified as nr ##em ##s .

reference_raw: Post - SD delta energy was compared with baseline in the first hour of spontaneous sleep after SD, whereas NREMS volume and duration (Table 2) were compared over 12 hours (ZT6-ZT18), in line with the different dynamics of the compensation responses of these variables to SD [57], NREMS bouts were defined as NREMS periods initiated by three consecutive 10 second epochs. NREMS and ended with three consecutive episodes that are not classified as NREMS.

reference_spacy_tokens: Post - SD delta energy was compared with baseline in the first hour of spontaneous sleep after SD , whereas NREMS volume and duration ( Table 2 ) were compared over 12 hours ( ZT6-ZT18 ) , in line with the different dynamics of the compensation responses of these variables to SD [ 57 ] , NREMS bouts were defined as NREMS periods initiated by three consecutive 10 second epochs . NREMS and ended with three consecutive episodes that are not classified as NREMS .


fn_spacy_tokens_for_baseline: The caches were a major supply source for Libya 's rebels , who overran many stashes and helped themselves , often welding weapons systems to pickup trucks and slapping on homemade metal plates for armor .

source_bert_toks: the cache ##s were a major supply source for libya ' s rebels , who over ##ran many st ##ash ##es and helped themselves , often welding weapons systems to pickup trucks and slapping on homemade metal plates for armor .

reference_raw: Caches were the main source of supply for the Libyan rebels, who had overrun many hideouts and helped themselves, often welding weapons systems to pick up trucks and slamming homemade metal plates for armor.

reference_spacy_tokens: Caches were the main source of supply for the Libyan rebels , who had overrun many hideouts and helped themselves , often welding weapons systems to pick up trucks and slamming homemade metal plates for armor .


fn_spacy_tokens_for_baseline: Initially it was believed that these facilities would eventually assemble and then produce the M-9 / DF-15 and M-11 / DF-11 .

source_bert_toks: initially it was believed that these facilities would eventually assemble and then produce the m - 9 / d ##f - 15 and m - 11 / d ##f - 11 .

reference_raw: At first, it was expected that these facilities would eventually build up and then produce M-9/DF-15 and M-11/DF-11.

reference_spacy_tokens: At first , it was expected that these facilities would eventually build up and then produce M-9 / DF-15 and M-11 / DF-11 .


fn_spacy_tokens_for_baseline: Our extraordinary permanent collection , facility , and grounds , we understand full well , would not be possible without the philanthropic support of civic - minded men and women .

source_bert_toks: our extraordinary permanent collection , facility , and grounds , we understand full well , would not be possible without the philanthropic support of civic - minded men and women .

reference_raw: Our extraordinary, permanent collection, equipment, and property, as we understand it, would not have been possible without the philanthropic support of the civil-minded men and women.

reference_spacy_tokens: Our extraordinary , permanent collection , equipment , and property , as we understand it , would not have been possible without the philanthropic support of the civil - minded men and women .


fn_spacy_tokens_for_baseline: Eh - " she laughed " - I remember , I put a headscarf over the lamp , and your Dad gave me such a telling off .

source_bert_toks: eh - " she laughed " - i remember , i put a heads ##car ##f over the lamp , and your dad gave me such a telling off .

reference_raw: "Eh-" she laughed" - I remember putting a scarf over the lamp, and your father gave me such a statement.

reference_spacy_tokens: " Eh- " she laughed " - I remember putting a scarf over the lamp , and your father gave me such a statement .


fn_spacy_tokens_for_baseline: The plane is taxiing , pursued by a group of running Masai warriors , glorious in their red and purple robes , ochred hair , lion head - dresses and so on .

source_bert_toks: the plane is taxi ##ing , pursued by a group of running mas ##ai warriors , glorious in their red and purple robes , och ##red hair , lion head - dresses and so on .

reference_raw: The plane is in a taxi followed by a group of running Masai warriors, famous in red and purple robes, ochred hair, lion headdresses, and so on.

reference_spacy_tokens: The plane is in a taxi followed by a group of running Masai warriors , famous in red and purple robes , ochred hair , lion headdresses , and so on .


fn_spacy_tokens_for_baseline: He came to believe that much worse was to come ; that there would be annihilation on a scale the men themselves had not yet dreamed of .

source_bert_toks: he came to believe that much worse was to come ; that there would be ann ##ih ##ilation on a scale the men themselves had not yet dreamed of .

reference_raw: He had come to believe that far worse would come; that there would be destruction on a scale that the men themselves had never dreamed of.

reference_spacy_tokens: He had come to believe that far worse would come ; that there would be destruction on a scale that the men themselves had never dreamed of .


fn_spacy_tokens_for_baseline: Because of its size , the Chinook presents a vulnerable target , particularly when taking off and landing .

source_bert_toks: because of its size , the chin ##ook presents a vulnerable target , particularly when taking off and landing .

reference_raw: Because of its size, Chinook is a vulnerable target, especially when it launches and lands.

reference_spacy_tokens: Because of its size , Chinook is a vulnerable target , especially when it launches and lands .


fn_spacy_tokens_for_baseline: Except the O'Neil family in the first row of the circle , who sat in stupefied amazement , hardly believing what they had witnessed .

source_bert_toks: except the o ' neil family in the first row of the circle , who sat in stu ##pe ##fied amazement , hardly believing what they had witnessed .

reference_raw: Except for the O'Neil family in the first row of the circle, who sat in stunned amazement, hardly believing what they had seen.

reference_spacy_tokens: Except for the O'Neil family in the first row of the circle , who sat in stunned amazement , hardly believing what they had seen .


fn_spacy_tokens_for_baseline: My siblings are all professional people , it was natural .

source_bert_toks: my siblings are all professional people , it was natural .

reference_raw: All my brothers and sisters are professionals, it was natural.

reference_spacy_tokens: All my brothers and sisters are professionals , it was natural .


fn_spacy_tokens_for_baseline: He drove whichever one happened to match his cuff - links . '

source_bert_toks: he drove whichever one happened to match his cuff - links . '

reference_raw: He was driving, whichever happened to match his cufflinks.'

reference_spacy_tokens: He was driving , whichever happened to match his cufflinks . '


fn_spacy_tokens_for_baseline: At the same time , city - states began to grow in influence on the southern Greek mainland .

source_bert_toks: at the same time , city - states began to grow in influence on the southern greek mainland .

reference_raw: At the same time, the city-states began to have an impact on the southern Greek continent.

reference_spacy_tokens: At the same time , the city - states began to have an impact on the southern Greek continent .


fn_spacy_tokens_for_baseline: By the way are you catching a cold ?

source_bert_toks: by the way are you catching a cold ?

reference_raw: You catch a chill, by the way?

reference_spacy_tokens: You catch a chill , by the way ?


fn_spacy_tokens_for_baseline: The case languished after Morsi was elected last year in the country 's first free presidential race , although local news outlets and Morsi 's opponents accused militants from Hamas , the Brotherhood 's Palestinian offshoot , of freeing their colleagues .

source_bert_toks: the case lang ##uis ##hed after mor ##si was elected last year in the country ' s first free presidential race , although local news outlets and mor ##si ' s opponents accused militants from hamas , the brotherhood ' s palestinian offs ##hoot , of freeing their colleagues .

reference_raw: After the election of Morsi last year in the country's first free presidential race, the case lingered, even though local news shops and Morsi's opponents blamed the militia of Hamas, the Palestinian Brotherhood, for the release of their colleagues.

reference_spacy_tokens: After the election of Morsi last year in the country 's first free presidential race , the case lingered , even though local news shops and Morsi 's opponents blamed the militia of Hamas , the Palestinian Brotherhood , for the release of their colleagues .


fn_spacy_tokens_for_baseline: Think of all the good stuff we all collect daily in our reporting that we never add to stories .

source_bert_toks: think of all the good stuff we all collect daily in our reporting that we never add to stories .

reference_raw: Think of all the good things we gather every day in our reports that we don't add to the stories.

reference_spacy_tokens: Think of all the good things we gather every day in our reports that we do n't add to the stories .


fn_spacy_tokens_for_baseline: In the torrent of replies that followed , one woman ringer from Solihull observed that " the average male ringer leaves quite a lot to be desired : badly dressed , decorated with acne and a large beer - belly , frequently unwashed and unbearably flatulent in peals .

source_bert_toks: in the torre ##nt of replies that followed , one woman ring ##er from sol ##ih ##ull observed that " the average male ring ##er leaves quite a lot to be desired : badly dressed , decorated with ac ##ne and a large beer - belly , frequently un ##washed and un ##be ##ara ##bly flat ##ulent in pea ##ls .

reference_raw: In the torrent of answers that followed, one of Solihull's ringers remarked that "the average male ringer leaves quite a lot to be desired: ill-dressed, decorated with acne and a large beer belly, often unwashed and unbearably flatulent in peals.

reference_spacy_tokens: In the torrent of answers that followed , one of Solihull 's ringers remarked that " the average male ringer leaves quite a lot to be desired : ill - dressed , decorated with acne and a large beer belly , often unwashed and unbearably flatulent in peals .


fn_spacy_tokens_for_baseline: The Thunderbird , Desert Inn , Sahara , Sands , and Riviera hotels were erected during this period , luring a curious clientele drawn by tales of all - night partying , exclusive entertainment , and cheap accommodations .

source_bert_toks: the thunder ##bird , desert inn , sahara , sands , and ri ##vier ##a hotels were erected during this period , lu ##ring a curious client ##ele drawn by tales of all - night party ##ing , exclusive entertainment , and cheap accommodations .

reference_raw: During this period, Thunderbird, Desert Inn, Sahara, Sands, and Riviera hotels had been built, attracting a strange clientele from stories of night-long partying, exclusive entertainment, and cheap accommodation.

reference_spacy_tokens: During this period , Thunderbird , Desert Inn , Sahara , Sands , and Riviera hotels had been built , attracting a strange clientele from stories of night - long partying , exclusive entertainment , and cheap accommodation .


fn_spacy_tokens_for_baseline: It depicted simply an enormous face , more than a metre wide : the face of a man of about forty - five , with a heavy black moustache and ruggedly handsome features .

source_bert_toks: it depicted simply an enormous face , more than a metre wide : the face of a man of about forty - five , with a heavy black mo ##ust ##ache and rugged ##ly handsome features .

reference_raw: It was simply a huge face, more than a meter wide: the face of a man of about forty-five, with a heavy black mustache and roughly handsome features.

reference_spacy_tokens: It was simply a huge face , more than a meter wide : the face of a man of about forty - five , with a heavy black mustache and roughly handsome features .


fn_spacy_tokens_for_baseline: Pyongyang was also required to " consistently take steps to implement the North - South Joint Declaration on the Denuclearization of the Korean Peninsula , " and remain a party to the NPT .

source_bert_toks: p ##yon ##gy ##ang was also required to " consistently take steps to implement the north - south joint declaration on the den ##uc ##lea ##rization of the korean peninsula , " and remain a party to the np ##t .

reference_raw: Pyongyang was also required to "consistently take steps to implement the North-South Joint Declaration on Denuclearisation of the Korean Peninsula" and continue to participate in the NPT.

reference_spacy_tokens: Pyongyang was also required to " consistently take steps to implement the North - South Joint Declaration on Denuclearisation of the Korean Peninsula " and continue to participate in the NPT .


fn_spacy_tokens_for_baseline: China has not joined the Missile Technology Control Regime ( MTCR ) , but has pledged to abide by its main parameters .

source_bert_toks: china has not joined the missile technology control regime ( mt ##cr ) , but has pledged to ab ##ide by its main parameters .

reference_raw: China has not joined the Missile Technology Control Regime (MTCR), but has committed itself to respect its main characteristics.

reference_spacy_tokens: China has not joined the Missile Technology Control Regime ( MTCR ) , but has committed itself to respect its main characteristics .


fn_spacy_tokens_for_baseline: In addition to aerial - delivered chemical ordnance ( bombs , possibly other types of ordnance ) , DPRK military airfields ( as of 1993 ) have posted a platoon of chemical defense personnel equipped decontamination and detection systems .

source_bert_toks: in addition to aerial - delivered chemical ordnance ( bombs , possibly other types of ordnance ) , d ##pr ##k military airfields ( as of 1993 ) have posted a platoon of chemical defense personnel equipped deco ##nta ##mina ##tion and detection systems .

reference_raw: In addition to airborne chemical commands (bombs, possibly other types of order), DPRK military airports (since 1993) have deployed a team of chemical defense personnel equipped with decontamination and detection systems.

reference_spacy_tokens: In addition to airborne chemical commands ( bombs , possibly other types of order ) , DPRK military airports ( since 1993 ) have deployed a team of chemical defense personnel equipped with decontamination and detection systems .


fn_spacy_tokens_for_baseline: The perfection of this design is attested by the fact that species belonging to quite different families of fish have adopted it and thus bear a strong resemblance to one another .

source_bert_toks: the perfection of this design is attested by the fact that species belonging to quite different families of fish have adopted it and thus bear a strong resemblance to one another .

reference_raw: The perfection of this concept is confirmed by the fact that species belonging to quite different groups of fish have adopted it and are therefore very similar to each other.

reference_spacy_tokens: The perfection of this concept is confirmed by the fact that species belonging to quite different groups of fish have adopted it and are therefore very similar to each other .


fn_spacy_tokens_for_baseline: A handsome Irish youth with ginger hair squirted some boiling water into the teapot and swilled a cup of dark brown liquid into a chipped cup .

source_bert_toks: a handsome irish youth with ginger hair sq ##ui ##rted some boiling water into the tea ##pot and sw ##ille ##d a cup of dark brown liquid into a chip ##ped cup .

reference_raw: A handsome Irish young man with ginger hair poured some boiling water into a teapot and poured a cup of dark brown liquid into a chipped cup.

reference_spacy_tokens: A handsome Irish young man with ginger hair poured some boiling water into a teapot and poured a cup of dark brown liquid into a chipped cup .


fn_spacy_tokens_for_baseline: When Mrs Funnell later relayed this conversation to her great - granddaughter , she had ended , ' And I understood his reason perfectly .

source_bert_toks: when mrs funnel ##l later relay ##ed this conversation to her great - granddaughter , she had ended , ' and i understood his reason perfectly .

reference_raw: When Mrs. Funnell later relayed the conversation to her granddaughter, she said, "And I understood his reason perfectly.

reference_spacy_tokens: When Mrs. Funnell later relayed the conversation to her granddaughter , she said , " And I understood his reason perfectly .


fn_spacy_tokens_for_baseline: Outside at the back a curlew piped , a lonely single sound , and among the weeds of the garden sparrows cheeped and quarrelled in shrill bursts of noise .

source_bert_toks: outside at the back a curl ##ew pipe ##d , a lonely single sound , and among the weeds of the garden sparrow ##s che ##ep ##ed and quarrel ##led in shrill bursts of noise .

reference_raw: A curlew piped in the back, a single sound, and sparrows cheeked and quarrelled among the weeds of the garden.

reference_spacy_tokens: A curlew piped in the back , a single sound , and sparrows cheeked and quarrelled among the weeds of the garden .


fn_spacy_tokens_for_baseline: Her head thumped , her eyes were half - closed and her voice rasped irritation .

source_bert_toks: her head thumped , her eyes were half - closed and her voice rasped irritation .

reference_raw: Her head was pounding, her eyes were half closed, her voice rasping with irritation.

reference_spacy_tokens: Her head was pounding , her eyes were half closed , her voice rasping with irritation .


fn_spacy_tokens_for_baseline: When she surfaced it was to find that they were back at Piazzale Roma , the big square thronging as usual .

source_bert_toks: when she surfaced it was to find that they were back at piazza ##le roma , the big square th ##rong ##ing as usual .

reference_raw: When she surfaced, she found that they were back in Piazzale Roma, a large square crowding as usual.

reference_spacy_tokens: When she surfaced , she found that they were back in Piazzale Roma , a large square crowding as usual .


fn_spacy_tokens_for_baseline: I took her part , got her into a cab , and here we are .

source_bert_toks: i took her part , got her into a cab , and here we are .

reference_raw: I got her part, I put her in a taxi, and we're here.

reference_spacy_tokens: I got her part , I put her in a taxi , and we 're here .


fn_spacy_tokens_for_baseline: Winston turned a switch and the voice sank somewhat , though the words were still distinguishable .

source_bert_toks: winston turned a switch and the voice sank somewhat , though the words were still distinguish ##able .

reference_raw: Winston flipped the switch and the voice dropped a little, though the words were still distinguishable.

reference_spacy_tokens: Winston flipped the switch and the voice dropped a little , though the words were still distinguishable .


fn_spacy_tokens_for_baseline: ' Yes , sir , there must have been some very strange people with some very strange ways in this house .

source_bert_toks: ' yes , sir , there must have been some very strange people with some very strange ways in this house .

reference_raw: 'Yes, sir, there must be some very strange people in this house with some very strange manners.

reference_spacy_tokens: ' Yes , sir , there must be some very strange people in this house with some very strange manners .


fn_spacy_tokens_for_baseline: The strong beat and earthy lyrics seem to symbolize and celebrate the character of this young and lively country .

source_bert_toks: the strong beat and earth ##y lyrics seem to symbol ##ize and celebrate the character of this young and lively country .

reference_raw: Strong rhythms and earthly texts seem to symbolize and celebrate the character of this young and living country.

reference_spacy_tokens: Strong rhythms and earthly texts seem to symbolize and celebrate the character of this young and living country .


fn_spacy_tokens_for_baseline: On the coast , Sandymount , Dollymount , and Killiney strands are the places to go .

source_bert_toks: on the coast , sandy ##mount , dolly ##mount , and kill ##ine ##y strands are the places to go .

reference_raw: There's Sandymount, Dollymount, and Killiney Strings on the coast.

reference_spacy_tokens: There 's Sandymount , Dollymount , and Killiney Strings on the coast .


fn_spacy_tokens_for_baseline: There are 12 of them ; you ca n't miss the eye - popping Lisboa , which has several floors of gambling , but there 's also the Hyatt Regency , the Mandarian Oriental , and Taipa 's Jockey Club .

source_bert_toks: there are 12 of them ; you can ' t miss the eye - popping li ##sb ##oa , which has several floors of gambling , but there ' s also the h ##yat ##t regency , the man ##dar ##ian oriental , and tai ##pa ' s jockey club .

reference_raw: There's 12 of them, and you can't lose an eye-popping Lisboa with a few floors of gambling, but there's also a Hyatt Regency, a Mandarian Oriental, and a Taipa Jockey Club.

reference_spacy_tokens: There 's 12 of them , and you ca n't lose an eye - popping Lisboa with a few floors of gambling , but there 's also a Hyatt Regency , a Mandarian Oriental , and a Taipa Jockey Club .


fn_spacy_tokens_for_baseline: Since there are so many alleged dope smugglers languishing in Mexican jails , some claimed to be unjustly accused , relations between the U.S. and Mexico have been taut of late .

source_bert_toks: since there are so many alleged do ##pe smug ##glers lang ##uis ##hing in mexican jail ##s , some claimed to be un ##just ##ly accused , relations between the u . s . and mexico have been taut of late .

reference_raw: Since there are so many alleged drug traffickers in Mexican prisons, some of them claim to have been wrongly accused, relations between the United States and Mexico have been delayed.

reference_spacy_tokens: Since there are so many alleged drug traffickers in Mexican prisons , some of them claim to have been wrongly accused , relations between the United States and Mexico have been delayed .


fn_spacy_tokens_for_baseline: My father has trouble pronouncing his r 's , owing to some palate fuck - up or gob - gimmick .

source_bert_toks: my father has trouble pro ##no ##un ##cing his r ' s , owing to some pal ##ate fuck - up or go ##b - gi ##mm ##ick .

reference_raw: My dad's having a hard time pronouncing his R's because of some palate shit or a gob trick.

reference_spacy_tokens: My dad 's having a hard time pronouncing his R 's because of some palate shit or a gob trick .


fn_spacy_tokens_for_baseline: The Edgware Road underpass will stay closed all weekend .

source_bert_toks: the ed ##g ##ware road under ##pass will stay closed all weekend .

reference_raw: The Edgware Road subway will be closed for the entire weekend.

reference_spacy_tokens: The Edgware Road subway will be closed for the entire weekend .


fn_spacy_tokens_for_baseline: She voided the lavatory , and ran cold water in the basin , laving her face , hands , wrists .

source_bert_toks: she void ##ed the lava ##tory , and ran cold water in the basin , la ##ving her face , hands , wrists .

reference_raw: She emptied the toilet and poured cold water into the sink, lashing her face, hands, wrists.

reference_spacy_tokens: She emptied the toilet and poured cold water into the sink , lashing her face , hands , wrists .


fn_spacy_tokens_for_baseline: Moreover , the German Navy , blockaded in harbour , was unable to succour German colonies in Africa and Asia , which by 1915 were being rapidly overrun .

source_bert_toks: moreover , the german navy , blockade ##d in harbour , was unable to su ##cco ##ur german colonies in africa and asia , which by 1915 were being rapidly overrun .

reference_raw: In addition, the German Navy, blocked in port, was unable to succumb to the German colonies in Africa and Asia, which were rapidly overrun by 1915.

reference_spacy_tokens: In addition , the German Navy , blocked in port , was unable to succumb to the German colonies in Africa and Asia , which were rapidly overrun by 1915 .


fn_spacy_tokens_for_baseline: Frayed or cut wires , for instance , can destroy expensive property by fire or even kill through electrocution .

source_bert_toks: fray ##ed or cut wires , for instance , can destroy expensive property by fire or even kill through electro ##cut ##ion .

reference_raw: Fraying or cutting wires, for example, can destroy expensive property by fire or even kill it by electrocuting.

reference_spacy_tokens: Fraying or cutting wires , for example , can destroy expensive property by fire or even kill it by electrocuting .


fn_spacy_tokens_for_baseline: Providing an influx of $ 165 million to the southwestern economy , Hoover Dam played a major role in preventing Las Vegas from drying up , both financially and literally .

source_bert_toks: providing an influx of $ 165 million to the southwestern economy , hoover dam played a major role in preventing las vegas from drying up , both financially and literally .

reference_raw: By providing an influx of $165 million to the southwest economy, Hoover Dam has played an important role in preventing Las Vegas from drying, both economically and literally.

reference_spacy_tokens: By providing an influx of $ 165 million to the southwest economy , Hoover Dam has played an important role in preventing Las Vegas from drying , both economically and literally .


fn_spacy_tokens_for_baseline: He is a man of fifty , strong , active , with iron - gray hair , great bunched black eyebrows , the step of a deer and the air of an emperor - a fierce , masterful man , with a red - hot spirit behind his parchment face .

source_bert_toks: he is a man of fifty , strong , active , with iron - gray hair , great bunch ##ed black eyebrows , the step of a deer and the air of an emperor - a fierce , master ##ful man , with a red - hot spirit behind his parchment face .

reference_raw: He is a man of fifty, strong and active, with iron-gray hair, large black eyebrows, the step of a deer, and the air of an Emperor-a fierce, masterful man with a red-hot soul behind his parchment face.

reference_spacy_tokens: He is a man of fifty , strong and active , with iron - gray hair , large black eyebrows , the step of a deer , and the air of an Emperor - a fierce , masterful man with a red - hot soul behind his parchment face .


fn_spacy_tokens_for_baseline: The ports are within hiking distance of several beautiful beaches , and within a one - hour hike of each other on a marked trail .

source_bert_toks: the ports are within hiking distance of several beautiful beaches , and within a one - hour hike of each other on a marked trail .

reference_raw: The ports are within the tourist range of several beautiful beaches, and within an hour of each other on a marked path.

reference_spacy_tokens: The ports are within the tourist range of several beautiful beaches , and within an hour of each other on a marked path .


fn_spacy_tokens_for_baseline: Even after the summer sessions come to a close , Jameson campers will take part in year - round programs designed to keep that positive contact with peers and role models alive and important .

source_bert_toks: even after the summer sessions come to a close , jameson camp ##ers will take part in year - round programs designed to keep that positive contact with peers and role models alive and important .

reference_raw: Even after the summer sessions have come to an end, Jameson campers will participate in the course of the year - round programs designed to keep this positive contact with their peers and role models alive and important.

reference_spacy_tokens: Even after the summer sessions have come to an end , Jameson campers will participate in the course of the year - round programs designed to keep this positive contact with their peers and role models alive and important .


fn_spacy_tokens_for_baseline: But , determined that he should n't have the satisfaction of seeing her vexation , she said drily , ' Do n't mention it ; I 'm only glad it was n't rush - hour . '

source_bert_toks: but , determined that he shouldn ' t have the satisfaction of seeing her ve ##xa ##tion , she said dr ##ily , ' don ' t mention it ; i ' m only glad it wasn ' t rush - hour . '

reference_raw: But, determined not to be happy to see her exultation, she said dryly, "Don't mention it; I'm just glad it wasn't a rush hour."

reference_spacy_tokens: But , determined not to be happy to see her exultation , she said dryly , " Do n't mention it ; I 'm just glad it was n't a rush hour . "


fn_spacy_tokens_for_baseline: Amazing what it does to one 's heart rate and one 's short - term memory .

source_bert_toks: amazing what it does to one ' s heart rate and one ' s short - term memory .

reference_raw: It's amazing what it does to one's heart rate and one's short-term remembrance.

reference_spacy_tokens: It 's amazing what it does to one 's heart rate and one 's short - term remembrance .


fn_spacy_tokens_for_baseline: Shiona frowned at the phone in total bewilderment .

source_bert_toks: shi ##ona frowned at the phone in total be ##wil ##der ##ment .

reference_raw: Shiona scowled at the phone in complete confusion.

reference_spacy_tokens: Shiona scowled at the phone in complete confusion .


fn_spacy_tokens_for_baseline: Leopold continued to keep Mozart and his mother apprised of all that was going on in Salzburg , including accounts of performances of Mozart 's compositions .

source_bert_toks: leopold continued to keep mozart and his mother app ##rise ##d of all that was going on in salzburg , including accounts of performances of mozart ' s compositions .

reference_raw: Leopold kept Mozart and his mother informed of what had happened in Salzburg, including the description of the performances of the composition of Mozart.

reference_spacy_tokens: Leopold kept Mozart and his mother informed of what had happened in Salzburg , including the description of the performances of the composition of Mozart .


fn_spacy_tokens_for_baseline: He was still naked and seemed so relaxed in that state that she wondered if he often wandered around like that .

source_bert_toks: he was still naked and seemed so relaxed in that state that she wondered if he often wandered around like that .

reference_raw: He was still nude, and he seemed so relaxed in his condition that she wondered if he often wandered around like this.

reference_spacy_tokens: He was still nude , and he seemed so relaxed in his condition that she wondered if he often wandered around like this .


fn_spacy_tokens_for_baseline: The present flora , vegetation , and landscape of the Outer Hebrides thus pose several interesting and challenging questions .

source_bert_toks: the present flora , vegetation , and landscape of the outer he ##bri ##des thus pose several interesting and challenging questions .

reference_raw: The current flora, vegetation and landscape of the Outer Hebrides therefore pose a number of interesting and difficult questions.

reference_spacy_tokens: The current flora , vegetation and landscape of the Outer Hebrides therefore pose a number of interesting and difficult questions .


fn_spacy_tokens_for_baseline: Early in the film , with the Flowers crisis in full bloom , Sam Donaldson interviews Stephanopoulos , who blames it all on the " Republican attack machine . "

source_bert_toks: early in the film , with the flowers crisis in full bloom , sam donaldson interviews stephan ##op ##oulos , who blame ##s it all on the " republican attack machine . "

reference_raw: At the beginning of the movie, when the Flowers Crisis is on its way, Sam Donaldson interviews Stephanopoulos, who blames everything on the Republican attack machine.

reference_spacy_tokens: At the beginning of the movie , when the Flowers Crisis is on its way , Sam Donaldson interviews Stephanopoulos , who blames everything on the Republican attack machine .


fn_spacy_tokens_for_baseline: ' I was on the ground and Robert came running over me and accidentally gashed my head with his boot , ' said Barnes .

source_bert_toks: ' i was on the ground and robert came running over me and accidentally gas ##hed my head with his boot , ' said barnes .

reference_raw: "I was on the floor, and Robert ran over me and accidentally hit me in the head with his shoe," said Barnes.

reference_spacy_tokens: " I was on the floor , and Robert ran over me and accidentally hit me in the head with his shoe , " said Barnes .


fn_spacy_tokens_for_baseline: " We renew our denouncement of violence , " the brotherhood said Monday .

source_bert_toks: " we renew our den ##oun ##ce ##ment of violence , " the brotherhood said monday .

reference_raw: "We're renewing our conviction for violence," the fraternity said on Monday.

reference_spacy_tokens: " We 're renewing our conviction for violence , " the fraternity said on Monday .


fn_spacy_tokens_for_baseline: He glanced down at Mariana , throwing her a fresh smile that was meant to be encouraging but she was looking straight ahead , eyes fixed on the sand - spit .

source_bert_toks: he glanced down at mariana , throwing her a fresh smile that was meant to be encouraging but she was looking straight ahead , eyes fixed on the sand - spit .

reference_raw: He looked down at Marian and gave her a new smile that should have been encouraging, but she looked straight ahead, her eyes fixed on the sand.

reference_spacy_tokens: He looked down at Marian and gave her a new smile that should have been encouraging , but she looked straight ahead , her eyes fixed on the sand .


fn_spacy_tokens_for_baseline: Next to the Jardine building is Exchange Square , a complex with a large shopping mall ; just behind it is the General Post Office with a philatelic center on the ground floor .

source_bert_toks: next to the jar ##dine building is exchange square , a complex with a large shopping mall ; just behind it is the general post office with a phil ##ate ##lic center on the ground floor .

reference_raw: There's Exchange Square next to Jardine's building, a complex with a large shopping center, just behind it is the General Post Office with a philatelic center on the ground floor.

reference_spacy_tokens: There 's Exchange Square next to Jardine 's building , a complex with a large shopping center , just behind it is the General Post Office with a philatelic center on the ground floor .


fn_spacy_tokens_for_baseline: Increasingly , health experts and researchers are naming the nation 's penchant for large portions and " supersizing " as a leading cause of obesity .

source_bert_toks: increasingly , health experts and researchers are naming the nation ' s pen ##chan ##t for large portions and " super ##si ##zing " as a leading cause of obesity .

reference_raw: Health professionals and researchers are increasingly naming the national penchant for large parts and "supervising" as the main cause of obesity.

reference_spacy_tokens: Health professionals and researchers are increasingly naming the national penchant for large parts and " supervising " as the main cause of obesity .


fn_spacy_tokens_for_baseline: Jiang Zemin was supportive of the reform line , but was regarded as a political lightweight lacking deep roots in the party .

source_bert_toks: jiang ze ##min was supportive of the reform line , but was regarded as a political lightweight lacking deep roots in the party .

reference_raw: Jiang Zemin supported the reform line, but was considered a political lightweight that lacked deep roots in the party.

reference_spacy_tokens: Jiang Zemin supported the reform line , but was considered a political lightweight that lacked deep roots in the party .


fn_spacy_tokens_for_baseline: In it Jones challenges the concept of full employment , questions the relevance of the work ethic and advocates the redefinition of work to include domestic labour and hobby activities .

source_bert_toks: in it jones challenges the concept of full employment , questions the relevance of the work et ##hic and advocates the red ##ef ##ini ##tion of work to include domestic labour and hobby activities .

reference_raw: Jones calls into question the concept of full employment, questions the relevance of work ethics, and advocates a new definition of work to include domestic work and hobby activities.

reference_spacy_tokens: Jones calls into question the concept of full employment , questions the relevance of work ethics , and advocates a new definition of work to include domestic work and hobby activities .


fn_spacy_tokens_for_baseline: Balerno is the terminus of the chain of villages linked by the river valley which skirts along the northern slopes of the Pentland Hills .

source_bert_toks: bal ##ern ##o is the terminus of the chain of villages linked by the river valley which skirts along the northern slopes of the pen ##tland hills .

reference_raw: Balerno is the terminus of a chain of villages connected by a river valley that spans the northern slopes of the Pentland Hills.

reference_spacy_tokens: Balerno is the terminus of a chain of villages connected by a river valley that spans the northern slopes of the Pentland Hills .


fn_spacy_tokens_for_baseline: The two greys snickered in reply , blowing out their lips and twitching their ears upon hearing their names .

source_bert_toks: the two grey ##s s ##nick ##ered in reply , blowing out their lips and twitching their ears upon hearing their names .

reference_raw: The two grays chuckled in response, blew out their mouths and twitched their ears when they heard their names.

reference_spacy_tokens: The two grays chuckled in response , blew out their mouths and twitched their ears when they heard their names .


fn_spacy_tokens_for_baseline: It quickly spread to the first floor where the main bathroom was destroyed .

source_bert_toks: it quickly spread to the first floor where the main bathroom was destroyed .

reference_raw: It spread rapidly to the first floor, where the main bathroom had been destroyed.

reference_spacy_tokens: It spread rapidly to the first floor , where the main bathroom had been destroyed .