fn_spacy_tokens_for_baseline: Catch 22 , though ostensibly about World War II , was in fact largely concerned with the Korean War and the state of mind prevailing in the Fifties .

source_bert_toks: catch 22 , though ostensibly about world war ii , was in fact largely concerned with the korean war and the state of mind prevailing in the fifties .

reference_raw: Catch 22, although evident in the Second World War, was, in fact, largely concerned with the Korean War and the state of mind prevailing in the 1950s.

reference_spacy_tokens: Catch 22 , although evident in the Second World War , was , in fact , largely concerned with the Korean War and the state of mind prevailing in the 1950s .


fn_spacy_tokens_for_baseline: So instead he decided to climb Everest .

source_bert_toks: so instead he decided to climb everest .

reference_raw: So he chose to climb Everest instead.

reference_spacy_tokens: So he chose to climb Everest instead .


fn_spacy_tokens_for_baseline: Leitenberg , who has worked on arms control and chemical and biological weapons issues for 40 years , told UPI that " a best case scenario " might kill most of the inhabitants of a subway car , but added " every calculation ( one can make about casualties ) relies on a whole series of assumptions . "

source_bert_toks: lei ##tenberg , who has worked on arms control and chemical and biological weapons issues for 40 years , told up ##i that " a best case scenario " might kill most of the inhabitants of a subway car , but added " every calculation ( one can make about casualties ) relies on a whole series of assumptions . "

reference_raw: Leitenberg, who has been working on weapons control and chemical and biological weapons issues for 40 years, told UPI that "the best-case scenario" could kill most people in a subway car, but added "any calculation (one can make a loss) depends on a number of assumptions."

reference_spacy_tokens: Leitenberg , who has been working on weapons control and chemical and biological weapons issues for 40 years , told UPI that " the best - case scenario " could kill most people in a subway car , but added " any calculation ( one can make a loss ) depends on a number of assumptions . "


fn_spacy_tokens_for_baseline: Amuni and Hurieh El Darrawish were tortured by interrogators at the Russian Compound in Jerusalem in January of this year .

source_bert_toks: am ##uni and hu ##rie ##h el dar ##ra ##wi ##sh were tortured by inter ##ro ##gat ##ors at the russian compound in jerusalem in january of this year .

reference_raw: In January of this year, Amuni and Hurieh El Darrawish were tormented by investigators at the Russian compound in Jerusalem.

reference_spacy_tokens: In January of this year , Amuni and Hurieh El Darrawish were tormented by investigators at the Russian compound in Jerusalem .


fn_spacy_tokens_for_baseline: He lurched to his feet .

source_bert_toks: he lurched to his feet .

reference_raw: He staggered to his feet.

reference_spacy_tokens: He staggered to his feet .


fn_spacy_tokens_for_baseline: The pair were quizzed over the abduction of a woman who underwent a terrifying 15-hour ordeal after calling a cab to collect her from a pub .

source_bert_toks: the pair were quiz ##zed over the abduction of a woman who underwent a terrifying 15 - hour ordeal after calling a cab to collect her from a pub .

reference_raw: The couple had been questioned about the kidnapping of a woman who had suffered a terrible 15-hour ordeal after calling a taxi to pick her up from the pub.

reference_spacy_tokens: The couple had been questioned about the kidnapping of a woman who had suffered a terrible 15-hour ordeal after calling a taxi to pick her up from the pub .


fn_spacy_tokens_for_baseline: I 'm not easily spooked , but I did n't like this voice .

source_bert_toks: i ' m not easily sp ##ook ##ed , but i didn ' t like this voice .

reference_raw: It's not easy to scare me, but I didn't like the voice.

reference_spacy_tokens: It 's not easy to scare me , but I did n't like the voice .


fn_spacy_tokens_for_baseline: Two kicks of his big flippers were sufficient to send him drifting back up towards the surface that quivered in the harsh sunlight like a sheet of liquid mercury .

source_bert_toks: two kicks of his big flip ##pers were sufficient to send him drifting back up towards the surface that quiver ##ed in the harsh sunlight like a sheet of liquid mercury .

reference_raw: The two kicks of his great fins were enough to send him back to the surface, which shivered in the harsh sunlight like a sheet of liquid mercury.

reference_spacy_tokens: The two kicks of his great fins were enough to send him back to the surface , which shivered in the harsh sunlight like a sheet of liquid mercury .


fn_spacy_tokens_for_baseline: And they will continue to be exposed until they become too embarrassing to even mention .

source_bert_toks: and they will continue to be exposed until they become too embarrassing to even mention .

reference_raw: And they'll be exposed until they're too awkward to even mention it.

reference_spacy_tokens: And they 'll be exposed until they 're too awkward to even mention it .


fn_spacy_tokens_for_baseline: Fed up with male drunkenness , local women held anti - booze demonstrations , then stormed bars and shops that sell arrack -- a fiery spirit , popular in India -- breaking bottles and setting the stuff ablaze .

source_bert_toks: fed up with male drunken ##ness , local women held anti - boo ##ze demonstrations , then stormed bars and shops that sell ar ##rac ##k - - a fiery spirit , popular in india - - breaking bottles and setting the stuff ab ##laze .

reference_raw: Feeding up with male drunkenness, the local women held anti-booze demonstrations, then raided bars and shops that sold arracks - fire spirit, popular in India - broke bottles and set things on fire.

reference_spacy_tokens: Feeding up with male drunkenness , the local women held anti - booze demonstrations , then raided bars and shops that sold arracks - fire spirit , popular in India - broke bottles and set things on fire .


fn_spacy_tokens_for_baseline: Problems identified by the librarian and other members of the library committee included : ( 1 ) inappropriate and inflexible shelving , making it difficult to shelve books in Dewey order ;

source_bert_toks: problems identified by the librarian and other members of the library committee included : ( 1 ) inappropriate and in ##fle ##xi ##ble she ##lving , making it difficult to she ##l ##ve books in dewey order ;

reference_raw: The problems identified by the librarian and other members of the Library Committee included: (1) inappropriate and inflexible shelf, making it difficult to store books in Dewey order;

reference_spacy_tokens: The problems identified by the librarian and other members of the Library Committee included : ( 1 ) inappropriate and inflexible shelf , making it difficult to store books in Dewey order ;


fn_spacy_tokens_for_baseline: A gang of youths threw stones and missiles at officers who were trying to break up the display .

source_bert_toks: a gang of youths threw stones and missiles at officers who were trying to break up the display .

reference_raw: A group of young men threw rocks and rockets at the officers trying to destroy the display.

reference_spacy_tokens: A group of young men threw rocks and rockets at the officers trying to destroy the display .


fn_spacy_tokens_for_baseline: After netting a lazy backhand to hand Stafford a place in the third round after two hours and 21 minutes Sampras said : ' I just felt tired and a little lethargic on court .

source_bert_toks: after netting a lazy back ##hand to hand stafford a place in the third round after two hours and 21 minutes sam ##pr ##as said : ' i just felt tired and a little let ##har ##gic on court .

reference_raw: After two hours and twenty-one minutes later, Sampras said, "I was tired and a little lethargy on the court, after a lazy backhand and handing Stafford a place in the third round.

reference_spacy_tokens: After two hours and twenty - one minutes later , Sampras said , " I was tired and a little lethargy on the court , after a lazy backhand and handing Stafford a place in the third round .


fn_spacy_tokens_for_baseline: When similar legislation was introduced in Canada , where the population is smaller , millions of dollars were invested in a four - year research programme .

source_bert_toks: when similar legislation was introduced in canada , where the population is smaller , millions of dollars were invested in a four - year research programme .

reference_raw: When similar legislation was put in place in Canada, where the population is smaller, billions of dollars were invested in a four-year research programme.

reference_spacy_tokens: When similar legislation was put in place in Canada , where the population is smaller , billions of dollars were invested in a four - year research programme .


fn_spacy_tokens_for_baseline: ' Anecdotes ' is something of a misnomer ; the book contains good quoted passages , but is in effect a series of long quotes rather than anecdotes .

source_bert_toks: ' an ##ec ##dote ##s ' is something of a mis ##no ##mer ; the book contains good quoted passages , but is in effect a series of long quotes rather than an ##ec ##dote ##s .

reference_raw: "Anecdotes" is something of a bad name; the book contains good quoted passages, but it is more like a series of long quotes than anecdotes.

reference_spacy_tokens: " Anecdotes " is something of a bad name ; the book contains good quoted passages , but it is more like a series of long quotes than anecdotes .


fn_spacy_tokens_for_baseline: Upon completion of several uranium exploration projects , Syria began experiments to extract uranium from its vast phosphoric rock reserves .

source_bert_toks: upon completion of several uranium exploration projects , syria began experiments to extract uranium from its vast ph ##os ##ph ##oric rock reserves .

reference_raw: Following the completion of several uranium research projects, Syria has begun experimenting with the extraction of uranium from its vast phosphoric rock stocks.

reference_spacy_tokens: Following the completion of several uranium research projects , Syria has begun experimenting with the extraction of uranium from its vast phosphoric rock stocks .


fn_spacy_tokens_for_baseline: For a moment , the Robemaker did not speak and then he drew nearer , the dark , silken folds of his cloak brushing the floor with a hissing sound .

source_bert_toks: for a moment , the robe ##maker did not speak and then he drew nearer , the dark , silk ##en folds of his cloak brushing the floor with a hissing sound .

reference_raw: The Robemaker said nothing for a moment, then moved closer, the dark silken folds of his robe brushing the floor with a hissing sound.

reference_spacy_tokens: The Robemaker said nothing for a moment , then moved closer , the dark silken folds of his robe brushing the floor with a hissing sound .


fn_spacy_tokens_for_baseline: She drove fearlessly up a narrow dirt - track road that wound steeply between scented pine trees because she was still mad that Fernando could have done such a thing .

source_bert_toks: she drove fearless ##ly up a narrow dirt - track road that wound steep ##ly between scented pine trees because she was still mad that fernando could have done such a thing .

reference_raw: She drove fearlessly down a narrow dirt road that twisted steeply among the scented pines, still angry that Fernando could do such a thing.

reference_spacy_tokens: She drove fearlessly down a narrow dirt road that twisted steeply among the scented pines , still angry that Fernando could do such a thing .


fn_spacy_tokens_for_baseline: and it was weird it was like they were trying if you were good boy let 's do n't have you on our team you know but um this year they had all good players except for the quarterback

source_bert_toks: and it was weird it was like they were trying if you were good boy let ' s don ' t have you on our team you know but um this year they had all good players except for the quarterback

reference_raw: and it was weird that they were trying to be a good guy, let's not have you on our team, you know, but this year, they had all the good guys except for the quarterback.

reference_spacy_tokens: and it was weird that they were trying to be a good guy , let 's not have you on our team , you know , but this year , they had all the good guys except for the quarterback .


fn_spacy_tokens_for_baseline: When you put it the way you put it , I suppose I should have guessed that you had guessed .

source_bert_toks: when you put it the way you put it , i suppose i should have guessed that you had guessed .

reference_raw: When you put it the way you put it, I suppose I should have thought you'd figured it out.

reference_spacy_tokens: When you put it the way you put it , I suppose I should have thought you 'd figured it out .


fn_spacy_tokens_for_baseline: The Bank of England squandered a huge chunk of Britain 's precious foreign currency reserves in a vain bid to prop it up .

source_bert_toks: the bank of england sq ##uan ##der ##ed a huge chunk of britain ' s precious foreign currency reserves in a vain bid to prop it up .

reference_raw: The Bank of England wasted a large portion of Britain's precious foreign-currency reserves in a futile bid to build them up.

reference_spacy_tokens: The Bank of England wasted a large portion of Britain 's precious foreign - currency reserves in a futile bid to build them up .


fn_spacy_tokens_for_baseline: Riegler , the Federal Vice - Chancellor , had led the party since May 1989 but announced his resignation as party leader on May 23 .

source_bert_toks: ri ##eg ##ler , the federal vice - chancellor , had led the party since may 1989 but announced his resignation as party leader on may 23 .

reference_raw: Riegler, the Federal Vice-Chancellor, had been in charge of the party since May 1989, but announced his resignation on May 23rd.

reference_spacy_tokens: Riegler , the Federal Vice - Chancellor , had been in charge of the party since May 1989 , but announced his resignation on May 23rd .


fn_spacy_tokens_for_baseline: The naughty monkeys screeched their high - pitched calls as the Pack Council met to discuss the man cub 's future .

source_bert_toks: the naughty monkeys sc ##ree ##ched their high - pitched calls as the pack council met to discuss the man cub ' s future .

reference_raw: The naughty apes shrieked their high-pitched calls as the Pack Council met to discuss the future of the young man.

reference_spacy_tokens: The naughty apes shrieked their high - pitched calls as the Pack Council met to discuss the future of the young man .


fn_spacy_tokens_for_baseline: On Monday 30 September 1991 troops overthrew the elected government of President Jean - Bertrand Aristide , who had taken office on 7 February 1991 .

source_bert_toks: on monday 30 september 1991 troops over ##th ##rew the elected government of president jean - bertrand ari ##sti ##de , who had taken office on 7 february 1991 .

reference_raw: On Monday, 30 September 1991, soldiers defeated the elected government of President Jean-Bertrand Aristide, who took office on 7 February 1991.

reference_spacy_tokens: On Monday , 30 September 1991 , soldiers defeated the elected government of President Jean - Bertrand Aristide , who took office on 7 February 1991 .


fn_spacy_tokens_for_baseline: Average NMP growth forecast for 1990 was in the range of 2.5 per cent and 3 per cent .

source_bert_toks: average nm ##p growth forecast for 1990 was in the range of 2 . 5 per cent and 3 per cent .

reference_raw: The average projections for NMP growth in 1990 ranged from 2.5% to 3%.

reference_spacy_tokens: The average projections for NMP growth in 1990 ranged from 2.5 % to 3 % .


fn_spacy_tokens_for_baseline: Merchandise imports , however , rose 5.1 % from January , almost twice the pace of exports , to $ 29.1 billion .

source_bert_toks: merchandise imports , however , rose 5 . 1 % from january , almost twice the pace of exports , to $ 29 . 1 billion .

reference_raw: However, since January, trade imports have increased by 5.1%, almost double the rate of exports, to $29.1 billion.

reference_spacy_tokens: However , since January , trade imports have increased by 5.1 % , almost double the rate of exports , to $ 29.1 billion .


fn_spacy_tokens_for_baseline: They had all made that shrill moan during their funny parties , and by the time of Gary 's birth , Mary had come to recognise them for what they were -- satanic incantations .

source_bert_toks: they had all made that shrill moan during their funny parties , and by the time of gary ' s birth , mary had come to recognise them for what they were - - satan ##ic inca ##ntation ##s .

reference_raw: All of them groaned at their fun parties, and when Gary was born, Mary recognized them for what they were, Satanic spells.

reference_spacy_tokens: All of them groaned at their fun parties , and when Gary was born , Mary recognized them for what they were , Satanic spells .


fn_spacy_tokens_for_baseline: There are two schools of thought concerning the application of syntactic knowledge .

source_bert_toks: there are two schools of thought concerning the application of syn ##ta ##ctic knowledge .

reference_raw: There are two schools of ideas on how to use syntactic knowledge.

reference_spacy_tokens: There are two schools of ideas on how to use syntactic knowledge .


fn_spacy_tokens_for_baseline: This terminal damage to the airfield met with the approval of many local residents , who gave their support to the project .

source_bert_toks: this terminal damage to the airfield met with the approval of many local residents , who gave their support to the project .

reference_raw: This terminal damage to the airport coincided with the approval of a number of local residents who supported the project.

reference_spacy_tokens: This terminal damage to the airport coincided with the approval of a number of local residents who supported the project .


fn_spacy_tokens_for_baseline: Seeing the glow of a red and yellow Shell sign ahead , she drives on and pulls into the forecourt of a self - service petrol station .

source_bert_toks: seeing the glow of a red and yellow shell sign ahead , she drives on and pulls into the fore ##court of a self - service petrol station .

reference_raw: Seeing the brightness of the red-and-yellow Shell sign in front of him, he drives on and pulls into the front yard of the self-service gas station.

reference_spacy_tokens: Seeing the brightness of the red - and - yellow Shell sign in front of him , he drives on and pulls into the front yard of the self - service gas station .


fn_spacy_tokens_for_baseline: All the food is prepared from fresh produce .

source_bert_toks: all the food is prepared from fresh produce .

reference_raw: All food is prepared from a new product.

reference_spacy_tokens: All food is prepared from a new product .


fn_spacy_tokens_for_baseline: The food is delicious .

source_bert_toks: the food is delicious .

reference_raw: The food's excellent.

reference_spacy_tokens: The food 's excellent .


fn_spacy_tokens_for_baseline: Flakes of snow settled on the muzzle of my rifle , and smoking a cigarette while wearing leather gloves left a gingery smell of burnt , nicotined hide in my gloved palm .

source_bert_toks: fl ##akes of snow settled on the muzzle of my rifle , and smoking a cigarette while wearing leather gloves left a ginger ##y smell of burnt , nico ##tine ##d hide in my glove ##d palm .

reference_raw: Flakes of snow settled on the muzzle of my rifle, and smoked a cigarette while wearing leather gauntlets left a gingery scent of burnt, nicotined skin in my gauntleted hand.

reference_spacy_tokens: Flakes of snow settled on the muzzle of my rifle , and smoked a cigarette while wearing leather gauntlets left a gingery scent of burnt , nicotined skin in my gauntleted hand .


fn_spacy_tokens_for_baseline: Resolution 45 / 63 expressed concern at Israel 's continuing nuclear build - up and urged all states ' not to co - operate with or give assistance to Israel that could enhance its nuclear weapons capability ' .

source_bert_toks: resolution 45 / 63 expressed concern at israel ' s continuing nuclear build - up and urged all states ' not to co - operate with or give assistance to israel that could enhance its nuclear weapons capability ' .

reference_raw: Resolution 45/63 expressed concerns about Israel's continued nuclear build-up and called on all States not to cooperate with Israel or to provide assistance to it that could enhance its nuclear capacity.

reference_spacy_tokens: Resolution 45/63 expressed concerns about Israel 's continued nuclear build - up and called on all States not to cooperate with Israel or to provide assistance to it that could enhance its nuclear capacity .


fn_spacy_tokens_for_baseline: Above him , the topmost twigs of the trees whispered interminably .

source_bert_toks: above him , the top ##most twigs of the trees whispered inter ##mina ##bly .

reference_raw: Above him, the top branches of the trees murmured endlessly.

reference_spacy_tokens: Above him , the top branches of the trees murmured endlessly .


fn_spacy_tokens_for_baseline: Some native trees have an attractive robustness and the rowan ( Sorbus aucuparia ) , particularly in the upright growing forms , is one .

source_bert_toks: some native trees have an attractive robust ##ness and the rowan ( so ##rb ##us au ##cup ##aria ) , particularly in the upright growing forms , is one .

reference_raw: Some native trees are attractively resilient and one is a rowan (Sorbus aucuparia), especially in the upright form of growth.

reference_spacy_tokens: Some native trees are attractively resilient and one is a rowan ( Sorbus aucuparia ) , especially in the upright form of growth .


fn_spacy_tokens_for_baseline: It was evident from his preoccupied expression and the abstracted way he ran his fingers through his thatch of silver hair that Gebrec had still not returned .

source_bert_toks: it was evident from his preoccupied expression and the abstract ##ed way he ran his fingers through his that ##ch of silver hair that ge ##bre ##c had still not returned .

reference_raw: The thoughtful look and the abstraction of the way he ran his fingers through his thatch of silver hair made it clear that Gebrec had not yet returned.

reference_spacy_tokens: The thoughtful look and the abstraction of the way he ran his fingers through his thatch of silver hair made it clear that Gebrec had not yet returned .


fn_spacy_tokens_for_baseline: The tall lanky figure of Billy Tolboys was slouched in the comer seat by the fire .

source_bert_toks: the tall lan ##ky figure of billy to ##lb ##oys was sl ##ou ##ched in the come ##r seat by the fire .

reference_raw: Billy Tolboys' tall, lanky figure was slumped in a corner seat by the fire.

reference_spacy_tokens: Billy Tolboys ' tall , lanky figure was slumped in a corner seat by the fire .


fn_spacy_tokens_for_baseline: She recalled with a sense of shock the queen - dowager 's words , her uneasy reference to Richard of Gloucester , when commanded to relinquish her younger son .

source_bert_toks: she recalled with a sense of shock the queen - dowager ' s words , her uneasy reference to richard of gloucester , when commanded to re ##lin ##qui ##sh her younger son .

reference_raw: With a shock, she remembered the Queen-Dowager's words, the restless mention of Richard of Gloucester, when she had been ordered to give up her younger son.

reference_spacy_tokens: With a shock , she remembered the Queen - Dowager 's words , the restless mention of Richard of Gloucester , when she had been ordered to give up her younger son .


fn_spacy_tokens_for_baseline: She nibbled a few more flakes of meat and dropped the bone back on to her plate .

source_bert_toks: she ni ##bbled a few more fl ##akes of meat and dropped the bone back on to her plate .

reference_raw: She nibbled a few more slices of meat and dropped the bone back onto her plate.

reference_spacy_tokens: She nibbled a few more slices of meat and dropped the bone back onto her plate .


fn_spacy_tokens_for_baseline: Wearing the county tie was a mark of modest social distinction and with that went the responsibility of meeting debts and subsidizing the side .

source_bert_toks: wearing the county tie was a mark of modest social distinction and with that went the responsibility of meeting debts and sub ##si ##di ##zing the side .

reference_raw: Wearing a county bond was a sign of a modest social difference, and with it it was the responsibility to meet the debts and to subsidize the party.

reference_spacy_tokens: Wearing a county bond was a sign of a modest social difference , and with it it was the responsibility to meet the debts and to subsidize the party .


fn_spacy_tokens_for_baseline: [ but ] there 's some passion in the action , a lilt to the chases , a fluid lyricism in the way the beasts move across hapless humans who cross their paths " ( Joe Morgenstern , the Wall Street Journal ) . ( See David Edelstein 's review in Slate and The Lost World site . )

source_bert_toks: [ but ] there ' s some passion in the action , a lil ##t to the chases , a fluid lyric ##ism in the way the beasts move across ha ##ples ##s humans who cross their paths " ( joe mor ##gens ##tern , the wall street journal ) . ( see david ed ##els ##tein ' s review in slate and the lost world site . )

reference_raw: [But] There is a certain passion in the action, a hint of chase, a fluid lyricism in how animals move through unhappy people who cross their paths" (Joe Morgenstern, Wall Street Journal) (see David Edelstein's review in Slate and Lost World.)

reference_spacy_tokens: [ But ] There is a certain passion in the action , a hint of chase , a fluid lyricism in how animals move through unhappy people who cross their paths " ( Joe Morgenstern , Wall Street Journal ) ( see David Edelstein 's review in Slate and Lost World . )


fn_spacy_tokens_for_baseline: SNOBBISH homeowners are appealing to be put into higher council tax bands to boost their property 's price and their own social status .

source_bert_toks: s ##nob ##bis ##h home ##own ##ers are appealing to be put into higher council tax bands to boost their property ' s price and their own social status .

reference_raw: The homeowners of SNOBBISH appeal to be placed in higher council tax bands in order to increase the price of their assets and their social status.

reference_spacy_tokens: The homeowners of SNOBBISH appeal to be placed in higher council tax bands in order to increase the price of their assets and their social status .


fn_spacy_tokens_for_baseline: This was borne out by the tests on ' bootiful ' Norfolk turkeys which needed an hour at half microwave power to cook right through without drying the breast meat .

source_bert_toks: this was borne out by the tests on ' boot ##iful ' norfolk turkey ##s which needed an hour at half microwave power to cook right through without drying the breast meat .

reference_raw: This was confirmed by tests on "booty" Norfolk turkeys, which required an hour at half-wave power to cook directly without drying their breasts.

reference_spacy_tokens: This was confirmed by tests on " booty " Norfolk turkeys , which required an hour at half - wave power to cook directly without drying their breasts .


fn_spacy_tokens_for_baseline: I know some people accused us of whingeing , but it was ridiculous that they were able to benefit from something that was entirely their fault .

source_bert_toks: i know some people accused us of w ##hing ##ein ##g , but it was ridiculous that they were able to benefit from something that was entirely their fault .

reference_raw: I know that some people have accused us of whining, but it's funny that they can take advantage of something that's entirely their fault.

reference_spacy_tokens: I know that some people have accused us of whining , but it 's funny that they can take advantage of something that 's entirely their fault .


fn_spacy_tokens_for_baseline: He stuffed extra grenades in his pockets .

source_bert_toks: he stuffed extra grenades in his pockets .

reference_raw: He filled his pockets with extra grenades.

reference_spacy_tokens: He filled his pockets with extra grenades .


fn_spacy_tokens_for_baseline: On the day the King died , just before dusk , an unknown messenger had delivered a letter at the gate .

source_bert_toks: on the day the king died , just before dusk , an unknown messenger had delivered a letter at the gate .

reference_raw: On the day of the King's death, just before dusk, an unknown messenger sent a letter to the gate.

reference_spacy_tokens: On the day of the King 's death , just before dusk , an unknown messenger sent a letter to the gate .


fn_spacy_tokens_for_baseline: A thin steel cord was bolted to the beam that supported the boxcar roof .

source_bert_toks: a thin steel cord was bolted to the beam that supported the box ##car roof .

reference_raw: A thin steel rope was fastened to the beam that supported the roof of the boxcar.

reference_spacy_tokens: A thin steel rope was fastened to the beam that supported the roof of the boxcar .


fn_spacy_tokens_for_baseline: A son should be concerned for his father 's health . '

source_bert_toks: a son should be concerned for his father ' s health . '

reference_raw: A son should be worried about his father's health.'

reference_spacy_tokens: A son should be worried about his father 's health . '


fn_spacy_tokens_for_baseline: ' There is exasperation that it is taking so long .

source_bert_toks: ' there is ex ##as ##peration that it is taking so long .

reference_raw: 'It's irritating that it's taking so long.

reference_spacy_tokens: ' It 's irritating that it 's taking so long .


fn_spacy_tokens_for_baseline: It has been pointed out that the last type of liability is not quite the same as liability under the rule in Rylands v. Fletcher in that the thing accumulated on the land does not itself escape .

source_bert_toks: it has been pointed out that the last type of liability is not quite the same as liability under the rule in ry ##lands v . fletcher in that the thing accumulated on the land does not itself escape .

reference_raw: It has been pointed out that the latter type of liability is not exactly the same as the liability under the Rylands v. Fletcher rule, since what is collected on the ground does not escape itself.

reference_spacy_tokens: It has been pointed out that the latter type of liability is not exactly the same as the liability under the Rylands v. Fletcher rule , since what is collected on the ground does not escape itself .


fn_spacy_tokens_for_baseline: Papal encyclicals came to be consulted by this route , as did the current treatises of Ius Publicun on church -- state relations .

source_bert_toks: papal en ##cy ##cl ##ical ##s came to be consulted by this route , as did the current treatise ##s of i ##us public ##un on church - - state relations .

reference_raw: The papal encyclicals were consulted on this route, as were the current conventions of Ius Publicun on church-state relations.

reference_spacy_tokens: The papal encyclicals were consulted on this route , as were the current conventions of Ius Publicun on church - state relations .


fn_spacy_tokens_for_baseline: I might have felt a little downcast at that point , only the evening had made me feel more encouraged about my prospects with her than I 'd felt for some time .

source_bert_toks: i might have felt a little down ##cast at that point , only the evening had made me feel more encouraged about my prospects with her than i ' d felt for some time .

reference_raw: I might have felt a little depressed at the time, but that evening made me feel more comforted by my prospects with her than I had in a long time.

reference_spacy_tokens: I might have felt a little depressed at the time , but that evening made me feel more comforted by my prospects with her than I had in a long time .


fn_spacy_tokens_for_baseline: QN : Will Japan 's share of global economic output decrease in the next few decades ?

source_bert_toks: q ##n : will japan ' s share of global economic output decrease in the next few decades ?

reference_raw: QN: Will Japan's share of global economy output fall over the next few decades?

reference_spacy_tokens: QN : Will Japan 's share of global economy output fall over the next few decades ?


fn_spacy_tokens_for_baseline: In Ukrainian , for instance , the word bidni refers to an unfortunate , pitiable soul .

source_bert_toks: in ukrainian , for instance , the word bid ##ni refers to an unfortunate , pit ##iable soul .

reference_raw: In Ukraine, for example, the word bidni speaks of an unhappy, regrettable soul.

reference_spacy_tokens: In Ukraine , for example , the word bidni speaks of an unhappy , regrettable soul .


fn_spacy_tokens_for_baseline: Howarth thrust the tormenting , brutally explicit images out of his mind .

source_bert_toks: how ##arth thrust the torment ##ing , brutally explicit images out of his mind .

reference_raw: Howard pushed the tortured, brutally clear images from his mind.

reference_spacy_tokens: Howard pushed the tortured , brutally clear images from his mind .


fn_spacy_tokens_for_baseline: 4- The Kiosk should be equipped with wireless communication equipment , and a mechanist to open and close the gate automatically .

source_bert_toks: 4 - the ki ##os ##k should be equipped with wireless communication equipment , and a me ##chan ##ist to open and close the gate automatically .

reference_raw: 4-Kiosk should be equipped with a wireless communication device and a mechanic to open and close the gate automatically.

reference_spacy_tokens: 4-Kiosk should be equipped with a wireless communication device and a mechanic to open and close the gate automatically .


fn_spacy_tokens_for_baseline: After five years of easy credit , the Fed has reversed course , leaving no doubt about its commitment to fighting inflation in an economy that has finally started to gain momentum .

source_bert_toks: after five years of easy credit , the fed has reversed course , leaving no doubt about its commitment to fighting inflation in an economy that has finally started to gain momentum .

reference_raw: After five years of easy credit, the Fed has reversed its course, leaving no doubt that it is committed to fighting inflation in an economy that has finally begun to gain momentum.

reference_spacy_tokens: After five years of easy credit , the Fed has reversed its course , leaving no doubt that it is committed to fighting inflation in an economy that has finally begun to gain momentum .


fn_spacy_tokens_for_baseline: The gang assaulted him during the drive to Rickmansworth in Hertfordshire , then threw him out of the car .

source_bert_toks: the gang assaulted him during the drive to rick ##mans ##worth in hertfordshire , then threw him out of the car .

reference_raw: He was attacked by a gang on the way to Rickmansworth in Hertfordshire, and then thrown out of the car.

reference_spacy_tokens: He was attacked by a gang on the way to Rickmansworth in Hertfordshire , and then thrown out of the car .


fn_spacy_tokens_for_baseline: The fellow gazed suspiciously round the crowded tavern .

source_bert_toks: the fellow gazed suspiciously round the crowded tavern .

reference_raw: The man looked suspiciously around the crowded inn.

reference_spacy_tokens: The man looked suspiciously around the crowded inn .


fn_spacy_tokens_for_baseline: When at last he placed the phone down he turned and gazed at Joe , saying in a bewildered tone , ' It 's Harry ; they . they want me to go at once . '

source_bert_toks: when at last he placed the phone down he turned and gazed at joe , saying in a bewildered tone , ' it ' s harry ; they . they want me to go at once . '

reference_raw: When he finally put the phone down, he turned and looked at Joe, and said in a puzzled voice, "It's Harry; they want me to leave at once."

reference_spacy_tokens: When he finally put the phone down , he turned and looked at Joe , and said in a puzzled voice , " It 's Harry ; they want me to leave at once . "


fn_spacy_tokens_for_baseline: Sharon Townsend was thrown through the air and left on the roadside with fatal head injuries , a court heard .

source_bert_toks: sharon townsend was thrown through the air and left on the roadside with fatal head injuries , a court heard .

reference_raw: Sharon Townsend was blown up and left on the side of the road with a lethal head injury.

reference_spacy_tokens: Sharon Townsend was blown up and left on the side of the road with a lethal head injury .


fn_spacy_tokens_for_baseline: The Peak Tram starts its scenic climb just across the street and around the corner from the American Consulate in Garden Road and makes its way , sometimes at a startlingly steep incline , to the summit at 398 m ( 1,305 ft ) .

source_bert_toks: the peak tram starts its scenic climb just across the street and around the corner from the american consulate in garden road and makes its way , sometimes at a startling ##ly steep incline , to the summit at 39 ##8 m ( 1 , 305 ft ) .

reference_raw: The Peak Tram begins its scenic climb just across the street and around the corner of the American Consulate on Garden Road, making its way to a peak of 398 m (1,305 ft), sometimes with a surprisingly steep slope.

reference_spacy_tokens: The Peak Tram begins its scenic climb just across the street and around the corner of the American Consulate on Garden Road , making its way to a peak of 398 m ( 1,305 ft ) , sometimes with a surprisingly steep slope .


fn_spacy_tokens_for_baseline: And if it proves to be Berowne 's blood , then he died first , unless , of course , he staggered across to Harry after making one or more of the superficial cuts in his own throat .

source_bert_toks: and if it proves to be be ##row ##ne ' s blood , then he died first , unless , of course , he staggered across to harry after making one or more of the superficial cuts in his own throat .

reference_raw: And if it turns out to be Berowne's blood, he died first, unless, of course, he stumbled over to Harry after making one or more shallow cuts in his throat.

reference_spacy_tokens: And if it turns out to be Berowne 's blood , he died first , unless , of course , he stumbled over to Harry after making one or more shallow cuts in his throat .


fn_spacy_tokens_for_baseline: After filling the casks are bunged before delivery to the pubs

source_bert_toks: after filling the cas ##ks are bun ##ged before delivery to the pubs

reference_raw: After filling the barrels are packed before delivery to the pubs


fn_spacy_tokens_for_baseline: As they drove off he threw a concrete block at each car in turn , smashing the rear window of one , cracking the windscreen of the other .

source_bert_toks: as they drove off he threw a concrete block at each car in turn , smashing the rear window of one , cracking the winds ##creen of the other .

reference_raw: As they drove away, he threw a concrete block at each car in turn, breaking one's rear window and cracking the other's windshield.

reference_spacy_tokens: As they drove away , he threw a concrete block at each car in turn , breaking one 's rear window and cracking the other 's windshield .


fn_spacy_tokens_for_baseline: David Kent 's good - natured face floated into her mind .

source_bert_toks: david kent ' s good - nature ##d face floated into her mind .

reference_raw: David Kent's benevolent face drifted into her mind.

reference_spacy_tokens: David Kent 's benevolent face drifted into her mind .


fn_spacy_tokens_for_baseline: A cart crashed by , its driver mouthing oaths .

source_bert_toks: a cart crashed by , its driver mouth ##ing oath ##s .

reference_raw: A cart crashed past, its driver swearing.

reference_spacy_tokens: A cart crashed past , its driver swearing .


fn_spacy_tokens_for_baseline: Although the cost of research is undoubtedly cheaper in the developing world due to relatively low researcher salaries , overhead and other work standards , these factors do not explain the substantial increase in the number of publications per amount of money allocated to research and development in Latin America , particularly from 1995 until 2000 ( Figure 2 ) .

source_bert_toks: although the cost of research is undoubtedly cheaper in the developing world due to relatively low researcher salaries , overhead and other work standards , these factors do not explain the substantial increase in the number of publications per amount of money allocated to research and development in latin america , particularly from 1995 until 2000 ( figure 2 ) .

reference_raw: Although research costs are undoubtedly cheaper in the developing world due to relatively low salaries of researchers, overheads and other working standards, these factors do not explain the significant increase in the number of publications per volume of R&D in Latin America, in particular between 1995 and 2000 (Figure 2).

reference_spacy_tokens: Although research costs are undoubtedly cheaper in the developing world due to relatively low salaries of researchers , overheads and other working standards , these factors do not explain the significant increase in the number of publications per volume of R&D in Latin America , in particular between 1995 and 2000 ( Figure 2 ) .


fn_spacy_tokens_for_baseline: Fine for baseball , hockey , tennis and golf , but a danger to our society when it involves basketball .

source_bert_toks: fine for baseball , hockey , tennis and golf , but a danger to our society when it involves basketball .

reference_raw: It's good for baseball, hockey, tennis, and golf, but it's dangerous for our company if it involves basketball.

reference_spacy_tokens: It 's good for baseball , hockey , tennis , and golf , but it 's dangerous for our company if it involves basketball .


fn_spacy_tokens_for_baseline: Further , what can be done to prevent or reduce the likelihood of incidents of BW terrorism ?

source_bert_toks: further , what can be done to prevent or reduce the likelihood of incidents of b ##w terrorism ?

reference_raw: What can be done to prevent or reduce the risk of BW terrorism incidents?

reference_spacy_tokens: What can be done to prevent or reduce the risk of BW terrorism incidents ?


fn_spacy_tokens_for_baseline: It had stopped raining but the wood was sopping .

source_bert_toks: it had stopped raining but the wood was so ##pping .

reference_raw: The rain had stopped, but the wood was soaking.

reference_spacy_tokens: The rain had stopped , but the wood was soaking .


fn_spacy_tokens_for_baseline: In addition , Russia remains unequivocally opposed to United Nations ' sanctions against Iran , especially given the absence of evidence to bolster claims about illicit activities .

source_bert_toks: in addition , russia remains une ##qui ##vo ##cal ##ly opposed to united nations ' sanctions against iran , especially given the absence of evidence to bo ##lster claims about illicit activities .

reference_raw: Moreover, Russia remains clearly opposed to UN penalties against Iran, particularly in the absence of evidence to support allegations of illegal activities.

reference_spacy_tokens: Moreover , Russia remains clearly opposed to UN penalties against Iran , particularly in the absence of evidence to support allegations of illegal activities .


fn_spacy_tokens_for_baseline: Like Han Ch'in that time , when she had almost bettered him at archery .

source_bert_toks: like han ch ' in that time , when she had almost better ##ed him at archery .

reference_raw: Like Han Ch'in, when she had almost improved him in archery.

reference_spacy_tokens: Like Han Ch'in , when she had almost improved him in archery .


fn_spacy_tokens_for_baseline: The goal of image - based patient selection is to narrow the range of patient characteristics , leading to a more homogeneous sample , reducing within - group variance , and increasing the statistical power of the experimental design to demonstrate efficacy .

source_bert_toks: the goal of image - based patient selection is to narrow the range of patient characteristics , leading to a more homogeneous sample , reducing within - group variance , and increasing the statistical power of the experimental design to demonstrate efficacy .

reference_raw: Image-based patient selection aims at narrowing the range of patient characteristics, leading to a more homogeneous sample, reducing intra-group variability, and increasing the statistical strength of the experimental design to demonstrate efficacy.

reference_spacy_tokens: Image - based patient selection aims at narrowing the range of patient characteristics , leading to a more homogeneous sample , reducing intra - group variability , and increasing the statistical strength of the experimental design to demonstrate efficacy .


fn_spacy_tokens_for_baseline: Trouble was I could never run very quickly , and I can not imagine what I would have done if I had been chased by the bull .

source_bert_toks: trouble was i could never run very quickly , and i can not imagine what i would have done if i had been chased by the bull .

reference_raw: The trouble was, I couldn't run very fast, and I can't see what I'd do if the bull was chasing me.

reference_spacy_tokens: The trouble was , I could n't run very fast , and I ca n't see what I 'd do if the bull was chasing me .


fn_spacy_tokens_for_baseline: In the show , Crawford did a song - and - dance impersonation of Fred Astaire up a lighted stairway .

source_bert_toks: in the show , crawford did a song - and - dance imp ##erson ##ation of fred as ##tai ##re up a lighted stairway .

reference_raw: On the show, Crawford performed Fred Astaire's song-and-dance impersonation up the illuminated stairs.

reference_spacy_tokens: On the show , Crawford performed Fred Astaire 's song - and - dance impersonation up the illuminated stairs .


fn_spacy_tokens_for_baseline: The independence she had always longed for would be hers at last .

source_bert_toks: the independence she had always longed for would be hers at last .

reference_raw: The independence she'd always wanted was finally hers.

reference_spacy_tokens: The independence she 'd always wanted was finally hers .


fn_spacy_tokens_for_baseline: " The Iranians are now willing to accept the installation of cameras only outside the cascade halls , which will not enable the IAEA to monitor the entire uranium enrichment process , " the diplomat said .

source_bert_toks: " the iranian ##s are now willing to accept the installation of cameras only outside the cascade halls , which will not enable the ia ##ea to monitor the entire uranium enrichment process , " the diplomat said .

reference_raw: "The Iranians are now willing to accept the installation of cameras only outside the cascade halls, so that the IAEA will not be able to monitor the whole process of enriching uranium," the diplomat said.

reference_spacy_tokens: " The Iranians are now willing to accept the installation of cameras only outside the cascade halls , so that the IAEA will not be able to monitor the whole process of enriching uranium , " the diplomat said .


fn_spacy_tokens_for_baseline: The house was always cold , full of stale animal smells and decorated with grotesque knick - knacks made from deer hooves or ram 's horns which gave her nightmares .

source_bert_toks: the house was always cold , full of stale animal smells and decorated with grotesque kn ##ick - kn ##ack ##s made from deer hooves or ram ' s horns which gave her nightmares .

reference_raw: The house was still cold, filled with stale animal odors and decorated with grotesque knacks made of deer hooves or ram horns that gave her nightmares.

reference_spacy_tokens: The house was still cold , filled with stale animal odors and decorated with grotesque knacks made of deer hooves or ram horns that gave her nightmares .


fn_spacy_tokens_for_baseline: There was only the scratching of pens and the rustle of paper as everyone waited for the reply .

source_bert_toks: there was only the scratching of pens and the rust ##le of paper as everyone waited for the reply .

reference_raw: There was only the scraping of pens and the scraping of paper as they waited for the answer.

reference_spacy_tokens: There was only the scraping of pens and the scraping of paper as they waited for the answer .


fn_spacy_tokens_for_baseline: ' Would it be impertinent to ask why ? ' he gritted .

source_bert_toks: ' would it be imp ##ert ##inen ##t to ask why ? ' he gritted .

reference_raw: "Would it be rude to ask why?" he gritted.

reference_spacy_tokens: " Would it be rude to ask why ? " he gritted .


fn_spacy_tokens_for_baseline: Another time , a photographer had ventured onto the reef that rose up from the sea at the far corner .

source_bert_toks: another time , a photographer had ventured onto the reef that rose up from the sea at the far corner .

reference_raw: Another time, a photographer took a chance on a cliff that rose out of the sea in the far corner.

reference_spacy_tokens: Another time , a photographer took a chance on a cliff that rose out of the sea in the far corner .


fn_spacy_tokens_for_baseline: It is even becoming something of a commuter town - owning or renting an apartment here costs a fraction of what it would in Hong Kong .

source_bert_toks: it is even becoming something of a commuter town - owning or rent ##ing an apartment here costs a fraction of what it would in hong kong .

reference_raw: In fact, it's becoming something of a commuter city - owning or renting a flat here cost a fraction of what it would have cost in Hong Kong.

reference_spacy_tokens: In fact , it 's becoming something of a commuter city - owning or renting a flat here cost a fraction of what it would have cost in Hong Kong .


fn_spacy_tokens_for_baseline: This assistance has included the sale of production and missile component technologies , training of personnel , construction of the Shahrud Missile Test Facility , and the assembly and production of the M-7 ( a.k.a . , CSS-8 , 8610 or B610 ) .

source_bert_toks: this assistance has included the sale of production and missile component technologies , training of personnel , construction of the shah ##rud missile test facility , and the assembly and production of the m - 7 ( a . k . a . , cs ##s - 8 , 86 ##10 or b ##6 ##10 ) .

reference_raw: This assistance included the sale of production and missile component technologies, the training of personnel, the construction of the Shahrud missile test facility and the assembly and production of M-7 (a.k.a., CSS-8, 8610 or B610).

reference_spacy_tokens: This assistance included the sale of production and missile component technologies , the training of personnel , the construction of the Shahrud missile test facility and the assembly and production of M-7 ( a.k.a . , CSS-8 , 8610 or B610 ) .


fn_spacy_tokens_for_baseline: His wrists began to ache , and his nails were empurpled with blood .

source_bert_toks: his wrists began to ache , and his nails were em ##pur ##pled with blood .

reference_raw: His wrists were beginning to hurt, and his fingernails were covered with blood.

reference_spacy_tokens: His wrists were beginning to hurt , and his fingernails were covered with blood .


fn_spacy_tokens_for_baseline: Very pleased , Cheryl bade her goodbye and tripped off to the bus - stop , collecting Mrs. Yatton 's shoes on the way .

source_bert_toks: very pleased , cheryl bad ##e her goodbye and tripped off to the bus - stop , collecting mrs . ya ##tton ' s shoes on the way .

reference_raw: Cheryl took great pleasure in saying good-bye and stumbled to the bus stop to pick up Mrs. Yatton's boots.

reference_spacy_tokens: Cheryl took great pleasure in saying good - bye and stumbled to the bus stop to pick up Mrs. Yatton 's boots .


fn_spacy_tokens_for_baseline: Have we become so depressed about any real prospect of newness that we 've decided to enjoy our chains , masochistically dwelling on our miseries and inadequacies ?

source_bert_toks: have we become so depressed about any real prospect of new ##ness that we ' ve decided to enjoy our chains , mas ##och ##istic ##ally dwelling on our mis ##eries and ina ##de ##qua ##cies ?

reference_raw: Have we become so dejected by the real prospect of newness that we have decided to enjoy our chains and masochistically dwell on our sufferings and inadequacies?

reference_spacy_tokens: Have we become so dejected by the real prospect of newness that we have decided to enjoy our chains and masochistically dwell on our sufferings and inadequacies ?


fn_spacy_tokens_for_baseline: It was handed in by a couple of children this morning .

source_bert_toks: it was handed in by a couple of children this morning .

reference_raw: Two kids gave it to me this morning.

reference_spacy_tokens: Two kids gave it to me this morning .


fn_spacy_tokens_for_baseline: However , Aetna 's employee benefits division , which includes its group health insurance operations , posted a 34 % profit gain to $ 106 million .

source_bert_toks: however , ae ##t ##na ' s employee benefits division , which includes its group health insurance operations , posted a 34 % profit gain to $ 106 million .

reference_raw: However, Aetna's employee benefits division, including its group health insurance activities, added 34% to $106 million.

reference_spacy_tokens: However , Aetna 's employee benefits division , including its group health insurance activities , added 34 % to $ 106 million .


fn_spacy_tokens_for_baseline: He had never been able to grasp it himself , never been able to assemble the jigsaw pieces of his identity into a clear recognisable picture .

source_bert_toks: he had never been able to grasp it himself , never been able to assemble the ji ##gs ##aw pieces of his identity into a clear rec ##og ##nis ##able picture .

reference_raw: He had never been able to understand it himself, had never been able to put the puzzle pieces of his identity together in a clear recognizable image.

reference_spacy_tokens: He had never been able to understand it himself , had never been able to put the puzzle pieces of his identity together in a clear recognizable image .


fn_spacy_tokens_for_baseline: Then he began to move slowly and carefully past the table , on the opposite side to Moore .

source_bert_toks: then he began to move slowly and carefully past the table , on the opposite side to moore .

reference_raw: Then he moved slowly and carefully around the table, across from Moore.

reference_spacy_tokens: Then he moved slowly and carefully around the table , across from Moore .


fn_spacy_tokens_for_baseline: Since then , as bien - pensant American opinion has embraced the ' peace process , ' Said has bemoaned Arafat 's ' capitulation ' and grown increasingly disgusted with the chairman 's dictatorial rule over a few scraps of occupied territory and with Israel 's continued expropriation of Palestinian lands .

source_bert_toks: since then , as bien - pens ##ant american opinion has embraced the ' peace process , ' said has be ##mo ##ane ##d ara ##fat ' s ' cap ##it ##ulation ' and grown increasingly disgusted with the chairman ' s dictator ##ial rule over a few scrap ##s of occupied territory and with israel ' s continued ex ##pro ##pr ##iation of palestinian lands .

reference_raw: Since then, as bien-pensant American opinion has accepted the peace process," said, moaning Arafat's surrender, "and growing more and more disgusted by the President's dictatorial reign over some of the occupied territories and the continued expropriation of Palestinian countries by Israel.

reference_spacy_tokens: Since then , as bien - pensant American opinion has accepted the peace process , " said , moaning Arafat 's surrender , " and growing more and more disgusted by the President 's dictatorial reign over some of the occupied territories and the continued expropriation of Palestinian countries by Israel .


fn_spacy_tokens_for_baseline: Ann Foster , the defending candidate 's wife and House of Commons secretary , had flowers and election leaflets in her basket and two liquorice sweets in her hand .

source_bert_toks: ann foster , the defending candidate ' s wife and house of commons secretary , had flowers and election leaflets in her basket and two liquor ##ice sweets in her hand .

reference_raw: Ann Foster, the defense candidate's wife and secretary of the House of Commons, held flowers and election pamphlets in her basket and two candy liquorice in her hand.

reference_spacy_tokens: Ann Foster , the defense candidate 's wife and secretary of the House of Commons , held flowers and election pamphlets in her basket and two candy liquorice in her hand .


fn_spacy_tokens_for_baseline: The road stretched ahead , swerving gently up a hill through fields bounded by stone walls .

source_bert_toks: the road stretched ahead , sw ##erving gently up a hill through fields bounded by stone walls .

reference_raw: The road stretched ahead, turning gently up the hill through the fields lined with stone walls.

reference_spacy_tokens: The road stretched ahead , turning gently up the hill through the fields lined with stone walls .


fn_spacy_tokens_for_baseline: They complained that the Law of Similars often obliged them to use overpriced components , handicapping their products in world markets .

source_bert_toks: they complained that the law of similar ##s often obliged them to use over ##pr ##ice ##d components , handicap ##ping their products in world markets .

reference_raw: They complained that the Law of Similarity often required them to use over-priced components and disabled their products on world markets.

reference_spacy_tokens: They complained that the Law of Similarity often required them to use over - priced components and disabled their products on world markets .


fn_spacy_tokens_for_baseline: Dulles also favoured American aid to members of the Baghdad Pact , though without American adherence .

source_bert_toks: dull ##es also favoured american aid to members of the baghdad pact , though without american adherence .

reference_raw: Dulles also preferred American support to the Baghdad Pact members, but without American support.

reference_spacy_tokens: Dulles also preferred American support to the Baghdad Pact members , but without American support .


fn_spacy_tokens_for_baseline: Meanwhile , while not officially sanctioning the use of force against Iraq , China 's curry - favouring bolstered its future bid for ' Third World ' leadership .

source_bert_toks: meanwhile , while not officially san ##ction ##ing the use of force against iraq , china ' s curry - favour ##ing bo ##lster ##ed its future bid for ' third world ' leadership .

reference_raw: Meanwhile, while not officially approving the use of force against Iraq, China's curry-favouring bolstered its future bid for the leadership of the Third World.

reference_spacy_tokens: Meanwhile , while not officially approving the use of force against Iraq , China 's curry - favouring bolstered its future bid for the leadership of the Third World .


fn_spacy_tokens_for_baseline: I noticed how her teeth were still white , not rotting black like those of the courtiers who constantly stuffed sweets and comfits into their mouth .

source_bert_toks: i noticed how her teeth were still white , not rotting black like those of the court ##iers who constantly stuffed sweets and com ##fi ##ts into their mouth .

reference_raw: I noticed that her teeth were still white, not rotten black, like those of the courtiers who kept stuffing sweets and comforts in their mouths.

reference_spacy_tokens: I noticed that her teeth were still white , not rotten black , like those of the courtiers who kept stuffing sweets and comforts in their mouths .


fn_spacy_tokens_for_baseline: Mitsubishi is expected to be the next Japanese company to begin car manufacture in Europe following in the footsteps of Nissan , Toyota and Honda .

source_bert_toks: mitsubishi is expected to be the next japanese company to begin car manufacture in europe following in the footsteps of nissan , toyota and honda .

reference_raw: Mitsubishi is expected to be the next Japanese company to start car production in Europe, followed by Nissan, Toyota and Honda.

reference_spacy_tokens: Mitsubishi is expected to be the next Japanese company to start car production in Europe , followed by Nissan , Toyota and Honda .


fn_spacy_tokens_for_baseline: Inwardly seething , she did as she was told , carefully tucking her dressing - gown about her legs .

source_bert_toks: inwardly see ##thing , she did as she was told , carefully tucking her dressing - gown about her legs .

reference_raw: She did as she was told, carefully tugging her robe around her legs.

reference_spacy_tokens: She did as she was told , carefully tugging her robe around her legs .


fn_spacy_tokens_for_baseline: They have covered every conceivable subject .

source_bert_toks: they have covered every con ##ce ##iva ##ble subject .

reference_raw: They took care of all possible subjects.

reference_spacy_tokens: They took care of all possible subjects .


fn_spacy_tokens_for_baseline: They came from various parts of Europe , many with poignant backgrounds and experiences of hardship and misery .

source_bert_toks: they came from various parts of europe , many with po ##ignant backgrounds and experiences of hardship and misery .

reference_raw: They came from different parts of Europe, many of them with a pretentious background and experience of hardship and suffering.

reference_spacy_tokens: They came from different parts of Europe , many of them with a pretentious background and experience of hardship and suffering .


fn_spacy_tokens_for_baseline: ONE of Scotland 's most ancient highways may be given a new lease of life as a commuter route for cyclists .

source_bert_toks: one of scotland ' s most ancient highways may be given a new lease of life as a commuter route for cyclists .

reference_raw: One of the oldest roads in Scotland can get a new lease of life as a commuter route for cyclists.

reference_spacy_tokens: One of the oldest roads in Scotland can get a new lease of life as a commuter route for cyclists .


fn_spacy_tokens_for_baseline: yeah i 'm very familiar with the area

source_bert_toks: yeah i ' m very familiar with the area

reference_raw: Yeah, I know the area very well

reference_spacy_tokens: Yeah , I know the area very well


fn_spacy_tokens_for_baseline: The statues in the main shrine represent Man , the god of literature , and Mo , the god of war , a curious juxtaposition .

source_bert_toks: the statues in the main shrine represent man , the god of literature , and mo , the god of war , a curious ju ##xt ##ap ##osition .

reference_raw: The statues of the Great Shrine represent Man, the God of Literature, and Mo, the God of War, a curious juxtaposition.

reference_spacy_tokens: The statues of the Great Shrine represent Man , the God of Literature , and Mo , the God of War , a curious juxtaposition .


fn_spacy_tokens_for_baseline: And , initiative succeeding , brighter futures for 15 million people in the North of England could light up a new way to many more .

source_bert_toks: and , initiative succeeding , brighter futures for 15 million people in the north of england could light up a new way to many more .

reference_raw: And with a successful initiative, a brighter future for 15 million people in the north of England could light up a new path for many others.

reference_spacy_tokens: And with a successful initiative , a brighter future for 15 million people in the north of England could light up a new path for many others .


fn_spacy_tokens_for_baseline: If she went out it was at night and she would arrange her veils so that they covered her face four times .

source_bert_toks: if she went out it was at night and she would arrange her veil ##s so that they covered her face four times .

reference_raw: If she went out, it would be nighttime, and she would have arranged the curtains to cover her face four times.

reference_spacy_tokens: If she went out , it would be nighttime , and she would have arranged the curtains to cover her face four times .


fn_spacy_tokens_for_baseline: They found it hard to understand what he saw in the boys he now surrounded himself with , some of whom seemed to the girls stupid and callow and bad at drawing .

source_bert_toks: they found it hard to understand what he saw in the boys he now surrounded himself with , some of whom seemed to the girls stupid and call ##ow and bad at drawing .

reference_raw: It was difficult for them to understand what he had seen in the boys with whom he now surrounded himself, some of whom seemed stupid and callow to the girls, and evil in drawing.

reference_spacy_tokens: It was difficult for them to understand what he had seen in the boys with whom he now surrounded himself , some of whom seemed stupid and callow to the girls , and evil in drawing .


fn_spacy_tokens_for_baseline: ' Our difficulties are not over , ' he remarked , shaking his head .

source_bert_toks: ' our difficulties are not over , ' he remarked , shaking his head .

reference_raw: 'We're not done with our troubles,' he said, shaking his face.

reference_spacy_tokens: ' We 're not done with our troubles , ' he said , shaking his face .


fn_spacy_tokens_for_baseline: NEWCASTLE romped to their biggest win of the season last night proving far too strong for their neighbours .

source_bert_toks: newcastle rom ##ped to their biggest win of the season last night proving far too strong for their neighbours .

reference_raw: Last night, Newcastle trudged to their biggest victory of the season, proving too strong for their neighbors.

reference_spacy_tokens: Last night , Newcastle trudged to their biggest victory of the season , proving too strong for their neighbors .


fn_spacy_tokens_for_baseline: Three appliances and a hydraulic platform tackled the blaze .

source_bert_toks: three appliances and a hydraulic platform tackled the blaze .

reference_raw: The fire was fought by three appliances and a hydraulic platform.

reference_spacy_tokens: The fire was fought by three appliances and a hydraulic platform .


fn_spacy_tokens_for_baseline: Why people , nervous that their little town was being made into a prime nuclear target , should be less nervous for getting a closer look at the cause of their fears is a question not easily answered .

source_bert_toks: why people , nervous that their little town was being made into a prime nuclear target , should be less nervous for getting a closer look at the cause of their fears is a question not easily answered .

reference_raw: Why people, anxious to make their small city a prime nuclear target, should be less anxious to get a closer look at the cause of their fears is not an easy question to answer.

reference_spacy_tokens: Why people , anxious to make their small city a prime nuclear target , should be less anxious to get a closer look at the cause of their fears is not an easy question to answer .


fn_spacy_tokens_for_baseline: If you would like more information about how CREDO Mid - Pay can release you from payroll drudgery , simply fill in the attached coupon and take or send it to your local Midland branch manager .

source_bert_toks: if you would like more information about how cr ##edo mid - pay can release you from payroll dr ##udge ##ry , simply fill in the attached coup ##on and take or send it to your local midland branch manager .

reference_raw: If you want to know more about how CREDO Mid-Pay can free you from payroll work, just fill in the attached coupon and take it or send it to your local Midland branch manager.

reference_spacy_tokens: If you want to know more about how CREDO Mid - Pay can free you from payroll work , just fill in the attached coupon and take it or send it to your local Midland branch manager .


fn_spacy_tokens_for_baseline: They disagreed whether they were obligated by the correct theory of legislation to enforce the most literal or the most sensible reading of the statute in the absence of any reliable evidence about what Congress actually intended .

source_bert_toks: they disagreed whether they were ob ##liga ##ted by the correct theory of legislation to enforce the most literal or the most sensible reading of the statute in the absence of any reliable evidence about what congress actually intended .

reference_raw: They disagreed as to whether the correct legal theory required them to enforce the most literal or reasonable interpretation of the law without any reliable evidence of what Congress really intended to do.

reference_spacy_tokens: They disagreed as to whether the correct legal theory required them to enforce the most literal or reasonable interpretation of the law without any reliable evidence of what Congress really intended to do .


fn_spacy_tokens_for_baseline: In the 80s , the banks , with poor management , had conspired with government to get us into this situation .

source_bert_toks: in the 80s , the banks , with poor management , had con ##sp ##ired with government to get us into this situation .

reference_raw: In the '80s, the banks, poorly managed, co-operated with the government to get us into this situation.

reference_spacy_tokens: In the ' 80s , the banks , poorly managed , co - operated with the government to get us into this situation .


fn_spacy_tokens_for_baseline: Its no surprise that the US dollar is accepted as readily as the Jamaican dollar to pay for goods .

source_bert_toks: its no surprise that the us dollar is accepted as readily as the jamaican dollar to pay for goods .

reference_raw: No wonder the US dollar is accepted as easily as the Jamaican dollar to pay for the merchandise.

reference_spacy_tokens: No wonder the US dollar is accepted as easily as the Jamaican dollar to pay for the merchandise .


fn_spacy_tokens_for_baseline: Other men engaged in close hand - to - hand scuffles with the gardai .

source_bert_toks: other men engaged in close hand - to - hand sc ##uf ##fles with the ga ##rda ##i .

reference_raw: The other men were engaged in close combat with the gardai.

reference_spacy_tokens: The other men were engaged in close combat with the gardai .


fn_spacy_tokens_for_baseline: I went swiftly down the hall to the front door , and eased its bolts open .

source_bert_toks: i went swiftly down the hall to the front door , and eased its bolts open .

reference_raw: I hurried down the corridor to the front door and opened the locks.

reference_spacy_tokens: I hurried down the corridor to the front door and opened the locks .


fn_spacy_tokens_for_baseline: um no there 's there 's only one pop machine and it 's not accessible to the cafeteria now so uh mainly what they serve in there is juice and coffee and tea

source_bert_toks: um no there ' s there ' s only one pop machine and it ' s not accessible to the cafeteria now so uh mainly what they serve in there is juice and coffee and tea

reference_raw: Um, no, there's only one pop machine and it's not available in the dining room right now, so, uh, most of all, what they're serving here is juicy and coffee and tea.

reference_spacy_tokens: Um , no , there 's only one pop machine and it 's not available in the dining room right now , so , uh , most of all , what they 're serving here is juicy and coffee and tea .


fn_spacy_tokens_for_baseline: You 'll soon be able to walk down Bond Street without spotting a single varicose vein or mottled thigh .

source_bert_toks: you ' ll soon be able to walk down bond street without spotting a single var ##ico ##se vein or mo ##ttle ##d thigh .

reference_raw: Soon you'll be able to walk down Bond Street without seeing a single varicose vein or a mottled leg.

reference_spacy_tokens: Soon you 'll be able to walk down Bond Street without seeing a single varicose vein or a mottled leg .


fn_spacy_tokens_for_baseline: As I was dithering between neglected work and abandoned clearing up , she rang me .

source_bert_toks: as i was di ##ther ##ing between neglected work and abandoned clearing up , she rang me .

reference_raw: While I was dining between neglected work and abandoned cleaning, she rang the bell.

reference_spacy_tokens: While I was dining between neglected work and abandoned cleaning , she rang the bell .


fn_spacy_tokens_for_baseline: Outside , a milk trolley was whirring by .

source_bert_toks: outside , a milk trolley was w ##hir ##ring by .

reference_raw: Outside, a milk cart whistled past.

reference_spacy_tokens: Outside , a milk cart whistled past .


fn_spacy_tokens_for_baseline: If ( say ) the mother is inconsistent , she is , in a sense , only half trying to get her child to behave in the way she desires .

source_bert_toks: if ( say ) the mother is inconsistent , she is , in a sense , only half trying to get her child to behave in the way she desires .

reference_raw: If (say) the mother is inconsistent, in a sense, she's only half trying to get her child to act the way she wants.

reference_spacy_tokens: If ( say ) the mother is inconsistent , in a sense , she 's only half trying to get her child to act the way she wants .


fn_spacy_tokens_for_baseline: Pipe tiny balls of pastry onto the prepared baking sheets , or not more than ½ × 5ml / tsp mounds if you do not have a piping bag .

source_bert_toks: pipe tiny balls of pastry onto the prepared baking sheets , or not more than ½ × 5 ##ml / ts ##p mounds if you do not have a pip ##ing bag .

reference_raw: Pipe small rolls of baking into prepared baking sheets or not more than 1,5 × 5 ml/tsp mounds, unless you have a pipe bag.

reference_spacy_tokens: Pipe small rolls of baking into prepared baking sheets or not more than 1,5 × 5 ml / tsp mounds , unless you have a pipe bag .


fn_spacy_tokens_for_baseline: If the following method of getting into Word does not apply exactly to the way your machine is set up , use your manual .

source_bert_toks: if the following method of getting into word does not apply exactly to the way your machine is set up , use your manual .

reference_raw: If the following method of accessing Word does not apply exactly how your computer is configured, use your handbook.

reference_spacy_tokens: If the following method of accessing Word does not apply exactly how your computer is configured , use your handbook .


fn_spacy_tokens_for_baseline: ' A chaotic case , my dear Watson , ' said Holmes over an evening pipe .

source_bert_toks: ' a chaotic case , my dear watson , ' said holmes over an evening pipe .

reference_raw: "It's a chaotic case, my dear Watson," said Holmes through the night pipe.

reference_spacy_tokens: " It 's a chaotic case , my dear Watson , " said Holmes through the night pipe .


fn_spacy_tokens_for_baseline: Furthermore , during Sir James 's subsequent stay , I gathered that Mr Graham was no longer in Sir James 's employ ; indeed that Sir James no longer employed any full - time staff at all .

source_bert_toks: furthermore , during sir james ' s subsequent stay , i gathered that mr graham was no longer in sir james ' s employ ; indeed that sir james no longer employed any full - time staff at all .

reference_raw: In addition, during the subsequent stay of Sir James, I learned that Mr. Graham was no longer in the service of Sir James; indeed, Sir James was no longer in full-time employment.

reference_spacy_tokens: In addition , during the subsequent stay of Sir James , I learned that Mr. Graham was no longer in the service of Sir James ; indeed , Sir James was no longer in full - time employment .


fn_spacy_tokens_for_baseline: The onus is on the defendant to show that the escape was due to the unforeseeable act of a stranger without any negligence on his own part .

source_bert_toks: the on ##us is on the defendant to show that the escape was due to the un ##for ##ese ##ea ##ble act of a stranger without any negligence on his own part .

reference_raw: It is for the defendant to prove that the escape was caused by the unexpected act of a foreigner without any negligence on his part.

reference_spacy_tokens: It is for the defendant to prove that the escape was caused by the unexpected act of a foreigner without any negligence on his part .


fn_spacy_tokens_for_baseline: Brandon 's acquaintances become suspicious of his gender , and John and Tom become hostile toward him .

source_bert_toks: brandon ' s acquaintances become suspicious of his gender , and john and tom become hostile toward him .

reference_raw: Brandon's friends start to suspect his sex, and John and Tom become hostile to him.

reference_spacy_tokens: Brandon 's friends start to suspect his sex , and John and Tom become hostile to him .


fn_spacy_tokens_for_baseline: 2- Under no circumstance a car , even that which belongs to the location should be permitted to park next to the fence .

source_bert_toks: 2 - under no circumstance a car , even that which belongs to the location should be permitted to park next to the fence .

reference_raw: 2- Under no circumstances should a vehicle be allowed to park next to the fence, even if it belongs to the site.

reference_spacy_tokens: 2- Under no circumstances should a vehicle be allowed to park next to the fence , even if it belongs to the site .


fn_spacy_tokens_for_baseline: Posing questions to which there are no satisfactory answers , Richter revels in the absurdity of all artistic activity -- and continues to paint .

source_bert_toks: posing questions to which there are no satisfactory answers , richter rev ##els in the absurd ##ity of all artistic activity - - and continues to paint .

reference_raw: He poses questions to which there are no satisfactory answers, and Richter revels in the ludicrousness of all artistic activities - and continues to paint.

reference_spacy_tokens: He poses questions to which there are no satisfactory answers , and Richter revels in the ludicrousness of all artistic activities - and continues to paint .


fn_spacy_tokens_for_baseline: In Liguria strong flavours mix with frugal foods for the specialities and hearty fish dishes play a big part -- try ' buridda ' , a tasty fish soup .

source_bert_toks: in li ##gur ##ia strong flavour ##s mix with fr ##uga ##l foods for the special ##ities and heart ##y fish dishes play a big part - - try ' bu ##rid ##da ' , a ta ##sty fish soup .

reference_raw: In Liguria, strong flavours mix with fruity foods for specialities and hearty fish dishes play a major role - try "buridda", delicious fish soup.

reference_spacy_tokens: In Liguria , strong flavours mix with fruity foods for specialities and hearty fish dishes play a major role - try " buridda " , delicious fish soup .


fn_spacy_tokens_for_baseline: If he made a joke and she realized it was one , she used to butt him in the chest -- she was much shorter -- and say ' You 're silly ! '

source_bert_toks: if he made a joke and she realized it was one , she used to butt him in the chest - - she was much shorter - - and say ' you ' re silly ! '

reference_raw: If he made a joke and she realized it was one of them, she'd put it in his chest - much shorter - and say, "You're stupid!"

reference_spacy_tokens: If he made a joke and she realized it was one of them , she 'd put it in his chest - much shorter - and say , " You 're stupid ! "


fn_spacy_tokens_for_baseline: Under this a corporation could be required to , say , build a new hospital , or pay for a motorway , school , nursery , or library .

source_bert_toks: under this a corporation could be required to , say , build a new hospital , or pay for a motorway , school , nursery , or library .

reference_raw: Under that, a company could be required, for example, to build a new clinic or to pay for a motorway, school, kindergarten, or library.

reference_spacy_tokens: Under that , a company could be required , for example , to build a new clinic or to pay for a motorway , school , kindergarten , or library .


fn_spacy_tokens_for_baseline: Inland travel and preaching became easier at once , though he had hair - raising adventures and was not naturally brave .

source_bert_toks: inland travel and preaching became easier at once , though he had hair - raising adventures and was not naturally brave .

reference_raw: Inland travel and preaching became easier at once, though he had a hairy adventure and was not naturally brave.

reference_spacy_tokens: Inland travel and preaching became easier at once , though he had a hairy adventure and was not naturally brave .


fn_spacy_tokens_for_baseline: It is a single cell , consisting of an outside layer which is relatively tough , an internal jelly - like substance and a central core , or nucleus which contains the chromosomes .

source_bert_toks: it is a single cell , consisting of an outside layer which is relatively tough , an internal jelly - like substance and a central core , or nucleus which contains the chromosomes .

reference_raw: It is a single cell consisting of a relatively hard outer layer, an internal jelly-like substance and a central nucleus, or a nucleus containing chromosomes.

reference_spacy_tokens: It is a single cell consisting of a relatively hard outer layer , an internal jelly - like substance and a central nucleus , or a nucleus containing chromosomes .


fn_spacy_tokens_for_baseline: She woke in the early dawn and peered around her blearily through the heavy mist that filled the wood .

source_bert_toks: she woke in the early dawn and peered around her b ##lea ##rily through the heavy mist that filled the wood .

reference_raw: She awoke in the early morning and looked around blearily through the heavy fog that filled the wood.

reference_spacy_tokens: She awoke in the early morning and looked around blearily through the heavy fog that filled the wood .


fn_spacy_tokens_for_baseline: ' Cole Porter -- and good champagne , ' she 'd said , lifting her glass filled with a delicate golden liquid whose tiny bubbles fizzed gently and steadily upwards .

source_bert_toks: ' cole porter - - and good champagne , ' she ' d said , lifting her glass filled with a delicate golden liquid whose tiny bubbles fi ##zz ##ed gently and steadily upwards .

reference_raw: 'Cole Porter - and good champagne,' she said, raising a glass filled with a fine golden liquid, the tiny bubbles of which fluttered gently and steadily upward.

reference_spacy_tokens: ' Cole Porter - and good champagne , ' she said , raising a glass filled with a fine golden liquid , the tiny bubbles of which fluttered gently and steadily upward .


fn_spacy_tokens_for_baseline: Coat each hair with a fine translucent film which smooths down the rough surface & seals the hair to prevent moisture loss .

source_bert_toks: coat each hair with a fine translucent film which smooth ##s down the rough surface & seals the hair to prevent moisture loss .

reference_raw: Cover each hair with a fine transparent film that smooths the rough surface and seals the hair in order to avoid loss of moisture.

reference_spacy_tokens: Cover each hair with a fine transparent film that smooths the rough surface and seals the hair in order to avoid loss of moisture .


fn_spacy_tokens_for_baseline: Constantinople was taken by Crusader forces in 1204 , and they stripped the city of many of its finest treasures -- which now grace the public buildings of Venice -- although a large consignment of books and manuscripts was transferred to the monastery at Patmos before the city fell .

source_bert_toks: constantinople was taken by crusader forces in 120 ##4 , and they stripped the city of many of its finest treasures - - which now grace the public buildings of venice - - although a large con ##si ##gn ##ment of books and manuscripts was transferred to the monastery at pat ##mos before the city fell .

reference_raw: Constantinople was captured by the Crusader forces in 1204, and the city was deprived of many of its finest treasures - which now grace the public buildings of Venice - though a large shipment of books and manuscripts had been transferred to the convent in Patmos before the collapse of the city.

reference_spacy_tokens: Constantinople was captured by the Crusader forces in 1204 , and the city was deprived of many of its finest treasures - which now grace the public buildings of Venice - though a large shipment of books and manuscripts had been transferred to the convent in Patmos before the collapse of the city .


fn_spacy_tokens_for_baseline: In the event , as historians have observed , the spark was trivial -- a man 's signature on his marriage contract .

source_bert_toks: in the event , as historians have observed , the spark was trivial - - a man ' s signature on his marriage contract .

reference_raw: In case, as historians have pointed out, the spark was inconsequential - the signature of a man on a marriage contract.

reference_spacy_tokens: In case , as historians have pointed out , the spark was inconsequential - the signature of a man on a marriage contract .


fn_spacy_tokens_for_baseline: Over the years , the new sound may acquire its own distinction : a dignified gentleman announcing Ahem ! to gain attention , rather than actually clearing his throat , or someone cackling Yukkety yuk yuk ! at a lousy joke .

source_bert_toks: over the years , the new sound may acquire its own distinction : a dig ##nified gentleman announcing ah ##em ! to gain attention , rather than actually clearing his throat , or someone ca ##ck ##ling yu ##kk ##ety yu ##k yu ##k ! at a lou ##sy joke .

reference_raw: Over the years, a new noise can have its own difference: a dignified gentleman announcing Ahem! to get attention instead of actually clearing his throat, or someone cackling Yukkety Yuk! at a bad joke.

reference_spacy_tokens: Over the years , a new noise can have its own difference : a dignified gentleman announcing Ahem ! to get attention instead of actually clearing his throat , or someone cackling Yukkety Yuk ! at a bad joke .


fn_spacy_tokens_for_baseline: During the sweltering I d of 1333 , a camel caravan could be seen winding its way through the narrow passes and defiles of the Hindu Kush .

source_bert_toks: during the sw ##elt ##ering id of 133 ##3 , a camel caravan could be seen winding its way through the narrow passes and def ##ile ##s of the hindu ku ##sh .

reference_raw: During the flooding Id of 1333, a camel caravan could be seen winding its way through the narrow passes and abysses of the Hindu Kush.

reference_spacy_tokens: During the flooding I d of 1333 , a camel caravan could be seen winding its way through the narrow passes and abysses of the Hindu Kush .


fn_spacy_tokens_for_baseline: In 1908 Russell wrote of how the club movement sought to emulate the schools , ' the special pride of the country ' .

source_bert_toks: in 1908 russell wrote of how the club movement sought to em ##ulate the schools , ' the special pride of the country ' .

reference_raw: In 1908, Russell said, "Special pride of the country", how the club movement tried to imitate schools.

reference_spacy_tokens: In 1908 , Russell said , " Special pride of the country " , how the club movement tried to imitate schools .


fn_spacy_tokens_for_baseline: Among the responses the Swiss trader got was one from the Soviet national shipping company , which had n't been invited to submit a bid .

source_bert_toks: among the responses the swiss trader got was one from the soviet national shipping company , which hadn ' t been invited to submit a bid .

reference_raw: Among the replies the Swiss trader received was one of the Soviet National Shipping Company, which was not asked to submit an offer.

reference_spacy_tokens: Among the replies the Swiss trader received was one of the Soviet National Shipping Company , which was not asked to submit an offer .


fn_spacy_tokens_for_baseline: So I hooked my leg through his and tripped him and he gave a roar of rage and punched me right in the stomach .

source_bert_toks: so i hooked my leg through his and tripped him and he gave a roar of rage and punched me right in the stomach .

reference_raw: So I hooked my foot into his, tripped him, and he screamed and hit me in the stomach.

reference_spacy_tokens: So I hooked my foot into his , tripped him , and he screamed and hit me in the stomach .


fn_spacy_tokens_for_baseline: Sofia 's International Peace Foundation , named after Mr Zhivkov 's late daughter , is being investigated following allegations by a central committee member that it was used to send convertible currency abroad for the family 's use .

source_bert_toks: sofia ' s international peace foundation , named after mr z ##hi ##v ##kov ' s late daughter , is being investigated following allegations by a central committee member that it was used to send convertible currency abroad for the family ' s use .

reference_raw: The Sofia International Peace Foundation, named after the late daughter of Mr. Zhivkov, is under investigation after a member of the Central Committee has claimed that it was used to send convertible currency abroad for family use.

reference_spacy_tokens: The Sofia International Peace Foundation , named after the late daughter of Mr. Zhivkov , is under investigation after a member of the Central Committee has claimed that it was used to send convertible currency abroad for family use .


fn_spacy_tokens_for_baseline: Nevertheless an assemblage of tools is often found together comprising shears , combs and spindle whorls for spinning .

source_bert_toks: nevertheless an ass ##em ##bla ##ge of tools is often found together comprising shear ##s , comb ##s and spin ##dle whorls for spinning .

reference_raw: However, a set of instruments is often found together, consisting of scissors, combs and spindle whorls for spinning.

reference_spacy_tokens: However , a set of instruments is often found together , consisting of scissors , combs and spindle whorls for spinning .


fn_spacy_tokens_for_baseline: This liability benefits only the immediate purchaser from the manufacturer , because liability for breach of contract exists only between parties to the same contract .

source_bert_toks: this liability benefits only the immediate purchase ##r from the manufacturer , because liability for breach of contract exists only between parties to the same contract .

reference_raw: This liability only benefits the manufacturer's direct buyer, since liability for breach of contract exists only between the parties to the same contract.

reference_spacy_tokens: This liability only benefits the manufacturer 's direct buyer , since liability for breach of contract exists only between the parties to the same contract .


fn_spacy_tokens_for_baseline: providing analysis and other support concerning the effectiveness of investments in communities and economic development ;

reference_raw: the provision of analyses and other support related to the efficiency of investment in communities and economic growth;

reference_spacy_tokens: the provision of analyses and other support related to the efficiency of investment in communities and economic growth ;


fn_spacy_tokens_for_baseline: People like feeling pity for people , it makes them feel lucky .

source_bert_toks: people like feeling pity for people , it makes them feel lucky .

reference_raw: People like to feel sorry for people, make them happy.

reference_spacy_tokens: People like to feel sorry for people , make them happy .


fn_spacy_tokens_for_baseline: The collision happened as the Greenpeace boat tried to follow the Akatsuki Maru on its voyage back to Japan with 1.7 tons of plutonium loaded in Cherbourg , France , on Saturday .

source_bert_toks: the collision happened as the green ##pe ##ace boat tried to follow the aka ##tsu ##ki maru on its voyage back to japan with 1 . 7 tons of pluto ##nium loaded in cher ##bourg , france , on saturday .

reference_raw: The collision occurred when the Greenpeace ship tried to track the Akatsuki Maru on its way back to Japan with 1.7 tons of plutonium loaded on Saturday in Cherbourg, France.

reference_spacy_tokens: The collision occurred when the Greenpeace ship tried to track the Akatsuki Maru on its way back to Japan with 1.7 tons of plutonium loaded on Saturday in Cherbourg , France .


fn_spacy_tokens_for_baseline: Instantly Harriet pressed her hand across her mouth in a theatrical gesture .

source_bert_toks: instantly harriet pressed her hand across her mouth in a theatrical gesture .

reference_raw: Harriet immediately clasped her hand over her mouth in a theatrical gesture.

reference_spacy_tokens: Harriet immediately clasped her hand over her mouth in a theatrical gesture .


fn_spacy_tokens_for_baseline: PORTADOWN families holidaying as far away as Crete have written home condemning the IRA for destroying their town , it was revealed today .

source_bert_toks: port ##ado ##wn families holiday ##ing as far away as crete have written home condemning the ira for destroying their town , it was revealed today .

reference_raw: The PORTADOWN family vacationed as far away as Crete had written home to denounce the IRA for the destruction of their city was revealed today.

reference_spacy_tokens: The PORTADOWN family vacationed as far away as Crete had written home to denounce the IRA for the destruction of their city was revealed today .


fn_spacy_tokens_for_baseline: ' But wait ' til you see winter in Spiderglass Scand ! ' he said , moist lips curving in an ecstatic smile .

source_bert_toks: ' but wait ' til you see winter in spider ##glass scan ##d ! ' he said , moist lips curving in an ec ##static smile .

reference_raw: "Wait 'til you see the winter in Spiderglass Scand!" he said, his wet lips curving in a smile of ecstasy.

reference_spacy_tokens: " Wait ' til you see the winter in Spiderglass Scand ! " he said , his wet lips curving in a smile of ecstasy .


fn_spacy_tokens_for_baseline: Even the father 's funeral feast explodes in chaos -- the classic Dostoevsky skandal .

source_bert_toks: even the father ' s funeral feast explodes in chaos - - the classic dos ##to ##evsky ska ##nda ##l .

reference_raw: Even my father's funeral banquet explodes in chaos - the classic Dostoevsky Skandal.

reference_spacy_tokens: Even my father 's funeral banquet explodes in chaos - the classic Dostoevsky Skandal .


fn_spacy_tokens_for_baseline: Arty 's voice thickened and blurred into animal grunts as he tried to speak and extend his tongue at the same time .

source_bert_toks: art ##y ' s voice thick ##ened and blurred into animal grunt ##s as he tried to speak and extend his tongue at the same time .

reference_raw: Arty's voice grew thick and blurry in animal growls as he tried to speak and spread his tongue at the same time.

reference_spacy_tokens: Arty 's voice grew thick and blurry in animal growls as he tried to speak and spread his tongue at the same time .


fn_spacy_tokens_for_baseline: And what did he want coming to this back of beyond ? '

source_bert_toks: and what did he want coming to this back of beyond ? '

reference_raw: And what did he want to go back to the other side of the world?'

reference_spacy_tokens: And what did he want to go back to the other side of the world ? '


fn_spacy_tokens_for_baseline: ' Gina -- I 'd like you to meet Lotta Petterson -- Lotta , this is Gina Price , a friend of mine from England . '

source_bert_toks: ' gina - - i ' d like you to meet lot ##ta pet ##ters ##on - - lot ##ta , this is gina price , a friend of mine from england . '

reference_raw: 'Gina - this is Lotta Petterson - Lotta, this is Gina Price, my English boyfriend.'

reference_spacy_tokens: ' Gina - this is Lotta Petterson - Lotta , this is Gina Price , my English boyfriend . '


fn_spacy_tokens_for_baseline: It is hard to see any anti - competitive danger that justifies denying people these benefits . "

source_bert_toks: it is hard to see any anti - competitive danger that just ##ifies denying people these benefits . "

reference_raw: It is difficult to see any anti-competitive danger that would warrant denying people such benefits.'

reference_spacy_tokens: It is difficult to see any anti - competitive danger that would warrant denying people such benefits . '


fn_spacy_tokens_for_baseline: The following paragraphs and the schedule attached to this letter summarize your main conditions of service as they will apply in relation to this appointment .

source_bert_toks: the following paragraph ##s and the schedule attached to this letter sum ##mar ##ize your main conditions of service as they will apply in relation to this appointment .

reference_raw: The following paragraphs and the schedule attached to this letter summarise your main conditions of service as they apply to this appointment.

reference_spacy_tokens: The following paragraphs and the schedule attached to this letter summarise your main conditions of service as they apply to this appointment .


fn_spacy_tokens_for_baseline: Open sources reported that the Russian Minister of Atomic Energy confirmed that discussions over supplying Syria with a power plant and a desalination plant were taking place .

source_bert_toks: open sources reported that the russian minister of atomic energy confirmed that discussions over supplying syria with a power plant and a des ##ali ##nation plant were taking place .

reference_raw: Open sources reported that Russia's Minister of Atomic Energy confirmed that discussions were taking place on the supply of the power plant and the desalination plant to Syria.

reference_spacy_tokens: Open sources reported that Russia 's Minister of Atomic Energy confirmed that discussions were taking place on the supply of the power plant and the desalination plant to Syria .


fn_spacy_tokens_for_baseline: This section of the towpath was about six feet wide , with the riverside cottages to their left and an iron railing to the right .

source_bert_toks: this section of the tow ##path was about six feet wide , with the riverside cottages to their left and an iron railing to the right .

reference_raw: This part of the trail was about six feet across, with the river-side huts on the left and the iron railing on the right.

reference_spacy_tokens: This part of the trail was about six feet across , with the river - side huts on the left and the iron railing on the right .


fn_spacy_tokens_for_baseline: Canadian companies exported $ 33.7 billion worth of goods , up 2.7 % from January 's revised level , the largest monthly rate of growth since May 2000 .

source_bert_toks: canadian companies exported $ 33 . 7 billion worth of goods , up 2 . 7 % from january ' s revised level , the largest monthly rate of growth since may 2000 .

reference_raw: Canadian companies exported $33.7 million worth of goods, up 2.7% from the revised January level, the highest monthly growth rate since May 2000.

reference_spacy_tokens: Canadian companies exported $ 33.7 million worth of goods , up 2.7 % from the revised January level , the highest monthly growth rate since May 2000 .