fn_spacy_tokens_for_baseline: He was on the road for a week , making sketches in villages along the way , intrigued particularly by the lives of weavers .

source_bert_toks: he was on the road for a week , making sketches in villages along the way , intrigued particularly by the lives of weaver ##s .

reference_raw: He'd been on the road for a week, making sketches in the villages along the way, particularly interested in the lives of the weavers.

reference_spacy_tokens: He 'd been on the road for a week , making sketches in the villages along the way , particularly interested in the lives of the weavers .


fn_spacy_tokens_for_baseline: And she would n't let Lucenzo crush her .

source_bert_toks: and she wouldn ' t let luce ##nzo crush her .

reference_raw: And she didn't want Lucenzo to destroy it.

reference_spacy_tokens: And she did n't want Lucenzo to destroy it .


fn_spacy_tokens_for_baseline: A series of disastrous decisions at the beginning of the 20th century began to sound a death knell for the Ottoman Empire .

source_bert_toks: a series of disastrous decisions at the beginning of the 20th century began to sound a death kn ##ell for the ottoman empire .

reference_raw: In the early 20th century, a series of catastrophic choices began to sound like the Ottoman Empire's death knell.

reference_spacy_tokens: In the early 20th century , a series of catastrophic choices began to sound like the Ottoman Empire 's death knell .


fn_spacy_tokens_for_baseline: That image becomes only slightly less blurry when , as now , there is another international alert about starving Ethiopians .

source_bert_toks: that image becomes only slightly less blur ##ry when , as now , there is another international alert about starving ethiopian ##s .

reference_raw: The image is only a little less blurry when, as it is now, there is another international alarm about starving Ethiopians.

reference_spacy_tokens: The image is only a little less blurry when , as it is now , there is another international alarm about starving Ethiopians .


fn_spacy_tokens_for_baseline: Some sources suggest that it is very close .

source_bert_toks: some sources suggest that it is very close .

reference_raw: Some sources indicate it's very near.

reference_spacy_tokens: Some sources indicate it 's very near .


fn_spacy_tokens_for_baseline: There is , however , a possibility that the peace concert , which was to have taken place this Saturday , May 29 , in the King 's Hall , may be rescheduled for the autumn .

source_bert_toks: there is , however , a possibility that the peace concert , which was to have taken place this saturday , may 29 , in the king ' s hall , may be res ##ched ##uled for the autumn .

reference_raw: It is possible, however, that the peace concert, which was to be held in the King's Hall on Saturday, May 29, may be postponed for the fall.

reference_spacy_tokens: It is possible , however , that the peace concert , which was to be held in the King 's Hall on Saturday , May 29 , may be postponed for the fall .


fn_spacy_tokens_for_baseline: It is in effect impossible to eliminate discretion by the formulation of rules ( Hill 1972 , Ch . 4 ) .

source_bert_toks: it is in effect impossible to eliminate discretion by the formulation of rules ( hill 1972 , ch . 4 ) .

reference_raw: In fact, it is not possible to exclude a margin of discretion by laying down rules (Hill 1972, Ch. 4).

reference_spacy_tokens: In fact , it is not possible to exclude a margin of discretion by laying down rules ( Hill 1972 , Ch . 4 ) .


fn_spacy_tokens_for_baseline: Cork is made up of a myriad of tiny cells , each imprisoning a tiny pocket of air .

source_bert_toks: cork is made up of a myriad of tiny cells , each imp ##ris ##oning a tiny pocket of air .

reference_raw: The cork consists of countless tiny cells, each holding a tiny pocket of air.

reference_spacy_tokens: The cork consists of countless tiny cells , each holding a tiny pocket of air .


fn_spacy_tokens_for_baseline: Because of difficulties with his squad getting time off work , Kelly fears he could be without as many as five players .

source_bert_toks: because of difficulties with his squad getting time off work , kelly fears he could be without as many as five players .

reference_raw: Because of the trouble with his team getting a break from work, Kelly's afraid he might be without up to five players.

reference_spacy_tokens: Because of the trouble with his team getting a break from work , Kelly 's afraid he might be without up to five players .


fn_spacy_tokens_for_baseline: Being the dead of night , the man was uncertain of how to leave the railway and at Rothley he walked up on to the platform .

source_bert_toks: being the dead of night , the man was uncertain of how to leave the railway and at roth ##ley he walked up on to the platform .

reference_raw: Because he was in the middle of the night, he didn't know how to leave the railroad, and he went to the platform in Rothley.

reference_spacy_tokens: Because he was in the middle of the night , he did n't know how to leave the railroad , and he went to the platform in Rothley .


fn_spacy_tokens_for_baseline: Sometimes she took the form of a crow , sitting quietly by as the soldiers went into the fray .

source_bert_toks: sometimes she took the form of a crow , sitting quietly by as the soldiers went into the fray .

reference_raw: From time to time she took the form of a crow and sat silently beside the soldiers as they entered the battle.

reference_spacy_tokens: From time to time she took the form of a crow and sat silently beside the soldiers as they entered the battle .


fn_spacy_tokens_for_baseline: At the moment the police have no conclusive evidence that Mr Riddle is dead , but if he is there is no reason to connect his death with the Wheel . '

source_bert_toks: at the moment the police have no con ##clusive evidence that mr riddle is dead , but if he is there is no reason to connect his death with the wheel . '

reference_raw: Right now, the police don't have any conclusive evidence that Mr. Riddle is dead, but if he is, there's no reason to link his death to the wheel.'

reference_spacy_tokens: Right now , the police do n't have any conclusive evidence that Mr. Riddle is dead , but if he is , there 's no reason to link his death to the wheel . '


fn_spacy_tokens_for_baseline: To date , Congress has authorized more than $ 4.7 billion for U.S. programs aimed at helping Russia and other newly independent states reduce the threats posed by their weapons of mass destruction .

source_bert_toks: to date , congress has authorized more than $ 4 . 7 billion for u . s . programs aimed at helping russia and other newly independent states reduce the threats posed by their weapons of mass destruction .

reference_raw: So far, Congress has approved over $4.7 billion for US programs to help Russia and other newly independent states reduce the threats posed by their weapons of mass destruction.

reference_spacy_tokens: So far , Congress has approved over $ 4.7 billion for US programs to help Russia and other newly independent states reduce the threats posed by their weapons of mass destruction .


fn_spacy_tokens_for_baseline: There are many successful schools scattered throughout this nation , some of them in the poorest of ghettos , and they are all sending us the same message .

source_bert_toks: there are many successful schools scattered throughout this nation , some of them in the poor ##est of ghetto ##s , and they are all sending us the same message .

reference_raw: There's a lot of successful schools all over the country, some in the poorest ghettos, and they're sending us the same message.

reference_spacy_tokens: There 's a lot of successful schools all over the country , some in the poorest ghettos , and they 're sending us the same message .


fn_spacy_tokens_for_baseline: The very flexible hooves of the mountain goat give it maximum grip on precarious slopes and dizzy ledges .

source_bert_toks: the very flexible hooves of the mountain goat give it maximum grip on pre ##car ##ious slopes and dizzy ledge ##s .

reference_raw: The very elastic hooves of the mountain goat give it maximum control over the uncertain slopes and the dizzying ledges.

reference_spacy_tokens: The very elastic hooves of the mountain goat give it maximum control over the uncertain slopes and the dizzying ledges .


fn_spacy_tokens_for_baseline: This fucking war has got to be fought .

source_bert_toks: this fucking war has got to be fought .

reference_raw: We have to fight this fucking war.

reference_spacy_tokens: We have to fight this fucking war .


fn_spacy_tokens_for_baseline: The device reportedly developed by al - Qaida to disperse deadly cyanide gas in subway cars and other confined spaces has never been used in a terrorist attack and probably would not be very effective , say experts .

source_bert_toks: the device reportedly developed by al - q ##aid ##a to disperse deadly cy ##ani ##de gas in subway cars and other confined spaces has never been used in a terrorist attack and probably would not be very effective , say experts .

reference_raw: The device that Al-Qaeda supposedly designed to dissipate lethal cyanide gas in subway cars and other confined spaces has not been used in a terrorist attack and is unlikely to be very effective, say experts.

reference_spacy_tokens: The device that Al - Qaeda supposedly designed to dissipate lethal cyanide gas in subway cars and other confined spaces has not been used in a terrorist attack and is unlikely to be very effective , say experts .


fn_spacy_tokens_for_baseline: Even the government bodies were starved of money .

source_bert_toks: even the government bodies were starved of money .

reference_raw: Even government bodies were hungry for money.

reference_spacy_tokens: Even government bodies were hungry for money .


fn_spacy_tokens_for_baseline: Some even asked the bewildered woman to sign their jeans .

source_bert_toks: some even asked the bewildered woman to sign their jeans .

reference_raw: Some even asked a confused woman to sign their jeans.

reference_spacy_tokens: Some even asked a confused woman to sign their jeans .


fn_spacy_tokens_for_baseline: Therefore , although hard work is necessary , slavishly following a ' suggested regime ' month after month hoping that it will some day ' click ' , may be ill - advised .

source_bert_toks: therefore , although hard work is necessary , sl ##avi ##sh ##ly following a ' suggested regime ' month after month hoping that it will some day ' click ' , may be ill - advised .

reference_raw: Therefore, although hard work is necessary, it may be unwise to follow the "proposed regime" month after month in the hope that one day it will click.

reference_spacy_tokens: Therefore , although hard work is necessary , it may be unwise to follow the " proposed regime " month after month in the hope that one day it will click .


fn_spacy_tokens_for_baseline: If his own reactions to past work are subject to shifts , the response of fans bewilders him even more .

source_bert_toks: if his own reactions to past work are subject to shifts , the response of fans be ##wil ##ders him even more .

reference_raw: When his own reaction to past work is subject to shifts, he is even more confused by the reaction of the fans.

reference_spacy_tokens: When his own reaction to past work is subject to shifts , he is even more confused by the reaction of the fans .


fn_spacy_tokens_for_baseline: ' We 'll swim in the sea , Grand - myre , ' she promised , putting a small consoling hand on Leonie 's shoulder .

source_bert_toks: ' we ' ll swim in the sea , grand - my ##re , ' she promised , putting a small con ##sol ##ing hand on leon ##ie ' s shoulder .

reference_raw: 'We will swim in the sea, Grandmyre,' she promised, laying a small comforting hand on Leonie's shoulder.

reference_spacy_tokens: ' We will swim in the sea , Grandmyre , ' she promised , laying a small comforting hand on Leonie 's shoulder .


fn_spacy_tokens_for_baseline: ' If you feed a powder supplement the feed should be dampened , so that if the horse blows through his nose , he does n't blow the powder onto the floor ! '

source_bert_toks: ' if you feed a powder supplement the feed should be damp ##ened , so that if the horse blows through his nose , he doesn ' t blow the powder onto the floor ! '

reference_raw: "If you feed the powder supplement, the feed should be damped, so that when the horse blows its nose, it does not blow the powder to the ground!"

reference_spacy_tokens: " If you feed the powder supplement , the feed should be damped , so that when the horse blows its nose , it does not blow the powder to the ground ! "


fn_spacy_tokens_for_baseline: And of all the lands of the world , this is a place armies covet . '

source_bert_toks: and of all the lands of the world , this is a place armies cove ##t . '

reference_raw: And of all the world's lands, it's a place the armies desire.'

reference_spacy_tokens: And of all the world 's lands , it 's a place the armies desire . '


fn_spacy_tokens_for_baseline: It seems that the picturesque older sections with their old houses , narrow streets , and winding alleyways may not be around much longer .

source_bert_toks: it seems that the picturesque older sections with their old houses , narrow streets , and winding alley ##ways may not be around much longer .

reference_raw: It seems that the picturesque older parts, with their old homes, small streets, and winding alleyways, may not be around much longer.

reference_spacy_tokens: It seems that the picturesque older parts , with their old homes , small streets , and winding alleyways , may not be around much longer .


fn_spacy_tokens_for_baseline: " One of the most oft told of the Larry Stories that circulate at CNN concerns his take - out order when he eats dinner at his desk , before the show .

source_bert_toks: " one of the most of ##t told of the larry stories that ci ##rc ##ulate at cnn concerns his take - out order when he eats dinner at his desk , before the show .

reference_raw: "One of the most important stories about Larry's stories circulating on CNN is that he's taken out of business when he's eating dinner at his desk before the show.

reference_spacy_tokens: " One of the most important stories about Larry 's stories circulating on CNN is that he 's taken out of business when he 's eating dinner at his desk before the show .


fn_spacy_tokens_for_baseline: Now , do you hear a long beep and a short beep , a long beep and a short beep ?

source_bert_toks: now , do you hear a long bee ##p and a short bee ##p , a long bee ##p and a short bee ##p ?

reference_raw: Now, can you hear the long, short, long bleep, and the short bleep?

reference_spacy_tokens: Now , can you hear the long , short , long bleep , and the short bleep ?


fn_spacy_tokens_for_baseline: Dutch police told off two of the gang , aged 10 and 11 .

source_bert_toks: dutch police told off two of the gang , aged 10 and 11 .

reference_raw: Dutch police outlawed two gangs, ages 10 and 11.

reference_spacy_tokens: Dutch police outlawed two gangs , ages 10 and 11 .


fn_spacy_tokens_for_baseline: A man with a pointed head rolled joints of hashish .

source_bert_toks: a man with a pointed head rolled joints of hash ##ish .

reference_raw: The man with the pointed head rolled the hash joints.

reference_spacy_tokens: The man with the pointed head rolled the hash joints .


fn_spacy_tokens_for_baseline: Kathmandu is over four thousand feet high . that 's why race favourite Hugh Jones . the first Brit to win the London Marathon has been out here for a week training .

source_bert_toks: kathmandu is over four thousand feet high . that ' s why race favourite hugh jones . the first brit to win the london marathon has been out here for a week training .

reference_raw: Kathmandu is over 4,000 feet tall, which is why the race favorite Hugh Jones is the first British to win the London Marathon in a week's training.

reference_spacy_tokens: Kathmandu is over 4,000 feet tall , which is why the race favorite Hugh Jones is the first British to win the London Marathon in a week 's training .


fn_spacy_tokens_for_baseline: Seventeen of the patients who identified food sensitivities had an open rechallenge with recurrence of symptoms in 10 ( 24 % of total ) .

source_bert_toks: seventeen of the patients who identified food sen ##sit ##iv ##ities had an open rec ##hall ##eng ##e with rec ##ur ##rence of symptoms in 10 ( 24 % of total ) .

reference_raw: Seventeen of the patients who identified food hypersensitivity had an open recurrence of symptoms in 10 (24% of the total).

reference_spacy_tokens: Seventeen of the patients who identified food hypersensitivity had an open recurrence of symptoms in 10 ( 24 % of the total ) .


fn_spacy_tokens_for_baseline: It is quite clear from studies of aboriginal peoples elsewhere that they could be astute traders and politicians , using the European newcomers for their own ends as much as they were being used .

source_bert_toks: it is quite clear from studies of aboriginal peoples elsewhere that they could be as ##tute traders and politicians , using the european newcomers for their own ends as much as they were being used .

reference_raw: Studies of native nations elsewhere show that they can be stupendous businessmen and politicians who use European newcomers for their own purposes as much as they are used for their own purposes.

reference_spacy_tokens: Studies of native nations elsewhere show that they can be stupendous businessmen and politicians who use European newcomers for their own purposes as much as they are used for their own purposes .


fn_spacy_tokens_for_baseline: George was a moderate smoker and his favourite meal before a race was a glass of beer and a hunk of bread and cheese .

source_bert_toks: george was a moderate smoke ##r and his favourite meal before a race was a glass of beer and a hu ##nk of bread and cheese .

reference_raw: George was a moderate smoker, and his favorite meal before the race was a glass of beer and a piece of bread and cheese.

reference_spacy_tokens: George was a moderate smoker , and his favorite meal before the race was a glass of beer and a piece of bread and cheese .


fn_spacy_tokens_for_baseline: They wrapped old sacks round themselves to keep out the cold .

source_bert_toks: they wrapped old sacks round themselves to keep out the cold .

reference_raw: They were wrapping old bags around each other so they wouldn't get cold.

reference_spacy_tokens: They were wrapping old bags around each other so they would n't get cold .


fn_spacy_tokens_for_baseline: If the House were to follow Palmerston blindly , they ' might as well give up talking about science and art and the beautification of the metropolis ' .

source_bert_toks: if the house were to follow palmer ##ston blindly , they ' might as well give up talking about science and art and the beau ##ti ##fication of the metropolis ' .

reference_raw: If the House followed Palmerston blindly, they might as well stop talking about science and art and the beauty of the city.

reference_spacy_tokens: If the House followed Palmerston blindly , they might as well stop talking about science and art and the beauty of the city .


fn_spacy_tokens_for_baseline: So , you know , they were very strict in those days .

source_bert_toks: so , you know , they were very strict in those days .

reference_raw: So, you know, they were pretty tight back then.

reference_spacy_tokens: So , you know , they were pretty tight back then .


fn_spacy_tokens_for_baseline: She had not taken off the headdress .

source_bert_toks: she had not taken off the head ##dre ##ss .

reference_raw: She didn't take her headband off.

reference_spacy_tokens: She did n't take her headband off .


fn_spacy_tokens_for_baseline: When a fox bolted towards the hedgerow , the dogs barked furiously .

source_bert_toks: when a fox bolted towards the hedge ##row , the dogs barked furiously .

reference_raw: The dogs barked furiously as the fox ran to the hedge.

reference_spacy_tokens: The dogs barked furiously as the fox ran to the hedge .


fn_spacy_tokens_for_baseline: JS has also launched its first sweet dessert sandwich - Banana Date and Raisin Sandwich made from a honey and sunflower seed bun loaf - which is in 125 branches and retails at £ 1.29 .

source_bert_toks: j ##s has also launched its first sweet dessert sandwich - banana date and rai ##sin sandwich made from a honey and sun ##flower seed bun loaf - which is in 125 branches and retail ##s at £1 . 29 .

reference_raw: JS also launched its first dessert sandwich, Banana Date and Raisin Sandwich, made from honey and sunflower bun loaf, which is in 125 branches and retails for £1.29.

reference_spacy_tokens: JS also launched its first dessert sandwich , Banana Date and Raisin Sandwich , made from honey and sunflower bun loaf , which is in 125 branches and retails for £ 1.29 .


fn_spacy_tokens_for_baseline: A storm or violent gale might disperse the combined fleets ; France has no port in the Channel ; in fact , innumerable mischances might ruin the enterprise .

source_bert_toks: a storm or violent gale might disperse the combined fleets ; france has no port in the channel ; in fact , inn ##ume ##rable mis ##chan ##ces might ruin the enterprise .

reference_raw: The combined fleets could be dispersed by a storm or a violent storm; France does not have a port in the Channel; in fact, countless accidents could destroy the enterprise.

reference_spacy_tokens: The combined fleets could be dispersed by a storm or a violent storm ; France does not have a port in the Channel ; in fact , countless accidents could destroy the enterprise .


fn_spacy_tokens_for_baseline: The public order essence of the offence has been wholly lost , and affray has become a form of aggravated assault .

source_bert_toks: the public order essence of the offence has been wholly lost , and af ##fra ##y has become a form of aggravated assault .

reference_raw: The nature of the crime's public order has been completely lost, and affray has become a form of aggravated attack.

reference_spacy_tokens: The nature of the crime 's public order has been completely lost , and affray has become a form of aggravated attack .


fn_spacy_tokens_for_baseline: It was not thickly populated or well defended , but it was much larger than the islands the English already held in the Caribbean , so it provided land for English emigrants for some years .

source_bert_toks: it was not thick ##ly populated or well defended , but it was much larger than the islands the english already held in the caribbean , so it provided land for english emi ##grants for some years .

reference_raw: It was not densely populated or well-protected, but it was much larger than the islands that the English had already held in the Caribbean, and for several years it provided the soil to English immigrants.

reference_spacy_tokens: It was not densely populated or well - protected , but it was much larger than the islands that the English had already held in the Caribbean , and for several years it provided the soil to English immigrants .


fn_spacy_tokens_for_baseline: A few windows were flung open , and two little lads pelted Broomhead with rotten apples before they were chased off .

source_bert_toks: a few windows were flung open , and two little lads pe ##lt ##ed broom ##head with rotten apples before they were chased off .

reference_raw: Several of the windows had been thrown open, and two small boys had crushed Broomhead with rotten apples before they were chased away.

reference_spacy_tokens: Several of the windows had been thrown open , and two small boys had crushed Broomhead with rotten apples before they were chased away .


fn_spacy_tokens_for_baseline: Mince the remaining garlic , add to the oil with the shallots and saute until soft -- do not allow to brown .

source_bert_toks: min ##ce the remaining garlic , add to the oil with the shall ##ots and sa ##ute until soft - - do not allow to brown .

reference_raw: Mining the remaining garlic, adding shallot oil and sauting until soft - do not allow browning.

reference_spacy_tokens: Mining the remaining garlic , adding shallot oil and sauting until soft - do not allow browning .


fn_spacy_tokens_for_baseline: She untied the sticks and rubbed them together between her palms .

source_bert_toks: she un ##tie ##d the sticks and rubbed them together between her palms .

reference_raw: She unfastened the sticks and rubbed them between her palms.

reference_spacy_tokens: She unfastened the sticks and rubbed them between her palms .


fn_spacy_tokens_for_baseline: When the adherence to treatment is considered , the data analysis results are very similar to those seen in the intention to treat analysis ( 10.2 % and 26 % of recurrences in heater probe and in control group respectively ; Fisher 's exact test p = 0.04 ) .

source_bert_toks: when the adherence to treatment is considered , the data analysis results are very similar to those seen in the intention to treat analysis ( 10 . 2 % and 26 % of rec ##ur ##rence ##s in heat ##er probe and in control group respectively ; fisher ' s exact test p = 0 . 04 ) .

reference_raw: When considering adherence to therapy, the results of the data analysis are very similar to those seen in the intention to treat the analysis (10.2% and 26% of recurrences in the heater probe and in the inspection group; Fisher's precise test p = 0.04).

reference_spacy_tokens: When considering adherence to therapy , the results of the data analysis are very similar to those seen in the intention to treat the analysis ( 10.2 % and 26 % of recurrences in the heater probe and in the inspection group ; Fisher 's precise test p = 0.04 ) .


fn_spacy_tokens_for_baseline: ' Acromegalics are often unusually strong , but in later life the pituitary becomes exhausted and the once strong man becomes flabby and weak . '

source_bert_toks: ' ac ##rom ##ega ##lic ##s are often unusually strong , but in later life the pit ##uit ##ary becomes exhausted and the once strong man becomes fl ##ab ##by and weak . '

reference_raw: "Acromegals are often unusually strong, but later in life the pituitary is exhausted, and once the strong man is weak and weak."

reference_spacy_tokens: " Acromegals are often unusually strong , but later in life the pituitary is exhausted , and once the strong man is weak and weak . "


fn_spacy_tokens_for_baseline: Less than a year later an almost identical crime was perpetrated when Sarah Metyard and her daughter Morgan were charged with the brutal murder of one of their five Parish apprentices .

source_bert_toks: less than a year later an almost identical crime was per ##pet ##rated when sarah met ##yard and her daughter morgan were charged with the brutal murder of one of their five parish apprentice ##s .

reference_raw: Less than a year later, an almost identical crime was committed when Sarah Metyard and her daughter Morgan were accused of the brutal murder of one of their five Parish disciples.

reference_spacy_tokens: Less than a year later , an almost identical crime was committed when Sarah Metyard and her daughter Morgan were accused of the brutal murder of one of their five Parish disciples .


fn_spacy_tokens_for_baseline: For example , if you 're copying files onto a few floppies , it 'll work out the files that will best fit into each disk .

source_bert_toks: for example , if you ' re copying files onto a few flop ##pies , it ' ll work out the files that will best fit into each disk .

reference_raw: For example, if you print files to a few disks, it will work out the files that are best suited to each disk.

reference_spacy_tokens: For example , if you print files to a few disks , it will work out the files that are best suited to each disk .


fn_spacy_tokens_for_baseline: Foreign officers could not operate radar and other navigational equipment .

source_bert_toks: foreign officers could not operate radar and other navigation ##al equipment .

reference_raw: Foreign officers couldn't use radar and other navigational equipment.

reference_spacy_tokens: Foreign officers could n't use radar and other navigational equipment .


fn_spacy_tokens_for_baseline: When the little animal is disturbed it burrows furiously down into the ground until it has completely disappeared except for its horny rump .

source_bert_toks: when the little animal is disturbed it burrows furiously down into the ground until it has completely disappeared except for its horn ##y rum ##p .

reference_raw: When the little animal is disturbed, it burrows wildly into the ground until it is completely gone except for its horny rum.

reference_spacy_tokens: When the little animal is disturbed , it burrows wildly into the ground until it is completely gone except for its horny rum .


fn_spacy_tokens_for_baseline: Also , emotionally it is very important that we do not carry resentment towards each other .

source_bert_toks: also , emotionally it is very important that we do not carry resentment towards each other .

reference_raw: It's also very important, emotionally, that we don't have a grudge against each other.

reference_spacy_tokens: It 's also very important , emotionally , that we do n't have a grudge against each other .


fn_spacy_tokens_for_baseline: I rousted Thessy out of his bed with a cup of tea , then went to my own bed as he took over the wheel .

source_bert_toks: i ro ##ust ##ed the ##ss ##y out of his bed with a cup of tea , then went to my own bed as he took over the wheel .

reference_raw: I got Thessy out of bed with a cup of tea, and when he took the wheel, I went to my own bed.

reference_spacy_tokens: I got Thessy out of bed with a cup of tea , and when he took the wheel , I went to my own bed .


fn_spacy_tokens_for_baseline: I still had my navy blue greatcoat , and went to the billeting officer for a few more blankets .

source_bert_toks: i still had my navy blue great ##coat , and went to the bill ##eti ##ng officer for a few more blankets .

reference_raw: I was still wearing my navy blue big coat, and I went to the billeting officer for some more blankets.

reference_spacy_tokens: I was still wearing my navy blue big coat , and I went to the billeting officer for some more blankets .


fn_spacy_tokens_for_baseline: ' I decided I was not going to change the way I taught to suit some sour little squirt of a fascist inspector who now turns out to be in cahoots with Roberto Bandeira .

source_bert_toks: ' i decided i was not going to change the way i taught to suit some sour little sq ##ui ##rt of a fascist inspector who now turns out to be in ca ##hoot ##s with roberto band ##eira .

reference_raw: I decided that I wouldn't change the way I'd learned to suit some sour little squirt of a fascist inspector who now turned out to be in a cataclysm with Roberto Bandeira.

reference_spacy_tokens: I decided that I would n't change the way I 'd learned to suit some sour little squirt of a fascist inspector who now turned out to be in a cataclysm with Roberto Bandeira .


fn_spacy_tokens_for_baseline: The sight of him like that gladdened my heart because I knew his news must be good .

source_bert_toks: the sight of him like that glad ##dened my heart because i knew his news must be good .

reference_raw: The sight of him so pleased me, for I knew his news had to be good.

reference_spacy_tokens: The sight of him so pleased me , for I knew his news had to be good .


fn_spacy_tokens_for_baseline: I cut out all the short stories from nearly 100 magazines and pasted them into a collection of scrapbooks .

source_bert_toks: i cut out all the short stories from nearly 100 magazines and paste ##d them into a collection of scrap ##books .

reference_raw: I cut all short stories out of almost a hundred magazines and put them in a collection of scrapbooks.

reference_spacy_tokens: I cut all short stories out of almost a hundred magazines and put them in a collection of scrapbooks .


fn_spacy_tokens_for_baseline: Between the gates and the big double doors was half an acre of lawn ; the driveway was lined by poplars .

source_bert_toks: between the gates and the big double doors was half an acre of lawn ; the driveway was lined by pop ##lars .

reference_raw: There was a half-acre lawn between the gate and the big double door; the driveway was covered with poplars.

reference_spacy_tokens: There was a half - acre lawn between the gate and the big double door ; the driveway was covered with poplars .


fn_spacy_tokens_for_baseline: First there was boom , then there was bust , but a container port opened in the 1990 s is breathing new life into the flagging commercial sector .

source_bert_toks: first there was boom , then there was bust , but a container port opened in the 1990 s is breathing new life into the flag ##ging commercial sector .

reference_raw: First there was a boom, and then there was a bust, but the container port opened in the '90s breathes new livelihoods into the flagging industry.

reference_spacy_tokens: First there was a boom , and then there was a bust , but the container port opened in the ' 90s breathes new livelihoods into the flagging industry .


fn_spacy_tokens_for_baseline: The driver , who is stuck with a truckload of oranges , called his company to tell of his ordeal .

source_bert_toks: the driver , who is stuck with a truck ##load of orange ##s , called his company to tell of his ordeal .

reference_raw: The driver, stuck in a truck full of oranges, called the company to tell them about his suffering.

reference_spacy_tokens: The driver , stuck in a truck full of oranges , called the company to tell them about his suffering .


fn_spacy_tokens_for_baseline: Our researches confirm that intoxication is implicated in many call outs .

source_bert_toks: our researches confirm that into ##xi ##cation is implicated in many call outs .

reference_raw: According to our research, drunkenness is involved in a lot of callouts.

reference_spacy_tokens: According to our research , drunkenness is involved in a lot of callouts .


fn_spacy_tokens_for_baseline: It was the first time that I had ever seen the inside of a police cell .

source_bert_toks: it was the first time that i had ever seen the inside of a police cell .

reference_raw: It was the first time I'd ever seen a police cell in it.

reference_spacy_tokens: It was the first time I 'd ever seen a police cell in it .


fn_spacy_tokens_for_baseline: The world 's most expensive resort at $ 1.6 billion , the Bellagio 's amenities include 5-star dining , Chanel - caliber boutiques , and a world - class collection of artistic masterworks .

source_bert_toks: the world ' s most expensive resort at $ 1 . 6 billion , the bella ##gio ' s amenities include 5 - star dining , chan ##el - caliber boutique ##s , and a world - class collection of artistic master ##works .

reference_raw: The most expensive resort in the world for $1.6 billion is a five-star restaurant, a chanel-caliber boutique, and a world-class collection of art masterpieces.

reference_spacy_tokens: The most expensive resort in the world for $ 1.6 billion is a five - star restaurant , a chanel - caliber boutique , and a world - class collection of art masterpieces .


fn_spacy_tokens_for_baseline: Four hundred years ago these crops brought British colonists to rule the land and African slaves to work it .

source_bert_toks: four hundred years ago these crops brought british colonists to rule the land and african slaves to work it .

reference_raw: 400 years ago, these crops brought British colonists to rule the country and African slaves to work on it.

reference_spacy_tokens: 400 years ago , these crops brought British colonists to rule the country and African slaves to work on it .


fn_spacy_tokens_for_baseline: Much of the Aegean came under the rule of the Ptolemies , along with Egypt .

source_bert_toks: much of the aegean came under the rule of the pt ##ole ##mies , along with egypt .

reference_raw: Most of the Aegeans, along with Egypt, were governed by the Ptolemies.

reference_spacy_tokens: Most of the Aegeans , along with Egypt , were governed by the Ptolemies .


fn_spacy_tokens_for_baseline: She was motherly , with a big mole on her upper lip .

source_bert_toks: she was mother ##ly , with a big mole on her upper lip .

reference_raw: She was maternal, with a large mark on her upper lip.

reference_spacy_tokens: She was maternal , with a large mark on her upper lip .


fn_spacy_tokens_for_baseline: The nonsmoker breathes ' sidestream ' smoke from the burning tip of the cigarette and ' mainstream ' smoke that has been inhaled and then exhaled by the smoker .

source_bert_toks: the non ##smo ##ker breathe ##s ' sides ##tream ' smoke from the burning tip of the cigarette and ' mainstream ' smoke that has been inhaled and then exhaled by the smoke ##r .

reference_raw: The non-smoker breathes "sidestream" smoke from the burning end of the cigarette and "mainstream" smoke, which is inhaled and then exhaled by the smoker.

reference_spacy_tokens: The non - smoker breathes " sidestream " smoke from the burning end of the cigarette and " mainstream " smoke , which is inhaled and then exhaled by the smoker .


fn_spacy_tokens_for_baseline: Suddenly I start puking into the road , but nothing comes up except this slimy stuff .

source_bert_toks: suddenly i start pu ##king into the road , but nothing comes up except this slim ##y stuff .

reference_raw: All of a sudden, I start throwing up on the road, but nothing comes up except this slimy thing.

reference_spacy_tokens: All of a sudden , I start throwing up on the road , but nothing comes up except this slimy thing .


fn_spacy_tokens_for_baseline: Why did cells gang together ; why the lumbering robots ?

source_bert_toks: why did cells gang together ; why the lumber ##ing robots ?

reference_raw: Why were the cells grouped; why were the lumbering robots?

reference_spacy_tokens: Why were the cells grouped ; why were the lumbering robots ?


fn_spacy_tokens_for_baseline: For all the rejection of what was sometimes called ' woman garbage " by American feminists , the issue of appearance is something that no woman can wholly avoid .

source_bert_toks: for all the rejection of what was sometimes called ' woman garbage " by american feminist ##s , the issue of appearance is something that no woman can wholly avoid .

reference_raw: For all the rejection of what American feminists sometimes referred to as "woman's garbage", the question of appearance is something that no woman can completely avoid.

reference_spacy_tokens: For all the rejection of what American feminists sometimes referred to as " woman 's garbage " , the question of appearance is something that no woman can completely avoid .


fn_spacy_tokens_for_baseline: A few blocks up Nathan Road is Kowloon Park ( open daily 6 am - midnight ) , elegantly laid out with fountains , promenades , and ornamental gardens ; be sure to go up the steps to see the Sculpture Walk .

source_bert_toks: a few blocks up nathan road is ko ##wl ##oon park ( open daily 6 am - midnight ) , elegant ##ly laid out with fountains , promenade ##s , and ornamental gardens ; be sure to go up the steps to see the sculpture walk .

reference_raw: A few blocks from Nathan Road is Kowloon Park (open at 6:00 a.m. every day), neatly arranged with fountains, promenades, and ornamental gardens; make sure to go up the stairs and look at the Sculpture Walk.

reference_spacy_tokens: A few blocks from Nathan Road is Kowloon Park ( open at 6:00 a.m. every day ) , neatly arranged with fountains , promenades , and ornamental gardens ; make sure to go up the stairs and look at the Sculpture Walk .


fn_spacy_tokens_for_baseline: He tore the doctor 's books and wrote all over them .

source_bert_toks: he tore the doctor ' s books and wrote all over them .

reference_raw: He ripped out the doctor's books and wrote them all.

reference_spacy_tokens: He ripped out the doctor 's books and wrote them all .


fn_spacy_tokens_for_baseline: Visitors entering the temple are confronted by a dense pall of smoke from all the burning joss sticks and the incense coils hanging from the ceiling ( these will burn for as long as a month ) .

source_bert_toks: visitors entering the temple are confronted by a dense pal ##l of smoke from all the burning jo ##ss sticks and the incense coil ##s hanging from the ceiling ( these will burn for as long as a month ) .

reference_raw: Visitors who enter the temple face a thick cloud of smoke from all the burning joss sticks and incense coils that hang from the ceiling (they burn for up to one moon).

reference_spacy_tokens: Visitors who enter the temple face a thick cloud of smoke from all the burning joss sticks and incense coils that hang from the ceiling ( they burn for up to one moon ) .


fn_spacy_tokens_for_baseline: Mid - sole : the layer between the sole and insole of the boot , which is anatomically shaped and designed to give the correct amount of flex and support for the activity for which the boot is designed .

source_bert_toks: mid - sole : the layer between the sole and ins ##ole of the boot , which is anatomical ##ly shaped and designed to give the correct amount of flex and support for the activity for which the boot is designed .

reference_raw: Mid-sole: a layer between the sole and the sole of the shoe, which is anatomically shaped and designed to provide the right amount of flex and support for the activity for which the shoe is designed.

reference_spacy_tokens: Mid - sole : a layer between the sole and the sole of the shoe , which is anatomically shaped and designed to provide the right amount of flex and support for the activity for which the shoe is designed .


fn_spacy_tokens_for_baseline: They all like a dryish soil in full sun ; in rich conditions or in shady spots they tend to grow too lush and produce too few flowers .

source_bert_toks: they all like a dry ##ish soil in full sun ; in rich conditions or in shady spots they tend to grow too lush and produce too few flowers .

reference_raw: They all like the dry soil in the full sun; in rich conditions or in shady places they tend to grow too lush and produce too few flowers.

reference_spacy_tokens: They all like the dry soil in the full sun ; in rich conditions or in shady places they tend to grow too lush and produce too few flowers .


fn_spacy_tokens_for_baseline: He clenched shut his eyes so as not to see the pale oval of her face through the shadows .

source_bert_toks: he clenched shut his eyes so as not to see the pale oval of her face through the shadows .

reference_raw: He closed his eyes so that through the shadows he could not see the pale oval of her face.

reference_spacy_tokens: He closed his eyes so that through the shadows he could not see the pale oval of her face .


fn_spacy_tokens_for_baseline: Think of all the good stuff we all collect daily in our reporting that we never add to stories .

source_bert_toks: think of all the good stuff we all collect daily in our reporting that we never add to stories .

reference_raw: Remember all the good things we collect every day in our reports that we don't add to the stories.

reference_spacy_tokens: Remember all the good things we collect every day in our reports that we do n't add to the stories .


fn_spacy_tokens_for_baseline: Recent estimates of North Korean chemical ordnance by the South Korean Ministry of National Defense ( MND ) have since been raised to the thousands of tons , probably based on recent information provided by North Korean defectors , including former members of DPRK military and NBC defence organizations .

source_bert_toks: recent estimates of north korean chemical ordnance by the south korean ministry of national defense ( mn ##d ) have since been raised to the thousands of tons , probably based on recent information provided by north korean defect ##ors , including former members of d ##pr ##k military and nbc defence organizations .

reference_raw: Since then, recent estimations of North Korea's chemical order by the South Korean Ministry of National Defence (MND) have been increased to thousands of tonnes, possibly based on recent information provided by North Korean defectors, including former members of the DPRK military and NBC defence organizations.

reference_spacy_tokens: Since then , recent estimations of North Korea 's chemical order by the South Korean Ministry of National Defence ( MND ) have been increased to thousands of tonnes , possibly based on recent information provided by North Korean defectors , including former members of the DPRK military and NBC defence organizations .


fn_spacy_tokens_for_baseline: Maybe they take after their mother , thought Jack , trying to keep calm .

source_bert_toks: maybe they take after their mother , thought jack , trying to keep calm .

reference_raw: Maybe they're chasing their mother, Jack thought, trying to stay calm.

reference_spacy_tokens: Maybe they 're chasing their mother , Jack thought , trying to stay calm .


fn_spacy_tokens_for_baseline: The dramatic desiccation of North Africa is a perplexing phenomenon .

source_bert_toks: the dramatic des ##ic ##cation of north africa is a per ##plex ##ing phenomenon .

reference_raw: The dramatic drying of North Africa is a confusing phenomenon.

reference_spacy_tokens: The dramatic drying of North Africa is a confusing phenomenon .


fn_spacy_tokens_for_baseline: From this , it is clear that the output voltage can be varied by altering the duty cycle .

source_bert_toks: from this , it is clear that the output voltage can be varied by altering the duty cycle .

reference_raw: It is clear from this that the output voltage can be changed by changing the service cycle.

reference_spacy_tokens: It is clear from this that the output voltage can be changed by changing the service cycle .


fn_spacy_tokens_for_baseline: It noted the utility of forcing the enemy to " suit up " in preparation for real or imagined use of chemical agents , for doing so would degrade the fighting ability of enemy forces .

source_bert_toks: it noted the utility of forcing the enemy to " suit up " in preparation for real or imagined use of chemical agents , for doing so would de ##grade the fighting ability of enemy forces .

reference_raw: He noted how useful it was to force the enemy to "suit up" in preparation for the actual or imagined use of chemical agents, since it would undermine the fighting capabilities of the enemy forces.

reference_spacy_tokens: He noted how useful it was to force the enemy to " suit up " in preparation for the actual or imagined use of chemical agents , since it would undermine the fighting capabilities of the enemy forces .


fn_spacy_tokens_for_baseline: The grand vision of the position of Canterbury was reinforced by anxieties such as these .

source_bert_toks: the grand vision of the position of canterbury was reinforced by an ##xie ##ties such as these .

reference_raw: The great vision of Canterbury's position has been strengthened by fears like this.

reference_spacy_tokens: The great vision of Canterbury 's position has been strengthened by fears like this .


fn_spacy_tokens_for_baseline: Revolutionary propaganda inspired by events in Russia had an effect , but the chief cause for mutiny lay in the soldiers ' disgust at their commanders ' inept leadership , Nivelle 's in particular .

source_bert_toks: revolutionary propaganda inspired by events in russia had an effect , but the chief cause for mutiny lay in the soldiers ' disgust at their commanders ' in ##ept leadership , ni ##vel ##le ' s in particular .

reference_raw: The revolutionary propaganda inspired by events in Russia had an effect, but the main cause of the rebellion was the reluctance of the soldiers at the inept leadership of their commanders, especially Nivelle.

reference_spacy_tokens: The revolutionary propaganda inspired by events in Russia had an effect , but the main cause of the rebellion was the reluctance of the soldiers at the inept leadership of their commanders , especially Nivelle .


fn_spacy_tokens_for_baseline: The 28-year - old blonde sailed through a gruelling training course , including dozens of parachute jumps , to win the famous red beret of the crack Parachute Regiment .

source_bert_toks: the 28 - year - old blonde sailed through a gr ##uel ##ling training course , including dozens of parachute jumps , to win the famous red be ##ret of the crack parachute regiment .

reference_raw: A 28-year-old blonde had sailed through a gruelling training course, including dozens of parachute jumps, to win the famous red beret of a broken parachute regiment.

reference_spacy_tokens: A 28-year - old blonde had sailed through a gruelling training course , including dozens of parachute jumps , to win the famous red beret of a broken parachute regiment .


fn_spacy_tokens_for_baseline: It is also more narrowly focused on the kinship group -- relationships with her parents , brothers , sisters , in - laws and so on are the ones she most values .

source_bert_toks: it is also more narrowly focused on the kinship group - - relationships with her parents , brothers , sisters , in - laws and so on are the ones she most values .

reference_raw: She's also more focused on the family group - the relationship with her parents, brothers, sisters, relatives, etc. is the one she values most.

reference_spacy_tokens: She 's also more focused on the family group - the relationship with her parents , brothers , sisters , relatives , etc . is the one she values most .


fn_spacy_tokens_for_baseline: With the help of friends like you , Goodwill has continued to adapt our services to meet the human needs of our changing society .

source_bert_toks: with the help of friends like you , goodwill has continued to adapt our services to meet the human needs of our changing society .

reference_raw: With the help of friends like you, Goodwill has continued to adapt our services to meet the human requirements of our changing society.

reference_spacy_tokens: With the help of friends like you , Goodwill has continued to adapt our services to meet the human requirements of our changing society .


fn_spacy_tokens_for_baseline: Khan Mohammad Mujahid , chief of the national police in Kandahar province , said the assailant set off his explosives when police surrounded the car , killing two officers and a civilian nearby .

source_bert_toks: khan mohammad mu ##jah ##id , chief of the national police in kan ##dah ##ar province , said the ass ##ail ##ant set off his explosives when police surrounded the car , killing two officers and a civilian nearby .

reference_raw: Khan Mohammad Mujahid, head of the state police in Kandahar Province, said that the attacker had detonated his explosives when the police surrounded the car and killed two officers and a civilian in the vicinity.

reference_spacy_tokens: Khan Mohammad Mujahid , head of the state police in Kandahar Province , said that the attacker had detonated his explosives when the police surrounded the car and killed two officers and a civilian in the vicinity .


fn_spacy_tokens_for_baseline: He is justly recognised by the American Philosophical Society , in whose annals his name stands second only to that of Benjamin Franklin .

source_bert_toks: he is just ##ly recognised by the american philosophical society , in whose annals his name stands second only to that of benjamin franklin .

reference_raw: He is rightly recognized by the American Philosophical Society, whose name is only second to Benjamin Franklin's annals.

reference_spacy_tokens: He is rightly recognized by the American Philosophical Society , whose name is only second to Benjamin Franklin 's annals .


fn_spacy_tokens_for_baseline: Countess Olivia , who recently lost her brother and father , is now in deep mourning and has vowed to live like a recluse for seven years .

source_bert_toks: countess olivia , who recently lost her brother and father , is now in deep mourning and has vowed to live like a rec ##lus ##e for seven years .

reference_raw: Countess Olivia, who recently lost her brother and father, now mourns deeply and vows to live alone for seven years.

reference_spacy_tokens: Countess Olivia , who recently lost her brother and father , now mourns deeply and vows to live alone for seven years .


fn_spacy_tokens_for_baseline: The officers also discovered a syringe on Jones but when asked about the drugs he said they were not his .

source_bert_toks: the officers also discovered a sy ##ring ##e on jones but when asked about the drugs he said they were not his .

reference_raw: Officers found a needle on Jones, too, but when they asked him about the drugs, he said it wasn't his.

reference_spacy_tokens: Officers found a needle on Jones , too , but when they asked him about the drugs , he said it was n't his .


fn_spacy_tokens_for_baseline: One was naked , and had been speared .

source_bert_toks: one was naked , and had been spear ##ed .

reference_raw: One of them was naked and stabbed.

reference_spacy_tokens: One of them was naked and stabbed .


fn_spacy_tokens_for_baseline: Lord Anglesey is the donor to the National Trust of Plas Newydd on the Isle of Anglesey .

source_bert_toks: lord angles ##ey is the donor to the national trust of pl ##as new ##yd ##d on the isle of angles ##ey .

reference_raw: Lord Anglesey is the sponsor of Plas Newydd's National Trust on Anglesey Island.

reference_spacy_tokens: Lord Anglesey is the sponsor of Plas Newydd 's National Trust on Anglesey Island .


fn_spacy_tokens_for_baseline: So she sipped champagne , and smiled , and ate , and all the while her fury against Naylor simmered away .

source_bert_toks: so she sipped champagne , and smiled , and ate , and all the while her fury against nay ##lor sim ##mere ##d away .

reference_raw: So she sipped champagne, smiled, and ate, and all the while her anger against Naylor was gone.

reference_spacy_tokens: So she sipped champagne , smiled , and ate , and all the while her anger against Naylor was gone .


fn_spacy_tokens_for_baseline: Other people 's lives bored him and he became sharp and irritable on the one occasion Lucien tried to impart some interesting snippet of information Azmaveth had told him .

source_bert_toks: other people ' s lives bored him and he became sharp and ir ##rita ##ble on the one occasion lucien tried to imp ##art some interesting s ##ni ##ppet of information az ##ma ##vet ##h had told him .

reference_raw: For the first time Lucien tried to impart some interesting piece of information that Azmaveth had told him, the lives of others were dulling him, and he was sharp and irritating.

reference_spacy_tokens: For the first time Lucien tried to impart some interesting piece of information that Azmaveth had told him , the lives of others were dulling him , and he was sharp and irritating .


fn_spacy_tokens_for_baseline: He walked along the road , hands in pockets , whistling like a blackbird .

source_bert_toks: he walked along the road , hands in pockets , whistling like a black ##bird .

reference_raw: He walked down the street, his hands in his pockets, hissing like a black bird.

reference_spacy_tokens: He walked down the street , his hands in his pockets , hissing like a black bird .


fn_spacy_tokens_for_baseline: Seizures of cannabis and amphetamines were dropping as the hard drugs began to dominate the scene , but as far as amphetamines are concerned it must be remembered that the seizure figures relate only to illegal imports .

source_bert_toks: seizures of cannabis and amp ##het ##amine ##s were dropping as the hard drugs began to dominate the scene , but as far as amp ##het ##amine ##s are concerned it must be remembered that the seizure figures relate only to illegal imports .

reference_raw: As the hard drugs began to dominate the scene, the seizures of hemp and amphetamines dropped, but as for amphetamines, it should be borne in mind that the seizure data relate only to illegal imports.

reference_spacy_tokens: As the hard drugs began to dominate the scene , the seizures of hemp and amphetamines dropped , but as for amphetamines , it should be borne in mind that the seizure data relate only to illegal imports .


fn_spacy_tokens_for_baseline: Places have become commodities to be packaged , marketed and sold .

source_bert_toks: places have become commodities to be packaged , marketed and sold .

reference_raw: Places became commodities for packing, marketing and sale.

reference_spacy_tokens: Places became commodities for packing , marketing and sale .


fn_spacy_tokens_for_baseline: They may call you for product details or information about the company which makes the product .

source_bert_toks: they may call you for product details or information about the company which makes the product .

reference_raw: You can be contacted for details of the product or information about the company that produces the product.

reference_spacy_tokens: You can be contacted for details of the product or information about the company that produces the product .


fn_spacy_tokens_for_baseline: Informed by the queen - dowager of their decision , resentful at being refused permission to return home , Anne made her displeasure plain .

source_bert_toks: informed by the queen - dowager of their decision , res ##ent ##ful at being refused permission to return home , anne made her displeasure plain .

reference_raw: Informed by the Queen Dowager of their decision and resented her refusal to return home, Anne made her displeasure clear.

reference_spacy_tokens: Informed by the Queen Dowager of their decision and resented her refusal to return home , Anne made her displeasure clear .


fn_spacy_tokens_for_baseline: To have to lie there in his coffin on Ingham 's counter and hear somebody like Tommy Drennan murder a good song like ' Slievenamon ' and himself lying there and could do nothing about it !

source_bert_toks: to have to lie there in his coffin on ing ##ham ' s counter and hear somebody like tommy dr ##enna ##n murder a good song like ' sl ##ie ##ven ##amo ##n ' and himself lying there and could do nothing about it !

reference_raw: Having to lie on Ingham's counter in a coffin and listen to someone like Tommy Drennan kill a good song like "Slievenamon" and he's lying there and there's nothing he can do about it!

reference_spacy_tokens: Having to lie on Ingham 's counter in a coffin and listen to someone like Tommy Drennan kill a good song like " Slievenamon " and he 's lying there and there 's nothing he can do about it !


fn_spacy_tokens_for_baseline: Shouldst thou not cry aloud , and show them their transgressions ; and entreat and beseech them as for life and death ? ''

source_bert_toks: should ##st thou not cry aloud , and show them their trans ##gre ##ssion ##s ; and en ##tre ##at and be ##see ##ch them as for life and death ? ' '

reference_raw: Shouldn't you cry out loud and show them their sins; and enter and beg them for life and death?'

reference_spacy_tokens: Should n't you cry out loud and show them their sins ; and enter and beg them for life and death ? '


fn_spacy_tokens_for_baseline: Four miles west of Bovey Tracey , on the east side of Dartmoor , are the abandoned granite quarries of Haytor , opened early in the nineteenth century by George Templer .

source_bert_toks: four miles west of bo ##vey tracey , on the east side of dart ##moor , are the abandoned granite quarries of hay ##tor , opened early in the nineteenth century by george temple ##r .

reference_raw: Four miles west of Bovey Tracey, on the eastern side of Dartmoor, is Haytor's abandoned granite quarry, opened by George Templer at the beginning of the nineteenth century.

reference_spacy_tokens: Four miles west of Bovey Tracey , on the eastern side of Dartmoor , is Haytor 's abandoned granite quarry , opened by George Templer at the beginning of the nineteenth century .


fn_spacy_tokens_for_baseline: The highest award was £ 307,781 to a computer expert who injured his back helping a store detective stop a suspected shoplifter .

source_bert_toks: the highest award was £3 ##0 ##7 , 78 ##1 to a computer expert who injured his back helping a store detective stop a suspected shop ##lift ##er .

reference_raw: The highest price was £307,781 for a computer expert who hurt his back and helped a shop detective stop a suspect thief.

reference_spacy_tokens: The highest price was £ 307,781 for a computer expert who hurt his back and helped a shop detective stop a suspect thief .


fn_spacy_tokens_for_baseline: On 18 December 1997 , the Islamic Republic News Agency ( IRNA ) reported that the Eastern railroad network , run by the Bonyad - e Mostazafan va Janbazan , has purchased 100 tank cars from Ukraine , specifically designed to transport highly toxic chemicals .

source_bert_toks: on 18 december 1997 , the islamic republic news agency ( ir ##na ) reported that the eastern railroad network , run by the bony ##ad - e most ##az ##af ##an va jan ##ba ##zan , has purchased 100 tank cars from ukraine , specifically designed to transport highly toxic chemicals .

reference_raw: On 18 December 1997, the Islamic Republic News Agency (IRNA) announced that the Eastern Rail Network, operated by the Bonyad-e Mostazafan va Janbazan, had purchased 100 tank-cars from Ukraine, specifically designed for the transport of highly toxic chemicals.

reference_spacy_tokens: On 18 December 1997 , the Islamic Republic News Agency ( IRNA ) announced that the Eastern Rail Network , operated by the Bonyad - e Mostazafan va Janbazan , had purchased 100 tank - cars from Ukraine , specifically designed for the transport of highly toxic chemicals .


fn_spacy_tokens_for_baseline: They come amid rumblings of new strikes in several key sectors , after disruption which has already cost 5 million lost working days this year , and production shortfalls of billions of roubles .

source_bert_toks: they come amid rumbling ##s of new strikes in several key sectors , after disruption which has already cost 5 million lost working days this year , and production short ##falls of billions of ro ##ub ##les .

reference_raw: They come in the midst of the rumblings of new strikes in a number of key sectors, following disruptions that have already cost five million lost working days this year, and production deficits of millions of roubles.

reference_spacy_tokens: They come in the midst of the rumblings of new strikes in a number of key sectors , following disruptions that have already cost five million lost working days this year , and production deficits of millions of roubles .


fn_spacy_tokens_for_baseline: The word was alien to her and she looked doubtful .

source_bert_toks: the word was alien to her and she looked doubtful .

reference_raw: The word was strange to her, and she looked dubious.

reference_spacy_tokens: The word was strange to her , and she looked dubious .


fn_spacy_tokens_for_baseline: In one such festival , her husband shows his love for her by presenting her with a new dress and himself attending to her hairdo and make up .

source_bert_toks: in one such festival , her husband shows his love for her by presenting her with a new dress and himself attending to her hair ##do and make up .

reference_raw: At one of these festivals, her husband shows his love for her by presenting her with a new dress and taking care of her hair and making up.

reference_spacy_tokens: At one of these festivals , her husband shows his love for her by presenting her with a new dress and taking care of her hair and making up .


fn_spacy_tokens_for_baseline: Rhetoric aside , North Korea faces many obstacles in actually employing CW agents , not to mention their manufacture and storage .

source_bert_toks: rhetoric aside , north korea faces many obstacles in actually employing cw agents , not to mention their manufacture and storage .

reference_raw: Rhetorically aside, North Korea faces a number of obstacles to actually employing CW agents, not to mention their production and storing.

reference_spacy_tokens: Rhetorically aside , North Korea faces a number of obstacles to actually employing CW agents , not to mention their production and storing .


fn_spacy_tokens_for_baseline: She twisted her wrist in his grip .

source_bert_toks: she twisted her wrist in his grip .

reference_raw: She turned her wrist in his grip.

reference_spacy_tokens: She turned her wrist in his grip .


fn_spacy_tokens_for_baseline: It also thwarted a plot to assassinate Abraham Lincoln , and thank God for that , for the entire course of history might have been different had the Great Emancipator been cut down .

source_bert_toks: it also thwarted a plot to assassinate abraham lincoln , and thank god for that , for the entire course of history might have been different had the great em ##an ##ci ##pa ##tor been cut down .

reference_raw: It also thwarted the plot to kill Abraham Lincoln, and thank God for it, for the whole story would have been different if the Great Emancipator had been cut down.

reference_spacy_tokens: It also thwarted the plot to kill Abraham Lincoln , and thank God for it , for the whole story would have been different if the Great Emancipator had been cut down .


fn_spacy_tokens_for_baseline: The Knights of St. John , a holy military force , made their way to Rhodes and Kos in the Dodecanese .

source_bert_toks: the knights of st . john , a holy military force , made their way to rhodes and ko ##s in the dod ##eca ##nese .

reference_raw: The Knights of Saint John, the Sacred Army Force, reached Rhodes and Kos in the Dodecanese.

reference_spacy_tokens: The Knights of Saint John , the Sacred Army Force , reached Rhodes and Kos in the Dodecanese .


fn_spacy_tokens_for_baseline: But some arms control specialists worry that the National Biodefense Analysis and Countermeasures Center -- now operating out of borrowed lab space at the Frederick base and elsewhere -- might develop new vaccine - resistant or lethal microbes without solid evidence of a terrorist plot to unleash similar bugs .

source_bert_toks: but some arms control specialists worry that the national bio ##de ##fen ##se analysis and counter ##me ##as ##ures center - - now operating out of borrowed lab space at the frederick base and elsewhere - - might develop new vaccine - resistant or lethal micro ##bes without solid evidence of a terrorist plot to un ##lea ##sh similar bugs .

reference_raw: But some weapons control specialists fear that the National Biodefence Analysis and Countermeasures Center, now operating from borrowed laboratory space at Frederick Base and elsewhere, may develop new vaccines - resistant or lethal microbes without solid proof of a terrorist conspiracy to release such bugs.

reference_spacy_tokens: But some weapons control specialists fear that the National Biodefence Analysis and Countermeasures Center , now operating from borrowed laboratory space at Frederick Base and elsewhere , may develop new vaccines - resistant or lethal microbes without solid proof of a terrorist conspiracy to release such bugs .


fn_spacy_tokens_for_baseline: Detective - Sergeant McWhirter went through into Miss Menzies ' anteroom .

source_bert_toks: detective - sergeant mc ##w ##hir ##ter went through into miss men ##zie ##s ' ant ##ero ##om .

reference_raw: Detective Sergeant McWhirter walked through to the front room of Miss Menzies.

reference_spacy_tokens: Detective Sergeant McWhirter walked through to the front room of Miss Menzies .


fn_spacy_tokens_for_baseline: Full assessment and nursing diagnoses are made using ultrasonography ( above ) and clients needing compression hosiery are measured accurately and given education ( left )

source_bert_toks: full assessment and nursing dia ##gno ##ses are made using ultra ##son ##ography ( above ) and clients needing compression ho ##sier ##y are measured accurately and given education ( left )

reference_raw: Full assessment and breast-feeding diagnostics are performed using ultrasoundography (above) and clients needing compression hosiers are accurately measured and educated (left)

reference_spacy_tokens: Full assessment and breast - feeding diagnostics are performed using ultrasoundography ( above ) and clients needing compression hosiers are accurately measured and educated ( left )


fn_spacy_tokens_for_baseline: Negotiations between Israel and the Palestinian authority have finally resumed .

source_bert_toks: negotiations between israel and the palestinian authority have finally resumed .

reference_raw: Finally, negotiations between Israel and the Palestinian Authority continued.

reference_spacy_tokens: Finally , negotiations between Israel and the Palestinian Authority continued .


fn_spacy_tokens_for_baseline: As a relieved and slightly rueful Bryan Robson put it : ' Shilts always complains that his worst night is when he has nothing to do .

source_bert_toks: as a relieved and slightly rue ##ful bryan robson put it : ' shi ##lts always complain ##s that his worst night is when he has nothing to do .

reference_raw: Bryan Robson said, relieved and slightly sad, "Shilts always complains that his worst night is when he's got nothing to do with it.

reference_spacy_tokens: Bryan Robson said , relieved and slightly sad , " Shilts always complains that his worst night is when he 's got nothing to do with it .


fn_spacy_tokens_for_baseline: However , Greece was not yet a country ; each city - state was self - governing and autonomous .

source_bert_toks: however , greece was not yet a country ; each city - state was self - governing and autonomous .

reference_raw: But Greece is not yet a country; every city state is self-government and independent.

reference_spacy_tokens: But Greece is not yet a country ; every city state is self - government and independent .


fn_spacy_tokens_for_baseline: ' Linford used to like his Saturday nights with his mates , ' he said , ' and they affected his Sunday mornings .

source_bert_toks: ' lin ##ford used to like his saturday nights with his mates , ' he said , ' and they affected his sunday mornings .

reference_raw: "Linford liked his friends on Saturday nights," he said, "and it affected his Sunday mornings.

reference_spacy_tokens: " Linford liked his friends on Saturday nights , " he said , " and it affected his Sunday mornings .


fn_spacy_tokens_for_baseline: With his hands protected by rubber gauntlets , he passed bucket after bucket of soggy glass fibre wool though the trap door into my waiting aching arms .

source_bert_toks: with his hands protected by rubber gaunt ##lets , he passed bucket after bucket of so ##ggy glass fibre wool though the trap door into my waiting aching arms .

reference_raw: Hands shielded by rubber gloves, he passed bucket by bucket of wet glass fiber wool, though the trap door to my waiting aching arms.

reference_spacy_tokens: Hands shielded by rubber gloves , he passed bucket by bucket of wet glass fiber wool , though the trap door to my waiting aching arms .


fn_spacy_tokens_for_baseline: ' I 'm not a Thespian , you cheeky bitch ! ' trilled Mallachy .

source_bert_toks: ' i ' m not a the ##sp ##ian , you cheek ##y bitch ! ' tri ##lled mall ##ach ##y .

reference_raw: 'I'm not Thespian, you cheeky bitch!' snapped Mallachy.

reference_spacy_tokens: ' I 'm not Thespian , you cheeky bitch ! ' snapped Mallachy .


fn_spacy_tokens_for_baseline: They scattered drugs and lab equipment over the floor , and opened a fridge door containing radioactive materials marked ' dangerous ' .

source_bert_toks: they scattered drugs and lab equipment over the floor , and opened a fridge door containing radioactive materials marked ' dangerous ' .

reference_raw: They spread drugs and laboratory equipment across the floor and opened the refrigerator door, which contained radioactive materials marked 'dangerous'.

reference_spacy_tokens: They spread drugs and laboratory equipment across the floor and opened the refrigerator door , which contained radioactive materials marked ' dangerous ' .


fn_spacy_tokens_for_baseline: One would construct alternative scenarios , and brood about them .

source_bert_toks: one would construct alternative scenarios , and brood about them .

reference_raw: You'd build alternative scenarios and think about them.

reference_spacy_tokens: You 'd build alternative scenarios and think about them .


fn_spacy_tokens_for_baseline: In doing so , he grazed his leg on an exposed tooth of his victim , and such a trivial scratch was ignored .

source_bert_toks: in doing so , he grazed his leg on an exposed tooth of his victim , and such a trivial scratch was ignored .

reference_raw: He scratched his foot on the victim's exposed tooth, ignoring such a trivial scratch.

reference_spacy_tokens: He scratched his foot on the victim 's exposed tooth , ignoring such a trivial scratch .


fn_spacy_tokens_for_baseline: Previously , Libya signed Comprehensive Test Ban Treaty in November 2001 and ratified it in January 2004 .

source_bert_toks: previously , libya signed comprehensive test ban treaty in november 2001 and ratified it in january 2004 .

reference_raw: In the past, Libya signed the Comprehensive Test Ban Treaty in November 2001 and ratified it in January 2004.

reference_spacy_tokens: In the past , Libya signed the Comprehensive Test Ban Treaty in November 2001 and ratified it in January 2004 .


fn_spacy_tokens_for_baseline: Jahanara Begum and the other women present began to wail , beat their breasts , tear their hair and rend their garments .

source_bert_toks: ja ##hana ##ra beg ##um and the other women present began to wai ##l , beat their breasts , tear their hair and ren ##d their garments .

reference_raw: Jahanara Begum and the other women in the room began to wail, beating their chests, tearing their hair and folding their clothes.

reference_spacy_tokens: Jahanara Begum and the other women in the room began to wail , beating their chests , tearing their hair and folding their clothes .


fn_spacy_tokens_for_baseline: Beneath her beige raincoat she wore a soft black polo - neck that emphasised the clean curve of her jaw .

source_bert_toks: beneath her beige rain ##coat she wore a soft black polo - neck that emphasis ##ed the clean curve of her jaw .

reference_raw: She wore a soft black polo-neck under her beige cape, which emphasized the clean curve of her jaw.

reference_spacy_tokens: She wore a soft black polo - neck under her beige cape , which emphasized the clean curve of her jaw .


fn_spacy_tokens_for_baseline: He had n't thought of marriage before .

source_bert_toks: he hadn ' t thought of marriage before .

reference_raw: He had never thought about getting married before.

reference_spacy_tokens: He had never thought about getting married before .


fn_spacy_tokens_for_baseline: For instance , the way to tell if a person is a witch is to stick two needles in the form of a cross into the sill above a door ; if the person in the room is a witch , she wo n't be able to leave the room .

source_bert_toks: for instance , the way to tell if a person is a witch is to stick two needles in the form of a cross into the si ##ll above a door ; if the person in the room is a witch , she won ' t be able to leave the room .

reference_raw: The way to know if a person is a witch, for example, is to stick two needles in the form of a cross in the sill above the door; if the person in the room is a witch, he can't leave the room.

reference_spacy_tokens: The way to know if a person is a witch , for example , is to stick two needles in the form of a cross in the sill above the door ; if the person in the room is a witch , he ca n't leave the room .


fn_spacy_tokens_for_baseline: Children are excellent at repetition to get what they want .

source_bert_toks: children are excellent at repetition to get what they want .

reference_raw: Kids are great at repeating themselves to get what they want.

reference_spacy_tokens: Kids are great at repeating themselves to get what they want .


fn_spacy_tokens_for_baseline: An Armenian official states that Armenia will send scientists , including specialists in nuclear physics who have been involved in the defense industry , to Iran in exchange for oil .

source_bert_toks: an armenian official states that armenia will send scientists , including specialists in nuclear physics who have been involved in the defense industry , to iran in exchange for oil .

reference_raw: The Armenian official states that Armenia will send scientists, including nuclear physics specialists involved in the defence industry, to Iran in exchange for petroleum.

reference_spacy_tokens: The Armenian official states that Armenia will send scientists , including nuclear physics specialists involved in the defence industry , to Iran in exchange for petroleum .


fn_spacy_tokens_for_baseline: Small vans burst into the forecourt through the arch of the gatehouse , to park at the front door and unload pot - plants , piles of plates , crates of wine , trays of freshly baked rolls .

source_bert_toks: small vans burst into the fore ##court through the arch of the gate ##house , to park at the front door and un ##load pot - plants , piles of plates , crates of wine , tray ##s of freshly baked rolls .

reference_raw: Small vans rushed into the courtyard through the archway of the gate, parked in the front door and unloaded pot plants, stacks of plates, crates of wine, trays of freshly baked cylinders.

reference_spacy_tokens: Small vans rushed into the courtyard through the archway of the gate , parked in the front door and unloaded pot plants , stacks of plates , crates of wine , trays of freshly baked cylinders .


fn_spacy_tokens_for_baseline: He had been slowly emotionally battered ever since he had met his beloved Rosemary .

source_bert_toks: he had been slowly emotionally battered ever since he had met his beloved rosemary .

reference_raw: From the moment he met his beloved Rosemary, he had been emotionally beaten.

reference_spacy_tokens: From the moment he met his beloved Rosemary , he had been emotionally beaten .


fn_spacy_tokens_for_baseline: ' Is it an arranged marriage between the two of you ? ' she hazarded .

source_bert_toks: ' is it an arranged marriage between the two of you ? ' she hazard ##ed .

reference_raw: "Is this an arranged marriage between you two?" she asked.

reference_spacy_tokens: " Is this an arranged marriage between you two ? " she asked .


fn_spacy_tokens_for_baseline: -- In most states , increasing expenditures on education , in our current circumstances , will probably make things worse , not better .

source_bert_toks: - - in most states , increasing expenditures on education , in our current circumstances , will probably make things worse , not better .

reference_raw: -- In most countries, increasing spending on education, in our present situation, is likely to make things worse, not better.

reference_spacy_tokens: -- In most countries , increasing spending on education , in our present situation , is likely to make things worse , not better .


fn_spacy_tokens_for_baseline: His infected lungs began to burble and froth with yellow fluid that choked his words of protest as they lowered him into the stone bath outside .

source_bert_toks: his infected lungs began to bu ##rb ##le and fr ##oth with yellow fluid that choked his words of protest as they lowered him into the stone bath outside .

reference_raw: His infected lungs began to burp and foam with yellow liquid that stifled his words of protest as they dropped him into the stone bath outside.

reference_spacy_tokens: His infected lungs began to burp and foam with yellow liquid that stifled his words of protest as they dropped him into the stone bath outside .


fn_spacy_tokens_for_baseline: I remember nothing from the film except a lot of droning talk and a fully clothed woman with dark lashes lying down .

source_bert_toks: i remember nothing from the film except a lot of dr ##oning talk and a fully clothed woman with dark lashes lying down .

reference_raw: I don't remember anything from the movie except a lot of droning talk and a fully dressed woman with dark eyelashes lying on the floor.

reference_spacy_tokens: I do n't remember anything from the movie except a lot of droning talk and a fully dressed woman with dark eyelashes lying on the floor .


fn_spacy_tokens_for_baseline: He will prepare food for us when he comes down , so mind what you say in his presence . '

source_bert_toks: he will prepare food for us when he comes down , so mind what you say in his presence . '

reference_raw: When he comes down, he'll make us a meal, so don't forget what you say in his presence.'

reference_spacy_tokens: When he comes down , he 'll make us a meal , so do n't forget what you say in his presence . '


fn_spacy_tokens_for_baseline: So the population is growing fairly rapidly even though about 8000 people emigrate from the region each year .

source_bert_toks: so the population is growing fairly rapidly even though about 800 ##0 people emi ##grate from the region each year .

reference_raw: So the population grows pretty fast, although about 8,000 people leave the region every year.

reference_spacy_tokens: So the population grows pretty fast , although about 8,000 people leave the region every year .


fn_spacy_tokens_for_baseline: And then he felt the music 's pull again , and thought that had n't they summoned Fael - Inis to help them , and was n't it sensible to obey him ?

source_bert_toks: and then he felt the music ' s pull again , and thought that hadn ' t they summoned fae ##l - in ##is to help them , and wasn ' t it sensible to obey him ?

reference_raw: And then he felt the music pull again, and he thought that Fael-Inis had not been called to help, and was it not wise to listen to him?

reference_spacy_tokens: And then he felt the music pull again , and he thought that Fael - Inis had not been called to help , and was it not wise to listen to him ?


fn_spacy_tokens_for_baseline: She had dark - brown , shiny eyes and a tanned , muscular frame on which she hung brightly coloured blouses and skirts .

source_bert_toks: she had dark - brown , shiny eyes and a tanned , muscular frame on which she hung brightly coloured blouse ##s and skirts .

reference_raw: Her eyes were dark-brown, gleaming, and her sunburned muscle frame hung brightly colored blouses and skirts.

reference_spacy_tokens: Her eyes were dark - brown , gleaming , and her sunburned muscle frame hung brightly colored blouses and skirts .


fn_spacy_tokens_for_baseline: Once a Squig has been provoked from its lair the Night Goblins throw nets over it then bash it senseless with large clubs so it can be safely dragged away .

source_bert_toks: once a sq ##ui ##g has been provoked from its lair the night goblin ##s throw nets over it then bash it sense ##less with large clubs so it can be safely dragged away .

reference_raw: Once the Squig has been provoked out of its lair, the Night Goblins will throw nets over it and beat it senselessly with large clubs so that it can be safely dragged away.

reference_spacy_tokens: Once the Squig has been provoked out of its lair , the Night Goblins will throw nets over it and beat it senselessly with large clubs so that it can be safely dragged away .


fn_spacy_tokens_for_baseline: It was a fairly even first half and the teams entered the dressing room equal at 1 - 1 .

source_bert_toks: it was a fairly even first half and the teams entered the dressing room equal at 1 - 1 .

reference_raw: The first half was fairly even, and the teams entered the locker room at one-one.

reference_spacy_tokens: The first half was fairly even , and the teams entered the locker room at one - one .


fn_spacy_tokens_for_baseline: Mrs Hassock ushered them into her front room , with the window on the street , the window through which Lucy , when walking that way , had glimpsed her after dusk on a winter evening .

source_bert_toks: mrs has ##so ##ck ushered them into her front room , with the window on the street , the window through which lucy , when walking that way , had glimpse ##d her after dusk on a winter evening .

reference_raw: Mrs. Hassock led them into her main room, with a window in the street and a window through which Lucy could see her after dark on a winter evening.

reference_spacy_tokens: Mrs. Hassock led them into her main room , with a window in the street and a window through which Lucy could see her after dark on a winter evening .


fn_spacy_tokens_for_baseline: There is some hope that the weekend will bring some rain ; however , this will likely not be enough to stop the fire .

source_bert_toks: there is some hope that the weekend will bring some rain ; however , this will likely not be enough to stop the fire .

reference_raw: There's a chance this weekend will bring some rain, but it probably won't be enough to stop the fire.

reference_spacy_tokens: There 's a chance this weekend will bring some rain , but it probably wo n't be enough to stop the fire .


fn_spacy_tokens_for_baseline: Some of the 14 alleged bin Laden associates arrested in Jordan in December have begun talking to investigators .

source_bert_toks: some of the 14 alleged bin laden associates arrested in jordan in december have begun talking to investigators .

reference_raw: Some of the 14 supposed bin Laden associates arrested in Jordan in December started talking to investigators.

reference_spacy_tokens: Some of the 14 supposed bin Laden associates arrested in Jordan in December started talking to investigators .


fn_spacy_tokens_for_baseline: JEALOUS Jason Osborne bludgeoned his sleeping brother to death with a mallet in a row over girls , a court heard yesterday .

source_bert_toks: jealous jason osborne blu ##dge ##oned his sleeping brother to death with a mall ##et in a row over girls , a court heard yesterday .

reference_raw: JEALOUS Jason Osborne beat his sleeping brother to death with a club in a row over the girls, a court hearing yesterday.

reference_spacy_tokens: JEALOUS Jason Osborne beat his sleeping brother to death with a club in a row over the girls , a court hearing yesterday .


fn_spacy_tokens_for_baseline: ' McIllvanney says that Billingsley owns a house on Murder Cay . '

source_bert_toks: ' mc ##ill ##van ##ney says that billings ##ley owns a house on murder ca ##y . '

reference_raw: "McIllvanney says Billingsley owns a house in the Homicide Bay."

reference_spacy_tokens: " McIllvanney says Billingsley owns a house in the Homicide Bay . "


fn_spacy_tokens_for_baseline: uh no i do n't think the Cowboys have got a chance i think they will probably win one or two more games than they did this year and they 'll get close to it they 'll probably get everybody 's hopes up and blow it toward the end

source_bert_toks: uh no i don ' t think the cowboys have got a chance i think they will probably win one or two more games than they did this year and they ' ll get close to it they ' ll probably get everybody ' s hopes up and blow it toward the end

reference_raw: Uh, no, I don't think the cowboys have a chance to think that they're probably going to get one or two more games than they did this year, and they're probably going to get everyone's hopes up and blow it to the end.

reference_spacy_tokens: Uh , no , I do n't think the cowboys have a chance to think that they 're probably going to get one or two more games than they did this year , and they 're probably going to get everyone 's hopes up and blow it to the end .


fn_spacy_tokens_for_baseline: One of the most incriminating things against the girls was the discovery of Michelle 's diary at the private Churchill Clinic in London where she worked with John O'Shaughnessy .

source_bert_toks: one of the most inc ##rim ##inating things against the girls was the discovery of michelle ' s diary at the private churchill clinic in london where she worked with john o ' sha ##ugh ##nessy .

reference_raw: One of the most incriminating things about the girls was the discovery of Michelle's journal at a private Churchill clinic in London, where she worked with John O'Shaughnessy.

reference_spacy_tokens: One of the most incriminating things about the girls was the discovery of Michelle 's journal at a private Churchill clinic in London , where she worked with John O'Shaughnessy .


fn_spacy_tokens_for_baseline: The royals flew home yesterday .

source_bert_toks: the royals flew home yesterday .

reference_raw: The Royals flew in last night.

reference_spacy_tokens: The Royals flew in last night .


fn_spacy_tokens_for_baseline: Farther south in Crete , the Minoan culture developed after 2000 b.c . into the most significant of its age , spreading its influence throughout the region by trade and diplomacy .

source_bert_toks: farther south in crete , the min ##oa ##n culture developed after 2000 b . c . into the most significant of its age , spreading its influence throughout the region by trade and diplomacy .

reference_raw: In the southern part of Crete, the Minoan culture developed after 2000 b.c. to the highest of its age and spread its influence throughout the region through trade and diplomacy.

reference_spacy_tokens: In the southern part of Crete , the Minoan culture developed after 2000 b.c . to the highest of its age and spread its influence throughout the region through trade and diplomacy .


fn_spacy_tokens_for_baseline: Place the ingredients and a metal spoon in a heavy goblet .

source_bert_toks: place the ingredients and a metal spoon in a heavy go ##ble ##t .

reference_raw: Put the ingredients and the metal teaspoon in a heavy cup.

reference_spacy_tokens: Put the ingredients and the metal teaspoon in a heavy cup .


fn_spacy_tokens_for_baseline: If Labov 's interpretations were suspect ( and of course they are not ) , this would not arise from the fact that he failed to test for significance .

source_bert_toks: if lab ##ov ' s interpretations were suspect ( and of course they are not ) , this would not arise from the fact that he failed to test for significance .

reference_raw: If Labov's interpretation had been suspicious (and of course not), it would not have been the result of his failure to test for meaning.

reference_spacy_tokens: If Labov 's interpretation had been suspicious ( and of course not ) , it would not have been the result of his failure to test for meaning .


fn_spacy_tokens_for_baseline: She had been determined not to give anything of herself away to him , but he had succeeded in antagonising her to such a pitch that she almost could n't help herself .

source_bert_toks: she had been determined not to give anything of herself away to him , but he had succeeded in ant ##ago ##nis ##ing her to such a pitch that she almost couldn ' t help herself .

reference_raw: She was determined not to give him anything of herself, but he was able to antagonize her to such an extent that she could hardly help it.

reference_spacy_tokens: She was determined not to give him anything of herself , but he was able to antagonize her to such an extent that she could hardly help it .


fn_spacy_tokens_for_baseline: If the horse is thumped by the farrier , or we belt it with a cane , the horse is likely to become so upset that the chances are we will never be able to shoe the horse !

source_bert_toks: if the horse is thumped by the far ##rier , or we belt it with a cane , the horse is likely to become so upset that the chances are we will never be able to shoe the horse !

reference_raw: If the horse is hit by a farrier, or if we strap it down with a stick, the horse will probably be so upset that there's a chance we'll never be able to shove it!

reference_spacy_tokens: If the horse is hit by a farrier , or if we strap it down with a stick , the horse will probably be so upset that there 's a chance we 'll never be able to shove it !


fn_spacy_tokens_for_baseline: He chewed ribs of grass and swallowed green saliva .

source_bert_toks: he chewed ribs of grass and swallowed green saliva .

reference_raw: He bit the grass ribs and swallowed the green saliva.

reference_spacy_tokens: He bit the grass ribs and swallowed the green saliva .


fn_spacy_tokens_for_baseline: Few traditional ancestral halls remain in China since the anti - historical destruction during the Cultural Revolution , so these New Territories ancestral halls are rare survivors .

source_bert_toks: few traditional ancestral halls remain in china since the anti - historical destruction during the cultural revolution , so these new territories ancestral halls are rare survivors .

reference_raw: Since the antihistorical destruction of the cultural revolution, few traditional ancestral halls have been left in China, so these New Territorial Halls are rare survivors.

reference_spacy_tokens: Since the antihistorical destruction of the cultural revolution , few traditional ancestral halls have been left in China , so these New Territorial Halls are rare survivors .


fn_spacy_tokens_for_baseline: Whilst on a formation training flight on November 8 , 1941 , the pilot flew through a hailstorm and lost his reference to the horizon , crashing into the sea .

source_bert_toks: whilst on a formation training flight on november 8 , 1941 , the pilot flew through a hail ##storm and lost his reference to the horizon , crashing into the sea .

reference_raw: While on the formation training flight of November 8, 1941, the pilot flew through the hail and lost sight of the horizon and crashed into the sea.

reference_spacy_tokens: While on the formation training flight of November 8 , 1941 , the pilot flew through the hail and lost sight of the horizon and crashed into the sea .


fn_spacy_tokens_for_baseline: On the way home , Clarissa was not only talkative but , for her , extremely voluble on the subject of good manners .

source_bert_toks: on the way home , clarissa was not only talk ##ative but , for her , extremely vol ##ub ##le on the subject of good manners .

reference_raw: Clarissa wasn't just talkative on the way home, she was very sensitive to good manners.

reference_spacy_tokens: Clarissa was n't just talkative on the way home , she was very sensitive to good manners .


fn_spacy_tokens_for_baseline: Instead of burrowing into the foliage it makes its home in the stems of aquatic plants .

source_bert_toks: instead of burr ##owing into the foliage it makes its home in the stems of aquatic plants .

reference_raw: Instead of digging into the leaves, it makes a home in the stems of water plants.

reference_spacy_tokens: Instead of digging into the leaves , it makes a home in the stems of water plants .


fn_spacy_tokens_for_baseline: Christ , said Campbell , accepted a cutting off from his Father in order to unite us to God .

source_bert_toks: christ , said campbell , accepted a cutting off from his father in order to unite us to god .

reference_raw: Christ, Campbell said, took a break from his father to bring us together with God.

reference_spacy_tokens: Christ , Campbell said , took a break from his father to bring us together with God .


fn_spacy_tokens_for_baseline: The hijackers gave themselves up after receiving assurances that they could seek asylum elsewhere .

source_bert_toks: the hi ##jack ##ers gave themselves up after receiving assurance ##s that they could seek asylum elsewhere .

reference_raw: The kidnappers surrendered when they were assured that they could seek asylum elsewhere.

reference_spacy_tokens: The kidnappers surrendered when they were assured that they could seek asylum elsewhere .


fn_spacy_tokens_for_baseline: Margaret Jourdain was squat , broad , and plain .

source_bert_toks: margaret jo ##ur ##dai ##n was squat , broad , and plain .

reference_raw: Margaret Jourdain was stocky, wide and simple.

reference_spacy_tokens: Margaret Jourdain was stocky , wide and simple .


fn_spacy_tokens_for_baseline: " A deadly - chemical exercise sent nearly 100 national guardsmen and women into action Wednesday morning .

source_bert_toks: " a deadly - chemical exercise sent nearly 100 national guards ##men and women into action wednesday morning .

reference_raw: "A deadly chemical exercise put nearly a hundred National Guardsmen and women into action on Wednesday morning."

reference_spacy_tokens: " A deadly chemical exercise put nearly a hundred National Guardsmen and women into action on Wednesday morning . "


fn_spacy_tokens_for_baseline: But woe betide the culprit who trespasses on the wrong side of 50 .

source_bert_toks: but wo ##e bet ##ide the cu ##lp ##rit who tres ##pass ##es on the wrong side of 50 .

reference_raw: But woe bet against the perpetrator who trespasses on the wrong side of the 50th.

reference_spacy_tokens: But woe bet against the perpetrator who trespasses on the wrong side of the 50th .


fn_spacy_tokens_for_baseline: You could easily categorise your addresses into five sections .

source_bert_toks: you could easily cat ##ego ##rise your addresses into five sections .

reference_raw: It's easy to classify your addresses in five sections.

reference_spacy_tokens: It 's easy to classify your addresses in five sections .


fn_spacy_tokens_for_baseline: Meanwhile , the Wiltshire - based Regency and West of England has come to the aid of small savers with a minimum of £ 500 to invest .

source_bert_toks: meanwhile , the wiltshire - based regency and west of england has come to the aid of small save ##rs with a minimum of £5 ##00 to invest .

reference_raw: In the meantime, the Wiltshire Regency and the western part of England have come to the aid of small savers with a minimum of £500 to invest.

reference_spacy_tokens: In the meantime , the Wiltshire Regency and the western part of England have come to the aid of small savers with a minimum of £ 500 to invest .


fn_spacy_tokens_for_baseline: In 1605 Lord Chief Justice Popham , prosecutor of Guy Fawkes , Ralegh , and the Queen of Scots , ' undertook ' to drain the fen at Upwell .

source_bert_toks: in 1605 lord chief justice pop ##ham , prosecutor of guy fa ##wk ##es , ra ##leg ##h , and the queen of scots , ' undertook ' to drain the fen at up ##well .

reference_raw: In 1605, Lord Justice Popham, prosecutor of Guy Fawkes, Ralegh, and queen of Scotland, "understand" to drain the fence in Upwell.

reference_spacy_tokens: In 1605 , Lord Justice Popham , prosecutor of Guy Fawkes , Ralegh , and queen of Scotland , " understand " to drain the fence in Upwell .


fn_spacy_tokens_for_baseline: Police duties are being handled by a 3,000-member interim of former soldiers with acceptable human rights records , coached by 800 International Police Monitors .

source_bert_toks: police duties are being handled by a 3 , 000 - member interim of former soldiers with acceptable human rights records , coached by 800 international police monitors .

reference_raw: Police duties are handled by an ex-soldier of 3,000, with acceptable human rights records, trained by 800 International Police Monitors.

reference_spacy_tokens: Police duties are handled by an ex - soldier of 3,000 , with acceptable human rights records , trained by 800 International Police Monitors .