fn_spacy_tokens_for_baseline: ' Dear God , ' he said , beginning to get rattled .

source_bert_toks: ' dear god , ' he said , beginning to get rattled .

reference_raw: 'Dear God,' he said, and his voice began to shake.

reference_spacy_tokens: ' Dear God , ' he said , and his voice began to shake .


fn_spacy_tokens_for_baseline: At eleven o'clock , the demonstrators formed a line in front of the abbey and prepared to parade slowly through the streets of the historic Georgian city .

source_bert_toks: at eleven o ' clock , the demonstrators formed a line in front of the abbey and prepared to parade slowly through the streets of the historic georgian city .

reference_raw: At eleven o'clock, the protestors formed a line in front of the abbey, ready to march slowly through the streets of the historic Georgian city.

reference_spacy_tokens: At eleven o'clock , the protestors formed a line in front of the abbey , ready to march slowly through the streets of the historic Georgian city .


fn_spacy_tokens_for_baseline: But he chafed a bit as a member of a commercial office team .

source_bert_toks: but he cha ##fed a bit as a member of a commercial office team .

reference_raw: But as a member of the business office team, he chaffed a little.

reference_spacy_tokens: But as a member of the business office team , he chaffed a little .


fn_spacy_tokens_for_baseline: After midnight mass on Christmas Eve the street was desperate with maudlin men with bloodied noses and bruised knuckles singing ' Silent Night , Holy Night ' as they urinated through the railings .

source_bert_toks: after midnight mass on christmas eve the street was desperate with maud ##lin men with blood ##ied noses and bruised knuckles singing ' silent night , holy night ' as they ur ##inated through the railing ##s .

reference_raw: After midnight mass on Christmas Eve, the street was filled with maudlin men with bloody noses and bruised ankles singing "Silent Night, Holy Night" as they peed on the railings.

reference_spacy_tokens: After midnight mass on Christmas Eve , the street was filled with maudlin men with bloody noses and bruised ankles singing " Silent Night , Holy Night " as they peed on the railings .


fn_spacy_tokens_for_baseline: Now I am twittering on about buying a new workshop , equipping it with this or that kind of planer / thicknesser , getting this or that panel saw .

source_bert_toks: now i am twitter ##ing on about buying a new workshop , e ##qui ##pping it with this or that kind of plane ##r / thickness ##er , getting this or that panel saw .

reference_raw: Now I'm talking about buying a new workshop, equipping it with this or this planer/thicknesser, getting this or the panel saw.

reference_spacy_tokens: Now I 'm talking about buying a new workshop , equipping it with this or this planer / thicknesser , getting this or the panel saw .


fn_spacy_tokens_for_baseline: My doctor tells me that leg of his must still be hurting like the devil .

source_bert_toks: my doctor tells me that leg of his must still be hurting like the devil .

reference_raw: My doctor says his leg must still be aching like a devil.

reference_spacy_tokens: My doctor says his leg must still be aching like a devil .


fn_spacy_tokens_for_baseline: Meanwhile Coventry boss Bobby Gould has used a touch of ' pure genius ' to prepare his players for the match .

source_bert_toks: meanwhile coventry boss bobby gould has used a touch of ' pure genius ' to prepare his players for the match .

reference_raw: In the meantime, Coventry Chief Bobby Gould used a little "pure genius" to get his players ready for the game.

reference_spacy_tokens: In the meantime , Coventry Chief Bobby Gould used a little " pure genius " to get his players ready for the game .


fn_spacy_tokens_for_baseline: A new sense of identity enveloped Greek peoples throughout the Aegean , thus commencing a movement to expand Greece and unify the disparate Orthodox populations .

source_bert_toks: a new sense of identity enveloped greek peoples throughout the aegean , thus commencing a movement to expand greece and un ##ify the di ##spar ##ate orthodox populations .

reference_raw: A new sense of identity enveloped the Greek nations across the Aegean, triggering a movement to expand Greece and unite the diverse populations of Orthodox.

reference_spacy_tokens: A new sense of identity enveloped the Greek nations across the Aegean , triggering a movement to expand Greece and unite the diverse populations of Orthodox .


fn_spacy_tokens_for_baseline: I pushed in a couple of pessaries , untied the sack from my middle and pulled my shirt over my head .

source_bert_toks: i pushed in a couple of pe ##ssar ##ies , un ##tie ##d the sack from my middle and pulled my shirt over my head .

reference_raw: I pushed in a few pessaries, pulled the bag out of the middle, and pulled the shirt over my head.

reference_spacy_tokens: I pushed in a few pessaries , pulled the bag out of the middle , and pulled the shirt over my head .


fn_spacy_tokens_for_baseline: They insist that the UN should condemn SWAPO 'S behaviour and hope that the incident will dent the movement 's fortunes in the election campaign .

source_bert_toks: they insist that the un should condemn swap ##o ' s behaviour and hope that the incident will dent the movement ' s fortunes in the election campaign .

reference_raw: They insist that the United Nations condemn the behavior of SWAPO and hope that the incident will deny the movement's wealth in the election campaign.

reference_spacy_tokens: They insist that the United Nations condemn the behavior of SWAPO and hope that the incident will deny the movement 's wealth in the election campaign .


fn_spacy_tokens_for_baseline: But when Nick said , coaxingly , ' They 're all for you , Mister Johnny , ' he came forward slowly , smiling his lop - sided smile and gobbling softly with pleasure .

source_bert_toks: but when nick said , coa ##xing ##ly , ' they ' re all for you , mister johnny , ' he came forward slowly , smiling his lo ##p - sided smile and go ##bbling softly with pleasure .

reference_raw: But when Nick said, coaxingly, "They're all for you, Mr. Johnny," he came forward slowly, smiling his lopsided smile, and gibbering gently with pleasure.

reference_spacy_tokens: But when Nick said , coaxingly , " They 're all for you , Mr. Johnny , " he came forward slowly , smiling his lopsided smile , and gibbering gently with pleasure .


fn_spacy_tokens_for_baseline: She noticed that the horses drawing the ' olde ' cabs were not all that well cared for , and several clinked along with loose shoes .

source_bert_toks: she noticed that the horses drawing the ' old ##e ' cab ##s were not all that well cared for , and several cl ##ink ##ed along with loose shoes .

reference_raw: She noticed that the horses drawing the 'old cabs weren't all that well taken care of, and a few of them clicked along with their loose boots.

reference_spacy_tokens: She noticed that the horses drawing the ' old cabs were n't all that well taken care of , and a few of them clicked along with their loose boots .


fn_spacy_tokens_for_baseline: It was a heartening conversation and I was grateful to him for contacting me .

source_bert_toks: it was a heart ##ening conversation and i was grateful to him for contact ##ing me .

reference_raw: It was a hearty conversation, and I was grateful that he had contacted me.

reference_spacy_tokens: It was a hearty conversation , and I was grateful that he had contacted me .


fn_spacy_tokens_for_baseline: The specimen is 15 cm long .

source_bert_toks: the specimen is 15 cm long .

reference_raw: The sample is 15 centimetres long.

reference_spacy_tokens: The sample is 15 centimetres long .


fn_spacy_tokens_for_baseline: Garnish with cayenne pepper , slices of lemon and dill .

source_bert_toks: ga ##rn ##ish with ca ##yen ##ne pepper , slices of lemon and dil ##l .

reference_raw: Garnish with cayenne paprika, slices of lemon and dill.

reference_spacy_tokens: Garnish with cayenne paprika , slices of lemon and dill .


fn_spacy_tokens_for_baseline: Changes can be discerned in family patterns by the end of the century .

source_bert_toks: changes can be disc ##ern ##ed in family patterns by the end of the century .

reference_raw: By the end of the century, changes in family patterns can be identified.

reference_spacy_tokens: By the end of the century , changes in family patterns can be identified .


fn_spacy_tokens_for_baseline: Chris Hanvey is divisional director of Leeds SSD and Area Child Protection Committee chairperson .

source_bert_toks: chris han ##vey is divisional director of leeds ss ##d and area child protection committee chairperson .

reference_raw: Chris Hanvey is the divisional director of Leeds SSD and the Chairman of the Area Child Protection Committee.

reference_spacy_tokens: Chris Hanvey is the divisional director of Leeds SSD and the Chairman of the Area Child Protection Committee .


fn_spacy_tokens_for_baseline: She sat there pondering this latest mystery .

source_bert_toks: she sat there ponder ##ing this latest mystery .

reference_raw: She sat there thinking about the last mystery.

reference_spacy_tokens: She sat there thinking about the last mystery .


fn_spacy_tokens_for_baseline: The sophisticated research facilities in Iran could easily serve as a front for illicit BW - related activities and offer a legitimate excuse to import dual - use material .

source_bert_toks: the sophisticated research facilities in iran could easily serve as a front for illicit b ##w - related activities and offer a legitimate excuse to import dual - use material .

reference_raw: Intricate research facilities in Iran could easily serve as a front for illegal BW-related activities and provide a legitimate excuse for importing dual-use materials.

reference_spacy_tokens: Intricate research facilities in Iran could easily serve as a front for illegal BW - related activities and provide a legitimate excuse for importing dual - use materials .


fn_spacy_tokens_for_baseline: After all , on his return he told of being attacked by insects as big as chickens .

source_bert_toks: after all , on his return he told of being attacked by insects as big as chickens .

reference_raw: After all, when he came back, he said he'd been attacked by insects the size of a chicken.

reference_spacy_tokens: After all , when he came back , he said he 'd been attacked by insects the size of a chicken .


fn_spacy_tokens_for_baseline: ' Both euthanasia and Hitler 's extermination projects have the same end , ' Mr Sgreccia had said in a radio interview .

source_bert_toks: ' both eu ##than ##asia and hitler ' s ex ##ter ##mina ##tion projects have the same end , ' mr sg ##re ##cci ##a had said in a radio interview .

reference_raw: 'Euthanasia and Hitler's destruction projects have the same end,' said Mr. Sgreccia, during the radio conversation.

reference_spacy_tokens: ' Euthanasia and Hitler 's destruction projects have the same end , ' said Mr. Sgreccia , during the radio conversation .


fn_spacy_tokens_for_baseline: Before reaching Great End however , follow the main path which veers to the right , down to a broad elevated col called Esk Hause ( 1.25 miles ) .

source_bert_toks: before reaching great end however , follow the main path which ve ##ers to the right , down to a broad elevated col called es ##k ha ##use ( 1 . 25 miles ) .

reference_raw: But before you reach the Great End, follow the main road that turns to the right, down to the wide, raised colt called Esk Hause (1.25 miles).

reference_spacy_tokens: But before you reach the Great End , follow the main road that turns to the right , down to the wide , raised colt called Esk Hause ( 1.25 miles ) .


fn_spacy_tokens_for_baseline: To begin with , he is the most difficult and exasperating man that I know -- except for myself . '

source_bert_toks: to begin with , he is the most difficult and ex ##as ##per ##ating man that i know - - except for myself . '

reference_raw: For starters, he's the hardest and most irritating man I've ever known - except me.'

reference_spacy_tokens: For starters , he 's the hardest and most irritating man I 've ever known - except me . '


fn_spacy_tokens_for_baseline: One suicide bomber was reported to have blown himself up in the wedding hall , and at least two car bombs went off during the attack , according to the governor .

source_bert_toks: one suicide bomber was reported to have blown himself up in the wedding hall , and at least two car bombs went off during the attack , according to the governor .

reference_raw: One suicide bomber was reported to have exploded in the wedding room, and according to the Governor, at least two car bombs exploded during the attack.

reference_spacy_tokens: One suicide bomber was reported to have exploded in the wedding room , and according to the Governor , at least two car bombs exploded during the attack .


fn_spacy_tokens_for_baseline: So who better than Tommy Lee Jones , the Academy Award - winning enigma who graduated cum laude in literature and roomed with Al Gore at Harvard University while making the All - Ivy League football team as an offensive lineman .

source_bert_toks: so who better than tommy lee jones , the academy award - winning enigma who graduated cum laude in literature and room ##ed with al gore at harvard university while making the all - ivy league football team as an offensive lineman .

reference_raw: So who better than Tommy Lee Jones, the Academy Award Winning Enigma who graduated from Cum Laude in Literature and went to Harvard with Al Gore, while making the All-Ivy League football team an offensive lineman.

reference_spacy_tokens: So who better than Tommy Lee Jones , the Academy Award Winning Enigma who graduated from Cum Laude in Literature and went to Harvard with Al Gore , while making the All - Ivy League football team an offensive lineman .


fn_spacy_tokens_for_baseline: Gastric emptying of liquid and solid phases of the test meal

source_bert_toks: gas ##tric empty ##ing of liquid and solid phases of the test meal

reference_raw: Gastric discharge of liquid and solid portions of the test meal


fn_spacy_tokens_for_baseline: The applicant is required to certify that he has taken nature conservation into account when implementing his scheme , even though the average farmer can not be expected to be capable of assessing such impacts .

source_bert_toks: the applicant is required to ce ##rti ##fy that he has taken nature conservation into account when implementing his scheme , even though the average farmer can not be expected to be capable of assessing such impacts .

reference_raw: The applicant must confirm that he has taken into account nature protection in the implementation of his scheme, even though the average farmer cannot be expected to be in a position to assess such effects.

reference_spacy_tokens: The applicant must confirm that he has taken into account nature protection in the implementation of his scheme , even though the average farmer can not be expected to be in a position to assess such effects .


fn_spacy_tokens_for_baseline: 20 RICH : Yeah , and whatever adjustment he makes today , is probably - tonight , is probably not gon na work , so we 're probably gon na have to check it tomorrow afternoon again .

source_bert_toks: 20 rich : yeah , and whatever adjustment he makes today , is probably - tonight , is probably not go ##n na work , so we ' re probably go ##n na have to check it tomorrow afternoon again .

reference_raw: 20 RICH: Yeah, and whatever he's doing today, it's probably--it's probably not going to work tonight, so I guess we'll have to recheck it tomorrow afternoon.

reference_spacy_tokens: 20 RICH : Yeah , and whatever he 's doing today , it 's probably -- it 's probably not going to work tonight , so I guess we 'll have to recheck it tomorrow afternoon .


fn_spacy_tokens_for_baseline: Two old ladies and two boys make a fairly engrossing household .

source_bert_toks: two old ladies and two boys make a fairly eng ##ross ##ing household .

reference_raw: Two old ladies and two boys make a pretty big house.

reference_spacy_tokens: Two old ladies and two boys make a pretty big house .


fn_spacy_tokens_for_baseline: I ca n't bear somnolent groups of people . '

source_bert_toks: i can ' t bear so ##m ##no ##lent groups of people . '

reference_raw: I can't stand sleepy groups.'

reference_spacy_tokens: I ca n't stand sleepy groups . '


fn_spacy_tokens_for_baseline: Opera is the communal act of listening to this silent voice from inside : it is not surprising that so many people are hungry for the experience it awakens .

source_bert_toks: opera is the communal act of listening to this silent voice from inside : it is not surprising that so many people are hungry for the experience it awake ##ns .

reference_raw: The opera is a common act of listening to that quiet voice from within: it is no wonder so many people are starving for the experience they wake up to.

reference_spacy_tokens: The opera is a common act of listening to that quiet voice from within : it is no wonder so many people are starving for the experience they wake up to .


fn_spacy_tokens_for_baseline: Yet without a secure nation - state the scope for development of what is conventionally identified as social policy is severely limited .

source_bert_toks: yet without a secure nation - state the scope for development of what is conventional ##ly identified as social policy is severely limited .

reference_raw: But without a safe country, the scope for developing what is traditionally referred to as social policy is very limited.

reference_spacy_tokens: But without a safe country , the scope for developing what is traditionally referred to as social policy is very limited .


fn_spacy_tokens_for_baseline: Perhaps with the taint of a half - smile they named the camps of Mordovia after the pretty , sun - dappled forests around Moscow where they took their family picnics and holidays .

source_bert_toks: perhaps with the tai ##nt of a half - smile they named the camps of mor ##do ##via after the pretty , sun - da ##pp ##led forests around moscow where they took their family picnic ##s and holidays .

reference_raw: Maybe with a half-smile they named Mordovia's camps after the beautiful, sun-drenched forests around Moscow, where they had taken their family tours and holidays.

reference_spacy_tokens: Maybe with a half - smile they named Mordovia 's camps after the beautiful , sun - drenched forests around Moscow , where they had taken their family tours and holidays .


fn_spacy_tokens_for_baseline: They bathed his arm again but with the water of the brook instead of wine , and though this gave him brief ease he was soon moaning and tossing again .

source_bert_toks: they bathed his arm again but with the water of the brook instead of wine , and though this gave him brief ease he was soon moaning and tossing again .

reference_raw: They bathed his hand again, but in the water of the stream instead of wine, and though it gave him a moment's ease, he soon began to groan and throw again.

reference_spacy_tokens: They bathed his hand again , but in the water of the stream instead of wine , and though it gave him a moment 's ease , he soon began to groan and throw again .


fn_spacy_tokens_for_baseline: Residues in meat may also cause allergic reactions in sensitive people .

source_bert_toks: residues in meat may also cause allergic reactions in sensitive people .

reference_raw: Meat residues can also cause allergic reactions in susceptible people.

reference_spacy_tokens: Meat residues can also cause allergic reactions in susceptible people .


fn_spacy_tokens_for_baseline: He crouched in the doorway , pulling off his leather gloves .

source_bert_toks: he crouched in the doorway , pulling off his leather gloves .

reference_raw: He crouched in the doorway and removed his leather gloves.

reference_spacy_tokens: He crouched in the doorway and removed his leather gloves .


fn_spacy_tokens_for_baseline: Even more shocking than the corruption was the ingenious ' slave system ' we found in the jail .

source_bert_toks: even more shocking than the corruption was the ing ##eni ##ous ' slave system ' we found in the jail .

reference_raw: The ingenious "slave system" we found in prison was even more surprising than corruption.

reference_spacy_tokens: The ingenious " slave system " we found in prison was even more surprising than corruption .


fn_spacy_tokens_for_baseline: The screaming would not stop , and he grimaced .

source_bert_toks: the screaming would not stop , and he grimaced .

reference_raw: The screams didn't stop, and he grinned.

reference_spacy_tokens: The screams did n't stop , and he grinned .


fn_spacy_tokens_for_baseline: Anger and frustration among Indians about the recent attacks were evident Wednesday when Rahul Gandhi , a possible future candidate for prime minister , was heckled while visiting blast victims at a Delhi hospital .

source_bert_toks: anger and frustration among indians about the recent attacks were evident wednesday when ra ##hul gandhi , a possible future candidate for prime minister , was heck ##led while visiting blast victims at a delhi hospital .

reference_raw: The anger and frustration of the Indians over the recent attacks were apparent on Wednesday, when Rahul Gandhi, a potential candidate for Prime Minister, was hesitated when he visited the blast victims in the Delhi hospital.

reference_spacy_tokens: The anger and frustration of the Indians over the recent attacks were apparent on Wednesday , when Rahul Gandhi , a potential candidate for Prime Minister , was hesitated when he visited the blast victims in the Delhi hospital .


fn_spacy_tokens_for_baseline: The most marked effect of the abstinence from sleep with this subject was the presence of hallucinations of sight .

source_bert_toks: the most marked effect of the abs ##tine ##nce from sleep with this subject was the presence of hall ##uc ##inations of sight .

reference_raw: The most significant effect of abstaining from sleeping with this subject was the presence of visual hallucinations.

reference_spacy_tokens: The most significant effect of abstaining from sleeping with this subject was the presence of visual hallucinations .


fn_spacy_tokens_for_baseline: Police are investigating two more cases of carjacking bringing to four , the total number of such robberies in the past week .

source_bert_toks: police are investigating two more cases of car ##jack ##ing bringing to four , the total number of such robber ##ies in the past week .

reference_raw: The police are investigating two other cases of car theft that led to four, the total number of these robberies over the last week.

reference_spacy_tokens: The police are investigating two other cases of car theft that led to four , the total number of these robberies over the last week .


fn_spacy_tokens_for_baseline: This traced itself back to John Merchant , a Fleming given a permit almost 100 years earlier , in 1492 , to export 50 tuns of ' ale called berre ' to the Low Countries .

source_bert_toks: this traced itself back to john merchant , a fleming given a permit almost 100 years earlier , in 149 ##2 , to export 50 tun ##s of ' ale called be ##rre ' to the low countries .

reference_raw: This traced back to John Merchant, a Fleming who had given permission almost 100 years ago in 1492 to export 50 tonnes of beer called berre to the Low Countries.

reference_spacy_tokens: This traced back to John Merchant , a Fleming who had given permission almost 100 years ago in 1492 to export 50 tonnes of beer called berre to the Low Countries .


fn_spacy_tokens_for_baseline: Complete with provenance reaching back to the artist 's lifetime , and in the present owner 's family since 1690 , this painting 's attribution to Rembrandt has never been questioned .

source_bert_toks: complete with proven ##ance reaching back to the artist ' s lifetime , and in the present owner ' s family since 1690 , this painting ' s at ##tri ##bution to re ##mb ##rand ##t has never been questioned .

reference_raw: Complete with a provenance that extends back to the life of the artist, and in the current owner's family since 1690, the imputation of this painting to Rembrandt has never been questioned.

reference_spacy_tokens: Complete with a provenance that extends back to the life of the artist , and in the current owner 's family since 1690 , the imputation of this painting to Rembrandt has never been questioned .


fn_spacy_tokens_for_baseline: He pushed his muzzle into her lap , wagging his rump , pleading to be let out .

source_bert_toks: he pushed his muzzle into her lap , wa ##gging his rum ##p , pleading to be let out .

reference_raw: He shoved his muzzle into her lap, wagged his rump, and begged her to let him out.

reference_spacy_tokens: He shoved his muzzle into her lap , wagged his rump , and begged her to let him out .


fn_spacy_tokens_for_baseline: She had been brought up to be thrifty and careful .

source_bert_toks: she had been brought up to be th ##rift ##y and careful .

reference_raw: She was raised to be prosperous and careful.

reference_spacy_tokens: She was raised to be prosperous and careful .


fn_spacy_tokens_for_baseline: A rite for the Mass of the Holy Name , confirmed officially in 1489 is found in a fourteenth - century missal belonging to William Beauchamp , Lord Bergavenny .

source_bert_toks: a rite for the mass of the holy name , confirmed officially in 148 ##9 is found in a fourteenth - century miss ##al belonging to william beau ##champ , lord berg ##ave ##nn ##y .

reference_raw: The ritual of Mass of the Holy Name, officially confirmed in 1489, is found in the 14th century Missal of William Beauchamp, Lord Bergavenny.

reference_spacy_tokens: The ritual of Mass of the Holy Name , officially confirmed in 1489 , is found in the 14th century Missal of William Beauchamp , Lord Bergavenny .


fn_spacy_tokens_for_baseline: A pin - up was tacked to the wall with drawing pins , whereas a reproduction print was carefully framed and positioned .

source_bert_toks: a pin - up was tack ##ed to the wall with drawing pins , whereas a reproduction print was carefully framed and positioned .

reference_raw: The pin was nailed to the wall by drawing pins, while the reproduction print was carefully framed and placed.

reference_spacy_tokens: The pin was nailed to the wall by drawing pins , while the reproduction print was carefully framed and placed .


fn_spacy_tokens_for_baseline: Public transport to Roos is poor : without a private car , residents are as isolated as their forefathers were .

source_bert_toks: public transport to ro ##os is poor : without a private car , residents are as isolated as their fore ##fat ##hers were .

reference_raw: Public transport to Roos is poor: without a private car, residents are as isolated as their ancestors.

reference_spacy_tokens: Public transport to Roos is poor : without a private car , residents are as isolated as their ancestors .


fn_spacy_tokens_for_baseline: On Hazely Peat Moor Bill waited for me , grinning as I slogged through the heather in the heat .

source_bert_toks: on hazel ##y peat moor bill waited for me , grinning as i sl ##og ##ged through the heather in the heat .

reference_raw: On Hazely Peat Moor Bill was waiting for me, smiling as I swerved through the heather.

reference_spacy_tokens: On Hazely Peat Moor Bill was waiting for me , smiling as I swerved through the heather .


fn_spacy_tokens_for_baseline: He was showered with fabulous jewels by the maharajahs .

source_bert_toks: he was showered with fabulous jewels by the maharaja ##hs .

reference_raw: The maharajas showered him with wonderful jewels.

reference_spacy_tokens: The maharajas showered him with wonderful jewels .


fn_spacy_tokens_for_baseline: If you have just a few bushes , drape individual plants with nets , burying or pegging down the edges during vulnerable periods .

source_bert_toks: if you have just a few bushes , dr ##ape individual plants with nets , burying or peg ##ging down the edges during vulnerable periods .

reference_raw: If you have only a few shrubs, cover individual plants with nets, bury or peg the edges in vulnerable times.

reference_spacy_tokens: If you have only a few shrubs , cover individual plants with nets , bury or peg the edges in vulnerable times .


fn_spacy_tokens_for_baseline: She reckons that more than 70 % of schoolgirls are subjected to some form of sexual harassment by their male teachers , and that a significant number are physically exploited or even raped .

source_bert_toks: she reckon ##s that more than 70 % of school ##girl ##s are subjected to some form of sexual harassment by their male teachers , and that a significant number are physically exploited or even raped .

reference_raw: He reckons that over 70% of schoolgirls are sexually harassed by their male teachers, and that a significant number of them are physically abused or even raped.

reference_spacy_tokens: He reckons that over 70 % of schoolgirls are sexually harassed by their male teachers , and that a significant number of them are physically abused or even raped .


fn_spacy_tokens_for_baseline: Standard pistol - shaped dryers are still the most popular but many come with a diffuser attachment .

source_bert_toks: standard pistol - shaped dry ##ers are still the most popular but many come with a diffuse ##r attachment .

reference_raw: The standard gun-shaped dryers are still the most popular, but many of them come with a diffuser fixture.

reference_spacy_tokens: The standard gun - shaped dryers are still the most popular , but many of them come with a diffuser fixture .


fn_spacy_tokens_for_baseline: The therapist agreed to see David daily for the next few days in order to provide him with support .

source_bert_toks: the therapist agreed to see david daily for the next few days in order to provide him with support .

reference_raw: He agreed to see David every day for the next few days to support him.

reference_spacy_tokens: He agreed to see David every day for the next few days to support him .


fn_spacy_tokens_for_baseline: A BUNGLING bandit botched three hold - ups in an hour - and ended up £ 200 worse off than when he started .

source_bert_toks: a bun ##gling bandit bot ##ched three hold - ups in an hour - and ended up £2 ##00 worse off than when he started .

reference_raw: The Bunging Bandit botched three stops in an hour-and ended up with two hundred pounds worse off than he had started.

reference_spacy_tokens: The Bunging Bandit botched three stops in an hour - and ended up with two hundred pounds worse off than he had started .


fn_spacy_tokens_for_baseline: Peaked caps sit on the bar along with foamy beer .

source_bert_toks: peaked caps sit on the bar along with foam ##y beer .

reference_raw: Peaked hats are on the bar with foamy beer.

reference_spacy_tokens: Peaked hats are on the bar with foamy beer .


fn_spacy_tokens_for_baseline: While allied airmen risk their lives in the Arabian desert , politicians in Bonn squabble over whether Germany is bound by treaty to aid Turkey , a NATO partner , should it be attacked by Iraq .

source_bert_toks: while allied airmen risk their lives in the arabian desert , politicians in bonn sq ##ua ##bble over whether germany is bound by treaty to aid turkey , a nato partner , should it be attacked by iraq .

reference_raw: While allied airmen risk their lives in the Arabian Desert, politicians in Bonn argue that Germany is bound by a treaty to help Turkey, a NATO partner, if Iraq attacks it.

reference_spacy_tokens: While allied airmen risk their lives in the Arabian Desert , politicians in Bonn argue that Germany is bound by a treaty to help Turkey , a NATO partner , if Iraq attacks it .


fn_spacy_tokens_for_baseline: Some interpreted the statement to mean it was unclear whether Muslim extremists were behind the attack .

source_bert_toks: some interpreted the statement to mean it was unclear whether muslim ex ##tre ##mist ##s were behind the attack .

reference_raw: Some interpreted it as meaning that it was not clear if Muslim extremists were responsible for the attack.

reference_spacy_tokens: Some interpreted it as meaning that it was not clear if Muslim extremists were responsible for the attack .


fn_spacy_tokens_for_baseline: She turned away to get something out of the fridge , which turned out to be a glass bowl full of trifle .

source_bert_toks: she turned away to get something out of the fridge , which turned out to be a glass bowl full of tri ##fle .

reference_raw: She turned away and pulled something out of the refrigerator, which turned out to be a glass dish full of little things.

reference_spacy_tokens: She turned away and pulled something out of the refrigerator , which turned out to be a glass dish full of little things .


fn_spacy_tokens_for_baseline: They need only position themselves near a company 's satellite dish and wait .

source_bert_toks: they need only position themselves near a company ' s satellite dish and wait .

reference_raw: All they have to do is sit close to the company's satellite dish and wait.

reference_spacy_tokens: All they have to do is sit close to the company 's satellite dish and wait .


fn_spacy_tokens_for_baseline: A second shot rang out and the bodyguard stumbled back , clutching his stomach .

source_bert_toks: a second shot rang out and the bodyguard stumbled back , clutching his stomach .

reference_raw: There was a second blast, and the bodyguard staggered back, clutching his stomach.

reference_spacy_tokens: There was a second blast , and the bodyguard staggered back , clutching his stomach .


fn_spacy_tokens_for_baseline: So my first act on Indian soil was to telex a friend at Weatherbys , the British racing bureaucrats , to get them to explain the facts of life to the Bombay Turf Club .

source_bert_toks: so my first act on indian soil was to tel ##ex a friend at weather ##by ##s , the british racing bureau ##crats , to get them to explain the facts of life to the bombay turf club .

reference_raw: So my first act on Indian soil was to telegraph a friend from Weatherbys, British racing officials, to explain the facts of life to the Bombay Turf Club.

reference_spacy_tokens: So my first act on Indian soil was to telegraph a friend from Weatherbys , British racing officials , to explain the facts of life to the Bombay Turf Club .


fn_spacy_tokens_for_baseline: At the time , Iraqi and U. S. officials touted a breakthrough called the Barzani initiative , named after Massoud Barzani , president of Iraqi Kurdistan .

source_bert_toks: at the time , iraqi and u . s . officials to ##uted a breakthrough called the bar ##zan ##i initiative , named after mass ##oud bar ##zan ##i , president of iraqi kurdistan .

reference_raw: At that time, Iraqi and American officials made a breakthrough known as the Barzani Initiative, named after Massoud Barzani, President of Iraqi Kurdistan.

reference_spacy_tokens: At that time , Iraqi and American officials made a breakthrough known as the Barzani Initiative , named after Massoud Barzani , President of Iraqi Kurdistan .


fn_spacy_tokens_for_baseline: She 'd reached a floodlit clearing where a group of costumed dancers were performing , brilliant in pink skirts , white petticoats , black bodices and bright head - scarves .

source_bert_toks: she ' d reached a flood ##lit clearing where a group of costume ##d dancers were performing , brilliant in pink skirts , white pet ##tic ##oat ##s , black bo ##dice ##s and bright head - scar ##ves .

reference_raw: She reached the floodlit clearing where a group of dressed dancers, brilliant in pink skirts, white petticoats, black bodices, and bright headscarves, performed.

reference_spacy_tokens: She reached the floodlit clearing where a group of dressed dancers , brilliant in pink skirts , white petticoats , black bodices , and bright headscarves , performed .


fn_spacy_tokens_for_baseline: Such behaviour was still rather sinful to my innocent mind : many years were to pass before I gained a taste for traditional ale !

source_bert_toks: such behaviour was still rather sin ##ful to my innocent mind : many years were to pass before i gained a taste for traditional ale !

reference_raw: That kind of behavior was still a sin for my innocent mind: it would have been many years before I had the taste of traditional beer!

reference_spacy_tokens: That kind of behavior was still a sin for my innocent mind : it would have been many years before I had the taste of traditional beer !


fn_spacy_tokens_for_baseline: Some of the patients look as though they have been showered with poppy seeds .

source_bert_toks: some of the patients look as though they have been showered with poppy seeds .

reference_raw: Some patients look like they've been sprayed with poppy seeds.

reference_spacy_tokens: Some patients look like they 've been sprayed with poppy seeds .


fn_spacy_tokens_for_baseline: Wooden - wheeled ox carts trundled through the dense throng and the air was heavy with the pungent reek of salted fish , oriental teas and spices .

source_bert_toks: wooden - wheeled ox carts tr ##und ##led through the dense th ##rong and the air was heavy with the pun ##gent re ##ek of salt ##ed fish , oriental tea ##s and spices .

reference_raw: The wooden-wheeled ox-carts trudged through the thick crowd, and the air was heavy with the pungent smell of salted fish, oriental teas and spices.

reference_spacy_tokens: The wooden - wheeled ox - carts trudged through the thick crowd , and the air was heavy with the pungent smell of salted fish , oriental teas and spices .


fn_spacy_tokens_for_baseline: Cobalt showed them into his sitting room .

source_bert_toks: cobalt showed them into his sitting room .

reference_raw: Cobalt showed them to the living room.

reference_spacy_tokens: Cobalt showed them to the living room .


fn_spacy_tokens_for_baseline: I inspected the posters on the cafe walls to see if there was anything interesting happening in the area in the near future , but apart from the Film Club there was n't much .

source_bert_toks: i inspected the posters on the cafe walls to see if there was anything interesting happening in the area in the near future , but apart from the film club there wasn ' t much .

reference_raw: I checked the posters on the walls of the coffee shop to see if anything interesting was going on in the near future, but with the exception of the film club, there wasn't much.

reference_spacy_tokens: I checked the posters on the walls of the coffee shop to see if anything interesting was going on in the near future , but with the exception of the film club , there was n't much .


fn_spacy_tokens_for_baseline: Vandals sparked a blaze when they set fire to old tyres at the former Walker Tyres site , in West Auckland , early yesterday .

source_bert_toks: van ##dal ##s sparked a blaze when they set fire to old tyres at the former walker tyres site , in west auckland , early yesterday .

reference_raw: Vandals ignited a fire when they burned the old tires at the former Walker Tyres site in West Auckland early yesterday.

reference_spacy_tokens: Vandals ignited a fire when they burned the old tires at the former Walker Tyres site in West Auckland early yesterday .


fn_spacy_tokens_for_baseline: While working at the cinema , for instance , he tried to repair a cistern and ended up flooding the place .

source_bert_toks: while working at the cinema , for instance , he tried to repair a cis ##tern and ended up flooding the place .

reference_raw: For example, when he worked in the movies, he tried to fix the cistern, and ended up infesting it.

reference_spacy_tokens: For example , when he worked in the movies , he tried to fix the cistern , and ended up infesting it .


fn_spacy_tokens_for_baseline: This development has been strongly influenced by a number of interrelated factors , all of which have varied considerably in importance over time .

source_bert_toks: this development has been strongly influenced by a number of inter ##rel ##ated factors , all of which have varied considerably in importance over time .

reference_raw: This evolution has been strongly influenced by a number of interrelated factors, all of which have changed significantly over time.

reference_spacy_tokens: This evolution has been strongly influenced by a number of interrelated factors , all of which have changed significantly over time .


fn_spacy_tokens_for_baseline: This morning the school party , including the wet member , having gone on well ahead , I crossed the beck and sat in the warm sun outside the gorge , simply looking .

source_bert_toks: this morning the school party , including the wet member , having gone on well ahead , i crossed the beck and sat in the warm sun outside the gorge , simply looking .

reference_raw: This morning, when the school party, including a wet member, was well ahead of me, I crossed the deck and sat in the warm sun outside the ravine, just watching.

reference_spacy_tokens: This morning , when the school party , including a wet member , was well ahead of me , I crossed the deck and sat in the warm sun outside the ravine , just watching .


fn_spacy_tokens_for_baseline: Like a tortured donkey , the klaxon brayed its amplified signal .

source_bert_toks: like a tortured donkey , the k ##la ##xon bray ##ed its amplified signal .

reference_raw: The klaxon, like a tortured donkey, braided his amplified signal.

reference_spacy_tokens: The klaxon , like a tortured donkey , braided his amplified signal .


fn_spacy_tokens_for_baseline: The car shifted , and something clanged .

source_bert_toks: the car shifted , and something clan ##ged .

reference_raw: The car moved, and something clicked.

reference_spacy_tokens: The car moved , and something clicked .


fn_spacy_tokens_for_baseline: At the same time , it does have a very sophisticated biotechnology infrastructure that includes leading research facilities and trained personnel .

source_bert_toks: at the same time , it does have a very sophisticated biotechnology infrastructure that includes leading research facilities and trained personnel .

reference_raw: At the same time, it has a highly sophisticated biotechnological infrastructure, including high-level research facilities and trained personnel.

reference_spacy_tokens: At the same time , it has a highly sophisticated biotechnological infrastructure , including high - level research facilities and trained personnel .


fn_spacy_tokens_for_baseline: Latin America as a whole contributed only 5.45 % to the total number of scientific publications in these ten years ( RICYT 2002 ) .

source_bert_toks: latin america as a whole contributed only 5 . 45 % to the total number of scientific publications in these ten years ( ric ##yt 2002 ) .

reference_raw: In these 10 years, Latin America as a whole contributed only 5.45% to the total number of scientific journals (RICYT 2002).

reference_spacy_tokens: In these 10 years , Latin America as a whole contributed only 5.45 % to the total number of scientific journals ( RICYT 2002 ) .


fn_spacy_tokens_for_baseline: He nudged Mrs Thatcher towards acceptance of a unified Germany .

source_bert_toks: he nudged mrs thatcher towards acceptance of a unified germany .

reference_raw: He urged Mrs. Thatcher to accept a united Germany.

reference_spacy_tokens: He urged Mrs. Thatcher to accept a united Germany .


fn_spacy_tokens_for_baseline: ' It was a wicked and spiteful thing to do . '

source_bert_toks: ' it was a wicked and spite ##ful thing to do . '

reference_raw: "It was an evil and malicious thing to do."

reference_spacy_tokens: " It was an evil and malicious thing to do . "


fn_spacy_tokens_for_baseline: But it provides a powerful aid to the understanding of some of the more baffling political manifestations of our time .

source_bert_toks: but it provides a powerful aid to the understanding of some of the more ba ##ff ##ling political manifestation ##s of our time .

reference_raw: But it helps to understand some of the more confusing political manifestations of our time.

reference_spacy_tokens: But it helps to understand some of the more confusing political manifestations of our time .


fn_spacy_tokens_for_baseline: A tranquil enough scene , we may say , once the squads of militia had departed and the floods abated .

source_bert_toks: a tran ##quil enough scene , we may say , once the squads of militia had departed and the floods aba ##ted .

reference_raw: A peaceful scene, we might say, once the militia had left and the floods had subsided.

reference_spacy_tokens: A peaceful scene , we might say , once the militia had left and the floods had subsided .


fn_spacy_tokens_for_baseline: Her conversations with the villagers as they shelled peanuts or sat around the fire , the interest she took in her pupils and their home backgrounds , her journeys out into the villages on teaching practice or corps activities had given her an appreciation of how the Africans thought and felt .

source_bert_toks: her conversations with the villagers as they shell ##ed peanuts or sat around the fire , the interest she took in her pupils and their home backgrounds , her journeys out into the villages on teaching practice or corps activities had given her an appreciation of how the africans thought and felt .

reference_raw: Her conversations with the villagers as they shelled nuts or sat around the fire, her interest in pupils and their backgrounds, her trips to the villages to study or corp activity gave her an appreciation of what the Africans thought and felt.

reference_spacy_tokens: Her conversations with the villagers as they shelled nuts or sat around the fire , her interest in pupils and their backgrounds , her trips to the villages to study or corp activity gave her an appreciation of what the Africans thought and felt .


fn_spacy_tokens_for_baseline: Canada 's merchandise exports and imports posted increases in February as automobile assembly lines stepped up production after shutdowns in January .

source_bert_toks: canada ' s merchandise exports and imports posted increases in february as automobile assembly lines stepped up production after shut ##down ##s in january .

reference_raw: Canada's exports and imports of goods increased in February when the car assembly lines increased production after the shutdown in January.

reference_spacy_tokens: Canada 's exports and imports of goods increased in February when the car assembly lines increased production after the shutdown in January .


fn_spacy_tokens_for_baseline: Was it the ultimate in malice -- to make sure that Toby , when he came to , in appalling pain , would have to contend with the idea that he would eventually die alone in the darkness ?

source_bert_toks: was it the ultimate in malice - - to make sure that toby , when he came to , in app ##all ##ing pain , would have to contend with the idea that he would eventually die alone in the darkness ?

reference_raw: Is it the ultimate of malice - to make sure that when Toby wakes up, in terrible pain, he has to face the thought of dying alone in the dark?

reference_spacy_tokens: Is it the ultimate of malice - to make sure that when Toby wakes up , in terrible pain , he has to face the thought of dying alone in the dark ?


fn_spacy_tokens_for_baseline: Whereas most terrorist groups during the 1960s and 1970s were motivated either by left - wing ideology ( socialist / communist policies advocated by Marxist - Leninist or Maoist groups ) or by national - separatist goals ( a group 's pursuit to become an independent state based on its ethnic , racial , or cultural make - up ) , the number of groups characterized primarily by religious beliefs began to increase in the 1980s .

source_bert_toks: whereas most terrorist groups during the 1960s and 1970s were motivated either by left - wing ideology ( socialist / communist policies advocated by marxist - lenin ##ist or mao ##ist groups ) or by national - sep ##arat ##ist goals ( a group ' s pursuit to become an independent state based on its ethnic , racial , or cultural make - up ) , the number of groups characterized primarily by religious beliefs began to increase in the 1980s .

reference_raw: While most terrorist groups in the 1960s and 1970s were driven either by left-wing ideology (socialist/communism policies advocated by Marxist - Leninist or Maoist groups) or by national-separatist goals (the group's desire to become an independent state based on its ethnic, racial or cultural make-up), the number of groups, characterised primarily by religious beliefs, began to increase in the 1980s.

reference_spacy_tokens: While most terrorist groups in the 1960s and 1970s were driven either by left - wing ideology ( socialist / communism policies advocated by Marxist - Leninist or Maoist groups ) or by national - separatist goals ( the group 's desire to become an independent state based on its ethnic , racial or cultural make - up ) , the number of groups , characterised primarily by religious beliefs , began to increase in the 1980s .


fn_spacy_tokens_for_baseline: If they know everything about a job then they may well be able to fix the problems for you .

source_bert_toks: if they know everything about a job then they may well be able to fix the problems for you .

reference_raw: If they know all about work, they might be able to solve your problems.

reference_spacy_tokens: If they know all about work , they might be able to solve your problems .


fn_spacy_tokens_for_baseline: The £ 3 million trial collapsed after the prosecution said Mr Clark 's evidence was not consistent with earlier statements and the charges could no longer be sustained .

source_bert_toks: the £3 million trial collapsed after the prosecution said mr clark ' s evidence was not consistent with earlier statements and the charges could no longer be sustained .

reference_raw: The £3 million trial collapsed when the prosecution said that Mr. Clark's evidence was inconsistent with previous statements and that the charges could no longer be sustained.

reference_spacy_tokens: The £ 3 million trial collapsed when the prosecution said that Mr. Clark 's evidence was inconsistent with previous statements and that the charges could no longer be sustained .


fn_spacy_tokens_for_baseline: But by the end she chose to overplay her hand and lost the sympathy of those who could have saved her from her last indignities -- though perhaps not from the bottle .

source_bert_toks: but by the end she chose to over ##play her hand and lost the sympathy of those who could have saved her from her last ind ##ign ##ities - - though perhaps not from the bottle .

reference_raw: At the end of the day, however, she decided to overplay her hand and lose the compassion of those who might have saved her from her last indignity-though perhaps not from the bottle.

reference_spacy_tokens: At the end of the day , however , she decided to overplay her hand and lose the compassion of those who might have saved her from her last indignity - though perhaps not from the bottle .


fn_spacy_tokens_for_baseline: We made it on time -- just -- thanks to our car phones .

source_bert_toks: we made it on time - - just - - thanks to our car phones .

reference_raw: We got there in time -- just -- thanks to our car phones.

reference_spacy_tokens: We got there in time -- just -- thanks to our car phones .


fn_spacy_tokens_for_baseline: Your powers , if I may say so without offence , seem superior to your opportunities . '

source_bert_toks: your powers , if i may say so without offence , seem superior to your opportunities . '

reference_raw: Your powers, if you don't mind my saying so, seem better than your options.'

reference_spacy_tokens: Your powers , if you do n't mind my saying so , seem better than your options . '


fn_spacy_tokens_for_baseline: There is a combination of two factors : the change in time zone and the sluggishness of our body rhythms to adjust to change .

source_bert_toks: there is a combination of two factors : the change in time zone and the slug ##gis ##hn ##ess of our body rhythms to adjust to change .

reference_raw: Two factors combine: change in the time zone and slowness in the rhythm of our body to adapt to change.

reference_spacy_tokens: Two factors combine : change in the time zone and slowness in the rhythm of our body to adapt to change .


fn_spacy_tokens_for_baseline: The three upper parts of the harmony may be reduplicated at the octave above , and the bass at the octave below .

source_bert_toks: the three upper parts of the harmony may be red ##up ##lica ##ted at the octave above , and the bass at the octave below .

reference_raw: Three upper parts of the harmony can be doubled in the octave above and the bass in the octave below.

reference_spacy_tokens: Three upper parts of the harmony can be doubled in the octave above and the bass in the octave below .


fn_spacy_tokens_for_baseline: Women who are courted by men are , however , in greater danger of being deceived and exploited :

source_bert_toks: women who are court ##ed by men are , however , in greater danger of being dec ##ei ##ved and exploited :

reference_raw: However, women who are judged by men are more at risk of being deceived and abused:

reference_spacy_tokens: However , women who are judged by men are more at risk of being deceived and abused :


fn_spacy_tokens_for_baseline: Inside we were greeted by the sight of a gaggle of top - heavy Sikhs energetically bopping around the hall to 1970s disco music ; beautiful Hindu ladies lilted delicately from side to side trying to avoid stepping on each other 's saris .

source_bert_toks: inside we were greeted by the sight of a gag ##gle of top - heavy sikhs energetic ##ally bop ##ping around the hall to 1970s disco music ; beautiful hindu ladies lil ##ted delicately from side to side trying to avoid stepping on each other ' s sar ##is .

reference_raw: Inside, we were greeted by the gaggle of high-heavy Sikhs bouncing energetically around the hall until the 1970s disco music; the beautiful Hindu ladies were lightly lining up from side to side, trying not to step on each other's saris.

reference_spacy_tokens: Inside , we were greeted by the gaggle of high - heavy Sikhs bouncing energetically around the hall until the 1970s disco music ; the beautiful Hindu ladies were lightly lining up from side to side , trying not to step on each other 's saris .


fn_spacy_tokens_for_baseline: He thought of the forsaken wedding preparations , of the thoughts running through the head of the betrothed man , whose name he did not even know , of the decorations which were now mockeries .

source_bert_toks: he thought of the for ##sa ##ken wedding preparations , of the thoughts running through the head of the bet ##rot ##hed man , whose name he did not even know , of the decorations which were now mock ##eries .

reference_raw: He thought of the abandoned wedding preparations, of the thoughts of the engaged man, whose name he didn't even know, of the decorations that were now mockery.

reference_spacy_tokens: He thought of the abandoned wedding preparations , of the thoughts of the engaged man , whose name he did n't even know , of the decorations that were now mockery .


fn_spacy_tokens_for_baseline: Best song of the night though , is the bitter ' High As I Kite " which builds via a tense three minutes , drops out and then comes back like an annoyed shop customer , to have another go .

source_bert_toks: best song of the night though , is the bitter ' high as i kite " which builds via a tense three minutes , drops out and then comes back like an annoyed shop customer , to have another go .

reference_raw: But the best song of the night is the bitter "High-As-I-Kite" that builds through a tense of three minutes, drops out, and then comes back like an angry salesman to try again.

reference_spacy_tokens: But the best song of the night is the bitter " High - As - I - Kite " that builds through a tense of three minutes , drops out , and then comes back like an angry salesman to try again .


fn_spacy_tokens_for_baseline: " I 'm pretty knackered .

source_bert_toks: " i ' m pretty kn ##acker ##ed .

reference_raw: "I'm very weak."

reference_spacy_tokens: " I 'm very weak . "


fn_spacy_tokens_for_baseline: ' You know , of course , that Travis has gone to get plastered , ' he charged aggressively as they started up the stairs .

source_bert_toks: ' you know , of course , that travis has gone to get plastered , ' he charged aggressively as they started up the stairs .

reference_raw: "Of course you know Travis went to get plastered," he said aggressively as they started up the stairs.

reference_spacy_tokens: " Of course you know Travis went to get plastered , " he said aggressively as they started up the stairs .


fn_spacy_tokens_for_baseline: Slater slouched a little and nodded , looking over the road to the gallery .

source_bert_toks: slater sl ##ou ##ched a little and nodded , looking over the road to the gallery .

reference_raw: Slater bowed slightly, nodded, and looked across the street at the gallery.

reference_spacy_tokens: Slater bowed slightly , nodded , and looked across the street at the gallery .


fn_spacy_tokens_for_baseline: The parishioners of St. Michael and All Angels stop to chat at the church door , as members here always have .

source_bert_toks: the parish ##ion ##ers of st . michael and all angels stop to chat at the church door , as members here always have .

reference_raw: The parishioners of St. Michael and all the angels stop at the church entrance, as the members of the church always do.

reference_spacy_tokens: The parishioners of St. Michael and all the angels stop at the church entrance , as the members of the church always do .


fn_spacy_tokens_for_baseline: The babies have traditionally been clubbed to death .

source_bert_toks: the babies have traditionally been club ##bed to death .

reference_raw: Kids were traditionally stabbed to death.

reference_spacy_tokens: Kids were traditionally stabbed to death .


fn_spacy_tokens_for_baseline: As soon as I saw you fainted away , I quitted the bed .

source_bert_toks: as soon as i saw you faint ##ed away , i quit ##ted the bed .

reference_raw: When I saw you passed out, I left the bed.

reference_spacy_tokens: When I saw you passed out , I left the bed .


fn_spacy_tokens_for_baseline: He thought it was a phone pest until police collared the culprit with a phone tap .

source_bert_toks: he thought it was a phone pest until police collar ##ed the cu ##lp ##rit with a phone tap .

reference_raw: He thought it was a phone pest until the police grabbed the perpetrator with a phone tap.

reference_spacy_tokens: He thought it was a phone pest until the police grabbed the perpetrator with a phone tap .


fn_spacy_tokens_for_baseline: On many occasions Jesus has relieved the sufferings of others , curing them of their sickness , freeing them from the hold of spirits .

source_bert_toks: on many occasions jesus has relieved the suffering ##s of others , cu ##ring them of their sickness , freeing them from the hold of spirits .

reference_raw: On many occasions, Jesus eased the suffering of others, cured them of their disease, freed them from the hold of the spirits.

reference_spacy_tokens: On many occasions , Jesus eased the suffering of others , cured them of their disease , freed them from the hold of the spirits .


fn_spacy_tokens_for_baseline: Here the mention of but one example will suffice .

source_bert_toks: here the mention of but one example will su ##ffi ##ce .

reference_raw: In this case, mentioning only one example is enough.

reference_spacy_tokens: In this case , mentioning only one example is enough .


fn_spacy_tokens_for_baseline: A mercy mission from Convoy Aid Romania is distributing £ 10,000 worth of powdered milk to feed starving orphans .

source_bert_toks: a mercy mission from convoy aid romania is distributing £10 , 000 worth of powder ##ed milk to feed starving orphans .

reference_raw: A mercy mission from Convoy Aid Romania distributes £10,000 worth of dried milk to feed starving orphans.

reference_spacy_tokens: A mercy mission from Convoy Aid Romania distributes £ 10,000 worth of dried milk to feed starving orphans .


fn_spacy_tokens_for_baseline: These claims have yet to be fully investigated , much less verified .

source_bert_toks: these claims have yet to be fully investigated , much less verified .

reference_raw: These allegations have not yet been fully examined, let alone verified.

reference_spacy_tokens: These allegations have not yet been fully examined , let alone verified .


fn_spacy_tokens_for_baseline: It flicked behind each dimpled knee ; and then scourged her at intervals from her pretty ankles to her shoulder blades .

source_bert_toks: it flicked behind each dim ##pled knee ; and then sc ##our ##ged her at intervals from her pretty ankles to her shoulder blades .

reference_raw: She flicked behind every dimpled knee, then scoured her from her pretty ankles to her shoulder blades at intervals.

reference_spacy_tokens: She flicked behind every dimpled knee , then scoured her from her pretty ankles to her shoulder blades at intervals .


fn_spacy_tokens_for_baseline: In fact , the route to prosperity is seldom on the backs of tormented people .

source_bert_toks: in fact , the route to prosperity is seldom on the backs of tormented people .

reference_raw: In fact, the road to prosperity is rarely backed by tortured people.

reference_spacy_tokens: In fact , the road to prosperity is rarely backed by tortured people .


fn_spacy_tokens_for_baseline: He is either a foreigner or has lived long in the tropics , for he is yellow and sapless , but tough as whipcord .

source_bert_toks: he is either a foreigner or has lived long in the tr ##op ##ics , for he is yellow and sap ##less , but tough as whip ##cor ##d .

reference_raw: Either he's a stranger, or he's lived in the tropics for a long time, because he's golden and sapless, but he's as hard as a whipcord.

reference_spacy_tokens: Either he 's a stranger , or he 's lived in the tropics for a long time , because he 's golden and sapless , but he 's as hard as a whipcord .


fn_spacy_tokens_for_baseline: A hundred years ago people brushed with toothpaste made from burnt eggshells or crumbled porcelain .

source_bert_toks: a hundred years ago people brushed with tooth ##pas ##te made from burnt eggs ##hell ##s or cr ##umble ##d porcelain .

reference_raw: Hundreds of years ago, people brushed with toothpaste made from burnt shells or crushed porcelain.

reference_spacy_tokens: Hundreds of years ago , people brushed with toothpaste made from burnt shells or crushed porcelain .


fn_spacy_tokens_for_baseline: The minimum pressure required to liquefy a gas at its critical temperature is called its critical pressure , pc .

source_bert_toks: the minimum pressure required to li ##que ##fy a gas at its critical temperature is called its critical pressure , pc .

reference_raw: The minimum pressure required to liquidate the gas at its critical temperature is called its critical pressure, pc.

reference_spacy_tokens: The minimum pressure required to liquidate the gas at its critical temperature is called its critical pressure , pc .


fn_spacy_tokens_for_baseline: Its thronged reefs were proudly stained rose - red , scarlet , purple , pink .

source_bert_toks: its th ##rong ##ed reefs were proudly stained rose - red , scarlet , purple , pink .

reference_raw: The crowded cliffs were proudly stained with rose-red, scarlet, violet, and pink.

reference_spacy_tokens: The crowded cliffs were proudly stained with rose - red , scarlet , violet , and pink .


fn_spacy_tokens_for_baseline: She had not even thought about persuading Marek Nowak to write down what he had told her .

source_bert_toks: she had not even thought about per ##su ##ading marek now ##ak to write down what he had told her .

reference_raw: She didn't even think of convincing Mark Nowak to make a note of what he had said.

reference_spacy_tokens: She did n't even think of convincing Mark Nowak to make a note of what he had said .


fn_spacy_tokens_for_baseline: It startled her that he should know this much when she had tried so hard to be circumspect in making her enquiries .

source_bert_toks: it startled her that he should know this much when she had tried so hard to be ci ##rc ##ums ##pe ##ct in making her en ##qui ##ries .

reference_raw: She was surprised to learn so much when she tried so hard to be careful when she asked.

reference_spacy_tokens: She was surprised to learn so much when she tried so hard to be careful when she asked .


fn_spacy_tokens_for_baseline: ' He can not twist this into a fight for the liberation of Panamanians . '

source_bert_toks: ' he can not twist this into a fight for the liberation of panama ##nian ##s . '

reference_raw: "He can't turn it into a struggle to free Panamanians."

reference_spacy_tokens: " He ca n't turn it into a struggle to free Panamanians . "


fn_spacy_tokens_for_baseline: Sligo 's lake is Lough Gill , where lies the Isle of Innisfree , named after Froech , who took the dragon - slaying sword from the hand of Finiver , his betrothed , raised above the water .

source_bert_toks: sl ##igo ' s lake is lough gill , where lies the isle of inn ##is ##free , named after fr ##oe ##ch , who took the dragon - sl ##ay ##ing sword from the hand of fin ##iver , his bet ##rot ##hed , raised above the water .

reference_raw: The lake of Sligo is Lough Gill, where lies the Isle of Innisfree, named after Froech, who took the dragon-slaying sword from Finiver's hand, his engagement raised above the water.

reference_spacy_tokens: The lake of Sligo is Lough Gill , where lies the Isle of Innisfree , named after Froech , who took the dragon - slaying sword from Finiver 's hand , his engagement raised above the water .


fn_spacy_tokens_for_baseline: For most of the journey to Barnswick Ruth deliberately tried to think of nothing , to let her mind go blank .

source_bert_toks: for most of the journey to barns ##wick ruth deliberately tried to think of nothing , to let her mind go blank .

reference_raw: For most of the journey to Barnswick Ruth had deliberately tried to think of nothing, to leave her mind blank.

reference_spacy_tokens: For most of the journey to Barnswick Ruth had deliberately tried to think of nothing , to leave her mind blank .


fn_spacy_tokens_for_baseline: Research has shown that they ate lasagne , pizza ( though tomatoes had not been discovered ) and ice - cream , along with dormice , sow 's teats and a disgusting sauce made of sun - dried , salted fish - guts .

source_bert_toks: research has shown that they ate las ##agne , pizza ( though tomatoes had not been discovered ) and ice - cream , along with dorm ##ice , so ##w ' s tea ##ts and a disgusting sauce made of sun - dried , salt ##ed fish - guts .

reference_raw: Research has shown that they have eaten lasagna, pizza (though no tomatoes have been found) and ice cream, along with dormice, sow teats, and a disgusting sauce made of sun-dried, salted fish-guts.

reference_spacy_tokens: Research has shown that they have eaten lasagna , pizza ( though no tomatoes have been found ) and ice cream , along with dormice , sow teats , and a disgusting sauce made of sun - dried , salted fish - guts .


fn_spacy_tokens_for_baseline: The great floods that occurred in Thailand in November 1988 cost many lives and alerted the government to the serious effect of cutting down rainforest .

source_bert_toks: the great floods that occurred in thailand in november 1988 cost many lives and alerted the government to the serious effect of cutting down rainforest .

reference_raw: The major floods that took place in Thailand in November 1988 cost a lot of lives and warned the government about the serious impact of cutting rain forests.

reference_spacy_tokens: The major floods that took place in Thailand in November 1988 cost a lot of lives and warned the government about the serious impact of cutting rain forests .


fn_spacy_tokens_for_baseline: He flushed the pan and buckled his belt .

source_bert_toks: he flushed the pan and buckled his belt .

reference_raw: He flushed the pelvis and fastened his belt.

reference_spacy_tokens: He flushed the pelvis and fastened his belt .


fn_spacy_tokens_for_baseline: When she had asked to see him he had offered a lavish dinner at the Ritz , which he instantly knew was a mistake .

source_bert_toks: when she had asked to see him he had offered a lavish dinner at the ri ##tz , which he instantly knew was a mistake .

reference_raw: When she asked to see him, he offered a fancy dinner at the Ritz, which he knew at once was a mistake.

reference_spacy_tokens: When she asked to see him , he offered a fancy dinner at the Ritz , which he knew at once was a mistake .


fn_spacy_tokens_for_baseline: In September 1962 the USSR was also gratified by a pledge given by the Shah of Iran not to permit the establishment of foreign missile bases of any sort on its territory .

source_bert_toks: in september 1962 the ussr was also gr ##ati ##fied by a pledge given by the shah of iran not to permit the establishment of foreign missile bases of any sort on its territory .

reference_raw: In September 1962, the USSR was also satisfied with a commitment given by the Sah of Iran not to allow foreign missile bases of any kind to be set up in its territory.

reference_spacy_tokens: In September 1962 , the USSR was also satisfied with a commitment given by the Sah of Iran not to allow foreign missile bases of any kind to be set up in its territory .


fn_spacy_tokens_for_baseline: It was ridiculous to pretend that there was anything immoral about the cinema .

source_bert_toks: it was ridiculous to pretend that there was anything im ##moral about the cinema .

reference_raw: It was ridiculous to act like there was something immoral about a movie.

reference_spacy_tokens: It was ridiculous to act like there was something immoral about a movie .


fn_spacy_tokens_for_baseline: Most famous is the striking 74 - story I.M. Pei Bank of China Tower , not beloved by the people of Hong Kong - its triangular prisms and sharp angles violate the principles of feng shui ( see box , page 68 ) and its radio masts stick up like an insect 's antennae .

source_bert_toks: most famous is the striking 74 - story i . m . pei bank of china tower , not beloved by the people of hong kong - its triangular prism ##s and sharp angles violate the principles of feng shu ##i ( see box , page 68 ) and its radio mast ##s stick up like an insect ' s antennae .

reference_raw: The most famous is I.M. Pei Bank of China Tower, which the people of Hong Kong do not love - its triangular prisms and sharp angles violate the principles of feng shui (see box, page 68) and its radio masts stick out like an insect antenna.

reference_spacy_tokens: The most famous is I.M. Pei Bank of China Tower , which the people of Hong Kong do not love - its triangular prisms and sharp angles violate the principles of feng shui ( see box , page 68 ) and its radio masts stick out like an insect antenna .


fn_spacy_tokens_for_baseline: The apartheid government also undertook a chemical and biological weapons ( CBW ) defense program , which reportedly also included offensive research and use of CBW agents against opponents of that government .

source_bert_toks: the apartheid government also undertook a chemical and biological weapons ( cb ##w ) defense program , which reportedly also included offensive research and use of cb ##w agents against opponents of that government .

reference_raw: The apartheid government also carried out a CBW defence programme, which allegedly included offensive research and use of CBW agents against its opponents.

reference_spacy_tokens: The apartheid government also carried out a CBW defence programme , which allegedly included offensive research and use of CBW agents against its opponents .


fn_spacy_tokens_for_baseline: She was a top class competitor , described in court as thorough , careful and sensible beyond her years .

source_bert_toks: she was a top class competitor , described in court as thorough , careful and sensible beyond her years .

reference_raw: She was a state-of-the-art contestant, described in court as thorough, careful, and reasonable after her years.

reference_spacy_tokens: She was a state - of - the - art contestant , described in court as thorough , careful , and reasonable after her years .


fn_spacy_tokens_for_baseline: In 1830 permission was granted for a cottage to be built at Fighting Cocks to provide accommodation for passengers and parcels .

source_bert_toks: in 1830 permission was granted for a cottage to be built at fighting cock ##s to provide accommodation for passengers and parcels .

reference_raw: In 1830, an authorisation was granted for the construction of a cabin in Fighting Cocks to accommodate passengers and parcels.

reference_spacy_tokens: In 1830 , an authorisation was granted for the construction of a cabin in Fighting Cocks to accommodate passengers and parcels .


fn_spacy_tokens_for_baseline: He said little about the case , but from that little we gathered that he also was not dissatisfied at the course of events .

source_bert_toks: he said little about the case , but from that little we gathered that he also was not dissatisfied at the course of events .

reference_raw: He didn't say much about the case, but we'd come to the conclusion that he wasn't unhappy about it either.

reference_spacy_tokens: He did n't say much about the case , but we 'd come to the conclusion that he was n't unhappy about it either .


fn_spacy_tokens_for_baseline: Mummius made some amends to the Greeks by generous dedications in their sanctuaries .

source_bert_toks: mum ##mi ##us made some amend ##s to the greeks by generous dedication ##s in their san ##ct ##uaries .

reference_raw: Mummius has made some adjustments to the Greeks with generous dedications to their sanctuaries.

reference_spacy_tokens: Mummius has made some adjustments to the Greeks with generous dedications to their sanctuaries .


fn_spacy_tokens_for_baseline: and you drowse and mutter beside me .

source_bert_toks: and you dr ##ows ##e and mutter beside me .

reference_raw: and you're sleepy and mumbling next to me.

reference_spacy_tokens: and you 're sleepy and mumbling next to me .


fn_spacy_tokens_for_baseline: Babies were often sent away to be nursed in rural parishes where they were ill fed , overcrowded , and quieted with opiates ( see Fildes 1988 ) .

source_bert_toks: babies were often sent away to be nurse ##d in rural parishes where they were ill fed , over ##crow ##ded , and quiet ##ed with op ##iate ##s ( see fi ##lde ##s 1988 ) .

reference_raw: Children were often sent to nurse in rural parishes, where they were ill-fed, crowded and opiated (see Fildes 1988).

reference_spacy_tokens: Children were often sent to nurse in rural parishes , where they were ill - fed , crowded and opiated ( see Fildes 1988 ) .


fn_spacy_tokens_for_baseline: Here is a boxful of tiny poulpes , a variety of squid which never grow big and which are exquisite fried crisp in oil .

source_bert_toks: here is a box ##ful of tiny po ##ul ##pes , a variety of squid which never grow big and which are exquisite fried crisp in oil .

reference_raw: There's a box full of tiny poulpes, a variety of squids that never grow big and are deliciously fried in oil.

reference_spacy_tokens: There 's a box full of tiny poulpes , a variety of squids that never grow big and are deliciously fried in oil .


fn_spacy_tokens_for_baseline: This is a conflict of interest which can not easily be overcome and hardly augurs well for the future reconciliation of the differences between the agricultural and non - agricultural rural population .

source_bert_toks: this is a conflict of interest which can not easily be overcome and hardly aug ##urs well for the future reconciliation of the differences between the agricultural and non - agricultural rural population .

reference_raw: This is a conflict of interest that cannot be easily overcome, and it is difficult to reconcile the differences between agricultural and non-agricultural rural populations in the future.

reference_spacy_tokens: This is a conflict of interest that can not be easily overcome , and it is difficult to reconcile the differences between agricultural and non - agricultural rural populations in the future .


fn_spacy_tokens_for_baseline: He took early retirement in 1990 after 25 years at IBM and joined Softwright a couple of months later .

source_bert_toks: he took early retirement in 1990 after 25 years at ibm and joined soft ##wright a couple of months later .

reference_raw: After 25 years at IBM, he retired early in 1990 and joined Softwright a few months later.

reference_spacy_tokens: After 25 years at IBM , he retired early in 1990 and joined Softwright a few months later .


fn_spacy_tokens_for_baseline: The findings of our research indicate that paraprofessional personnel perform the bulk of face - to - face social service and social development activity around the world .

source_bert_toks: the findings of our research indicate that para ##pro ##fe ##ssion ##al personnel perform the bulk of face - to - face social service and social development activity around the world .

reference_raw: The results of our research show that para-professionals carry out most of the personal social services and social development activities around the world.

reference_spacy_tokens: The results of our research show that para - professionals carry out most of the personal social services and social development activities around the world .


fn_spacy_tokens_for_baseline: The sanctions can not be lifted until U.N. inspectors certify that Iraq has eliminated its weapons of mass destruction and the means to produce them .

source_bert_toks: the sanctions can not be lifted until u . n . inspectors ce ##rti ##fy that iraq has eliminated its weapons of mass destruction and the means to produce them .

reference_raw: Penalties cannot be lifted until UN inspectors confirm that Iraq has eliminated its weapons of mass destruction and the resources to produce them.

reference_spacy_tokens: Penalties can not be lifted until UN inspectors confirm that Iraq has eliminated its weapons of mass destruction and the resources to produce them .


fn_spacy_tokens_for_baseline: Just past the temple is the aptly named Ladder Street .

source_bert_toks: just past the temple is the apt ##ly named ladder street .

reference_raw: There's a well-named Ladder Street just outside the temple.

reference_spacy_tokens: There 's a well - named Ladder Street just outside the temple .


fn_spacy_tokens_for_baseline: This provided jobs and houses in new communities for people from overcrowded cities and run - down industrial areas .

source_bert_toks: this provided jobs and houses in new communities for people from over ##crow ##ded cities and run - down industrial areas .

reference_raw: This provided jobs and homes in new communities for people from crowded cities and depleted industrial areas.

reference_spacy_tokens: This provided jobs and homes in new communities for people from crowded cities and depleted industrial areas .


fn_spacy_tokens_for_baseline: ' It is n't Miss Morton 's fault , ' Lindsey reasoned quietly .

source_bert_toks: ' it isn ' t miss morton ' s fault , ' lindsey reasoned quietly .

reference_raw: 'It's not Miss Morton's fault,' said Lindsey softly.

reference_spacy_tokens: ' It 's not Miss Morton 's fault , ' said Lindsey softly .


fn_spacy_tokens_for_baseline: Mary Finnigan : ' We were extremely righteous about our drugs in those days .

source_bert_toks: mary finn ##igan : ' we were extremely righteous about our drugs in those days .

reference_raw: Mary Finnigan: 'At the time, we were very honest about our drugs.

reference_spacy_tokens: Mary Finnigan : ' At the time , we were very honest about our drugs .


fn_spacy_tokens_for_baseline: The demand for buses has dropped dramatically since the late 1970s and this process has been accelerated by the ending of both the bus grant and revenue support for bus services .

source_bert_toks: the demand for buses has dropped dramatically since the late 1970s and this process has been accelerated by the ending of both the bus grant and revenue support for bus services .

reference_raw: Since the end of the 1970s, the demand for buses has fallen dramatically and this process has been accelerated by the end of both the bus grant and the revenue support for bus services.

reference_spacy_tokens: Since the end of the 1970s , the demand for buses has fallen dramatically and this process has been accelerated by the end of both the bus grant and the revenue support for bus services .


fn_spacy_tokens_for_baseline: The events that immediately precede a strike are more accurately defined as the factors which serve to precipitate the ensuing conflict .

source_bert_toks: the events that immediately pre ##cede a strike are more accurately defined as the factors which serve to pre ##ci ##pit ##ate the ensuing conflict .

reference_raw: Events immediately prior to the strike are defined more precisely as factors that will accelerate the subsequent conflict.

reference_spacy_tokens: Events immediately prior to the strike are defined more precisely as factors that will accelerate the subsequent conflict .


fn_spacy_tokens_for_baseline: King 's Cross is just one of London 's more conspicuous examples of planning and democracy in action .

source_bert_toks: king ' s cross is just one of london ' s more conspicuous examples of planning and democracy in action .

reference_raw: The King's Cross is just one of London's most obvious examples of planning and democracy in action.

reference_spacy_tokens: The King 's Cross is just one of London 's most obvious examples of planning and democracy in action .


fn_spacy_tokens_for_baseline: ' So this Alfred Emblow steps forward , ' she went on , deepening her voice a tone to impersonate the strong - man , ' and says : ' Well done , young man .

source_bert_toks: ' so this alfred em ##bl ##ow steps forward , ' she went on , deep ##ening her voice a tone to imp ##erson ##ate the strong - man , ' and says : ' well done , young man .

reference_raw: "So this Alfred Emblow steps forward," she went on, deepening her voice to pretend to be a strong man, "and he says, "Well done, young man.

reference_spacy_tokens: " So this Alfred Emblow steps forward , " she went on , deepening her voice to pretend to be a strong man , " and he says , " Well done , young man .


fn_spacy_tokens_for_baseline: Glass tinkled on the roadway .

source_bert_toks: glass tin ##kled on the roadway .

reference_raw: The glass rattled on the road.

reference_spacy_tokens: The glass rattled on the road .


fn_spacy_tokens_for_baseline: The wood was pleasingly warm and aromatic ; the hot steam washed over him in tingling waves .

source_bert_toks: the wood was pleasing ##ly warm and aromatic ; the hot steam washed over him in tingling waves .

reference_raw: The wood was pleasantly warm and fragrant; hot steam washed over him in tingling waves.

reference_spacy_tokens: The wood was pleasantly warm and fragrant ; hot steam washed over him in tingling waves .


fn_spacy_tokens_for_baseline: It was a strange misdemeanour but it launched The Doc on a career of unparalleled misbehaviour , which included regular confrontations with the footballing authorities and inevitable conflict with the law .

source_bert_toks: it was a strange mis ##de ##me ##ano ##ur but it launched the doc on a career of un ##para ##lle ##led mis ##be ##ha ##vio ##ur , which included regular confrontation ##s with the football ##ing authorities and inevitable conflict with the law .

reference_raw: It was a strange offense, but he launched the Doctor into a career of unparalleled misconduct, including regular confrontations with the football authorities and inevitable violations of the law.

reference_spacy_tokens: It was a strange offense , but he launched the Doctor into a career of unparalleled misconduct , including regular confrontations with the football authorities and inevitable violations of the law .


fn_spacy_tokens_for_baseline: Their approaches to Pope Boniface VIII and the resulting admonitions from the Pope condemning English invasions of the Papal fief of Scotland had incensed Edward and driven him to some of his more savage oppressions .

source_bert_toks: their approaches to pope bon ##iface viii and the resulting ad ##mon ##ition ##s from the pope condemning english invasions of the papal fi ##ef of scotland had incense ##d edward and driven him to some of his more savage oppression ##s .

reference_raw: Their approach to Pope Boniface VIII and the subsequent warnings of the Pope, which condemned the English invasion of the Papal fief of Scotland, provoked Edward into some of his more violent oppressions.

reference_spacy_tokens: Their approach to Pope Boniface VIII and the subsequent warnings of the Pope , which condemned the English invasion of the Papal fief of Scotland , provoked Edward into some of his more violent oppressions .


fn_spacy_tokens_for_baseline: But such exposure has not satisfied Koons ' craving for fame .

source_bert_toks: but such exposure has not satisfied ko ##ons ' craving for fame .

reference_raw: But such exposure did not satisfy Koon's desire for glory.

reference_spacy_tokens: But such exposure did not satisfy Koon 's desire for glory .


fn_spacy_tokens_for_baseline: Earl Spencer always stoutly defended his wife 's robust management of the estate saying : ' The cost of restoration has been immense . '

source_bert_toks: earl spencer always stout ##ly defended his wife ' s robust management of the estate saying : ' the cost of restoration has been immense . '

reference_raw: Earl Spencer had always defended his wife's strong management of the estate, saying, "The cost of restoration was enormous."

reference_spacy_tokens: Earl Spencer had always defended his wife 's strong management of the estate , saying , " The cost of restoration was enormous . "


fn_spacy_tokens_for_baseline: Suddenly , she was clinging to him , her hands in his dark hair , gasping with pent - up desire as his hands swept up to her breasts .

source_bert_toks: suddenly , she was clinging to him , her hands in his dark hair , gasping with pen ##t - up desire as his hands swept up to her breasts .

reference_raw: She was suddenly clinging to him, her hands in his dark hair, panting with pent-up longing as he reached up to her breasts.

reference_spacy_tokens: She was suddenly clinging to him , her hands in his dark hair , panting with pent - up longing as he reached up to her breasts .


fn_spacy_tokens_for_baseline: Earlier , he had tried to sidestep his detractors this week by announcing he was in favor of the strike .

source_bert_toks: earlier , he had tried to sides ##te ##p his det ##rac ##tors this week by announcing he was in favor of the strike .

reference_raw: Earlier this week, he tried to take sides with his detractors by announcing that he was in favour of the strike.

reference_spacy_tokens: Earlier this week , he tried to take sides with his detractors by announcing that he was in favour of the strike .


fn_spacy_tokens_for_baseline: Then if he still has not come out of the tent I will go down there while it is still light , very quietly , and see if I can see , without getting too close , how he is .

source_bert_toks: then if he still has not come out of the tent i will go down there while it is still light , very quietly , and see if i can see , without getting too close , how he is .

reference_raw: If he still hasn't left the tent, I'll go down there while it's still daylight, very quiet, and I'll see if I can see, without getting too close, how he's doing.

reference_spacy_tokens: If he still has n't left the tent , I 'll go down there while it 's still daylight , very quiet , and I 'll see if I can see , without getting too close , how he 's doing .


fn_spacy_tokens_for_baseline: But to show he was independent and a big boy he had lately taken to spelling his name with a small letter : martin .

source_bert_toks: but to show he was independent and a big boy he had lately taken to spelling his name with a small letter : martin .

reference_raw: But to prove that he was independent and that he was a big boy he had recently taken to write his name in a little letter: Martin.

reference_spacy_tokens: But to prove that he was independent and that he was a big boy he had recently taken to write his name in a little letter : Martin .


fn_spacy_tokens_for_baseline: Louisa began again , but faltered when she saw Emilia close her eyes and shake her head in the little bonnet she wore .

source_bert_toks: louisa began again , but faltered when she saw emilia close her eyes and shake her head in the little bonnet she wore .

reference_raw: Louisa started again, but hesitated when she saw Emilia close her eyes and shake her head in the small hood she was wearing.

reference_spacy_tokens: Louisa started again , but hesitated when she saw Emilia close her eyes and shake her head in the small hood she was wearing .


fn_spacy_tokens_for_baseline: Constantinople was taken by Crusader forces in 1204 , and they stripped the city of many of its finest treasures -- which now grace the public buildings of Venice -- although a large consignment of books and manuscripts was transferred to the monastery at Patmos before the city fell .

source_bert_toks: constantinople was taken by crusader forces in 120 ##4 , and they stripped the city of many of its finest treasures - - which now grace the public buildings of venice - - although a large con ##si ##gn ##ment of books and manuscripts was transferred to the monastery at pat ##mos before the city fell .

reference_raw: Constantinople was captured by the Crusader forces in 1204 and stripped the city of many of its finest treasures - which now grace the public buildings of Venice - though a large shipment of books and manuscripts had been transferred to a convent in Patmos before the city collapsed.

reference_spacy_tokens: Constantinople was captured by the Crusader forces in 1204 and stripped the city of many of its finest treasures - which now grace the public buildings of Venice - though a large shipment of books and manuscripts had been transferred to a convent in Patmos before the city collapsed .


fn_spacy_tokens_for_baseline: The new features along with a faster Program Manager , File Manager and SmartDrive disc cache , make upgrading to version 3.1 a sensible choice .

source_bert_toks: the new features along with a faster program manager , file manager and smart ##drive disc cache , make upgrading to version 3 . 1 a sensible choice .

reference_raw: New features, together with a quicker program manager, file manager and smartDrive disk cache, make upgrading to version 3.1 a reasonable choice.

reference_spacy_tokens: New features , together with a quicker program manager , file manager and smartDrive disk cache , make upgrading to version 3.1 a reasonable choice .


fn_spacy_tokens_for_baseline: Just as then , the state arms dealers were mum about potential customers and contracts .

source_bert_toks: just as then , the state arms dealers were mum about potential customers and contracts .

reference_raw: Just like that, state arms dealers were moms about potential customers and contracts.

reference_spacy_tokens: Just like that , state arms dealers were moms about potential customers and contracts .


fn_spacy_tokens_for_baseline: There are also souvenir stands , benches for a rest , and perhaps Hong Kong 's last surviving rickshaws - however these are not for rides , but are a tourist photo opportunity .

source_bert_toks: there are also so ##uven ##ir stands , benches for a rest , and perhaps hong kong ' s last surviving rick ##shaw ##s - however these are not for rides , but are a tourist photo opportunity .

reference_raw: There are also souvenir stands, resting benches, and perhaps the last surviving Hong Kong rickshaws - but they're not for driving, they're a tourist photo opportunity.

reference_spacy_tokens: There are also souvenir stands , resting benches , and perhaps the last surviving Hong Kong rickshaws - but they 're not for driving , they 're a tourist photo opportunity .


fn_spacy_tokens_for_baseline: After that you wear paper overalls that get combusted at every stage . '

source_bert_toks: after that you wear paper overall ##s that get comb ##ust ##ed at every stage . '

reference_raw: Then you wear paper overalls that burn at every stage.'

reference_spacy_tokens: Then you wear paper overalls that burn at every stage . '


fn_spacy_tokens_for_baseline: I beseech you say not one word but ' yes ' or ' no ' till I have said all I have to say .

source_bert_toks: i be ##see ##ch you say not one word but ' yes ' or ' no ' till i have said all i have to say .

reference_raw: Please don't say a word, but "yes" or "no" until I say what I have to say.

reference_spacy_tokens: Please do n't say a word , but " yes " or " no " until I say what I have to say .


fn_spacy_tokens_for_baseline: With the cost of publishing a paper rising , ..

source_bert_toks: with the cost of publishing a paper rising , . .

reference_raw: With the cost of publishing the newspapers rising...

reference_spacy_tokens: With the cost of publishing the newspapers rising ...


fn_spacy_tokens_for_baseline: The two were indicted as responsible for killings , rapes , torture and beatings by camp personnel under their command .

source_bert_toks: the two were indicted as responsible for killings , rape ##s , torture and beating ##s by camp personnel under their command .

reference_raw: Both were charged with the murder, rape, torture and beating of campers under their command.

reference_spacy_tokens: Both were charged with the murder , rape , torture and beating of campers under their command .


fn_spacy_tokens_for_baseline: It is difficult to point to the material goals which football hooligans or juvenile delinquents are chasing .

source_bert_toks: it is difficult to point to the material goals which football ho ##oli ##gan ##s or juvenile del ##in ##quent ##s are chasing .

reference_raw: It is difficult to point out the material objectives pursued by football hooligans or juvenile offenders.

reference_spacy_tokens: It is difficult to point out the material objectives pursued by football hooligans or juvenile offenders .


fn_spacy_tokens_for_baseline: When Democrats wonder why there is so much resentment of Clinton , they do n't need to look much further than the Big Lie about philandering that Stephanopoulos , Carville ( and a cooperative campaign press corps ) helped to put over in 1992 .

source_bert_toks: when democrats wonder why there is so much resentment of clinton , they don ' t need to look much further than the big lie about phil ##ander ##ing that stephan ##op ##oulos , car ##ville ( and a cooperative campaign press corps ) helped to put over in 1992 .

reference_raw: When Democrats ask why Clinton has so much resentment, they need not look further than the Great Lie about the philandering that Stephanopoulos and Carville (and the Cooperative Press Force) helped put in place in 1992.

reference_spacy_tokens: When Democrats ask why Clinton has so much resentment , they need not look further than the Great Lie about the philandering that Stephanopoulos and Carville ( and the Cooperative Press Force ) helped put in place in 1992 .


fn_spacy_tokens_for_baseline: He had ranged ahead , limiting himself to brusque commands and a variety of signals .

source_bert_toks: he had ranged ahead , limiting himself to br ##us ##que commands and a variety of signals .

reference_raw: He ran forward, restricting himself to harsh commands and various signals.

reference_spacy_tokens: He ran forward , restricting himself to harsh commands and various signals .


fn_spacy_tokens_for_baseline: It originated when these rare spices were first brought to Italy from the East in medieval times .

source_bert_toks: it originated when these rare spices were first brought to italy from the east in medieval times .

reference_raw: It came from the first time in the Middle Ages when these rare melanges were brought to Italy from the east.

reference_spacy_tokens: It came from the first time in the Middle Ages when these rare melanges were brought to Italy from the east .


fn_spacy_tokens_for_baseline: On her slender body was only the bathrobe , which fluttered out behind her as she ran into the steaming night .

source_bert_toks: on her slender body was only the bath ##ro ##be , which fluttered out behind her as she ran into the steaming night .

reference_raw: There was only a bathrobe on her slim body that fluttered behind her as she ran into the steaming night.

reference_spacy_tokens: There was only a bathrobe on her slim body that fluttered behind her as she ran into the steaming night .


fn_spacy_tokens_for_baseline: GENERAL Manuel Antonio Noriega yesterday accused the US of planning and supporting Tuesday 's failed coup to topple Panama 's resilient military leader .

source_bert_toks: general manuel antonio nor ##ieg ##a yesterday accused the us of planning and supporting tuesday ' s failed coup to top ##ple panama ' s res ##ili ##ent military leader .

reference_raw: Yesterday, Gen. Manuel Antonio Noriega accused the United States of planning and supporting Tuesday's failed coup to overthrow Panama's resilient military leader.

reference_spacy_tokens: Yesterday , Gen. Manuel Antonio Noriega accused the United States of planning and supporting Tuesday 's failed coup to overthrow Panama 's resilient military leader .


fn_spacy_tokens_for_baseline: As a policy that might have succeeded it suffered from impossible political equivocation .

source_bert_toks: as a policy that might have succeeded it suffered from impossible political e ##qui ##vocation .

reference_raw: As a policy that could succeed, he suffered from an impossible political imbalance.

reference_spacy_tokens: As a policy that could succeed , he suffered from an impossible political imbalance .


fn_spacy_tokens_for_baseline: He heard the clang of metal on metal , and a ricochet whined viciously past his head .

source_bert_toks: he heard the clan ##g of metal on metal , and a rico ##chet w ##hine ##d vicious ##ly past his head .

reference_raw: He could hear the clattering of metal against metal, and the ricochet howled viciously around his head.

reference_spacy_tokens: He could hear the clattering of metal against metal , and the ricochet howled viciously around his head .