fn_spacy_tokens_for_baseline: Every Scottish town has a local pub owned by an ex - footballer , where the die - hards can drink in the company of former heroes and where old programmes and framed football strips decorate the walls .

source_bert_toks: every scottish town has a local pub owned by an ex - footballer , where the die - hard ##s can drink in the company of former heroes and where old programmes and framed football strips decorate the walls .

reference_raw: Each Scottish city has a local pub owned by an ex-footballer, where die-hards can drink in the company of former heroes, and where old programs and framed football strips adorn the walls.

reference_spacy_tokens: Each Scottish city has a local pub owned by an ex - footballer , where die - hards can drink in the company of former heroes , and where old programs and framed football strips adorn the walls .


fn_spacy_tokens_for_baseline: The wistful longing after a determinate hidden variable theory clearly remained unassuaged .

source_bert_toks: the wi ##st ##ful longing after a deter ##minate hidden variable theory clearly remained una ##ss ##ua ##ged .

reference_raw: Evidently, the wistful desire after the indeterminate hidden variable theory remained unconvinced.

reference_spacy_tokens: Evidently , the wistful desire after the indeterminate hidden variable theory remained unconvinced .


fn_spacy_tokens_for_baseline: Like the suicide bomber in Jerusalem , the Netanya shooters hailed from refugee camps , which Israel maintains are hotbeds of armed resistance .

source_bert_toks: like the suicide bomber in jerusalem , the net ##any ##a shooters hailed from refugee camps , which israel maintains are hot ##bed ##s of armed resistance .

reference_raw: Like a suicidal bomber in Jerusalem, Netanya gunmen hailed from refugee camps, which Israel claims to be the hot beds of armed resistance.

reference_spacy_tokens: Like a suicidal bomber in Jerusalem , Netanya gunmen hailed from refugee camps , which Israel claims to be the hot beds of armed resistance .


fn_spacy_tokens_for_baseline: With his conscious self , Lewis had a very distinct loathing of Ulster Protestantism .

source_bert_toks: with his conscious self , lewis had a very distinct lo ##athing of ulster protestant ##ism .

reference_raw: Lewis, with his conscious self, was clearly disgusted with Ulster Protestantism.

reference_spacy_tokens: Lewis , with his conscious self , was clearly disgusted with Ulster Protestantism .


fn_spacy_tokens_for_baseline: The pup bleated weakly , and Privet dared at last to look at it .

source_bert_toks: the pup b ##lea ##ted weakly , and pri ##vet dared at last to look at it .

reference_raw: The puppy belted weakly, and Privet finally ventured to look at it.

reference_spacy_tokens: The puppy belted weakly , and Privet finally ventured to look at it .


fn_spacy_tokens_for_baseline: His wife 's beauty , little adorned , seemed to draw the lamplight towards her : it shone on the latticework of her sleeves and the exact and regular folds that defined the slender bones of her body .

source_bert_toks: his wife ' s beauty , little adorned , seemed to draw the lamp ##light towards her : it shone on the lattice ##work of her sleeves and the exact and regular folds that defined the slender bones of her body .

reference_raw: The beauty of his wife, a little decorated, seemed to draw the lamplight toward her: it shone on the lattice of her sleeves and the precise and regular folds that defined the slender bones of her body.

reference_spacy_tokens: The beauty of his wife , a little decorated , seemed to draw the lamplight toward her : it shone on the lattice of her sleeves and the precise and regular folds that defined the slender bones of her body .


fn_spacy_tokens_for_baseline: Suddenly , a wave of tiredness swept through her and she closed her eyes for a moment , during which the girl remained quiet , but visibly agitated and eager to be getting on with her work .

source_bert_toks: suddenly , a wave of tired ##ness swept through her and she closed her eyes for a moment , during which the girl remained quiet , but visibly agitated and eager to be getting on with her work .

reference_raw: A sudden wave of fatigue swept through her, and she closed her eyes for a moment, during which she remained silent, but clearly excited and eager to continue her work.

reference_spacy_tokens: A sudden wave of fatigue swept through her , and she closed her eyes for a moment , during which she remained silent , but clearly excited and eager to continue her work .


fn_spacy_tokens_for_baseline: Thirty - two of the 159 U.N. members were honoring the sanctions against Iraq .

source_bert_toks: thirty - two of the 159 u . n . members were honoring the sanctions against iraq .

reference_raw: Thirty-two out of 159 UN members respected sanctions against Iraq.

reference_spacy_tokens: Thirty - two out of 159 UN members respected sanctions against Iraq .


fn_spacy_tokens_for_baseline: If Richter 's Brahms is a revelation , then his playing of Liszt is without equal .

source_bert_toks: if richter ' s brahms is a revelation , then his playing of liszt is without equal .

reference_raw: If Richter's Brahms is a revelation, then Liszt's game isn't the same.

reference_spacy_tokens: If Richter 's Brahms is a revelation , then Liszt 's game is n't the same .


fn_spacy_tokens_for_baseline: He does n't speak a lot because he stutters .

source_bert_toks: he doesn ' t speak a lot because he stu ##tters .

reference_raw: She doesn't talk much because she stumbles.

reference_spacy_tokens: She does n't talk much because she stumbles .


fn_spacy_tokens_for_baseline: On July 15 it had been reported that the new Cabinet had drafted 35 pieces of legislation for immediate consideration by the new Congress .

source_bert_toks: on july 15 it had been reported that the new cabinet had drafted 35 pieces of legislation for immediate consideration by the new congress .

reference_raw: On July 15th, it was announced that the new government had drawn up 35 pieces of legislation for immediate consideration by the new Congress.

reference_spacy_tokens: On July 15th , it was announced that the new government had drawn up 35 pieces of legislation for immediate consideration by the new Congress .


fn_spacy_tokens_for_baseline: With a blood - curdling growl , the curtain was snatched aside .

source_bert_toks: with a blood - cu ##rd ##ling growl , the curtain was snatched aside .

reference_raw: The curtain was torn aside with a blood-curling growl.

reference_spacy_tokens: The curtain was torn aside with a blood - curling growl .


fn_spacy_tokens_for_baseline: A WOMAN deputy sheriff has been fired for fondling male colleagues and talking dirty to them .

source_bert_toks: a woman deputy sheriff has been fired for fond ##ling male colleagues and talking dirty to them .

reference_raw: A WOMAN deputy sheriff was sacked for fondling male colleagues and talking dirty to them.

reference_spacy_tokens: A WOMAN deputy sheriff was sacked for fondling male colleagues and talking dirty to them .


fn_spacy_tokens_for_baseline: She reached for the bottle and half filled his tumbler .

source_bert_toks: she reached for the bottle and half filled his tumble ##r .

reference_raw: She reached for the bottle and half-filled it.

reference_spacy_tokens: She reached for the bottle and half - filled it .


fn_spacy_tokens_for_baseline: If only I had a stole or something to cover it up . '

source_bert_toks: if only i had a stole or something to cover it up . '

reference_raw: I wish I had a burglary or something to hide it.'

reference_spacy_tokens: I wish I had a burglary or something to hide it . '


fn_spacy_tokens_for_baseline: Only 3 % ( 4 / 129 ) of patients with dementia who attended two neurology outpatient departments were not admitted to psychiatric hospital .

source_bert_toks: only 3 % ( 4 / 129 ) of patients with dementia who attended two ne ##uro ##logy out ##patient departments were not admitted to psychiatric hospital .

reference_raw: Only 3% (4/129) of patients with dementia who attended two neurological outpatients were not admitted to a psychiatric hospital.

reference_spacy_tokens: Only 3 % ( 4/129 ) of patients with dementia who attended two neurological outpatients were not admitted to a psychiatric hospital .


fn_spacy_tokens_for_baseline: He closed his mouth down around hers , and for a moment she was too stunned to react .

source_bert_toks: he closed his mouth down around hers , and for a moment she was too stunned to react .

reference_raw: He shut his mouth around hers, and for a moment she was too stunned to respond.

reference_spacy_tokens: He shut his mouth around hers , and for a moment she was too stunned to respond .


fn_spacy_tokens_for_baseline: Then a momentary thinning of the swirling fog revealed to his horrified gaze the alarming sight of the black garbed figure sliding over the platform rail to drop on his unsuspecting colleague .

source_bert_toks: then a momentary thin ##ning of the swirling fog revealed to his horrified gaze the alarm ##ing sight of the black ga ##rb ##ed figure sliding over the platform rail to drop on his un ##sus ##pe ##cting colleague .

reference_raw: Then a momentary thinning of the swirling mist revealed to his horrified eyes the appalling sight of a black robed figure sliding over the railing of the platform to fall upon his unsuspecting colleague.

reference_spacy_tokens: Then a momentary thinning of the swirling mist revealed to his horrified eyes the appalling sight of a black robed figure sliding over the railing of the platform to fall upon his unsuspecting colleague .


fn_spacy_tokens_for_baseline: At one time , the average person could harvest around a sackful of wheat a day .

source_bert_toks: at one time , the average person could harvest around a sack ##ful of wheat a day .

reference_raw: At one time, the average person would be able to harvest around a sack of wheat a day.

reference_spacy_tokens: At one time , the average person would be able to harvest around a sack of wheat a day .


fn_spacy_tokens_for_baseline: My man and I separated when I was 60 .

source_bert_toks: my man and i separated when i was 60 .

reference_raw: I broke up with my husband when I was 60.

reference_spacy_tokens: I broke up with my husband when I was 60 .


fn_spacy_tokens_for_baseline: Two years ago , Sept. 22 , 1993 , an eastbound Sunset Limited train derailed into a bayou near Saraland , Alabama , killing 47 people .

source_bert_toks: two years ago , sept . 22 , 1993 , an eastbound sunset limited train der ##ailed into a bayou near sara ##land , alabama , killing 47 people .

reference_raw: Two years ago, September 22, 1993, an eastbound train from Sunset Limited derailed to a bay near Saraland, Alabama, killing 47 people.

reference_spacy_tokens: Two years ago , September 22 , 1993 , an eastbound train from Sunset Limited derailed to a bay near Saraland , Alabama , killing 47 people .


fn_spacy_tokens_for_baseline: If your hair is shoulder - length or just beyond , Clairol 's Lock'N Roll are the best way to create fabulous curls and waves .

source_bert_toks: if your hair is shoulder - length or just beyond , clair ##ol ' s lock ' n roll are the best way to create fabulous curls and waves .

reference_raw: If your hair is shoulder-length or right behind you, Clairol's Lock'N Roll is the best way to make wonderful curls and ripples.

reference_spacy_tokens: If your hair is shoulder - length or right behind you , Clairol 's Lock'N Roll is the best way to make wonderful curls and ripples .


fn_spacy_tokens_for_baseline: She was handcuffed to the bed .

source_bert_toks: she was hand ##cu ##ffed to the bed .

reference_raw: She was chained to the bed.

reference_spacy_tokens: She was chained to the bed .


fn_spacy_tokens_for_baseline: It was the catastrophe of the Crimean War which rendered this commitment untenable .

source_bert_toks: it was the catastrophe of the crimean war which rendered this commitment un ##ten ##able .

reference_raw: It was the disaster of the Crimean War that made this commitment unsustainable.

reference_spacy_tokens: It was the disaster of the Crimean War that made this commitment unsustainable .


fn_spacy_tokens_for_baseline: Iraq has claimed that more than 1.5 million people , mostly children and the elderly , have died of curable diseases due to the decade - long U.N. sanctions .

source_bert_toks: iraq has claimed that more than 1 . 5 million people , mostly children and the elderly , have died of cu ##rable diseases due to the decade - long u . n . sanctions .

reference_raw: Iraq argued that more than 1.5 million people, mostly children and older people, died of curable diseases as a result of decade-long UN sanctions.

reference_spacy_tokens: Iraq argued that more than 1.5 million people , mostly children and older people , died of curable diseases as a result of decade - long UN sanctions .


fn_spacy_tokens_for_baseline: ' Well , he can atone for his sins by waiting on you for a few days , ' Jack said laughingly .

source_bert_toks: ' well , he can at ##one for his sins by waiting on you for a few days , ' jack said laughing ##ly .

reference_raw: 'Well, he can undo his sins by waiting a few days for you,' Jack said with a laugh.

reference_spacy_tokens: ' Well , he can undo his sins by waiting a few days for you , ' Jack said with a laugh .


fn_spacy_tokens_for_baseline: In 1904 , the narrow , double - decker trams ran along the waterfront , but land reclamation has placed them far inland .

source_bert_toks: in 1904 , the narrow , double - decker trams ran along the waterfront , but land reclamation has placed them far inland .

reference_raw: In 1904, narrow, double-decker trams ran along the waterfront, but land reclamation had put them far into the interior.

reference_spacy_tokens: In 1904 , narrow , double - decker trams ran along the waterfront , but land reclamation had put them far into the interior .


fn_spacy_tokens_for_baseline: What is the point of only taking what you need and looking after your resources for the future , if they are simply going to be swiped by somebody else ?

source_bert_toks: what is the point of only taking what you need and looking after your resources for the future , if they are simply going to be swiped by somebody else ?

reference_raw: What's the point of just taking what you need and taking care of your resources in the future when someone else is just going to replace them?

reference_spacy_tokens: What 's the point of just taking what you need and taking care of your resources in the future when someone else is just going to replace them ?


fn_spacy_tokens_for_baseline: Rosa 's story contains some of the main themes that we can find in women 's own accounts of their involvement in crime .

source_bert_toks: rosa ' s story contains some of the main themes that we can find in women ' s own accounts of their involvement in crime .

reference_raw: Rosa's story includes some of the most important topics that can be found in women's own accounts of their involvement in crime.

reference_spacy_tokens: Rosa 's story includes some of the most important topics that can be found in women 's own accounts of their involvement in crime .


fn_spacy_tokens_for_baseline: Two years ago , the Rev. Jeremy Hummerstone , vicar of Great Torrington , Devon , got so fed up with ringers who did n't attend service he sacked the entire band ; the ringers promptly set up a picket line in protest .

source_bert_toks: two years ago , the rev . jeremy hum ##mers ##tone , vicar of great tor ##rington , devon , got so fed up with ring ##ers who didn ' t attend service he sacked the entire band ; the ring ##ers promptly set up a picket line in protest .

reference_raw: Two years ago, Reverend Jeremy Hummerstone, the vicar of Great Torrington, Devon, was so fed up with ringers who didn't attend the service that he sacked the whole group; the ringers immediately started a patrol line in protest.

reference_spacy_tokens: Two years ago , Reverend Jeremy Hummerstone , the vicar of Great Torrington , Devon , was so fed up with ringers who did n't attend the service that he sacked the whole group ; the ringers immediately started a patrol line in protest .


fn_spacy_tokens_for_baseline: Another member of the Squadron , air bomber Colin Gifford , remembers Johnson declaring Sugar the best aeroplane on the Squadron after having got him through some violent evasive action one night .

source_bert_toks: another member of the squadron , air bomber colin gifford , remembers johnson declaring sugar the best aero ##plane on the squadron after having got him through some violent eva ##sive action one night .

reference_raw: Another member of the squadron, Air Bomber Colin Gifford, remembers Johnson declaring Sugar to be the best plane on the squadron after one night he'd had a violent evasion.

reference_spacy_tokens: Another member of the squadron , Air Bomber Colin Gifford , remembers Johnson declaring Sugar to be the best plane on the squadron after one night he 'd had a violent evasion .


fn_spacy_tokens_for_baseline: Today Jamaican population is a mixture of African and English , with Spanish , Indian , and a smattering of Portuguese Jews , Germans , Welsh , and Scots .

source_bert_toks: today jamaican population is a mixture of african and english , with spanish , indian , and a sm ##atter ##ing of portuguese jews , germans , welsh , and scots .

reference_raw: The Jamaican population is now a mixture of African and English, with Spanish, Indian, and a mass of Portuguese Jews, Germany, Welsh, and Scotland.

reference_spacy_tokens: The Jamaican population is now a mixture of African and English , with Spanish , Indian , and a mass of Portuguese Jews , Germany , Welsh , and Scotland .


fn_spacy_tokens_for_baseline: It is easier for a horse to evade going correctly because correct work is hard work , requiring effort .

source_bert_toks: it is easier for a horse to evade going correctly because correct work is hard work , requiring effort .

reference_raw: It's easier for a horse to avoid going right, because right work is hard work and it takes effort.

reference_spacy_tokens: It 's easier for a horse to avoid going right , because right work is hard work and it takes effort .


fn_spacy_tokens_for_baseline: In Slovenia a psychiatrist has been advising staff in refugee camps as to how to respond to the needs of traumatised children .

source_bert_toks: in slovenia a psychiatrist has been advising staff in refugee camps as to how to respond to the needs of trauma ##tis ##ed children .

reference_raw: In Slovenia, a psychiatrist advises people in refugee camps on how to respond to the needs of traumatized children.

reference_spacy_tokens: In Slovenia , a psychiatrist advises people in refugee camps on how to respond to the needs of traumatized children .


fn_spacy_tokens_for_baseline: Took him to the station and routine happened -- they had to call the bridewell surgeon and the drunk could call his own doctor , fixing bail and so on .

source_bert_toks: took him to the station and routine happened - - they had to call the bride ##well surgeon and the drunk could call his own doctor , fixing bail and so on .

reference_raw: He took him to the station and there was a routine - a bridewell surgeon had to be called, and a drunk could call his own doctor, get bail, and so on.

reference_spacy_tokens: He took him to the station and there was a routine - a bridewell surgeon had to be called , and a drunk could call his own doctor , get bail , and so on .


fn_spacy_tokens_for_baseline: Crocodiles digest all the mineral matter in bones , leaving the soft organic residues that decay rapidly after being voided by the crocodile .

source_bert_toks: crocodile ##s digest all the mineral matter in bones , leaving the soft organic residues that decay rapidly after being void ##ed by the crocodile .

reference_raw: The crocodiles digest all the minerals in the bones, leaving the soft organic residues which decompose rapidly after the crocodile has been removed.

reference_spacy_tokens: The crocodiles digest all the minerals in the bones , leaving the soft organic residues which decompose rapidly after the crocodile has been removed .


fn_spacy_tokens_for_baseline: Police nabbed the man , who was out on licence from prison , when he returned home .

source_bert_toks: police na ##bbed the man , who was out on licence from prison , when he returned home .

reference_raw: The police gave a name to a man who was out of jail with a license when he came home.

reference_spacy_tokens: The police gave a name to a man who was out of jail with a license when he came home .


fn_spacy_tokens_for_baseline: Between 1951 and 1980 the total area brought under afforestation schemes was 3.18 m ha , and 2.2 m ha ( nearly 70 % ) were plantations for industrial purposes .

source_bert_toks: between 1951 and 1980 the total area brought under af ##for ##est ##ation schemes was 3 . 18 ##m ha , and 2 . 2 ##m ha ( nearly 70 % ) were plantations for industrial purposes .

reference_raw: Between 1951 and 1980, the total land covered by afforestation schemes amounted to 3,18 million hectares and 2.2 million hectares (almost 70 %) were plantations for industrial purposes.

reference_spacy_tokens: Between 1951 and 1980 , the total land covered by afforestation schemes amounted to 3,18 million hectares and 2.2 million hectares ( almost 70 % ) were plantations for industrial purposes .


fn_spacy_tokens_for_baseline: It was still early and the bar seemed strange without voices and laughter and the clink of ice in tall glasses .

source_bert_toks: it was still early and the bar seemed strange without voices and laughter and the cl ##ink of ice in tall glasses .

reference_raw: It was still early, and without voices and laughter and the click of ice in high glasses, the bar seemed strange.

reference_spacy_tokens: It was still early , and without voices and laughter and the click of ice in high glasses , the bar seemed strange .


fn_spacy_tokens_for_baseline: At the end of Mass , Canon Mulvaney presented the Papal Blessing to Mrs Pat Nicholls , chairman , who received it on behalf of the section .

source_bert_toks: at the end of mass , canon mu ##lva ##ney presented the papal blessing to mrs pat nicholls , chairman , who received it on behalf of the section .

reference_raw: At the end of Mass, Canon Mulvaney presented the papal gift to Mrs Pat Nicholls, President, who had received it on behalf of the section.

reference_spacy_tokens: At the end of Mass , Canon Mulvaney presented the papal gift to Mrs Pat Nicholls , President , who had received it on behalf of the section .


fn_spacy_tokens_for_baseline: Graphically the game is top - notch , the character sprites are large and nicely detailed while movement is fluid and looks very believable .

source_bert_toks: graphical ##ly the game is top - notch , the character sp ##rites are large and nicely detailed while movement is fluid and looks very bel ##ie ##vable .

reference_raw: Graphically, the game is first-rate, the character sprites are large and very detailed, while the movement is fluid and very reliable.

reference_spacy_tokens: Graphically , the game is first - rate , the character sprites are large and very detailed , while the movement is fluid and very reliable .


fn_spacy_tokens_for_baseline: Being English , she thought that a sure way of bestowing pleasure on strangers was to compliment them on their dogs .

source_bert_toks: being english , she thought that a sure way of best ##owing pleasure on strangers was to compliment them on their dogs .

reference_raw: Since she was English, she thought the sure way to give pleasure to strangers was to praise their dogs.

reference_spacy_tokens: Since she was English , she thought the sure way to give pleasure to strangers was to praise their dogs .


fn_spacy_tokens_for_baseline: The changes in media ownership since 1945 have been well documented .

source_bert_toks: the changes in media ownership since 1945 have been well documented .

reference_raw: Changes in the possession of the media since 1945 have been well documented.

reference_spacy_tokens: Changes in the possession of the media since 1945 have been well documented .


fn_spacy_tokens_for_baseline: Take it step by step , but do not jab her in the mouth and be FAIR but FIRM .

source_bert_toks: take it step by step , but do not ja ##b her in the mouth and be fair but firm .

reference_raw: Step by step, but don't stab her in the mouth and be FAIR, but FIRM.

reference_spacy_tokens: Step by step , but do n't stab her in the mouth and be FAIR , but FIRM .


fn_spacy_tokens_for_baseline: A few patients in surgical wards are found to have inoperable conditions or conditions for which only palliative surgery can be performed .

source_bert_toks: a few patients in surgical wards are found to have in ##oper ##able conditions or conditions for which only pal ##lia ##tive surgery can be performed .

reference_raw: Several patients in surgery are found to have inoperable conditions or conditions for which only palliatory surgery can be performed.

reference_spacy_tokens: Several patients in surgery are found to have inoperable conditions or conditions for which only palliatory surgery can be performed .


fn_spacy_tokens_for_baseline: Every metric is a pseudo metric .

source_bert_toks: every metric is a pseudo metric .

reference_raw: Each metric is a quasi-metric.

reference_spacy_tokens: Each metric is a quasi - metric .


fn_spacy_tokens_for_baseline: ' The people who live there are dissatisfied , restless and bitter , ' he warned , ' Especially the women -- still girls in a mining camp . '

source_bert_toks: ' the people who live there are dissatisfied , restless and bitter , ' he warned , ' especially the women - - still girls in a mining camp . '

reference_raw: 'The people who live there are unhappy, restless and bitter,' he warned, 'especially the women - they're still girls in the mining camp.'

reference_spacy_tokens: ' The people who live there are unhappy , restless and bitter , ' he warned , ' especially the women - they 're still girls in the mining camp . '


fn_spacy_tokens_for_baseline: Bees and wasps hitch their fore and hind wings together with hooks to make , in effect , a single surface .

source_bert_toks: bees and wasps hitch their fore and hind wings together with hooks to make , in effect , a single surface .

reference_raw: Bees and wasps hit the front and rear wings with hooks to form a single surface.

reference_spacy_tokens: Bees and wasps hit the front and rear wings with hooks to form a single surface .


fn_spacy_tokens_for_baseline: Clive also attended , visibly gleeful that he had spared the school any undesirable publicity by unloading me in the nick of time .

source_bert_toks: clive also attended , visibly glee ##ful that he had spared the school any und ##es ##ira ##ble publicity by un ##loading me in the nick of time .

reference_raw: Clive was also present, obviously pleased that he had spared the school any unwanted publicity by unloading me in the middle of the night.

reference_spacy_tokens: Clive was also present , obviously pleased that he had spared the school any unwanted publicity by unloading me in the middle of the night .


fn_spacy_tokens_for_baseline: The bishops will be prepared to confirm children at a rather younger age so that they may be admitted earlier to the communicant life .

source_bert_toks: the bishops will be prepared to confirm children at a rather younger age so that they may be admitted earlier to the com ##mun ##ica ##nt life .

reference_raw: The bishops will be ready to acknowledge children of a rather younger age so that they can be admitted to communicable life beforehand.

reference_spacy_tokens: The bishops will be ready to acknowledge children of a rather younger age so that they can be admitted to communicable life beforehand .


fn_spacy_tokens_for_baseline: Our total expenditure on research and development in the past year amounted to £ 25.0 million .

source_bert_toks: our total expenditure on research and development in the past year amounted to £2 ##5 . 0 million .

reference_raw: Our overall R&D spending last year was £25.0 million.

reference_spacy_tokens: Our overall R&D spending last year was £ 25.0 million .


fn_spacy_tokens_for_baseline: Auditing of accounts aims to check periodically the adequacy of accounting procedures .

source_bert_toks: audit ##ing of accounts aims to check periodically the ad ##e ##qua ##cy of accounting procedures .

reference_raw: The purpose of the auditing of the accounts is to verify on a regular basis the appropriateness of the accounting procedures.

reference_spacy_tokens: The purpose of the auditing of the accounts is to verify on a regular basis the appropriateness of the accounting procedures .


fn_spacy_tokens_for_baseline: ' It is suggested a letter be sent to each known tobacco retailer giving full details of the law .

source_bert_toks: ' it is suggested a letter be sent to each known tobacco retailer giving full details of the law .

reference_raw: 'It is proposed to send a letter to every known tobacco seller, giving full details of the legislation.

reference_spacy_tokens: ' It is proposed to send a letter to every known tobacco seller , giving full details of the legislation .


fn_spacy_tokens_for_baseline: Nevertheless the chaos which resulted in our schools ( a result of bull - headed intransigence on both sides ) did not suggest professionalism either from politicians or teachers .

source_bert_toks: nevertheless the chaos which resulted in our schools ( a result of bull - headed intra ##ns ##igen ##ce on both sides ) did not suggest professional ##ism either from politicians or teachers .

reference_raw: However, the chaos that led to our schools (due to bullish indifference on both sides) did not suggest professionalism either by politicians or by teachers.

reference_spacy_tokens: However , the chaos that led to our schools ( due to bullish indifference on both sides ) did not suggest professionalism either by politicians or by teachers .


fn_spacy_tokens_for_baseline: Holmes laughed good - humoredly .

source_bert_toks: holmes laughed good - humor ##edly .

reference_raw: Holmes smiled happily.

reference_spacy_tokens: Holmes smiled happily .


fn_spacy_tokens_for_baseline: Philip Hoby , a man of considerable wealth , built today 's fine Tudor residence .

source_bert_toks: philip ho ##by , a man of considerable wealth , built today ' s fine tudor residence .

reference_raw: Philip Hoby, a man of considerable wealth, built today's fine Tudor mansion.

reference_spacy_tokens: Philip Hoby , a man of considerable wealth , built today 's fine Tudor mansion .


fn_spacy_tokens_for_baseline: Part of the answer lies in the unexciting fact that he is prepared to take on the jobs .

source_bert_toks: part of the answer lies in the une ##x ##cit ##ing fact that he is prepared to take on the jobs .

reference_raw: Part of the answer lies in the inexorable fact that he's ready to take over the job.

reference_spacy_tokens: Part of the answer lies in the inexorable fact that he 's ready to take over the job .


fn_spacy_tokens_for_baseline: She then deprived the tsar of the special status he had enjoyed at Constantinople since 1833 .

source_bert_toks: she then deprived the tsar of the special status he had enjoyed at constantinople since 1833 .

reference_raw: Then she stripped the tsar of the special status he had enjoyed in Constantinople since 1833.

reference_spacy_tokens: Then she stripped the tsar of the special status he had enjoyed in Constantinople since 1833 .


fn_spacy_tokens_for_baseline: ' It was a really good energy , ' he avows .

source_bert_toks: ' it was a really good energy , ' he av ##ows .

reference_raw: 'It was very good energy,' he said.

reference_spacy_tokens: ' It was very good energy , ' he said .


fn_spacy_tokens_for_baseline: The lock clicked sharply into place .

source_bert_toks: the lock clicked sharply into place .

reference_raw: The lock snapped in place.

reference_spacy_tokens: The lock snapped in place .


fn_spacy_tokens_for_baseline: ' And Glyn is not amorous .

source_bert_toks: ' and g ##lyn is not amor ##ous .

reference_raw: And Glyn's not funny.

reference_spacy_tokens: And Glyn 's not funny .


fn_spacy_tokens_for_baseline: they 've got to be curious

source_bert_toks: they ' ve got to be curious

reference_raw: they have to be inquisitive

reference_spacy_tokens: they have to be inquisitive


fn_spacy_tokens_for_baseline: The DA had the only two witnesses available -- the two narcotics officers who made the bust .

source_bert_toks: the da had the only two witnesses available - - the two narcotics officers who made the bust .

reference_raw: The D.A. had only two witnesses at his disposal - the two narcotics officers who made the arrest.

reference_spacy_tokens: The D.A. had only two witnesses at his disposal - the two narcotics officers who made the arrest .


fn_spacy_tokens_for_baseline: Before hunting Lele men abstain from sexual intercourse and avoid all contact with menstruating women .

source_bert_toks: before hunting le ##le men abs ##tain from sexual intercourse and avoid all contact with men ##st ##ru ##ating women .

reference_raw: Before hunting Lele men avoid sexual intercourse and avoid contact with menstruating women.

reference_spacy_tokens: Before hunting Lele men avoid sexual intercourse and avoid contact with menstruating women .


fn_spacy_tokens_for_baseline: Its sides consist of silt , washed down from the hills since they were deforested ; pottery - fragments of the Christian era have been found in them , over a metre down .

source_bert_toks: its sides consist of si ##lt , washed down from the hills since they were def ##ores ##ted ; pottery - fragments of the christian era have been found in them , over a metre down .

reference_raw: Its sides are silt that has been washed from the hills since their deforestation; the ceramic fragments of the Christian era have been found in them, more than a meter below.

reference_spacy_tokens: Its sides are silt that has been washed from the hills since their deforestation ; the ceramic fragments of the Christian era have been found in them , more than a meter below .


fn_spacy_tokens_for_baseline: All around fellow diners hushed .

source_bert_toks: all around fellow diner ##s hushed .

reference_raw: All around the other restaurants there was silence.

reference_spacy_tokens: All around the other restaurants there was silence .


fn_spacy_tokens_for_baseline: Covering the brick floor were piles of scrap -- rusty cracked drain pipes , guttering , old kitchen ranges , wooden tubs for oddments , such as nuts and bolts , square wicker baskets that held rabbit skins , cotton , wool , crates into which jam jars were stacked , the variety was endless .

source_bert_toks: covering the brick floor were piles of scrap - - rusty cracked drain pipes , gut ##tering , old kitchen ranges , wooden tub ##s for odd ##ments , such as nuts and bolts , square wi ##cker baskets that held rabbit skins , cotton , wool , crates into which jam jars were stacked , the variety was endless .

reference_raw: The brick floor was littered with scraps - rusty cracked drainpipes, gutters, old kitchen areas, wooden tubs for odds like nuts and bolts, square wicker baskets with rabbit skins, cotton, wool, boxes with jam jars stacked in them, and the variety was infinite.

reference_spacy_tokens: The brick floor was littered with scraps - rusty cracked drainpipes , gutters , old kitchen areas , wooden tubs for odds like nuts and bolts , square wicker baskets with rabbit skins , cotton , wool , boxes with jam jars stacked in them , and the variety was infinite .


fn_spacy_tokens_for_baseline: Otherwise , you 'll miss receiving the new quarterly Chronicle newsletter , the special exhibition opening invitation , a Janus Ball invitation and advance notice of the Visiting Artist lectures and the exciting activities planned to celebrate Herron 's 90 th birthday .

source_bert_toks: otherwise , you ' ll miss receiving the new quarterly chronicle newsletter , the special exhibition opening invitation , a jan ##us ball invitation and advance notice of the visiting artist lectures and the exciting activities planned to celebrate herr ##on ' s 90 th birthday .

reference_raw: Otherwise, you're gonna miss getting a new quarterly Chronicle Newsletter, a special exhibition opening invitation, an invitation to Janus Ball, and an advance notice of visiting artist lectures and exciting activities scheduled to celebrate Herron's 90th birthday.

reference_spacy_tokens: Otherwise , you 're gon na miss getting a new quarterly Chronicle Newsletter , a special exhibition opening invitation , an invitation to Janus Ball , and an advance notice of visiting artist lectures and exciting activities scheduled to celebrate Herron 's 90th birthday .


fn_spacy_tokens_for_baseline: It is of a more than usually splendid birthday party , of jolly music , beer and sausages , goose - stepping , displays of rocket transporters and President Gorbachev saying ( without mentioning his loaded off - the - cuff remarks , or those by his spokesman , Gennady Gerasimov ) all the right things about West German revanchism .

source_bert_toks: it is of a more than usually splendid birthday party , of jolly music , beer and sausage ##s , goose - stepping , displays of rocket transport ##ers and president go ##rba ##chev saying ( without mentioning his loaded off - the - cuff remarks , or those by his spokesman , gen ##nad ##y ge ##ras ##imov ) all the right things about west german rev ##an ##chi ##sm .

reference_raw: It's more than usual a wonderful birthday party, with joyous music, beer and sausages, goose-stepping, displays of rocket carriers, and President Gorbachev saying (without mentioning his overloaded remarks, or those of his spokesman Gennady Gerasimov) all the good things about West German revanchism.

reference_spacy_tokens: It 's more than usual a wonderful birthday party , with joyous music , beer and sausages , goose - stepping , displays of rocket carriers , and President Gorbachev saying ( without mentioning his overloaded remarks , or those of his spokesman Gennady Gerasimov ) all the good things about West German revanchism .


fn_spacy_tokens_for_baseline: It was widely known , however , that China had been pressing for a Japanese imperial visit for some time as a means of marking a further stage in the country 's rehabilitation from the diplomatic isolation which had followed the Tiananmen Square massacre .

source_bert_toks: it was widely known , however , that china had been pressing for a japanese imperial visit for some time as a means of marking a further stage in the country ' s rehabilitation from the diplomatic isolation which had followed the tian ##an ##men square massacre .

reference_raw: But it was widely known that China had urged a Japanese Imperial visit for some time to mark the next stage of the country's recovery from the diplomatic isolation that had followed the massacre in Tiananmen Square.

reference_spacy_tokens: But it was widely known that China had urged a Japanese Imperial visit for some time to mark the next stage of the country 's recovery from the diplomatic isolation that had followed the massacre in Tiananmen Square .


fn_spacy_tokens_for_baseline: The thing bellowed and lowered its head again , rain - water - spume - blood - oil running from its jaws .

source_bert_toks: the thing bellowed and lowered its head again , rain - water - sp ##ume - blood - oil running from its jaws .

reference_raw: The thing roared and lowered its head again, and rain-water oil ran from its jaws.

reference_spacy_tokens: The thing roared and lowered its head again , and rain - water oil ran from its jaws .


fn_spacy_tokens_for_baseline: He produced a packet of cigarettes , and lit up .

source_bert_toks: he produced a packet of cigarettes , and lit up .

reference_raw: He took out a pack of cigarettes and lit it.

reference_spacy_tokens: He took out a pack of cigarettes and lit it .


fn_spacy_tokens_for_baseline: The second , and quite different variety of wrongdoing involves provoking the use of unlawful violence by others , by the use of threats , abuse or insults .

source_bert_toks: the second , and quite different variety of wrong ##do ##ing involves pro ##voking the use of unlawful violence by others , by the use of threats , abuse or insults .

reference_raw: The second, and quite different kinds of misconduct, involves provoking the use of illegal violence by others through threats, abuses or insults.

reference_spacy_tokens: The second , and quite different kinds of misconduct , involves provoking the use of illegal violence by others through threats , abuses or insults .


fn_spacy_tokens_for_baseline: QN : Is the blasting tube visible outside the projectile ?

source_bert_toks: q ##n : is the blasting tube visible outside the projectile ?

reference_raw: QN: Can the blast tube be seen outside the projectile?

reference_spacy_tokens: QN : Can the blast tube be seen outside the projectile ?


fn_spacy_tokens_for_baseline: Talbot listened again , and just before the allotted minute was up , he leaned forward and creased his brow .

source_bert_toks: talbot listened again , and just before the allotted minute was up , he leaned forward and cr ##eased his brow .

reference_raw: Talbot listened again, then leaned forward and wrinkled his forehead just before the assigned minute was up.

reference_spacy_tokens: Talbot listened again , then leaned forward and wrinkled his forehead just before the assigned minute was up .


fn_spacy_tokens_for_baseline: Little can be done without permission -- the same security system which prevents light - fingered customers from making off with the goods , also trains an unblinking eye on the shop - worker .

source_bert_toks: little can be done without permission - - the same security system which prevents light - fingered customers from making off with the goods , also trains an un ##bl ##inking eye on the shop - worker .

reference_raw: Little can be done without permission -- the same security system that prevents light-fingering customers from making goods, and also trains the unblinking eyes of the shopkeeper.

reference_spacy_tokens: Little can be done without permission -- the same security system that prevents light - fingering customers from making goods , and also trains the unblinking eyes of the shopkeeper .


fn_spacy_tokens_for_baseline: Self - gravity would shrink the Sun to a point in a mere 29 minutes , if the outward thermonuclear pressures were absent .

source_bert_toks: self - gravity would shrink the sun to a point in a mere 29 minutes , if the outward the ##rm ##on ##uc ##lea ##r pressures were absent .

reference_raw: Self-gravity would reduce the sun to a point in a mere 29 minutes, if there were no external thermonuclear pressures.

reference_spacy_tokens: Self - gravity would reduce the sun to a point in a mere 29 minutes , if there were no external thermonuclear pressures .


fn_spacy_tokens_for_baseline: Personnel associated with Coast have characterized it as the most sophisticated program of its type outside of the former Soviet Union , but international CBW experts generally consider it to have been considerably less advanced from a scientific standpoint .

source_bert_toks: personnel associated with coast have characterized it as the most sophisticated program of its type outside of the former soviet union , but international cb ##w experts generally consider it to have been considerably less advanced from a scientific stand ##point .

reference_raw: Coast-related staff have described it as the most sophisticated program of its kind outside the former Soviet Union, but international CBW experts generally consider it to be significantly less advanced from a scientific point of view.

reference_spacy_tokens: Coast - related staff have described it as the most sophisticated program of its kind outside the former Soviet Union , but international CBW experts generally consider it to be significantly less advanced from a scientific point of view .


fn_spacy_tokens_for_baseline: Liessa reached up and removed her helmet , letting the coils of red hair tumble out .

source_bert_toks: lies ##sa reached up and removed her helmet , letting the coil ##s of red hair tumble out .

reference_raw: Liessa reached out and took off her helmet, letting the coils of red hair fall out.

reference_spacy_tokens: Liessa reached out and took off her helmet , letting the coils of red hair fall out .


fn_spacy_tokens_for_baseline: Firstly I 'd like to thank your brilliant mag .

source_bert_toks: firstly i ' d like to thank your brilliant mag .

reference_raw: First of all, I'd like to thank your brilliant magician.

reference_spacy_tokens: First of all , I 'd like to thank your brilliant magician .


fn_spacy_tokens_for_baseline: It 's also quiet when they 're in church ( hey , I 'm from the Midwest , OK ? )

source_bert_toks: it ' s also quiet when they ' re in church ( hey , i ' m from the midwest , ok ? )

reference_raw: It's still when they're in church (hey, I'm from the Midwest, okay?)

reference_spacy_tokens: It 's still when they 're in church ( hey , I 'm from the Midwest , okay ? )


fn_spacy_tokens_for_baseline: You need to train the dog to desist from barking excessively .

source_bert_toks: you need to train the dog to des ##ist from barking excessive ##ly .

reference_raw: You have to train a dog to resist barking too much.

reference_spacy_tokens: You have to train a dog to resist barking too much .


fn_spacy_tokens_for_baseline: As the Byzantine Empire weakened at the end of the first millennium , Crusader forces were sent from Western Europe to counter the Muslim forces and retake Jerusalem for the Christian faith .

source_bert_toks: as the byzantine empire weakened at the end of the first millennium , crusader forces were sent from western europe to counter the muslim forces and re ##take jerusalem for the christian faith .

reference_raw: As the Byzantine Empire weakened in the late millennia, crusader forces were sent from Western Europe to fight the Muslim forces and reclaim Jerusalem for the Christian faith.

reference_spacy_tokens: As the Byzantine Empire weakened in the late millennia , crusader forces were sent from Western Europe to fight the Muslim forces and reclaim Jerusalem for the Christian faith .


fn_spacy_tokens_for_baseline: A dapper stranger ( John Berger ) hoves into view and launches into a long , rather tedious yarn about two Italian peasants who meet at a Communist Party dance .

source_bert_toks: a da ##pper stranger ( john berger ) hove ##s into view and launches into a long , rather ted ##ious yarn about two italian peasants who meet at a communist party dance .

reference_raw: The dapper stranger (John Berger) floats in sight and launches into a long, rather boring thread of two Italian peasants who meet at the Communist Party dance.

reference_spacy_tokens: The dapper stranger ( John Berger ) floats in sight and launches into a long , rather boring thread of two Italian peasants who meet at the Communist Party dance .


fn_spacy_tokens_for_baseline: He was held in incommunicado in Bouchoucha Detention Centre for nearly three months , over 70 days beyond the maximum 10-day period allowed by Tunisian law .

source_bert_toks: he was held in inc ##om ##mun ##ica ##do in bo ##uch ##ou ##cha detention centre for nearly three months , over 70 days beyond the maximum 10 - day period allowed by tunisian law .

reference_raw: He was detained at the Bouchoucha Detention Centre in Communicado for almost three months, more than 70 days after the maximum 10-day period allowed by Tunisian law.

reference_spacy_tokens: He was detained at the Bouchoucha Detention Centre in Communicado for almost three months , more than 70 days after the maximum 10-day period allowed by Tunisian law .


fn_spacy_tokens_for_baseline: Wycliffe said to Kersey : ' No mistress for Francis yet ? '

source_bert_toks: w ##y ##cliffe said to ke ##rse ##y : ' no mistress for francis yet ? '

reference_raw: Wycliffe asked Kersey, 'Isn't there a lady for Francis yet?'

reference_spacy_tokens: Wycliffe asked Kersey , ' Is n't there a lady for Francis yet ? '


fn_spacy_tokens_for_baseline: The Union also elects student representatives to sit on the principal decision - making bodies of the University , the Council and Senate , and their major sub - committees .

source_bert_toks: the union also elects student representatives to sit on the principal decision - making bodies of the university , the council and senate , and their major sub - committees .

reference_raw: The Union shall also appoint student representatives to sit on the main decision-making bodies of the University, the Council and the Senate and their main subcommittees.

reference_spacy_tokens: The Union shall also appoint student representatives to sit on the main decision - making bodies of the University , the Council and the Senate and their main subcommittees .


fn_spacy_tokens_for_baseline: Serve with creamy potatoes or boiled rice if you require a more substantial dish .

source_bert_toks: serve with creamy potatoes or boiled rice if you require a more substantial dish .

reference_raw: Serve with creamy potatoes or boiled rice if you need a larger meal.

reference_spacy_tokens: Serve with creamy potatoes or boiled rice if you need a larger meal .


fn_spacy_tokens_for_baseline: ' I did n't fib to Mummy . '

source_bert_toks: ' i didn ' t fi ##b to mummy . '

reference_raw: "I didn't fit in with my mom."

reference_spacy_tokens: " I did n't fit in with my mom . "


fn_spacy_tokens_for_baseline: When frozen , some of these waterfalls can offer ice - climbing practice , but in a hard winter the cloughs often fill with deep snow and their ascents can vary in difficulty from Grade I to impossible .

source_bert_toks: when frozen , some of these waterfalls can offer ice - climbing practice , but in a hard winter the cl ##ough ##s often fill with deep snow and their ascent ##s can vary in difficulty from grade i to impossible .

reference_raw: When frozen, some of these waterfalls may offer ice-climbing practice, but in hard winter, the clouds often fill with deep snow, and their climbs may vary in difficulty from grade I to impossible.

reference_spacy_tokens: When frozen , some of these waterfalls may offer ice - climbing practice , but in hard winter , the clouds often fill with deep snow , and their climbs may vary in difficulty from grade I to impossible .


fn_spacy_tokens_for_baseline: ' All workers are requested to join their places of work at all the oil installations , and all companies are also requested to send their tankers to these oil terminals for oil shipments .

source_bert_toks: ' all workers are requested to join their places of work at all the oil installations , and all companies are also requested to send their tanker ##s to these oil terminals for oil shipments .

reference_raw: 'All workers are asked to join their workplaces in all oil installations, and all companies are also required to send their tankers to these oil terminals for the purpose of transporting oil.

reference_spacy_tokens: ' All workers are asked to join their workplaces in all oil installations , and all companies are also required to send their tankers to these oil terminals for the purpose of transporting oil .


fn_spacy_tokens_for_baseline: A boatload of men came ashore to demand a ransom of 2000 guineas [ £ 2100 ] , or the surrender of the local vicar as a hostage , for not attacking the town .

source_bert_toks: a boat ##load of men came ashore to demand a ransom of 2000 guineas [ £2 ##100 ] , or the surrender of the local vicar as a hostage , for not attacking the town .

reference_raw: A shipload of men came ashore to demand a ransom of 2000 guineas [2100] or a surrender of a local vicar as a hostage for not attacking the city.

reference_spacy_tokens: A shipload of men came ashore to demand a ransom of 2000 guineas [ 2100 ] or a surrender of a local vicar as a hostage for not attacking the city .


fn_spacy_tokens_for_baseline: Mabs is knock - kneed , have you noticed ? '

source_bert_toks: mab ##s is knock - knee ##d , have you noticed ? '

reference_raw: Mabs is on his knees, did you notice?'

reference_spacy_tokens: Mabs is on his knees , did you notice ? '


fn_spacy_tokens_for_baseline: A brash bell rang and Pete swung down from his bunk .

source_bert_toks: a bra ##sh bell rang and pete swung down from his bunk .

reference_raw: The brash bell rang, and Pete bounced off the bunk.

reference_spacy_tokens: The brash bell rang , and Pete bounced off the bunk .


fn_spacy_tokens_for_baseline: The United Nations says Somali gunmen who hijacked a U.N. - chartered vessel carrying food aid for tsunami victims have released the ship after holding it for more than two months .

source_bert_toks: the united nations says somali gunmen who hi ##jack ##ed a u . n . - chartered vessel carrying food aid for tsunami victims have released the ship after holding it for more than two months .

reference_raw: According to the United Nations, Somali gunmen who hijacked a United Nations chartered ship carrying food support to victims of tsunamis released the ship after holding it for more than two months.

reference_spacy_tokens: According to the United Nations , Somali gunmen who hijacked a United Nations chartered ship carrying food support to victims of tsunamis released the ship after holding it for more than two months .


fn_spacy_tokens_for_baseline: The river forms a natural line between the north and south sections of the city .

source_bert_toks: the river forms a natural line between the north and south sections of the city .

reference_raw: The river is a natural line between the northern and southern parts of the city.

reference_spacy_tokens: The river is a natural line between the northern and southern parts of the city .


fn_spacy_tokens_for_baseline: If there are recesses for items like washing machines and dishwashers , be sure to remove these to allow you to tile right back to the wall .

source_bert_toks: if there are recess ##es for items like washing machines and dish ##wash ##ers , be sure to remove these to allow you to tile right back to the wall .

reference_raw: If there are breaks for items such as washing machines and dishwashers, make sure to remove them so that you can tilt back to the wall.

reference_spacy_tokens: If there are breaks for items such as washing machines and dishwashers , make sure to remove them so that you can tilt back to the wall .


fn_spacy_tokens_for_baseline: The diplomacy which must have preceded this match , and Cnut 's desire for it , imply worries about Robert 's attitude which were to prove well founded .

source_bert_toks: the diplomacy which must have preceded this match , and cn ##ut ' s desire for it , imply worries about robert ' s attitude which were to prove well founded .

reference_raw: The diplomacy that had to come before the match, and Cnut's desire for it, meant concern for Robert's attitude, which would prove to be well-founded.

reference_spacy_tokens: The diplomacy that had to come before the match , and Cnut 's desire for it , meant concern for Robert 's attitude , which would prove to be well - founded .


fn_spacy_tokens_for_baseline: The 9 others in the dock face a combination of charges ranging from conspiracy to pervert the course of justice to assault .

source_bert_toks: the 9 others in the dock face a combination of charges ranging from conspiracy to per ##vert the course of justice to assault .

reference_raw: The other nine at the docks face a combination of charges ranging from conspiring to perverting the course of justice to attacking.

reference_spacy_tokens: The other nine at the docks face a combination of charges ranging from conspiring to perverting the course of justice to attacking .


fn_spacy_tokens_for_baseline: But the acme of scientific voyages was that of HMS Challenger .

source_bert_toks: but the ac ##me of scientific voyages was that of hms challenger .

reference_raw: But the number of scientific voyages was HMS Challenger's.

reference_spacy_tokens: But the number of scientific voyages was HMS Challenger 's .


fn_spacy_tokens_for_baseline: ' They had already lost one boat , their clothes were in rags , and all they had to eat was mouldy flour and a few dried apples .

source_bert_toks: ' they had already lost one boat , their clothes were in rags , and all they had to eat was mo ##uld ##y flour and a few dried apples .

reference_raw: They'd lost a boat, their clothes were in rags, and all they had to eat was moldy flour and a couple of dried orbs.

reference_spacy_tokens: They 'd lost a boat , their clothes were in rags , and all they had to eat was moldy flour and a couple of dried orbs .


fn_spacy_tokens_for_baseline: Sherds of such pottery have been found on sites along the eastern seaboard of the United States , including Florida , the Caribbean islands and parts of South America such as Venezuela .

source_bert_toks: she ##rds of such pottery have been found on sites along the eastern sea ##board of the united states , including florida , the caribbean islands and parts of south america such as venezuela .

reference_raw: Herds of such pottery were found in locations along the eastern coast of the United States, including Florida, Caribbean islands and parts of South America, such as Venezuela.

reference_spacy_tokens: Herds of such pottery were found in locations along the eastern coast of the United States , including Florida , Caribbean islands and parts of South America , such as Venezuela .


fn_spacy_tokens_for_baseline: One of the marks of a competent lawyer is his ability to know what gaps there are in the facts of his case .

source_bert_toks: one of the marks of a competent lawyer is his ability to know what gaps there are in the facts of his case .

reference_raw: One of the marks of a competent lawyer is that he has the ability to identify the gaps in the facts.

reference_spacy_tokens: One of the marks of a competent lawyer is that he has the ability to identify the gaps in the facts .


fn_spacy_tokens_for_baseline: Vi stared into the mirror , tweaking her tie straight .

source_bert_toks: vi stared into the mirror , t ##we ##aking her tie straight .

reference_raw: Vi looked in the mirror and pulled her tie straight.

reference_spacy_tokens: Vi looked in the mirror and pulled her tie straight .


fn_spacy_tokens_for_baseline: Nor , said Thomas Gisborne in 1795 , must he himself disdain to borrow money at the appropriate moment if he is not to put his credit to real and serious hazard .

source_bert_toks: nor , said thomas gi ##sb ##orne in 1795 , must he himself disdain to borrow money at the appropriate moment if he is not to put his credit to real and serious hazard .

reference_raw: Nor, said Thomas Gisborne in 1795, does he have to despise himself for borrowing money at the right time, unless he puts his credit in real and serious danger.

reference_spacy_tokens: Nor , said Thomas Gisborne in 1795 , does he have to despise himself for borrowing money at the right time , unless he puts his credit in real and serious danger .


fn_spacy_tokens_for_baseline: ANEW portrait of Jesse Jackson , showing him as a blond , blue - eyed white man , attracted more than aesthetic interest when it was displayed on a Washington street corner last Wednesday .

source_bert_toks: an ##ew portrait of jesse jackson , showing him as a blond , blue - eyed white man , attracted more than aesthetic interest when it was displayed on a washington street corner last wednesday .

reference_raw: The new portrait of Jesse Jackson, which showed him as a blond white man with blue eyes, attracted more than aesthetic interest when it appeared on the corner of Washington Street last Wednesday.

reference_spacy_tokens: The new portrait of Jesse Jackson , which showed him as a blond white man with blue eyes , attracted more than aesthetic interest when it appeared on the corner of Washington Street last Wednesday .


fn_spacy_tokens_for_baseline: But his acceptance of a hypothetical possibility had n't prepared him for the shock of contact with cold reality , and for her brazen admission that she was cheating , deceiving him .

source_bert_toks: but his acceptance of a hypothetical possibility hadn ' t prepared him for the shock of contact with cold reality , and for her bra ##zen admission that she was cheating , dec ##ei ##ving him .

reference_raw: But his acceptance of the hypothetical possibility did not prepare him for the shock of contact with the cold reality, or for her shameless admittance that she had deceived him and deceived him.

reference_spacy_tokens: But his acceptance of the hypothetical possibility did not prepare him for the shock of contact with the cold reality , or for her shameless admittance that she had deceived him and deceived him .


fn_spacy_tokens_for_baseline: Though it may snack on a strawberry , the ground beetle is an ally

source_bert_toks: though it may snack on a strawberry , the ground beetle is an ally

reference_raw: Although a strawberry can be eaten, a ground bug is an ally

reference_spacy_tokens: Although a strawberry can be eaten , a ground bug is an ally


fn_spacy_tokens_for_baseline: What was once a sure thing became much more competitive .

source_bert_toks: what was once a sure thing became much more competitive .

reference_raw: What had once been a certain thing had become very competitive.

reference_spacy_tokens: What had once been a certain thing had become very competitive .


fn_spacy_tokens_for_baseline: Tom Gibson collected the glittering prizes , but he undervalued his contribution to his own area of medicine .

source_bert_toks: tom gibson collected the glittering prizes , but he under ##val ##ue ##d his contribution to his own area of medicine .

reference_raw: Tom Gibson picked up sparkling awards, but underestimated his contribution to his medical field.

reference_spacy_tokens: Tom Gibson picked up sparkling awards , but underestimated his contribution to his medical field .


fn_spacy_tokens_for_baseline: In other words : ' As an important chap from England , I know better . '

source_bert_toks: in other words : ' as an important cha ##p from england , i know better . '

reference_raw: In other words, "I know better as an important man from England."

reference_spacy_tokens: In other words , " I know better as an important man from England . "


fn_spacy_tokens_for_baseline: A horse skidded on ice , whinnying loudly as it fell to its side .

source_bert_toks: a horse ski ##dded on ice , w ##hin ##ny ##ing loudly as it fell to its side .

reference_raw: The horse skidded on the ice, whining loudly as it fell to its side.

reference_spacy_tokens: The horse skidded on the ice , whining loudly as it fell to its side .


fn_spacy_tokens_for_baseline: That would be a disaster for the rest of the country .

source_bert_toks: that would be a disaster for the rest of the country .

reference_raw: It would be disastrous for the rest of the country.

reference_spacy_tokens: It would be disastrous for the rest of the country .


fn_spacy_tokens_for_baseline: Mr Najibullah , many of his key ministers , elite units of the Afghan army and most of the Pakistan - based Mujahideen groups are members of the Pushtun tribes which have dominated Afghanistan for 200 years .

source_bert_toks: mr na ##ji ##bu ##llah , many of his key ministers , elite units of the afghan army and most of the pakistan - based mu ##jah ##ide ##en groups are members of the push ##tu ##n tribes which have dominated afghanistan for 200 years .

reference_raw: Mr. Najibullah, many of his key ministers, elite units of the Afghan army, and most of the Pakistani-based Mujahideens are members of the Pushtun tribes that have ruled Afghanistan for 200 years.

reference_spacy_tokens: Mr. Najibullah , many of his key ministers , elite units of the Afghan army , and most of the Pakistani - based Mujahideens are members of the Pushtun tribes that have ruled Afghanistan for 200 years .


fn_spacy_tokens_for_baseline: ' Unix Lite would have been okay four years ago , but with the performance and memory capacity of today 's machines -- and their future potential -- we do n't need cut - down Unix .

source_bert_toks: ' unix lit ##e would have been okay four years ago , but with the performance and memory capacity of today ' s machines - - and their future potential - - we don ' t need cut - down unix .

reference_raw: 'Unix Lite would have been fine four years ago, but with the power and memory capabilities of today's machines - and their future potential - we don't need to cut off Unix.

reference_spacy_tokens: ' Unix Lite would have been fine four years ago , but with the power and memory capabilities of today 's machines - and their future potential - we do n't need to cut off Unix .


fn_spacy_tokens_for_baseline: Camels operate each foreleg and its associated hindleg in unison , more like a pantomime horse than a regular quadruped .

source_bert_toks: camel ##s operate each fore ##leg and its associated hind ##leg in unison , more like a pan ##tom ##ime horse than a regular quad ##rup ##ed .

reference_raw: The camels operate each front leg and the associated hind leg in unison, more like a pantomime horse than a normal quadruped horse.

reference_spacy_tokens: The camels operate each front leg and the associated hind leg in unison , more like a pantomime horse than a normal quadruped horse .


fn_spacy_tokens_for_baseline: But Arnold Thomas smelled a bigger profit from the up - and - coming developers who were looking to build back - to - backs for the mill - workers .

source_bert_toks: but arnold thomas smelled a bigger profit from the up - and - coming developers who were looking to build back - to - backs for the mill - workers .

reference_raw: But Arnold Thomas felt more profit from future developers who wanted to build back-to-back for millworkers.

reference_spacy_tokens: But Arnold Thomas felt more profit from future developers who wanted to build back - to - back for millworkers .


fn_spacy_tokens_for_baseline: Elke has laid the table for the evening meal and fried the eggs .

source_bert_toks: elk ##e has laid the table for the evening meal and fried the eggs .

reference_raw: Elke laid down a table for dinner and roasted the eggs.

reference_spacy_tokens: Elke laid down a table for dinner and roasted the eggs .


fn_spacy_tokens_for_baseline: The only sites where some time dependence of the blockages was apparent was for those derivatives with a pendant intercalator ( 2 , 3 , 5 and 6 ; Figures 2 and 3 ) .

source_bert_toks: the only sites where some time dependence of the block ##ages was apparent was for those derivatives with a pendant inter ##cala ##tor ( 2 , 3 , 5 and 6 ; figures 2 and 3 ) .

reference_raw: For those derivatives with a pendant intercalator (2, 3, 5 and 6; Figures 2 and 3), the only places where a certain time dependency of the blockages was apparent.

reference_spacy_tokens: For those derivatives with a pendant intercalator ( 2 , 3 , 5 and 6 ; Figures 2 and 3 ) , the only places where a certain time dependency of the blockages was apparent .


fn_spacy_tokens_for_baseline: Miss Logan did not break her alarmed silence ; she merely followed her employer who was pushing on ahead up a gully of rock .

source_bert_toks: miss logan did not break her alarmed silence ; she merely followed her employer who was pushing on ahead up a gu ##lly of rock .

reference_raw: Miss Logan didn't break her alarmed silence; she simply followed her employer, who was pushing ahead through the rock ravine.

reference_spacy_tokens: Miss Logan did n't break her alarmed silence ; she simply followed her employer , who was pushing ahead through the rock ravine .


fn_spacy_tokens_for_baseline: Westminster City Council community liaison officer David Tan set up a training session last week , with a Cantonese interpreter at the Man Fu Kung restaurant in London 's Leicester Square .

source_bert_toks: westminster city council community liaison officer david tan set up a training session last week , with a cantonese interpreter at the man fu kung restaurant in london ' s leicester square .

reference_raw: Westminster City Council liaison officer David Tan started a training session last week with a Cantonese interpreter at the Man Fu Kung restaurant in Leicester Square in London.

reference_spacy_tokens: Westminster City Council liaison officer David Tan started a training session last week with a Cantonese interpreter at the Man Fu Kung restaurant in Leicester Square in London .


fn_spacy_tokens_for_baseline: Police have used articles in the penal code to back up arrests of journalists critical of the government and to disable printing presses .

source_bert_toks: police have used articles in the penal code to back up arrests of journalists critical of the government and to di ##sable printing presses .

reference_raw: The police used articles in the Criminal Code to support arrests of journalists critical of the government and to deactivate printing presses.

reference_spacy_tokens: The police used articles in the Criminal Code to support arrests of journalists critical of the government and to deactivate printing presses .


fn_spacy_tokens_for_baseline: Rachaela looked flustered , apologized , and fished the extra note out of the till .

source_bert_toks: ra ##cha ##ela looked flu ##stered , apologized , and fished the extra note out of the till .

reference_raw: Rachaela looked disappointed, apologized, and fished out an extra note from the cash register.

reference_spacy_tokens: Rachaela looked disappointed , apologized , and fished out an extra note from the cash register .


fn_spacy_tokens_for_baseline: At which point two other giant rats sprang from the lower part of the building , jaws agape , and flung themselves at her .

source_bert_toks: at which point two other giant rats sprang from the lower part of the building , jaws ag ##ape , and flung themselves at her .

reference_raw: At that moment, two other giant rats leapt out of the lower part of the building, jaws open, and threw themselves at her.

reference_spacy_tokens: At that moment , two other giant rats leapt out of the lower part of the building , jaws open , and threw themselves at her .


fn_spacy_tokens_for_baseline: Now we were approaching a steep ravine .

source_bert_toks: now we were approaching a steep ravine .

reference_raw: Now we were approaching a steep gorge.

reference_spacy_tokens: Now we were approaching a steep gorge .


fn_spacy_tokens_for_baseline: For whereas in subject matter and perspective those lectures clearly prefigure the final work , stylistically they still bear some of the marks of academic decorum from which BT is entirely removed .

source_bert_toks: for whereas in subject matter and perspective those lectures clearly pre ##fi ##gur ##e the final work , stylistic ##ally they still bear some of the marks of academic decor ##um from which bt is entirely removed .

reference_raw: While, in terms of the subject-matter and perspective, these lectures clearly precede the final work, they remain stylistically marked with a certain degree of academic decorum from which BT is completely removed.

reference_spacy_tokens: While , in terms of the subject - matter and perspective , these lectures clearly precede the final work , they remain stylistically marked with a certain degree of academic decorum from which BT is completely removed .


fn_spacy_tokens_for_baseline: ' Stew very slowly one quart of green gooseberries with half a pound of white sugar and enough water to prevent fruit from burning .

source_bert_toks: ' stew very slowly one qu ##art of green goose ##berries with half a pound of white sugar and enough water to prevent fruit from burning .

reference_raw: 'Stew very slowly one litre of green gooseberries with half a kilo of white sugar and enough water to keep the fruit from burning.

reference_spacy_tokens: ' Stew very slowly one litre of green gooseberries with half a kilo of white sugar and enough water to keep the fruit from burning .


fn_spacy_tokens_for_baseline: ' It 's possible he is a manual worker as he has quite strong forearms .

source_bert_toks: ' it ' s possible he is a manual worker as he has quite strong forearms .

reference_raw: 'It's possible he's a manual worker because he's got pretty strong arms.

reference_spacy_tokens: ' It 's possible he 's a manual worker because he 's got pretty strong arms .


fn_spacy_tokens_for_baseline: Parents do not want trendy socio - economic arguments about why their school is not as good as another .

source_bert_toks: parents do not want trend ##y socio - economic arguments about why their school is not as good as another .

reference_raw: Parents don't want trendy socio-economic reasoning about why their school isn't as good as the rest of them.

reference_spacy_tokens: Parents do n't want trendy socio - economic reasoning about why their school is n't as good as the rest of them .


fn_spacy_tokens_for_baseline: Good education is not cheap , as we have already found , and meeting the ideals of the General Medical Council is more costly and time consuming than older methods of medical education .

source_bert_toks: good education is not cheap , as we have already found , and meeting the ideals of the general medical council is more costly and time consuming than older methods of medical education .

reference_raw: As we have seen, good education is not cheap, and meeting the ideals of the General Medical Council is more expensive and time-consuming than older medical training methods.

reference_spacy_tokens: As we have seen , good education is not cheap , and meeting the ideals of the General Medical Council is more expensive and time - consuming than older medical training methods .


fn_spacy_tokens_for_baseline: The walls had been panelled in varnished oak .

source_bert_toks: the walls had been panel ##led in var ##nished oak .

reference_raw: The walls were lined with varnished oak.

reference_spacy_tokens: The walls were lined with varnished oak .


fn_spacy_tokens_for_baseline: A MAN was shot twice yesterday as he fled from five masked youths .

source_bert_toks: a man was shot twice yesterday as he fled from five masked youths .

reference_raw: Yesterday, a man was shot twice when he escaped from five masked young men.

reference_spacy_tokens: Yesterday , a man was shot twice when he escaped from five masked young men .


fn_spacy_tokens_for_baseline: Next to Chez Panisse a homeless couple , bundled into a blue sleeping bag , sat up , said , " Good morning " and then the woman smiled , said , " Is n't it great just to be alive ? " I agreed .

source_bert_toks: next to che ##z pan ##isse a homeless couple , bundled into a blue sleeping bag , sat up , said , " good morning " and then the woman smiled , said , " isn ' t it great just to be alive ? " i agreed .

reference_raw: Beside Chez Panissa, a pair of homeless men, wrapped in a blue sleeping bag, sat down and said, "Good morning," and then she smiled and said, "Isn't it good to be alive?" I said.

reference_spacy_tokens: Beside Chez Panissa , a pair of homeless men , wrapped in a blue sleeping bag , sat down and said , " Good morning , " and then she smiled and said , " Is n't it good to be alive ? " I said .


fn_spacy_tokens_for_baseline: Fears were expressed by puritan divines that to thirst after natural knowledge was to run the risk of elevating reason at the expense of faith .

source_bert_toks: fears were expressed by pu ##ritan divine ##s that to thirst after natural knowledge was to run the risk of el ##eva ##ting reason at the expense of faith .

reference_raw: The puritan gods expressed fear that thirsty after natural knowledge would risk raising reason at the expense of faith.

reference_spacy_tokens: The puritan gods expressed fear that thirsty after natural knowledge would risk raising reason at the expense of faith .


fn_spacy_tokens_for_baseline: It was possible that even a reject like him could be of use in such a godforsaken spot .

source_bert_toks: it was possible that even a reject like him could be of use in such a god ##for ##sa ##ken spot .

reference_raw: It was possible that even a reject like him could be useful in a place like this.

reference_spacy_tokens: It was possible that even a reject like him could be useful in a place like this .


fn_spacy_tokens_for_baseline: The Japan Times reported that the Japan Chamber of Commerce and Industry had called on the government for a bailout " for small- and medium - sized companies , which have been hit especially hard by the prolonged economic slump . "

source_bert_toks: the japan times reported that the japan chamber of commerce and industry had called on the government for a bail ##out " for small - and medium - sized companies , which have been hit especially hard by the prolonged economic slump . "

reference_raw: The Japanese Times reported that the Japanese Chamber of Commerce and Industry called on the government to rescue "small and medium-sized companies that were particularly affected by the long economic downturn."

reference_spacy_tokens: The Japanese Times reported that the Japanese Chamber of Commerce and Industry called on the government to rescue " small and medium - sized companies that were particularly affected by the long economic downturn . "


fn_spacy_tokens_for_baseline: I also deeply sympathized with George because Lennie had practically spoiled his life yet George never seemed to complain .

source_bert_toks: i also deeply sy ##mp ##athi ##zed with george because len ##nie had practically spoiled his life yet george never seemed to complain .

reference_raw: I also felt a deep sympathy for George, for Lennie had practically ruined his life, but George didn't seem to complain.

reference_spacy_tokens: I also felt a deep sympathy for George , for Lennie had practically ruined his life , but George did n't seem to complain .


fn_spacy_tokens_for_baseline: Lead coffins were very rare in colonial America , and could only be afforded by the very rich .

source_bert_toks: lead coffin ##s were very rare in colonial america , and could only be afforded by the very rich .

reference_raw: In colonial America, lead caskets were very rare, and only the very rich could afford them.

reference_spacy_tokens: In colonial America , lead caskets were very rare , and only the very rich could afford them .


fn_spacy_tokens_for_baseline: And the reason we do n't want to is that effective education would require us to relinquish some cherished metaphysical beliefs about human nature in general and the human nature of young people in particular , as well as to violate some cherished vested interests .

source_bert_toks: and the reason we don ' t want to is that effective education would require us to re ##lin ##qui ##sh some cher ##ished metaphysical beliefs about human nature in general and the human nature of young people in particular , as well as to violate some cher ##ished vested interests .

reference_raw: And the reason we don't want to do that is because effective education would require us to give up some of our cherished metaphysical beliefs about human nature in general and the human nature of young people in particular, and to violate some of our cherished vested interests.

reference_spacy_tokens: And the reason we do n't want to do that is because effective education would require us to give up some of our cherished metaphysical beliefs about human nature in general and the human nature of young people in particular , and to violate some of our cherished vested interests .


fn_spacy_tokens_for_baseline: It 's in my mind , grandfather , that Lachlan may rue the day he called in on Marion Aluinn again ! '

source_bert_toks: it ' s in my mind , grandfather , that lac ##hl ##an may rue the day he called in on marion al ##uin ##n again ! '

reference_raw: I think, Grandfather, that Lachlan might regret the day he called Marion Aluinn again!'

reference_spacy_tokens: I think , Grandfather , that Lachlan might regret the day he called Marion Aluinn again ! '


fn_spacy_tokens_for_baseline: This is partly because of Marx 's strictures on Utopian socialism .

source_bert_toks: this is partly because of marx ' s strict ##ures on utopia ##n socialism .

reference_raw: This is partly due to Marx's adherence to Utopian socialism.

reference_spacy_tokens: This is partly due to Marx 's adherence to Utopian socialism .


fn_spacy_tokens_for_baseline: Flor gets off to an impressive start ; the terraced dynamics and tempi of the opening section are brooding and solid , with deep , ruminative phrasing from the Concertgebouw basses .

source_bert_toks: fl ##or gets off to an impressive start ; the terrace ##d dynamics and te ##mp ##i of the opening section are brooding and solid , with deep , rum ##ina ##tive ph ##ras ##ing from the concert ##ge ##bo ##uw bass ##es .

reference_raw: Flor rises to an impressive start; the terraced dynamism and tempi of the opening section are brooding and solid, with a deep, ruminative line from the Concertgebouw bass.

reference_spacy_tokens: Flor rises to an impressive start ; the terraced dynamism and tempi of the opening section are brooding and solid , with a deep , ruminative line from the Concertgebouw bass .


fn_spacy_tokens_for_baseline: A four - mile path meanders round the lake in the centre of the park ; our project was to lay red shale on a popular and consequently very worn stretch along the north side .

source_bert_toks: a four - mile path mean ##ders round the lake in the centre of the park ; our project was to lay red shale on a popular and consequently very worn stretch along the north side .

reference_raw: The four-mile path means around the lake in the middle of the park; our project was to lay red slate on a popular and therefore very worn stretch on the north side.

reference_spacy_tokens: The four - mile path means around the lake in the middle of the park ; our project was to lay red slate on a popular and therefore very worn stretch on the north side .


fn_spacy_tokens_for_baseline: Crystal chandeliers glittered brightly above a marble floor ; a quartet of musicians played music -- real music , Nicolo thought , incongruously , not the brain - frying stuff they 'd played during the fashion show .

source_bert_toks: crystal chan ##del ##iers glitter ##ed brightly above a marble floor ; a quartet of musicians played music - - real music , nico ##lo thought , inc ##ong ##ru ##ously , not the brain - fry ##ing stuff they ' d played during the fashion show .

reference_raw: The crystal chandeliers glittered brightly above the marble floor; the four musicians were playing music -- real music, Nicole thought uncomfortably, not the brain-frying things they had played during the fashion show.

reference_spacy_tokens: The crystal chandeliers glittered brightly above the marble floor ; the four musicians were playing music -- real music , Nicole thought uncomfortably , not the brain - frying things they had played during the fashion show .


fn_spacy_tokens_for_baseline: To Leonard , who long had felt the masterful power of passion -- when the guests become tyrants -- Layton 's honesty was as refreshing as his candour was liberating .

source_bert_toks: to leonard , who long had felt the master ##ful power of passion - - when the guests become tyrant ##s - - layton ' s honesty was as refreshing as his can ##dou ##r was li ##ber ##ating .

reference_raw: For Leonard, who had long felt the masterful power of passion-when the guests became tyrants-Layton's sincerity was as refreshing as his honesty freed him.

reference_spacy_tokens: For Leonard , who had long felt the masterful power of passion - when the guests became tyrants - Layton 's sincerity was as refreshing as his honesty freed him .


fn_spacy_tokens_for_baseline: Some of these lorikeets have small bills that are capable only of pinching the skin of human handlers , while other species can easily draw blood and even splinter wood .

source_bert_toks: some of these lori ##kee ##ts have small bills that are capable only of pinch ##ing the skin of human handler ##s , while other species can easily draw blood and even splinter wood .

reference_raw: Some of these lorikeets have small bills that can only pinch the skin of human handlers, while others can easily draw blood and even split wood.

reference_spacy_tokens: Some of these lorikeets have small bills that can only pinch the skin of human handlers , while others can easily draw blood and even split wood .


fn_spacy_tokens_for_baseline: FARMER 'S wife Mary Watson drowned herself when she heard her husband had only six months to live .

source_bert_toks: farmer ' s wife mary watson drowned herself when she heard her husband had only six months to live .

reference_raw: Farmer's wife, Mary Watson, died when she heard that her husband had only six months to live.

reference_spacy_tokens: Farmer 's wife , Mary Watson , died when she heard that her husband had only six months to live .


fn_spacy_tokens_for_baseline: His plimsolls were now caked in heavy clods of wet earth and his jersey was already wet from his soaked mackintosh .

source_bert_toks: his pl ##im ##sol ##ls were now cake ##d in heavy cl ##ods of wet earth and his jersey was already wet from his soaked mack ##int ##osh .

reference_raw: His plimsolls were now covered with heavy clots of wet ground, and his uniform was already wet from his wet mackintosh.

reference_spacy_tokens: His plimsolls were now covered with heavy clots of wet ground , and his uniform was already wet from his wet mackintosh .


fn_spacy_tokens_for_baseline: The priest wore a cowl over his head .

source_bert_toks: the priest wore a cow ##l over his head .

reference_raw: The priest was wearing a hood.

reference_spacy_tokens: The priest was wearing a hood .


fn_spacy_tokens_for_baseline: 5- Cars parked inside the location should have their front facing the fence so they could be used quickly in case of emergency .

source_bert_toks: 5 - cars parked inside the location should have their front facing the fence so they could be used quickly in case of emergency .

reference_raw: 5-Cars parked in a position should have their front facing the fence so that they can be used quickly in the event of an emergency.

reference_spacy_tokens: 5-Cars parked in a position should have their front facing the fence so that they can be used quickly in the event of an emergency .


fn_spacy_tokens_for_baseline: The only way to redeem yourself is to check into a rehab clinic , suffer the torments of the damned and make a final public confession of your sins .

source_bert_toks: the only way to red ##eem yourself is to check into a rehab clinic , suffer the torment ##s of the damned and make a final public confession of your sins .

reference_raw: The only way to redeem yourself is to go to a rehab clinic, suffer the torments of the damned, and confess your sins to the public one last time.

reference_spacy_tokens: The only way to redeem yourself is to go to a rehab clinic , suffer the torments of the damned , and confess your sins to the public one last time .


fn_spacy_tokens_for_baseline: Entities and models can be considered as elements within the set that describes their assembly , and each of these geometric entities is considered to lie within a local space .

source_bert_toks: entities and models can be considered as elements within the set that describes their assembly , and each of these geometric entities is considered to lie within a local space .

reference_raw: Entities and models may be considered as elements in a set that describes their assemblies, and each of these geometric entities shall be deemed to be located in a local space.

reference_spacy_tokens: Entities and models may be considered as elements in a set that describes their assemblies , and each of these geometric entities shall be deemed to be located in a local space .


fn_spacy_tokens_for_baseline: In Difficulties with girls there are passages which recall that lift of the old proud head .

source_bert_toks: in difficulties with girls there are passages which recall that lift of the old proud head .

reference_raw: There are passages in trouble with girls that remember the lift of an old proud head.

reference_spacy_tokens: There are passages in trouble with girls that remember the lift of an old proud head .


fn_spacy_tokens_for_baseline: Similar questions arose in Marcel v Commissioner of Police ( 1991 ) 2 WLR 1118 , where the police had seized documents from people connected with a company .

source_bert_toks: similar questions arose in marcel v commissioner of police ( 1991 ) 2 w ##lr 111 ##8 , where the police had seized documents from people connected with a company .

reference_raw: Similar questions arose in Marcel v Police Commissioner (1991) 2 WLR 1118, in which the police confiscated documents from persons related to the company.

reference_spacy_tokens: Similar questions arose in Marcel v Police Commissioner ( 1991 ) 2 WLR 1118 , in which the police confiscated documents from persons related to the company .


fn_spacy_tokens_for_baseline: Transgressors would see the enormous snake bearing down on them , so they would break camp and attempt to hide in water holes or caverns .

source_bert_toks: trans ##gre ##sso ##rs would see the enormous snake bearing down on them , so they would break camp and attempt to hide in water holes or cavern ##s .

reference_raw: The transgressors would see a giant snake bearing down on them, and they would break the camp and try to hide in water holes or caves.

reference_spacy_tokens: The transgressors would see a giant snake bearing down on them , and they would break the camp and try to hide in water holes or caves .


fn_spacy_tokens_for_baseline: Russell 's screenplay is full of announced sympathy for ordinary people 's lives , and actual condescension .

source_bert_toks: russell ' s screenplay is full of announced sympathy for ordinary people ' s lives , and actual conde ##sc ##ens ##ion .

reference_raw: Russell's script is filled with announced sympathy for the lives of ordinary people and a true condescension.

reference_spacy_tokens: Russell 's script is filled with announced sympathy for the lives of ordinary people and a true condescension .


fn_spacy_tokens_for_baseline: John Surtees kept the British flag flying in 1964 , before Clark won his second title a year later .

source_bert_toks: john sur ##tees kept the british flag flying in 1964 , before clark won his second title a year later .

reference_raw: John Surtees had the British flag flying in 1964 before Clark won his second degree a year later.

reference_spacy_tokens: John Surtees had the British flag flying in 1964 before Clark won his second degree a year later .


fn_spacy_tokens_for_baseline: Today , we serve children and families with a multitude of problems : emotional , physical , psychological and sexual abuse .

source_bert_toks: today , we serve children and families with a multitude of problems : emotional , physical , psychological and sexual abuse .

reference_raw: Today we serve children and families with many problems: emotional, physical, psychological and sexual violence.

reference_spacy_tokens: Today we serve children and families with many problems : emotional , physical , psychological and sexual violence .


fn_spacy_tokens_for_baseline: They suffered the heartbreak of losing three children through premature births .

source_bert_toks: they suffered the heartbreak of losing three children through premature births .

reference_raw: They suffered a heart attack from the loss of three children due to premature birth.

reference_spacy_tokens: They suffered a heart attack from the loss of three children due to premature birth .


fn_spacy_tokens_for_baseline: ' Give me a pen , ' asked the bully with a scowl .

source_bert_toks: ' give me a pen , ' asked the bully with a scowl .

reference_raw: "Give me a pen," the tyrant said, frowning.

reference_spacy_tokens: " Give me a pen , " the tyrant said , frowning .


fn_spacy_tokens_for_baseline: Make your case crisply and succinctly , comprehensively but not exhaustively .

source_bert_toks: make your case crisp ##ly and su ##cci ##nc ##tly , comprehensive ##ly but not exhaust ##ively .

reference_raw: Make it crisp and brief, comprehensive but not exhaustive.

reference_spacy_tokens: Make it crisp and brief , comprehensive but not exhaustive .


fn_spacy_tokens_for_baseline: Other Asian officials attending the preparatory meeting here agreed .

source_bert_toks: other asian officials attending the preparatory meeting here agreed .

reference_raw: Other Asian officials attending the prep meeting agreed to this meeting.

reference_spacy_tokens: Other Asian officials attending the prep meeting agreed to this meeting .


fn_spacy_tokens_for_baseline: To keep a horse clean you need to groom it .

source_bert_toks: to keep a horse clean you need to groom it .

reference_raw: If you want to keep the horse clean, you'll have to fix it.

reference_spacy_tokens: If you want to keep the horse clean , you 'll have to fix it .


fn_spacy_tokens_for_baseline: In the late 1960s , North Korea continued to expand its educational and research institutions to support a nuclear program for both civilian and military applications .

source_bert_toks: in the late 1960s , north korea continued to expand its educational and research institutions to support a nuclear program for both civilian and military applications .

reference_raw: In the late 1960s, North Korea continued to expand its educational and research institutions to support a nuclear programme for both civilian and military use.

reference_spacy_tokens: In the late 1960s , North Korea continued to expand its educational and research institutions to support a nuclear programme for both civilian and military use .


fn_spacy_tokens_for_baseline: Use a moisturised foundation if your skin is normal - to - dry .

source_bert_toks: use a moist ##uri ##sed foundation if your skin is normal - to - dry .

reference_raw: If your skin is normal to dry, use a wet base.

reference_spacy_tokens: If your skin is normal to dry , use a wet base .


fn_spacy_tokens_for_baseline: Commercial breaks were replaced with old clips of Aoun ranting from a balcony to adoring crowds , just like a Nuremberg rally .

source_bert_toks: commercial breaks were replaced with old clips of ao ##un ran ##ting from a balcony to ad ##orin ##g crowds , just like a nuremberg rally .

reference_raw: The commercial breaks were replaced by old Aoun clips, which ran from the balcony to the admiring crowds, like the Nuremberg rally.

reference_spacy_tokens: The commercial breaks were replaced by old Aoun clips , which ran from the balcony to the admiring crowds , like the Nuremberg rally .


fn_spacy_tokens_for_baseline: As those who use infer for imply might be somehow stigmatized in ( some ) educated circles , failure to report such a usage leaves the suspicious user of a dictionary ( or grammar ) who has the wit to look it up facing a serious lacuna in the information given about the language .

source_bert_toks: as those who use in ##fer for imply might be somehow stigma ##tized in ( some ) educated circles , failure to report such a usage leaves the suspicious user of a dictionary ( or grammar ) who has the wit to look it up facing a serious lac ##una in the information given about the language .

reference_raw: Since those who use inference may somehow be stigmatized in (some) educated circles, non-reporting such use leaves the suspect user of a dictionary (or grammar) who has the wit to look up and face a serious gap in information about the language.

reference_spacy_tokens: Since those who use inference may somehow be stigmatized in ( some ) educated circles , non - reporting such use leaves the suspect user of a dictionary ( or grammar ) who has the wit to look up and face a serious gap in information about the language .


fn_spacy_tokens_for_baseline: ' Yes , ' said Sly , looking up , glad of the excuse to stop struggling with the crappy food .

source_bert_toks: ' yes , ' said sly , looking up , glad of the excuse to stop struggling with the crap ##py food .

reference_raw: 'Yes,' said Sly, looking up, glad to have an excuse to stop fighting the shitty food.

reference_spacy_tokens: ' Yes , ' said Sly , looking up , glad to have an excuse to stop fighting the shitty food .


fn_spacy_tokens_for_baseline: Essam Gheriani said rebels staffing checkpoints had been instructed to keep unarmed youths from reaching the front .

source_bert_toks: es ##sam g ##her ##iani said rebels staff ##ing checkpoint ##s had been instructed to keep unarmed youths from reaching the front .

reference_raw: Essam Gheriani said that the rebels in charge of the checkpoints were ordered to prevent unarmed young men from reaching the front.

reference_spacy_tokens: Essam Gheriani said that the rebels in charge of the checkpoints were ordered to prevent unarmed young men from reaching the front .


fn_spacy_tokens_for_baseline: He related how he had come down to London and systematically searched through the various agencies that might have employed Elsie , how he had tracked down Mrs Wilson and had gone to see her .

source_bert_toks: he related how he had come down to london and systematically searched through the various agencies that might have employed elsie , how he had tracked down mrs wilson and had gone to see her .

reference_raw: He told him how he had come to London and systematically searched the various agencies that might have employed Elsie, how he had tracked down Mrs. Wilson and visited her.

reference_spacy_tokens: He told him how he had come to London and systematically searched the various agencies that might have employed Elsie , how he had tracked down Mrs. Wilson and visited her .


fn_spacy_tokens_for_baseline: The lack of battlefield progress has frustrated North Atlantic Treaty Organization members .

source_bert_toks: the lack of battlefield progress has frustrated north atlantic treaty organization members .

reference_raw: The lack of advancement in the field has frustrated members of the North Atlantic Treaty Organisation.

reference_spacy_tokens: The lack of advancement in the field has frustrated members of the North Atlantic Treaty Organisation .


fn_spacy_tokens_for_baseline: Each day , when Tod and I are done with the Gazette , we take it back to the store .

source_bert_toks: each day , when tod and i are done with the gazette , we take it back to the store .

reference_raw: Every day, when Tod and I finish the Gazette, we take it back to the store.

reference_spacy_tokens: Every day , when Tod and I finish the Gazette , we take it back to the store .