fn_spacy_tokens_for_baseline: A later epitaph carved on the sarcophagus of Scipio Africanus ' ancestor , Lucius Cornelius Scipio Barbatus , described him as having ' good looks equal to his valour " , an idea foreign to traditional Roman thought but very much in the tradition of Alexander of Macedon .

source_bert_toks: a later ep ##ita ##ph carved on the sar ##co ##pha ##gus of sci ##pio african ##us ' ancestor , lucius cornelius sci ##pio bar ##bat ##us , described him as having ' good looks equal to his val ##our " , an idea foreign to traditional roman thought but very much in the tradition of alexander of mace ##don .

reference_raw: A later epitaph engraved on the sarcophagus of Scipio Africanus' ancestor, Lucius Cornelius Scipio Barbatus, described him as "good looks equal to his bravery", an idea alien to traditional Roman thoughts, but very much in the tradition of Alexander of Macedon.

reference_spacy_tokens: A later epitaph engraved on the sarcophagus of Scipio Africanus ' ancestor , Lucius Cornelius Scipio Barbatus , described him as " good looks equal to his bravery " , an idea alien to traditional Roman thoughts , but very much in the tradition of Alexander of Macedon .


fn_spacy_tokens_for_baseline: ' The weight of office ! ' she shrilled .

source_bert_toks: ' the weight of office ! ' she shrill ##ed .

reference_raw: "The weight of the office!" she screamed.

reference_spacy_tokens: " The weight of the office ! " she screamed .


fn_spacy_tokens_for_baseline: Even Homer wrote about Achilles and Patroclus , who have been considered to be the perfect model of true love ( Emond ) .

source_bert_toks: even homer wrote about achilles and pat ##ro ##cl ##us , who have been considered to be the perfect model of true love ( em ##ond ) .

reference_raw: Even Homer wrote about Achilles and Patroclus, who were considered the perfect model of real love.

reference_spacy_tokens: Even Homer wrote about Achilles and Patroclus , who were considered the perfect model of real love .


fn_spacy_tokens_for_baseline: He gripped and released his fists again and again , seething with anger , frustration and despair .

source_bert_toks: he gripped and released his fists again and again , see ##thing with anger , frustration and despair .

reference_raw: He clasped and let go of his fists over and over again, fuming with anger, frustration, and despair.

reference_spacy_tokens: He clasped and let go of his fists over and over again , fuming with anger , frustration , and despair .


fn_spacy_tokens_for_baseline: ' Sit down and I 'll tell you -- we 're having another baby . '

source_bert_toks: ' sit down and i ' ll tell you - - we ' re having another baby . '

reference_raw: "Sit down and let me tell you-we've got another child."

reference_spacy_tokens: " Sit down and let me tell you - we've got another child . "


fn_spacy_tokens_for_baseline: With a good heavy hot iron , it would stop belling out here and there , she thought , and she experienced a flash of pleasure at the quickness and deftness of her work .

source_bert_toks: with a good heavy hot iron , it would stop bell ##ing out here and there , she thought , and she experienced a flash of pleasure at the quick ##ness and def ##tness of her work .

reference_raw: With good hot iron, it would stop ringing from time to time, she thought, and she felt a flash of joy at the speed and skill of her work.

reference_spacy_tokens: With good hot iron , it would stop ringing from time to time , she thought , and she felt a flash of joy at the speed and skill of her work .


fn_spacy_tokens_for_baseline: That poses a high risk of civilian casualties in Tripoli , a dense urban landscape with more than 1.6 million people .

source_bert_toks: that poses a high risk of civilian casualties in tripoli , a dense urban landscape with more than 1 . 6 million people .

reference_raw: In Tripoli, a dense urban environment with more than 1.6 million people, this poses a high threat of civilian casualties.

reference_spacy_tokens: In Tripoli , a dense urban environment with more than 1.6 million people , this poses a high threat of civilian casualties .


fn_spacy_tokens_for_baseline: Well aware that most workers were indifferent to foreign affairs , he fully expected the majority of them to be swept into fratricide by patriotic propaganda if war actually came .

source_bert_toks: well aware that most workers were indifferent to foreign affairs , he fully expected the majority of them to be swept into fra ##tric ##ide by patriotic propaganda if war actually came .

reference_raw: Knowing that most workers were indifferent to foreign affairs, he fully expected that most of them would be wiped out by patriotic propaganda if war really came.

reference_spacy_tokens: Knowing that most workers were indifferent to foreign affairs , he fully expected that most of them would be wiped out by patriotic propaganda if war really came .


fn_spacy_tokens_for_baseline: The center , which has drawn criticism from arms control experts and local activists , will be the first department lab to focus strictly on biodefense .

source_bert_toks: the center , which has drawn criticism from arms control experts and local activists , will be the first department lab to focus strictly on bio ##de ##fen ##se .

reference_raw: The center, which has been criticized by weapons-control experts and local activists, will be the first departmental laboratory to focus on biodefence.

reference_spacy_tokens: The center , which has been criticized by weapons - control experts and local activists , will be the first departmental laboratory to focus on biodefence .


fn_spacy_tokens_for_baseline: Pare the rind from fruit and cut into fine strips .

source_bert_toks: par ##e the ri ##nd from fruit and cut into fine strips .

reference_raw: Take the fruit out of the rind and cut it into fine strips.

reference_spacy_tokens: Take the fruit out of the rind and cut it into fine strips .


fn_spacy_tokens_for_baseline: Stanley puffed on his pipe and beamed .

source_bert_toks: stanley puff ##ed on his pipe and beamed .

reference_raw: Stanley blew his pipe and beamed.

reference_spacy_tokens: Stanley blew his pipe and beamed .


fn_spacy_tokens_for_baseline: The broomstick dipped its twiggy end and soared upward like a rocket .

source_bert_toks: the broom ##stick dipped its t ##wig ##gy end and soared upward like a rocket .

reference_raw: The broomstick dipped its wiggly end and rose like a rocket.

reference_spacy_tokens: The broomstick dipped its wiggly end and rose like a rocket .


fn_spacy_tokens_for_baseline: There is a large head compartment and oilskin locker to starboard of the companionway .

source_bert_toks: there is a large head compartment and oils ##kin locker to starboard of the companion ##way .

reference_raw: On the right side of the companionway is a large head compartment and an oil-skin cabinet.

reference_spacy_tokens: On the right side of the companionway is a large head compartment and an oil - skin cabinet .


fn_spacy_tokens_for_baseline: Kneeling down on the dusty pavement , she made as if to tie her shoelaces .

source_bert_toks: kneeling down on the dusty pavement , she made as if to tie her shoe ##lace ##s .

reference_raw: She knelt on the dusty sidewalk and made as if to tie her laces.

reference_spacy_tokens: She knelt on the dusty sidewalk and made as if to tie her laces .


fn_spacy_tokens_for_baseline: Yeremi 's stream of plasma ceased abruptly as his hand cramped within that fervid womb .

source_bert_toks: yer ##emi ' s stream of plasma ceased abruptly as his hand cramped within that fe ##r ##vid womb .

reference_raw: Yeremi's plasma flow stopped suddenly as his hand tightened in the fervent uterus.

reference_spacy_tokens: Yeremi 's plasma flow stopped suddenly as his hand tightened in the fervent uterus .


fn_spacy_tokens_for_baseline: Wearing a chic black costume and white fur wrap , she is seen waving to him as he departs for the colony before walking away to a smart car beside which stands a chauffeur .

source_bert_toks: wearing a chi ##c black costume and white fur wrap , she is seen waving to him as he depart ##s for the colony before walking away to a smart car beside which stands a cha ##uf ##fe ##ur .

reference_raw: She was dressed in a chic black suit and a white fur cover, and she was seen waving to him as he left for the colony before he went to the smart car next to the driver.

reference_spacy_tokens: She was dressed in a chic black suit and a white fur cover , and she was seen waving to him as he left for the colony before he went to the smart car next to the driver .


fn_spacy_tokens_for_baseline: One branch went down directly to the Horse Fair , the other , this one , cut through to emerge halfway along the Foregate , almost within sight of the abbey gatehouse .

source_bert_toks: one branch went down directly to the horse fair , the other , this one , cut through to emerge halfway along the fore ##gate , almost within sight of the abbey gate ##house .

reference_raw: One branch went straight to the Horse Fair, and the other, this one, cut through and appeared halfway along the Foregate, almost within sight of the abbey's gate.

reference_spacy_tokens: One branch went straight to the Horse Fair , and the other , this one , cut through and appeared halfway along the Foregate , almost within sight of the abbey 's gate .


fn_spacy_tokens_for_baseline: He was hatless , his silver hair awry , his eyes glowing with insane fury .

source_bert_toks: he was hat ##less , his silver hair aw ##ry , his eyes glowing with insane fury .

reference_raw: He had no hat, his silver hair awry, and his eyes glowed with mad rage.

reference_spacy_tokens: He had no hat , his silver hair awry , and his eyes glowed with mad rage .


fn_spacy_tokens_for_baseline: How do we represent the zoo , ship , town , pet shop or mayor 's office ?

source_bert_toks: how do we represent the zoo , ship , town , pet shop or mayor ' s office ?

reference_raw: What's the status of the zoo, the boat, the city, the pet shop or the mayor's office?

reference_spacy_tokens: What 's the status of the zoo , the boat , the city , the pet shop or the mayor 's office ?


fn_spacy_tokens_for_baseline: ' We would do well to learn from them , ' Wei Feng said , reaching up to pick a leaf from the branch .

source_bert_toks: ' we would do well to learn from them , ' wei feng said , reaching up to pick a leaf from the branch .

reference_raw: 'We'd do well to learn from them,' said Wei Feng, reaching for a leaf from a branch.

reference_spacy_tokens: ' We 'd do well to learn from them , ' said Wei Feng , reaching for a leaf from a branch .


fn_spacy_tokens_for_baseline: This is effective from the date it is received at our offices .

source_bert_toks: this is effective from the date it is received at our offices .

reference_raw: It shall take effect from the day it is received in our offices.

reference_spacy_tokens: It shall take effect from the day it is received in our offices .


fn_spacy_tokens_for_baseline: Make sure the truffles are completely coated in chocolate .

source_bert_toks: make sure the tr ##uf ##fles are completely coated in chocolate .

reference_raw: Make sure the truffles are completely covered with chocolate.

reference_spacy_tokens: Make sure the truffles are completely covered with chocolate .


fn_spacy_tokens_for_baseline: Peggy did not move , but after a moment of silence she said , ' I can divorce him .

source_bert_toks: peggy did not move , but after a moment of silence she said , ' i can divorce him .

reference_raw: Peggy didn't move, but after a moment's silence she said, "I can get rid of him.

reference_spacy_tokens: Peggy did n't move , but after a moment 's silence she said , " I can get rid of him .


fn_spacy_tokens_for_baseline: We ran Borneo 's uncharted rapids in Dyak canoes , dived with sharks in the rip - currents of Komodo , and were sluiced off Javanese roads in monsoon flash - floods .

source_bert_toks: we ran borneo ' s un ##cha ##rted rapids in d ##ya ##k canoe ##s , dive ##d with sharks in the rip - currents of ko ##mo ##do , and were sl ##ui ##ced off javanese roads in monsoon flash - floods .

reference_raw: In Dyak canoes, we ran Borneo's uncharted fasts, dived with sharks in Komodo's streams, and were cut off from Javanese roads in monsoon flash floods.

reference_spacy_tokens: In Dyak canoes , we ran Borneo 's uncharted fasts , dived with sharks in Komodo 's streams , and were cut off from Javanese roads in monsoon flash floods .


fn_spacy_tokens_for_baseline: She gulped and rubbed the ivory bangle on her wrist .

source_bert_toks: she gulped and rubbed the ivory bang ##le on her wrist .

reference_raw: She swallowed and rubbed the ivory bracelet on her wrist.

reference_spacy_tokens: She swallowed and rubbed the ivory bracelet on her wrist .


fn_spacy_tokens_for_baseline: Mr Appleby said he complained to a senior officer who made a note in the ship 's log .

source_bert_toks: mr apple ##by said he complained to a senior officer who made a note in the ship ' s log .

reference_raw: Mr. Appleby said he complained to a senior officer who made a note on the ship's record.

reference_spacy_tokens: Mr. Appleby said he complained to a senior officer who made a note on the ship 's record .


fn_spacy_tokens_for_baseline: As the light grew so Tallis could see his armoured helmet , crested by a fan of spikes , and the dull leather of his breastplate .

source_bert_toks: as the light grew so tall ##is could see his armoured helmet , crested by a fan of spikes , and the dull leather of his breast ##plate .

reference_raw: As the light grew, Tallis could see his armored helm, crested by a fan of spikes, and the dull skin of his chest.

reference_spacy_tokens: As the light grew , Tallis could see his armored helm , crested by a fan of spikes , and the dull skin of his chest .


fn_spacy_tokens_for_baseline: He was in the hall next morning as Maggie came downstairs , and at the sight of her he walked forward to watch her descent .

source_bert_toks: he was in the hall next morning as maggie came downstairs , and at the sight of her he walked forward to watch her descent .

reference_raw: When Maggie came down, he was in the hall the next morning, and when he saw her, he stepped forward to watch her fall.

reference_spacy_tokens: When Maggie came down , he was in the hall the next morning , and when he saw her , he stepped forward to watch her fall .


fn_spacy_tokens_for_baseline: Previous studies have shown that Gad1 can be regulated at the post - transcriptional and translational level .

source_bert_toks: previous studies have shown that ga ##d ##1 can be regulated at the post - transcription ##al and translation ##al level .

reference_raw: Previous studies have shown that GAD1 can be regulated at the post-transscription and translation stage.

reference_spacy_tokens: Previous studies have shown that GAD1 can be regulated at the post - transscription and translation stage .


fn_spacy_tokens_for_baseline: Another text with allusions to Jewish ethical norms attributed to Phocylides was recognized long ago to be a Jewish forgery of the Hellenistic age .

source_bert_toks: another text with all ##usions to jewish ethical norms attributed to ph ##oc ##yl ##ides was recognized long ago to be a jewish forge ##ry of the hellenistic age .

reference_raw: Another text with references to Jewish ethical norms attributed to Phocylides has long since been recognised as a Jewish counterfeit of the Hellenist Age.

reference_spacy_tokens: Another text with references to Jewish ethical norms attributed to Phocylides has long since been recognised as a Jewish counterfeit of the Hellenist Age .


fn_spacy_tokens_for_baseline: My perm would stink under my swimming hat .

source_bert_toks: my per ##m would stink under my swimming hat .

reference_raw: My perm would smell under my swimmer's hat.

reference_spacy_tokens: My perm would smell under my swimmer 's hat .


fn_spacy_tokens_for_baseline: Ignoring his protests , Beth stripped away his undergarments and lifted him into her arms .

source_bert_toks: ignoring his protests , beth stripped away his under ##gar ##ments and lifted him into her arms .

reference_raw: Beth ignored his protests, stripped off his underwear, and lifted him into her arms.

reference_spacy_tokens: Beth ignored his protests , stripped off his underwear , and lifted him into her arms .


fn_spacy_tokens_for_baseline: Sensations of white are not alike in some respect ; they are alike " altogether " .

source_bert_toks: sensations of white are not alike in some respect ; they are alike " altogether " .

reference_raw: In some respects, the senses of white are not the same; they are the same.

reference_spacy_tokens: In some respects , the senses of white are not the same ; they are the same .


fn_spacy_tokens_for_baseline: When I tugged back a sleeve , the wrist was naked -- forgot my watch again -- and both hands chapped and rough .

source_bert_toks: when i tugged back a sleeve , the wrist was naked - - forgot my watch again - - and both hands cha ##pped and rough .

reference_raw: When I pulled my sleeve back, my wrist was naked - I'd left my watch again - and both hands were clapped and rough.

reference_spacy_tokens: When I pulled my sleeve back , my wrist was naked - I 'd left my watch again - and both hands were clapped and rough .


fn_spacy_tokens_for_baseline: Record insertion , deletion and update may involve high costs .

source_bert_toks: record insertion , del ##eti ##on and update may involve high costs .

reference_raw: Inserting, erasing and updating records can entail a high cost.

reference_spacy_tokens: Inserting , erasing and updating records can entail a high cost .


fn_spacy_tokens_for_baseline: He was glib in tongue , lavish in promises , big in size and somewhat stupid .

source_bert_toks: he was g ##lib in tongue , lavish in promises , big in size and somewhat stupid .

reference_raw: He was slippery in his tongue, lavish in his promises, big in size, and a little stupid.

reference_spacy_tokens: He was slippery in his tongue , lavish in his promises , big in size , and a little stupid .


fn_spacy_tokens_for_baseline: If he 'd been moderate in his thieving he would never have been caught;. '

source_bert_toks: if he ' d been moderate in his th ##ieving he would never have been caught ; . '

reference_raw: If he had been moderate in his theft, he would never have been caught;'

reference_spacy_tokens: If he had been moderate in his theft , he would never have been caught ; '


fn_spacy_tokens_for_baseline: Or , Griffin said , the bombs are triggered with remote devices such as a car alarm , garage door opener or beeper , which can send voltage to the blasting cap .

source_bert_toks: or , griffin said , the bombs are triggered with remote devices such as a car alarm , garage door opener or bee ##per , which can send voltage to the blasting cap .

reference_raw: Or, Griffin had said, the bombs were activated by remote devices, such as a car alarm, a garage door opener, or a beeper, which could send voltage to the blast cap.

reference_spacy_tokens: Or , Griffin had said , the bombs were activated by remote devices , such as a car alarm , a garage door opener , or a beeper , which could send voltage to the blast cap .


fn_spacy_tokens_for_baseline: In a number of theories of text comprehension , such mappings are assumed to be made ( potentially ) at a number of levels .

source_bert_toks: in a number of theories of text comprehension , such mapping ##s are assumed to be made ( potentially ) at a number of levels .

reference_raw: In many theories of interpretation of text, it is assumed that these mappings will be carried out (potentially) at several levels.

reference_spacy_tokens: In many theories of interpretation of text , it is assumed that these mappings will be carried out ( potentially ) at several levels .


fn_spacy_tokens_for_baseline: It is the close focus of snapshots like these that lend credence to the white heat of his outpourings : ' I have lived for fifty years as an unequal in this country , enveloped by hate ' .

source_bert_toks: it is the close focus of snaps ##hot ##s like these that lend cr ##ede ##nce to the white heat of his out ##pour ##ings : ' i have lived for fifty years as an une ##qual in this country , enveloped by hate ' .

reference_raw: The close focus of images like this lends confidence to the white heat of his outbursts: 'I have lived for fifty years as an uneven man in this country, surrounded by hatred.'

reference_spacy_tokens: The close focus of images like this lends confidence to the white heat of his outbursts : ' I have lived for fifty years as an uneven man in this country , surrounded by hatred . '


fn_spacy_tokens_for_baseline: Questions about Mr Major 's style and the way he was fighting the battle arose from the evident disarray in the Conservative campaign .

source_bert_toks: questions about mr major ' s style and the way he was fighting the battle arose from the evident di ##sar ##ray in the conservative campaign .

reference_raw: Questions about Mr. Major's style and how he fought the battle arose from obvious confusion in the conservative campaign.

reference_spacy_tokens: Questions about Mr. Major 's style and how he fought the battle arose from obvious confusion in the conservative campaign .


fn_spacy_tokens_for_baseline: In Jerusalem the remains were received by her sister , Princess Louis of Battenberg , the mother of Mountbatten , and buried in the Russian church on the Mount of Olives .

source_bert_toks: in jerusalem the remains were received by her sister , princess louis of bat ##tenberg , the mother of mount ##bat ##ten , and buried in the russian church on the mount of olive ##s .

reference_raw: In Jerusalem, her sister, Princess Louis of Battenberg, mother of Mountainbatten, received the remains and was buried in a Russian church on the Olive Mountains.

reference_spacy_tokens: In Jerusalem , her sister , Princess Louis of Battenberg , mother of Mountainbatten , received the remains and was buried in a Russian church on the Olive Mountains .


fn_spacy_tokens_for_baseline: Though a mocking smile played at the corners of his chiselled mouth , his voice had a caustic bite .

source_bert_toks: though a mocking smile played at the corners of his chi ##selle ##d mouth , his voice had a ca ##ust ##ic bite .

reference_raw: Though there was a taunting smile at the corners of his chiseled mouth, there was a caustic bite in his voice.

reference_spacy_tokens: Though there was a taunting smile at the corners of his chiseled mouth , there was a caustic bite in his voice .


fn_spacy_tokens_for_baseline: The paunchy politician had a wonderful , wish - you - were - here time in a month - long stay at the Marbella villa rented by Mona .

source_bert_toks: the pau ##nch ##y politician had a wonderful , wish - you - were - here time in a month - long stay at the mar ##bella villa rented by mona .

reference_raw: In a month's stay at the Marbella villa rented by Mona, the poor politician had a wonderful wish-you-were here.

reference_spacy_tokens: In a month 's stay at the Marbella villa rented by Mona , the poor politician had a wonderful wish - you - were here .


fn_spacy_tokens_for_baseline: Rain ousted Zak Smythe from her chair and asked what was going on .

source_bert_toks: rain ousted za ##k smyth ##e from her chair and asked what was going on .

reference_raw: The rain pulled Zak Smythe out of her chair and asked what was happening.

reference_spacy_tokens: The rain pulled Zak Smythe out of her chair and asked what was happening .


fn_spacy_tokens_for_baseline: The scientists hope to try again today , which shows commendable patience .

source_bert_toks: the scientists hope to try again today , which shows com ##men ##dable patience .

reference_raw: Scientists hope to try again today, which demonstrates a laudable patience.

reference_spacy_tokens: Scientists hope to try again today , which demonstrates a laudable patience .


fn_spacy_tokens_for_baseline: They receive a child who has been badly let down in the past , who has to learn , painfully , how to care and trust again .

source_bert_toks: they receive a child who has been badly let down in the past , who has to learn , painfully , how to care and trust again .

reference_raw: They get a kid who's been badly disappointed in the past, who has to learn painfully how to take care of and believe again.

reference_spacy_tokens: They get a kid who 's been badly disappointed in the past , who has to learn painfully how to take care of and believe again .


fn_spacy_tokens_for_baseline: Can we use UCS as a common denominator for that ?

source_bert_toks: can we use uc ##s as a common den ##omi ##nator for that ?

reference_raw: Is it possible to use UCS as the general denominator?

reference_spacy_tokens: Is it possible to use UCS as the general denominator ?


fn_spacy_tokens_for_baseline: ' It is a rougher country than these southern parts , with wild moors , good for hawking and not much else .

source_bert_toks: ' it is a rough ##er country than these southern parts , with wild moors , good for hawk ##ing and not much else .

reference_raw: It's a rougher country than this southern part of the country, with wild moors, and it's fine for hawking, and it's not much else.

reference_spacy_tokens: It 's a rougher country than this southern part of the country , with wild moors , and it 's fine for hawking , and it 's not much else .


fn_spacy_tokens_for_baseline: As with people we meet during the day , some authors are accepted as close friends while others alienate or repel us .

source_bert_toks: as with people we meet during the day , some authors are accepted as close friends while others alien ##ate or rep ##el us .

reference_raw: As with the people we meet in the daytime, some authors are accepted as close friends, while others alienate or repulse us.

reference_spacy_tokens: As with the people we meet in the daytime , some authors are accepted as close friends , while others alienate or repulse us .


fn_spacy_tokens_for_baseline: But with this factory farming system , sows are confined in narrow stalls or tethered in rows by neck straps or girth straps shackled to the floor .

source_bert_toks: but with this factory farming system , so ##ws are confined in narrow stalls or te ##ther ##ed in rows by neck straps or gi ##rth straps shack ##led to the floor .

reference_raw: However, in this factory-farming system, the sows are confined to narrow stalls or tied in rows by neck straps or girth straps chained to the floor.

reference_spacy_tokens: However , in this factory - farming system , the sows are confined to narrow stalls or tied in rows by neck straps or girth straps chained to the floor .


fn_spacy_tokens_for_baseline: With due reverence to her mother 's memory , Pol O'Gorman made the sign of the cross .

source_bert_toks: with due rev ##erence to her mother ' s memory , pol o ' gorman made the sign of the cross .

reference_raw: Pol O'Gorman made a sign of the cross with respect to her mother's memory.

reference_spacy_tokens: Pol O'Gorman made a sign of the cross with respect to her mother 's memory .


fn_spacy_tokens_for_baseline: The man in charge of his Avro Cadet restoration is Stan Smith , a retired Air New Zealand captain , now an astounding jack - of - all - aeronautical - trades , and master of every one .

source_bert_toks: the man in charge of his av ##ro cadet restoration is stan smith , a retired air new zealand captain , now an as ##tou ##nding jack - of - all - aeronautical - trades , and master of every one .

reference_raw: The man in charge of the restoration of the Avro Cadet is Stan Smith, a retired captain of the Air New Zealand, now a stunning jack of aeronautical trades, and a master of all.

reference_spacy_tokens: The man in charge of the restoration of the Avro Cadet is Stan Smith , a retired captain of the Air New Zealand , now a stunning jack of aeronautical trades , and a master of all .


fn_spacy_tokens_for_baseline: She dragged her eyes up and watched as , unhurriedly , he stripped off his heavy gloves and laid them across the bike before lifting his helmet off and balancing it in front of him .

source_bert_toks: she dragged her eyes up and watched as , un ##hur ##ried ##ly , he stripped off his heavy gloves and laid them across the bike before lifting his helmet off and balancing it in front of him .

reference_raw: She pulled her eyes up and watched him unhurriedly take off his heavy gloves and put them on the wheel before removing his helmet and balancing it in front of him.

reference_spacy_tokens: She pulled her eyes up and watched him unhurriedly take off his heavy gloves and put them on the wheel before removing his helmet and balancing it in front of him .


fn_spacy_tokens_for_baseline: The mother -- who believes she passed on her 50-a - day habit to the girl while she was pregnant -- revealed that Cherie had been diagnosed a nicotine addict by a doctor .

source_bert_toks: the mother - - who believes she passed on her 50 - a - day habit to the girl while she was pregnant - - revealed that cher ##ie had been diagnosed a nico ##tine addict by a doctor .

reference_raw: A mother, who believes she passed on her 50-day habit to a girl when she was pregnant, discovered that Cherie had been diagnosed by a doctor with nicotine.

reference_spacy_tokens: A mother , who believes she passed on her 50-day habit to a girl when she was pregnant , discovered that Cherie had been diagnosed by a doctor with nicotine .


fn_spacy_tokens_for_baseline: There 've been low points , too -- not least the fire in January last year which destroyed an entire hangar and its contents at a cost to the Air Force of 40 million .

source_bert_toks: there ' ve been low points , too - - not least the fire in january last year which destroyed an entire hangar and its contents at a cost to the air force of 40 million .

reference_raw: There are also low points - not least the fire in January last year, which destroyed the entire bay and its contents at a price of 40 million to the Air Force.

reference_spacy_tokens: There are also low points - not least the fire in January last year , which destroyed the entire bay and its contents at a price of 40 million to the Air Force .


fn_spacy_tokens_for_baseline: Gass took over the abandoned Mormon fort and 640 acres ( 260 hectares ) surrounding it , dubbing it the Las Vegas Ranch .

source_bert_toks: gas ##s took over the abandoned mormon fort and 640 acres ( 260 hectares ) surrounding it , dub ##bing it the las vegas ranch .

reference_raw: Gass took over the deserted fortress of Mormon and 640 acres (260 hectares) surrounding it and dubbed it to the Las Vegas ranch.

reference_spacy_tokens: Gass took over the deserted fortress of Mormon and 640 acres ( 260 hectares ) surrounding it and dubbed it to the Las Vegas ranch .


fn_spacy_tokens_for_baseline: Most of the games he owned were very old and substandard but the one saving grace in his collection was a game called Rambo .

source_bert_toks: most of the games he owned were very old and sub ##stand ##ard but the one saving grace in his collection was a game called ram ##bo .

reference_raw: Most of his games were very old and inferior, but the only one that saved grace in his collection was a game called Rambo.

reference_spacy_tokens: Most of his games were very old and inferior , but the only one that saved grace in his collection was a game called Rambo .


fn_spacy_tokens_for_baseline: As she went , she ransacked her bag for her keys , and almost bumped into Rebecca , coming in the opposite direction .

source_bert_toks: as she went , she ran ##sack ##ed her bag for her keys , and almost bumped into rebecca , coming in the opposite direction .

reference_raw: She went through the bag to get her keys and almost ran into Rebecca, who was heading the other way.

reference_spacy_tokens: She went through the bag to get her keys and almost ran into Rebecca , who was heading the other way .


fn_spacy_tokens_for_baseline: There was a buzz of voices in the shrine .

source_bert_toks: there was a buzz of voices in the shrine .

reference_raw: Voices hummed in the sanctuary.

reference_spacy_tokens: Voices hummed in the sanctuary .


fn_spacy_tokens_for_baseline: Because they strive , but can never counterfeit the ease or inevitability of great soul ; are smart but never opulent , well - turned but never flamboyant .

source_bert_toks: because they strive , but can never counter ##feit the ease or in ##ev ##ita ##bility of great soul ; are smart but never op ##ulent , well - turned but never fl ##am ##boy ##ant .

reference_raw: Because they strive, but they can never forge the ease or inevitability of a great soul; they are clever, but never opulent, well-turned, but never flamboyant.

reference_spacy_tokens: Because they strive , but they can never forge the ease or inevitability of a great soul ; they are clever , but never opulent , well - turned , but never flamboyant .


fn_spacy_tokens_for_baseline: ' Her personal possessions -- jewellery , furniture and so on .

source_bert_toks: ' her personal possessions - - jewellery , furniture and so on .

reference_raw: 'Her personal belongings - jewelry, furniture, etc.

reference_spacy_tokens: ' Her personal belongings - jewelry , furniture , etc .


fn_spacy_tokens_for_baseline: A well - observed story , with admirable performances , Two Left Feet gave Crawford some comical scenes that were a prelude to his later role as Frank Spencer on television .

source_bert_toks: a well - observed story , with ad ##mir ##able performances , two left feet gave crawford some comical scenes that were a prelude to his later role as frank spencer on television .

reference_raw: A well-observed story with admirable performances, Two Left Feet provided Crawford with a series of comic scenes that preceded his later role as Frank Spencer on TV.

reference_spacy_tokens: A well - observed story with admirable performances , Two Left Feet provided Crawford with a series of comic scenes that preceded his later role as Frank Spencer on TV .


fn_spacy_tokens_for_baseline: Another set pitched in from the north of the village , another from the south .

source_bert_toks: another set pitched in from the north of the village , another from the south .

reference_raw: From the northern part of the village came another set, another from the south.

reference_spacy_tokens: From the northern part of the village came another set , another from the south .


fn_spacy_tokens_for_baseline: R4000A shipments are expected through SGI 's semiconductor vendors this year as well as a 67Mhz R4000A iteration .

source_bert_toks: r ##400 ##0 ##a shipments are expected through sg ##i ' s semiconductor vendors this year as well as a 67 ##m ##h ##z r ##400 ##0 ##a iteration .

reference_raw: R4000A shipments are expected to be made this year by SGI semiconductor sellers and 67MHz R4000A iteration.

reference_spacy_tokens: R4000A shipments are expected to be made this year by SGI semiconductor sellers and 67MHz R4000A iteration .


fn_spacy_tokens_for_baseline: Add the beans to a large saucepan of boiling water and boil rapidly for 10min .

source_bert_toks: add the beans to a large sauce ##pan of boiling water and boil rapidly for 10 ##min .

reference_raw: Add the beans to a large saucepan of steaming water and cook quickly for 10 minutes.

reference_spacy_tokens: Add the beans to a large saucepan of steaming water and cook quickly for 10 minutes .


fn_spacy_tokens_for_baseline: I should perhaps add , ' the Israeli finished , his tone dry but somewhat less unfriendly , ' that Max once told me he invariably addressed the Lord in Hebrew , the language of the Torah .

source_bert_toks: i should perhaps add , ' the israeli finished , his tone dry but somewhat less un ##fr ##ien ##dly , ' that max once told me he invariably addressed the lord in hebrew , the language of the torah .

reference_raw: Perhaps I should add," the Israeli finished in a dry but less hostile tone, "that Max once told me that he always spoke to the Lord of Hebrew, the language of the Torah.

reference_spacy_tokens: Perhaps I should add , " the Israeli finished in a dry but less hostile tone , " that Max once told me that he always spoke to the Lord of Hebrew , the language of the Torah .


fn_spacy_tokens_for_baseline: A measure of freedom to the son , and the last indignity to the father 's bones -- what manner of dealing is that ? ' said Llewelyn , smouldering .

source_bert_toks: a measure of freedom to the son , and the last ind ##ign ##ity to the father ' s bones - - what manner of dealing is that ? ' said ll ##ew ##ely ##n , sm ##ou ##lder ##ing .

reference_raw: A measure of freedom for his son, and a final indignation for his father's bones - how do you deal with it?' said Llewelyn, smoldering.

reference_spacy_tokens: A measure of freedom for his son , and a final indignation for his father 's bones - how do you deal with it ? ' said Llewelyn , smoldering .


fn_spacy_tokens_for_baseline: Those cells collect information , motivate Pakistani expatriates , recruit , procure weapons and raise money , said Raman , director of the Institute for Topical Studies in Chennai , India .

source_bert_toks: those cells collect information , mo ##tiv ##ate pakistani ex ##pa ##tri ##ates , recruit , pro ##cure weapons and raise money , said rama ##n , director of the institute for topical studies in chennai , india .

reference_raw: These cells gather information, motivate Pakistani expatriates, recruit, acquire weapons, and raise money, said Raman, Director of the Institute of Topical Studies in Chennai, India.

reference_spacy_tokens: These cells gather information , motivate Pakistani expatriates , recruit , acquire weapons , and raise money , said Raman , Director of the Institute of Topical Studies in Chennai , India .


fn_spacy_tokens_for_baseline: Kadafi remains elusive , defiant as fighting continues in Tripoli

source_bert_toks: ka ##da ##fi remains elusive , defiant as fighting continues in tripoli

reference_raw: Kadafi remains fleeting and defiant as the battle in Tripoli continues.

reference_spacy_tokens: Kadafi remains fleeting and defiant as the battle in Tripoli continues .


fn_spacy_tokens_for_baseline: What is poisonous to cats ?

source_bert_toks: what is poisonous to cats ?

reference_raw: What's toxic for cats?

reference_spacy_tokens: What 's toxic for cats ?


fn_spacy_tokens_for_baseline: This enthusiasm was not , however , shared by the bishop , Laurence Bothe , who was clearly unhappy at the arrival of so powerful a neighbour .

source_bert_toks: this enthusiasm was not , however , shared by the bishop , laurence both ##e , who was clearly unhappy at the arrival of so powerful a neighbour .

reference_raw: But this enthusiasm was not shared by the Bishop, Laurence Bothe, who was obviously unhappy with the coming of such a powerful neighbor.

reference_spacy_tokens: But this enthusiasm was not shared by the Bishop , Laurence Bothe , who was obviously unhappy with the coming of such a powerful neighbor .


fn_spacy_tokens_for_baseline: TWO prisoners bungled an escape bid after running either side of a lamp - post -- while handcuffed .

source_bert_toks: two prisoners bun ##gled an escape bid after running either side of a lamp - post - - while hand ##cu ##ffed .

reference_raw: The two prisoners, after running both sides of the lamppost, buffeted an escape bid - while in handcuffs.

reference_spacy_tokens: The two prisoners , after running both sides of the lamppost , buffeted an escape bid - while in handcuffs .


fn_spacy_tokens_for_baseline: It ca n't be , she wanted to wail aloud , it just ca n't be !

source_bert_toks: it can ' t be , she wanted to wai ##l aloud , it just can ' t be !

reference_raw: She wanted to cry out loud, but it can't be!

reference_spacy_tokens: She wanted to cry out loud , but it ca n't be !


fn_spacy_tokens_for_baseline: ROBBERS stole paintings worth £ 25 million in the French Riviera 's biggest art theft .

source_bert_toks: robbers stole paintings worth £2 ##5 million in the french ri ##vier ##a ' s biggest art theft .

reference_raw: ROBBERS stole paintings worth £25 million in the greatest art heist in the French Riviera.

reference_spacy_tokens: ROBBERS stole paintings worth £ 25 million in the greatest art heist in the French Riviera .


fn_spacy_tokens_for_baseline: Although deep - freezing has revolutionised the way food is preserved , with some kinds of fish I still prefer the old method of salting and sun drying .

source_bert_toks: although deep - freezing has revolution ##ised the way food is preserved , with some kinds of fish i still prefer the old method of salt ##ing and sun drying .

reference_raw: Although deep-frozening has revolutionized the way food is kept, with some fish, I still prefer the old salting and sun-drying method.

reference_spacy_tokens: Although deep - frozening has revolutionized the way food is kept , with some fish , I still prefer the old salting and sun - drying method .


fn_spacy_tokens_for_baseline: Hardly earth - shattering confessions , I admit .

source_bert_toks: hardly earth - shattering confessions , i admit .

reference_raw: Hardly a land-shattering confession, I'll admit.

reference_spacy_tokens: Hardly a land - shattering confession , I 'll admit .


fn_spacy_tokens_for_baseline: This ominous escalation of tension has come amid reports that the rail blockade of Armenia and Nagorny Karabakh by Azerbaijan -- partially lifted at least in recent days -- has been re - imposed after fresh violence .

source_bert_toks: this ominous es ##cala ##tion of tension has come amid reports that the rail blockade of armenia and na ##gor ##ny kara ##ba ##kh by azerbaijan - - partially lifted at least in recent days - - has been re - imposed after fresh violence .

reference_raw: This sinister escalation of tensions has come in the midst of reports that Azerbaijan's railway blockade of Armenia and Nagorny Karabakh - partially lifted in recent days at least - has been re-established after new violence.

reference_spacy_tokens: This sinister escalation of tensions has come in the midst of reports that Azerbaijan 's railway blockade of Armenia and Nagorny Karabakh - partially lifted in recent days at least - has been re - established after new violence .


fn_spacy_tokens_for_baseline: Food containing insoluble fibre is satisfying as it needs more chewing than other foods and , as it absorbs water and swells in the stomach , it is filling .

source_bert_toks: food containing ins ##ol ##ub ##le fibre is satisfying as it needs more chewing than other foods and , as it absorb ##s water and swell ##s in the stomach , it is filling .

reference_raw: Food containing insoluble fibres is satisfactory because it needs to be chewed more than other foods and is filled with water and swelling in the stomach.

reference_spacy_tokens: Food containing insoluble fibres is satisfactory because it needs to be chewed more than other foods and is filled with water and swelling in the stomach .


fn_spacy_tokens_for_baseline: Curiously this dead period in Paris , when the city was preoccupied with war , coincided with a time of intense growth and change for Modigliani .

source_bert_toks: curiously this dead period in paris , when the city was preoccupied with war , coincided with a time of intense growth and change for mod ##ig ##lian ##i .

reference_raw: Curiously, this dead period in Paris, when the city was busy with war, coincided with a period of intensive growth and change for Modigliani.

reference_spacy_tokens: Curiously , this dead period in Paris , when the city was busy with war , coincided with a period of intensive growth and change for Modigliani .


fn_spacy_tokens_for_baseline: Endill tried to sit up to get a better look but as he did so , knocked over a book and it thumped onto the shelf .

source_bert_toks: end ##ill tried to sit up to get a better look but as he did so , knocked over a book and it thumped onto the shelf .

reference_raw: Endill tried to sit up for a better look, but when he did, he knocked over the book and it hit the shelf.

reference_spacy_tokens: Endill tried to sit up for a better look , but when he did , he knocked over the book and it hit the shelf .


fn_spacy_tokens_for_baseline: She sat looking bored and did n't seem perturbed about the noises around them .

source_bert_toks: she sat looking bored and didn ' t seem per ##tur ##bed about the noises around them .

reference_raw: She sat there, looking bored, and seemed unconcerned by the sounds around her.

reference_spacy_tokens: She sat there , looking bored , and seemed unconcerned by the sounds around her .


fn_spacy_tokens_for_baseline: As one , they shrank away from the far wall , watching rainwater trickling through the cracks in the boards and spattering on the basement floor .

source_bert_toks: as one , they sh ##rank away from the far wall , watching rain ##water trick ##ling through the cracks in the boards and spat ##tering on the basement floor .

reference_raw: As one, they moved away from the far wall, watching the rainwater stream through the cracks in the boards and splash down the cellar floor.

reference_spacy_tokens: As one , they moved away from the far wall , watching the rainwater stream through the cracks in the boards and splash down the cellar floor .


fn_spacy_tokens_for_baseline: It is a tragedy that many children have been denied the chance to take these tests .

source_bert_toks: it is a tragedy that many children have been denied the chance to take these tests .

reference_raw: It's tragic that many children were denied the opportunity to take these tests.

reference_spacy_tokens: It 's tragic that many children were denied the opportunity to take these tests .


fn_spacy_tokens_for_baseline: Episcopal registers amply attest the development of this system .

source_bert_toks: episcopal registers amp ##ly at ##test the development of this system .

reference_raw: The Episcopal Registers confirm the development of this system.

reference_spacy_tokens: The Episcopal Registers confirm the development of this system .


fn_spacy_tokens_for_baseline: I want the pair of you dressed and off this train in five minutes -- or I swear I 'll drag you off in your pyjamas ! '

source_bert_toks: i want the pair of you dressed and off this train in five minutes - - or i swear i ' ll drag you off in your p ##y ##ja ##mas ! '

reference_raw: I want you two to dress up and get off this train in five minutes - or I promise I'll drag you out in your pajamas!'

reference_spacy_tokens: I want you two to dress up and get off this train in five minutes - or I promise I 'll drag you out in your pajamas ! '


fn_spacy_tokens_for_baseline: I hear that sound again , a pathetic whimper of overwhelmed fear , and I know it is wrong .

source_bert_toks: i hear that sound again , a pathetic whimper of overwhelmed fear , and i know it is wrong .

reference_raw: I hear the sound again, the pathetic whine of overpowered fear, and I know it's wrong.

reference_spacy_tokens: I hear the sound again , the pathetic whine of overpowered fear , and I know it 's wrong .


fn_spacy_tokens_for_baseline: Yes it was very probable that Father Bernard Vaughan would come again to preach .

source_bert_toks: yes it was very probable that father bernard vaughan would come again to preach .

reference_raw: Yes, it was very likely that Father Bernard Vaughan would return to preach.

reference_spacy_tokens: Yes , it was very likely that Father Bernard Vaughan would return to preach .


fn_spacy_tokens_for_baseline: It was the threat of the Americans coming in to replace all aircraft manufacturing for Europe which finally persuaded the Germans they should not back out .

source_bert_toks: it was the threat of the americans coming in to replace all aircraft manufacturing for europe which finally persuaded the germans they should not back out .

reference_raw: It was the threat that Americans would come to replace all aircraft manufacturing for Europe that finally convinced the Germans not to retreat.

reference_spacy_tokens: It was the threat that Americans would come to replace all aircraft manufacturing for Europe that finally convinced the Germans not to retreat .


fn_spacy_tokens_for_baseline: It is an industry which boasts many famous companies -- but it is also driven by the dynamism of many small firms .

source_bert_toks: it is an industry which boasts many famous companies - - but it is also driven by the d ##yna ##mism of many small firms .

reference_raw: It is an industry that boasts many famous companies - but is also driven by the dynamics of many small companies.

reference_spacy_tokens: It is an industry that boasts many famous companies - but is also driven by the dynamics of many small companies .


fn_spacy_tokens_for_baseline: They could raise between them up to ten thousand men in that great remote province ; and at the same time assail the western Douglas strength .

source_bert_toks: they could raise between them up to ten thousand men in that great remote province ; and at the same time ass ##ail the western douglas strength .

reference_raw: In this vast remote province, they could raise up to ten thousand men among them, while attacking the strength of Western Douglas.

reference_spacy_tokens: In this vast remote province , they could raise up to ten thousand men among them , while attacking the strength of Western Douglas .


fn_spacy_tokens_for_baseline: ' You are now aware the neighborhood of Muwallamin belongs to the Islamic State of Iraq , ' the bigger man said .

source_bert_toks: ' you are now aware the neighborhood of mu ##wall ##ami ##n belongs to the islamic state of iraq , ' the bigger man said .

reference_raw: 'Now you know that Muwallamin is part of the Islamic State of Iraq,' said the larger man.

reference_spacy_tokens: ' Now you know that Muwallamin is part of the Islamic State of Iraq , ' said the larger man .


fn_spacy_tokens_for_baseline: She had been nineteen like me , and youth , as I knew , even when its possessor is unattractive , has an appeal of its own .

source_bert_toks: she had been nineteen like me , and youth , as i knew , even when its possess ##or is una ##tt ##ractive , has an appeal of its own .

reference_raw: She was nineteen, like me, and young, I knew, though her owner was unattractive, she had her own appeal.

reference_spacy_tokens: She was nineteen , like me , and young , I knew , though her owner was unattractive , she had her own appeal .


fn_spacy_tokens_for_baseline: The taxi rattled to the side of the road , steam issuing from its bonnet regions .

source_bert_toks: the taxi rattled to the side of the road , steam issuing from its bonnet regions .

reference_raw: The cab rattled to the side of the road, steam emanating from its hooded areas.

reference_spacy_tokens: The cab rattled to the side of the road , steam emanating from its hooded areas .


fn_spacy_tokens_for_baseline: The southern boundary of the District was accordingly modified from the mouth of the Blackwater River in Essex westwards to the Buckinghamshire county boundary .

source_bert_toks: the southern boundary of the district was accordingly modified from the mouth of the black ##water river in essex westward ##s to the buckinghamshire county boundary .

reference_raw: The southern border of the district has therefore been changed from the mouth of the Blackwater River in Essex west to the border of Buckinghamshire.

reference_spacy_tokens: The southern border of the district has therefore been changed from the mouth of the Blackwater River in Essex west to the border of Buckinghamshire .


fn_spacy_tokens_for_baseline: John , who always carries his laptop with him , took a flight from Boston to Paris on the morning of Dec 11th .

source_bert_toks: john , who always carries his laptop with him , took a flight from boston to paris on the morning of dec 11th .

reference_raw: John, always carrying his laptop, flew from Boston to Paris on the morning of December 11th.

reference_spacy_tokens: John , always carrying his laptop , flew from Boston to Paris on the morning of December 11th .


fn_spacy_tokens_for_baseline: Traditional exercises like sit - ups , press - ups and pull - ups are great for strengthening the body , providing that you do them properly .

source_bert_toks: traditional exercises like sit - ups , press - ups and pull - ups are great for strengthening the body , providing that you do them properly .

reference_raw: Traditional exercises, such as sit-ups, push-ups and pull-ups, are excellent for strengthening the body, provided you do them properly.

reference_spacy_tokens: Traditional exercises , such as sit - ups , push - ups and pull - ups , are excellent for strengthening the body , provided you do them properly .


fn_spacy_tokens_for_baseline: But the provinces reneged on the promise ( prompting a spate of civil law suits ) and in 1991 made a silent compact to leave all matters of compensation to Ottawa .

source_bert_toks: but the provinces rene ##ged on the promise ( prompting a spat ##e of civil law suits ) and in 1991 made a silent compact to leave all matters of compensation to ottawa .

reference_raw: However, the provinces gave up their promise (promotion of a space of civil-law suits) and, in 1991, made a silent agreement to leave the matter of compensation to Ottawa.

reference_spacy_tokens: However , the provinces gave up their promise ( promotion of a space of civil - law suits ) and , in 1991 , made a silent agreement to leave the matter of compensation to Ottawa .


fn_spacy_tokens_for_baseline: ' Other titles are bought and ordered in the normal way , but the 2,500 titles represent 80 % of Penguin 's sales . '

source_bert_toks: ' other titles are bought and ordered in the normal way , but the 2 , 500 titles represent 80 % of penguin ' s sales . '

reference_raw: "Other titles are normally purchased and commissioned, but 2,500 titles account for 80% of Penguin's sales."

reference_spacy_tokens: " Other titles are normally purchased and commissioned , but 2,500 titles account for 80 % of Penguin 's sales . "


fn_spacy_tokens_for_baseline: That was the case at North Manchester General Hospital , where Wimpey Construction UK Northern worked alongside staff and patients to build a new £ 18 million wing to the existing hospital .

source_bert_toks: that was the case at north manchester general hospital , where wi ##mp ##ey construction uk northern worked alongside staff and patients to build a new £1 ##8 million wing to the existing hospital .

reference_raw: This was the case at the North Manchester General Hospital, where Wimpey Construction UK Northern worked with employees and patients to build a new 18 million-pound ward for the existing hospital.

reference_spacy_tokens: This was the case at the North Manchester General Hospital , where Wimpey Construction UK Northern worked with employees and patients to build a new 18 million - pound ward for the existing hospital .


fn_spacy_tokens_for_baseline: Marlon had been embarrassed by his mum coming to pick him up from the school disco .

source_bert_toks: marlon had been embarrassed by his mum coming to pick him up from the school disco .

reference_raw: Marlon was ashamed that his mother had come to pick him up from the school disco.

reference_spacy_tokens: Marlon was ashamed that his mother had come to pick him up from the school disco .


fn_spacy_tokens_for_baseline: One expert , whose job is so politically sensitive that he spoke on condition that he would n't be named or quoted , said the expected influx of East European refugees over the next few years will greatly increase the chances of computer - maintenance workers , for example , doubling as foreign spies .

source_bert_toks: one expert , whose job is so politically sensitive that he spoke on condition that he wouldn ' t be named or quoted , said the expected influx of east european refugees over the next few years will greatly increase the chances of computer - maintenance workers , for example , doubling as foreign spies .

reference_raw: One expert, whose work is so politically sensitive that he speaks on the condition that he is not named or quoted, said that the expected influx of refugees from Eastern Europe over the next few years would greatly increase the chances of computer-protection workers, for example, doubling as foreign spies.

reference_spacy_tokens: One expert , whose work is so politically sensitive that he speaks on the condition that he is not named or quoted , said that the expected influx of refugees from Eastern Europe over the next few years would greatly increase the chances of computer - protection workers , for example , doubling as foreign spies .


fn_spacy_tokens_for_baseline: Effective communication will play a vital role in the referendum planned for April 1993 , when citizens will vote for or against an independent Eritrea .

source_bert_toks: effective communication will play a vital role in the referendum planned for april 1993 , when citizens will vote for or against an independent eritrea .

reference_raw: Effective communication will play an important role in the April 1993 referendum, when citizens will vote for or against an independent Eritrea.

reference_spacy_tokens: Effective communication will play an important role in the April 1993 referendum , when citizens will vote for or against an independent Eritrea .


fn_spacy_tokens_for_baseline: They mouldered outside the casa , a - thirst for the gasoline which no longer arrived in Chiguana .

source_bert_toks: they mo ##uld ##ered outside the casa , a - thirst for the gasoline which no longer arrived in chi ##gua ##na .

reference_raw: They molded in front of the casa, a-thirst for gasoline that no longer came to Chiguana.

reference_spacy_tokens: They molded in front of the casa , a - thirst for gasoline that no longer came to Chiguana .


fn_spacy_tokens_for_baseline: I should have been more entertaining company . '

source_bert_toks: i should have been more entertaining company . '

reference_raw: I was supposed to be more fun company.'

reference_spacy_tokens: I was supposed to be more fun company . '


fn_spacy_tokens_for_baseline: This has been complemented , to a lesser extent , by the willingness of other nations ( e.g. , Libya and Syria ) to cooperate within the realm of ballistic missile development .

source_bert_toks: this has been complement ##ed , to a lesser extent , by the willingness of other nations ( e . g . , libya and syria ) to cooperate within the realm of ballistic missile development .

reference_raw: This is supplemented to a lesser extent by the willingness of other countries (e.g. Libya and Syria) to cooperate in the development of ballistic missiles.

reference_spacy_tokens: This is supplemented to a lesser extent by the willingness of other countries ( e.g. Libya and Syria ) to cooperate in the development of ballistic missiles .


fn_spacy_tokens_for_baseline: You sit on your bottom first , you 're kneeling up .

source_bert_toks: you sit on your bottom first , you ' re kneeling up .

reference_raw: First you sit on your ass and get down on your knees.

reference_spacy_tokens: First you sit on your ass and get down on your knees .


fn_spacy_tokens_for_baseline: Hearing that Balsley was not expected to live , Chapman literally scoured France for oranges .

source_bert_toks: hearing that bal ##sley was not expected to live , chapman literally sc ##oured france for orange ##s .

reference_raw: When Chapman heard Balsley wasn't supposed to live, he literally searched France for oranges.

reference_spacy_tokens: When Chapman heard Balsley was n't supposed to live , he literally searched France for oranges .


fn_spacy_tokens_for_baseline: Because the elements are now infinitesimal , the impedance is everywhere Z k. < pb n=216 >

source_bert_toks: because the elements are now infinite ##si ##mal , the imp ##edance is everywhere z k . < p ##b n = 216 >

reference_raw: Since the elements are now infinite, the impedance is everywhere Z k. <pb n=216>

reference_spacy_tokens: Since the elements are now infinite , the impedance is everywhere Z k. < pb n=216 >


fn_spacy_tokens_for_baseline: Dr Jaffery rustled around the room , picking up books and looking behind cushions for his mosque cap before remembering that he was already wearing it .

source_bert_toks: dr ja ##ffer ##y rust ##led around the room , picking up books and looking behind cushions for his mosque cap before remembering that he was already wearing it .

reference_raw: Dr. Jaffery ran around the room, picked up the books, and looked behind the pillows for his mosque cap before he remembered he was wearing it.

reference_spacy_tokens: Dr. Jaffery ran around the room , picked up the books , and looked behind the pillows for his mosque cap before he remembered he was wearing it .


fn_spacy_tokens_for_baseline: We entirely accept the need to avoid a single buyer acquiring too many bus companies .

source_bert_toks: we entirely accept the need to avoid a single buyer acquiring too many bus companies .

reference_raw: We fully accept the need to prevent one purchaser from acquiring too many bus companies.

reference_spacy_tokens: We fully accept the need to prevent one purchaser from acquiring too many bus companies .


fn_spacy_tokens_for_baseline: And now she could see the puzzlement on everyone 's face .

source_bert_toks: and now she could see the puzzle ##ment on everyone ' s face .

reference_raw: Now she saw the confusion on everyone's face.

reference_spacy_tokens: Now she saw the confusion on everyone 's face .


fn_spacy_tokens_for_baseline: A EUROPEAN ruling today pushed Britain closer to being placed in the dock over the killing by SAS soldiers in Gibraltar of three IRA terrorists .

source_bert_toks: a european ruling today pushed britain closer to being placed in the dock over the killing by sas soldiers in gibraltar of three ira terrorists .

reference_raw: The European ruling today pushed Britain closer to being placed on the docks for the murder of three IRA terrorists by SAS troops in Gibraltar.

reference_spacy_tokens: The European ruling today pushed Britain closer to being placed on the docks for the murder of three IRA terrorists by SAS troops in Gibraltar .


fn_spacy_tokens_for_baseline: The maximum punishment is non - receipt of the medals and a disrepute charge . '

source_bert_toks: the maximum punishment is non - receipt of the medals and a di ##sr ##ep ##ute charge . '

reference_raw: "The maximum sentence is not to receive medals or false accusations."

reference_spacy_tokens: " The maximum sentence is not to receive medals or false accusations . "


fn_spacy_tokens_for_baseline: It is certainly verified experimentally that the sonic clicks produced are both highly structured and directional .

source_bert_toks: it is certainly verified experimental ##ly that the sonic clicks produced are both highly structured and directional .

reference_raw: It is clear that the sonic clicks produced are both highly structured and directional.

reference_spacy_tokens: It is clear that the sonic clicks produced are both highly structured and directional .


fn_spacy_tokens_for_baseline: That 's shaken them up a bit , I expect . '

source_bert_toks: that ' s shaken them up a bit , i expect . '

reference_raw: I suppose that's a bit of a shock to them.'

reference_spacy_tokens: I suppose that 's a bit of a shock to them . '


fn_spacy_tokens_for_baseline: The far left had some good issues even if it did not have good programs for dealing with them .

source_bert_toks: the far left had some good issues even if it did not have good programs for dealing with them .

reference_raw: There were some good problems on the far-left side, though there were no good programs to deal with them.

reference_spacy_tokens: There were some good problems on the far - left side , though there were no good programs to deal with them .


fn_spacy_tokens_for_baseline: Most idioms are homophonous with grammatically well - formed transparent expressions .

source_bert_toks: most id ##ioms are homo ##phon ##ous with grammatical ##ly well - formed transparent expressions .

reference_raw: Most idioms are homophony with grammatically well-formed transparent expressions.

reference_spacy_tokens: Most idioms are homophony with grammatically well - formed transparent expressions .


fn_spacy_tokens_for_baseline: The item was deferred until the full council meets on November 26 .

source_bert_toks: the item was def ##erre ##d until the full council meets on november 26 .

reference_raw: The item was postponed until the full Council meeting on November 26th.

reference_spacy_tokens: The item was postponed until the full Council meeting on November 26th .


fn_spacy_tokens_for_baseline: I returned it , she slammed it back , I caught it neatly , spun round and delivered a deft backward glance over my left shoulder .

source_bert_toks: i returned it , she slammed it back , i caught it neatly , spun round and delivered a def ##t backward glance over my left shoulder .

reference_raw: I gave it back, she hit it back, and I caught it neatly, turned, and gave me a deft look back over my left shoulder.

reference_spacy_tokens: I gave it back , she hit it back , and I caught it neatly , turned , and gave me a deft look back over my left shoulder .


fn_spacy_tokens_for_baseline: The New Territories can be explored by taking the Kowloon - Canton Railway ( KCR ) , which makes 10 stops between the station in Kowloon and Sheung Shui , the last stop before entering China .

source_bert_toks: the new territories can be explored by taking the ko ##wl ##oon - canton railway ( kc ##r ) , which makes 10 stops between the station in ko ##wl ##oon and she ##ung shu ##i , the last stop before entering china .

reference_raw: The new territories can be examined by using the Kowloon-Canton railway (KCR), which makes 10 stops between Kowloon and Sheung Shui, the last stop before entering China.

reference_spacy_tokens: The new territories can be examined by using the Kowloon - Canton railway ( KCR ) , which makes 10 stops between Kowloon and Sheung Shui , the last stop before entering China .


fn_spacy_tokens_for_baseline: One of them , Gerard Cochran , boasted that he personally ' would kill Joseph and scalp him and wear his scalp as a bridle ' .

source_bert_toks: one of them , gerard cochran , boasted that he personally ' would kill joseph and scalp him and wear his scalp as a br ##id ##le ' .

reference_raw: One of them, Gerard Cochran, boasted that he would personally "kill Joseph, skin him, and wear his skull like a bridle."

reference_spacy_tokens: One of them , Gerard Cochran , boasted that he would personally " kill Joseph , skin him , and wear his skull like a bridle . "


fn_spacy_tokens_for_baseline: In fact , you have a particular feeling , that they have collided : a foreshadowing of the physical confrontation of sex .

source_bert_toks: in fact , you have a particular feeling , that they have collided : a fore ##sha ##do ##wing of the physical confrontation of sex .

reference_raw: In fact, you have a special feeling that they've collided: a prelude to the physical confrontation of sex.

reference_spacy_tokens: In fact , you have a special feeling that they 've collided : a prelude to the physical confrontation of sex .


fn_spacy_tokens_for_baseline: He believed that , by its means , we could arrive at certainty on such matters .

source_bert_toks: he believed that , by its means , we could arrive at certainty on such matters .

reference_raw: He believed that, through his means, we could be certain of such matters.

reference_spacy_tokens: He believed that , through his means , we could be certain of such matters .


fn_spacy_tokens_for_baseline: As it appears from his zip top I smack my right fist into his face .

source_bert_toks: as it appears from his zip top i smack my right fist into his face .

reference_raw: As he emerges from the top of his zip, I slap him in the face with my right fist.

reference_spacy_tokens: As he emerges from the top of his zip , I slap him in the face with my right fist .


fn_spacy_tokens_for_baseline: ' What do you mean to do , ' demanded Harry , looking fiercely up at him from under drawn brows , ' now that you 've tricked me into this betrayal ?

source_bert_toks: ' what do you mean to do , ' demanded harry , looking fiercely up at him from under drawn brows , ' now that you ' ve tricked me into this betrayal ?

reference_raw: 'What are you going to do,' said Harry, looking wildly at him from beneath his drawn eyebrows, 'now that you've deceived me into this treachery?

reference_spacy_tokens: ' What are you going to do , ' said Harry , looking wildly at him from beneath his drawn eyebrows , ' now that you 've deceived me into this treachery ?


fn_spacy_tokens_for_baseline: Levi - Strauss ' argument that the incest taboo marks the crucial bridge between nature and culture is untenable in the form in which it was originally propounded , since it is contradicted by the ethnographic evidence .

source_bert_toks: levi - strauss ' argument that the inc ##est taboo marks the crucial bridge between nature and culture is un ##ten ##able in the form in which it was originally prop ##ounded , since it is contra ##dict ##ed by the et ##hn ##ographic evidence .

reference_raw: The argument put forward by Levi-Strauss that the incest taboo marks a key bridge between nature and culture is unsustainable in the form in which it was originally propounded, since it is contrary to the ethnographic evidence.

reference_spacy_tokens: The argument put forward by Levi - Strauss that the incest taboo marks a key bridge between nature and culture is unsustainable in the form in which it was originally propounded , since it is contrary to the ethnographic evidence .


fn_spacy_tokens_for_baseline: In Vienna the interception of letters became under Metternich more frequent than ever before .

source_bert_toks: in vienna the interception of letters became under met ##tern ##ich more frequent than ever before .

reference_raw: In Vienna, letters were intercepted more frequently than ever in Metternich.

reference_spacy_tokens: In Vienna , letters were intercepted more frequently than ever in Metternich .


fn_spacy_tokens_for_baseline: Criticisms from ex - players , in my opinion , are nothing but sour grapes .

source_bert_toks: criticisms from ex - players , in my opinion , are nothing but sour grapes .

reference_raw: The criticisms of former players, in my opinion, are nothing more than bitter grapes.

reference_spacy_tokens: The criticisms of former players , in my opinion , are nothing more than bitter grapes .


fn_spacy_tokens_for_baseline: On the night of 15 June 1908 , a tremendous blaze gutted much of the mill .

source_bert_toks: on the night of 15 june 1908 , a tremendous blaze gut ##ted much of the mill .

reference_raw: On the night of June 15, 1908, a huge fire eviscerated most of the mill.

reference_spacy_tokens: On the night of June 15 , 1908 , a huge fire eviscerated most of the mill .


fn_spacy_tokens_for_baseline: Detectives believe a New York Mafia family , who planned to ' launder ' the bonds , sent a hitman to silence Thomas before he could name names .

source_bert_toks: detectives believe a new york mafia family , who planned to ' lau ##nder ' the bonds , sent a hit ##man to silence thomas before he could name names .

reference_raw: Detectives believe that the New York mob family, planning to "launder" the bonds, sent a hit man to shut Thomas down before he could name names.

reference_spacy_tokens: Detectives believe that the New York mob family , planning to " launder " the bonds , sent a hit man to shut Thomas down before he could name names .


fn_spacy_tokens_for_baseline: A nice man , he canvasses in anorak and crew - neck jumper ; Cranston wears pin striped suit , Crombie overcoat and refulgent black shoes .

source_bert_toks: a nice man , he canvas ##ses in an ##ora ##k and crew - neck jumper ; cr ##ans ##ton wears pin striped suit , cr ##om ##bie over ##coat and ref ##ul ##gent black shoes .

reference_raw: He was a handsome man, dressed in anorak and a crew-neck jumper; Cranston was wearing a pin-striped suit, Crombie's coat, and refilling black boots.

reference_spacy_tokens: He was a handsome man , dressed in anorak and a crew - neck jumper ; Cranston was wearing a pin - striped suit , Crombie 's coat , and refilling black boots .


fn_spacy_tokens_for_baseline: But with her view of her caller blocked by the open door and her guest , Leith was in too much of a dilemma just then to be too infuriated by the liberty he had taken .

source_bert_toks: but with her view of her caller blocked by the open door and her guest , leith was in too much of a dilemma just then to be too in ##fur ##iated by the liberty he had taken .

reference_raw: But with the sight of her caller locked by the open door and her guest, Leith was in too much trouble for the freedom he had taken.

reference_spacy_tokens: But with the sight of her caller locked by the open door and her guest , Leith was in too much trouble for the freedom he had taken .


fn_spacy_tokens_for_baseline: As it was only a few minutes before the shop closed , he forbore to detail the checkout girl with his usual badinage about the finer points of philosophy or astrophysics .

source_bert_toks: as it was only a few minutes before the shop closed , he for ##bor ##e to detail the check ##out girl with his usual bad ##ina ##ge about the finer points of philosophy or astro ##physics .

reference_raw: Since it was only a few minutes before the shop closed, he refrained from detailing the cashier with his usual mischief about the better points of philosophy and astrophysics.

reference_spacy_tokens: Since it was only a few minutes before the shop closed , he refrained from detailing the cashier with his usual mischief about the better points of philosophy and astrophysics .


fn_spacy_tokens_for_baseline: Ben jiggled his buttocks on the hard wooden bench , one cheek to the other , hands jammed beneath his legs .

source_bert_toks: ben ji ##ggle ##d his butt ##ocks on the hard wooden bench , one cheek to the other , hands jammed beneath his legs .

reference_raw: Ben jerked his butts on a hard wooden bench, face to face, hands stuck under his feet.

reference_spacy_tokens: Ben jerked his butts on a hard wooden bench , face to face , hands stuck under his feet .


fn_spacy_tokens_for_baseline: The project concluded with an attempt to match design ability against some criterea for distinct types of ' intelligence ' , in an attempt to establish design intelligence as one of those distinct types .

source_bert_toks: the project concluded with an attempt to match design ability against some cr ##iter ##ea for distinct types of ' intelligence ' , in an attempt to establish design intelligence as one of those distinct types .

reference_raw: The project ended with an attempt to match the design capabilities against certain criteria for different types of 'intelligence' in order to establish design intelligence as one of these different types.

reference_spacy_tokens: The project ended with an attempt to match the design capabilities against certain criteria for different types of ' intelligence ' in order to establish design intelligence as one of these different types .


fn_spacy_tokens_for_baseline: She wore a cream linen suit , a black straw boater , and black gloves .

source_bert_toks: she wore a cream linen suit , a black straw boat ##er , and black gloves .

reference_raw: She was wearing a cream linen suit, a black straw boat, and black gloves.

reference_spacy_tokens: She was wearing a cream linen suit , a black straw boat , and black gloves .


fn_spacy_tokens_for_baseline: Three days later Abbot Kenneth himself christened the baby .

source_bert_toks: three days later abbot kenneth himself christ ##ened the baby .

reference_raw: Three days later, the child was baptized by Abbot Kenneth himself.

reference_spacy_tokens: Three days later , the child was baptized by Abbot Kenneth himself .


fn_spacy_tokens_for_baseline: Crumble the softened butter into the flour , sprinkling in the rice flour or cornflour at intervals , as and when the butter seems to be getting sticky .

source_bert_toks: cr ##umble the softened butter into the flour , sp ##rin ##kling in the rice flour or corn ##fl ##our at intervals , as and when the butter seems to be getting sticky .

reference_raw: Break the soft butter into flour and spray it with rice flour or corn flour at intervals, as and when the butter appears to be sticky.

reference_spacy_tokens: Break the soft butter into flour and spray it with rice flour or corn flour at intervals , as and when the butter appears to be sticky .


fn_spacy_tokens_for_baseline: Call - note of drake a whistling ' crrick , crrick ' , of duck a short , high - pitched quack ; courting parties in spring utter a chorus of bell - like notes .

source_bert_toks: call - note of drake a whistling ' cr ##rick , cr ##rick ' , of duck a short , high - pitched qu ##ack ; court ##ing parties in spring utter a chorus of bell - like notes .

reference_raw: The call-note of the whistling "crick, crrick" of the duck a short, high-pitched charlatan; the courting parties in the spring utter a chorus of bell-like notes.

reference_spacy_tokens: The call - note of the whistling " crick , crrick " of the duck a short , high - pitched charlatan ; the courting parties in the spring utter a chorus of bell - like notes .


fn_spacy_tokens_for_baseline: Instead Westminster Bank made him a junior at its Darlington branch : ' I did all the jobs from making the tea to fetching the ledgers from the safe . '

source_bert_toks: instead westminster bank made him a junior at its darlington branch : ' i did all the jobs from making the tea to fetch ##ing the ledger ##s from the safe . '

reference_raw: Instead, Westminster Bank made him a junior at his Darlington branch: 'I've done all the work from making tea to getting the books out of the vault.'

reference_spacy_tokens: Instead , Westminster Bank made him a junior at his Darlington branch : ' I 've done all the work from making tea to getting the books out of the vault . '


fn_spacy_tokens_for_baseline: The party may well face further depletion with the expected defection of some members to set up yet another social democratic opposition party .

source_bert_toks: the party may well face further de ##ple ##tion with the expected defect ##ion of some members to set up yet another social democratic opposition party .

reference_raw: With the expected failure of some members to establish another social democratic opposition party, the party may well face further exhaustion.

reference_spacy_tokens: With the expected failure of some members to establish another social democratic opposition party , the party may well face further exhaustion .


fn_spacy_tokens_for_baseline: Now a select committee has ruled that broadcasts are not privileged .

source_bert_toks: now a select committee has ruled that broadcasts are not privileged .

reference_raw: The select committee has now decided that broadcasts are not privileged.

reference_spacy_tokens: The select committee has now decided that broadcasts are not privileged .


fn_spacy_tokens_for_baseline: And in the third part , ' Tuami glanced back at the gap through the mountain and saw that it was full of golden light and the sun was sitting in it ' .

source_bert_toks: and in the third part , ' tu ##ami glanced back at the gap through the mountain and saw that it was full of golden light and the sun was sitting in it ' .

reference_raw: And in the third part,' Tuami looked back at the hole in the mountain and saw that it was filled with golden light and that the sun sat in it.

reference_spacy_tokens: And in the third part , ' Tuami looked back at the hole in the mountain and saw that it was filled with golden light and that the sun sat in it .


fn_spacy_tokens_for_baseline: Peach recalled the fat moustached man in the croupier 's jacket who had picked up the note she had delivered on her way home from school .

source_bert_toks: peach recalled the fat mo ##ust ##ache ##d man in the cr ##ou ##pie ##r ' s jacket who had picked up the note she had delivered on her way home from school .

reference_raw: Peach remembered a fat, mustached man in a croupier's jacket who had picked up a note she had delivered on the way home from school.

reference_spacy_tokens: Peach remembered a fat , mustached man in a croupier 's jacket who had picked up a note she had delivered on the way home from school .


fn_spacy_tokens_for_baseline: Shrouded in mystery : Fog surrounds a police tent covering the spot where James Bulger was found on Sunday

source_bert_toks: sh ##roud ##ed in mystery : fog surrounds a police tent covering the spot where james bulge ##r was found on sunday

reference_raw: The fog encircles a police tent covering the spot where James Bulger was found on Sunday.

reference_spacy_tokens: The fog encircles a police tent covering the spot where James Bulger was found on Sunday .


fn_spacy_tokens_for_baseline: He hooked a finger into the corner of his mouth , as though he was versifying on the spot .

source_bert_toks: he hooked a finger into the corner of his mouth , as though he was ve ##rs ##ifying on the spot .

reference_raw: He put a finger to the corner of his mouth, as if to verify it on the spot.

reference_spacy_tokens: He put a finger to the corner of his mouth , as if to verify it on the spot .


fn_spacy_tokens_for_baseline: Sally Baker looked surprised at the question .

source_bert_toks: sally baker looked surprised at the question .

reference_raw: Sally Baker looked startled.

reference_spacy_tokens: Sally Baker looked startled .


fn_spacy_tokens_for_baseline: So , start your children off on a lifetime 's love of books , a future of eager learning .

source_bert_toks: so , start your children off on a lifetime ' s love of books , a future of eager learning .

reference_raw: So start your kids with the love of books, the future of eager learning.

reference_spacy_tokens: So start your kids with the love of books , the future of eager learning .


fn_spacy_tokens_for_baseline: I must stress that we are looking primarily , or we propose to look primarily , er , at the east of the county .

source_bert_toks: i must stress that we are looking primarily , or we propose to look primarily , er , at the east of the county .

reference_raw: I'd like to point out that we're looking first, or we suggest we look first and foremost in, uh, the eastern part of the county.

reference_spacy_tokens: I 'd like to point out that we 're looking first , or we suggest we look first and foremost in , uh , the eastern part of the county .


fn_spacy_tokens_for_baseline: Her monograph , The Metabolism of Fat , published in 1943 as the first of Methuen 's monographs in biochemistry , summarized her views on the field , in which she was by then a recognized authority .

source_bert_toks: her monograph , the metabolism of fat , published in 1943 as the first of met ##hue ##n ' s monograph ##s in biochemistry , summarized her views on the field , in which she was by then a recognized authority .

reference_raw: Her monogram, the Metabolism of Fat, published in 1943 as the first of Methuen's biochemistry monograms, summarized her views on the field in which she was now a recognised authority.

reference_spacy_tokens: Her monogram , the Metabolism of Fat , published in 1943 as the first of Methuen 's biochemistry monograms , summarized her views on the field in which she was now a recognised authority .


fn_spacy_tokens_for_baseline: But when I got to be twenty - one , I was astonished at how much he had learned in seven years .

source_bert_toks: but when i got to be twenty - one , i was astonished at how much he had learned in seven years .

reference_raw: But when I was twenty-one, I wondered what he had learned in seven years.

reference_spacy_tokens: But when I was twenty - one , I wondered what he had learned in seven years .


fn_spacy_tokens_for_baseline: The majority of the beef raised is sold to satisfy the enormous appetite of the USA .

source_bert_toks: the majority of the beef raised is sold to satisfy the enormous appetite of the usa .

reference_raw: Most of the beef produced is sold to satisfy the great appetites of the United States.

reference_spacy_tokens: Most of the beef produced is sold to satisfy the great appetites of the United States .


fn_spacy_tokens_for_baseline: This has been complemented , to a lesser extent , by the willingness of other nations ( e.g. , Libya and Syria ) to cooperate within the realm of ballistic missile development .

source_bert_toks: this has been complement ##ed , to a lesser extent , by the willingness of other nations ( e . g . , libya and syria ) to cooperate within the realm of ballistic missile development .

reference_raw: To a lesser extent, other countries (e.g. Libya and Syria) are willing to cooperate in the development of ballistic missiles.

reference_spacy_tokens: To a lesser extent , other countries ( e.g. Libya and Syria ) are willing to cooperate in the development of ballistic missiles .


fn_spacy_tokens_for_baseline: Woodsmoke and the pungent aroma of apples and Michaelmas daisies spiced the dusk .

source_bert_toks: woods ##mo ##ke and the pun ##gent aroma of apples and michael ##mas dai ##sies spice ##d the dusk .

reference_raw: Woodsmoke and the pungent smell of apples and michaelmas daisies spiced the gloom.

reference_spacy_tokens: Woodsmoke and the pungent smell of apples and michaelmas daisies spiced the gloom .


fn_spacy_tokens_for_baseline: An additional piece of evidence from the Senate : Holding other factors constant , such as incumbency advantages and regional factors , the difference between popular votes for Republican presidential and senatorial candidates in states conducting a Senate election turns out to be a positive function of how onerous the federal government 's tax burden is per state ( a progressive tax rate hits higher - income states harder ) .

source_bert_toks: an additional piece of evidence from the senate : holding other factors constant , such as inc ##umb ##ency advantages and regional factors , the difference between popular votes for republican presidential and senator ##ial candidates in states conducting a senate election turns out to be a positive function of how one ##rous the federal government ' s tax burden is per state ( a progressive tax rate hits higher - income states harder ) .

reference_raw: Other evidence from the Senate: keeping other factors constant, such as incumbency benefits and regional factors, the difference between the popular votes of Republican presidential and senatorial candidates in the states holding the Senate elections proves to be a positive function of the burden of the federal government's tax burden on the state (the progressive tax rate hits higher income countries harder).

reference_spacy_tokens: Other evidence from the Senate : keeping other factors constant , such as incumbency benefits and regional factors , the difference between the popular votes of Republican presidential and senatorial candidates in the states holding the Senate elections proves to be a positive function of the burden of the federal government 's tax burden on the state ( the progressive tax rate hits higher income countries harder ) .


fn_spacy_tokens_for_baseline: On Monday , three eyewitnesses to the slayings and one surviving victim were cross - examined by the man they said was the killer .

source_bert_toks: on monday , three eye ##wi ##tness ##es to the sl ##ay ##ings and one surviving victim were cross - examined by the man they said was the killer .

reference_raw: On Monday, three witnesses to the murders and one surviving victim were cross-checked by the man they said was the killer.

reference_spacy_tokens: On Monday , three witnesses to the murders and one surviving victim were cross - checked by the man they said was the killer .


fn_spacy_tokens_for_baseline: ' He 'd do that all right but look at what he 's getting mixed up ' It may be just talk , ' she ventured edgily .

source_bert_toks: ' he ' d do that all right but look at what he ' s getting mixed up ' it may be just talk , ' she ventured ed ##gil ##y .

reference_raw: 'He'd do it well, but look what he's getting into, 'Maybe it's just talk,' she said edgyly.

reference_spacy_tokens: ' He 'd do it well , but look what he 's getting into , ' Maybe it 's just talk , ' she said edgyly .


fn_spacy_tokens_for_baseline: She paused a moment , turned and looked at the line of narrow drawers , read the label , then weighed out two ounces of loose tobacco .

source_bert_toks: she paused a moment , turned and looked at the line of narrow drawers , read the label , then weighed out two ounce ##s of loose tobacco .

reference_raw: She paused for a moment, turned, looked down at the row of narrow drawers, read the label, and weighed the two occupies of loose tobacco.

reference_spacy_tokens: She paused for a moment , turned , looked down at the row of narrow drawers , read the label , and weighed the two occupies of loose tobacco .


fn_spacy_tokens_for_baseline: The government 's praiseworthy efforts to improve efficiency in health and education have been undermined by too little cash .

source_bert_toks: the government ' s praise ##worthy efforts to improve efficiency in health and education have been undermine ##d by too little cash .

reference_raw: Too little money has undermined the government's commendable efforts to improve the efficiency of health and education.

reference_spacy_tokens: Too little money has undermined the government 's commendable efforts to improve the efficiency of health and education .


fn_spacy_tokens_for_baseline: Pyongyang was also required to " consistently take steps to implement the North - South Joint Declaration on the Denuclearization of the Korean Peninsula , " and remain a party to the NPT .

source_bert_toks: p ##yon ##gy ##ang was also required to " consistently take steps to implement the north - south joint declaration on the den ##uc ##lea ##rization of the korean peninsula , " and remain a party to the np ##t .

reference_raw: Pyongyang was also required to "consistently take action to implement the North-South Joint Declaration on Denuclearisation of the Korean Peninsula" and remain a party to the NPT.

reference_spacy_tokens: Pyongyang was also required to " consistently take action to implement the North - South Joint Declaration on Denuclearisation of the Korean Peninsula " and remain a party to the NPT .


fn_spacy_tokens_for_baseline: In desperation , Forman had hatched the scheme to rob the bank .

source_bert_toks: in desperation , form ##an had hatch ##ed the scheme to rob the bank .

reference_raw: Desperately, Forman devised a plan to rob a bank.

reference_spacy_tokens: Desperately , Forman devised a plan to rob a bank .


fn_spacy_tokens_for_baseline: City workers pretended to be victims of the attack .

source_bert_toks: city workers pretended to be victims of the attack .

reference_raw: The town workers pretended to be the victims of the attack.

reference_spacy_tokens: The town workers pretended to be the victims of the attack .


fn_spacy_tokens_for_baseline: In any case , I believe Eliot admired the thrillers of the prolific E. Phillips Oppenheim , who was published in the yellow - backed series to which he more than once referred as a possible source of inspiration .

source_bert_toks: in any case , i believe eliot admired the thriller ##s of the prolific e . phillips op ##pen ##heim , who was published in the yellow - backed series to which he more than once referred as a possible source of inspiration .

reference_raw: Anyway, I think Eliot admired the exciting E. Phillips Oppenheim, which was published in a yellow-backed series to which he had referred more than once as a potential source of inspiration.

reference_spacy_tokens: Anyway , I think Eliot admired the exciting E. Phillips Oppenheim , which was published in a yellow - backed series to which he had referred more than once as a potential source of inspiration .


fn_spacy_tokens_for_baseline: Eventually at about 10 pm she slurred : ' What time did you say we would have dinner ? '

source_bert_toks: eventually at about 10 ##pm she sl ##ur ##red : ' what time did you say we would have dinner ? '

reference_raw: At about ten o'clock she said, "When did you say we were going to have dinner?"

reference_spacy_tokens: At about ten o'clock she said , " When did you say we were going to have dinner ? "


fn_spacy_tokens_for_baseline: I would help with the preparation of a meal for all the men who were doing the work .

source_bert_toks: i would help with the preparation of a meal for all the men who were doing the work .

reference_raw: I'd help prepare food for all the men who did the job.

reference_spacy_tokens: I 'd help prepare food for all the men who did the job .


fn_spacy_tokens_for_baseline: The French expeditionary forces numbered 250000 men .

source_bert_toks: the french expeditionary forces numbered 2500 ##00 men .

reference_raw: The French expeditionary forces had a total of 250,000 men.

reference_spacy_tokens: The French expeditionary forces had a total of 250,000 men .


fn_spacy_tokens_for_baseline: The stink of gasoline filled the air and the Prophet 's eyes widened in shocked disbelief .

source_bert_toks: the stink of gasoline filled the air and the prophet ' s eyes widened in shocked disbelief .

reference_raw: The smell of gasoline filled the air, and the Prophet's eyes widened in shocked disbelief.

reference_spacy_tokens: The smell of gasoline filled the air , and the Prophet 's eyes widened in shocked disbelief .


fn_spacy_tokens_for_baseline: ' You do n't have to tell me that ! ' she snorted .

source_bert_toks: ' you don ' t have to tell me that ! ' she snorted .

reference_raw: "Don't tell me!" she sniffed.

reference_spacy_tokens: " Do n't tell me ! " she sniffed .


fn_spacy_tokens_for_baseline: I hope I can communicate with you through the Messenger before you depart Turkey .

source_bert_toks: i hope i can communicate with you through the messenger before you depart turkey .

reference_raw: I'm hoping to get in touch with you through the Messenger before you leave Turkey.

reference_spacy_tokens: I 'm hoping to get in touch with you through the Messenger before you leave Turkey .


fn_spacy_tokens_for_baseline: It was indeed Mrs. Mounce yet again , and in her frilly nightwear , but Bob did not throw her downstairs and break her neck .

source_bert_toks: it was indeed mrs . mo ##unce yet again , and in her fr ##illy night ##wear , but bob did not throw her downstairs and break her neck .

reference_raw: It was Mrs. Mounce again, and in her frigid nightgown, but Bob didn't throw her down and break her neck.

reference_spacy_tokens: It was Mrs. Mounce again , and in her frigid nightgown , but Bob did n't throw her down and break her neck .


fn_spacy_tokens_for_baseline: If you do feel revolted when you watch the patient eat , you should not feel guilty about it , but neither should you let yourself become irritable with the patient over it .

source_bert_toks: if you do feel revolt ##ed when you watch the patient eat , you should not feel guilty about it , but neither should you let yourself become ir ##rita ##ble with the patient over it .

reference_raw: If you feel disgusted watching a patient eat, you shouldn't feel guilty about it, but you shouldn't be upset about it either.

reference_spacy_tokens: If you feel disgusted watching a patient eat , you should n't feel guilty about it , but you should n't be upset about it either .


fn_spacy_tokens_for_baseline: THE players of the English Shakespeare Company have been wowing audiences in the African bush with a production of Macbeth .

source_bert_toks: the players of the english shakespeare company have been wow ##ing audiences in the african bush with a production of macbeth .

reference_raw: Players from the English Shakespeare Company were worshipping audiences in the African bush with Macbeth's production.

reference_spacy_tokens: Players from the English Shakespeare Company were worshipping audiences in the African bush with Macbeth 's production .


fn_spacy_tokens_for_baseline: Diego told her of his sick uncle and of the request from the bishop .

source_bert_toks: diego told her of his sick uncle and of the request from the bishop .

reference_raw: Diego spoke to her about his sick uncle and the Bishop's request.

reference_spacy_tokens: Diego spoke to her about his sick uncle and the Bishop 's request .


fn_spacy_tokens_for_baseline: The court 's decision was based on a finding that M Touvier had not acted in the context of a ' concerted plan of extermination ' by the state .

source_bert_toks: the court ' s decision was based on a finding that m to ##u ##vier had not acted in the context of a ' concert ##ed plan of ex ##ter ##mina ##tion ' by the state .

reference_raw: The decision of the court was based on the finding that M Touvier had not acted in the context of the State's "concerned plan to exterminate."

reference_spacy_tokens: The decision of the court was based on the finding that M Touvier had not acted in the context of the State 's " concerned plan to exterminate . "


fn_spacy_tokens_for_baseline: The route then follows the Ebor Way for a stretch before veering off right just before Hollin Hill Plantation .

source_bert_toks: the route then follows the e ##bor way for a stretch before ve ##ering off right just before ho ##llin hill plantation .

reference_raw: The route then follows the Ebor Way for a stretch before turning off just before the Hollin Hill plantation.

reference_spacy_tokens: The route then follows the Ebor Way for a stretch before turning off just before the Hollin Hill plantation .


fn_spacy_tokens_for_baseline: Nylon does have an exasperating trait of expanding in the wet and cold , causing the fly to sag .

source_bert_toks: nylon does have an ex ##as ##per ##ating trait of expanding in the wet and cold , causing the fly to sa ##g .

reference_raw: Nylon has an irritating feature of growing wet and cold, causing the fly to sag.

reference_spacy_tokens: Nylon has an irritating feature of growing wet and cold , causing the fly to sag .


fn_spacy_tokens_for_baseline: But minutes later , this carjacking took a deadly new twist .

source_bert_toks: but minutes later , this car ##jack ##ing took a deadly new twist .

reference_raw: But a few minutes later, the car-jacking took a lethal new turn.

reference_spacy_tokens: But a few minutes later , the car - jacking took a lethal new turn .