fn_spacy_tokens_for_baseline: Suddenly he reached out and tugged a small , black feather from the fringe of his cloak .

source_bert_toks: suddenly he reached out and tugged a small , black feather from the fringe of his cloak .

reference_raw: Suddenly he reached out and pulled a small black feather from the edge of his cloak.

reference_spacy_tokens: Suddenly he reached out and pulled a small black feather from the edge of his cloak .


fn_spacy_tokens_for_baseline: Stalin 's corpse had n't even grown cold before they had taken Beria , the dead leader 's chief henchman and the most powerful chairman the KGB had ever had , dragged him screaming out of a Politburo meeting and shot him .

source_bert_toks: stalin ' s corpse hadn ' t even grown cold before they had taken be ##ria , the dead leader ' s chief hen ##chman and the most powerful chairman the kgb had ever had , dragged him screaming out of a pol ##it ##buro meeting and shot him .

reference_raw: Stalin's body had not even cooled down before he was captured by Beria, the head of the dead leader and the most powerful chairman of the KGB, who had dragged him screaming out of the Politburo meeting and shot him.

reference_spacy_tokens: Stalin 's body had not even cooled down before he was captured by Beria , the head of the dead leader and the most powerful chairman of the KGB , who had dragged him screaming out of the Politburo meeting and shot him .


fn_spacy_tokens_for_baseline: They have been melded together , giving rise to a fascinating national identity .

source_bert_toks: they have been mel ##ded together , giving rise to a fascinating national identity .

reference_raw: They were melded together, creating a fascinating national identity.

reference_spacy_tokens: They were melded together , creating a fascinating national identity .


fn_spacy_tokens_for_baseline: Towering mountains surround the village and the area around St Anton is fantastic for walking .

source_bert_toks: towering mountains surround the village and the area around st anton is fantastic for walking .

reference_raw: The village is surrounded by towering mountains, and the area around St. Anton is great for walking.

reference_spacy_tokens: The village is surrounded by towering mountains , and the area around St. Anton is great for walking .


fn_spacy_tokens_for_baseline: Both young and old go through ballet - like movements in slow motion to discipline the mind and body .

source_bert_toks: both young and old go through ballet - like movements in slow motion to discipline the mind and body .

reference_raw: Both the young and the old pass through the ballet - like slow movements to discipline the mind and body.

reference_spacy_tokens: Both the young and the old pass through the ballet - like slow movements to discipline the mind and body .


fn_spacy_tokens_for_baseline: He believes , therefore , that his criticism of identity at the same time helps to put a stop to this virulent and mystifying doctrine .

source_bert_toks: he believes , therefore , that his criticism of identity at the same time helps to put a stop to this vi ##ru ##lent and my ##sti ##fying doctrine .

reference_raw: He therefore believes that his criticism of identity also helps to put an end to this virulent and mysterious doctrine.

reference_spacy_tokens: He therefore believes that his criticism of identity also helps to put an end to this virulent and mysterious doctrine .


fn_spacy_tokens_for_baseline: Plant up arrangements in bulb bowls and planters choosing bulbs which are at the same stage of development .

source_bert_toks: plant up arrangements in bulb bowls and plant ##ers choosing bulbs which are at the same stage of development .

reference_raw: Plant the arrangements in bulb bowls and plants selecting bulbs at the same stage of development.

reference_spacy_tokens: Plant the arrangements in bulb bowls and plants selecting bulbs at the same stage of development .


fn_spacy_tokens_for_baseline: For about 4000 years , the Archaics thrived in a culture that included many signs of early civilization .

source_bert_toks: for about 4000 years , the archaic ##s thrive ##d in a culture that included many signs of early civilization .

reference_raw: The archaics have prospered for some 4,000 years in a culture that contains many signs of early civilization.

reference_spacy_tokens: The archaics have prospered for some 4,000 years in a culture that contains many signs of early civilization .


fn_spacy_tokens_for_baseline: Stephen 's eyes flared angrily .

source_bert_toks: stephen ' s eyes flared angrily .

reference_raw: Stephen's eyes blazed angrily.

reference_spacy_tokens: Stephen 's eyes blazed angrily .


fn_spacy_tokens_for_baseline: Pascoe walked down the hallway , still feeling a little light - headed .

source_bert_toks: pas ##coe walked down the hallway , still feeling a little light - headed .

reference_raw: Pascoe walked down the corridor, still slightly light-headed.

reference_spacy_tokens: Pascoe walked down the corridor , still slightly light - headed .


fn_spacy_tokens_for_baseline: We grieve for my brother .

source_bert_toks: we gr ##ie ##ve for my brother .

reference_raw: We're mourning my brother.

reference_spacy_tokens: We 're mourning my brother .


fn_spacy_tokens_for_baseline: Israel has insisted that Abbas ' vow to quell the violence requires him to round up fighters , confiscate weapons and dismantle the makeshift factories where bombs and Kassam rockets are made .

source_bert_toks: israel has insisted that abbas ' vow to que ##ll the violence requires him to round up fighters , con ##fi ##sca ##te weapons and di ##sman ##tle the makeshift factories where bombs and ka ##ssa ##m rockets are made .

reference_raw: Israel insists that Abbas' promise of suppressing violence requires that he gather fighters, seize weapons, and dismantle makeshift factories where bombs and Kassam missiles are made.

reference_spacy_tokens: Israel insists that Abbas ' promise of suppressing violence requires that he gather fighters , seize weapons , and dismantle makeshift factories where bombs and Kassam missiles are made .


fn_spacy_tokens_for_baseline: ' Christ , I hurt everywhere . '

source_bert_toks: ' christ , i hurt everywhere . '

reference_raw: "Jesus, I'm in pain all over the place."

reference_spacy_tokens: " Jesus , I 'm in pain all over the place . "


fn_spacy_tokens_for_baseline: She sucked in her breath and shook her head .

source_bert_toks: she sucked in her breath and shook her head .

reference_raw: She inhaled and shook her head.

reference_spacy_tokens: She inhaled and shook her head .


fn_spacy_tokens_for_baseline: At first , in the fading light , we could see nothing but the icy path , the snow - covered trees on either side -- but then the flicker of a candle flame caught our eyes .

source_bert_toks: at first , in the fading light , we could see nothing but the icy path , the snow - covered trees on either side - - but then the flicker of a candle flame caught our eyes .

reference_raw: At first we saw nothing in the fading light but the icy trail, the snow-covered trees on both sides - but then the flash of candlelight caught our eyes.

reference_spacy_tokens: At first we saw nothing in the fading light but the icy trail , the snow - covered trees on both sides - but then the flash of candlelight caught our eyes .


fn_spacy_tokens_for_baseline: In February 2004 , it was revealed that HEU traces detected by IAEA inspectors twelve months previously -- in at least two different sites -- were pure enough to produce nuclear weaponry .

source_bert_toks: in february 2004 , it was revealed that he ##u traces detected by ia ##ea inspectors twelve months previously - - in at least two different sites - - were pure enough to produce nuclear weaponry .

reference_raw: In February 2004, the HEU traces detected by IAEA inspectors 12 months ago, at least two different locations, were found to be clean enough to produce nuclear weapons.

reference_spacy_tokens: In February 2004 , the HEU traces detected by IAEA inspectors 12 months ago , at least two different locations , were found to be clean enough to produce nuclear weapons .


fn_spacy_tokens_for_baseline: What is it with soup , I wonder , as Mock Turtle Martin Coogan slurps on his minestrone .

source_bert_toks: what is it with soup , i wonder , as mock turtle martin co ##ogan sl ##ur ##ps on his mines ##tron ##e .

reference_raw: What's the matter with the soup, I wonder, the way Mock Turtle Martin Coogan slumps on his minestone.

reference_spacy_tokens: What 's the matter with the soup , I wonder , the way Mock Turtle Martin Coogan slumps on his minestone .


fn_spacy_tokens_for_baseline: Pickett , who was shot in the knee by the Secret Service after allegedly firing two shots outside the White House , used crutches to walk into the court .

source_bert_toks: picket ##t , who was shot in the knee by the secret service after allegedly firing two shots outside the white house , used cr ##ut ##ches to walk into the court .

reference_raw: Pickett, who was shot in the knee by the Secret Service after allegedly shooting two shots in front of the White House, used his crutches to enter the courthouse.

reference_spacy_tokens: Pickett , who was shot in the knee by the Secret Service after allegedly shooting two shots in front of the White House , used his crutches to enter the courthouse .


fn_spacy_tokens_for_baseline: I was writing a comedy with sinister undertones about the villa renters and expats of Chiantishire .

source_bert_toks: i was writing a comedy with sinister under ##tones about the villa rent ##ers and ex ##pa ##ts of chi ##ant ##ish ##ire .

reference_raw: I wrote a comic with ominous undertones about the tenants of the villa and the expats of Chiantishire.

reference_spacy_tokens: I wrote a comic with ominous undertones about the tenants of the villa and the expats of Chiantishire .


fn_spacy_tokens_for_baseline: He was wearing white flannel trousers and a white shirt with a cravat at his neck .

source_bert_toks: he was wearing white fl ##anne ##l trousers and a white shirt with a cr ##ava ##t at his neck .

reference_raw: He wore white flannel pants and a white shirt with a neck collar.

reference_spacy_tokens: He wore white flannel pants and a white shirt with a neck collar .


fn_spacy_tokens_for_baseline: His letters evince the excitement he felt at undertaking this journey , one which few Europeans had as yet made , and his anticipation of getting plenty of big game hunting on the way .

source_bert_toks: his letters ev ##in ##ce the excitement he felt at undertaking this journey , one which few europeans had as yet made , and his anticipation of getting plenty of big game hunting on the way .

reference_raw: His letters evoked the excitement he felt when he made this journey, one that few Europeans had ever done, and he expected a lot of big game hunting on the way.

reference_spacy_tokens: His letters evoked the excitement he felt when he made this journey , one that few Europeans had ever done , and he expected a lot of big game hunting on the way .


fn_spacy_tokens_for_baseline: That was it , Henry 's charity ball .

source_bert_toks: that was it , henry ' s charity ball .

reference_raw: That's it, Henry's charitable prom.

reference_spacy_tokens: That 's it , Henry 's charitable prom .


fn_spacy_tokens_for_baseline: It was terribly important that I should beat him , and I struggled desperately against the invisible forces that always prevent one running in dreams .

source_bert_toks: it was terribly important that i should beat him , and i struggled desperately against the invisible forces that always prevent one running in dreams .

reference_raw: It was very important to beat him, and I fought desperately against the invisible forces that kept you from running in your dreams.

reference_spacy_tokens: It was very important to beat him , and I fought desperately against the invisible forces that kept you from running in your dreams .


fn_spacy_tokens_for_baseline: Also , the visitors with high security clearance should be designated parking spots inside the location .

source_bert_toks: also , the visitors with high security clearance should be designated parking spots inside the location .

reference_raw: Visitors with a high security clearance should also be identified as parking spaces within the site.

reference_spacy_tokens: Visitors with a high security clearance should also be identified as parking spaces within the site .


fn_spacy_tokens_for_baseline: Traditionally , we relied on cereals such as oats , barley , bran and flaked maize , with occasional succulents and mashes .

source_bert_toks: traditionally , we relied on cereal ##s such as o ##ats , barley , bran and fl ##ake ##d maize , with occasional su ##cc ##ulent ##s and mas ##hes .

reference_raw: We have traditionally relied on cereals such as oats, barley, bran and flaky maize, with occasional succulents and mashes.

reference_spacy_tokens: We have traditionally relied on cereals such as oats , barley , bran and flaky maize , with occasional succulents and mashes .


fn_spacy_tokens_for_baseline: The eggs of these parasites are voided in the faeces , and the resulting larvae do represent a slight risk to human health , because they may cause the disease known as toxocariasis .

source_bert_toks: the eggs of these parasites are void ##ed in the fae ##ces , and the resulting larvae do represent a slight risk to human health , because they may cause the disease known as to ##x ##oca ##ria ##sis .

reference_raw: The eggs of these parasites are excreted in the faeces and the resulting larvae present a small risk to human health as they may cause a disease known as toxocariasis.

reference_spacy_tokens: The eggs of these parasites are excreted in the faeces and the resulting larvae present a small risk to human health as they may cause a disease known as toxocariasis .


fn_spacy_tokens_for_baseline: The Air Force then used two 500-pound bombs to destroy the downed craft to prevent hostile forces from recovering it , the military said .

source_bert_toks: the air force then used two 500 - pound bombs to destroy the downed craft to prevent hostile forces from recovering it , the military said .

reference_raw: The Air Force then used two 500-pound bombs to destroy a fallen ship to prevent the enemy from recovering it, the army said.

reference_spacy_tokens: The Air Force then used two 500-pound bombs to destroy a fallen ship to prevent the enemy from recovering it , the army said .


fn_spacy_tokens_for_baseline: " So crunch , crunch , crunch , bang , bang , bang -- here come the ringers from above , making a very obvious exit while the congregation is at prayer , " he says .

source_bert_toks: " so crunch , crunch , crunch , bang , bang , bang - - here come the ring ##ers from above , making a very obvious exit while the congregation is at prayer , " he says .

reference_raw: "So crack, crack, crack, bang, bang, bang -- here comes the ringers from above, making a very clear exit while the congregation is in prayer," he says.

reference_spacy_tokens: " So crack , crack , crack , bang , bang , bang -- here comes the ringers from above , making a very clear exit while the congregation is in prayer , " he says .


fn_spacy_tokens_for_baseline: The package would cross the Wall by another safer but slower route .

source_bert_toks: the package would cross the wall by another safer but slower route .

reference_raw: The package will take another safer but slower route across the Wall.

reference_spacy_tokens: The package will take another safer but slower route across the Wall .


fn_spacy_tokens_for_baseline: They 'd eaten peanuts in the Store , of course .

source_bert_toks: they ' d eaten peanuts in the store , of course .

reference_raw: Of course, they ate nuts at the Store.

reference_spacy_tokens: Of course , they ate nuts at the Store .


fn_spacy_tokens_for_baseline: Obsidian is a hard , vitreous volcanic rock , which could be fashioned into tools for cutting and stabbing .

source_bert_toks: obsidian is a hard , vi ##tre ##ous volcanic rock , which could be fashioned into tools for cutting and stabbing .

reference_raw: Obsidian is a hard, vitreous volcanic rock that can be made into tools to slice and stab.

reference_spacy_tokens: Obsidian is a hard , vitreous volcanic rock that can be made into tools to slice and stab .


fn_spacy_tokens_for_baseline: Mysteriously , the Anasazi vanished from the valley around a.d . 1150 , leaving it to be repopulated by the Southern Paiutes , another hunter - gatherer tribe .

source_bert_toks: mysteriously , the ana ##sa ##zi vanished from the valley around a . d . 115 ##0 , leaving it to be rep ##op ##ulated by the southern pa ##iu ##tes , another hunter - gather ##er tribe .

reference_raw: The Anasazi mysteriously disappeared from the valley around A.D. 1150, leaving the South Paiutes, another tribe of hunters.

reference_spacy_tokens: The Anasazi mysteriously disappeared from the valley around A.D. 1150 , leaving the South Paiutes , another tribe of hunters .


fn_spacy_tokens_for_baseline: A robust economy helps by providing job opportunities , but to be honest , most of the people who are n't working today are quite simply the ones who face the greatest obstacles .

source_bert_toks: a robust economy helps by providing job opportunities , but to be honest , most of the people who aren ' t working today are quite simply the ones who face the greatest obstacles .

reference_raw: A strong economy helps by providing jobs, but to be honest, most people who do not work today are simply those who face the biggest obstacles.

reference_spacy_tokens: A strong economy helps by providing jobs , but to be honest , most people who do not work today are simply those who face the biggest obstacles .


fn_spacy_tokens_for_baseline: It could point to plenty of ailments that the Spanish economic rejuvenation so far has failed to cure .

source_bert_toks: it could point to plenty of ai ##lm ##ents that the spanish economic re ##ju ##ven ##ation so far has failed to cure .

reference_raw: It could point to a number of diseases that the Spanish economic recovery has not yet healed.

reference_spacy_tokens: It could point to a number of diseases that the Spanish economic recovery has not yet healed .


fn_spacy_tokens_for_baseline: While I did not attend the trial -- I was lucky to be able to read your highly amusing and informative dispatches , several of which made me spit up my lunch laughing -- it certainly seemed as if the image of Bill Gates took a beating and the insular culture of Microsoft did not look so good .

source_bert_toks: while i did not attend the trial - - i was lucky to be able to read your highly amusing and inform ##ative dispatch ##es , several of which made me spit up my lunch laughing - - it certainly seemed as if the image of bill gates took a beating and the ins ##ular culture of microsoft did not look so good .

reference_raw: Although I didn't attend the trial-I was fortunate enough to read your highly amusing and informative dispatches, some of which made me spit out my lunch laugh-it certainly seemed to me that Bill Gates had been beaten and Microsoft's insular culture didn't look very good.

reference_spacy_tokens: Although I did n't attend the trial - I was fortunate enough to read your highly amusing and informative dispatches , some of which made me spit out my lunch laugh - it certainly seemed to me that Bill Gates had been beaten and Microsoft 's insular culture did n't look very good .


fn_spacy_tokens_for_baseline: Then the task was to help children who lost parents in the Civil War .

source_bert_toks: then the task was to help children who lost parents in the civil war .

reference_raw: Then it was his job to help the children who lost their parents in the Civil War.

reference_spacy_tokens: Then it was his job to help the children who lost their parents in the Civil War .


fn_spacy_tokens_for_baseline: When the elder members of the family began to die , Mrs Thwaites did most , if not all of the baking and catering for the funerals .

source_bert_toks: when the elder members of the family began to die , mrs th ##waite ##s did most , if not all of the baking and catering for the funeral ##s .

reference_raw: When the older family members began to die, Mrs. Thwaites did the most, if not all, cooking and catering for funerals.

reference_spacy_tokens: When the older family members began to die , Mrs. Thwaites did the most , if not all , cooking and catering for funerals .


fn_spacy_tokens_for_baseline: But the muscles had no strength to sustain it , and it fell over forwards , hitting its nose on the ground .

source_bert_toks: but the muscles had no strength to sustain it , and it fell over forwards , hitting its nose on the ground .

reference_raw: But his muscles didn't have the strength to hold him, and he fell forward and struck his nose on the floor.

reference_spacy_tokens: But his muscles did n't have the strength to hold him , and he fell forward and struck his nose on the floor .


fn_spacy_tokens_for_baseline: He watched her over the rim of his glass , his eyes lambent , his mouth uptilted .

source_bert_toks: he watched her over the rim of his glass , his eyes lamb ##ent , his mouth up ##ti ##lt ##ed .

reference_raw: He watched her over the edge of his glass, his eyes bright and his mouth cocked.

reference_spacy_tokens: He watched her over the edge of his glass , his eyes bright and his mouth cocked .


fn_spacy_tokens_for_baseline: You 've watched steam bubbling from the earth ,

source_bert_toks: you ' ve watched steam bubbling from the earth ,

reference_raw: You saw the steam bouncing off the ground,

reference_spacy_tokens: You saw the steam bouncing off the ground ,


fn_spacy_tokens_for_baseline: He swigged his champagne with such abandon that Ruth knew he had swallowed Maria Luisa 's explanation of their affair with the same ease as she had at first .

source_bert_toks: he sw ##ig ##ged his champagne with such abandon that ruth knew he had swallowed maria luisa ' s explanation of their affair with the same ease as she had at first .

reference_raw: He sipped the champagne with such abandon that Ruth knew he had swallowed Maria Luisa's explanation of their affair as easily as she had at first.

reference_spacy_tokens: He sipped the champagne with such abandon that Ruth knew he had swallowed Maria Luisa 's explanation of their affair as easily as she had at first .


fn_spacy_tokens_for_baseline: MY WIFE and I would like to express our sincere gratitude for the heart - warming friendliness shown to us by the Liverpool citizens we met at the celebrations .

source_bert_toks: my wife and i would like to express our sincere gratitude for the heart - warming friend ##liness shown to us by the liverpool citizens we met at the celebrations .

reference_raw: My wife and I would like to express our sincere gratitude for the warm friendship that the citizens of Liverpool have shown us at the celebrations.

reference_spacy_tokens: My wife and I would like to express our sincere gratitude for the warm friendship that the citizens of Liverpool have shown us at the celebrations .


fn_spacy_tokens_for_baseline: It is now unequivocally clear that these trash shipments are a weak link in our security . " ( hometownlife.com ; 19Apr06 ; Carl Levin , U.S. Senator from Michigan ) ( Link )

source_bert_toks: it is now une ##qui ##vo ##cal ##ly clear that these trash shipments are a weak link in our security . " ( hometown ##life . com ; 19 ##ap ##r ##0 ##6 ; carl levin , u . s . senator from michigan ) ( link )

reference_raw: It is now clear that these shipments of waste are a weak connection to our security." (hometownlife.com; 19 April 2006; Carl Levin, United States senator from Michigan)

reference_spacy_tokens: It is now clear that these shipments of waste are a weak connection to our security . " ( hometownlife.com ; 19 April 2006 ; Carl Levin , United States senator from Michigan )


fn_spacy_tokens_for_baseline: Also in attendance were PERRY FARRELL and a bare - chested SLASH , although neither stayed for the after - show party at a sleazy ten - pin bowling alley , where a fun knock - out contest was held .

source_bert_toks: also in attendance were perry farrell and a bare - chest ##ed slash , although neither stayed for the after - show party at a sl ##ea ##zy ten - pin bowling alley , where a fun knock - out contest was held .

reference_raw: PERRY FARRELL and the bare-chested SLASH were also present, though neither of them stayed for the after-show party in a sleek ten-pin bowling alley where there was a fun knockout contest.

reference_spacy_tokens: PERRY FARRELL and the bare - chested SLASH were also present , though neither of them stayed for the after - show party in a sleek ten - pin bowling alley where there was a fun knockout contest .


fn_spacy_tokens_for_baseline: North Atlantic Treaty Organization and Afghan troops launched an offensive last month to flush out Taliban militants from the province 's northern tip .

source_bert_toks: north atlantic treaty organization and afghan troops launched an offensive last month to flush out taliban militants from the province ' s northern tip .

reference_raw: The North Atlantic Treaty Organization and Afghan troops launched an attack last month to remove Taliban troops from the northern tip of the province.

reference_spacy_tokens: The North Atlantic Treaty Organization and Afghan troops launched an attack last month to remove Taliban troops from the northern tip of the province .


fn_spacy_tokens_for_baseline: With warm sunshine , beautiful beaches , lush tropical scenery , and fine hotels , it is guaranteed to provide a little rest and relaxation .

source_bert_toks: with warm sunshine , beautiful beaches , lush tropical scenery , and fine hotels , it is guaranteed to provide a little rest and relaxation .

reference_raw: With warm sunlight, beautiful beaches, lush tropical landscapes, and fine hotels, it is guaranteed to provide some rest and rest.

reference_spacy_tokens: With warm sunlight , beautiful beaches , lush tropical landscapes , and fine hotels , it is guaranteed to provide some rest and rest .


fn_spacy_tokens_for_baseline: Hundreds of workers " were working feverishly " to place piping and wiring in Iran 's underground enrichment facility at Natanz , said a diplomat accredited to the agency .

source_bert_toks: hundreds of workers " were working fever ##ishly " to place pip ##ing and wiring in iran ' s underground enrichment facility at nat ##an ##z , said a diplomat accredited to the agency .

reference_raw: Hundreds of workers "worked feverishly" to place pipes and wires in the Iranian subterranean enrichment facility in Natanz, said a diplomat approved by the Agency.

reference_spacy_tokens: Hundreds of workers " worked feverishly " to place pipes and wires in the Iranian subterranean enrichment facility in Natanz , said a diplomat approved by the Agency .


fn_spacy_tokens_for_baseline: Conversely Mortimer should not have invoked the earls to revolt against the king .

source_bert_toks: conversely mortimer should not have invoked the earls to revolt against the king .

reference_raw: Mortimer, on the other hand, should not have called upon the Counts to rebel against the King.

reference_spacy_tokens: Mortimer , on the other hand , should not have called upon the Counts to rebel against the King .


fn_spacy_tokens_for_baseline: He bought that because he once had a tiff with a BBC car park attendant who would n't let him in .

source_bert_toks: he bought that because he once had a ti ##ff with a bbc car park attendant who wouldn ' t let him in .

reference_raw: He bought it because he used to have a relationship with a BBC parking attendant who wouldn't let him in.

reference_spacy_tokens: He bought it because he used to have a relationship with a BBC parking attendant who would n't let him in .


fn_spacy_tokens_for_baseline: Because chemical weapons are best suited for delivery with larger caliber artillery pieces , it is worth noting that over the last two years the North has further increased the number of long - range 240 mm multiple rocket launcher systems and 170 mm howitzers , all placed in hardened sites near the DMZ .

source_bert_toks: because chemical weapons are best suited for delivery with larger caliber artillery pieces , it is worth noting that over the last two years the north has further increased the number of long - range 240 mm multiple rocket launcher systems and 170 mm how ##itzer ##s , all placed in hardened sites near the d ##m ##z .

reference_raw: Since chemical weapons are the most suitable for delivery with larger caliber artillery, it is worth noting that in the past two years the North has increased the number of long-range 240mm multiple rocket launcher systems and 170mm howitzers, all located in hardened areas near the DMZ.

reference_spacy_tokens: Since chemical weapons are the most suitable for delivery with larger caliber artillery , it is worth noting that in the past two years the North has increased the number of long - range 240 mm multiple rocket launcher systems and 170 mm howitzers , all located in hardened areas near the DMZ .


fn_spacy_tokens_for_baseline: He was thickset with a broad forehead and full beard and very light - coloured , widely set eyes that could be most intimidating .

source_bert_toks: he was thick ##set with a broad forehead and full beard and very light - coloured , widely set eyes that could be most intimidating .

reference_raw: He was thick with a broad forehead and a full beard, and very light-coloured, wide-set eyes that might have been most intimidating.

reference_spacy_tokens: He was thick with a broad forehead and a full beard , and very light - coloured , wide - set eyes that might have been most intimidating .


fn_spacy_tokens_for_baseline: To my delight , dotted here and there on the leafy verge were gleams of light , a pale luminous shining in the warm darkness .

source_bert_toks: to my delight , dotted here and there on the leaf ##y verge were gleam ##s of light , a pale luminous shining in the warm darkness .

reference_raw: To my delight, dotted here and there on the edge of the leaves was a flash of light, a pale light shining in the warm darkness.

reference_spacy_tokens: To my delight , dotted here and there on the edge of the leaves was a flash of light , a pale light shining in the warm darkness .


fn_spacy_tokens_for_baseline: He must tie one end of the string to the opening of the cave and then let the ball unwind as he went down into the labyrinth .

source_bert_toks: he must tie one end of the string to the opening of the cave and then let the ball un ##wind as he went down into the labyrinth .

reference_raw: He had to tie one end of the rope to the opening of the cave, then release the ball as he descended into the labyrinth.

reference_spacy_tokens: He had to tie one end of the rope to the opening of the cave , then release the ball as he descended into the labyrinth .


fn_spacy_tokens_for_baseline: This objective change in the market has also generated a logical change in the role required of the state by capitalism .

source_bert_toks: this objective change in the market has also generated a logical change in the role required of the state by capitalism .

reference_raw: This objective change in the market has also led to a logical change in the role that capitalism requires of the State.

reference_spacy_tokens: This objective change in the market has also led to a logical change in the role that capitalism requires of the State .


fn_spacy_tokens_for_baseline: That era is gone now , but other elements of the island 's old life are preserved .

source_bert_toks: that era is gone now , but other elements of the island ' s old life are preserved .

reference_raw: This time is over, but the rest of the island's old life is preserved.

reference_spacy_tokens: This time is over , but the rest of the island 's old life is preserved .


fn_spacy_tokens_for_baseline: The supplement is very modestly priced and will be indispensable for those who use Mr Bramwell 's book .

source_bert_toks: the supplement is very modest ##ly priced and will be ind ##is ##pen ##sable for those who use mr bram ##well ' s book .

reference_raw: The supplement is very modestly priced and will be necessary for those who use Mr. Bramwell's book.

reference_spacy_tokens: The supplement is very modestly priced and will be necessary for those who use Mr. Bramwell 's book .


fn_spacy_tokens_for_baseline: Bureaucratic power thus becomes the foundation for a new ruling class .

source_bert_toks: bureau ##cratic power thus becomes the foundation for a new ruling class .

reference_raw: As a result, bureaucratic power will be the basis for a new ruling group.

reference_spacy_tokens: As a result , bureaucratic power will be the basis for a new ruling group .


fn_spacy_tokens_for_baseline: In 1997 , two more Chinese companies and were sanctioned by the US State Department for selling Iran CW related precursors and equipment .

source_bert_toks: in 1997 , two more chinese companies and were sanctioned by the us state department for selling iran cw related precursor ##s and equipment .

reference_raw: In 1997, two other Chinese companies were sanctioned by the U.S. State Department for the sale of precursors and devices related to Iran's CW.

reference_spacy_tokens: In 1997 , two other Chinese companies were sanctioned by the U.S. State Department for the sale of precursors and devices related to Iran 's CW .


fn_spacy_tokens_for_baseline: The Madeiran is very talkative with his friends and family .

source_bert_toks: the madeira ##n is very talk ##ative with his friends and family .

reference_raw: Madeiran talks very much to friends and family.

reference_spacy_tokens: Madeiran talks very much to friends and family .


fn_spacy_tokens_for_baseline: The guard - who has not been named - was told he would be blown up and his family killed if he made one false move .

source_bert_toks: the guard - who has not been named - was told he would be blown up and his family killed if he made one false move .

reference_raw: The guard, who had not been named, had been told that he would be shot and his family would be killed if he made one false move.

reference_spacy_tokens: The guard , who had not been named , had been told that he would be shot and his family would be killed if he made one false move .


fn_spacy_tokens_for_baseline: In 1346 Pope Clement VI rebuked Edward for a seizure which would imperil his soul , not to mention those of the sacrilegious laymen occupying church goods .

source_bert_toks: in 134 ##6 pope clement vi re ##bu ##ked edward for a seizure which would imp ##eri ##l his soul , not to mention those of the sac ##ril ##eg ##ious lay ##men occupying church goods .

reference_raw: In 1346, Pope Clement VI rebuked Edward for a seizure that would endanger his soul, not to mention the sacrilege laymen who occupied the church goods.

reference_spacy_tokens: In 1346 , Pope Clement VI rebuked Edward for a seizure that would endanger his soul , not to mention the sacrilege laymen who occupied the church goods .


fn_spacy_tokens_for_baseline: Most of the literature and accusations come from CIA reports , uncited writings of experts , and claims made by Iranian dissidents .

source_bert_toks: most of the literature and accusations come from cia reports , un ##cite ##d writings of experts , and claims made by iranian di ##ssi ##dents .

reference_raw: Most of the literature and accusations come from CIA reports, uncited reports from experts, and statements from Iranian dissidents.

reference_spacy_tokens: Most of the literature and accusations come from CIA reports , uncited reports from experts , and statements from Iranian dissidents .


fn_spacy_tokens_for_baseline: Perdita was trembling so badly that she could hardly zip up her boots .

source_bert_toks: per ##dit ##a was trembling so badly that she could hardly zip up her boots .

reference_raw: Perdita was shaking so badly that she could barely lift her shoes.

reference_spacy_tokens: Perdita was shaking so badly that she could barely lift her shoes .


fn_spacy_tokens_for_baseline: Sitting where he was , a bullet fired into the back of his neck might pass through and embed itself somewhere in the brickwork above the stove .

source_bert_toks: sitting where he was , a bullet fired into the back of his neck might pass through and em ##bed itself somewhere in the brick ##work above the stove .

reference_raw: Sitting where he was, a bullet in the back of his neck could have gone through and inserted itself into the brickwork above the stove.

reference_spacy_tokens: Sitting where he was , a bullet in the back of his neck could have gone through and inserted itself into the brickwork above the stove .


fn_spacy_tokens_for_baseline: They needed galvanising .

source_bert_toks: they needed gal ##vani ##sing .

reference_raw: They needed to galvanize.

reference_spacy_tokens: They needed to galvanize .


fn_spacy_tokens_for_baseline: When they did make up the T - shirts -- as I backed down and did the separations -- they got busted for sedition , which was an obscure act of whenever .

source_bert_toks: when they did make up the t - shirts - - as i backed down and did the separation ##s - - they got busted for se ##dition , which was an obscure act of whenever .

reference_raw: When they made up their shirts - when I backed out and split up - they were arrested for sedition, which was a covert act at any time.

reference_spacy_tokens: When they made up their shirts - when I backed out and split up - they were arrested for sedition , which was a covert act at any time .


fn_spacy_tokens_for_baseline: She wrinkled her nose at him .

source_bert_toks: she wrinkled her nose at him .

reference_raw: She cocked her nose at him.

reference_spacy_tokens: She cocked her nose at him .


fn_spacy_tokens_for_baseline: I would like to outline some of the major terms of the legislation , the far reaching implications it has for unemployed people and what we as a local group are trying to do to combat it .

source_bert_toks: i would like to outline some of the major terms of the legislation , the far reaching implications it has for unemployed people and what we as a local group are trying to do to combat it .

reference_raw: I would like to set out some of the main terms of the legislation, the far-reaching implications for the unemployed and what we, as a local group, are trying to do to combat it.

reference_spacy_tokens: I would like to set out some of the main terms of the legislation , the far - reaching implications for the unemployed and what we , as a local group , are trying to do to combat it .


fn_spacy_tokens_for_baseline: Other hazards in the kitchen include the hot cooker and hot baking utensils although protecting the hands and wrists with heat - resistant gloves helps to avoid burns .

source_bert_toks: other hazards in the kitchen include the hot cooke ##r and hot baking ut ##ens ##ils although protecting the hands and wrists with heat - resistant gloves helps to avoid burns .

reference_raw: Other hazards in the kitchen include hot cookers and hot baking equipment, although the protection of hands and wrists with heat-resistant gloves helps to prevent burns.

reference_spacy_tokens: Other hazards in the kitchen include hot cookers and hot baking equipment , although the protection of hands and wrists with heat - resistant gloves helps to prevent burns .


fn_spacy_tokens_for_baseline: There are some excellent commercial pesto sauces available , but always be prepared to pay for one made with olive oil and not a lighter , less flavoursome oil .

source_bert_toks: there are some excellent commercial pest ##o sauce ##s available , but always be prepared to pay for one made with olive oil and not a lighter , less flavour ##some oil .

reference_raw: Some excellent commercial pesto sauces are available, but they are always ready to pay for one produced with olive oil rather than lighter, less aromatic oil.

reference_spacy_tokens: Some excellent commercial pesto sauces are available , but they are always ready to pay for one produced with olive oil rather than lighter , less aromatic oil .


fn_spacy_tokens_for_baseline: I 've won one Rodney , and I 'll have a shitload more this autumn .

source_bert_toks: i ' ve won one rodney , and i ' ll have a shit ##load more this autumn .

reference_raw: I won one Rodney, and I'm gonna have more shit in the fall.

reference_spacy_tokens: I won one Rodney , and I 'm gon na have more shit in the fall .


fn_spacy_tokens_for_baseline: In the temporal priority condition , one of the blocks moved before the other block , but the string which connected the two blocks was screened from the children 's view .

source_bert_toks: in the temporal priority condition , one of the blocks moved before the other block , but the string which connected the two blocks was screened from the children ' s view .

reference_raw: One block moved in front of the other block in a time-priority condition, but the string that linked the two blocks was viewed from a child's perspective.

reference_spacy_tokens: One block moved in front of the other block in a time - priority condition , but the string that linked the two blocks was viewed from a child 's perspective .


fn_spacy_tokens_for_baseline: China 's development of anti - satellite ( ASAT ) capabilities has also raised concerns about China 's missile and related military space program .

source_bert_toks: china ' s development of anti - satellite ( asa ##t ) capabilities has also raised concerns about china ' s missile and related military space program .

reference_raw: The development of anti-sat (ASAT) capabilities in China has also given rise to concerns about the Chinese missile and related military space programme.

reference_spacy_tokens: The development of anti - sat ( ASAT ) capabilities in China has also given rise to concerns about the Chinese missile and related military space programme .


fn_spacy_tokens_for_baseline: Only we British valiantly battle with elastic bands and hairgrips to control the frizzies .

source_bert_toks: only we british valiant ##ly battle with elastic bands and hair ##gr ##ip ##s to control the fr ##iz ##zie ##s .

reference_raw: Only we British bravely fight with flexible bands and hairdressers to control the frizzies.

reference_spacy_tokens: Only we British bravely fight with flexible bands and hairdressers to control the frizzies .


fn_spacy_tokens_for_baseline: Unable to replicate the agricultural techniques of the Anasazi , the Paiutes were destined to a semi - nomadic lifestyle until European settlers arrived , changing the nature of existence in the valley forever .

source_bert_toks: unable to replicate the agricultural techniques of the ana ##sa ##zi , the pa ##iu ##tes were destined to a semi - nomadic lifestyle until european settlers arrived , changing the nature of existence in the valley forever .

reference_raw: The Paiutes, unable to replicate the farming techniques of the Anasazi, were set for a semi-nomadic lifestyle until European settlers arrived and changed the nature of life in the valley forever.

reference_spacy_tokens: The Paiutes , unable to replicate the farming techniques of the Anasazi , were set for a semi - nomadic lifestyle until European settlers arrived and changed the nature of life in the valley forever .


fn_spacy_tokens_for_baseline: Additionally , I am sending traditional background materials on the Museum and the two latest issues of our Previews Magazine detailing upcoming events , exhibitions , and educational programs .

source_bert_toks: additionally , i am sending traditional background materials on the museum and the two latest issues of our preview ##s magazine detailing upcoming events , exhibitions , and educational programs .

reference_raw: In addition, I'm sending traditional background material to the museum and the two latest editions of our Preview Magazine, which describe the upcoming events, exhibitions, and educational programs.

reference_spacy_tokens: In addition , I 'm sending traditional background material to the museum and the two latest editions of our Preview Magazine , which describe the upcoming events , exhibitions , and educational programs .


fn_spacy_tokens_for_baseline: Providing an influx of $ 165 million to the southwestern economy , Hoover Dam played a major role in preventing Las Vegas from drying up , both financially and literally .

source_bert_toks: providing an influx of $ 165 million to the southwestern economy , hoover dam played a major role in preventing las vegas from drying up , both financially and literally .

reference_raw: With an influx of $165 million to the southwest economy, Hoover Dam played an important role in preventing Las Vegas from desiccating, both financially and literally.

reference_spacy_tokens: With an influx of $ 165 million to the southwest economy , Hoover Dam played an important role in preventing Las Vegas from desiccating , both financially and literally .


fn_spacy_tokens_for_baseline: It hopes to speak to students at theological colleges about the joys of bell ringing and will shortly publish a booklet for every vicar in the country entitled , " The Bells in Your Care .

source_bert_toks: it hopes to speak to students at theological colleges about the joy ##s of bell ringing and will shortly publish a booklet for every vicar in the country entitled , " the bells in your care .

reference_raw: He hopes to talk to the students of theology schools about the joys of ringing bells and will soon publish a brochure for every vicar in the country entitled "Bells in Your Care."

reference_spacy_tokens: He hopes to talk to the students of theology schools about the joys of ringing bells and will soon publish a brochure for every vicar in the country entitled " Bells in Your Care . "


fn_spacy_tokens_for_baseline: He came wearing his purple confessor 's stole and carrying the little box of sacred oils for the anointing of the dying .

source_bert_toks: he came wearing his purple confess ##or ' s stole and carrying the little box of sacred oils for the an ##oint ##ing of the dying .

reference_raw: He came in wearing his violet confessor's theft and carried a small box of holy oil to anoint the dying.

reference_spacy_tokens: He came in wearing his violet confessor 's theft and carried a small box of holy oil to anoint the dying .


fn_spacy_tokens_for_baseline: She carried a textbook on neurology in case she had to wait long for David .

source_bert_toks: she carried a textbook on ne ##uro ##logy in case she had to wait long for david .

reference_raw: In case she had to wait long for David, she carried a textbook on neurological.

reference_spacy_tokens: In case she had to wait long for David , she carried a textbook on neurological .


fn_spacy_tokens_for_baseline: I closed my eyes weakly .

source_bert_toks: i closed my eyes weakly .

reference_raw: I shut my eyes weakly.

reference_spacy_tokens: I shut my eyes weakly .


fn_spacy_tokens_for_baseline: I shall go garbed as a maidservant and , if seen and questioned , shall concoct a tale about having a message for one of the guards .

source_bert_toks: i shall go ga ##rb ##ed as a maids ##er ##vant and , if seen and questioned , shall con ##co ##ct a tale about having a message for one of the guards .

reference_raw: I will dress as a servant and, if seen and questioned, make up a story of having a message for one of the guards.

reference_spacy_tokens: I will dress as a servant and , if seen and questioned , make up a story of having a message for one of the guards .


fn_spacy_tokens_for_baseline: The arrival of each vendor is greeted by the crowd rather as the appearance of a man with a sackful of rice would be greeted in a Kurdish refugee camp in midwinter .

source_bert_toks: the arrival of each vendor is greeted by the crowd rather as the appearance of a man with a sack ##ful of rice would be greeted in a kurdish refugee camp in mid ##win ##ter .

reference_raw: The arrival of every vendor is greeted more by the crowd than by the appearance of a man with a sack of rice in a Kurdish refugee camp in the middle of winter.

reference_spacy_tokens: The arrival of every vendor is greeted more by the crowd than by the appearance of a man with a sack of rice in a Kurdish refugee camp in the middle of winter .


fn_spacy_tokens_for_baseline: There were fears that the crane could buckle due to the heat and collapse .

source_bert_toks: there were fears that the crane could buckle due to the heat and collapse .

reference_raw: There was concern that the crane might buckle because of the heat and collapse.

reference_spacy_tokens: There was concern that the crane might buckle because of the heat and collapse .


fn_spacy_tokens_for_baseline: PETER Scudamore 's neighbour Nigel Twiston - Davies has got off to a tremendous start this season with 24 wins in the bag already .

source_bert_toks: peter sc ##uda ##more ' s neighbour nigel twist ##on - davies has got off to a tremendous start this season with 24 wins in the bag already .

reference_raw: PETER Scudamore's neighbor, Nigel Twiston-Davies, has made a huge start this season with 24 wins already in the bag.

reference_spacy_tokens: PETER Scudamore 's neighbor , Nigel Twiston - Davies , has made a huge start this season with 24 wins already in the bag .


fn_spacy_tokens_for_baseline: If she had a wallet of money she 'd go and buy them now .

source_bert_toks: if she had a wallet of money she ' d go and buy them now .

reference_raw: If she had a purse full of money, she'd be buying it right now.

reference_spacy_tokens: If she had a purse full of money , she 'd be buying it right now .


fn_spacy_tokens_for_baseline: The T&G , which may yet be shamed into balloting its members , has made no secret of its backing for Smith on the basis that he has a ' movement background ' .

source_bert_toks: the t & g , which may yet be shame ##d into ballot ##ing its members , has made no secret of its backing for smith on the basis that he has a ' movement background ' .

reference_raw: The T&G, who may yet be ashamed to vote for its members, did not conceal his support for Smith on the basis of his "movement background".

reference_spacy_tokens: The T&G , who may yet be ashamed to vote for its members , did not conceal his support for Smith on the basis of his " movement background " .


fn_spacy_tokens_for_baseline: Cowan believes that a phenomenon known as lateral inhibition is responsible for the patterns generated by hallucinogens .

source_bert_toks: cowan believes that a phenomenon known as lateral inhibition is responsible for the patterns generated by hall ##uc ##ino ##gens .

reference_raw: Cowan believes that the patterns produced by hallucinogenics are caused by a phenomenon known as lateral inhibition.

reference_spacy_tokens: Cowan believes that the patterns produced by hallucinogenics are caused by a phenomenon known as lateral inhibition .


fn_spacy_tokens_for_baseline: Welcome back : Trading Standards officers have begun a campaign to stem the increasing flood of counterfeit goods on sale in shops and markets .

source_bert_toks: welcome back : trading standards officers have begun a campaign to stem the increasing flood of counter ##feit goods on sale in shops and markets .

reference_raw: Welcome back: Trade Standards officials have launched a campaign to stop the growing flood of fake goods sold in shops and markets.

reference_spacy_tokens: Welcome back : Trade Standards officials have launched a campaign to stop the growing flood of fake goods sold in shops and markets .


fn_spacy_tokens_for_baseline: New tentacles writhed and grew , variously greasy and glassy and jelly - like .

source_bert_toks: new tentacles writ ##hed and grew , variously greasy and glass ##y and jelly - like .

reference_raw: New tendrils writhed and grew, variously oily, glassy, and jellylike.

reference_spacy_tokens: New tendrils writhed and grew , variously oily , glassy , and jellylike .


fn_spacy_tokens_for_baseline: Christian preachers attempted , without much success , to persuade their congregations to fast while inebriated pagans feasted and to give alms to the very poor who could give no present in return . )

source_bert_toks: christian preacher ##s attempted , without much success , to persuade their congregations to fast while in ##eb ##riated pagan ##s feast ##ed and to give al ##ms to the very poor who could give no present in return . )

reference_raw: The Christian preachers tried, without much success, to convince their congregation to move fast while the drunken pagans feasted, and to give alms to the poor, who could not give a gift in return.)

reference_spacy_tokens: The Christian preachers tried , without much success , to convince their congregation to move fast while the drunken pagans feasted , and to give alms to the poor , who could not give a gift in return . )


fn_spacy_tokens_for_baseline: She registered his sardonic nod with dismay .

source_bert_toks: she registered his sar ##don ##ic nod with dismay .

reference_raw: She noted his sardonic nod in horror.

reference_spacy_tokens: She noted his sardonic nod in horror .


fn_spacy_tokens_for_baseline: In a leaflet distributed in the Gaza Strip , the group , which belongs to Palestinian Authority President Mahmoud Abbas 's Fatah Party , said the weapons were the result of a three - year effort .

source_bert_toks: in a leaf ##let distributed in the gaza strip , the group , which belongs to palestinian authority president mahmoud abbas ' s fat ##ah party , said the weapons were the result of a three - year effort .

reference_raw: In a leaflet distributed in the Gaza Strip, a group belonging to the Fatah Party of Palestinian Authority President Mahmoud Abbas stated that the weapons were the result of a three-year attempt.

reference_spacy_tokens: In a leaflet distributed in the Gaza Strip , a group belonging to the Fatah Party of Palestinian Authority President Mahmoud Abbas stated that the weapons were the result of a three - year attempt .


fn_spacy_tokens_for_baseline: His tunic of undressed deer - skin was patched with mole and tied about with a thong that might long ago have been the tail of a beast .

source_bert_toks: his tunic of und ##ressed deer - skin was patch ##ed with mole and tied about with a thong that might long ago have been the tail of a beast .

reference_raw: His shirt of undressed deer skin was stained with a mole and tied with a strap that might have been the tail of an animal long ago.

reference_spacy_tokens: His shirt of undressed deer skin was stained with a mole and tied with a strap that might have been the tail of an animal long ago .


fn_spacy_tokens_for_baseline: Nail the head plate in place , using a plumb line to check that sole plate and head plate align .

source_bert_toks: nail the head plate in place , using a plum ##b line to check that sole plate and head plate align .

reference_raw: Put the head plate in place and use the plumbing line to check that the sole plate and the head plate are aligned.

reference_spacy_tokens: Put the head plate in place and use the plumbing line to check that the sole plate and the head plate are aligned .


fn_spacy_tokens_for_baseline: The waves lapped into the bay in a murmur , and the sun set the sea dazzlingly alight .

source_bert_toks: the waves lap ##ped into the bay in a murmur , and the sun set the sea dazzling ##ly ali ##ght .

reference_raw: The waves thumped into the cove in a whisper, and the sun brightened the sea.

reference_spacy_tokens: The waves thumped into the cove in a whisper , and the sun brightened the sea .


fn_spacy_tokens_for_baseline: Rory laughed , just as his attention was caught by a little white blossom lying on the road surface in front of them .

source_bert_toks: rory laughed , just as his attention was caught by a little white blossom lying on the road surface in front of them .

reference_raw: Rory laughed, just as a small white flower lay on the road in front of him caught his attention.

reference_spacy_tokens: Rory laughed , just as a small white flower lay on the road in front of him caught his attention .


fn_spacy_tokens_for_baseline: This set is a comprehensive history of Zeppelin , the ten years when the dinosaur ruled the Earth .

source_bert_toks: this set is a comprehensive history of zeppelin , the ten years when the dinosaur ruled the earth .

reference_raw: This set is a complete history of Zeppelin, the ten years that dinosaurs took over the Earth.

reference_spacy_tokens: This set is a complete history of Zeppelin , the ten years that dinosaurs took over the Earth .


fn_spacy_tokens_for_baseline: A man once attempted to descend into the cave on a long rope tied at the surface to a bell .

source_bert_toks: a man once attempted to descend into the cave on a long rope tied at the surface to a bell .

reference_raw: One day a man tried to descend into the cave on a long rope bound to a bell at the surface.

reference_spacy_tokens: One day a man tried to descend into the cave on a long rope bound to a bell at the surface .


fn_spacy_tokens_for_baseline: For the first time the fair will include a loan exhibition , drawing on the outstanding print collection donated to Plymouth City Art Gallery in the nineteenth - century .

source_bert_toks: for the first time the fair will include a loan exhibition , drawing on the outstanding print collection donated to plymouth city art gallery in the nineteenth - century .

reference_raw: The fair will include, for the first time, a credit exhibition which draws on an unresolved print collection donated to the Art Gallery of Plymouth City in the nineteenth century.

reference_spacy_tokens: The fair will include , for the first time , a credit exhibition which draws on an unresolved print collection donated to the Art Gallery of Plymouth City in the nineteenth century .


fn_spacy_tokens_for_baseline: On 19 December 2003 , Libyan leader Col . Muammar Qadhafi publicly confirmed his commitment to disclose and dismantle WMD programs in his country following a nine - month period of negotiations with US and UK authorities .

source_bert_toks: on 19 december 2003 , libyan leader col . mu ##am ##mar q ##ad ##ha ##fi publicly confirmed his commitment to disclose and di ##sman ##tle w ##md programs in his country following a nine - month period of negotiations with us and uk authorities .

reference_raw: On 19 December 2003, Libyan leader Colonel Muammar Qadhafi publicly confirmed his commitment to publish and dismantle weapons of mass destruction programmes in his country after a nine-month period of negotiations with the authorities of the United States and the United Kingdom.

reference_spacy_tokens: On 19 December 2003 , Libyan leader Colonel Muammar Qadhafi publicly confirmed his commitment to publish and dismantle weapons of mass destruction programmes in his country after a nine - month period of negotiations with the authorities of the United States and the United Kingdom .


fn_spacy_tokens_for_baseline: Iranian Defense and Foreign Ministry officials continue to defend Iran 's right to protect itself from potential threats in the region , while denying any ill intent towards countries such as the United States .

source_bert_toks: iranian defense and foreign ministry officials continue to defend iran ' s right to protect itself from potential threats in the region , while denying any ill intent towards countries such as the united states .

reference_raw: Iran's defence and foreign ministry officials continue to protect Iran from possible threats in the region, while denying any ill intentions towards countries like the United States.

reference_spacy_tokens: Iran 's defence and foreign ministry officials continue to protect Iran from possible threats in the region , while denying any ill intentions towards countries like the United States .


fn_spacy_tokens_for_baseline: She was perplexed ; she had sensed his interest in the bar downstairs .

source_bert_toks: she was per ##plex ##ed ; she had sensed his interest in the bar downstairs .

reference_raw: She was confused; she sensed his interest in the bar below.

reference_spacy_tokens: She was confused ; she sensed his interest in the bar below .


fn_spacy_tokens_for_baseline: ' A typewriter is normal , ' D'Arcy assured .

source_bert_toks: ' a type ##writer is normal , ' d ' arc ##y assured .

reference_raw: 'The typewriter is normal,' said D'Arcy.

reference_spacy_tokens: ' The typewriter is normal , ' said D'Arcy .


fn_spacy_tokens_for_baseline: The North Yorkshire assistant trading standards officer , Edward Chicken , said at least 3,300 cartons were bought as fire - damaged stock , filled with a caustic chemical , then sold as ordinary washing powder .

source_bert_toks: the north yorkshire assistant trading standards officer , edward chicken , said at least 3 , 300 cart ##ons were bought as fire - damaged stock , filled with a ca ##ust ##ic chemical , then sold as ordinary washing powder .

reference_raw: The North Yorkshire Assistant Trade Standards Officer, Edward Chicken, said that at least 3,300 boxes were purchased as a fire-damaged stock, full of caustic chemicals, and then sold as a normal washing powder.

reference_spacy_tokens: The North Yorkshire Assistant Trade Standards Officer , Edward Chicken , said that at least 3,300 boxes were purchased as a fire - damaged stock , full of caustic chemicals , and then sold as a normal washing powder .


fn_spacy_tokens_for_baseline: They guessed she was on a bad trip and moved in swiftly before she could hurt herself .

source_bert_toks: they guessed she was on a bad trip and moved in swiftly before she could hurt herself .

reference_raw: They guessed he was on the wrong road and moved quickly before he could hurt himself.

reference_spacy_tokens: They guessed he was on the wrong road and moved quickly before he could hurt himself .


fn_spacy_tokens_for_baseline: If community care is to function properly , suitable housing must be affordable on the low income support funds available for unemployed disabled people .

source_bert_toks: if community care is to function properly , suitable housing must be affordable on the low income support funds available for unemployed disabled people .

reference_raw: In order for community care to work properly, adequate housing must be available from the low-income support funds available to unemployed people with disabilities.

reference_spacy_tokens: In order for community care to work properly , adequate housing must be available from the low - income support funds available to unemployed people with disabilities .


fn_spacy_tokens_for_baseline: It said UN military observers helped after it collapsed in a dispute over control of the local police , prompting new fighting for territory yesterday between the former allies .

source_bert_toks: it said un military observers helped after it collapsed in a dispute over control of the local police , prompting new fighting for territory yesterday between the former allies .

reference_raw: He said that U.N. military observers helped him when he collapsed in a dispute over the control of the local police, triggering a new battle last night between former allies for territory.

reference_spacy_tokens: He said that U.N. military observers helped him when he collapsed in a dispute over the control of the local police , triggering a new battle last night between former allies for territory .


fn_spacy_tokens_for_baseline: Two days after seeing my surgeon and exactly a week before going into hospital , aided by my wife , I crawled up to London and met the hero of the book .

source_bert_toks: two days after seeing my surgeon and exactly a week before going into hospital , aided by my wife , i crawled up to london and met the hero of the book .

reference_raw: Two days after I saw my surgeon, and exactly a week before I went to the hospital with my wife's help, I crawled to London and met a book hero.

reference_spacy_tokens: Two days after I saw my surgeon , and exactly a week before I went to the hospital with my wife 's help , I crawled to London and met a book hero .


fn_spacy_tokens_for_baseline: Also , like many facilities in the West , Iran 's leading biotechnology research and development facilities create valuable vaccine products that are distributed in Iran and throughout the world .

source_bert_toks: also , like many facilities in the west , iran ' s leading biotechnology research and development facilities create valuable vaccine products that are distributed in iran and throughout the world .

reference_raw: Like many facilities in the West, Iran's leading research and development facilities in the field of biotechnology also produce valuable vaccine products that are disseminated in Iran and around the world.

reference_spacy_tokens: Like many facilities in the West , Iran 's leading research and development facilities in the field of biotechnology also produce valuable vaccine products that are disseminated in Iran and around the world .


fn_spacy_tokens_for_baseline: When screening began we agreed to discontinue it at the end of the first year if there were a number of traumatised families .

source_bert_toks: when screening began we agreed to disco ##nti ##nu ##e it at the end of the first year if there were a number of trauma ##tis ##ed families .

reference_raw: When the screening started, we agreed to stop at the end of the first year if there were many traumatized families.

reference_spacy_tokens: When the screening started , we agreed to stop at the end of the first year if there were many traumatized families .


fn_spacy_tokens_for_baseline: He fixed bail for appeal but said McGuigan was not to be released pending appeal .

source_bert_toks: he fixed bail for appeal but said mc ##gui ##gan was not to be released pending appeal .

reference_raw: He set bail for the appeal, but he said that McGuigan would not be released until the appeal was filed.

reference_spacy_tokens: He set bail for the appeal , but he said that McGuigan would not be released until the appeal was filed .


fn_spacy_tokens_for_baseline: The eggs of these parasites are voided in the faeces , and the resulting larvae do represent a slight risk to human health , because they may cause the disease known as toxocariasis .

source_bert_toks: the eggs of these parasites are void ##ed in the fae ##ces , and the resulting larvae do represent a slight risk to human health , because they may cause the disease known as to ##x ##oca ##ria ##sis .

reference_raw: The eggs of these parasites are excreted in the faeces and the resulting larvae present a small risk to human health as they may cause a disease known as toxocariasis.

reference_spacy_tokens: The eggs of these parasites are excreted in the faeces and the resulting larvae present a small risk to human health as they may cause a disease known as toxocariasis .


fn_spacy_tokens_for_baseline: He seemed as happy as Larry trailing round the greasy dustbins of Bristol till nuclear war broke out or the police nabbed him for pilfering a used Tesco bag .

source_bert_toks: he seemed as happy as larry trailing round the greasy dust ##bin ##s of bristol till nuclear war broke out or the police na ##bbed him for pi ##lf ##ering a used te ##sco bag .

reference_raw: He looked as happy as Larry trailed around the greasy dustbins of Bristol until there was a nuclear war, or the police called him to pick up a used Tesco bag.

reference_spacy_tokens: He looked as happy as Larry trailed around the greasy dustbins of Bristol until there was a nuclear war , or the police called him to pick up a used Tesco bag .


fn_spacy_tokens_for_baseline: 2 A triangle has an area of 12 cm and a base of 4 cm .

source_bert_toks: 2 a triangle has an area of 12 ##cm and a base of 4 ##cm .

reference_raw: 2 The triangle has a radius of 12 cm and a base of 4 cm.

reference_spacy_tokens: 2 The triangle has a radius of 12 cm and a base of 4 cm .


fn_spacy_tokens_for_baseline: ' You can say I twisted my ankle when the heel broke , ' Paula improvised .

source_bert_toks: ' you can say i twisted my ankle when the heel broke , ' paula improvised .

reference_raw: 'As you can tell, I turned my ankle when my heel broke,' Paula improvised.

reference_spacy_tokens: ' As you can tell , I turned my ankle when my heel broke , ' Paula improvised .


fn_spacy_tokens_for_baseline: The chosen champion of the Everqueen of Avelorn , he is a warrior without peer and a foe without mercy .

source_bert_toks: the chosen champion of the ever ##que ##en of ave ##lor ##n , he is a warrior without peer and a foe without mercy .

reference_raw: The chosen champion of the Everqueen of Avelorn is a warrior with no peers and no mercy.

reference_spacy_tokens: The chosen champion of the Everqueen of Avelorn is a warrior with no peers and no mercy .


fn_spacy_tokens_for_baseline: It 's not oral history ; the author is there on every page , as enticed by vanity as any journalist is -- maybe more so , because his is the kind of journalism that aspires most nakedly to the status of literature .

source_bert_toks: it ' s not oral history ; the author is there on every page , as en ##tic ##ed by vanity as any journalist is - - maybe more so , because his is the kind of journalism that as ##pire ##s most naked ##ly to the status of literature .

reference_raw: It's not an oral story; there's a writer on every page as enticed by vanity as any journalist - perhaps more so, because he's the kind of journalism that aspires most nakedly to the status of literature.

reference_spacy_tokens: It 's not an oral story ; there 's a writer on every page as enticed by vanity as any journalist - perhaps more so , because he 's the kind of journalism that aspires most nakedly to the status of literature .


fn_spacy_tokens_for_baseline: To support his family , which had been living in grinding poverty in a squalid tenement , he had to emigrate in 1903 to the USA .

source_bert_toks: to support his family , which had been living in grinding poverty in a sq ##ual ##id ten ##ement , he had to emi ##grate in 1903 to the usa .

reference_raw: In order to support his family, who lived in squalid poverty, he had to move to the United States in 1903.

reference_spacy_tokens: In order to support his family , who lived in squalid poverty , he had to move to the United States in 1903 .


fn_spacy_tokens_for_baseline: Has she perhaps met her end on the same night as the friend whom she had summoned ?

source_bert_toks: has she perhaps met her end on the same night as the friend whom she had summoned ?

reference_raw: Did she perhaps meet her end on the same night as the friend she called?

reference_spacy_tokens: Did she perhaps meet her end on the same night as the friend she called ?


fn_spacy_tokens_for_baseline: There could be no mistaking that squat , muscular figure and purposeful walk .

source_bert_toks: there could be no mist ##aking that squat , muscular figure and purpose ##ful walk .

reference_raw: There was no mistaking the squat, muscled figure and the purposeful walk.

reference_spacy_tokens: There was no mistaking the squat , muscled figure and the purposeful walk .


fn_spacy_tokens_for_baseline: However , it would appear that over the last 20 years , the DPRK has increased its capacity not only in CW agent production but also the development and deployment of a variety of chemical delivery systems .

source_bert_toks: however , it would appear that over the last 20 years , the d ##pr ##k has increased its capacity not only in cw agent production but also the development and deployment of a variety of chemical delivery systems .

reference_raw: However, the DPRK appears to have increased its capacity not only in the production of CW agents, but also in the development and deployment of various chemical delivery systems over the past two decades.

reference_spacy_tokens: However , the DPRK appears to have increased its capacity not only in the production of CW agents , but also in the development and deployment of various chemical delivery systems over the past two decades .


fn_spacy_tokens_for_baseline: Rep. Tony Hall , D- Ohio , did not call for a lifting of sanctions imposed on Iraq for its 1990 invasion of Kuwait , but said the United Nations should make sure that sanctions do not hurt innocent Iraqis .

source_bert_toks: rep . tony hall , d - ohio , did not call for a lifting of sanctions imposed on iraq for its 1990 invasion of kuwait , but said the united nations should make sure that sanctions do not hurt innocent iraqi ##s .

reference_raw: Deputy Tony Hall, D-Ohio, did not demand the lifting of the sanctions imposed on Iraq for the invasion of Kuwait in 1990, but said that the United Nations should ensure that sanctions do not harm innocent Iraqis.

reference_spacy_tokens: Deputy Tony Hall , D - Ohio , did not demand the lifting of the sanctions imposed on Iraq for the invasion of Kuwait in 1990 , but said that the United Nations should ensure that sanctions do not harm innocent Iraqis .


fn_spacy_tokens_for_baseline: Bodo downed his drink and held his glass out for more .

source_bert_toks: bodo downed his drink and held his glass out for more .

reference_raw: Bodo lowered his drink and held out his glass.

reference_spacy_tokens: Bodo lowered his drink and held out his glass .


fn_spacy_tokens_for_baseline: The air was cold and the snow crunched as we walked .

source_bert_toks: the air was cold and the snow crunch ##ed as we walked .

reference_raw: The air was cold and the snow crackled as we walked.

reference_spacy_tokens: The air was cold and the snow crackled as we walked .


fn_spacy_tokens_for_baseline: A cold and melancholy walk of a couple of miles brought us to a high wooden gate , which opened into a gloomy avenue of chestnuts .

source_bert_toks: a cold and melancholy walk of a couple of miles brought us to a high wooden gate , which opened into a gloom ##y avenue of chestnut ##s .

reference_raw: The cool, melancholy walk of several miles led us to a high wooden gate that opened into a dark avenue of chestnuts.

reference_spacy_tokens: The cool , melancholy walk of several miles led us to a high wooden gate that opened into a dark avenue of chestnuts .


fn_spacy_tokens_for_baseline: This villain 's policy was to murder , on one pretext or another , every man who showed such promise that he might in time come to be a dangerous rival .

source_bert_toks: this villain ' s policy was to murder , on one pre ##text or another , every man who showed such promise that he might in time come to be a dangerous rival .

reference_raw: The ruffian's policy was to kill, under one pretext or another, any man who had made such a vow that he might become a dangerous opponent in time.

reference_spacy_tokens: The ruffian 's policy was to kill , under one pretext or another , any man who had made such a vow that he might become a dangerous opponent in time .


fn_spacy_tokens_for_baseline: Here the windows and open doors of the shops reveal an alluring selection of Asian furniture , carpets , carvings , tomb figures , porcelain , and bronze .

source_bert_toks: here the windows and open doors of the shops reveal an all ##uring selection of asian furniture , carpets , carvings , tomb figures , porcelain , and bronze .

reference_raw: Here, the windows and open doors of the shops reveal an admirable choice of Asian furniture, carpets, carvings, tomb figures, porcelain, and bronze.

reference_spacy_tokens: Here , the windows and open doors of the shops reveal an admirable choice of Asian furniture , carpets , carvings , tomb figures , porcelain , and bronze .


fn_spacy_tokens_for_baseline: Although in 88 b.c . , Mithradates made a swift and successful raid from the East across Asia Minor and the Aegean Islands , the next major power change brought influence from the West .

source_bert_toks: although in 88 b . c . , mit ##hra ##dates made a swift and successful raid from the east across asia minor and the aegean islands , the next major power change brought influence from the west .

reference_raw: Although in 88 B.C., Mithradates quickly and successfully invaded Asia Minor and the Aegean Islands from the east, another major change in power brought influence from the west.

reference_spacy_tokens: Although in 88 B.C. , Mithradates quickly and successfully invaded Asia Minor and the Aegean Islands from the east , another major change in power brought influence from the west .


fn_spacy_tokens_for_baseline: It was here that he wrote what was to become the final book of the New Testament , the Book of Revelation .

source_bert_toks: it was here that he wrote what was to become the final book of the new testament , the book of revelation .

reference_raw: Here he wrote what would become the last book of the New Testament, the Book of Revelation.

reference_spacy_tokens: Here he wrote what would become the last book of the New Testament , the Book of Revelation .


fn_spacy_tokens_for_baseline: The Dutch sent an invasion flotilla to Macau in 1622 , but the defenders triumphed .

source_bert_toks: the dutch sent an invasion flotilla to macau in 1622 , but the defenders triumph ##ed .

reference_raw: In 1622, the Dutch sent an invasion fleet to Macau, but the defenses prevailed.

reference_spacy_tokens: In 1622 , the Dutch sent an invasion fleet to Macau , but the defenses prevailed .


fn_spacy_tokens_for_baseline: In his rooms by ten , he summoned a cold platter and a pint of beer and wrote an optimistic , almost boastful letter to Newton .

source_bert_toks: in his rooms by ten , he summoned a cold platt ##er and a pin ##t of beer and wrote an optimistic , almost bo ##ast ##ful letter to newton .

reference_raw: At ten o'clock in his room, he called out a cold tray and a pint of beer and wrote an optimistic, almost bragging letter to Newton.

reference_spacy_tokens: At ten o'clock in his room , he called out a cold tray and a pint of beer and wrote an optimistic , almost bragging letter to Newton .


fn_spacy_tokens_for_baseline: The best - known , however , is the Contes moralises ( probably written after 1320 ) , a collection of prose stories and exempla illustrating some moral point , which were perhaps intended to be used in sermons .

source_bert_toks: the best - known , however , is the con ##tes moral ##ises ( probably written after 132 ##0 ) , a collection of prose stories and ex ##em ##pl ##a illustrating some moral point , which were perhaps intended to be used in sermons .

reference_raw: But the most famous are the Contes morals (probably written after 1320), a collection of prose stories and examples that illustrate a moral point that might have been used in sermons.

reference_spacy_tokens: But the most famous are the Contes morals ( probably written after 1320 ) , a collection of prose stories and examples that illustrate a moral point that might have been used in sermons .


fn_spacy_tokens_for_baseline: The thunder of the choppers filled Kabul 's night sky as Obama 's entourage passed over the capital .

source_bert_toks: the thunder of the chopper ##s filled kabul ' s night sky as obama ' s entourage passed over the capital .

reference_raw: As Obama's escort swept across the capital, the thunder of helicopters filled Kabul's night sky.

reference_spacy_tokens: As Obama 's escort swept across the capital , the thunder of helicopters filled Kabul 's night sky .


fn_spacy_tokens_for_baseline: Change - ringing , a mind - boggling exercise the English invented 380 years ago , requires physical dexterity -- some bells weigh more than a ton -- combined with intense mental concentration .

source_bert_toks: change - ringing , a mind - bog ##gling exercise the english invented 380 years ago , requires physical dexter ##ity - - some bells weigh more than a ton - - combined with intense mental concentration .

reference_raw: The change-ringing, the mind-shifting exercise that England invented 380 years ago, requires physical skill - some bells weigh more than a ton - combined with intense mental concentration.

reference_spacy_tokens: The change - ringing , the mind - shifting exercise that England invented 380 years ago , requires physical skill - some bells weigh more than a ton - combined with intense mental concentration .


fn_spacy_tokens_for_baseline: I can be reading a book and be totally lost in it and think , " Wow !

source_bert_toks: i can be reading a book and be totally lost in it and think , " wow !

reference_raw: You know, I can read a book, and I'm totally out of it, and I'm like, "Wow!

reference_spacy_tokens: You know , I can read a book , and I 'm totally out of it , and I 'm like , " Wow !


fn_spacy_tokens_for_baseline: They cause illness or death within minutes to hours after exposure .

source_bert_toks: they cause illness or death within minutes to hours after exposure .

reference_raw: They cause disease or death within a few seconds to a few hours of exposure.

reference_spacy_tokens: They cause disease or death within a few seconds to a few hours of exposure .


fn_spacy_tokens_for_baseline: Kun Iam Tong , off Avenida do Coronel Mesquita ( open daily 8 am - 6 pm ) , is a 17th - century Buddhist temple of considerable splendor and charm .

source_bert_toks: kun ia ##m tong , off ave ##ni ##da do co ##rone ##l me ##s ##qui ##ta ( open daily 8 am - 6 pm ) , is a 17th - century buddhist temple of considerable sp ##len ##dor and charm .

reference_raw: Kun Iam Tong, off Avenida do Coronel Mesquita (open daily at 8 - 6 p.m.), is a 17th-century Buddhistic temple of considerable beauty and charm.

reference_spacy_tokens: Kun Iam Tong , off Avenida do Coronel Mesquita ( open daily at 8 - 6 p.m. ) , is a 17th - century Buddhistic temple of considerable beauty and charm .


fn_spacy_tokens_for_baseline: The e - commerce free zone is situated in north Dubai , near the industrial free zone in Jebel Ali , the top regional and tenth international leading area in container transit .

source_bert_toks: the e - commerce free zone is situated in north dubai , near the industrial free zone in je ##bel ali , the top regional and tenth international leading area in container transit .

reference_raw: The e-commerce-free zone is located in Northern Dubai, close to the industrial-free zone of Jebel Ali, the highest regional and tenth international leadership in container transit.

reference_spacy_tokens: The e - commerce - free zone is located in Northern Dubai , close to the industrial - free zone of Jebel Ali , the highest regional and tenth international leadership in container transit .


fn_spacy_tokens_for_baseline: Ok , post and/or email me direct if you are or might be interested .

source_bert_toks: ok , post and / or email me direct if you are or might be interested .

reference_raw: Okay, post and/or e-mail me directly if you are or might be interested.

reference_spacy_tokens: Okay , post and/or e - mail me directly if you are or might be interested .


fn_spacy_tokens_for_baseline: Lindsey rose to her feet , nudging a drawer to a close .

source_bert_toks: lindsey rose to her feet , nu ##d ##ging a drawer to a close .

reference_raw: Lindsey stood up and pushed the drawer shut.

reference_spacy_tokens: Lindsey stood up and pushed the drawer shut .


fn_spacy_tokens_for_baseline: His second attack ( Echo June 12 ) , however , was spiteful and even more irritating .

source_bert_toks: his second attack ( echo june 12 ) , however , was spite ##ful and even more irritating .

reference_raw: But his second attack (Echo June 12) was malignant and even more irritating.

reference_spacy_tokens: But his second attack ( Echo June 12 ) was malignant and even more irritating .


fn_spacy_tokens_for_baseline: The nightlife revolves around several self - contained centres , the biggest and best being the Kasbah where most nights you 'll find us hopping and bopping around Fantasy Island , a wonderful disco pub presided over by our friends Steve and Donato .

source_bert_toks: the night ##life revolves around several self - contained centres , the biggest and best being the ka ##sb ##ah where most nights you ' ll find us hopping and bop ##ping around fantasy island , a wonderful disco pub presided over by our friends steve and dona ##to .

reference_raw: The nightlife revolves around a few separate centers, the greatest and best of all being the Kasbah, where most of the night you find us bouncing and bouncing around Fantasy Island, the great disco bar presided over by our friends, Steve and Donato.

reference_spacy_tokens: The nightlife revolves around a few separate centers , the greatest and best of all being the Kasbah , where most of the night you find us bouncing and bouncing around Fantasy Island , the great disco bar presided over by our friends , Steve and Donato .


fn_spacy_tokens_for_baseline: " I 'm feeling a lot more optimistic today than I did yesterday .

source_bert_toks: " i ' m feeling a lot more optimistic today than i did yesterday .

reference_raw: "Today I feel more optimistic than yesterday."

reference_spacy_tokens: " Today I feel more optimistic than yesterday . "


fn_spacy_tokens_for_baseline: It 's a flimsy structure , built up on supports , and it was really rocking around .

source_bert_toks: it ' s a fl ##im ##sy structure , built up on supports , and it was really rocking around .

reference_raw: It's a flimsy structure, built on support, and it's really bouncing around.

reference_spacy_tokens: It 's a flimsy structure , built on support , and it 's really bouncing around .


fn_spacy_tokens_for_baseline: Iran continues to assert , however , that its nuclear program is for the generation of electricity alone .

source_bert_toks: iran continues to assert , however , that its nuclear program is for the generation of electricity alone .

reference_raw: However, Iran continues to claim that its nuclear programme is designed only to produce electricity.

reference_spacy_tokens: However , Iran continues to claim that its nuclear programme is designed only to produce electricity .


fn_spacy_tokens_for_baseline: In the aftermath of its losses in the Six Day War , Syria felt that it needed broader support from the international community to guard against Israeli acts of aggression .

source_bert_toks: in the aftermath of its losses in the six day war , syria felt that it needed broader support from the international community to guard against israeli acts of aggression .

reference_raw: After losing in the Six-Day War, Syria felt that it needed wider support from the international community to protect against Israeli acts of aggression.

reference_spacy_tokens: After losing in the Six - Day War , Syria felt that it needed wider support from the international community to protect against Israeli acts of aggression .


fn_spacy_tokens_for_baseline: The agreement also bound the two sides to forgo the possession of " nuclear reprocessing and uranium enrichment facilities . "

source_bert_toks: the agreement also bound the two sides to for ##go the possession of " nuclear rep ##ro ##ces ##sing and uranium enrichment facilities . "

reference_raw: The agreement also required both parties to waive the possession of "nuclear reprocessing and uranium enrichment facilities."

reference_spacy_tokens: The agreement also required both parties to waive the possession of " nuclear reprocessing and uranium enrichment facilities . "


fn_spacy_tokens_for_baseline: In the Histories , however , he is sly , drunken and spineless , even lifting a sentence of excommunication on a man suspected of matricide .

source_bert_toks: in the histories , however , he is sly , drunken and spine ##less , even lifting a sentence of ex ##com ##mun ##ication on a man suspected of mat ##ric ##ide .

reference_raw: But in history, he is sly, drunk and spineless, and he even lifts the sentence of excommunication against a man suspected of murder.

reference_spacy_tokens: But in history , he is sly , drunk and spineless , and he even lifts the sentence of excommunication against a man suspected of murder .


fn_spacy_tokens_for_baseline: The meat is put back , coated in a cream - reduction sauce and glazed .

source_bert_toks: the meat is put back , coated in a cream - reduction sauce and glazed .

reference_raw: The meat is returned, coated with cream-reducing sauce and glassed.

reference_spacy_tokens: The meat is returned , coated with cream - reducing sauce and glassed .


fn_spacy_tokens_for_baseline: The facility also will be used to assess threat vulnerabilities and potential consequences and conduct forensic analysis of evidence from terrorism and biological crimes .

source_bert_toks: the facility also will be used to assess threat vu ##ln ##era ##bilities and potential consequences and conduct forensic analysis of evidence from terrorism and biological crimes .

reference_raw: The instrument will also be used to assess threat weaknesses and possible consequences and to carry out forensic analysis of evidence from terrorism and biological crime.

reference_spacy_tokens: The instrument will also be used to assess threat weaknesses and possible consequences and to carry out forensic analysis of evidence from terrorism and biological crime .


fn_spacy_tokens_for_baseline: Scald the milk with the citrus zest in a medium - sized saucepan .

source_bert_toks: sc ##ald the milk with the citrus ze ##st in a medium - sized sauce ##pan .

reference_raw: Mix the milk with citrus zest in a medium-sized saucepan.

reference_spacy_tokens: Mix the milk with citrus zest in a medium - sized saucepan .


fn_spacy_tokens_for_baseline: He also is charged with aggravated sexual assault , kidnapping , forcible confinement and indignity to a human body .

source_bert_toks: he also is charged with aggravated sexual assault , kidnapping , for ##ci ##ble confinement and ind ##ign ##ity to a human body .

reference_raw: He's also accused of aggravated sex attack, kidnapping, forced confinement and indignation to the human body.

reference_spacy_tokens: He 's also accused of aggravated sex attack , kidnapping , forced confinement and indignation to the human body .


fn_spacy_tokens_for_baseline: This theory singles out current Executive Editor Downie for abuse , but complacency took root as early as 1981 , when the Post 's cross - town competitor , the Washington Star , folded , allowing the fat beast to diddle all it wanted without paying a price .

source_bert_toks: this theory singles out current executive editor down ##ie for abuse , but com ##pl ##ace ##ncy took root as early as 1981 , when the post ' s cross - town competitor , the washington star , folded , allowing the fat beast to did ##dle all it wanted without paying a price .

reference_raw: This theory singles out the current executive editor Downie for abuse, but complacency was rooted in 1981 when the Post's cross-town rival, the Washington Star, collapsed, allowing the fat animal to do what it wanted without paying the price.

reference_spacy_tokens: This theory singles out the current executive editor Downie for abuse , but complacency was rooted in 1981 when the Post 's cross - town rival , the Washington Star , collapsed , allowing the fat animal to do what it wanted without paying the price .


fn_spacy_tokens_for_baseline: Baynes flushed with pleasure .

source_bert_toks: bay ##nes flushed with pleasure .

reference_raw: Baynes flushed with joy.

reference_spacy_tokens: Baynes flushed with joy .


fn_spacy_tokens_for_baseline: When he heard of a Kaiser talking in an after - dinner speech about ' my friend the Sultan ' he was astonished , and could have rent his garments .

source_bert_toks: when he heard of a kaiser talking in an after - dinner speech about ' my friend the sultan ' he was astonished , and could have rent his garments .

reference_raw: When he heard the Emperor speak of 'my friend the sultan' in an after-dinner speech, he was surprised and could borrow his clothes.

reference_spacy_tokens: When he heard the Emperor speak of ' my friend the sultan ' in an after - dinner speech , he was surprised and could borrow his clothes .


fn_spacy_tokens_for_baseline: It still revels in its own identity , which is now internationally recognized through such influential cultural products as the Rastafarian religion and reggae music .

source_bert_toks: it still rev ##els in its own identity , which is now internationally recognized through such influential cultural products as the ras ##ta ##far ##ian religion and reggae music .

reference_raw: It still enjoys its own identity, which is now internationally recognised by such powerful cultural products as the Rastafarian religion and reggae music.

reference_spacy_tokens: It still enjoys its own identity , which is now internationally recognised by such powerful cultural products as the Rastafarian religion and reggae music .


fn_spacy_tokens_for_baseline: I 'm dressed in black jeans , black boots and a dark blue polo - neck over a navy shirt and two vests .

source_bert_toks: i ' m dressed in black jeans , black boots and a dark blue polo - neck over a navy shirt and two vest ##s .

reference_raw: I'm wearing black jeans, black shoes, and a dark blue polo neck over a Navy shirt and two vests.

reference_spacy_tokens: I 'm wearing black jeans , black shoes , and a dark blue polo neck over a Navy shirt and two vests .


fn_spacy_tokens_for_baseline: On his marriage on 2 April 1622 to Elizabeth , daughter of Robert Coxe , grocer , of London , he had land in Hampshire , Surrey , and Wiltshire settled on him .

source_bert_toks: on his marriage on 2 april 1622 to elizabeth , daughter of robert cox ##e , gr ##oc ##er , of london , he had land in hampshire , surrey , and wiltshire settled on him .

reference_raw: On April 2, 1622, he married Elizabeth, daughter of Robert Coxe, a grocer in London, and settled in Hampshire, Surrey, and Wiltshire.

reference_spacy_tokens: On April 2 , 1622 , he married Elizabeth , daughter of Robert Coxe , a grocer in London , and settled in Hampshire , Surrey , and Wiltshire .


fn_spacy_tokens_for_baseline: They asked that their wrists be untied .

source_bert_toks: they asked that their wrists be un ##tie ##d .

reference_raw: They asked to loosen their wrists.

reference_spacy_tokens: They asked to loosen their wrists .


fn_spacy_tokens_for_baseline: After the initial years of Roman administration and political infighting , Rome installed Herod ( scion of a family from Idumea , a Jewish kingdom in the desert ) as King of Judea .

source_bert_toks: after the initial years of roman administration and political in ##fighting , rome installed hero ##d ( sci ##on of a family from id ##ume ##a , a jewish kingdom in the desert ) as king of jude ##a .

reference_raw: After the first years of the Roman administration and the political struggle, Rome introduced Herod (science of a family from Idumea, a Jewish kingdom in the desert) as King of Judea.

reference_spacy_tokens: After the first years of the Roman administration and the political struggle , Rome introduced Herod ( science of a family from Idumea , a Jewish kingdom in the desert ) as King of Judea .


fn_spacy_tokens_for_baseline: His interest is in pricking Prior Robert and Sub - Prior Herluin into bristling at each other with wattles glowing scarlet and throats gobbling rage .

source_bert_toks: his interest is in prick ##ing prior robert and sub - prior her ##lu ##in into br ##ist ##ling at each other with watt ##les glowing scarlet and throat ##s go ##bbling rage .

reference_raw: He's interested in stabbing Prior Robert and Sub-prior Herluin into bristling each other with wattles of glittering scarlet and throats of bubbling rage.

reference_spacy_tokens: He 's interested in stabbing Prior Robert and Sub - prior Herluin into bristling each other with wattles of glittering scarlet and throats of bubbling rage .


fn_spacy_tokens_for_baseline: The Hasmonean dynasty , descendants of the Maccabee family , ruled an independent Jewish Commonwealth that stretched from the Negev to the Galilee .

source_bert_toks: the has ##mon ##ean dynasty , descendants of the mac ##ca ##bee family , ruled an independent jewish commonwealth that stretched from the ne ##ge ##v to the galilee .

reference_raw: The Hasmonian dynasty, descendants of the Maccabee family, ruled an independent Jewish community that ran from Negev to Galilee.

reference_spacy_tokens: The Hasmonian dynasty , descendants of the Maccabee family , ruled an independent Jewish community that ran from Negev to Galilee .


fn_spacy_tokens_for_baseline: The coins clinked into the slot .

source_bert_toks: the coins cl ##ink ##ed into the slot .

reference_raw: Coins clicked in the slot.

reference_spacy_tokens: Coins clicked in the slot .


fn_spacy_tokens_for_baseline: I admit Victor is evasive at times , but we have known one another since early childhood , we are as close as brother and sister -- '

source_bert_toks: i admit victor is eva ##sive at times , but we have known one another since early childhood , we are as close as brother and sister - - '

reference_raw: I admit Victor's elusive sometimes, but we've known each other since we were little, and we've been as close to each other as siblings-'

reference_spacy_tokens: I admit Victor 's elusive sometimes , but we 've known each other since we were little , and we 've been as close to each other as siblings- '


fn_spacy_tokens_for_baseline: There it will only be 6 pm local time , but thanks to Indiana 's all - electronic system , votes will be tallied on a running basis throughout the day .

source_bert_toks: there it will only be 6 pm local time , but thanks to indiana ' s all - electronic system , votes will be tall ##ied on a running basis throughout the day .

reference_raw: There will be only 6:00 a.m. local time, but thanks to Indiana's electronic system, the votes will be raised throughout the day.

reference_spacy_tokens: There will be only 6:00 a.m. local time , but thanks to Indiana 's electronic system , the votes will be raised throughout the day .


fn_spacy_tokens_for_baseline: After hours of going round and round the stable yard , he was at last satisfied with her deportment in the saddle and she , herself , felt at one with her mount .

source_bert_toks: after hours of going round and round the stable yard , he was at last satisfied with her de ##port ##ment in the saddle and she , herself , felt at one with her mount .

reference_raw: After hours of walking around the stable yard, he was finally satisfied with her deportation in the saddle, and she felt one with her horse.

reference_spacy_tokens: After hours of walking around the stable yard , he was finally satisfied with her deportation in the saddle , and she felt one with her horse .