fn_spacy_tokens_for_baseline: Sprinkle with the breadcrumbs and then moisten the contents of the dish with the vegetable stock .

source_bert_toks: sp ##rin ##kle with the bread ##cr ##umb ##s and then moist ##en the contents of the dish with the vegetable stock .

reference_raw: Sprinkle the bread crumbs and then wet the contents with the vegetable stock.

reference_spacy_tokens: Sprinkle the bread crumbs and then wet the contents with the vegetable stock .


fn_spacy_tokens_for_baseline: He could farm alpaca , deer and wild boar .

source_bert_toks: he could farm al ##pac ##a , deer and wild boar .

reference_raw: He can grow alpaca, deer and wild boar.

reference_spacy_tokens: He can grow alpaca , deer and wild boar .


fn_spacy_tokens_for_baseline: Not only have the supply of components to be of perfect quality and in the exact quantity , but they have to be delivered in small batches at very specific times .

source_bert_toks: not only have the supply of components to be of perfect quality and in the exact quantity , but they have to be delivered in small batch ##es at very specific times .

reference_raw: Not only do the components have to be of perfect quality and in the same amount, but they must be delivered in small batches at very specific times.

reference_spacy_tokens: Not only do the components have to be of perfect quality and in the same amount , but they must be delivered in small batches at very specific times .


fn_spacy_tokens_for_baseline: Walking into the dining room he saw a huge man about seven or eight feet tall standing behind the desk at the other end of the room .

source_bert_toks: walking into the dining room he saw a huge man about seven or eight feet tall standing behind the desk at the other end of the room .

reference_raw: He entered the mess hall and saw a huge man, about seven or eight feet tall, standing behind a table at the far end of the room.

reference_spacy_tokens: He entered the mess hall and saw a huge man , about seven or eight feet tall , standing behind a table at the far end of the room .


fn_spacy_tokens_for_baseline: Any Conservative you care to converse with will predict a close contest at the next election .

source_bert_toks: any conservative you care to converse with will predict a close contest at the next election .

reference_raw: Any conservative you want to talk to will predict a close competition for the next election.

reference_spacy_tokens: Any conservative you want to talk to will predict a close competition for the next election .


fn_spacy_tokens_for_baseline: He could see sorrow in the dark eyes which glowed as if there were candles burning behind them .

source_bert_toks: he could see sorrow in the dark eyes which glowed as if there were candles burning behind them .

reference_raw: He saw sadness in those dark eyes that glowed like candles burning behind them.

reference_spacy_tokens: He saw sadness in those dark eyes that glowed like candles burning behind them .


fn_spacy_tokens_for_baseline: Edward Crumwallis let out more silvery squeaks of amusement .

source_bert_toks: edward cr ##um ##wall ##is let out more silvery squeak ##s of amusement .

reference_raw: Edward Crumwallis let out another silvery squeal of amusement.

reference_spacy_tokens: Edward Crumwallis let out another silvery squeal of amusement .


fn_spacy_tokens_for_baseline: When the time comes to move to a new territory , the nest dissolves and its residents decamp , taking their herds with them ( German Research , 2/91 , pp4 - 7 ) .

source_bert_toks: when the time comes to move to a new territory , the nest dissolve ##s and its residents dec ##amp , taking their herds with them ( german research , 2 / 91 , pp ##4 - 7 ) .

reference_raw: When it is time to move to a new area, the nest will dissolve and its inhabitants will de-camp and take the herds with them (German Research, 2/91, pp4-7).

reference_spacy_tokens: When it is time to move to a new area , the nest will dissolve and its inhabitants will de - camp and take the herds with them ( German Research , 2/91 , pp4 - 7 ) .


fn_spacy_tokens_for_baseline: All summer English cricket has been highly suspicious about how the Pakistanis made the old ball swing about so violently .

source_bert_toks: all summer english cricket has been highly suspicious about how the pakistani ##s made the old ball swing about so violently .

reference_raw: All summer, English cricket was very suspicious of how the Pakistanis had so violently turned the old ball around.

reference_spacy_tokens: All summer , English cricket was very suspicious of how the Pakistanis had so violently turned the old ball around .


fn_spacy_tokens_for_baseline: First , the ballet livrets of this period treat the instrumentalists as members of discrete groups .

source_bert_toks: first , the ballet liv ##ret ##s of this period treat the instrumentalist ##s as members of discrete groups .

reference_raw: First, the ballet livrets of this period consider instrumentalists to be members of separate groups.

reference_spacy_tokens: First , the ballet livrets of this period consider instrumentalists to be members of separate groups .


fn_spacy_tokens_for_baseline: On Sunday morning Rachel awoke to bright autumn sunshine and clear blue skies .

source_bert_toks: on sunday morning rachel awoke to bright autumn sunshine and clear blue skies .

reference_raw: On Sunday morning Rachel woke up in a clear autumn sun and a clear blue sky.

reference_spacy_tokens: On Sunday morning Rachel woke up in a clear autumn sun and a clear blue sky .


fn_spacy_tokens_for_baseline: She mulled over what the object might be .

source_bert_toks: she mu ##lled over what the object might be .

reference_raw: She wondered what the object might be.

reference_spacy_tokens: She wondered what the object might be .


fn_spacy_tokens_for_baseline: Firms in those countries become the world leaders and begin to export as rising incomes spur demand elsewhere .

source_bert_toks: firms in those countries become the world leaders and begin to export as rising incomes spur demand elsewhere .

reference_raw: Firms in these countries will become world leaders, and they will start to exporters, as rising incomes spur demand elsewhere.

reference_spacy_tokens: Firms in these countries will become world leaders , and they will start to exporters , as rising incomes spur demand elsewhere .


fn_spacy_tokens_for_baseline: He stepped on to my lap and began to tread my crotch , purring loudly .

source_bert_toks: he stepped on to my lap and began to tread my crotch , pu ##rring loudly .

reference_raw: He stepped into my lap and began to tread on my crotch, whirring loudly.

reference_spacy_tokens: He stepped into my lap and began to tread on my crotch , whirring loudly .


fn_spacy_tokens_for_baseline: ' I think you 'd better stay at home , ' Otley cautioned .

source_bert_toks: ' i think you ' d better stay at home , ' ot ##ley caution ##ed .

reference_raw: 'You should stay home,' Otley said.

reference_spacy_tokens: ' You should stay home , ' Otley said .


fn_spacy_tokens_for_baseline: Having established the undercoat by way of washing and blotting onto damp paper , I now begin to apply very watery paint onto dry paper , slowly building up a series of translucent layers .

source_bert_toks: having established the under ##coat by way of washing and b ##lot ##ting onto damp paper , i now begin to apply very watery paint onto dry paper , slowly building up a series of translucent layers .

reference_raw: After fixing the undercoat by washing and staining it on wet paper, I now begin to apply very watery paint to the dry paper and slowly build up a series of transparent layers.

reference_spacy_tokens: After fixing the undercoat by washing and staining it on wet paper , I now begin to apply very watery paint to the dry paper and slowly build up a series of transparent layers .


fn_spacy_tokens_for_baseline: The propulsive string motif of Jacksons , Monk and Rowe solicited warm applause as did the political recriminations of This Sad Burlesque .

source_bert_toks: the prop ##ulsive string motif of jackson ##s , monk and rowe sol ##ici ##ted warm applause as did the political rec ##rim ##inations of this sad bu ##rle ##sque .

reference_raw: The propulsive string motif of Jackson, Monk, and Rowe brought warm applause, as did this sad Burlesque's political accusations.

reference_spacy_tokens: The propulsive string motif of Jackson , Monk , and Rowe brought warm applause , as did this sad Burlesque 's political accusations .


fn_spacy_tokens_for_baseline: Tora ! filming was not a happy one , as the film crew obliterated the old paint on the airframe and ground - looped a gear leg off during the filming .

source_bert_toks: tor ##a ! filming was not a happy one , as the film crew ob ##lite ##rated the old paint on the air ##frame and ground - loop ##ed a gear leg off during the filming .

reference_raw: Tora! the filming wasn't happy, because the movie crew wiped out the old paint on the air frame and grounded the gear leg while the filming took place.

reference_spacy_tokens: Tora ! the filming was n't happy , because the movie crew wiped out the old paint on the air frame and grounded the gear leg while the filming took place .


fn_spacy_tokens_for_baseline: The incident at Mayak was the third shooting in recent weeks involving nuclear weapons or facilities in Russia .

source_bert_toks: the incident at maya ##k was the third shooting in recent weeks involving nuclear weapons or facilities in russia .

reference_raw: The Mayak incident was the third shooting in the last few weeks involving nuclear weapons or equipment in Russia.

reference_spacy_tokens: The Mayak incident was the third shooting in the last few weeks involving nuclear weapons or equipment in Russia .


fn_spacy_tokens_for_baseline: But the Mafia bosses who financed the operation were displeased with its performance ; Siegel was murdered in the summer of 1947 .

source_bert_toks: but the mafia bosses who financed the operation were di ##sp ##lea ##sed with its performance ; siegel was murdered in the summer of 1947 .

reference_raw: But the mob bosses who funded the operation didn't like it; Siegel was murdered in the summer of 1947.

reference_spacy_tokens: But the mob bosses who funded the operation did n't like it ; Siegel was murdered in the summer of 1947 .


fn_spacy_tokens_for_baseline: Many roadblocks remain and progress is likely to be painful and slow .

source_bert_toks: many road ##block ##s remain and progress is likely to be painful and slow .

reference_raw: There are still many roadblocks and progress is likely to be painful and slow.

reference_spacy_tokens: There are still many roadblocks and progress is likely to be painful and slow .


fn_spacy_tokens_for_baseline: Tug had just one glimpse of the girl 's horror as her mouth and her eyes opened wide .

source_bert_toks: tug had just one glimpse of the girl ' s horror as her mouth and her eyes opened wide .

reference_raw: Tug saw only one glimpse of the girl's terror as she opened her mouth and eyes wide.

reference_spacy_tokens: Tug saw only one glimpse of the girl 's terror as she opened her mouth and eyes wide .


fn_spacy_tokens_for_baseline: There ' a kid in a white leather blazer ' had asked her ' Dorothy , do you have some problem at home ? '

source_bert_toks: there ' a kid in a white leather blaze ##r ' had asked her ' dorothy , do you have some problem at home ? '

reference_raw: "A boy in a white leather jacket" asked her, "Dorothy, do you have a problem at home?"

reference_spacy_tokens: " A boy in a white leather jacket " asked her , " Dorothy , do you have a problem at home ? "


fn_spacy_tokens_for_baseline: The soul of a princess in her gypsy rags , Doomed to fret in her humble stall .

source_bert_toks: the soul of a princess in her gypsy rags , doomed to fr ##et in her humble stall .

reference_raw: The soul of the princess in her gypsy cloths, Doomed to fret in her humble stall.

reference_spacy_tokens: The soul of the princess in her gypsy cloths , Doomed to fret in her humble stall .


fn_spacy_tokens_for_baseline: Its companions emerged and approached the small fire , but stayed warily at a distance , more afraid of the flame than of the humans who had kindled it , Tallis decided .

source_bert_toks: its companions emerged and approached the small fire , but stayed warily at a distance , more afraid of the flame than of the humans who had kind ##led it , tall ##is decided .

reference_raw: His companions came out and approached the small fire, but remained wary of the fire, more afraid of it than of the people who had treated it, Tallis decided.

reference_spacy_tokens: His companions came out and approached the small fire , but remained wary of the fire , more afraid of it than of the people who had treated it , Tallis decided .


fn_spacy_tokens_for_baseline: ' I 'll kill him , ' repeated Bigwig , spluttering through his fouled whiskers and clotted fur .

source_bert_toks: ' i ' ll kill him , ' repeated big ##wig , sp ##lu ##ttering through his foul ##ed w ##his ##kers and cl ##otted fur .

reference_raw: 'I'm going to kill him,' said Bigwig, splashing through his foul beard and clotted fur.

reference_spacy_tokens: ' I 'm going to kill him , ' said Bigwig , splashing through his foul beard and clotted fur .


fn_spacy_tokens_for_baseline: When he married he rented a rambling red - brick Georgian house two miles away and bicycled to work at the forge most days .

source_bert_toks: when he married he rented a ram ##bling red - brick georgian house two miles away and bicycle ##d to work at the forge most days .

reference_raw: When he got married, he rented a rattling, red-brick Georgian house two miles away and spent most of the day on a bike to work in a forge.

reference_spacy_tokens: When he got married , he rented a rattling , red - brick Georgian house two miles away and spent most of the day on a bike to work in a forge .


fn_spacy_tokens_for_baseline: Rachel 's eyes were scornful .

source_bert_toks: rachel ' s eyes were sc ##orn ##ful .

reference_raw: Rachel looked contemptuous.

reference_spacy_tokens: Rachel looked contemptuous .


fn_spacy_tokens_for_baseline: Following this debacle , the Ottomans then allied themselves to Germany in the World War I , losing more territory with the defeat of the Germans in that war .

source_bert_toks: following this de ##ba ##cle , the ottomans then allied themselves to germany in the world war i , losing more territory with the defeat of the germans in that war .

reference_raw: After this debacle, the Ottomans then joined Germany during World War I, and lost more land after the Germans were defeated in that war.

reference_spacy_tokens: After this debacle , the Ottomans then joined Germany during World War I , and lost more land after the Germans were defeated in that war .


fn_spacy_tokens_for_baseline: Paisley had broken with Kilfedder because he had not been sufficiently outspoken in his criticism of O'Neill .

source_bert_toks: paisley had broken with ki ##lf ##edd ##er because he had not been sufficiently outspoken in his criticism of o ' neill .

reference_raw: Paisley broke up with Kilfedder because he wasn't open enough to criticize O'Neill.

reference_spacy_tokens: Paisley broke up with Kilfedder because he was n't open enough to criticize O'Neill .


fn_spacy_tokens_for_baseline: They played hopscotch , their favourite , in the ever brightening sunshine , throwing a white pebble into the boxes they had marked out on the ground , and then trying to hop to where the pebble landed without touching any lines .

source_bert_toks: they played hop ##sco ##tch , their favourite , in the ever bright ##ening sunshine , throwing a white pe ##bble into the boxes they had marked out on the ground , and then trying to hop to where the pe ##bble landed without touching any lines .

reference_raw: In the ever-brightening sunlight, they played their favorite homscotch, threw a white pebble into the boxes they had identified on the ground, and then tried to jump to where the pebble landed without touching the lines.

reference_spacy_tokens: In the ever - brightening sunlight , they played their favorite homscotch , threw a white pebble into the boxes they had identified on the ground , and then tried to jump to where the pebble landed without touching the lines .


fn_spacy_tokens_for_baseline: I stayed at the Hotel Corrieu in peaceful La Llagonne .

source_bert_toks: i stayed at the hotel co ##rrie ##u in peaceful la ll ##ago ##nne .

reference_raw: I was at the Corrieu Hotel in peaceful La Llagonne.

reference_spacy_tokens: I was at the Corrieu Hotel in peaceful La Llagonne .


fn_spacy_tokens_for_baseline: Hundreds of workers " were working feverishly " to place piping and wiring in Iran 's underground enrichment facility at Natanz , said a diplomat accredited to the agency .

source_bert_toks: hundreds of workers " were working fever ##ishly " to place pip ##ing and wiring in iran ' s underground enrichment facility at nat ##an ##z , said a diplomat accredited to the agency .

reference_raw: Hundreds of employees "worked feverishly" to place pipes and wires in the Iranian subterranean enrichment facility in Natanz, said a diplomat accredited to the Agency.

reference_spacy_tokens: Hundreds of employees " worked feverishly " to place pipes and wires in the Iranian subterranean enrichment facility in Natanz , said a diplomat accredited to the Agency .


fn_spacy_tokens_for_baseline: These were not genuine madrigals though they show madrigalian traits , nor are most of his Songs of sundrie natures of the following year .

source_bert_toks: these were not genuine mad ##ri ##gal ##s though they show mad ##ri ##gal ##ian traits , nor are most of his songs of sun ##dr ##ie nature ##s of the following year .

reference_raw: They weren't real madrigals, though they showed madrigal traits, and most of his songs were not sundry in the following year.

reference_spacy_tokens: They were n't real madrigals , though they showed madrigal traits , and most of his songs were not sundry in the following year .


fn_spacy_tokens_for_baseline: Gabriel carefully buttered a roll .

source_bert_toks: gabriel carefully butter ##ed a roll .

reference_raw: Gabriel chewed the roll carefully.

reference_spacy_tokens: Gabriel chewed the roll carefully .


fn_spacy_tokens_for_baseline: Joseph demanded of her : ' Who is this ?

source_bert_toks: joseph demanded of her : ' who is this ?

reference_raw: Joseph asked her, "Who's that?

reference_spacy_tokens: Joseph asked her , " Who 's that ?


fn_spacy_tokens_for_baseline: Other shots were fired , but Mr Ellis escaped injury .

source_bert_toks: other shots were fired , but mr ellis escaped injury .

reference_raw: More shots were fired, but Mr. Ellis got away from the wound.

reference_spacy_tokens: More shots were fired , but Mr. Ellis got away from the wound .


fn_spacy_tokens_for_baseline: Once you agree to help us move this fund , we will link you up with our late father 's lawyer who endorsed his signatures during the day my father was depositing the fund so that he can brief you more better .

source_bert_toks: once you agree to help us move this fund , we will link you up with our late father ' s lawyer who endorsed his signatures during the day my father was deposit ##ing the fund so that he can brief you more better .

reference_raw: Once you've agreed to help us move the fund, we'll link you to our deceased father's attorney who approved his signatures on the day my father deposited the fund to give you more information.

reference_spacy_tokens: Once you 've agreed to help us move the fund , we 'll link you to our deceased father 's attorney who approved his signatures on the day my father deposited the fund to give you more information .


fn_spacy_tokens_for_baseline: The survey revealed that 100,000 people had injected drugs in the past five years , with more than half sharing needles .

source_bert_toks: the survey revealed that 100 , 000 people had injected drugs in the past five years , with more than half sharing needles .

reference_raw: Research has shown that over the last five years, 100,000 people have given drugs and more than half share needles.

reference_spacy_tokens: Research has shown that over the last five years , 100,000 people have given drugs and more than half share needles .


fn_spacy_tokens_for_baseline: ' A bus - load of boring belly dancers , ' I said , and pranced around the room .

source_bert_toks: ' a bus - load of boring belly dancers , ' i said , and pr ##ance ##d around the room .

reference_raw: "Busload of boring belly dancers," I said, walking around the room.

reference_spacy_tokens: " Busload of boring belly dancers , " I said , walking around the room .


fn_spacy_tokens_for_baseline: It was wonderful to be up in the air and to feel the air swishing past his face .

source_bert_toks: it was wonderful to be up in the air and to feel the air sw ##ishing past his face .

reference_raw: It was wonderful to be up in the air and feel the air swirl around his face.

reference_spacy_tokens: It was wonderful to be up in the air and feel the air swirl around his face .


fn_spacy_tokens_for_baseline: Aisha 's gold chain which I 'd carried away from her house hidden among my clothes was in my hands one moment and the next on the counter in the Oxford Street goldsmith 's .

source_bert_toks: ai ##sha ' s gold chain which i ' d carried away from her house hidden among my clothes was in my hands one moment and the next on the counter in the oxford street goldsmith ' s .

reference_raw: One moment I held Aisha's gold necklace, which I had carried away from her house, hidden between my clothes, and the next on the counter of the Oxford Street goldsmith.

reference_spacy_tokens: One moment I held Aisha 's gold necklace , which I had carried away from her house , hidden between my clothes , and the next on the counter of the Oxford Street goldsmith .


fn_spacy_tokens_for_baseline: Sabine sat up , shivered a little in the cool of the early morning air , as Rohan walked in , a towel knotted round his hips , carrying two cups .

source_bert_toks: sabine sat up , shivered a little in the cool of the early morning air , as rohan walked in , a towel knotted round his hips , carrying two cups .

reference_raw: Sabine sat up, shivering slightly in the early morning air, and Rohan entered with a towel wrapped around his hips and two cups in his hand.

reference_spacy_tokens: Sabine sat up , shivering slightly in the early morning air , and Rohan entered with a towel wrapped around his hips and two cups in his hand .


fn_spacy_tokens_for_baseline: According to diplomatic sources , Baker warned that failure to address the charges could derail the peace process .

source_bert_toks: according to diplomatic sources , baker warned that failure to address the charges could der ##ail the peace process .

reference_raw: According to diplomatic sources, Baker warned that non-responsiveness to the charges might disrupt the peace process.

reference_spacy_tokens: According to diplomatic sources , Baker warned that non - responsiveness to the charges might disrupt the peace process .


fn_spacy_tokens_for_baseline: ' When I estimate prices I look at how important the costume or prop was in the film , and how significant the film was .

source_bert_toks: ' when i estimate prices i look at how important the costume or prop was in the film , and how significant the film was .

reference_raw: When I estimate the price, I look at how important the costume or prop was in the movie and how important it was.

reference_spacy_tokens: When I estimate the price , I look at how important the costume or prop was in the movie and how important it was .


fn_spacy_tokens_for_baseline: Alfonso was victorious without striking a blow ; and his anger at the failure of El Cid to join him knew no bounds .

source_bert_toks: alfonso was victorious without striking a blow ; and his anger at the failure of el cid to join him knew no bounds .

reference_raw: Alfonso won without a blow; and his anger at El Cid's failure to join him knew no bounds.

reference_spacy_tokens: Alfonso won without a blow ; and his anger at El Cid 's failure to join him knew no bounds .


fn_spacy_tokens_for_baseline: They were n't too well versed in the disciplines and restraints imposed by TV .

source_bert_toks: they weren ' t too well verse ##d in the disciplines and restraints imposed by tv .

reference_raw: They were not very good at the disciplines and restraints imposed by television.

reference_spacy_tokens: They were not very good at the disciplines and restraints imposed by television .


fn_spacy_tokens_for_baseline: And she does this by telling the stories of her different heroes in a series of ever more tense situations of suspense , situations where the outcome is fearfully doubtful .

source_bert_toks: and she does this by telling the stories of her different heroes in a series of ever more tense situations of suspense , situations where the outcome is fearful ##ly doubtful .

reference_raw: And he's doing it by recounting the tales of his various heroes in a series of increasingly tense situations of tension, situations where the outcome is fearfully questionable.

reference_spacy_tokens: And he 's doing it by recounting the tales of his various heroes in a series of increasingly tense situations of tension , situations where the outcome is fearfully questionable .


fn_spacy_tokens_for_baseline: So necessity it would seem was another reason why she tended to use just the one camera .

source_bert_toks: so necessity it would seem was another reason why she tended to use just the one camera .

reference_raw: So necessary that seemed to be another reason why she had a tendency to use only one camera.

reference_spacy_tokens: So necessary that seemed to be another reason why she had a tendency to use only one camera .


fn_spacy_tokens_for_baseline: She took another drag of her cigarette .

source_bert_toks: she took another drag of her cigarette .

reference_raw: She took another sip of her cigarette.

reference_spacy_tokens: She took another sip of her cigarette .


fn_spacy_tokens_for_baseline: As the apparatus of imperial rule expanded in Asia and Africa , the aristocratic militarism that Bright had decried gained a new lease of life .

source_bert_toks: as the apparatus of imperial rule expanded in asia and africa , the aristocratic mil ##ita ##ris ##m that bright had dec ##ried gained a new lease of life .

reference_raw: As the Empire's apparatus expanded in Asia and Africa, the aristocratic militarism that Bright had desecrated gained a new lease of life.

reference_spacy_tokens: As the Empire 's apparatus expanded in Asia and Africa , the aristocratic militarism that Bright had desecrated gained a new lease of life .


fn_spacy_tokens_for_baseline: A detailed observation of the mother feeding the child can give a guide to the emotional nature of the relationship .

source_bert_toks: a detailed observation of the mother feeding the child can give a guide to the emotional nature of the relationship .

reference_raw: The detailed monitoring of the mother feeding the child may provide guidance on the emotional nature of the relationship.

reference_spacy_tokens: The detailed monitoring of the mother feeding the child may provide guidance on the emotional nature of the relationship .


fn_spacy_tokens_for_baseline: The Mycenaeans were an acquisitive race who came to conquer , not to trade .

source_bert_toks: the my ##cen ##aea ##ns were an ac ##qui ##sit ##ive race who came to conquer , not to trade .

reference_raw: The Mycenaeans were an acquiescence breed that came to conquer, not to trade.

reference_spacy_tokens: The Mycenaeans were an acquiescence breed that came to conquer , not to trade .


fn_spacy_tokens_for_baseline: For a while he sat in a corridor outside the room where the medical team was saving Edmund Jason 's life , and he did his bit by praying hard but silently for the young man .

source_bert_toks: for a while he sat in a corridor outside the room where the medical team was saving edmund jason ' s life , and he did his bit by praying hard but silently for the young man .

reference_raw: He sat for a moment in the hallway in front of the room where the medical team had saved Edmund Jason's life, and he did his part by praying hard but quietly to the young man.

reference_spacy_tokens: He sat for a moment in the hallway in front of the room where the medical team had saved Edmund Jason 's life , and he did his part by praying hard but quietly to the young man .


fn_spacy_tokens_for_baseline: In the early Middle Ages , Canton had a significant Muslim population as a result of its trade with the Middle East .

source_bert_toks: in the early middle ages , canton had a significant muslim population as a result of its trade with the middle east .

reference_raw: In the early Middle Ages, Canton had a significant Muslim population due to his dealings with the Middle East.

reference_spacy_tokens: In the early Middle Ages , Canton had a significant Muslim population due to his dealings with the Middle East .


fn_spacy_tokens_for_baseline: Blood from his torn ear was soaking his left epaulette with its tarnished chains and gilded eagle .

source_bert_toks: blood from his torn ear was soaking his left epa ##ule ##tte with its tar ##nished chains and gilded eagle .

reference_raw: The blood from his tattered ear drenched his left epaulette with tainted chains and gilded eagles.

reference_spacy_tokens: The blood from his tattered ear drenched his left epaulette with tainted chains and gilded eagles .


fn_spacy_tokens_for_baseline: Addressing the final Tory news conference later , Mr Major reaffirmed he was confident of winning a majority sufficient to keep him in power for another five years .

source_bert_toks: addressing the final tory news conference later , mr major re ##af ##firmed he was confident of winning a majority sufficient to keep him in power for another five years .

reference_raw: Later, when Mr. Major addressed the final Tory News Conference, he confirmed that he was confident that he would win a majority sufficient to keep him in power for the next five years.

reference_spacy_tokens: Later , when Mr. Major addressed the final Tory News Conference , he confirmed that he was confident that he would win a majority sufficient to keep him in power for the next five years .


fn_spacy_tokens_for_baseline: False rumours soon spread that Hardy had suffered a defeat and that no British Ship remained in the home waters to prevent imminent invasion .

source_bert_toks: false rumours soon spread that hardy had suffered a defeat and that no british ship remained in the home waters to prevent imminent invasion .

reference_raw: False rumors soon spread that Hardy had been defeated and that no British ship had remained in the waters of his homeland to prevent the imminent incursion.

reference_spacy_tokens: False rumors soon spread that Hardy had been defeated and that no British ship had remained in the waters of his homeland to prevent the imminent incursion .


fn_spacy_tokens_for_baseline: When a child or young person is received into care a placement with a carer or carers has to be made .

source_bert_toks: when a child or young person is received into care a placement with a care ##r or care ##rs has to be made .

reference_raw: When a child or young person is taken into care, a caretaker or caregivers must be placed.

reference_spacy_tokens: When a child or young person is taken into care , a caretaker or caregivers must be placed .


fn_spacy_tokens_for_baseline: Was suede footwear de rigueur for scoffing fish in Tennessee ?

source_bert_toks: was sued ##e foot ##wear de rig ##ue ##ur for sc ##off ##ing fish in tennessee ?

reference_raw: Was Suede Shoes de Rigueur guilty of scoffing fish in Tennessee?

reference_spacy_tokens: Was Suede Shoes de Rigueur guilty of scoffing fish in Tennessee ?


fn_spacy_tokens_for_baseline: There are days when it 's best to pretend that the children belong to someone else and yesterday was one of them .

source_bert_toks: there are days when it ' s best to pretend that the children belong to someone else and yesterday was one of them .

reference_raw: There are days when it's best to pretend that the kids are somebody else's, and yesterday was one of them.

reference_spacy_tokens: There are days when it 's best to pretend that the kids are somebody else 's , and yesterday was one of them .


fn_spacy_tokens_for_baseline: In May , Dundee Port Authority generously hosted a reception for around 50 Council members based in the Tayside area .

source_bert_toks: in may , dundee port authority generous ##ly hosted a reception for around 50 council members based in the tay ##side area .

reference_raw: In May, the port office of Dundee generously hosted a meeting of about 50 members of the Council established in the Tayside region.

reference_spacy_tokens: In May , the port office of Dundee generously hosted a meeting of about 50 members of the Council established in the Tayside region .


fn_spacy_tokens_for_baseline: A gravel pit search by divers was put off yesterday as experts continued checking the area .

source_bert_toks: a gravel pit search by divers was put off yesterday as experts continued checking the area .

reference_raw: The divers' gravel pit investigation was postponed yesterday as the experts continued to check the area.

reference_spacy_tokens: The divers ' gravel pit investigation was postponed yesterday as the experts continued to check the area .


fn_spacy_tokens_for_baseline: " If the cartel succeeds in blackmailing the Colombian authorities into negotiations , the cartel will be in control and Fidel can exploit his past relationships with them , " he told the Journal 's David Asman recently .

source_bert_toks: " if the cartel succeeds in blackmail ##ing the colombian authorities into negotiations , the cartel will be in control and fide ##l can exploit his past relationships with them , " he told the journal ' s david as ##man recently .

reference_raw: "If the cartel succeeds in extorting the Colombian authorities into negotiations, the cartel will be in control, and Fidel will be able to take advantage of his previous relations with them," David Asman had recently told the Journalist.

reference_spacy_tokens: " If the cartel succeeds in extorting the Colombian authorities into negotiations , the cartel will be in control , and Fidel will be able to take advantage of his previous relations with them , " David Asman had recently told the Journalist .


fn_spacy_tokens_for_baseline: After three hours of continuous nibbling it seemed , I will confess , rather on the acid and insubstantial side , and I began to yearn for a bowl of pasta .

source_bert_toks: after three hours of continuous ni ##bbling it seemed , i will confess , rather on the acid and ins ##ub ##stan ##tial side , and i began to year ##n for a bowl of pasta .

reference_raw: After three hours of uninterrupted nibbling, I confess, rather on the acid and insubstantial side, that I began to yearn for a cup of pasta.

reference_spacy_tokens: After three hours of uninterrupted nibbling , I confess , rather on the acid and insubstantial side , that I began to yearn for a cup of pasta .


fn_spacy_tokens_for_baseline: I am not seriously advocating suicide right on stage , although I know a man who does .

source_bert_toks: i am not seriously advocating suicide right on stage , although i know a man who does .

reference_raw: I'm not seriously defending suicide on stage, even though I know a man who does.

reference_spacy_tokens: I 'm not seriously defending suicide on stage , even though I know a man who does .


fn_spacy_tokens_for_baseline: For example I often paint an area with retouching varnish mixed with pigment as a glaze , then I absorb much of it with newspaper dabbed onto the canvas .

source_bert_toks: for example i often paint an area with re ##tou ##ching var ##nish mixed with pigment as a g ##laze , then i absorb much of it with newspaper da ##bbed onto the canvas .

reference_raw: For example, I often draw an area of retouching varnish mixed with pigment like a glaze, and then I absorb most of it with newspapers dabbed on the canvas.

reference_spacy_tokens: For example , I often draw an area of retouching varnish mixed with pigment like a glaze , and then I absorb most of it with newspapers dabbed on the canvas .


fn_spacy_tokens_for_baseline: The court heard Bedworth , now a student at Edinburgh University studying artificial intelligence , spent hours sitting in his bedroom mastering a £ 200 Christmas present which helped him hack into hi - tech systems .

source_bert_toks: the court heard bed ##worth , now a student at edinburgh university studying artificial intelligence , spent hours sitting in his bedroom mastering a £2 ##00 christmas present which helped him hack into hi - tech systems .

reference_raw: The court heard that Bedworth, now a student at the University of Edinburgh, had spent hours in his room, mastering a £200 Christmas present that helped him hack into the high-tech systems.

reference_spacy_tokens: The court heard that Bedworth , now a student at the University of Edinburgh , had spent hours in his room , mastering a £ 200 Christmas present that helped him hack into the high - tech systems .


fn_spacy_tokens_for_baseline: ' How dare you conceal the knowledge that I have a son ? ' he roared .

source_bert_toks: ' how dare you conceal the knowledge that i have a son ? ' he roared .

reference_raw: "How dare you hide the fact that I have a son?" he shouted.

reference_spacy_tokens: " How dare you hide the fact that I have a son ? " he shouted .


fn_spacy_tokens_for_baseline: They had lowcut dresses and thick black eyeshadow , and one wore no shoes , toes crossed over each other from having her feet crammed into tight footwear all her life .

source_bert_toks: they had low ##cut dresses and thick black eyes ##had ##ow , and one wore no shoes , toes crossed over each other from having her feet cr ##ammed into tight foot ##wear all her life .

reference_raw: They wore low-cut dresses and thick black eyeshades, and one wore no boots, fingers crossed over one another because his feet had been stuffed into tight shoes all his life.

reference_spacy_tokens: They wore low - cut dresses and thick black eyeshades , and one wore no boots , fingers crossed over one another because his feet had been stuffed into tight shoes all his life .


fn_spacy_tokens_for_baseline: These beautifully crafted panniers would sell for high prices in the West , but hours of labour and generations of skill are treated casually here .

source_bert_toks: these beautifully crafted pan ##nier ##s would sell for high prices in the west , but hours of labour and generations of skill are treated casually here .

reference_raw: In the West, these beautifully crafted panniers would be traded at high prices, but hours of work and generations of skill are treated carelessly.

reference_spacy_tokens: In the West , these beautifully crafted panniers would be traded at high prices , but hours of work and generations of skill are treated carelessly .


fn_spacy_tokens_for_baseline: Here , perhaps , green consumerism can try to get us to eat tuna that has been caught in a wildlife - friendly way !

source_bert_toks: here , perhaps , green consumer ##ism can try to get us to eat tuna that has been caught in a wildlife - friendly way !

reference_raw: Here, perhaps, green consumerism could be trying to get us to eat some kind of fish that were caught in a wildlife-friendly way!

reference_spacy_tokens: Here , perhaps , green consumerism could be trying to get us to eat some kind of fish that were caught in a wildlife - friendly way !


fn_spacy_tokens_for_baseline: For the past 300 years the substantial remains of one of medieval England 's most important fortresses have lain hidden beneath part of the city centre .

source_bert_toks: for the past 300 years the substantial remains of one of medieval england ' s most important fortress ##es have lai ##n hidden beneath part of the city centre .

reference_raw: Over the last 300 years, the substantial remains of one of the most important forts in the Middle Ages of England have been buried beneath a section of the city center.

reference_spacy_tokens: Over the last 300 years , the substantial remains of one of the most important forts in the Middle Ages of England have been buried beneath a section of the city center .


fn_spacy_tokens_for_baseline: David left the salon straight after dinner on the excuse that he had letters to write and , half an hour later , Julia went up to bed early , leaving Comfort and Anthony alone .

source_bert_toks: david left the salon straight after dinner on the excuse that he had letters to write and , half an hour later , julia went up to bed early , leaving comfort and anthony alone .

reference_raw: David left the saloon immediately after dinner for an excuse to write letters, and half an hour later Julie went to bed early, leaving Comfort and Anthony alone.

reference_spacy_tokens: David left the saloon immediately after dinner for an excuse to write letters , and half an hour later Julie went to bed early , leaving Comfort and Anthony alone .


fn_spacy_tokens_for_baseline: Goodwill has devised the programs that turned your investment into results .

source_bert_toks: goodwill has devised the programs that turned your investment into results .

reference_raw: Goodwill devised programs that transformed your investment into results.

reference_spacy_tokens: Goodwill devised programs that transformed your investment into results .


fn_spacy_tokens_for_baseline: A judge has ordered a fish farm to compensate a group of anglers for ruining their fishing season .

source_bert_toks: a judge has ordered a fish farm to compensate a group of angle ##rs for ruining their fishing season .

reference_raw: The judge instructed the fish farm to compensate a group of anglers for the destruction of the fishing season.

reference_spacy_tokens: The judge instructed the fish farm to compensate a group of anglers for the destruction of the fishing season .


fn_spacy_tokens_for_baseline: ' DOS 6 is the biggest upgrade we 've made since DOS 2 , ' says David Smith , systems marketing manager for Microsoft in the UK .

source_bert_toks: ' dos 6 is the biggest upgrade we ' ve made since dos 2 , ' says david smith , systems marketing manager for microsoft in the uk .

reference_raw: "DOS 6 is the biggest upgrade we've made since DOS 2," says David Smith, Microsoft Systems Marketing Director in the United Kingdom.

reference_spacy_tokens: " DOS 6 is the biggest upgrade we 've made since DOS 2 , " says David Smith , Microsoft Systems Marketing Director in the United Kingdom .


fn_spacy_tokens_for_baseline: When they had fruitlessly exhausted their task , Myeloski called the caretaker to guide them round the rest of the palace .

source_bert_toks: when they had fruit ##lessly exhausted their task , my ##elo ##ski called the caretaker to guide them round the rest of the palace .

reference_raw: When they had exhausted their task in vain, Myeloski summoned the warden to lead them around the rest of the palace.

reference_spacy_tokens: When they had exhausted their task in vain , Myeloski summoned the warden to lead them around the rest of the palace .


fn_spacy_tokens_for_baseline: The imaginary war consisted of a real military confrontation , with real soldiers , real weapons and using real resources .

source_bert_toks: the imaginary war consisted of a real military confrontation , with real soldiers , real weapons and using real resources .

reference_raw: The imaginary war consisted of a real military conflict with real soldiers, real weapons, and the use of real resources.

reference_spacy_tokens: The imaginary war consisted of a real military conflict with real soldiers , real weapons , and the use of real resources .


fn_spacy_tokens_for_baseline: Wendy was twenty - one and wore an apricot - coloured shortie nightie in brushed nylon .

source_bert_toks: wendy was twenty - one and wore an apr ##ico ##t - coloured short ##ie night ##ie in brushed nylon .

reference_raw: Wendy was twenty-one, wearing an apricot-colored nightgown in a brushed nylon.

reference_spacy_tokens: Wendy was twenty - one , wearing an apricot - colored nightgown in a brushed nylon .


fn_spacy_tokens_for_baseline: He boarded the express with two minutes to spare .

source_bert_toks: he boarded the express with two minutes to spare .

reference_raw: He got on the express with two minutes to spare.

reference_spacy_tokens: He got on the express with two minutes to spare .


fn_spacy_tokens_for_baseline: Our fascination with the minutiae of everyday life , our knowledge of its texture , smell and colour , is the subject of Godfrey - Isaacs ' work .

source_bert_toks: our fascination with the min ##uti ##ae of everyday life , our knowledge of its texture , smell and colour , is the subject of godfrey - isaac ##s ' work .

reference_raw: Our fascination with the minutiae of everyday life, our knowledge of its texture, smell and color, is the object of the work of Godfrey-Isaacs.

reference_spacy_tokens: Our fascination with the minutiae of everyday life , our knowledge of its texture , smell and color , is the object of the work of Godfrey - Isaacs .


fn_spacy_tokens_for_baseline: Well maybe he did tweak it .

source_bert_toks: well maybe he did t ##we ##ak it .

reference_raw: Well, maybe he's softened it.

reference_spacy_tokens: Well , maybe he 's softened it .


fn_spacy_tokens_for_baseline: These patrols tour the area during specific times such as , dinner , dawn , dusk , and midnight

source_bert_toks: these patrols tour the area during specific times such as , dinner , dawn , dusk , and midnight

reference_raw: These patrols tour the area at certain times, e.g. supper, dawn, dusk and midnight.

reference_spacy_tokens: These patrols tour the area at certain times , e.g. supper , dawn , dusk and midnight .


fn_spacy_tokens_for_baseline: But matters were so arranged that for most the outlook was not completely bleak ; almost everyone could arrive eventually at a state of relative freedom from intimidation and enjoy a measure of authority over others .

source_bert_toks: but matters were so arranged that for most the outlook was not completely bleak ; almost everyone could arrive eventually at a state of relative freedom from intimidation and enjoy a measure of authority over others .

reference_raw: But things were arranged in such a way that most of the outlook was not entirely bleak; almost everyone could eventually reach a state of relative freedom from intimidation and enjoy a degree of authority over others.

reference_spacy_tokens: But things were arranged in such a way that most of the outlook was not entirely bleak ; almost everyone could eventually reach a state of relative freedom from intimidation and enjoy a degree of authority over others .


fn_spacy_tokens_for_baseline: This school of thought has ample evidence to support its claims : North Korea 's initiation of the Korean War , acts of terrorism , forward - deployed military forces , a constitution that states that the DPRK is the sole legitimate government for all of Korea , and Korean Workers ' Party bylaws calling for a " completion of the revolution in the south . "

source_bert_toks: this school of thought has ample evidence to support its claims : north korea ' s initiation of the korean war , acts of terrorism , forward - deployed military forces , a constitution that states that the d ##pr ##k is the sole legitimate government for all of korea , and korean workers ' party by ##law ##s calling for a " completion of the revolution in the south . "

reference_raw: This school of thought has plenty of evidence to support its claims: North Korea's opening of the Korean War, terrorist attacks, forward - military forces deployed, a constitution that states that the DPRK is the only legitimate government of all Korea, and the Korean Workers' Party's bylaws calling for "the completion of the South Revolution."

reference_spacy_tokens: This school of thought has plenty of evidence to support its claims : North Korea 's opening of the Korean War , terrorist attacks , forward - military forces deployed , a constitution that states that the DPRK is the only legitimate government of all Korea , and the Korean Workers ' Party 's bylaws calling for " the completion of the South Revolution . "


fn_spacy_tokens_for_baseline: As of this date , China had not informed Iran that it had canceled its sale of a uranium conversion facility to Iran .

source_bert_toks: as of this date , china had not informed iran that it had canceled its sale of a uranium conversion facility to iran .

reference_raw: Since that date, China has not informed Iran that it has cancelled the sale of the uranium transformation facility to Iran.

reference_spacy_tokens: Since that date , China has not informed Iran that it has cancelled the sale of the uranium transformation facility to Iran .


fn_spacy_tokens_for_baseline: He was the only one to spot the danger to the mother and child , and dashed onto the tracks in order to try and save their lives , waving his arms frantically .

source_bert_toks: he was the only one to spot the danger to the mother and child , and dashed onto the tracks in order to try and save their lives , waving his arms frantically .

reference_raw: Only he could see the danger to his mother and child, and he ran to the rails to save their lives, waving his arms frantically.

reference_spacy_tokens: Only he could see the danger to his mother and child , and he ran to the rails to save their lives , waving his arms frantically .


fn_spacy_tokens_for_baseline: Although they neither rebelled nor resigned , their disenchantment was soon widely known .

source_bert_toks: although they neither rebelled nor resigned , their di ##sen ##chan ##tment was soon widely known .

reference_raw: Though they neither rebelled nor resigned, their disenchantment was soon known.

reference_spacy_tokens: Though they neither rebelled nor resigned , their disenchantment was soon known .


fn_spacy_tokens_for_baseline: If so , it is unclear if these devices have been " weaponized " or are small enough to be mated with delivery systems ; the location of any such weapons is unknown .

source_bert_toks: if so , it is unclear if these devices have been " weapon ##ized " or are small enough to be mated with delivery systems ; the location of any such weapons is unknown .

reference_raw: If so, it is not clear whether these devices are "weaponized" or are small enough to mate with delivery systems; the location of any such weapons is not known.

reference_spacy_tokens: If so , it is not clear whether these devices are " weaponized " or are small enough to mate with delivery systems ; the location of any such weapons is not known .


fn_spacy_tokens_for_baseline: The relief of an interlude with one of the handful of people who could understand his feelings made him weep , which embarrassed them both .

source_bert_toks: the relief of an interlude with one of the handful of people who could understand his feelings made him weep , which embarrassed them both .

reference_raw: The relief of being in touch with one of the few people who knew how he felt made him cry, which embarrassed both of them.

reference_spacy_tokens: The relief of being in touch with one of the few people who knew how he felt made him cry , which embarrassed both of them .


fn_spacy_tokens_for_baseline: It was night , and as the wind gusted down the iron chimney pipe , a shower of metal flakes spattered on to the wooden floor .

source_bert_toks: it was night , and as the wind gust ##ed down the iron chimney pipe , a shower of metal fl ##akes spat ##tered on to the wooden floor .

reference_raw: It was night, and a shower of metal flakes splashed on the wooden floor as the wind blew down the iron chimney pipe.

reference_spacy_tokens: It was night , and a shower of metal flakes splashed on the wooden floor as the wind blew down the iron chimney pipe .


fn_spacy_tokens_for_baseline: I conclude , then , not with stirring words of praise for the philosophy of animal rights , or with caustic words of censure for the other philosophies I have mentioned .

source_bert_toks: i conclude , then , not with stirring words of praise for the philosophy of animal rights , or with ca ##ust ##ic words of ce ##ns ##ure for the other phil ##oso ##phi ##es i have mentioned .

reference_raw: I conclude from this that it is not with the inspiring words of praise for the philosophy of animal rights, nor with the caustic words of censure for the other philosophies I have mentioned.

reference_spacy_tokens: I conclude from this that it is not with the inspiring words of praise for the philosophy of animal rights , nor with the caustic words of censure for the other philosophies I have mentioned .


fn_spacy_tokens_for_baseline: But there 's also a cool complacency , an indifferent shrug .

source_bert_toks: but there ' s also a cool com ##pl ##ace ##ncy , an indifferent shrug .

reference_raw: But there is also a cold complacency, an indifferent shrug.

reference_spacy_tokens: But there is also a cold complacency , an indifferent shrug .


fn_spacy_tokens_for_baseline: Scrutinized from the ground , which is where the narrator and Elena McMahon are , this history is not as random as it might seem .

source_bert_toks: sc ##rut ##ini ##zed from the ground , which is where the narrator and elena mcmahon are , this history is not as random as it might seem .

reference_raw: Scrutinized from the ground, where the storyteller and Elena McMahon are, this story isn't as random as it looks.

reference_spacy_tokens: Scrutinized from the ground , where the storyteller and Elena McMahon are , this story is n't as random as it looks .


fn_spacy_tokens_for_baseline: If Adrian were . deserted like that , I 'd rush to comfort him .

source_bert_toks: if adrian were . deserted like that , i ' d rush to comfort him .

reference_raw: If Adrian were... abandoned like this, I'd be in a hurry to comfort him.

reference_spacy_tokens: If Adrian were ... abandoned like this , I 'd be in a hurry to comfort him .


fn_spacy_tokens_for_baseline: The dynastic struggle was eventually resolved in favour of the Habsburgs , but not before the death of Zapolya in 1540 .

source_bert_toks: the d ##yna ##stic struggle was eventually resolved in favour of the habsburg ##s , but not before the death of za ##pol ##ya in 1540 .

reference_raw: In the end, the dynastic struggle was settled in favour of the Habsburgs, but not before Zapolya died in 1540.

reference_spacy_tokens: In the end , the dynastic struggle was settled in favour of the Habsburgs , but not before Zapolya died in 1540 .


fn_spacy_tokens_for_baseline: Maintaining over 200 historic houses with rare and precious contents ; 100 beautiful gardens , protecting over 600,000 acres of varied unspoilt coastline , and preserving even entire villages , is an expensive business .

source_bert_toks: maintaining over 200 historic houses with rare and precious contents ; 100 beautiful gardens , protecting over 600 , 000 acres of varied un ##sp ##oi ##lt coastline , and preserving even entire villages , is an expensive business .

reference_raw: Maintaining more than 200 historical buildings with precious and precious contents, 100 beautiful gardens, protecting more than 600,000 acres of diverse, unspoiled coastlines, and preserving even whole villages, is a costly business.

reference_spacy_tokens: Maintaining more than 200 historical buildings with precious and precious contents , 100 beautiful gardens , protecting more than 600,000 acres of diverse , unspoiled coastlines , and preserving even whole villages , is a costly business .


fn_spacy_tokens_for_baseline: ' This city is ruled by fear .

source_bert_toks: ' this city is ruled by fear .

reference_raw: This town is run by fear.

reference_spacy_tokens: This town is run by fear .


fn_spacy_tokens_for_baseline: One Sunday evening I went into the vestry to speak to a number of my girls who were about to take their first communion .

source_bert_toks: one sunday evening i went into the vest ##ry to speak to a number of my girls who were about to take their first communion .

reference_raw: I went to the lobby one Sunday night to talk to some of my girls who were about to take their first communal.

reference_spacy_tokens: I went to the lobby one Sunday night to talk to some of my girls who were about to take their first communal .


fn_spacy_tokens_for_baseline: MANAGER Ray Hankin blasted his side for ' defending like amateurs ' after errors cost Quakers the chance of lifting themselves off the bottom of the table .

source_bert_toks: manager ray hank ##in blasted his side for ' defending like amateurs ' after errors cost quakers the chance of lifting themselves off the bottom of the table .

reference_raw: Manager Ray Hankin blew his hip for "protecting as amateurs" after mistakes cost Quakers a chance to get off the table.

reference_spacy_tokens: Manager Ray Hankin blew his hip for " protecting as amateurs " after mistakes cost Quakers a chance to get off the table .


fn_spacy_tokens_for_baseline: More recently , South Africa began working more closely with the IAEA in 2004 , in order to monitor international smuggling of nuclear weapons materials , after investigations of a South African businessman exposed connections to the A.Q. Khan network .

source_bert_toks: more recently , south africa began working more closely with the ia ##ea in 2004 , in order to monitor international smuggling of nuclear weapons materials , after investigations of a south african businessman exposed connections to the a . q . khan network .

reference_raw: Recently, South Africa started to work more closely with the IAEA in 2004 to follow up the international smuggling of nuclear weapons materials, following an investigation into a South African businessman who exposed contact with the A.Q. Khan network.

reference_spacy_tokens: Recently , South Africa started to work more closely with the IAEA in 2004 to follow up the international smuggling of nuclear weapons materials , following an investigation into a South African businessman who exposed contact with the A.Q. Khan network .


fn_spacy_tokens_for_baseline: CBW can have a greater psychological impact than conventional explosives , as suggested by the 2001 anthrax letter attacks , which killed only five people but frightened millions of Americans .

source_bert_toks: cb ##w can have a greater psychological impact than conventional explosives , as suggested by the 2001 ant ##hra ##x letter attacks , which killed only five people but frightened millions of americans .

reference_raw: According to the 2001 Anthrax letter attacks, which killed only five people but scared millions of Americans, CBW could have a greater psychological impact than conventional explosions.

reference_spacy_tokens: According to the 2001 Anthrax letter attacks , which killed only five people but scared millions of Americans , CBW could have a greater psychological impact than conventional explosions .


fn_spacy_tokens_for_baseline: He said companies engaged in e - commerce would be able to set up offices , employ staff and own equipment in the open zone , including fully - owned foreign companies .

source_bert_toks: he said companies engaged in e - commerce would be able to set up offices , employ staff and own equipment in the open zone , including fully - owned foreign companies .

reference_raw: He said that e-commerce companies could set up offices, employ staff and own facilities in the open zone, including fully owned non-resident companies.

reference_spacy_tokens: He said that e - commerce companies could set up offices , employ staff and own facilities in the open zone , including fully owned non - resident companies .


fn_spacy_tokens_for_baseline: ' They must keep the pressure up , and take out as many people in the Taliban 's top tier leadership as possible , ' Gul said .

source_bert_toks: ' they must keep the pressure up , and take out as many people in the taliban ' s top tier leadership as possible , ' gu ##l said .

reference_raw: 'They've got to keep the pressure up and get as many people out of the top level of the Taliban as possible,' Gul said.

reference_spacy_tokens: ' They 've got to keep the pressure up and get as many people out of the top level of the Taliban as possible , ' Gul said .


fn_spacy_tokens_for_baseline: The Doctor looked around from under the stairwell when the alarm began hooting , but saw nothing .

source_bert_toks: the doctor looked around from under the stairwell when the alarm began ho ##oting , but saw nothing .

reference_raw: When the alarm sounded, the doctor looked around from under the stairs, but saw nothing.

reference_spacy_tokens: When the alarm sounded , the doctor looked around from under the stairs , but saw nothing .


fn_spacy_tokens_for_baseline: Robert Merkel , a former U.S. attorney handling drug indictments in Florida , does n't think for a minute that Castro 's much publicized trials of high officials engaged in the drug trade mean he has broken off with the Medellin drug cartel .

source_bert_toks: robert mer ##kel , a former u . s . attorney handling drug indictment ##s in florida , doesn ' t think for a minute that castro ' s much publicized trials of high officials engaged in the drug trade mean he has broken off with the med ##elli ##n drug cartel .

reference_raw: Robert Merkel, a former U.S. attorney dealing with drug charges in Florida, does not think for a moment that Castro's many publicized trials of high-ranking officials involved in drug trafficking... ...mean that he broke up with the Medellin drug cartel.

reference_spacy_tokens: Robert Merkel , a former U.S. attorney dealing with drug charges in Florida , does not think for a moment that Castro 's many publicized trials of high - ranking officials involved in drug trafficking ... ... mean that he broke up with the Medellin drug cartel .


fn_spacy_tokens_for_baseline: All around him people were hurling possessions from windows and dragging horses from smoking stables .

source_bert_toks: all around him people were hurling possessions from windows and dragging horses from smoking stables .

reference_raw: All around him people threw things out of the windows and dragged horses out of the smoking stables.

reference_spacy_tokens: All around him people threw things out of the windows and dragged horses out of the smoking stables .


fn_spacy_tokens_for_baseline: Away from that pulsing artery of East London it suddenly became quiet .

source_bert_toks: away from that pulsing artery of east london it suddenly became quiet .

reference_raw: There was a sudden silence from the throbbing vein of East London.

reference_spacy_tokens: There was a sudden silence from the throbbing vein of East London .


fn_spacy_tokens_for_baseline: Romantic country lore advised girls to peel an apple carefully then throw the whole skin over their shoulder when it would land in the shape of their true love 's initial ; there were countless similar superstitions .

source_bert_toks: romantic country lore advised girls to peel an apple carefully then throw the whole skin over their shoulder when it would land in the shape of their true love ' s initial ; there were countless similar super ##sti ##tions .

reference_raw: The Romantic country tradition advised the girls to peele the apple carefully and then toss the entire skin over their shoulders when it landed in the shape of the original of their true love; there were countless similar superstitions.

reference_spacy_tokens: The Romantic country tradition advised the girls to peele the apple carefully and then toss the entire skin over their shoulders when it landed in the shape of the original of their true love ; there were countless similar superstitions .


fn_spacy_tokens_for_baseline: Critical Acclaim -- Since being voted European Car of the Year in 1991 , the Clio has attracted warm praise from numerous expert motoring journalists .

source_bert_toks: critical acclaim - - since being voted european car of the year in 1991 , the cl ##io has attracted warm praise from numerous expert motor ##ing journalists .

reference_raw: Critical Acknowledgment - Since the election of the European Car of the Year in 1991, the Clio has attracted a warm appreciation from a number of professional motorists.

reference_spacy_tokens: Critical Acknowledgment - Since the election of the European Car of the Year in 1991 , the Clio has attracted a warm appreciation from a number of professional motorists .


fn_spacy_tokens_for_baseline: They readily damn the ' Love Is Hell ' LP nowadays , and reckon ' Strange Free World ' is their first record .

source_bert_toks: they readily damn the ' love is hell ' lp nowadays , and reckon ' strange free world ' is their first record .

reference_raw: Now they're willing to curse "Love is Hell" LP, and they're counting "Strange Free World" as their first record.

reference_spacy_tokens: Now they 're willing to curse " Love is Hell " LP , and they 're counting " Strange Free World " as their first record .


fn_spacy_tokens_for_baseline: They won their obscenity trial but poverty drove them to a caravan beside a Methodist chapel where they lived off skips , meeting other swinging exiles and learning how much people waste .

source_bert_toks: they won their ob ##sc ##enity trial but poverty drove them to a caravan beside a methodist chapel where they lived off skip ##s , meeting other swinging exiles and learning how much people waste .

reference_raw: They got their dirty trial, but poverty drove them to the caravan next to the Methodist chapel, where they lived on the skips, where they met other swinging exiles, and learned how much people were wasting.

reference_spacy_tokens: They got their dirty trial , but poverty drove them to the caravan next to the Methodist chapel , where they lived on the skips , where they met other swinging exiles , and learned how much people were wasting .


fn_spacy_tokens_for_baseline: He said the situation in Grozny was murky and lamented that the Red Cross had difficulty delivering medicine and other humanitarian supplies to the capital , possibly because of the heavy fighting .

source_bert_toks: he said the situation in gr ##oz ##ny was mu ##rky and lame ##nted that the red cross had difficulty delivering medicine and other humanitarian supplies to the capital , possibly because of the heavy fighting .

reference_raw: He said that the situation in Grozny was murky and complained that the Red Cross was having trouble delivering medical supplies and other humanitarian supplies to the capital, possibly due to heavy fighting.

reference_spacy_tokens: He said that the situation in Grozny was murky and complained that the Red Cross was having trouble delivering medical supplies and other humanitarian supplies to the capital , possibly due to heavy fighting .


fn_spacy_tokens_for_baseline: The case of Donoghue v. Stevenson is noted moreover for the general test as to liability in negligence propounded by Lord Atkin where he says : ' You must not injure your neighbour .

source_bert_toks: the case of don ##og ##hue v . stevenson is noted moreover for the general test as to liability in negligence prop ##ounded by lord at ##kin where he says : ' you must not in ##jure your neighbour .

reference_raw: In addition, the Donoghue v Stevenson case is noted for the general test of liability for negligence advocated by Lord Atkin, where he says, "You must not harm your neighbor.

reference_spacy_tokens: In addition , the Donoghue v Stevenson case is noted for the general test of liability for negligence advocated by Lord Atkin , where he says , " You must not harm your neighbor .


fn_spacy_tokens_for_baseline: But the surgeon can suffer from tiredness and stress .

source_bert_toks: but the surgeon can suffer from tired ##ness and stress .

reference_raw: But a surgeon may suffer fatigue and stress.

reference_spacy_tokens: But a surgeon may suffer fatigue and stress .


fn_spacy_tokens_for_baseline: Did you deduce this from the symptoms you saw or was there harder evidence ? '

source_bert_toks: did you de ##du ##ce this from the symptoms you saw or was there harder evidence ? '

reference_raw: Have you derived it from the symptoms you've seen, or has there been more difficult evidence?'

reference_spacy_tokens: Have you derived it from the symptoms you 've seen , or has there been more difficult evidence ? '


fn_spacy_tokens_for_baseline: She recalled the docks , and the way the sea screamed and wailed like a soul in torment , throwing itself against the piers with a wild vengeance that struck terror into her young heart .

source_bert_toks: she recalled the docks , and the way the sea screamed and wai ##led like a soul in torment , throwing itself against the piers with a wild vengeance that struck terror into her young heart .

reference_raw: She remembered the docks, and how the sea screamed and howled like a soul in agony, leaping at the docks with a fierce vengeance that struck terror in her young heart.

reference_spacy_tokens: She remembered the docks , and how the sea screamed and howled like a soul in agony , leaping at the docks with a fierce vengeance that struck terror in her young heart .


fn_spacy_tokens_for_baseline: She did n't look quite so indignant as she 'd looked before .

source_bert_toks: she didn ' t look quite so ind ##ignant as she ' d looked before .

reference_raw: She did not look as outraged as she had looked before.

reference_spacy_tokens: She did not look as outraged as she had looked before .


fn_spacy_tokens_for_baseline: She had been very lonely before he arrived , with no one to talk to but her brother , Walter , and he was the most taciturn of men .

source_bert_toks: she had been very lonely before he arrived , with no one to talk to but her brother , walter , and he was the most ta ##cit ##urn of men .

reference_raw: By the time he arrived, she was very lonely, and had no one to talk to but her brother, Walter, and he was the quietest of men.

reference_spacy_tokens: By the time he arrived , she was very lonely , and had no one to talk to but her brother , Walter , and he was the quietest of men .


fn_spacy_tokens_for_baseline: Presumably he had snatched a few more hours ' sleep , she decided morosely , while she 'd been traipsing fruitlessly up and down Strøget .

source_bert_toks: presumably he had snatched a few more hours ' sleep , she decided mor ##ose ##ly , while she ' d been tr ##ai ##ps ##ing fruit ##lessly up and down st ##r ##ø ##get .

reference_raw: He must have taken a few more hours of sleep, she thought grimly, as she trudged fruitlessly up and down Ströget.

reference_spacy_tokens: He must have taken a few more hours of sleep , she thought grimly , as she trudged fruitlessly up and down Stroget .


fn_spacy_tokens_for_baseline: Many studies have shown that these tumours are surgically curable .

source_bert_toks: many studies have shown that these tu ##mour ##s are surgical ##ly cu ##rable .

reference_raw: Many studies have shown that these tumours are surgically treatable.

reference_spacy_tokens: Many studies have shown that these tumours are surgically treatable .


fn_spacy_tokens_for_baseline: Soviet and foreign relief organizations had installed themselves with efficiency and were giving out free food .

source_bert_toks: soviet and foreign relief organizations had installed themselves with efficiency and were giving out free food .

reference_raw: The Soviet and foreign-relief organizations had installed themselves with efficiency and were giving food for nothing.

reference_spacy_tokens: The Soviet and foreign - relief organizations had installed themselves with efficiency and were giving food for nothing .


fn_spacy_tokens_for_baseline: She had always been stout , endowed he had thought .

source_bert_toks: she had always been stout , endowed he had thought .

reference_raw: She was always strong, gifted, he thought.

reference_spacy_tokens: She was always strong , gifted , he thought .


fn_spacy_tokens_for_baseline: Your gift to Goodwill will help the many people who want to tell their own stories of success .

source_bert_toks: your gift to goodwill will help the many people who want to tell their own stories of success .

reference_raw: Your gift to Goodwill will help a lot of people who want to tell their own successful stories.

reference_spacy_tokens: Your gift to Goodwill will help a lot of people who want to tell their own successful stories .


fn_spacy_tokens_for_baseline: At the end of the bed was a small card - table which Changez bought for her as a wedding present ; I 'd carried it back from a local junk shop .

source_bert_toks: at the end of the bed was a small card - table which change ##z bought for her as a wedding present ; i ' d carried it back from a local junk shop .

reference_raw: There was a small card table at the end of the bed that Changez had purchased for her as a wedding gift; I had brought it back from the local junk store.

reference_spacy_tokens: There was a small card table at the end of the bed that Changez had purchased for her as a wedding gift ; I had brought it back from the local junk store .


fn_spacy_tokens_for_baseline: The only hint of rebellion seems to have been sparked by her first crush on a classmate known only by the name of Grant .

source_bert_toks: the only hint of rebellion seems to have been sparked by her first crush on a classmate known only by the name of grant .

reference_raw: The only hint of rebellion seemed to have been triggered by her first crush on a classmate known only as Grant.

reference_spacy_tokens: The only hint of rebellion seemed to have been triggered by her first crush on a classmate known only as Grant .


fn_spacy_tokens_for_baseline: Frau Nordern frowned as Marx stubbed out his cigar and promptly took out another one .

source_bert_toks: fra ##u nord ##ern frowned as marx stu ##bbed out his cigar and promptly took out another one .

reference_raw: Frau Nordern scowled as Marx dug out his cigar and immediately removed another.

reference_spacy_tokens: Frau Nordern scowled as Marx dug out his cigar and immediately removed another .


fn_spacy_tokens_for_baseline: In late November , three car bombs exploded in markets near the central bank , killing at least 68 people , injuring 111 and destroying 22 businesses , police said .

source_bert_toks: in late november , three car bombs exploded in markets near the central bank , killing at least 68 people , injuring 111 and destroying 22 businesses , police said .

reference_raw: At the end of November, three car-bombs exploded in markets near the central bank, killing at least 68 people, wounding 111 and destroying 22 businesses, the police said.

reference_spacy_tokens: At the end of November , three car - bombs exploded in markets near the central bank , killing at least 68 people , wounding 111 and destroying 22 businesses , the police said .


fn_spacy_tokens_for_baseline: Girls screamed over Rock Hudson and Jimmy Dean while they were out cruising Boystown .

source_bert_toks: girls screamed over rock hudson and jimmy dean while they were out cruising boys ##town .

reference_raw: The girls were yelling about Rock Hudson and Jimmy Dean while they were out cruising Boystown.

reference_spacy_tokens: The girls were yelling about Rock Hudson and Jimmy Dean while they were out cruising Boystown .


fn_spacy_tokens_for_baseline: ' His most annoying habit was burping .

source_bert_toks: ' his most annoying habit was bu ##rp ##ing .

reference_raw: 'His most unpleasant habit was a burp.

reference_spacy_tokens: ' His most unpleasant habit was a burp .


fn_spacy_tokens_for_baseline: Those car firms that build a more or less complete organisation for manufacturing , supply and design in America and Europe will be most likely to do well .

source_bert_toks: those car firms that build a more or less complete organisation for manufacturing , supply and design in america and europe will be most likely to do well .

reference_raw: Car companies that build a more or less complete production, supply and design organisation in the United States and Europe will most likely do well.

reference_spacy_tokens: Car companies that build a more or less complete production , supply and design organisation in the United States and Europe will most likely do well .


fn_spacy_tokens_for_baseline: Then he stiffened as if sandbagged by a sudden recollection , gave a small yelp of terror and dashed into the gloom .

source_bert_toks: then he stiffened as if sand ##bag ##ged by a sudden rec ##oll ##ection , gave a small ye ##lp of terror and dashed into the gloom .

reference_raw: Then he froze, as if a sudden memory had made a sandbag, gave a small cry of terror, and dashed into the darkness.

reference_spacy_tokens: Then he froze , as if a sudden memory had made a sandbag , gave a small cry of terror , and dashed into the darkness .


fn_spacy_tokens_for_baseline: She is extremely distressed and has been seen by a police surgeon .

source_bert_toks: she is extremely distressed and has been seen by a police surgeon .

reference_raw: She's very upset, and she was seen by a police surgeon.

reference_spacy_tokens: She 's very upset , and she was seen by a police surgeon .


fn_spacy_tokens_for_baseline: Ed_Henry : Democratic leader Harry Reed accused Republicans of failing to probe allegations the White House manipulated intelligence to justify the war in Iraq .

source_bert_toks: ed _ henry : democratic leader harry reed accused republicans of failing to probe allegations the white house manipulated intelligence to justify the war in iraq .

reference_raw: Ed_Henry: Democratic leader Harry Reed accused the Republicans of not probing allegations that the White House was manipulating intelligence in support of the war in Iraq.

reference_spacy_tokens: Ed_Henry : Democratic leader Harry Reed accused the Republicans of not probing allegations that the White House was manipulating intelligence in support of the war in Iraq .


fn_spacy_tokens_for_baseline: Gregory is wrongly seen by many as a passive and reserved figure , when he is really a strong , assertive person .

source_bert_toks: gregory is wrongly seen by many as a passive and reserved figure , when he is really a strong , assert ##ive person .

reference_raw: Gregory is wrongly viewed by many as a passive and restrained figure, when he is truly a strong, assertive man.

reference_spacy_tokens: Gregory is wrongly viewed by many as a passive and restrained figure , when he is truly a strong , assertive man .


fn_spacy_tokens_for_baseline: Benjamin asked , peering closely at me , his head deep in its woollen cowl .

source_bert_toks: benjamin asked , peering closely at me , his head deep in its wool ##len cow ##l .

reference_raw: Benjamin asked, staring intently at me, his head deep in his woolly hood.

reference_spacy_tokens: Benjamin asked , staring intently at me , his head deep in his woolly hood .


fn_spacy_tokens_for_baseline: Some were taking boxes and drums off the lorries .

source_bert_toks: some were taking boxes and drums off the lo ##rries .

reference_raw: Some of them took boxes and barrels from trucks.

reference_spacy_tokens: Some of them took boxes and barrels from trucks .


fn_spacy_tokens_for_baseline: Late on Tuesday , 30 May 1916 , the British Grand Fleet left its bases for one of its occasional reconnaissance sweeps across the North Sea .

source_bert_toks: late on tuesday , 30 may 1916 , the british grand fleet left its bases for one of its occasional reconnaissance sweeps across the north sea .

reference_raw: Late on Tuesday, May 30, 1916, the British Grand Fleet left its bases for one of its casual searches across the North Sea.

reference_spacy_tokens: Late on Tuesday , May 30 , 1916 , the British Grand Fleet left its bases for one of its casual searches across the North Sea .


fn_spacy_tokens_for_baseline: In only the last two years I 've noticed that more people are being drawn to the hills in Northern Ireland .

source_bert_toks: in only the last two years i ' ve noticed that more people are being drawn to the hills in northern ireland .

reference_raw: In the past two years, I've noticed that more people are being drawn to the mountains of Northern Ireland.

reference_spacy_tokens: In the past two years , I 've noticed that more people are being drawn to the mountains of Northern Ireland .


fn_spacy_tokens_for_baseline: QN : Did the Herron products contain poison ?

source_bert_toks: q ##n : did the herr ##on products contain poison ?

reference_raw: QN: Did Herron products contain venom?

reference_spacy_tokens: QN : Did Herron products contain venom ?


fn_spacy_tokens_for_baseline: If your sister is as virtuous as you say , then she has nothing to fear from my nephew . '

source_bert_toks: if your sister is as vi ##rt ##uous as you say , then she has nothing to fear from my nephew . '

reference_raw: If your sister is as honest as you say, she has nothing to fear from my nephew.'

reference_spacy_tokens: If your sister is as honest as you say , she has nothing to fear from my nephew . '


fn_spacy_tokens_for_baseline: Last Friday , the US rejected a Soviet suggestion that the two superpowers act as guarantors of the peace process .

source_bert_toks: last friday , the us rejected a soviet suggestion that the two super ##power ##s act as gu ##aran ##tors of the peace process .

reference_raw: Last Friday, the U.S. turned down the Soviet proposal that the two superpowers act as guarantors of the peace process.

reference_spacy_tokens: Last Friday , the U.S. turned down the Soviet proposal that the two superpowers act as guarantors of the peace process .


fn_spacy_tokens_for_baseline: The skin was brown with grated nutmeg .

source_bert_toks: the skin was brown with gr ##ated nut ##me ##g .

reference_raw: The skin was brown with a crusted nutmeg.

reference_spacy_tokens: The skin was brown with a crusted nutmeg .


fn_spacy_tokens_for_baseline: His co - star , actress Audrey Jenkinson , apprentice jockey Mo in the series , was there to say goodbye to her favourite horse , and to ensure he would go to a good home .

source_bert_toks: his co - star , actress audrey jenkins ##on , apprentice jockey mo in the series , was there to say goodbye to her favourite horse , and to ensure he would go to a good home .

reference_raw: His star, actress Audrey Jenkinson, apprentice jockey Mo in the series, was there to say good-bye to her favorite horse and make sure she went to a good house.

reference_spacy_tokens: His star , actress Audrey Jenkinson , apprentice jockey Mo in the series , was there to say good - bye to her favorite horse and make sure she went to a good house .


fn_spacy_tokens_for_baseline: I showered carefully , starting at my hair and ending between my toes and under my toenails .

source_bert_toks: i showered carefully , starting at my hair and ending between my toes and under my toe ##nail ##s .

reference_raw: I took a careful bath, starting with my hair and ending between my toes and under my fingernails.

reference_spacy_tokens: I took a careful bath , starting with my hair and ending between my toes and under my fingernails .


fn_spacy_tokens_for_baseline: I took her part , got her into a cab , and here we are .

source_bert_toks: i took her part , got her into a cab , and here we are .

reference_raw: I took her part, put her in a taxi, and here we are.

reference_spacy_tokens: I took her part , put her in a taxi , and here we are .


fn_spacy_tokens_for_baseline: The Cabinet noted that the examination papers appeared to have been deliberately leaked in an attempt to shake the educational system and society at large .

source_bert_toks: the cabinet noted that the examination papers appeared to have been deliberately leaked in an attempt to shake the educational system and society at large .

reference_raw: The government noted that the examination papers appeared to have been deliberately published in an attempt to shake the education system and society as a whole.

reference_spacy_tokens: The government noted that the examination papers appeared to have been deliberately published in an attempt to shake the education system and society as a whole .


fn_spacy_tokens_for_baseline: And Daeve said , ' Heroin , it 's what your right arm 's for . '

source_bert_toks: and da ##eve said , ' heroin , it ' s what your right arm ' s for . '

reference_raw: And Daeve said, "Heroin, you have a right hand for this."

reference_spacy_tokens: And Daeve said , " Heroin , you have a right hand for this . "


fn_spacy_tokens_for_baseline: The Parlement of Bordeaux , for example , gave forcible expression in a remonstrance of May 1757 to the idea that it was the guardian of the ' ancient and fundamental laws ' of France and could and should not register any legislation which infringed these .

source_bert_toks: the par ##lem ##ent of bordeaux , for example , gave for ##ci ##ble expression in a re ##mons ##tra ##nce of may 1757 to the idea that it was the guardian of the ' ancient and fundamental laws ' of france and could and should not register any legislation which in ##fr ##inge ##d these .

reference_raw: For example, in a May 1757 protest, the Parlement of Bordeaux gave strong expression to the idea that he was the guardian of French 'ancient and fundamental laws' and that he could and should not register any legislation in breach of those laws.

reference_spacy_tokens: For example , in a May 1757 protest , the Parlement of Bordeaux gave strong expression to the idea that he was the guardian of French ' ancient and fundamental laws ' and that he could and should not register any legislation in breach of those laws .


fn_spacy_tokens_for_baseline: ' If you believe in miracles you can make them happen ! '

source_bert_toks: ' if you believe in miracles you can make them happen ! '

reference_raw: "If you have faith in miracles, you can do them!"

reference_spacy_tokens: " If you have faith in miracles , you can do them ! "


fn_spacy_tokens_for_baseline: Will the Minister comment on the question that was sidestepped by the Secretary of State ?

source_bert_toks: will the minister comment on the question that was sides ##te ##pped by the secretary of state ?

reference_raw: Is the Minister going to comment on a question the Secretary of State put aside?

reference_spacy_tokens: Is the Minister going to comment on a question the Secretary of State put aside ?


fn_spacy_tokens_for_baseline: When I accepted he suggested I might like to give him a certain sum to help the wine flow .

source_bert_toks: when i accepted he suggested i might like to give him a certain sum to help the wine flow .

reference_raw: When I accepted, he suggested that I should pay him a certain amount of money to help the wine flow.

reference_spacy_tokens: When I accepted , he suggested that I should pay him a certain amount of money to help the wine flow .


fn_spacy_tokens_for_baseline: He inherits a country where crime , judicial ineptness , military impunity and poverty have become endemic .

source_bert_toks: he inherit ##s a country where crime , judicial in ##ept ##ness , military imp ##uni ##ty and poverty have become endemic .

reference_raw: He inherits a country where crime, judicial incompetence, military impunity and poverty have become endemic.

reference_spacy_tokens: He inherits a country where crime , judicial incompetence , military impunity and poverty have become endemic .


fn_spacy_tokens_for_baseline: In addition to feeling threatened by Iraq 's growing nuclear program , these attacks may explain why the Khomeini government ultimately resumed its efforts to continue Iran 's nuclear power program and strengthen its existing nuclear research program -- and ultimately to develop nuclear weapons .

source_bert_toks: in addition to feeling threatened by iraq ' s growing nuclear program , these attacks may explain why the k ##hom ##ein ##i government ultimately resumed its efforts to continue iran ' s nuclear power program and strengthen its existing nuclear research program - - and ultimately to develop nuclear weapons .

reference_raw: In addition to feeling threatened by the increasing Iraqi nuclear program, these attacks can explain why the Khomeini government has finally resumed its efforts to continue Iran's nuclear power program and strengthen its existing nuclear research programme - and ultimately to develop nuclear weapons.

reference_spacy_tokens: In addition to feeling threatened by the increasing Iraqi nuclear program , these attacks can explain why the Khomeini government has finally resumed its efforts to continue Iran 's nuclear power program and strengthen its existing nuclear research programme - and ultimately to develop nuclear weapons .


fn_spacy_tokens_for_baseline: Barton saw a few metallic glints at great distance .

source_bert_toks: barton saw a few metallic glint ##s at great distance .

reference_raw: Barton could see several metallic flashes from far away.

reference_spacy_tokens: Barton could see several metallic flashes from far away .


fn_spacy_tokens_for_baseline: U.S. pressure caused Taiwan to end its nuclear weapons program in 1988 after International Atomic Energy Agency ( IAEA ) inspections discovered missing fuel rods and the former deputy director of INER defected to the United States with detailed information about Taiwan 's program .

source_bert_toks: u . s . pressure caused taiwan to end its nuclear weapons program in 1988 after international atomic energy agency ( ia ##ea ) inspections discovered missing fuel rods and the former deputy director of in ##er defected to the united states with detailed information about taiwan ' s program .

reference_raw: U.S. pressure caused Taiwan to terminate its nuclear weapons program in 1988, following inspections by the International Atomic Energy Agency (IAEA) that revealed missing fuel rods and that the former Deputy Director of INER had defected to the United States with detailed information on Taiwan's programme.

reference_spacy_tokens: U.S. pressure caused Taiwan to terminate its nuclear weapons program in 1988 , following inspections by the International Atomic Energy Agency ( IAEA ) that revealed missing fuel rods and that the former Deputy Director of INER had defected to the United States with detailed information on Taiwan 's programme .


fn_spacy_tokens_for_baseline: A JURY sat spellbound yesterday as they heard the ' chilling ' account of estate agent Stephanie Slater 's terrifying eight - day kidnap ordeal at the hands of alleged killer Michael Sams .

source_bert_toks: a jury sat spell ##bound yesterday as they heard the ' chilling ' account of estate agent stephanie slater ' s terrifying eight - day kidnap ordeal at the hands of alleged killer michael sam ##s .

reference_raw: Yesterday, the Jury sat enchanted when they heard the 'chilling' account of real estate agent Stephanie Slater's terrible eight-day abduction torture at the hands of the alleged murderer Michael Sams.

reference_spacy_tokens: Yesterday , the Jury sat enchanted when they heard the ' chilling ' account of real estate agent Stephanie Slater 's terrible eight - day abduction torture at the hands of the alleged murderer Michael Sams .


fn_spacy_tokens_for_baseline: He sprinkled it freely in the gate opening and beyond in the passage , then turned to me .

source_bert_toks: he sp ##rin ##kled it freely in the gate opening and beyond in the passage , then turned to me .

reference_raw: He poured it loosely into the opening of the gate and out into the passageway, then turned to me.

reference_spacy_tokens: He poured it loosely into the opening of the gate and out into the passageway , then turned to me .


fn_spacy_tokens_for_baseline: The law still says that men accused of rape can be bailed unless they have a severe psycopathic or psychiatric disorder .

source_bert_toks: the law still says that men accused of rape can be bail ##ed unless they have a severe ps ##y ##co ##pathic or psychiatric disorder .

reference_raw: The law still says that a man accused of rape may be released if he does not suffer from severe psycopathy or mental illness.

reference_spacy_tokens: The law still says that a man accused of rape may be released if he does not suffer from severe psycopathy or mental illness .


fn_spacy_tokens_for_baseline: When Jeopardy was not working , he was often intoxicated .

source_bert_toks: when jeopardy was not working , he was often into ##xi ##cated .

reference_raw: He was often drunk when Jeopardy didn't work.

reference_spacy_tokens: He was often drunk when Jeopardy did n't work .


fn_spacy_tokens_for_baseline: In Paris , in March 1881 , she bore him a daughter , who was christened Jeanne - Marie , with the surname of Langtry .

source_bert_toks: in paris , in march 1881 , she bore him a daughter , who was christ ##ened jeanne - marie , with the surname of lang ##try .

reference_raw: In Paris, in March 1881, she gave birth to a daughter named Jeanne-Marie by the last name of Langtry.

reference_spacy_tokens: In Paris , in March 1881 , she gave birth to a daughter named Jeanne - Marie by the last name of Langtry .


fn_spacy_tokens_for_baseline: The existing policy is one of seeking abortion on demand , up to the point of birth and without legal or medical restriction .

source_bert_toks: the existing policy is one of seeking abortion on demand , up to the point of birth and without legal or medical restriction .

reference_raw: The current policy is to seek an abortion on demand, up to the point of birth and without legislative or medical restrictions.

reference_spacy_tokens: The current policy is to seek an abortion on demand , up to the point of birth and without legislative or medical restrictions .


fn_spacy_tokens_for_baseline: Westinghouse Anniston and the Anniston Chemical Agent Disposal Facility ( ANCDF ) received its third consecutive Safe Operating Facility of the Year Award from Washington Group International this week .

source_bert_toks: west ##ing ##house ann ##isto ##n and the ann ##isto ##n chemical agent disposal facility ( an ##cd ##f ) received its third consecutive safe operating facility of the year award from washington group international this week .

reference_raw: Westinghouse Anniston and the Anniston Chemical Agent Disposal Facility (ANCDF) received the third consecutive Safe Operations Facility of the Year Award from Washington Group International this weekend.

reference_spacy_tokens: Westinghouse Anniston and the Anniston Chemical Agent Disposal Facility ( ANCDF ) received the third consecutive Safe Operations Facility of the Year Award from Washington Group International this weekend .


fn_spacy_tokens_for_baseline: ' Well , if this war wound stands up ter walkin ' up those stairs I might be able ter get it down ter the dustbin for yer , ' he said with a grimace .

source_bert_toks: ' well , if this war wound stands up ter walk ##in ' up those stairs i might be able ter get it down ter the dust ##bin for yer , ' he said with a grimace .

reference_raw: "Well, if the war blows up, ter's going up the stairs, maybe I'll get it down the dustbin for you," he said with a grin.

reference_spacy_tokens: " Well , if the war blows up , ter 's going up the stairs , maybe I 'll get it down the dustbin for you , " he said with a grin .


fn_spacy_tokens_for_baseline: ' Last night you were threatening to ruin him if he hurt Maria Luisa again ; now you 're condoning their going away together . '

source_bert_toks: ' last night you were threatening to ruin him if he hurt maria luisa again ; now you ' re condo ##ning their going away together . '

reference_raw: 'You threatened to destroy him last night if he harmed Maria Luisa again, and now you're condoning them to leave together.'

reference_spacy_tokens: ' You threatened to destroy him last night if he harmed Maria Luisa again , and now you 're condoning them to leave together . '


fn_spacy_tokens_for_baseline: Father Gordy Carvaho is seen through the twisted window in the bell room of Kalaheo town 's Holy Cross Catholic church , which had its steeple devastated in the storms .

source_bert_toks: father go ##rdy car ##vah ##o is seen through the twisted window in the bell room of kala ##he ##o town ' s holy cross catholic church , which had its steep ##le devastated in the storms .

reference_raw: Father Gordy Carvaho is seen through a twisted window in the bell room of the Catholic Church of the Holy Cross of Kalaheo, whose steeple was destroyed by the storms.

reference_spacy_tokens: Father Gordy Carvaho is seen through a twisted window in the bell room of the Catholic Church of the Holy Cross of Kalaheo , whose steeple was destroyed by the storms .


fn_spacy_tokens_for_baseline: Lady Cross 's family was too grief - stricken to attend the trial .

source_bert_toks: lady cross ' s family was too grief - stricken to attend the trial .

reference_raw: Lady Cross' family was too grieving to go to court.

reference_spacy_tokens: Lady Cross ' family was too grieving to go to court .


fn_spacy_tokens_for_baseline: Alice cooked herself eggs , drank tea , and washed herself in cold water , standing in the bath .

source_bert_toks: alice cooked herself eggs , drank tea , and washed herself in cold water , standing in the bath .

reference_raw: Alice cooked her eggs, drank her tea, and bathed in cold water.

reference_spacy_tokens: Alice cooked her eggs , drank her tea , and bathed in cold water .


fn_spacy_tokens_for_baseline: I was just parched and thirsty --

source_bert_toks: i was just parc ##hed and thirsty - -

reference_raw: I was dry and thirsty --

reference_spacy_tokens: I was dry and thirsty --


fn_spacy_tokens_for_baseline: First there was the indignity of rolling up his trousers and removing his socks and shoes , then the endless probing of horizontal holes in the rocks to see if pungars lurked within .

source_bert_toks: first there was the ind ##ign ##ity of rolling up his trousers and removing his socks and shoes , then the endless probing of horizontal holes in the rocks to see if pun ##gar ##s lu ##rked within .

reference_raw: First there was the indignity of rolling up his pants and removing his socks and boots, then the endless probing of horizontal holes in the rocks to see if the pungars were lurking inside.

reference_spacy_tokens: First there was the indignity of rolling up his pants and removing his socks and boots , then the endless probing of horizontal holes in the rocks to see if the pungars were lurking inside .


fn_spacy_tokens_for_baseline: The attendant explained with a friendly grin .

source_bert_toks: the attendant explained with a friendly grin .

reference_raw: The stewardess explained with a friendly smile.

reference_spacy_tokens: The stewardess explained with a friendly smile .