fn_spacy_tokens_for_baseline: The plot concerns an attempt to assassinate the Roman Emperor Titus : it is foiled , but the magnanimous emperor pardons the conspirators .

source_bert_toks: the plot concerns an attempt to assassinate the roman emperor titus : it is foil ##ed , but the magna ##ni ##mous emperor pardon ##s the con ##sp ##ira ##tors .

reference_raw: The plot relates to an attempt to assassinate the Roman Emperor Titus: it is foiled, but the noble Emperor forgives the conspirators.

reference_spacy_tokens: The plot relates to an attempt to assassinate the Roman Emperor Titus : it is foiled , but the noble Emperor forgives the conspirators .


fn_spacy_tokens_for_baseline: I myself took such courses in college , thinking I might end up a schoolteacher .

source_bert_toks: i myself took such courses in college , thinking i might end up a school ##teacher .

reference_raw: I myself took those courses in college, and I figured I'd end up a teacher.

reference_spacy_tokens: I myself took those courses in college , and I figured I 'd end up a teacher .


fn_spacy_tokens_for_baseline: The gift that I am asking you to make will be used to continue our mission of helping people prepare for , find and keep jobs .

source_bert_toks: the gift that i am asking you to make will be used to continue our mission of helping people prepare for , find and keep jobs .

reference_raw: The gift I'm asking you to make will be used to continue our mission to help people get ready, find and maintain jobs.

reference_spacy_tokens: The gift I 'm asking you to make will be used to continue our mission to help people get ready , find and maintain jobs .


fn_spacy_tokens_for_baseline: The paradox of using force to overcome force is here a real contradiction .

source_bert_toks: the paradox of using force to overcome force is here a real contradiction .

reference_raw: Here, the paradox of using power to overcome power is a true contradiction.

reference_spacy_tokens: Here , the paradox of using power to overcome power is a true contradiction .


fn_spacy_tokens_for_baseline: A MOTHER was yesterday convicted of assaulting her daughter by smacking her bottom with a slipper .

source_bert_toks: a mother was yesterday convicted of assault ##ing her daughter by smack ##ing her bottom with a slip ##per .

reference_raw: A mother was sentenced yesterday for assaulting her daughter by slapping her ass with a slipper.

reference_spacy_tokens: A mother was sentenced yesterday for assaulting her daughter by slapping her ass with a slipper .


fn_spacy_tokens_for_baseline: There are fewer boats now than in the past ; many boat people , especially the younger generation , have moved to housing projects .

source_bert_toks: there are fewer boats now than in the past ; many boat people , especially the younger generation , have moved to housing projects .

reference_raw: There are fewer ships now than in the past; many shipmen, especially young ones, have moved to housing projects.

reference_spacy_tokens: There are fewer ships now than in the past ; many shipmen , especially young ones , have moved to housing projects .


fn_spacy_tokens_for_baseline: Anfield manager Graeme Souness was at the Deva Stadium last Saturday to watch 19-year - old Lambert turn on a wonder show in the 3 - 0 rout of Chester .

source_bert_toks: an ##field manager graeme so ##unes ##s was at the dev ##a stadium last saturday to watch 19 - year - old lambert turn on a wonder show in the 3 - 0 ro ##ut of chester .

reference_raw: The field manager, Graeme Souness, was at Deva Stadium last Saturday, watching a 19-year-old Lambert perform a miracle show on a 3-0 Chester route.

reference_spacy_tokens: The field manager , Graeme Souness , was at Deva Stadium last Saturday , watching a 19-year - old Lambert perform a miracle show on a 3 - 0 Chester route .


fn_spacy_tokens_for_baseline: This was a Sunday .

source_bert_toks: this was a sunday .

reference_raw: It's been Saturday.

reference_spacy_tokens: It 's been Saturday .


fn_spacy_tokens_for_baseline: Law is the ' wrong , mechanism for dealing with personal behaviour , emotions , feelings ; it is cold , antagonistic , adversarial and alienating .

source_bert_toks: law is the ' wrong , mechanism for dealing with personal behaviour , emotions , feelings ; it is cold , antagonist ##ic , ad ##vers ##aria ##l and alien ##ating .

reference_raw: The law is a "wrong, mechanism to deal with personal behavior, emotions, feelings; it's cold, antagonistic, adversarial, and alienation.

reference_spacy_tokens: The law is a " wrong , mechanism to deal with personal behavior , emotions , feelings ; it 's cold , antagonistic , adversarial , and alienation .


fn_spacy_tokens_for_baseline: On a certain evening , which had been prearranged , I sent my friend final instructions , for the man was forever on the alert and continually changed his room .

source_bert_toks: on a certain evening , which had been pre ##ar ##rang ##ed , i sent my friend final instructions , for the man was forever on the alert and continually changed his room .

reference_raw: On a certain evening, which had been arranged, I sent my friend the final instructions, for he was always awake and constantly changing his chambers.

reference_spacy_tokens: On a certain evening , which had been arranged , I sent my friend the final instructions , for he was always awake and constantly changing his chambers .


fn_spacy_tokens_for_baseline: The French authorities said that it was legitimate to differentiate between French companies and non - French companies in order to prevent tax avoidance by the latter .

source_bert_toks: the french authorities said that it was legitimate to differentiate between french companies and non - french companies in order to prevent tax avoidance by the latter .

reference_raw: According to the French authorities, it is legitimate to distinguish between French companies and non-French companies in order to avoid tax evasion by those companies.

reference_spacy_tokens: According to the French authorities , it is legitimate to distinguish between French companies and non - French companies in order to avoid tax evasion by those companies .


fn_spacy_tokens_for_baseline: And of course , quotations of APR by individual traders would be very much more valuable if people could set them against a background of what is typical than if they stood alone , in isolation .

source_bert_toks: and of course , quota ##tions of apr by individual traders would be very much more valuable if people could set them against a background of what is typical than if they stood alone , in isolation .

reference_raw: And, of course, quotations of APRs by individual traders would be worth a lot more if people could put them in the context of something typical than standing alone, alone.

reference_spacy_tokens: And , of course , quotations of APRs by individual traders would be worth a lot more if people could put them in the context of something typical than standing alone , alone .


fn_spacy_tokens_for_baseline: Reproduced to a uniform size on the printed page , sculptures which are monumental in size can not be distinguished from those which are mere studies or maquettes .

source_bert_toks: reproduced to a uniform size on the printed page , sculptures which are monumental in size can not be distinguished from those which are mere studies or ma ##quette ##s .

reference_raw: Replaced to the same size on the printed page, statues of monumental size cannot be distinguished from those which are merely studies or maquettes.

reference_spacy_tokens: Replaced to the same size on the printed page , statues of monumental size can not be distinguished from those which are merely studies or maquettes .


fn_spacy_tokens_for_baseline: ' Shy people have an overgenerous view of others ' might be more accurate .

source_bert_toks: ' shy people have an over ##gen ##ero ##us view of others ' might be more accurate .

reference_raw: "Shy people have too much insight into other people" might be more precise.

reference_spacy_tokens: " Shy people have too much insight into other people " might be more precise .


fn_spacy_tokens_for_baseline: However , what can we say with confidence about the beliefs of ordinary people , either in the nineteenth or even in the late twentieth century ?

source_bert_toks: however , what can we say with confidence about the beliefs of ordinary people , either in the nineteenth or even in the late twentieth century ?

reference_raw: But what can we tell with confidence about the faith of ordinary people, whether in the nineteenth or even in the late twentieth century?

reference_spacy_tokens: But what can we tell with confidence about the faith of ordinary people , whether in the nineteenth or even in the late twentieth century ?


fn_spacy_tokens_for_baseline: The youngsters died after a car ploughed into a roadside bench at Akers Way in Swindon .

source_bert_toks: the young ##sters died after a car pl ##ough ##ed into a roadside bench at ak ##ers way in swindon .

reference_raw: The youngsters died when the car was plowed onto the roadside bench at Akers Way in Swindon.

reference_spacy_tokens: The youngsters died when the car was plowed onto the roadside bench at Akers Way in Swindon .


fn_spacy_tokens_for_baseline: The captain 's citation , which made no mention of the fatal rendezvous between missiles and 290 civilians , commended the captain for ' exceptionally meritorious conduct in the performance of outstanding service ' and for the ' calm and professional atmosphere ' prevailing aboard the Vincennes .

source_bert_toks: the captain ' s citation , which made no mention of the fatal rendezvous between missiles and 290 civilians , commended the captain for ' exceptionally meritorious conduct in the performance of outstanding service ' and for the ' calm and professional atmosphere ' prevailing aboard the vince ##nne ##s .

reference_raw: The captain's quote, which made no mention of the fatal encounter between missiles and 290 civilians, praised the captain for "extremely meritorious conduct in performing excellent service" and for the "calm and professional atmosphere" that prevailed on board the Vincennes.

reference_spacy_tokens: The captain 's quote , which made no mention of the fatal encounter between missiles and 290 civilians , praised the captain for " extremely meritorious conduct in performing excellent service " and for the " calm and professional atmosphere " that prevailed on board the Vincennes .


fn_spacy_tokens_for_baseline: As is invariably the case , the chorus 's singing was first - rate and so was the orchestral playing .

source_bert_toks: as is invariably the case , the chorus ' s singing was first - rate and so was the orchestral playing .

reference_raw: As is always the case, the choir's singing was first class, and so was the orchestra's play.

reference_spacy_tokens: As is always the case , the choir 's singing was first class , and so was the orchestra 's play .


fn_spacy_tokens_for_baseline: I thought back to seeing the man in the hollow church and described his skin , his dark hair , the way that light seemed to flow around him , as best as I could .

source_bert_toks: i thought back to seeing the man in the hollow church and described his skin , his dark hair , the way that light seemed to flow around him , as best as i could .

reference_raw: I remembered seeing the man in the hollow church, describing his skin, his black hair, the way the light seemed to flow around him as best I could.

reference_spacy_tokens: I remembered seeing the man in the hollow church , describing his skin , his black hair , the way the light seemed to flow around him as best I could .


fn_spacy_tokens_for_baseline: As Roth says , the film is a meditation on codes of honour , on professional and personal loyalties .

source_bert_toks: as roth says , the film is a meditation on codes of honour , on professional and personal loyal ##ties .

reference_raw: As Roth says, this film is a meditator of codes of honor, professional and personal loyalty.

reference_spacy_tokens: As Roth says , this film is a meditator of codes of honor , professional and personal loyalty .


fn_spacy_tokens_for_baseline: On the day when it really mattered , my underwear was clean .

source_bert_toks: on the day when it really mattered , my underwear was clean .

reference_raw: The day that mattered, my underpants were clean.

reference_spacy_tokens: The day that mattered , my underpants were clean .


fn_spacy_tokens_for_baseline: She must also show the relationships of such a scale to the claims for detachment made within particular cultural conventions .

source_bert_toks: she must also show the relationships of such a scale to the claims for detachment made within particular cultural conventions .

reference_raw: It must also demonstrate the relations of such a scale with the claims for separation made in the context of specific cultural agreements.

reference_spacy_tokens: It must also demonstrate the relations of such a scale with the claims for separation made in the context of specific cultural agreements .


fn_spacy_tokens_for_baseline: I saw the massed coils of barbed wire , the tall wooden towers and the muffled sentries that we had passed on the night I arrived .

source_bert_toks: i saw the mass ##ed coil ##s of barbed wire , the tall wooden towers and the muffled sent ##ries that we had passed on the night i arrived .

reference_raw: I could see the massed spools of barbed wire, the tall wooden towers, and the muffled guards we had passed the night I arrived.

reference_spacy_tokens: I could see the massed spools of barbed wire , the tall wooden towers , and the muffled guards we had passed the night I arrived .


fn_spacy_tokens_for_baseline: ' You hit me with five ton of leg in your sleep .

source_bert_toks: ' you hit me with five ton of leg in your sleep .

reference_raw: 'In your sleep, you struck me with five tons of foot.

reference_spacy_tokens: ' In your sleep , you struck me with five tons of foot .


fn_spacy_tokens_for_baseline: Although a GOP president may limit local benefits to the voter 's particular district / state , such a president is also likely to be more effective at preventing other districts / states and their legislators from bringing home the local benefits .

source_bert_toks: although a go ##p president may limit local benefits to the voter ' s particular district / state , such a president is also likely to be more effective at preventing other districts / states and their legislators from bringing home the local benefits .

reference_raw: While the President of the GOP may limit local benefits to the specific district/state of the voter, he is also likely to be more effective in preventing other districts/states and their legislators from bringing home local benefits.

reference_spacy_tokens: While the President of the GOP may limit local benefits to the specific district / state of the voter , he is also likely to be more effective in preventing other districts / states and their legislators from bringing home local benefits .


fn_spacy_tokens_for_baseline: You might destroy vital medical evidence which will help prove the case against the person who assaulted you .

source_bert_toks: you might destroy vital medical evidence which will help prove the case against the person who assaulted you .

reference_raw: You could destroy vital medical evidence to support the case against the person who attacked you.

reference_spacy_tokens: You could destroy vital medical evidence to support the case against the person who attacked you .


fn_spacy_tokens_for_baseline: The struggle against the drug lords in Colombia will be a near thing .

source_bert_toks: the struggle against the drug lords in colombia will be a near thing .

reference_raw: Fighting drug lords in Colombia will be close.

reference_spacy_tokens: Fighting drug lords in Colombia will be close .


fn_spacy_tokens_for_baseline: Surrounded by small seaside resorts and redwood avenues is San Francisco , a cosmopolitan town whose many nationalities have inspired a host of restaurants .

source_bert_toks: surrounded by small seaside resorts and redwood avenues is san francisco , a cosmopolitan town whose many nationalities have inspired a host of restaurants .

reference_raw: Surrounded by small seaside resorts and redwood streets is San Francisco, a cosmopolitan city whose numerous nationalities have inspired many restaurants.

reference_spacy_tokens: Surrounded by small seaside resorts and redwood streets is San Francisco , a cosmopolitan city whose numerous nationalities have inspired many restaurants .


fn_spacy_tokens_for_baseline: Her voice had taken on a husky , girlish tone and he was gratified .

source_bert_toks: her voice had taken on a husky , girl ##ish tone and he was gr ##ati ##fied .

reference_raw: Her voice was hoarse, girlish, and he was satisfied.

reference_spacy_tokens: Her voice was hoarse , girlish , and he was satisfied .


fn_spacy_tokens_for_baseline: On the main street , running directly into central London , a Woolworths , a Marks and Spencer and several other department stores preside over a range of smaller shops .

source_bert_toks: on the main street , running directly into central london , a wool ##worth ##s , a marks and spencer and several other department stores pre ##side over a range of smaller shops .

reference_raw: The Woolworths, Marks, Spencer, and several other department stores presided over a number of small shops along the main street, which led directly to the center of London.

reference_spacy_tokens: The Woolworths , Marks , Spencer , and several other department stores presided over a number of small shops along the main street , which led directly to the center of London .


fn_spacy_tokens_for_baseline: He hoisted the contraption in his arms and made for the battlezone .

source_bert_toks: he hoisted the contra ##ption in his arms and made for the battle ##zone .

reference_raw: He lifted the device in his arms and headed for the battle zone.

reference_spacy_tokens: He lifted the device in his arms and headed for the battle zone .


fn_spacy_tokens_for_baseline: Their dominance stood in clear contrast with the much more diffused influence of the county gentry in the earlier seventeenth century , yet it was an almost logical outcome of the steady pattern of estate aggrandisement and judicious marriages which the more prudent of the local squirearchy had pursued over several generations .

source_bert_toks: their dominance stood in clear contrast with the much more diffuse ##d influence of the county gentry in the earlier seventeenth century , yet it was an almost logical outcome of the steady pattern of estate ag ##gra ##ndi ##se ##ment and ju ##dic ##ious marriages which the more pr ##ude ##nt of the local squire ##ar ##chy had pursued over several generations .

reference_raw: Their dominance was clearly in contrast to the much more diffuse influence of the county gentry in the early seventeenth century, but it was almost a logical consequence of a stable pattern of property aggression and judicious marriages that the more prudent of the local squirearchy had pursued for several generations.

reference_spacy_tokens: Their dominance was clearly in contrast to the much more diffuse influence of the county gentry in the early seventeenth century , but it was almost a logical consequence of a stable pattern of property aggression and judicious marriages that the more prudent of the local squirearchy had pursued for several generations .


fn_spacy_tokens_for_baseline: An examination of changes in personal staffing decisions in the Senate between 1986 and 1987 ( when control of that body changed party hands ) , moreover , reveals that the personal staffing differences noted in the table can not be attributed to the disproportionate control Democrats exercise , due to their majority - party status , over other resources such as committee staff .

source_bert_toks: an examination of changes in personal staff ##ing decisions in the senate between 1986 and 1987 ( when control of that body changed party hands ) , moreover , reveals that the personal staff ##ing differences noted in the table can not be attributed to the di ##sp ##rop ##ort ##ion ##ate control democrats exercise , due to their majority - party status , over other resources such as committee staff .

reference_raw: In addition, the review of the amendments made to the decisions on personal staff in the Senate between 1986 and 1987 (when the control of that body was altered by the hands of the parties) shows that the differences in personal staff in the table cannot be attributed to the excessive control exercised by Democrats over other resources, such as committee staff, by virtue of their majority party status.

reference_spacy_tokens: In addition , the review of the amendments made to the decisions on personal staff in the Senate between 1986 and 1987 ( when the control of that body was altered by the hands of the parties ) shows that the differences in personal staff in the table can not be attributed to the excessive control exercised by Democrats over other resources , such as committee staff , by virtue of their majority party status .


fn_spacy_tokens_for_baseline: He also was miffed that World Tour organizers did not contact enough players before going public .

source_bert_toks: he also was mi ##ffed that world tour organizers did not contact enough players before going public .

reference_raw: He was also confused by the fact that the World Tour organizers didn't contact enough players before they went public.

reference_spacy_tokens: He was also confused by the fact that the World Tour organizers did n't contact enough players before they went public .


fn_spacy_tokens_for_baseline: ' Oh Lord , ' he whimpered to himself .

source_bert_toks: ' oh lord , ' he whimpered to himself .

reference_raw: "Oh, my God," he whined to himself.

reference_spacy_tokens: " Oh , my God , " he whined to himself .


fn_spacy_tokens_for_baseline: The judgement of the dead gradually came under the authority of Osiris , reaching its developed form by the New Kingdom .

source_bert_toks: the judgement of the dead gradually came under the authority of os ##iri ##s , reaching its developed form by the new kingdom .

reference_raw: The judgment of the dead had gradually come under Osiris' authority, and the New Kingdom had reached its advanced form.

reference_spacy_tokens: The judgment of the dead had gradually come under Osiris ' authority , and the New Kingdom had reached its advanced form .


fn_spacy_tokens_for_baseline: Soap ceased his fantastic monologue , and Pooley and Omally stared at him dumb and slack - jawed .

source_bert_toks: soap ceased his fantastic mono ##logue , and poole ##y and om ##ally stared at him dumb and slack - jaw ##ed .

reference_raw: Soap stopped his fantastic monologue, and Pooley and Omally stared at him, dumb and slack-jawed.

reference_spacy_tokens: Soap stopped his fantastic monologue , and Pooley and Omally stared at him , dumb and slack - jawed .


fn_spacy_tokens_for_baseline: STAFF and students at a local boys ' school are preparing to thrill audiences with their latest drama .

source_bert_toks: staff and students at a local boys ' school are preparing to thrill audiences with their latest drama .

reference_raw: STAFF and students from the local boys' school prepare to excite the audience with the latest drama.

reference_spacy_tokens: STAFF and students from the local boys ' school prepare to excite the audience with the latest drama .


fn_spacy_tokens_for_baseline: Our data suggest that in addition to androgen - independent positional influences on fibroblast phenotypes , the AR is originally involved in establishing stable and reproducible patterns of gene expression in stromal cells during genital differentiation , which are reflected in the differences in global gene - expression patterns between fibroblasts cultured from the genital skin of normal individuals and females affected by AIS .

source_bert_toks: our data suggest that in addition to and ##rogen - independent position ##al influences on fi ##bro ##bla ##st ph ##eno ##type ##s , the ar is originally involved in establishing stable and rep ##rod ##ucible patterns of gene expression in st ##rom ##al cells during gen ##ital differentiation , which are reflected in the differences in global gene - expression patterns between fi ##bro ##bla ##sts culture ##d from the gen ##ital skin of normal individuals and females affected by ai ##s .

reference_raw: Our data indicate that, in addition to androgen-independent positional effects on fibroblast phenotypes, the AR is initially involved in the development of stable and reproducible patterns of gene expression in stromal cells during genital differentiation, reflecting differences in the overall gene-expression patterns between fibroblasts cultured from the genital skin of normal individuals and females affected by AIS.

reference_spacy_tokens: Our data indicate that , in addition to androgen - independent positional effects on fibroblast phenotypes , the AR is initially involved in the development of stable and reproducible patterns of gene expression in stromal cells during genital differentiation , reflecting differences in the overall gene - expression patterns between fibroblasts cultured from the genital skin of normal individuals and females affected by AIS .


fn_spacy_tokens_for_baseline: Had the vibrations of Kershaw reached it as it lay slumbering in the earth ?

source_bert_toks: had the vibrations of ke ##rs ##haw reached it as it lay sl ##umber ##ing in the earth ?

reference_raw: Had Kershaw's vibrations reached him as he lay dozing on the ground?

reference_spacy_tokens: Had Kershaw 's vibrations reached him as he lay dozing on the ground ?


fn_spacy_tokens_for_baseline: There is no point in complaining ; they may try to mollify you in their irritatingly good English , but they will not have a clue what you are so anxious about .

source_bert_toks: there is no point in complaining ; they may try to mo ##lli ##fy you in their irritating ##ly good english , but they will not have a clue what you are so anxious about .

reference_raw: There's no point in complaining; they might try to cheer you up in their irritatingly good English, but they won't know what you're so anxious about.

reference_spacy_tokens: There 's no point in complaining ; they might try to cheer you up in their irritatingly good English , but they wo n't know what you 're so anxious about .


fn_spacy_tokens_for_baseline: She arched her back , tried to stretch her neck above assorted flesh and hair and smell .

source_bert_toks: she arched her back , tried to stretch her neck above ass ##orted flesh and hair and smell .

reference_raw: She arched her back and tried to stretch her throat over the tangled flesh and hair and the scent.

reference_spacy_tokens: She arched her back and tried to stretch her throat over the tangled flesh and hair and the scent .


fn_spacy_tokens_for_baseline: There is a theory that the curious expression ( from the Bible ) , It is harder for a rich man to enter the kingdom of heaven than for a camel to go through the eye of a needle results from a misreading of the original : the original , it is said , has a word meaning ' rope , ' not ' camel , ' which makes sense ( to me ) .

source_bert_toks: there is a theory that the curious expression ( from the bible ) , it is harder for a rich man to enter the kingdom of heaven than for a camel to go through the eye of a needle results from a mis ##rea ##ding of the original : the original , it is said , has a word meaning ' rope , ' not ' camel , ' which makes sense ( to me ) .

reference_raw: There's a theory that the strange expression (from the Bible) is more difficult for a rich man to enter the kingdom of heaven than for a camel to pass through the eye of a needle is the result of a misreading of the original: the original, they say, has the meaning of 'rope', not 'camel', which makes sense to me.

reference_spacy_tokens: There 's a theory that the strange expression ( from the Bible ) is more difficult for a rich man to enter the kingdom of heaven than for a camel to pass through the eye of a needle is the result of a misreading of the original : the original , they say , has the meaning of ' rope ' , not ' camel ' , which makes sense to me .


fn_spacy_tokens_for_baseline: I then launched Xwindows .

source_bert_toks: i then launched x ##wind ##ows .

reference_raw: Then I started the Xwindows.

reference_spacy_tokens: Then I started the Xwindows .


fn_spacy_tokens_for_baseline: He was educated at the Palace School , Enfield , before unenthusiastically joining the family firm .

source_bert_toks: he was educated at the palace school , enfield , before une ##nt ##hus ##ias ##tically joining the family firm .

reference_raw: He had been educated at the Palace School in Enfield before joining the family business unenthusiastically.

reference_spacy_tokens: He had been educated at the Palace School in Enfield before joining the family business unenthusiastically .


fn_spacy_tokens_for_baseline: They may be openly on display , or totally hidden by pubic hair .

source_bert_toks: they may be openly on display , or totally hidden by pub ##ic hair .

reference_raw: They can be openly displayed, or completely concealed by pubic hair.

reference_spacy_tokens: They can be openly displayed , or completely concealed by pubic hair .


fn_spacy_tokens_for_baseline: Why , then , do we make it compulsory to be educated ?

source_bert_toks: why , then , do we make it compulsory to be educated ?

reference_raw: So why are we making education mandatory?

reference_spacy_tokens: So why are we making education mandatory ?


fn_spacy_tokens_for_baseline: The front - page of the Sun confidently stressed that The Fox ' based his sickening crimes on hard - core videos hired from sex shops ' .

source_bert_toks: the front - page of the sun confidently stressed that the fox ' based his sick ##ening crimes on hard - core videos hired from sex shops ' .

reference_raw: The front page of the sun confidently pointed out that Fox "based his gruesome crimes on hard-core videos hired by sex stores."

reference_spacy_tokens: The front page of the sun confidently pointed out that Fox " based his gruesome crimes on hard - core videos hired by sex stores . "


fn_spacy_tokens_for_baseline: The clothes he wore , the cut of his hair , even the subtly elegant watch on his wrist , everything about him seemed to indicate a man who had been brought up to take wealth for granted .

source_bert_toks: the clothes he wore , the cut of his hair , even the subtly elegant watch on his wrist , everything about him seemed to indicate a man who had been brought up to take wealth for granted .

reference_raw: The clothes he wore, the haircut of his hair, even the delicately elegant watch on his wrist, all about him seemed to indicate a man who had been raised to take wealth for granted.

reference_spacy_tokens: The clothes he wore , the haircut of his hair , even the delicately elegant watch on his wrist , all about him seemed to indicate a man who had been raised to take wealth for granted .


fn_spacy_tokens_for_baseline: Vologsky was alert immediately , the tensions now on the surface , his nerve - endings tingling with anticipation and fear .

source_bert_toks: vol ##og ##sky was alert immediately , the tensions now on the surface , his nerve - endings tingling with anticipation and fear .

reference_raw: Vologsky was alert at once, the tension on the surface now, his nerve endings tinging with anticipation and fear.

reference_spacy_tokens: Vologsky was alert at once , the tension on the surface now , his nerve endings tinging with anticipation and fear .


fn_spacy_tokens_for_baseline: All children who attend the camp are referred by social workers , doctors , teachers , counselors , and other professionals .

source_bert_toks: all children who attend the camp are referred by social workers , doctors , teachers , counselor ##s , and other professionals .

reference_raw: Social workers, doctors, teachers, advisers, and other professionals recommend all children who attend the camp.

reference_spacy_tokens: Social workers , doctors , teachers , advisers , and other professionals recommend all children who attend the camp .


fn_spacy_tokens_for_baseline: ' It was only slightly traumatic , but I knew from my safety audit of the operators that it was virtually impossible for things to go wrong , ' explained Nigel .

source_bert_toks: ' it was only slightly traumatic , but i knew from my safety audit of the operators that it was virtually impossible for things to go wrong , ' explained nigel .

reference_raw: 'It was just a little traumatized, but I knew from the operator's security audit that it was almost impossible for things to go wrong,' said Nigel.

reference_spacy_tokens: ' It was just a little traumatized , but I knew from the operator 's security audit that it was almost impossible for things to go wrong , ' said Nigel .


fn_spacy_tokens_for_baseline: Then she checked her appearance in the mirror , objectively staring back at the exquisite reflection , the shining flaxen hair , the huge dark eyes , the full mouth .

source_bert_toks: then she checked her appearance in the mirror , objective ##ly staring back at the exquisite reflection , the shining fl ##ax ##en hair , the huge dark eyes , the full mouth .

reference_raw: Then she checked her appearance in the mirror and looked objectively back at the beautiful reflection, the gleaming flaxy hair, the huge dark eyes, the full mouth.

reference_spacy_tokens: Then she checked her appearance in the mirror and looked objectively back at the beautiful reflection , the gleaming flaxy hair , the huge dark eyes , the full mouth .


fn_spacy_tokens_for_baseline: Finally , as greenhouse gas emissions are projected to grow exponentially in the developing world in the next two decades , we must evaluate the costs of imposing domestic reductions as a very high cost against potentially low - cost opportunities for mitigating and sequestering carbon emissions in the developing world .

source_bert_toks: finally , as greenhouse gas emissions are projected to grow exponential ##ly in the developing world in the next two decades , we must evaluate the costs of imposing domestic reductions as a very high cost against potentially low - cost opportunities for mit ##iga ##ting and se ##quest ##ering carbon emissions in the developing world .

reference_raw: Finally, as GHG emissions are expected to grow exponentially in the developing world over the next two decades, we need to assess the cost of imposing domestic cuts as a very significant cost compared to potentially cheap opportunities for mitigating and sequestering carbon emissions in the developing world.

reference_spacy_tokens: Finally , as GHG emissions are expected to grow exponentially in the developing world over the next two decades , we need to assess the cost of imposing domestic cuts as a very significant cost compared to potentially cheap opportunities for mitigating and sequestering carbon emissions in the developing world .


fn_spacy_tokens_for_baseline: The " Sacher Torte " cake was available for purchase at something like £ 3 a mouthful .

source_bert_toks: the " sac ##her tor ##te " cake was available for purchase at something like £3 a mouthful .

reference_raw: The Sacher Torte cake was available to buy something like three pounds a mouthful.

reference_spacy_tokens: The Sacher Torte cake was available to buy something like three pounds a mouthful .


fn_spacy_tokens_for_baseline: You can try your luck at pari mutuel betting on jai - alai at pari mutuel , greyhound - racing at the Cani drome ( one of the largest in the world ) , and harness - racing on Taipa .

source_bert_toks: you can try your luck at par ##i mu ##tu ##el betting on jai - ala ##i at par ##i mu ##tu ##el , greyhound - racing at the can ##i dr ##ome ( one of the largest in the world ) , and harness - racing on tai ##pa .

reference_raw: You can test your luck in Paris Mutuel betting on jai-alai in Paris Mutuel, Greyhound - race in the Cani Drome (one of the largest in the world) and harness - race on Taipa.

reference_spacy_tokens: You can test your luck in Paris Mutuel betting on jai - alai in Paris Mutuel , Greyhound - race in the Cani Drome ( one of the largest in the world ) and harness - race on Taipa .


fn_spacy_tokens_for_baseline: I recommend you to contact the trust for information ( enclosing a donation ) and rewrite your editorial .

source_bert_toks: i recommend you to contact the trust for information ( en ##cl ##osing a donation ) and re ##write your editorial .

reference_raw: I recommend that you contact your trust for information (enclosing your donation) and rewrite your publisher.

reference_spacy_tokens: I recommend that you contact your trust for information ( enclosing your donation ) and rewrite your publisher .


fn_spacy_tokens_for_baseline: The Investigation of the Year award , presented at the annual What the Papers Say Awards by Lord McGregor of Durris , chairman of the Press Complaints Commission , followed his award last week as Author of the Year at the British Book Awards .

source_bert_toks: the investigation of the year award , presented at the annual what the papers say awards by lord mcgregor of du ##rri ##s , chairman of the press complaints commission , followed his award last week as author of the year at the british book awards .

reference_raw: The investigation of the Year Award, presented in the Year's Awards by Lord McGregor of Durris, Chairman of the Press Complaints Commission, followed his award last week as author of the Year at the British Book Awards.

reference_spacy_tokens: The investigation of the Year Award , presented in the Year 's Awards by Lord McGregor of Durris , Chairman of the Press Complaints Commission , followed his award last week as author of the Year at the British Book Awards .


fn_spacy_tokens_for_baseline: There is also the possibility of using neural computing techniques as an aid to plant recognition and classification .

source_bert_toks: there is also the possibility of using neural computing techniques as an aid to plant recognition and classification .

reference_raw: It is also possible to use neural computing techniques to support the recognition and classification of plants.

reference_spacy_tokens: It is also possible to use neural computing techniques to support the recognition and classification of plants .


fn_spacy_tokens_for_baseline: Those who believe North Korea is a revisionist state argue that Pyongyang 's nuclear motivations constitute a serious external threat .

source_bert_toks: those who believe north korea is a revision ##ist state argue that p ##yon ##gy ##ang ' s nuclear motivation ##s constitute a serious external threat .

reference_raw: Those who believe that North Korea is a revisionist state claim that the nuclear motives of Pyongyang constitute a serious external threat.

reference_spacy_tokens: Those who believe that North Korea is a revisionist state claim that the nuclear motives of Pyongyang constitute a serious external threat .


fn_spacy_tokens_for_baseline: He was ashamed that Michael had heard his father - in - law speak to him like that .

source_bert_toks: he was ashamed that michael had heard his father - in - law speak to him like that .

reference_raw: He was ashamed that Michael had heard his in-law talk to him that way.

reference_spacy_tokens: He was ashamed that Michael had heard his in - law talk to him that way .


fn_spacy_tokens_for_baseline: The entry into force of START I is a major landmark in the process of nuclear arms control , which was greatly helped by the decision of Ukraine to accede to the NPT .

source_bert_toks: the entry into force of start i is a major landmark in the process of nuclear arms control , which was greatly helped by the decision of ukraine to acc ##ede to the np ##t .

reference_raw: The entry into force of START I is an important milestone in the nuclear arms control process, which has been greatly facilitated by Ukraine's decision to join the NPT.

reference_spacy_tokens: The entry into force of START I is an important milestone in the nuclear arms control process , which has been greatly facilitated by Ukraine 's decision to join the NPT .


fn_spacy_tokens_for_baseline: This is the most famous of all ancient circular temples and , first as a temple , and later as a church , has been in continuous use since its building .

source_bert_toks: this is the most famous of all ancient circular temples and , first as a temple , and later as a church , has been in continuous use since its building .

reference_raw: It is the most famous of all the old circular temples, and, first as a temple, and later as a church, it has been in constant use since it was built.

reference_spacy_tokens: It is the most famous of all the old circular temples , and , first as a temple , and later as a church , it has been in constant use since it was built .


fn_spacy_tokens_for_baseline: He hid nothing from me .

source_bert_toks: he hid nothing from me .

reference_raw: He didn't keep anything from me.

reference_spacy_tokens: He did n't keep anything from me .


fn_spacy_tokens_for_baseline: United States Helps Uzbekistan Secure Dangerous Nuclear Materials : Energy agency announces completion of secret uranium transfer back to Russia

source_bert_toks: united states helps uzbekistan secure dangerous nuclear materials : energy agency announces completion of secret uranium transfer back to russia

reference_raw: U.S. Helps Uzbekistan Security Dangerous Nuclear Material: The Energy Agency announces the completion of the secret transfer of uranium back to Russia

reference_spacy_tokens: U.S. Helps Uzbekistan Security Dangerous Nuclear Material : The Energy Agency announces the completion of the secret transfer of uranium back to Russia


fn_spacy_tokens_for_baseline: Cards , bead chains and baubles are displayed on the mantelshelf while a garland is carefully stapled to the underside , with tiny cherubs and tassels tied in place .

source_bert_toks: cards , bea ##d chains and ba ##ub ##les are displayed on the man ##tel ##sh ##el ##f while a garland is carefully staple ##d to the underside , with tiny cher ##ub ##s and ta ##ssel ##s tied in place .

reference_raw: Cards, bead chains and baubles appear on the shelf, while the garland is carefully attached to the bottom, with small cherubs and tassels attached.

reference_spacy_tokens: Cards , bead chains and baubles appear on the shelf , while the garland is carefully attached to the bottom , with small cherubs and tassels attached .


fn_spacy_tokens_for_baseline: She tells me the ambulance is on its way , then she fetches Ma downstairs and sits her by the Rayburn .

source_bert_toks: she tells me the ambulance is on its way , then she fetch ##es ma downstairs and sits her by the ray ##burn .

reference_raw: She told me the ambulance was on its way, and then she brought my mom down and put her at Rayburn's.

reference_spacy_tokens: She told me the ambulance was on its way , and then she brought my mom down and put her at Rayburn 's .


fn_spacy_tokens_for_baseline: Robert Merkel , a former U.S. attorney handling drug indictments in Florida , does n't think for a minute that Castro 's much publicized trials of high officials engaged in the drug trade mean he has broken off with the Medellin drug cartel .

source_bert_toks: robert mer ##kel , a former u . s . attorney handling drug indictment ##s in florida , doesn ' t think for a minute that castro ' s much publicized trials of high officials engaged in the drug trade mean he has broken off with the med ##elli ##n drug cartel .

reference_raw: Robert Merkel, a former U.S. attorney dealing with drug charges in Florida, does not think for a moment that Castro's many publicized trials of high-level officials involved in drug trafficking mean that he broke up with the Medellin drug cartel.

reference_spacy_tokens: Robert Merkel , a former U.S. attorney dealing with drug charges in Florida , does not think for a moment that Castro 's many publicized trials of high - level officials involved in drug trafficking mean that he broke up with the Medellin drug cartel .


fn_spacy_tokens_for_baseline: Indeed the commercial aspirations of publishers are precisely to ensure additionality , not direct substitution for print in their pricing and packaging structures .

source_bert_toks: indeed the commercial aspirations of publishers are precisely to ensure additional ##ity , not direct substitution for print in their pricing and packaging structures .

reference_raw: Indeed, publishers' commercial ambition is precisely to ensure additionality, not direct substitution for printing in their pricing and packaging structures.

reference_spacy_tokens: Indeed , publishers ' commercial ambition is precisely to ensure additionality , not direct substitution for printing in their pricing and packaging structures .


fn_spacy_tokens_for_baseline: ' Because I ran your mother into Dublin to get a new wedding outfit .

source_bert_toks: ' because i ran your mother into dublin to get a new wedding outfit .

reference_raw: Because I drove your mother to Dublin for a new wedding dress.

reference_spacy_tokens: Because I drove your mother to Dublin for a new wedding dress .


fn_spacy_tokens_for_baseline: Weapons were often embellished with precious metal , and the Encomiast describes the magnificence of Cnut 's invasion fleet , and the gold and silver decoration of its ships .

source_bert_toks: weapons were often em ##bell ##ished with precious metal , and the en ##com ##ias ##t describes the mag ##ni ##fi ##cence of cn ##ut ' s invasion fleet , and the gold and silver decoration of its ships .

reference_raw: The weapons were often decorated with precious metal, and the Encomiast described the size of Cnut's invasion fleet and the gold and silver decorations of its ships.

reference_spacy_tokens: The weapons were often decorated with precious metal , and the Encomiast described the size of Cnut 's invasion fleet and the gold and silver decorations of its ships .


fn_spacy_tokens_for_baseline: She ran past Seaview , the road that was falling off the cliff , and then she started to wonder where she was going .

source_bert_toks: she ran past sea ##view , the road that was falling off the cliff , and then she started to wonder where she was going .

reference_raw: She ran past Seaview, a trail falling from a rock, then began to wonder where she was going.

reference_spacy_tokens: She ran past Seaview , a trail falling from a rock , then began to wonder where she was going .


fn_spacy_tokens_for_baseline: But a leisurely trip by boat is recommended .

source_bert_toks: but a leisure ##ly trip by boat is recommended .

reference_raw: But we recommend a leisurely voyage by boat.

reference_spacy_tokens: But we recommend a leisurely voyage by boat .


fn_spacy_tokens_for_baseline: Equivalence relations are often more readily comprehended and also constructed in terms of the concept of partition .

source_bert_toks: equivalence relations are often more readily comprehend ##ed and also constructed in terms of the concept of partition .

reference_raw: Equivalence relationships are often more easily understood and developed in terms of the concept of partitioning.

reference_spacy_tokens: Equivalence relationships are often more easily understood and developed in terms of the concept of partitioning .


fn_spacy_tokens_for_baseline: It was thoughtful of Rufus because it 's on the bus route .

source_bert_toks: it was thoughtful of rufus because it ' s on the bus route .

reference_raw: He thought about Rufus because he's on a bus route.

reference_spacy_tokens: He thought about Rufus because he 's on a bus route .


fn_spacy_tokens_for_baseline: She was reasonably certain by then that it was merely a necessary preliminary to the real business he had with her .

source_bert_toks: she was reasonably certain by then that it was merely a necessary preliminary to the real business he had with her .

reference_raw: By that time she was reasonably sure that this was just a necessary preliminary to his real business with her.

reference_spacy_tokens: By that time she was reasonably sure that this was just a necessary preliminary to his real business with her .


fn_spacy_tokens_for_baseline: Why does everybody seem to know everybody else ?

source_bert_toks: why does everybody seem to know everybody else ?

reference_raw: Why does everyone seem to recognize everyone else?

reference_spacy_tokens: Why does everyone seem to recognize everyone else ?


fn_spacy_tokens_for_baseline: And she has no difficulty in culling support for her thesis from the recent list of hot stories : the New Yorker succession , Time / CNN / sarin , Jim Fallows ' firing , Nina Burleigh on the Oral Office , Steven Brill , etc .

source_bert_toks: and she has no difficulty in cu ##lling support for her thesis from the recent list of hot stories : the new yorker succession , time / cnn / sar ##in , jim fall ##ows ' firing , nina bu ##rle ##igh on the oral office , steven br ##ill , etc .

reference_raw: And she doesn't have any trouble getting her thesis backed up by a recent list of hot stories: the New Yorker series, Time/CNN/Sarin, the shooting of Jim Fallows, Nina Burleigh at the Oral Office, Steven Brill, etc.

reference_spacy_tokens: And she does n't have any trouble getting her thesis backed up by a recent list of hot stories : the New Yorker series , Time / CNN / Sarin , the shooting of Jim Fallows , Nina Burleigh at the Oral Office , Steven Brill , etc .


fn_spacy_tokens_for_baseline: Her shoulders shook convulsively and she rolled to her side on the bed , curling up .

source_bert_toks: her shoulders shook con ##vu ##ls ##ively and she rolled to her side on the bed , curling up .

reference_raw: Her shoulders trembled convulsively, and she rolled to her side on the bed and curled up.

reference_spacy_tokens: Her shoulders trembled convulsively , and she rolled to her side on the bed and curled up .


fn_spacy_tokens_for_baseline: A routine safeguards inspection of Iran 's nuclear program is scheduled for 10/92 .

source_bert_toks: a routine safeguard ##s inspection of iran ' s nuclear program is scheduled for 10 / 92 .

reference_raw: A routine security check on Iran's nuclear programme is scheduled for 10/92.

reference_spacy_tokens: A routine security check on Iran 's nuclear programme is scheduled for 10/92 .


fn_spacy_tokens_for_baseline: The Periplus also describes Zoscales , King of Aksum , as ' a covetous and grasping man but otherwise noble , and imbued with Greek learning ' .

source_bert_toks: the per ##ip ##lus also describes z ##os ##cal ##es , king of ak ##sum , as ' a cove ##tou ##s and grasping man but otherwise noble , and im ##bu ##ed with greek learning ' .

reference_raw: The Periplus also describes Zoscales, King of Aksum, as a greedy and grasping man, but otherwise noble, and imbued with Greek education.

reference_spacy_tokens: The Periplus also describes Zoscales , King of Aksum , as a greedy and grasping man , but otherwise noble , and imbued with Greek education .


fn_spacy_tokens_for_baseline: He yearned for escape to a place and an audience which would appreciate his talents to the full .

source_bert_toks: he year ##ned for escape to a place and an audience which would appreciate his talents to the full .

reference_raw: He wanted to run to a place and an audience that appreciated his talents to the full.

reference_spacy_tokens: He wanted to run to a place and an audience that appreciated his talents to the full .


fn_spacy_tokens_for_baseline: The armed following that accompanied Robert the Frisian on his Jerusalem pilgrimage so impressed the Emperor of Byzantium , Alexius Comnenus , with its martial bearing that he requested similar assistance from the west .

source_bert_toks: the armed following that accompanied robert the fr ##isi ##an on his jerusalem pilgrimage so impressed the emperor of by ##zan ##tium , alex ##ius com ##nen ##us , with its martial bearing that he requested similar assistance from the west .

reference_raw: The armed man who had accompanied Robert the Frisian on his Jerusalem pilgrimage had so impressed the Emperor of Byzantium, Alexius Comnenus, with his military bearings that he had asked for similar help from the West.

reference_spacy_tokens: The armed man who had accompanied Robert the Frisian on his Jerusalem pilgrimage had so impressed the Emperor of Byzantium , Alexius Comnenus , with his military bearings that he had asked for similar help from the West .


fn_spacy_tokens_for_baseline: Their presence also has surprised some of those whose homes they raided , who are shocked to hear Arabic commands coming from under the hoods of men they assumed were Americans .

source_bert_toks: their presence also has surprised some of those whose homes they raided , who are shocked to hear arabic commands coming from under the hood ##s of men they assumed were americans .

reference_raw: Their presence also surprised some of the people whose homes they had raided, who were surprised to hear Arabic commands coming from beneath the hoods of men they had assumed to be Americans.

reference_spacy_tokens: Their presence also surprised some of the people whose homes they had raided , who were surprised to hear Arabic commands coming from beneath the hoods of men they had assumed to be Americans .


fn_spacy_tokens_for_baseline: freezing the long - closed eyelids of Romans .

source_bert_toks: freezing the long - closed eyelids of romans .

reference_raw: freezing the Romans' long-closed lids.

reference_spacy_tokens: freezing the Romans ' long - closed lids .


fn_spacy_tokens_for_baseline: ' You reek of cheap whisky .

source_bert_toks: ' you re ##ek of cheap whisky .

reference_raw: 'You smell like cheap whiskey.

reference_spacy_tokens: ' You smell like cheap whiskey .


fn_spacy_tokens_for_baseline: She could easily recall his smell too , as if he were in her arms at this very moment -- an expensive cologne warmly melded with his very own Mediterranean muskiness .

source_bert_toks: she could easily recall his smell too , as if he were in her arms at this very moment - - an expensive cologne warmly mel ##ded with his very own mediterranean mu ##skin ##ess .

reference_raw: She could easily recollect his scent, as if he were in her arms right now - an expensive cologne warmly fused with his own Mediterranean muskiness.

reference_spacy_tokens: She could easily recollect his scent , as if he were in her arms right now - an expensive cologne warmly fused with his own Mediterranean muskiness .


fn_spacy_tokens_for_baseline: And while this claim has not yet been substantiated by IAEA inspectors , proponents argue that Iran has violated the NPT and that the country 's nuclear file should , in turn , be referred to the United Nations Security Council ( UNSC ) for its review .

source_bert_toks: and while this claim has not yet been sub ##stan ##tia ##ted by ia ##ea inspectors , proponents argue that iran has violated the np ##t and that the country ' s nuclear file should , in turn , be referred to the united nations security council ( un ##sc ) for its review .

reference_raw: Although this claim has not yet been substantiated by IAEA surveyors, the proponents argue that Iran has breached the NPT and that the nuclear file of the country should in turn be referred to the UN Security Council for review.

reference_spacy_tokens: Although this claim has not yet been substantiated by IAEA surveyors , the proponents argue that Iran has breached the NPT and that the nuclear file of the country should in turn be referred to the UN Security Council for review .


fn_spacy_tokens_for_baseline: The movement has admitted responsibility for hundreds of attacks , including a car - bomb explosion that killed 19 civilians in 1983 and a bombing that killed five civilians near Durban last December .

source_bert_toks: the movement has admitted responsibility for hundreds of attacks , including a car - bomb explosion that killed 19 civilians in 1983 and a bombing that killed five civilians near durban last december .

reference_raw: The movement is responsible for hundreds of attacks, including the car bombing that killed 19 civilians in 1983 and the bombing that killed five civilians outside Durban last December.

reference_spacy_tokens: The movement is responsible for hundreds of attacks , including the car bombing that killed 19 civilians in 1983 and the bombing that killed five civilians outside Durban last December .


fn_spacy_tokens_for_baseline: Sudan says it 's ready to sign the international convention banning chemical weapons .

source_bert_toks: sudan says it ' s ready to sign the international convention banning chemical weapons .

reference_raw: Sudan says he's prepared to sign an international convention banning chemical weapons.

reference_spacy_tokens: Sudan says he 's prepared to sign an international convention banning chemical weapons .


fn_spacy_tokens_for_baseline: I have been asked to enquire if we could hold meetings of our national Council at your hotel on a regular basis .

source_bert_toks: i have been asked to en ##qui ##re if we could hold meetings of our national council at your hotel on a regular basis .

reference_raw: I've been asked to ask you if we can arrange a regular session of the National Council at your hotel.

reference_spacy_tokens: I 've been asked to ask you if we can arrange a regular session of the National Council at your hotel .


fn_spacy_tokens_for_baseline: It 's like the time when I nearly drowned in the Mediterranean with you . '

source_bert_toks: it ' s like the time when i nearly drowned in the mediterranean with you . '

reference_raw: It's like when I almost sunk with you in the Mediterranean.'

reference_spacy_tokens: It 's like when I almost sunk with you in the Mediterranean . '


fn_spacy_tokens_for_baseline: Her aimless meandering eventually brought her to the top of Heymouth , directly underneath the towering cliffs .

source_bert_toks: her aim ##less mean ##der ##ing eventually brought her to the top of hey ##mouth , directly underneath the towering cliffs .

reference_raw: In the end, her aimless meaning led her to the top of Heymouth, right under the towering cliffs.

reference_spacy_tokens: In the end , her aimless meaning led her to the top of Heymouth , right under the towering cliffs .


fn_spacy_tokens_for_baseline: Technical Capability : The terrorist groups of greatest concern possess the technical capability and know - how to acquire , produce , and deliver chemical or biological agents , or to recruit scientific experts in these areas .

source_bert_toks: technical capability : the terrorist groups of greatest concern possess the technical capability and know - how to acquire , produce , and deliver chemical or biological agents , or to recruit scientific experts in these areas .

reference_raw: Technical capacity: Terrorist groups of major concern have the technical capacity and know-how to acquire, produce or supply chemical or biological substances or to recruit scientific experts in these fields.

reference_spacy_tokens: Technical capacity : Terrorist groups of major concern have the technical capacity and know - how to acquire , produce or supply chemical or biological substances or to recruit scientific experts in these fields .


fn_spacy_tokens_for_baseline: At first light on Tuesday , 17 January , a wide - awake Warden scanned the flock of white - fronted geese grazing on the banks of the Severn estuary -- and found the exciting stranger in his telescope .

source_bert_toks: at first light on tuesday , 17 january , a wide - awake warden scanned the flock of white - fronted geese grazing on the banks of the severn estuary - - and found the exciting stranger in his telescope .

reference_raw: At first light on Tuesday, January 17, the wide-awaken Warden scanned the herd of white-fronted geese grazing on the shores of the Severn estuary - and found an exciting stranger in his binoculars.

reference_spacy_tokens: At first light on Tuesday , January 17 , the wide - awaken Warden scanned the herd of white - fronted geese grazing on the shores of the Severn estuary - and found an exciting stranger in his binoculars .


fn_spacy_tokens_for_baseline: She rarely wears them : she wears her little locket , superstitiously .

source_bert_toks: she rarely wears them : she wears her little locke ##t , super ##sti ##tious ##ly .

reference_raw: He rarely carries them: he carries his little medallion, superstitiously.

reference_spacy_tokens: He rarely carries them : he carries his little medallion , superstitiously .


fn_spacy_tokens_for_baseline: As 30 firemen fought the flames , one said : ' We fear the worst . '

source_bert_toks: as 30 fire ##men fought the flames , one said : ' we fear the worst . '

reference_raw: When thirty firefighters battled the flames, one of them said, "We're afraid of the worst."

reference_spacy_tokens: When thirty firefighters battled the flames , one of them said , " We 're afraid of the worst . "


fn_spacy_tokens_for_baseline: We have also seen how in earlier times people involved in acts of gross disorder would commonly be charged only with simple assault or drunkenness . street violence was too much of an everyday occurrence to count as ' real ' crime .

source_bert_toks: we have also seen how in earlier times people involved in acts of gross disorder would commonly be charged only with simple assault or drunken ##ness . street violence was too much of an everyday occurrence to count as ' real ' crime .

reference_raw: We've also seen how, in the past, people involved in acts of gross disorder would normally only be accused of simple assault or drunkenness; street violence was too much of a daily occurrence to count as "real" crime.

reference_spacy_tokens: We 've also seen how , in the past , people involved in acts of gross disorder would normally only be accused of simple assault or drunkenness ; street violence was too much of a daily occurrence to count as " real " crime .


fn_spacy_tokens_for_baseline: He crouched there a moment , watching him .

source_bert_toks: he crouched there a moment , watching him .

reference_raw: He squatted there for a moment, looking at him.

reference_spacy_tokens: He squatted there for a moment , looking at him .


fn_spacy_tokens_for_baseline: It is false that Bin Laden was seen in Tora Bora .

source_bert_toks: it is false that bin laden was seen in tor ##a bo ##ra .

reference_raw: It's a lie that Bin Laden was spotted in Tora Bora.

reference_spacy_tokens: It 's a lie that Bin Laden was spotted in Tora Bora .


fn_spacy_tokens_for_baseline: High - handedness and arrogance are their trademarks , as you saw last night at the governor 's palace .

source_bert_toks: high - handed ##ness and arrogance are their trademark ##s , as you saw last night at the governor ' s palace .

reference_raw: Their brands are high-handed and arrogant, as you saw yesterday in the Governor's Palace.

reference_spacy_tokens: Their brands are high - handed and arrogant , as you saw yesterday in the Governor 's Palace .


fn_spacy_tokens_for_baseline: The shelves are full of wonderful food at this time of year and I thought of how I could binge and throw up all day long .

source_bert_toks: the shelves are full of wonderful food at this time of year and i thought of how i could bing ##e and throw up all day long .

reference_raw: The shelves are full of great food at this time of year, and I've been thinking about how I can binge and throw up all day.

reference_spacy_tokens: The shelves are full of great food at this time of year , and I 've been thinking about how I can binge and throw up all day .


fn_spacy_tokens_for_baseline: Nah , the addiction to E 's came a bit later .

source_bert_toks: nah , the addiction to e ' s came a bit later .

reference_raw: No, E's dependency came a little late.

reference_spacy_tokens: No , E 's dependency came a little late .


fn_spacy_tokens_for_baseline: She peered past him .

source_bert_toks: she peered past him .

reference_raw: She looked past him.

reference_spacy_tokens: She looked past him .


fn_spacy_tokens_for_baseline: In her incensed whisper she called me names I did n't understand .

source_bert_toks: in her incense ##d whisper she called me names i didn ' t understand .

reference_raw: In her angry whisper, she called me names I did not understand.

reference_spacy_tokens: In her angry whisper , she called me names I did not understand .


fn_spacy_tokens_for_baseline: It is hardly decent to envy the baby to whom so much is owed .

source_bert_toks: it is hardly decent to envy the baby to whom so much is owed .

reference_raw: It's hardly decent to be jealous of a child that you owe so much.

reference_spacy_tokens: It 's hardly decent to be jealous of a child that you owe so much .


fn_spacy_tokens_for_baseline: I was more surprised than gratified , for without having really considered it I would have expected unsolicited adoration to annoy Nour , to lead to stone - throwing .

source_bert_toks: i was more surprised than gr ##ati ##fied , for without having really considered it i would have expected un ##sol ##ici ##ted ad ##oration to ann ##oy no ##ur , to lead to stone - throwing .

reference_raw: I was more surprised than grateful, for if I didn't really think about it, I'd expect unsolicited admiration to annoy Nour and lead to rock-throwing.

reference_spacy_tokens: I was more surprised than grateful , for if I did n't really think about it , I 'd expect unsolicited admiration to annoy Nour and lead to rock - throwing .


fn_spacy_tokens_for_baseline: A week of national mourning was announced after more than 150 people were killed when a passenger train collided with a goods train near Dolisie on Sept. 6 .

source_bert_toks: a week of national mourning was announced after more than 150 people were killed when a passenger train collided with a goods train near do ##lis ##ie on sept . 6 .

reference_raw: A week of national mourning was announced after more than 150 people were killed when a passenger train crashed into a freight train near Dolisie in September 6.

reference_spacy_tokens: A week of national mourning was announced after more than 150 people were killed when a passenger train crashed into a freight train near Dolisie in September 6 .


fn_spacy_tokens_for_baseline: As the door opened , Alain ushered in a small dark woman , his hand on her shoulder , and Jenna 's expectations collapsed like a deflated balloon .

source_bert_toks: as the door opened , alain ushered in a small dark woman , his hand on her shoulder , and jenna ' s expectations collapsed like a def ##lated balloon .

reference_raw: When the door opened, Alain led the way into a small, dark woman with a hand on her shoulder, and Jenna's hopes collapsed like a deflated balloon.

reference_spacy_tokens: When the door opened , Alain led the way into a small , dark woman with a hand on her shoulder , and Jenna 's hopes collapsed like a deflated balloon .


fn_spacy_tokens_for_baseline: Mitchell trained as a journalist on The Scotsman and worked for the Scottish Tourist Board , Apex Publishing in Oman and British Gas Scotland before setting up Elliot Mitchell Communications , which later merged with Commpress .

source_bert_toks: mitchell trained as a journalist on the scots ##man and worked for the scottish tourist board , apex publishing in oman and british gas scotland before setting up elliot mitchell communications , which later merged with com ##mp ##ress .

reference_raw: Mitchell had been a journalist for the Scotsman and worked for the Scottish Tourist Council, Apex Publishing in Oman and British Gas Scotia, before the creation of Elliot Mitchell Communications, which later merged with the Commpress.

reference_spacy_tokens: Mitchell had been a journalist for the Scotsman and worked for the Scottish Tourist Council , Apex Publishing in Oman and British Gas Scotia , before the creation of Elliot Mitchell Communications , which later merged with the Commpress .


fn_spacy_tokens_for_baseline: There was no manual with the beta version , but the package as a whole is a cinch to use .

source_bert_toks: there was no manual with the beta version , but the package as a whole is a ci ##nch to use .

reference_raw: There was no manual with a beta version, but the package as a whole is a cinch to be used.

reference_spacy_tokens: There was no manual with a beta version , but the package as a whole is a cinch to be used .


fn_spacy_tokens_for_baseline: Bach confessed that he had set off to fight in Iraq but instead came home with orders to help carry out a bombing in Italy , police say .

source_bert_toks: bach confessed that he had set off to fight in iraq but instead came home with orders to help carry out a bombing in italy , police say .

reference_raw: Bach admitted that he was going to fight in Iraq, but instead came home with orders to help carry out the attack in Italy, the police said.

reference_spacy_tokens: Bach admitted that he was going to fight in Iraq , but instead came home with orders to help carry out the attack in Italy , the police said .


fn_spacy_tokens_for_baseline: It is perhaps because they are both unique and at the same time a faithful continuation of ancestral traditions that oriental rugs are objects of allure and fascination for the West .

source_bert_toks: it is perhaps because they are both unique and at the same time a faithful continuation of ancestral traditions that oriental rug ##s are objects of all ##ure and fascination for the west .

reference_raw: Oriental carpets are, perhaps, objects of allure and fascination to the West because they are both unique and a loyal continuation of ancient traditions.

reference_spacy_tokens: Oriental carpets are , perhaps , objects of allure and fascination to the West because they are both unique and a loyal continuation of ancient traditions .


fn_spacy_tokens_for_baseline: Nurses at the infirmary have just been praised by the Audit Commission for their work on discharge planning , and a group of sisters in the orthopaedic unit confirmed that they had long taken this seriously .

source_bert_toks: nurses at the infirmary have just been praised by the audit commission for their work on discharge planning , and a group of sisters in the or ##th ##opa ##ed ##ic unit confirmed that they had long taken this seriously .

reference_raw: The Sisters in the infirmary had just been praised by the Audit Committee for their work on discharge planning, and a group of sisters in the orthopaedic unit had confirmed that they had taken it seriously for a long time.

reference_spacy_tokens: The Sisters in the infirmary had just been praised by the Audit Committee for their work on discharge planning , and a group of sisters in the orthopaedic unit had confirmed that they had taken it seriously for a long time .


fn_spacy_tokens_for_baseline: At the station I pick up my other parcel from Left Luggage , and toss it in a holdall .

source_bert_toks: at the station i pick up my other parcel from left luggage , and toss it in a hold ##all .

reference_raw: At the station, I pick up my next package from Left Luggage and throw it in the stall.

reference_spacy_tokens: At the station , I pick up my next package from Left Luggage and throw it in the stall .


fn_spacy_tokens_for_baseline: Existing industries expanded in leaps and bounds .

source_bert_toks: existing industries expanded in leaps and bounds .

reference_raw: The existing industries have grown in leaps and boundary.

reference_spacy_tokens: The existing industries have grown in leaps and boundary .


fn_spacy_tokens_for_baseline: Some people feel they have lost a space of time and , like other members of the panel , I would be cautious in the use of sedatives in this situation .

source_bert_toks: some people feel they have lost a space of time and , like other members of the panel , i would be cautious in the use of se ##da ##tive ##s in this situation .

reference_raw: Some people think they've lost time, and like other members of the board, I'd be careful to use sedation in this situation.

reference_spacy_tokens: Some people think they 've lost time , and like other members of the board , I 'd be careful to use sedation in this situation .


fn_spacy_tokens_for_baseline: As there was no English headsman capable of wielding a sword for such a purpose , one had been brought over from Calais ( still an English possession ) .

source_bert_toks: as there was no english heads ##man capable of wielding a sword for such a purpose , one had been brought over from calais ( still an english possession ) .

reference_raw: Since no English leader could wield a sword for that purpose, one was brought from Calais (still an English possession).

reference_spacy_tokens: Since no English leader could wield a sword for that purpose , one was brought from Calais ( still an English possession ) .


fn_spacy_tokens_for_baseline: Thankfully , Margi Clarke had evolved from her modest beginnings into a very fine actress indeed .

source_bert_toks: thankfully , mar ##gi clarke had evolved from her modest beginnings into a very fine actress indeed .

reference_raw: Fortunately, Margi Clarke turned out to be a very good actress from her humble beginnings.

reference_spacy_tokens: Fortunately , Margi Clarke turned out to be a very good actress from her humble beginnings .


fn_spacy_tokens_for_baseline: He dances about among the crowd , greeting people here and there by stamping yellow rice marks on their foreheads with the thumb of his other hand .

source_bert_toks: he dances about among the crowd , greeting people here and there by stamp ##ing yellow rice marks on their forehead ##s with the thumb of his other hand .

reference_raw: He strolls around the crowd, greeting people from time to time with the thumb of his other hand, stamping yellow rice marks on their foreheads.

reference_spacy_tokens: He strolls around the crowd , greeting people from time to time with the thumb of his other hand , stamping yellow rice marks on their foreheads .


fn_spacy_tokens_for_baseline: Further along is Jingle Pot , another large crater of no great depth .

source_bert_toks: further along is jingle pot , another large crater of no great depth .

reference_raw: Along the way is Jingle Pot, another big box that doesn't have much depth.

reference_spacy_tokens: Along the way is Jingle Pot , another big box that does n't have much depth .


fn_spacy_tokens_for_baseline: But some arms control specialists worry that the National Biodefense Analysis and Countermeasures Center -- now operating out of borrowed lab space at the Frederick base and elsewhere -- might develop new vaccine - resistant or lethal microbes without solid evidence of a terrorist plot to unleash similar bugs .

source_bert_toks: but some arms control specialists worry that the national bio ##de ##fen ##se analysis and counter ##me ##as ##ures center - - now operating out of borrowed lab space at the frederick base and elsewhere - - might develop new vaccine - resistant or lethal micro ##bes without solid evidence of a terrorist plot to un ##lea ##sh similar bugs .

reference_raw: But some weapons control specialists fear that the National Biodefence Analysis and Countermeasures Center, now operating from borrowed laboratory space at Frederick Base and elsewhere, may develop new vaccines - resistant or lethal microbes without solid proof of a terrorist conspiracy to release such bugs.

reference_spacy_tokens: But some weapons control specialists fear that the National Biodefence Analysis and Countermeasures Center , now operating from borrowed laboratory space at Frederick Base and elsewhere , may develop new vaccines - resistant or lethal microbes without solid proof of a terrorist conspiracy to release such bugs .


fn_spacy_tokens_for_baseline: Pleasant walks here are plentiful , or you can simply sunbathe and admire the views , before making your way back down to the village for a piece of scrumptious gateau in one of the numerous cafes .

source_bert_toks: pleasant walks here are pl ##ent ##iful , or you can simply sun ##bat ##he and admire the views , before making your way back down to the village for a piece of sc ##rum ##pt ##ious gate ##au in one of the numerous cafes .

reference_raw: The pleasant walks here are abundant, or you can simply bathe and admire the views before you make your way back to the village for a piece of scruffy gateau in one of the many coffee shops.

reference_spacy_tokens: The pleasant walks here are abundant , or you can simply bathe and admire the views before you make your way back to the village for a piece of scruffy gateau in one of the many coffee shops .


fn_spacy_tokens_for_baseline: The steady trickle of blood from the corner of his mouth was dripping from his chin onto his coat front .

source_bert_toks: the steady trickle of blood from the corner of his mouth was dripping from his chin onto his coat front .

reference_raw: A steady trickle of blood from the corner of his mouth dripped from his chin to the forefront of his coat.

reference_spacy_tokens: A steady trickle of blood from the corner of his mouth dripped from his chin to the forefront of his coat .


fn_spacy_tokens_for_baseline: Danny R. Dean Director of Development

source_bert_toks: danny r . dean director of development

reference_raw: Danny R. Dean Developer

reference_spacy_tokens: Danny R. Dean Developer


fn_spacy_tokens_for_baseline: Although his support for Darwinism was unusual , his concept of successive waves of migration radiating outwards from a centre of progressive evolution seems to have struck a chord in the minds of his contemporaries .

source_bert_toks: although his support for darwin ##ism was unusual , his concept of successive waves of migration radiating outward ##s from a centre of progressive evolution seems to have struck a chord in the minds of his contemporaries .

reference_raw: Though his support for Darwinism was unusual, his concept of successive waves of migration emanating from the center of progressive evolution seemed to have struck a chord in his contemporary mind.

reference_spacy_tokens: Though his support for Darwinism was unusual , his concept of successive waves of migration emanating from the center of progressive evolution seemed to have struck a chord in his contemporary mind .


fn_spacy_tokens_for_baseline: The President was perturbed at the signs of Russian obduracy over Poland but felt that cooperation with Moscow could be preserved if the correct blend of firmness and concession was applied .

source_bert_toks: the president was per ##tur ##bed at the signs of russian ob ##dur ##acy over poland but felt that cooperation with moscow could be preserved if the correct blend of firm ##ness and concession was applied .

reference_raw: The President was perplexed by the symptoms of Russian obduracy in Poland, but he felt that cooperation with Moscow could be maintained if the right combination of firmness and concessions were to be applied.

reference_spacy_tokens: The President was perplexed by the symptoms of Russian obduracy in Poland , but he felt that cooperation with Moscow could be maintained if the right combination of firmness and concessions were to be applied .


fn_spacy_tokens_for_baseline: The EU has given large subsidies to develop Greece 's infrastructure and grants to excavate and protect its ancient monuments .

source_bert_toks: the eu has given large subsidies to develop greece ' s infrastructure and grants to ex ##ca ##vate and protect its ancient monuments .

reference_raw: The EU has provided substantial subsidies for the development of Greek infrastructure and grants for the excavation and protection of its ancient monuments.

reference_spacy_tokens: The EU has provided substantial subsidies for the development of Greek infrastructure and grants for the excavation and protection of its ancient monuments .


fn_spacy_tokens_for_baseline: A precedent was set in 1337 when the commanders of an army going to Scotland were engaged by contract , but their troops were raised by array .

source_bert_toks: a precedent was set in 133 ##7 when the commanders of an army going to scotland were engaged by contract , but their troops were raised by array .

reference_raw: The precedent was set in 1337, when military leaders going to Scotland were engaged under contract, but their troops were raised in the field.

reference_spacy_tokens: The precedent was set in 1337 , when military leaders going to Scotland were engaged under contract , but their troops were raised in the field .


fn_spacy_tokens_for_baseline: ' Whether to be a very High Church clergyman with a short lacy surplice , or a very Low Church clergyman with long grey moustaches . '

source_bert_toks: ' whether to be a very high church clergyman with a short lacy sur ##pl ##ice , or a very low church clergyman with long grey mo ##ust ##ache ##s . '

reference_raw: "If you're a very high church priest with a short lace surplus, or a very low church priest with a long gray mustache."

reference_spacy_tokens: " If you 're a very high church priest with a short lace surplus , or a very low church priest with a long gray mustache . "


fn_spacy_tokens_for_baseline: Maybe she was being foolish in placing so much importance on those brief few words she- and Billy had exchanged in the park .

source_bert_toks: maybe she was being foolish in placing so much importance on those brief few words she - and billy had exchanged in the park .

reference_raw: Perhaps she had been a fool to put so much importance to the little words she and Billy had exchanged in the park.

reference_spacy_tokens: Perhaps she had been a fool to put so much importance to the little words she and Billy had exchanged in the park .


fn_spacy_tokens_for_baseline: He is so anxious about being accepted that he is trying to be extra good and even perfect . '

source_bert_toks: he is so anxious about being accepted that he is trying to be extra good and even perfect . '

reference_raw: He's so eager to be accepted that he's trying to be extra good and even perfect.'

reference_spacy_tokens: He 's so eager to be accepted that he 's trying to be extra good and even perfect . '


fn_spacy_tokens_for_baseline: Caroline had no choice but to trot alongside as he strode towards an arched doorway .

source_bert_toks: caroline had no choice but to tr ##ot alongside as he strode towards an arched doorway .

reference_raw: Caroline had no choice but to run beside him as he walked toward the arched door.

reference_spacy_tokens: Caroline had no choice but to run beside him as he walked toward the arched door .


fn_spacy_tokens_for_baseline: The lieutenant crushed it angrily with his boot before looking back at Hencke .

source_bert_toks: the lieutenant crushed it angrily with his boot before looking back at hen ##cke .

reference_raw: The lieutenant grazed him with his boot before he looked back at Hencke.

reference_spacy_tokens: The lieutenant grazed him with his boot before he looked back at Hencke .


fn_spacy_tokens_for_baseline: ' Not so fast , ' she cried as they thundered along Rodney Street .

source_bert_toks: ' not so fast , ' she cried as they thunder ##ed along rodney street .

reference_raw: "Not so fast," she shouted as they roared along Rodney Street.

reference_spacy_tokens: " Not so fast , " she shouted as they roared along Rodney Street .


fn_spacy_tokens_for_baseline: The first , a 8,000 hectare blaze near Blackheath , which has been burning for nine days broke containment lines at 11 PM AEDT on Monday .

source_bert_toks: the first , a 8 , 000 hectare blaze near black ##hea ##th , which has been burning for nine days broke containment lines at 11 pm ae ##dt on monday .

reference_raw: The first was a fire of 8,000 hectares near Blackheath, which had been burning for a nine-day period, breaking the containment line at 11:00 AEDT on Monday.

reference_spacy_tokens: The first was a fire of 8,000 hectares near Blackheath , which had been burning for a nine - day period , breaking the containment line at 11:00 AEDT on Monday .


fn_spacy_tokens_for_baseline: ' There , now -- that should fill the bellies of those young fellows , ' he remarked with satisfaction .

source_bert_toks: ' there , now - - that should fill the bell ##ies of those young fellows , ' he remarked with satisfaction .

reference_raw: 'Here - that should fill the young men's stomachs,' he said with satisfaction.

reference_spacy_tokens: ' Here - that should fill the young men 's stomachs , ' he said with satisfaction .


fn_spacy_tokens_for_baseline: The chilling thought struck Sabine to the bone .

source_bert_toks: the chilling thought struck sabine to the bone .

reference_raw: The cold thought struck Sabine in the bone.

reference_spacy_tokens: The cold thought struck Sabine in the bone .


fn_spacy_tokens_for_baseline: These changes are a response to the wishes of subscribers , as expressed in readership surveys , and of the editorial staff , as expressed in repeated cries of woe .

source_bert_toks: these changes are a response to the wishes of subscribers , as expressed in readers ##hip surveys , and of the editorial staff , as expressed in repeated cries of wo ##e .

reference_raw: These changes respond to the wishes of the subscribers expressed in the readership survey and the editorial staff expressed in repeated mourning.

reference_spacy_tokens: These changes respond to the wishes of the subscribers expressed in the readership survey and the editorial staff expressed in repeated mourning .


fn_spacy_tokens_for_baseline: This hypothesis has yielded contradictory results .

source_bert_toks: this hypothesis has yielded contradictory results .

reference_raw: This hypothesis has led to contradictory results.

reference_spacy_tokens: This hypothesis has led to contradictory results .


fn_spacy_tokens_for_baseline: I am a country living junkie and my appetite for magazines devoted to country life is insatiable .

source_bert_toks: i am a country living junk ##ie and my appetite for magazines devoted to country life is ins ##ati ##able .

reference_raw: I'm a country addict, and my appetite for magazines dedicated to country life is insatiable.

reference_spacy_tokens: I 'm a country addict , and my appetite for magazines dedicated to country life is insatiable .


fn_spacy_tokens_for_baseline: They 'd struck on the very first day .

source_bert_toks: they ' d struck on the very first day .

reference_raw: They hit the first day.

reference_spacy_tokens: They hit the first day .


fn_spacy_tokens_for_baseline: Slice fungi and fry down with the butter and onions until all the liquid has evaporated .

source_bert_toks: slice fungi and fry down with the butter and onions until all the liquid has eva ##por ##ated .

reference_raw: Slice mushrooms and fry down with butter and onions until all the liquid is gone.

reference_spacy_tokens: Slice mushrooms and fry down with butter and onions until all the liquid is gone .


fn_spacy_tokens_for_baseline: Marion whispered and turned away because she could n't bear to be there when something died , when all the love that she had bottled up inside herself evaporated like liquid left out in the sun .

source_bert_toks: marion whispered and turned away because she couldn ' t bear to be there when something died , when all the love that she had bottled up inside herself eva ##por ##ated like liquid left out in the sun .

reference_raw: Marion murmured and turned away, for she could not bear to be there when something died, when all the love she had bottled inside her vanished like liquid left out in the sun.

reference_spacy_tokens: Marion murmured and turned away , for she could not bear to be there when something died , when all the love she had bottled inside her vanished like liquid left out in the sun .


fn_spacy_tokens_for_baseline: As discussed earlier ( p. 31 ) , it is likely that unemployment can contribute to attempted suicide by precipitating or exacerbating domestic , social , and financial problems .

source_bert_toks: as discussed earlier ( p . 31 ) , it is likely that unemployment can contribute to attempted suicide by pre ##ci ##pit ##ating or ex ##ace ##rba ##ting domestic , social , and financial problems .

reference_raw: As discussed above (p. 31), unemployment is likely to contribute to suicidal attempts by accelerating or exacerbating domestic, social and financial problems.

reference_spacy_tokens: As discussed above ( p. 31 ) , unemployment is likely to contribute to suicidal attempts by accelerating or exacerbating domestic , social and financial problems .


fn_spacy_tokens_for_baseline: A constable was shot dead yesterday in Alexandra , a Johannesburg township , bringing to 42 the total of SAP men assassinated on active duty so far this year .

source_bert_toks: a constable was shot dead yesterday in alexandra , a johannesburg township , bringing to 42 the total of sap men assassinated on active duty so far this year .

reference_raw: Yesterday, a constable was shot dead in Alexandra, a township in Johannesburg, bringing 42 SAP men killed on active duty this year.

reference_spacy_tokens: Yesterday , a constable was shot dead in Alexandra , a township in Johannesburg , bringing 42 SAP men killed on active duty this year .


fn_spacy_tokens_for_baseline: Whether I 'd stuck to my guns or not , it had been a harrowing experience and I felt abused .

source_bert_toks: whether i ' d stuck to my guns or not , it had been a harrow ##ing experience and i felt abused .

reference_raw: Whether I clung to my weapons or not, it was a difficult experience, and I felt abused.

reference_spacy_tokens: Whether I clung to my weapons or not , it was a difficult experience , and I felt abused .


fn_spacy_tokens_for_baseline: Ordering coffee she then pointed to my pullover and shook her finger .

source_bert_toks: ordering coffee she then pointed to my pull ##over and shook her finger .

reference_raw: She ordered a cup of coffee, then gestured to me and shook a finger.

reference_spacy_tokens: She ordered a cup of coffee , then gestured to me and shook a finger .


fn_spacy_tokens_for_baseline: Asked why the shows were not coming to Washington D.C. , New York , Chicago or Los Angeles , Mr Hoving said : ' Oh , they 'll grumble something about scheduling or funding .

source_bert_toks: asked why the shows were not coming to washington d . c . , new york , chicago or los angeles , mr ho ##ving said : ' oh , they ' ll gr ##umble something about scheduling or funding .

reference_raw: When Mr. Hoving asked why the show didn't come to Washington D.C., New York, Chicago, or Los Angeles, he said, "Oh, they're going to complain about planning or financing.

reference_spacy_tokens: When Mr. Hoving asked why the show did n't come to Washington D.C. , New York , Chicago , or Los Angeles , he said , " Oh , they 're going to complain about planning or financing .


fn_spacy_tokens_for_baseline: Though living chiefly in England , Morris was proud to be Welsh , admiring the Welsh character and abhorring the English class system .

source_bert_toks: though living chiefly in england , morris was proud to be welsh , admiring the welsh character and ab ##hor ##ring the english class system .

reference_raw: Although he lived mainly in England, Morris was proud to be a Welsh, admired the Welsh character and hated the English class system.

reference_spacy_tokens: Although he lived mainly in England , Morris was proud to be a Welsh , admired the Welsh character and hated the English class system .


fn_spacy_tokens_for_baseline: Peter Fonda and Dennis Hopper were to co - star and Nicholson wrote a part in it for himself but Corman refused to cast him and Bruce Dern played the role instead .

source_bert_toks: peter fond ##a and dennis hopper were to co - star and nicholson wrote a part in it for himself but co ##rman refused to cast him and bruce der ##n played the role instead .

reference_raw: Peter Fonda and Dennis Hopper were going to be the star, and Nicholson had written a role for himself, but Corman had refused to cast it, and Bruce Dern had played the role instead.

reference_spacy_tokens: Peter Fonda and Dennis Hopper were going to be the star , and Nicholson had written a role for himself , but Corman had refused to cast it , and Bruce Dern had played the role instead .


fn_spacy_tokens_for_baseline: The nearby Falkland hills are delightful and not too strenuous .

source_bert_toks: the nearby falkland hills are delightful and not too st ##ren ##uous .

reference_raw: The nearby hills of Falkland are adorable and not too strenuous.

reference_spacy_tokens: The nearby hills of Falkland are adorable and not too strenuous .


fn_spacy_tokens_for_baseline: ' I can sympathize . '

source_bert_toks: ' i can sy ##mp ##athi ##ze . '

reference_raw: "I understand."

reference_spacy_tokens: " I understand . "


fn_spacy_tokens_for_baseline: The public rebuke of Sununu was also widely interpreted as a deliberate attempt to undercut some of the authority of his powerful Chief of Staff .

source_bert_toks: the public re ##bu ##ke of sun ##un ##u was also widely interpreted as a deliberate attempt to under ##cut some of the authority of his powerful chief of staff .

reference_raw: The public accusation of Sununu was also widely interpreted as a deliberate attempt to undermine some of the authority of his powerful chief of staff.

reference_spacy_tokens: The public accusation of Sununu was also widely interpreted as a deliberate attempt to undermine some of the authority of his powerful chief of staff .


fn_spacy_tokens_for_baseline: He looked dismayed , as if the word conjured up a vision of a formal enquiry , with everyone being grilled about their movements and the happy atmosphere of his beloved school fouled by dark suspicions .

source_bert_toks: he looked dismay ##ed , as if the word con ##jured up a vision of a formal en ##qui ##ry , with everyone being grille ##d about their movements and the happy atmosphere of his beloved school foul ##ed by dark suspicions .

reference_raw: He looked dismayed, as if the word had conjured up a vision of a formal inquiry, and everyone had been barbecued about their movements and the happy atmosphere of his beloved school, fouled with dark suspicions.

reference_spacy_tokens: He looked dismayed , as if the word had conjured up a vision of a formal inquiry , and everyone had been barbecued about their movements and the happy atmosphere of his beloved school , fouled with dark suspicions .


fn_spacy_tokens_for_baseline: The significance for human living is that meaning is given to our lives through object relations .

source_bert_toks: the significance for human living is that meaning is given to our lives through object relations .

reference_raw: The meaning of human life is that our lives are given meaning through object relationships.

reference_spacy_tokens: The meaning of human life is that our lives are given meaning through object relationships .


fn_spacy_tokens_for_baseline: Marines continue to be ferried on patrol or into battle in open - air vehicles with little more than thin steel plating welded to the sides and instructions to keep their heads low .

source_bert_toks: marines continue to be fe ##rrie ##d on patrol or into battle in open - air vehicles with little more than thin steel pl ##ating welded to the sides and instructions to keep their heads low .

reference_raw: Marines continue to be ferried on watch or into battle in open-air vehicles with little more than a thin steel plate welded to the sides and instructions to keep their heads down.

reference_spacy_tokens: Marines continue to be ferried on watch or into battle in open - air vehicles with little more than a thin steel plate welded to the sides and instructions to keep their heads down .


fn_spacy_tokens_for_baseline: Meciar ally elected as Slovak president

source_bert_toks: me ##cia ##r ally elected as slovak president

reference_raw: The Meciar Ally elected as the Slovak Chairman


fn_spacy_tokens_for_baseline: Against rigorism , is the sense that it is rather absurd to lump all who are not utilitarian saints with actual wrongdoers .

source_bert_toks: against rig ##oris ##m , is the sense that it is rather absurd to lump all who are not ut ##ili ##tarian saints with actual wrong ##do ##ers .

reference_raw: In the face of rigorism, it is rather preposterous to confuse those who are not utilitarian saints with true wrongdoers.

reference_spacy_tokens: In the face of rigorism , it is rather preposterous to confuse those who are not utilitarian saints with true wrongdoers .


fn_spacy_tokens_for_baseline: Ratagan cocked his head to listen to the race of the wind outside that creaked the rafters .

source_bert_toks: rat ##aga ##n cocked his head to listen to the race of the wind outside that creaked the raft ##ers .

reference_raw: Ratagan cocked his head to listen to the winds outside, squealing the rafters.

reference_spacy_tokens: Ratagan cocked his head to listen to the winds outside , squealing the rafters .


fn_spacy_tokens_for_baseline: He adjusted his spectacles with the forefinger of his right hand before continuing .

source_bert_toks: he adjusted his spectacle ##s with the fore ##finger of his right hand before continuing .

reference_raw: Before continuing, he adjusted his glasses with the index finger of his right hand.

reference_spacy_tokens: Before continuing , he adjusted his glasses with the index finger of his right hand .


fn_spacy_tokens_for_baseline: Fags make you smell like ash - trays , play havoc with yer tongues .

source_bert_toks: fa ##gs make you smell like ash - tray ##s , play havoc with yer tongues .

reference_raw: The fags make you stink like ash-trays, play havoc with your tongues.

reference_spacy_tokens: The fags make you stink like ash - trays , play havoc with your tongues .


fn_spacy_tokens_for_baseline: where l(n ) is the the length of the utterance covered by the current hypothesis , L(n ) is the length of the remainder of the hypothesis , and d(n ) is the shortfall score divided by l(n ) .

source_bert_toks: where l ( n ) is the the length of the utter ##ance covered by the current hypothesis , l ( n ) is the length of the remainder of the hypothesis , and d ( n ) is the short ##fall score divided by l ( n ) .

reference_raw: if l(n) is the duration of the speech covered by the current hypothesis, L(n) is the duration of the rest of the hypothesis, and d(n) is the deficit score divided by l(n).

reference_spacy_tokens: if l(n ) is the duration of the speech covered by the current hypothesis , L(n ) is the duration of the rest of the hypothesis , and d(n ) is the deficit score divided by l(n ) .