fn_spacy_tokens_for_baseline: Leslie O'Neal sacked Evans for a seven - yard loss , Junior Seau stuffed Harvey Williams for a four - yard loss and then harassed Evans into underthrowing Daryl Hobbs on third - and-21 from the Raider 14 .

source_bert_toks: leslie o ' neal sacked evans for a seven - yard loss , junior sea ##u stuffed harvey williams for a four - yard loss and then harassed evans into under ##th ##row ##ing daryl hobbs on third - and - 21 from the raider 14 .

reference_raw: Leslie O'Neal sacked Evans for a seven-yard loss, Junior Seau stuffed Harvey Williams for a four-yard loss, and then molested Evans to overthrow Daryl Hobbs on the third and 21th of Raider 14.

reference_spacy_tokens: Leslie O'Neal sacked Evans for a seven - yard loss , Junior Seau stuffed Harvey Williams for a four - yard loss , and then molested Evans to overthrow Daryl Hobbs on the third and 21th of Raider 14 .


fn_spacy_tokens_for_baseline: The student may therefore be held responsible , but not accountable , for her actions , until she becomes sufficiently knowledgeable and experienced , and hence qualified .

source_bert_toks: the student may therefore be held responsible , but not accountable , for her actions , until she becomes sufficiently knowledge ##able and experienced , and hence qualified .

reference_raw: Thus, a student can be held accountable, but not accountable, for her actions until she has become sufficiently experienced and experienced and therefore qualified.

reference_spacy_tokens: Thus , a student can be held accountable , but not accountable , for her actions until she has become sufficiently experienced and experienced and therefore qualified .


fn_spacy_tokens_for_baseline: The first function might look something like this :

source_bert_toks: the first function might look something like this :

reference_raw: The first feature could look something like this:

reference_spacy_tokens: The first feature could look something like this :


fn_spacy_tokens_for_baseline: Farther away is Coloane , connected to Taipa by a causeway and a large land reclamation project .

source_bert_toks: farther away is col ##oa ##ne , connected to tai ##pa by a causeway and a large land reclamation project .

reference_raw: In the distance is Coloane, linked to Taipa by a causeway and a major land reconstruction project.

reference_spacy_tokens: In the distance is Coloane , linked to Taipa by a causeway and a major land reconstruction project .


fn_spacy_tokens_for_baseline: She stood up to get her little - black hat , perched it on the side of her sleek fair head and skewered a pearl - tipped hatpin through the felt .

source_bert_toks: she stood up to get her little - black hat , perched it on the side of her sleek fair head and sk ##ew ##ered a pearl - tipped hat ##pin through the felt .

reference_raw: She got to her feet for a small black hat, put it on the side of her smooth blond head, and slipped a pearl-tipped hat through her felt.

reference_spacy_tokens: She got to her feet for a small black hat , put it on the side of her smooth blond head , and slipped a pearl - tipped hat through her felt .


fn_spacy_tokens_for_baseline: Is not it disgraceful that the Government are destroying living standards , yet they claim to believe in human values ?

source_bert_toks: is not it disgrace ##ful that the government are destroying living standards , yet they claim to believe in human values ?

reference_raw: Is it not shameful that the government destroys living standards, but claims to believe in human values?

reference_spacy_tokens: Is it not shameful that the government destroys living standards , but claims to believe in human values ?


fn_spacy_tokens_for_baseline: The mastheads of beached yachts tinkled in a stiff breeze .

source_bert_toks: the mast ##heads of beach ##ed yacht ##s tin ##kled in a stiff breeze .

reference_raw: The mastheads of the beached yachts shimmered in the stiff breeze.

reference_spacy_tokens: The mastheads of the beached yachts shimmered in the stiff breeze .


fn_spacy_tokens_for_baseline: The Concise Oxford Dictionary gives two definitions for each ( Table 1 ) .

source_bert_toks: the con ##cise oxford dictionary gives two definitions for each ( table 1 ) .

reference_raw: The concise Oxford Dictionary provides two delineations for each of them (Table 1).

reference_spacy_tokens: The concise Oxford Dictionary provides two delineations for each of them ( Table 1 ) .


fn_spacy_tokens_for_baseline: In battle scenes the villainous attackers move in from the right and the valiant defenders , usually the good guys obstinately rejecting defeat , are on the left .

source_bert_toks: in battle scenes the villain ##ous attackers move in from the right and the valiant defenders , usually the good guys ob ##sti ##nate ##ly rejecting defeat , are on the left .

reference_raw: In battle scenes, the bad guys move in from the right, and the brave defenders, usually the good ones stubbornly reject defeat, are on the left.

reference_spacy_tokens: In battle scenes , the bad guys move in from the right , and the brave defenders , usually the good ones stubbornly reject defeat , are on the left .


fn_spacy_tokens_for_baseline: The hydrides , particularly those of non - metals , tend to have trivial names ( see table 4.8 )

source_bert_toks: the h ##yd ##ride ##s , particularly those of non - metals , tend to have trivial names ( see table 4 . 8 )

reference_raw: Hydrides, especially non-metals, tend to have minor names (see Table 4.8).

reference_spacy_tokens: Hydrides , especially non - metals , tend to have minor names ( see Table 4.8 ) .


fn_spacy_tokens_for_baseline: The New Statesman Society was concerned about the ' relative leniency of the GMC 's disciplinary action . '

source_bert_toks: the new statesman society was concerned about the ' relative len ##ien ##cy of the gm ##c ' s disciplinary action . '

reference_raw: The new statesman society was concerned about "relative leniency in the discipline of the GMC."

reference_spacy_tokens: The new statesman society was concerned about " relative leniency in the discipline of the GMC . "


fn_spacy_tokens_for_baseline: A month or so before this was due to be delivered , however , a curt memorandum arrived from the Energy Department warning the group that it ' should resist getting drawn into the fray ' .

source_bert_toks: a month or so before this was due to be delivered , however , a curt memorandum arrived from the energy department warning the group that it ' should resist getting drawn into the fray ' .

reference_raw: About a month before it was due to be delivered, however, a brief message from the Ministry of Energy came to warn the group that it should "resist from being dragged into the fray."

reference_spacy_tokens: About a month before it was due to be delivered , however , a brief message from the Ministry of Energy came to warn the group that it should " resist from being dragged into the fray . "


fn_spacy_tokens_for_baseline: So I thought I 'd spend tomorrow at home clearing up and reading the newspapers and engaging in some spiritually uplifting reading .

source_bert_toks: so i thought i ' d spend tomorrow at home clearing up and reading the newspapers and engaging in some spiritual ##ly up ##lifting reading .

reference_raw: So I thought I'd spend the morning at home cleaning up and reading the papers and engaging in some spiritually refreshing reading.

reference_spacy_tokens: So I thought I 'd spend the morning at home cleaning up and reading the papers and engaging in some spiritually refreshing reading .


fn_spacy_tokens_for_baseline: Some sting , some bite , some throw poisonous hairs at you and others squirt you with blinding sprays .

source_bert_toks: some sting , some bite , some throw poisonous hairs at you and others sq ##ui ##rt you with blinding spray ##s .

reference_raw: A little biting, a little biting, some throwing poisonous hair at you, others spraying you with blinding sprays.

reference_spacy_tokens: A little biting , a little biting , some throwing poisonous hair at you , others spraying you with blinding sprays .


fn_spacy_tokens_for_baseline: Quantity and quality of missiles and missile - related technology acquired , size and experience of the indigenous missile - related manpower pool .

source_bert_toks: quantity and quality of missiles and missile - related technology acquired , size and experience of the indigenous missile - related manpower pool .

reference_raw: Quantity and quality of rockets and rockets - related technologies acquired, size and expertise of domestic missiles - related human resources pool.

reference_spacy_tokens: Quantity and quality of rockets and rockets - related technologies acquired , size and expertise of domestic missiles - related human resources pool .


fn_spacy_tokens_for_baseline: I am sure that you are aware of all these suspicions that surround the regime 's [ Religious ] scholars .

source_bert_toks: i am sure that you are aware of all these suspicions that surround the regime ' s [ religious ] scholars .

reference_raw: I'm sure you're aware of all the suspicions surrounding the government's [religious] scholars.

reference_spacy_tokens: I 'm sure you 're aware of all the suspicions surrounding the government 's [ religious ] scholars .


fn_spacy_tokens_for_baseline: You may not be thirsty , but your body needs to rehydrate as soon as possible .

source_bert_toks: you may not be thirsty , but your body needs to re ##hy ##dra ##te as soon as possible .

reference_raw: You may not have thirst, but your body should be rehydrated as soon as possible.

reference_spacy_tokens: You may not have thirst , but your body should be rehydrated as soon as possible .


fn_spacy_tokens_for_baseline: An Amnesty International report , published in February , documented torture of Tibetan men as well as women .

source_bert_toks: an amnesty international report , published in february , documented torture of tibetan men as well as women .

reference_raw: The Amnesty International Report, published in February, illustrated the torture of Tibetan men and women.

reference_spacy_tokens: The Amnesty International Report , published in February , illustrated the torture of Tibetan men and women .


fn_spacy_tokens_for_baseline: Hurworth House school is staging a production of the 1920s comic murder mystery The Ghost Train later this week .

source_bert_toks: hu ##r ##worth house school is staging a production of the 1920s comic murder mystery the ghost train later this week .

reference_raw: Hurworth House School is staging the 1920s comic-murder puzzle of the Ghost Train later this week.

reference_spacy_tokens: Hurworth House School is staging the 1920s comic - murder puzzle of the Ghost Train later this week .


fn_spacy_tokens_for_baseline: That has meant sleeping in bus stations and caves , bumping in lorries across the Kalahari desert , crowded for days onto the trans - Siberian railway , and sheltering in a mud hut from a rainstorm in Ethiopia .

source_bert_toks: that has meant sleeping in bus stations and caves , bump ##ing in lo ##rries across the kala ##hari desert , crowded for days onto the trans - siberian railway , and shelter ##ing in a mud hut from a rains ##torm in ethiopia .

reference_raw: This meant sleeping in bus stops and caves, bumping into trucks across the Kalahari Desert, crowding for days on the trans-Siberian railroad, and hiding in a mud hut from a storm in Ethiopia.

reference_spacy_tokens: This meant sleeping in bus stops and caves , bumping into trucks across the Kalahari Desert , crowding for days on the trans - Siberian railroad , and hiding in a mud hut from a storm in Ethiopia .


fn_spacy_tokens_for_baseline: Cardigan Bay , once famed for its dolphins , is now polluted with raw sewage and animal wastes .

source_bert_toks: card ##igan bay , once famed for its dolphins , is now poll ##uted with raw sewage and animal waste ##s .

reference_raw: The Gulf of Cardigan, once famous for its dolphins, is now polluted with crude sewage and animal waste.

reference_spacy_tokens: The Gulf of Cardigan , once famous for its dolphins , is now polluted with crude sewage and animal waste .


fn_spacy_tokens_for_baseline: Barefoot and in a panic , she missed the bottom step of the wrought - iron spiral staircase , stubbing her toe and grazing her right shin .

source_bert_toks: barefoot and in a panic , she missed the bottom step of the wrought - iron spiral staircase , stu ##bbing her toe and grazing her right shin .

reference_raw: Barefoot and panicked, she missed the bottom step of the wrought-iron spiral staircase, stabbed her toe, and grazed her right shin.

reference_spacy_tokens: Barefoot and panicked , she missed the bottom step of the wrought - iron spiral staircase , stabbed her toe , and grazed her right shin .


fn_spacy_tokens_for_baseline: The growing competition in rail transport resulted in Union Pacific buying the Los Angeles - Salt Lake line .

source_bert_toks: the growing competition in rail transport resulted in union pacific buying the los angeles - salt lake line .

reference_raw: The increasing competition in the railway sector has led the Union Pacific to purchase the L.A. - Salt Lake line.

reference_spacy_tokens: The increasing competition in the railway sector has led the Union Pacific to purchase the L.A. - Salt Lake line .


fn_spacy_tokens_for_baseline: He cut and chopped and she felt herself detached from the rotten wood .

source_bert_toks: he cut and chopped and she felt herself detached from the rotten wood .

reference_raw: He cut and sliced, and she felt herself disconnected from the rotting wood.

reference_spacy_tokens: He cut and sliced , and she felt herself disconnected from the rotting wood .


fn_spacy_tokens_for_baseline: I was accused of assault and inciting a riot .

source_bert_toks: i was accused of assault and inc ##iting a riot .

reference_raw: I've been charged with assault and rioting.

reference_spacy_tokens: I 've been charged with assault and rioting .


fn_spacy_tokens_for_baseline: He would be told to take down his trousers and underpants and would be whipped by his foster father , he alleged .

source_bert_toks: he would be told to take down his trousers and under ##pants and would be whipped by his foster father , he alleged .

reference_raw: They'll tell him to take off his pants and underpants, and his stepfather's gonna beat him up, he said.

reference_spacy_tokens: They 'll tell him to take off his pants and underpants , and his stepfather 's gon na beat him up , he said .


fn_spacy_tokens_for_baseline: How can he reconcile his selective greenness with a recent speech to the construction industry condemning conservationists as ' the rich socialists who live in their converted farmhouses ' ?

source_bert_toks: how can he reconcile his selective green ##ness with a recent speech to the construction industry condemning conservation ##ists as ' the rich socialists who live in their converted farmhouse ##s ' ?

reference_raw: How can he reconcile his selective greenness with the recent speech of the construction industry that condemns the protectors as "rich socialists living in their converted farms"?

reference_spacy_tokens: How can he reconcile his selective greenness with the recent speech of the construction industry that condemns the protectors as " rich socialists living in their converted farms " ?


fn_spacy_tokens_for_baseline: It 's too heavy for her to carry , so she pulls it to pieces with her beak , holding it tightly in her talons .

source_bert_toks: it ' s too heavy for her to carry , so she pulls it to pieces with her beak , holding it tightly in her talon ##s .

reference_raw: It's too heavy for her to carry, so she pulls it apart with her beak and holds it tightly in her claws.

reference_spacy_tokens: It 's too heavy for her to carry , so she pulls it apart with her beak and holds it tightly in her claws .


fn_spacy_tokens_for_baseline: Grasslands provide more scope for combining conservation and good livestock husbandry .

source_bert_toks: grasslands provide more scope for combining conservation and good livestock husband ##ry .

reference_raw: The pastures provide more room for a combination of conservation and good livestock farming.

reference_spacy_tokens: The pastures provide more room for a combination of conservation and good livestock farming .


fn_spacy_tokens_for_baseline: Nevertheless it had been at Bray 's Buildings , stench or no stench , squeals of slaughtered beasts or no squeals , that one of the most fascinating of Benjamin 's children had entered the world .

source_bert_toks: nevertheless it had been at bray ' s buildings , stench or no stench , sq ##ue ##als of slaughtered beasts or no sq ##ue ##als , that one of the most fascinating of benjamin ' s children had entered the world .

reference_raw: However, one of the most fascinating of Benjamin's children came into the world, in Bray's Buildings, smellless or smellless, the screams of slaughtered animals or no screams.

reference_spacy_tokens: However , one of the most fascinating of Benjamin 's children came into the world , in Bray 's Buildings , smellless or smellless , the screams of slaughtered animals or no screams .


fn_spacy_tokens_for_baseline: Hundreds of Muslims have recently protested the alleged imprisonment by priests of two Christian women who converted to Islam .

source_bert_toks: hundreds of muslims have recently protested the alleged imprisonment by priests of two christian women who converted to islam .

reference_raw: Hundreds of Muslims recently objected to the supposed imprisonment of the priests of two Christian women who turned into Islam.

reference_spacy_tokens: Hundreds of Muslims recently objected to the supposed imprisonment of the priests of two Christian women who turned into Islam .


fn_spacy_tokens_for_baseline: It irked them unbearably to let something slip through their fingers .

source_bert_toks: it ir ##ked them un ##be ##ara ##bly to let something slip through their fingers .

reference_raw: It irritated them to let something slip through their fingers.

reference_spacy_tokens: It irritated them to let something slip through their fingers .


fn_spacy_tokens_for_baseline: The Baronne 's gathering frown dispersed almost magically as she espied a flat be - ribboned box on the tray .

source_bert_toks: the baron ##ne ' s gathering frown dispersed almost magical ##ly as she es ##pie ##d a flat be - ribbon ##ed box on the tray .

reference_raw: The Baronne's gathering scowl faded almost magically as she spied a flat, be-ribboned box on the tray.

reference_spacy_tokens: The Baronne 's gathering scowl faded almost magically as she spied a flat , be - ribboned box on the tray .


fn_spacy_tokens_for_baseline: Our reception is most gratifying - for it is enthusiastic and really kind in the highest degree .

source_bert_toks: our reception is most gr ##ati ##fying - for it is enthusiastic and really kind in the highest degree .

reference_raw: Our reception is very satisfying - because he's excited and very kind at the highest level.

reference_spacy_tokens: Our reception is very satisfying - because he 's excited and very kind at the highest level .


fn_spacy_tokens_for_baseline: On Good Friday 1919 , Jack test flew the modified Vimy , carrying 865 gallons of petrol and 50 gallons of oil -- a four ton weight in all !

source_bert_toks: on good friday 1919 , jack test flew the modified vi ##my , carrying 86 ##5 gallons of petrol and 50 gallons of oil - - a four ton weight in all !

reference_raw: On Good Friday, 1919, Jack's test had flown a modified Vimy with 865 litres of gasoline and 50 litres of oil - a total of four tons!

reference_spacy_tokens: On Good Friday , 1919 , Jack 's test had flown a modified Vimy with 865 litres of gasoline and 50 litres of oil - a total of four tons !


fn_spacy_tokens_for_baseline: We camped on an island of palm trees .

source_bert_toks: we camped on an island of palm trees .

reference_raw: We were encamped on an island of palm trees.

reference_spacy_tokens: We were encamped on an island of palm trees .


fn_spacy_tokens_for_baseline: It is your perplexity that is odd , not your spirit - person . '

source_bert_toks: it is your per ##plex ##ity that is odd , not your spirit - person . '

reference_raw: It's your confusion that's strange, not your ghost.'

reference_spacy_tokens: It 's your confusion that 's strange , not your ghost . '


fn_spacy_tokens_for_baseline: If the cost of a practical system was the abandonment of the guiding principle of the law of trusts , so be it .

source_bert_toks: if the cost of a practical system was the abandonment of the guiding principle of the law of trusts , so be it .

reference_raw: If the cost of a practical system is to abandon the fundamental principle of trust law, so be it.

reference_spacy_tokens: If the cost of a practical system is to abandon the fundamental principle of trust law , so be it .


fn_spacy_tokens_for_baseline: The black - haired man slid the door shut but refrained from padlocking it .

source_bert_toks: the black - haired man slid the door shut but refrain ##ed from pad ##lock ##ing it .

reference_raw: The dark-haired man closed the door, but did not padlock it.

reference_spacy_tokens: The dark - haired man closed the door , but did not padlock it .


fn_spacy_tokens_for_baseline: I 've already had a couple of spats with them and they would n't pass up an opportunity like this to poke fun .

source_bert_toks: i ' ve already had a couple of spat ##s with them and they wouldn ' t pass up an opportunity like this to poke fun .

reference_raw: I've had a few spits with them before, and they wouldn't miss an opportunity like this to have fun.

reference_spacy_tokens: I 've had a few spits with them before , and they would n't miss an opportunity like this to have fun .


fn_spacy_tokens_for_baseline: Last night , Horsewell 's distraught girlfriend cancelled their church wedding .

source_bert_toks: last night , horse ##well ' s distraught girlfriend cancelled their church wedding .

reference_raw: Last night, Horsewell's upset girlfriend canceled their church marriage.

reference_spacy_tokens: Last night , Horsewell 's upset girlfriend canceled their church marriage .


fn_spacy_tokens_for_baseline: The man was having a family gathering when the masked raiders , armed with a pistol and a knife , barged into his home in Knowle , Bristol .

source_bert_toks: the man was having a family gathering when the masked raiders , armed with a pistol and a knife , barge ##d into his home in know ##le , bristol .

reference_raw: The man had a family meeting when disguised raiders, armed with a gun and a knife, barged into his house in Knowle, Bristol.

reference_spacy_tokens: The man had a family meeting when disguised raiders , armed with a gun and a knife , barged into his house in Knowle , Bristol .


fn_spacy_tokens_for_baseline: At Monterrey , publisher Luis Gabriel Cano , although shaken by the murders , issued a statement saying : " We will not cease our fight against drug trafficking .

source_bert_toks: at monterrey , publisher luis gabriel can ##o , although shaken by the murders , issued a statement saying : " we will not cease our fight against drug trafficking .

reference_raw: In Monterrey, publisher Luis Gabriel Cano, though shaken by the killings, issued a statement saying, "We will not stop fighting drug trafficking.

reference_spacy_tokens: In Monterrey , publisher Luis Gabriel Cano , though shaken by the killings , issued a statement saying , " We will not stop fighting drug trafficking .


fn_spacy_tokens_for_baseline: ' What 's the rush ? ' a harried clerk had asked when Caroline had tried to talk her way into being permitted to enter a summer class that was already under way .

source_bert_toks: ' what ' s the rush ? ' a ha ##rrie ##d clerk had asked when caroline had tried to talk her way into being permitted to enter a summer class that was already under way .

reference_raw: "What's the hurry?" the hairy clerk asked as Caroline tried to convince herself to go to a summer class that was already underway.

reference_spacy_tokens: " What 's the hurry ? " the hairy clerk asked as Caroline tried to convince herself to go to a summer class that was already underway .


fn_spacy_tokens_for_baseline: The ICRC estimated that in the town of Iscia Baidoa , 220 km north - west of Mogadishu , 7,000 of the town 's 40,000 people had died from starvation in recent months .

source_bert_toks: the ic ##rc estimated that in the town of is ##cia bai ##do ##a , 220 km north - west of mo ##ga ##dis ##hu , 7 , 000 of the town ' s 40 , 000 people had died from starvation in recent months .

reference_raw: The ICRC estimated that 7,000 of the city's 40,000 people died of hunger in recent months in the city of Iscia Baidoa, 220 km northwest of Mogadishu.

reference_spacy_tokens: The ICRC estimated that 7,000 of the city 's 40,000 people died of hunger in recent months in the city of Iscia Baidoa , 220 km northwest of Mogadishu .


fn_spacy_tokens_for_baseline: Now , everyone confronts the same challenge , and Mr Lang is looking for consensus .

source_bert_toks: now , everyone confronts the same challenge , and mr lang is looking for consensus .

reference_raw: We're all facing the same challenge, and Mr. Lang is looking for a consensus.

reference_spacy_tokens: We 're all facing the same challenge , and Mr. Lang is looking for a consensus .


fn_spacy_tokens_for_baseline: For the purposes of this tutorial , however , the term " terrorism " will be used to describe acts that incorporate the following elements : Intentional or threatened violence directed against civilians or noncombatants ; Actors that are sub - national groups or individuals ( although they may receive financial or logistical support from governments ) ; Motivations that are chiefly political , ideological , or religious ( i.e. , not strictly criminal ) ; Often , some element of symbolism in the choice of target , together with the desire to elicit fear in a larger audience beyond the immediate victims of an attack .

source_bert_toks: for the purposes of this tutor ##ial , however , the term " terrorism " will be used to describe acts that incorporate the following elements : intentional or threatened violence directed against civilians or non ##comb ##ata ##nts ; actors that are sub - national groups or individuals ( although they may receive financial or logistical support from governments ) ; motivation ##s that are chiefly political , ideological , or religious ( i . e . , not strictly criminal ) ; often , some element of symbolism in the choice of target , together with the desire to eli ##cit fear in a larger audience beyond the immediate victims of an attack .

reference_raw: However, for the purposes of this tutorial, the term "terrorism" shall be used to describe acts containing the following elements: intentional or threatened violence against civilians or non-combatants; activities which are sub-national groups or individuals (although they may receive financial or logistical support from governments); motivations which are mainly political, ideological or religious (i.e. not strictly criminal); some element of symbolism in the choice of destination, along with the desire to elicit fear in a larger audience beyond the immediate casualties of the attack.

reference_spacy_tokens: However , for the purposes of this tutorial , the term " terrorism " shall be used to describe acts containing the following elements : intentional or threatened violence against civilians or non - combatants ; activities which are sub - national groups or individuals ( although they may receive financial or logistical support from governments ) ; motivations which are mainly political , ideological or religious ( i.e. not strictly criminal ) ; some element of symbolism in the choice of destination , along with the desire to elicit fear in a larger audience beyond the immediate casualties of the attack .


fn_spacy_tokens_for_baseline: Am I to stick in my flat like bait -- the tethered goat waiting for the tiger to pounce ?

source_bert_toks: am i to stick in my flat like bait - - the te ##ther ##ed goat waiting for the tiger to po ##unce ?

reference_raw: I'm supposed to stay in my apartment like a decoy - a tied goat waiting for a tiger to pounce?

reference_spacy_tokens: I 'm supposed to stay in my apartment like a decoy - a tied goat waiting for a tiger to pounce ?


fn_spacy_tokens_for_baseline: The boy naturalist Charles Darwin could have shown him a thing or two about that , but Hume had been dead 40 years when Darwin enrolled in Hume 's university of Edinburgh .

source_bert_toks: the boy naturalist charles darwin could have shown him a thing or two about that , but hume had been dead 40 years when darwin enrolled in hume ' s university of edinburgh .

reference_raw: Charles Darwin, the boy's naturalist, might have shown him something about it, but Hume was dead forty years when Darwin signed up at the University of Hume in Edinburgh.

reference_spacy_tokens: Charles Darwin , the boy 's naturalist , might have shown him something about it , but Hume was dead forty years when Darwin signed up at the University of Hume in Edinburgh .


fn_spacy_tokens_for_baseline: Keith pulled a face at her and tugged his hair despairingly .

source_bert_toks: keith pulled a face at her and tugged his hair despair ##ingly .

reference_raw: Keith pulled his face at her and pulled desperately at his hair.

reference_spacy_tokens: Keith pulled his face at her and pulled desperately at his hair .


fn_spacy_tokens_for_baseline: The bruising was not contiguous to the incision .

source_bert_toks: the br ##uising was not contiguous to the inc ##ision .

reference_raw: The bruises didn't match the cut.

reference_spacy_tokens: The bruises did n't match the cut .


fn_spacy_tokens_for_baseline: The night outside was drizzling with rain , and everyone except himself hurried for a cab ; the flower - sellers were disconsolate .

source_bert_toks: the night outside was dr ##iz ##z ##ling with rain , and everyone except himself hurried for a cab ; the flower - sellers were disco ##ns ##olate .

reference_raw: The night outside was drizzling with rain, and everyone but him hurried to the cab; the flower-sellers were dissatisfied.

reference_spacy_tokens: The night outside was drizzling with rain , and everyone but him hurried to the cab ; the flower - sellers were dissatisfied .


fn_spacy_tokens_for_baseline: One of them - Splendid China - purports to show " all of China in one day . "

source_bert_toks: one of them - splendid china - pu ##rp ##ort ##s to show " all of china in one day . "

reference_raw: One of them - the Great China - is supposed to show "all of China in one night."

reference_spacy_tokens: One of them - the Great China - is supposed to show " all of China in one night . "


fn_spacy_tokens_for_baseline: They were led by Gerald Greenwald , a former Chrysler vice - chairman who quit to take part in an abortive , union - backed buy - out of United Airlines .

source_bert_toks: they were led by gerald green ##wald , a former chrysler vice - chairman who quit to take part in an ab ##ort ##ive , union - backed buy - out of united airlines .

reference_raw: They were led by Gerald Greenwald, a former Vice-President of Chrysler, who stopped to participate in an abortive, union-backed buy-out of United Airlines.

reference_spacy_tokens: They were led by Gerald Greenwald , a former Vice - President of Chrysler , who stopped to participate in an abortive , union - backed buy - out of United Airlines .


fn_spacy_tokens_for_baseline: In Iraq , some interpreters said , soldiers mocked their Arabic surnames and accused them of being ' on the wrong side ' of the conflict .

source_bert_toks: in iraq , some interpreter ##s said , soldiers mocked their arabic surname ##s and accused them of being ' on the wrong side ' of the conflict .

reference_raw: In Iraq, some interpreters said, soldiers laughed at their Arabic surnames and accused them of being on the wrong side of the conflict.

reference_spacy_tokens: In Iraq , some interpreters said , soldiers laughed at their Arabic surnames and accused them of being on the wrong side of the conflict .


fn_spacy_tokens_for_baseline: On the positive side , most say the acting is great , and though the film " does n't take enormous chances , " it is nevertheless " extremely satisfying " ( Denby , The New Yorker ) . Slate 's Edelstein is more positive than most , praising the " deliciously resonant dual setting : a Catskills summer community to which middle - class Jews from the city migrate to swim and eat and play mah - jongg , and the gathering hippies at nearby Woodstock . "

source_bert_toks: on the positive side , most say the acting is great , and though the film " doesn ' t take enormous chances , " it is nevertheless " extremely satisfying " ( den ##by , the new yorker ) . slate ' s ed ##els ##tein is more positive than most , praising the " delicious ##ly res ##ona ##nt dual setting : a cats ##kill ##s summer community to which middle - class jews from the city migrate to swim and eat and play ma ##h - jong ##g , and the gathering hip ##pies at nearby woodstock . "

reference_raw: On the other hand, most people say that the act is great, and although the movie "does not take a great risk, "it is nevertheless very satisfying (Denby, New Yorker). Slate's Edelstein is more positive than most, and praises the "deliciously resonant double setting: the Catskills summer community, where middle-class Jews from the city migrate to swim and eat and eat. Mah-Jongg, and a bunch of hippies in nearby Woodstock.

reference_spacy_tokens: On the other hand , most people say that the act is great , and although the movie " does not take a great risk , " it is nevertheless very satisfying ( Denby , New Yorker ) . Slate 's Edelstein is more positive than most , and praises the " deliciously resonant double setting : the Catskills summer community , where middle - class Jews from the city migrate to swim and eat and eat . Mah - Jongg , and a bunch of hippies in nearby Woodstock .


fn_spacy_tokens_for_baseline: Presently , Natural is partially compliant with X / Open Group Co Ltd 's XA transaction processing interface , but the firm is working on that standard now .

source_bert_toks: presently , natural is partially compliant with x / open group co ltd ' s x ##a transaction processing interface , but the firm is working on that standard now .

reference_raw: Currently, Natural is partly in line with the XA transaction processing interface of X/Open Group Co Ltd, but the company is currently working on this standard.

reference_spacy_tokens: Currently , Natural is partly in line with the XA transaction processing interface of X / Open Group Co Ltd , but the company is currently working on this standard .


fn_spacy_tokens_for_baseline: There was a succession of right - wing attempts to govern and Spain floundered in a sea of political strikes and violence .

source_bert_toks: there was a succession of right - wing attempts to govern and spain fl ##ound ##ered in a sea of political strikes and violence .

reference_raw: There was a series of right-wing attempts to rule, and Spain floundered in a sea of political attacks and violence.

reference_spacy_tokens: There was a series of right - wing attempts to rule , and Spain floundered in a sea of political attacks and violence .


fn_spacy_tokens_for_baseline: Rerpf ducked , allowing a troll behind him to raise its huge iron crossbow and fire a spear - length quarrel into the nearest assassin .

source_bert_toks: re ##rp ##f ducked , allowing a troll behind him to raise its huge iron crossbow and fire a spear - length quarrel into the nearest assassin .

reference_raw: Rerpf ducked, allowing the troll behind him to lift his huge iron bow and fire a spear-length arrow at the nearest assassin.

reference_spacy_tokens: Rerpf ducked , allowing the troll behind him to lift his huge iron bow and fire a spear - length arrow at the nearest assassin .


fn_spacy_tokens_for_baseline: To my amazement , they were burning brightly as the rain fell and water dripped from the ash trees .

source_bert_toks: to my amazement , they were burning brightly as the rain fell and water dripped from the ash trees .

reference_raw: To my surprise, they burned brightly as the rain fell and the water poured from the ash trees.

reference_spacy_tokens: To my surprise , they burned brightly as the rain fell and the water poured from the ash trees .


fn_spacy_tokens_for_baseline: The students at Cuddesdon still found him very odd , and very unpractical , and very absent - minded , and much given to muttering to himself .

source_bert_toks: the students at cu ##dd ##es ##don still found him very odd , and very un ##pr ##actic ##al , and very absent - minded , and much given to muttering to himself .

reference_raw: Students in Cuddesdon still found him very strange, very unprofessional, and very distracted, and much given to muttering to himself.

reference_spacy_tokens: Students in Cuddesdon still found him very strange , very unprofessional , and very distracted , and much given to muttering to himself .


fn_spacy_tokens_for_baseline: Saddam Hussein 's actions are a response to Third World powerlessness -- and one we should expect to see more of .

source_bert_toks: saddam hussein ' s actions are a response to third world powerless ##ness - - and one we should expect to see more of .

reference_raw: The actions of Saddam Hussein are a reaction to the helplessness of the Third World - and one we should expect to see more.

reference_spacy_tokens: The actions of Saddam Hussein are a reaction to the helplessness of the Third World - and one we should expect to see more .


fn_spacy_tokens_for_baseline: In other words we are not talking about subtle errors of judgement , but major fumbles , demonstrations of serious incompetence .

source_bert_toks: in other words we are not talking about subtle errors of judgement , but major fumble ##s , demonstrations of serious inc ##omp ##ete ##nce .

reference_raw: In other words, we're not talking about subtle errors in judgment, we're talking about serious failures, we're talking about serious incompetence.

reference_spacy_tokens: In other words , we 're not talking about subtle errors in judgment , we 're talking about serious failures , we 're talking about serious incompetence .


fn_spacy_tokens_for_baseline: At least 151 people have died in bombings since last Tuesday , when a suicide attacker struck a crowd of police recruits in Tikrit , killing 60 people .

source_bert_toks: at least 151 people have died in bombings since last tuesday , when a suicide attacker struck a crowd of police recruits in ti ##kr ##it , killing 60 people .

reference_raw: Since last Tuesday, when a suicide bomber hit a bunch of police recruits in Tikrit and killed 60 people, at least 151 people have died in bombings.

reference_spacy_tokens: Since last Tuesday , when a suicide bomber hit a bunch of police recruits in Tikrit and killed 60 people , at least 151 people have died in bombings .


fn_spacy_tokens_for_baseline: Free access to holy sites for members of all religions was guaranteed by the armistice agreements .

source_bert_toks: free access to holy sites for members of all religions was guaranteed by the armistice agreements .

reference_raw: Free access to sacred sites for members of all religions was guaranteed by the cease-fire arrangements.

reference_spacy_tokens: Free access to sacred sites for members of all religions was guaranteed by the cease - fire arrangements .


fn_spacy_tokens_for_baseline: The IMF is considering lending Russia $ 4 .

source_bert_toks: the im ##f is considering lending russia $ 4 .

reference_raw: The IMF is considering borrowing $4 from Russia.

reference_spacy_tokens: The IMF is considering borrowing $ 4 from Russia .


fn_spacy_tokens_for_baseline: He professes to be an atheist but met his wife at the Youth Fellowship at a church in Edinburgh .

source_bert_toks: he prof ##esses to be an atheist but met his wife at the youth fellowship at a church in edinburgh .

reference_raw: He says he's an atheist, but he met his wife at a youth college in a church in Edinburgh.

reference_spacy_tokens: He says he 's an atheist , but he met his wife at a youth college in a church in Edinburgh .


fn_spacy_tokens_for_baseline: Thus , they exclude a range of offences , such as shoplifting and stealing from work , where the non - reporting is particula rly high .

source_bert_toks: thus , they exclude a range of offences , such as shop ##lifting and stealing from work , where the non - reporting is part ##ic ##ula r ##ly high .

reference_raw: They therefore exclude a number of offences, such as theft and theft of work, where non-reporting is a particula rly high.

reference_spacy_tokens: They therefore exclude a number of offences , such as theft and theft of work , where non - reporting is a particula rly high .


fn_spacy_tokens_for_baseline: He and Tundrish , d'Arquebus , Akbar , and the Sergeant hunched by the base of a stubby vitreous tower .

source_bert_toks: he and tun ##dr ##ish , d ' ar ##que ##bus , akbar , and the sergeant hunched by the base of a stu ##bby vi ##tre ##ous tower .

reference_raw: He and Tundrish, d'Arquebus, Akbar, and the sergeant crouched at the base of the stubby tower.

reference_spacy_tokens: He and Tundrish , d'Arquebus , Akbar , and the sergeant crouched at the base of the stubby tower .


fn_spacy_tokens_for_baseline: Rachel and Chas sprawled in undignified positions on the floor ..

source_bert_toks: rachel and cha ##s sprawled in und ##ign ##ified positions on the floor . .

reference_raw: Rachel and Chas lay on the floor in undignified positions . . .


fn_spacy_tokens_for_baseline: And , when we were driving back towards the tunnel , do you know Upper Parliament Street ?

source_bert_toks: and , when we were driving back towards the tunnel , do you know upper parliament street ?

reference_raw: And you know Upper Parliament Street when we went back to the tube?

reference_spacy_tokens: And you know Upper Parliament Street when we went back to the tube ?


fn_spacy_tokens_for_baseline: Those years were the high points of the Stalinist repression in Hungary .

source_bert_toks: those years were the high points of the stalin ##ist repression in hungary .

reference_raw: These years were the peaks of the Stalinist repression in Hungary.

reference_spacy_tokens: These years were the peaks of the Stalinist repression in Hungary .


fn_spacy_tokens_for_baseline: ' I have an arrangement with Jenkins whereby I consume copious quantities of tonic water , lemon and ice .

source_bert_toks: ' i have an arrangement with jenkins whereby i consume cop ##ious quantities of tonic water , lemon and ice .

reference_raw: I've got a deal with Jenkins that I use a lot of tonic water, lemon and ice.

reference_spacy_tokens: I 've got a deal with Jenkins that I use a lot of tonic water , lemon and ice .


fn_spacy_tokens_for_baseline: ' Do off his helmet , quickly , ' said Hotspur , tearing off his gauntlets and himself stooping to fumble at the mail gorget , ' he 's breathing blood ! '

source_bert_toks: ' do off his helmet , quickly , ' said hotspur , tearing off his gaunt ##lets and himself st ##ooping to fumble at the mail gorge ##t , ' he ' s breathing blood ! '

reference_raw: 'Get off his helmet, quickly,' said Hotspur, tearing off his gloves, and he bent down to fumble over the mail gorge, 'he's breathing blood!'

reference_spacy_tokens: ' Get off his helmet , quickly , ' said Hotspur , tearing off his gloves , and he bent down to fumble over the mail gorge , ' he 's breathing blood ! '


fn_spacy_tokens_for_baseline: Before Lachlan could free it Hector had tripped him and soused him , for the cold water to bring him to his senses .

source_bert_toks: before lac ##hl ##an could free it hector had tripped him and sous ##ed him , for the cold water to bring him to his senses .

reference_raw: Before Lachlan could free him, Hector tripped him and soaked him, so that the cold water would bring him to his senses.

reference_spacy_tokens: Before Lachlan could free him , Hector tripped him and soaked him , so that the cold water would bring him to his senses .


fn_spacy_tokens_for_baseline: Drumheller told the Post he was surprised when a few days later , on February 5 , 2003 , Powell told the U.N. Security Council that " we have first - hand descriptions of biological weapons factories on wheels and rails . "

source_bert_toks: drum ##hell ##er told the post he was surprised when a few days later , on february 5 , 2003 , powell told the u . n . security council that " we have first - hand descriptions of biological weapons factories on wheels and rails . "

reference_raw: Drumheller said to the Post that he was surprised when a few days later, on February 5, 2003, Powell said to the UN Security Council, "We have a first-hand description of the bioweapons plants on wheels and rails."

reference_spacy_tokens: Drumheller said to the Post that he was surprised when a few days later , on February 5 , 2003 , Powell said to the UN Security Council , " We have a first - hand description of the bioweapons plants on wheels and rails . "


fn_spacy_tokens_for_baseline: After a week of fevered speculation , John Major , Britain 's prime minister , shuffled his cabinet .

source_bert_toks: after a week of fever ##ed speculation , john major , britain ' s prime minister , shuffled his cabinet .

reference_raw: After a week of feverish speculation, John Major, the British Premier, shuffled his cabinet.

reference_spacy_tokens: After a week of feverish speculation , John Major , the British Premier , shuffled his cabinet .


fn_spacy_tokens_for_baseline: She said yesterday that the three - bedroom property was capable of sleeping five people comfortably .

source_bert_toks: she said yesterday that the three - bedroom property was capable of sleeping five people comfortably .

reference_raw: Yesterday she said that the three-bedroom property was capable of comfortably asleep five people.

reference_spacy_tokens: Yesterday she said that the three - bedroom property was capable of comfortably asleep five people .


fn_spacy_tokens_for_baseline: Or anything he has not been able to hush up .

source_bert_toks: or anything he has not been able to hush up .

reference_raw: Or something he couldn't shut up.

reference_spacy_tokens: Or something he could n't shut up .


fn_spacy_tokens_for_baseline: These structures are found in the hop - growing areas of Kent and East Sussex , where they are called oast - houses , and the westernmost part of Surrey , Herefordshire and West Worcestershire .

source_bert_toks: these structures are found in the hop - growing areas of kent and east sussex , where they are called o ##ast - houses , and the western ##most part of surrey , hereford ##shire and west worcestershire .

reference_raw: These structures are located in the hop-growing areas of Kent and East Sussex, which are called oast-houses, and in the west of Surrey, Herefordshire and West Worcestershire.

reference_spacy_tokens: These structures are located in the hop - growing areas of Kent and East Sussex , which are called oast - houses , and in the west of Surrey , Herefordshire and West Worcestershire .


fn_spacy_tokens_for_baseline: The striking nameplates affixed to 6165 commemorated those GC employees who died in the Great War .

source_bert_toks: the striking name ##plate ##s af ##fixed to 61 ##65 commemorated those g ##c employees who died in the great war .

reference_raw: The striking nameplates attached to 6165 commemorate the GC employees who died in the Great War.

reference_spacy_tokens: The striking nameplates attached to 6165 commemorate the GC employees who died in the Great War .


fn_spacy_tokens_for_baseline: A score out of 10 is given for each set , the score being tallied as user progresses .

source_bert_toks: a score out of 10 is given for each set , the score being tall ##ied as user progresses .

reference_raw: For each set, a score of 10 is given, and the score is taller as the user advances.

reference_spacy_tokens: For each set , a score of 10 is given , and the score is taller as the user advances .


fn_spacy_tokens_for_baseline: ' I would wish that your deportment on a horse could be more that of a lady and less that of a farm waggoner , ' she remarked spitefully .

source_bert_toks: ' i would wish that your de ##port ##ment on a horse could be more that of a lady and less that of a farm wa ##gg ##one ##r , ' she remarked spite ##fully .

reference_raw: "I'd like you to deport yourself on horseback to be more like a lady and less like a farmer's waggoner," she said gruffly.

reference_spacy_tokens: " I 'd like you to deport yourself on horseback to be more like a lady and less like a farmer 's waggoner , " she said gruffly .


fn_spacy_tokens_for_baseline: This means " tracking , " whose main purpose is less to permit the gifted youngsters to flourish ( though that is clearly desirable ) than to ensure that the less gifted get the necessary grounding for further study or for entering the modern world of work .

source_bert_toks: this means " tracking , " whose main purpose is less to permit the gifted young ##sters to flourish ( though that is clearly desirable ) than to ensure that the less gifted get the necessary ground ##ing for further study or for entering the modern world of work .

reference_raw: This means "tracking", the main purpose of which is less to allow gifted young people to flourish (although this is clearly appropriate) than to ensure that the less gifted have the necessary grounds for further study or entry into the modern world of work.

reference_spacy_tokens: This means " tracking " , the main purpose of which is less to allow gifted young people to flourish ( although this is clearly appropriate ) than to ensure that the less gifted have the necessary grounds for further study or entry into the modern world of work .


fn_spacy_tokens_for_baseline: No sound , except the lazy drone of the cicadas in the trees .

source_bert_toks: no sound , except the lazy drone of the ci ##ca ##das in the trees .

reference_raw: There was no sound, except the lazy sound of cicadas in the trees.

reference_spacy_tokens: There was no sound , except the lazy sound of cicadas in the trees .


fn_spacy_tokens_for_baseline: She peered beneath her hand at Sybil , then jumped as an impatient hoot sounded behind them .

source_bert_toks: she peered beneath her hand at sy ##bil , then jumped as an impatient ho ##ot sounded behind them .

reference_raw: She looked under her arm at Sybil, then leapt to her feet as there was an impatient sound behind them.

reference_spacy_tokens: She looked under her arm at Sybil , then leapt to her feet as there was an impatient sound behind them .


fn_spacy_tokens_for_baseline: He was dressed in a Victorian morning suit , high starched collar , watered - silk cravat .

source_bert_toks: he was dressed in a victorian morning suit , high star ##ched collar , watered - silk cr ##ava ##t .

reference_raw: He was dressed in a Victorian morning suit, a high starched collar, and a water-silk collar.

reference_spacy_tokens: He was dressed in a Victorian morning suit , a high starched collar , and a water - silk collar .


fn_spacy_tokens_for_baseline: At times in the past there must have been tenderness between the members of this family ; the old lady had conceived and given birth to two children , nursed them and watched them grow into adult life .

source_bert_toks: at times in the past there must have been tenderness between the members of this family ; the old lady had conceived and given birth to two children , nurse ##d them and watched them grow into adult life .

reference_raw: There must have been some tenderness in the past between the family members; the old woman had conceived and delivered two children, nursed them, and watched them grow into adult life.

reference_spacy_tokens: There must have been some tenderness in the past between the family members ; the old woman had conceived and delivered two children , nursed them , and watched them grow into adult life .


fn_spacy_tokens_for_baseline: The value placed on individuals of whatever rank , evinced by the rows of photographs of people who had worked there for forty years , must make for happiness in the workplace .

source_bert_toks: the value placed on individuals of whatever rank , ev ##in ##ced by the rows of photographs of people who had worked there for forty years , must make for happiness in the workplace .

reference_raw: The value placed on individuals of any rank, escalated by a series of photographs of people who had worked there for forty years, must be good luck in the workplace.

reference_spacy_tokens: The value placed on individuals of any rank , escalated by a series of photographs of people who had worked there for forty years , must be good luck in the workplace .


fn_spacy_tokens_for_baseline: Lady Walters , looking very pretty in a pale blue sequinned satin dress was the very able Chairman of this year 's ball .

source_bert_toks: lady walters , looking very pretty in a pale blue se ##quin ##ned satin dress was the very able chairman of this year ' s ball .

reference_raw: Lady Walters, who looked very pretty in her pale blue satin dress, was the most capable president of this year's prom.

reference_spacy_tokens: Lady Walters , who looked very pretty in her pale blue satin dress , was the most capable president of this year 's prom .


fn_spacy_tokens_for_baseline: The missionaries struggled valiantly against the dictates of the desert , trying simultaneously to survive the harshness of their circumstances and spread the Mormon faith .

source_bert_toks: the missionaries struggled valiant ##ly against the di ##cta ##tes of the desert , trying simultaneously to survive the harsh ##ness of their circumstances and spread the mormon faith .

reference_raw: The missionaries fought valiantly against the dictates of the desert, trying at the same time to survive the harshness of their circumstances and spread the Mormon faith.

reference_spacy_tokens: The missionaries fought valiantly against the dictates of the desert , trying at the same time to survive the harshness of their circumstances and spread the Mormon faith .


fn_spacy_tokens_for_baseline: 4- Inside parking lot should be strictly designated to the location 's cars in order to protect them from sabotage .

source_bert_toks: 4 - inside parking lot should be strictly designated to the location ' s cars in order to protect them from sabotage .

reference_raw: 4-Indoor parking should be strictly reserved for local vehicles in order to protect them from sabotage.

reference_spacy_tokens: 4-Indoor parking should be strictly reserved for local vehicles in order to protect them from sabotage .


fn_spacy_tokens_for_baseline: With the economy moving out of recession we expect to see fewer clients cutting back and this should help reduce our terminations .

source_bert_toks: with the economy moving out of recession we expect to see fewer clients cutting back and this should help reduce our termination ##s .

reference_raw: With the economy moving away from recession, we expect fewer clients to cut back, which should help reduce the number of exits.

reference_spacy_tokens: With the economy moving away from recession , we expect fewer clients to cut back , which should help reduce the number of exits .


fn_spacy_tokens_for_baseline: Whether your hair is naturally curly or permed it needs extra special care to keep it in tip - top condition .

source_bert_toks: whether your hair is naturally curly or per ##med it needs extra special care to keep it in tip - top condition .

reference_raw: Whether your hair is naturally curly or permeated, you need special care to keep it in tip-to-top condition.

reference_spacy_tokens: Whether your hair is naturally curly or permeated , you need special care to keep it in tip - to - top condition .


fn_spacy_tokens_for_baseline: The next morning Benjamin shook me awake .

source_bert_toks: the next morning benjamin shook me awake .

reference_raw: Benjamin woke me up the next morning.

reference_spacy_tokens: Benjamin woke me up the next morning .


fn_spacy_tokens_for_baseline: Soon he would n't be wanting a live - in housekeeper .

source_bert_toks: soon he wouldn ' t be wanting a live - in housekeeper .

reference_raw: Soon he won't be looking for a living housekeeper.

reference_spacy_tokens: Soon he wo n't be looking for a living housekeeper .


fn_spacy_tokens_for_baseline: But even if magnetic fields could confine the wind , the hot gas pressure would be expected to build until it was episodically released as in a pressure cooker .

source_bert_toks: but even if magnetic fields could con ##fine the wind , the hot gas pressure would be expected to build until it was ep ##iso ##dic ##ally released as in a pressure cooke ##r .

reference_raw: But even if magnetic fields can limit the wind, the pressure of the hot gas is expected to increase until it is episodically released, like the pressure cooker.

reference_spacy_tokens: But even if magnetic fields can limit the wind , the pressure of the hot gas is expected to increase until it is episodically released , like the pressure cooker .


fn_spacy_tokens_for_baseline: I said , hunching up as small as I could .

source_bert_toks: i said , hu ##nch ##ing up as small as i could .

reference_raw: I said, I crouched as little as I could.

reference_spacy_tokens: I said , I crouched as little as I could .


fn_spacy_tokens_for_baseline: She gave that infectious gurgle of laughter , and his eyes warmed .

source_bert_toks: she gave that infectious gu ##rg ##le of laughter , and his eyes warmed .

reference_raw: She gave the infectious gurgle of laughter, and his eyes were hot.

reference_spacy_tokens: She gave the infectious gurgle of laughter , and his eyes were hot .


fn_spacy_tokens_for_baseline: Accordingly , the five bodies are baptized with the names of famous Blues songs : ' Dippermouth ' , ' Gut Bucket ' , ' Potato Head ' , ' Tin Roof ' , and ' Really ' .

source_bert_toks: accordingly , the five bodies are baptized with the names of famous blues songs : ' dip ##per ##mouth ' , ' gut bucket ' , ' potato head ' , ' tin roof ' , and ' really ' .

reference_raw: The five bodies are therefore christened by the names of the famous Blues songs: Dippermouth , Gut Bucket , Potato Head , Tin Roof , and Real.

reference_spacy_tokens: The five bodies are therefore christened by the names of the famous Blues songs : Dippermouth , Gut Bucket , Potato Head , Tin Roof , and Real .


fn_spacy_tokens_for_baseline: It showed how categorisation by discipline installations , painting , photography and so on can still work effectively as a way of organising an exhibition .

source_bert_toks: it showed how cat ##ego ##ris ##ation by discipline installations , painting , photography and so on can still work effectively as a way of organising an exhibition .

reference_raw: It has shown how the classification of discipline equipment, painting, photography, etc. can still work effectively as a way of organising the exhibition.

reference_spacy_tokens: It has shown how the classification of discipline equipment , painting , photography , etc . can still work effectively as a way of organising the exhibition .


fn_spacy_tokens_for_baseline: ' What enchants you in particular ? ' he wanted to know as he downed some of his coffee .

source_bert_toks: ' what en ##chan ##ts you in particular ? ' he wanted to know as he downed some of his coffee .

reference_raw: "What's your special charm?" he asked, lowering a cup of coffee.

reference_spacy_tokens: " What 's your special charm ? " he asked , lowering a cup of coffee .


fn_spacy_tokens_for_baseline: As she stepped , slivers of glass cracked and crunched beneath her feet .

source_bert_toks: as she stepped , sl ##iver ##s of glass cracked and crunch ##ed beneath her feet .

reference_raw: Slivers of glass cracked and crackled under her feet as she stepped.

reference_spacy_tokens: Slivers of glass cracked and crackled under her feet as she stepped .


fn_spacy_tokens_for_baseline: Nelson was obviously some years younger than herself , a fact that , given her new get - up , was probably not at all obvious to him .

source_bert_toks: nelson was obviously some years younger than herself , a fact that , given her new get - up , was probably not at all obvious to him .

reference_raw: Nelson was obviously a few years younger than she was, a fact that, given her new rise, he probably wasn't quite sure.

reference_spacy_tokens: Nelson was obviously a few years younger than she was , a fact that , given her new rise , he probably was n't quite sure .


fn_spacy_tokens_for_baseline: In 1844 , American explorer John C. Fremont parked his horses at Big Springs , and his report to the government resulted in a mail route leading past the spot on its way to California .

source_bert_toks: in 1844 , american explorer john c . fremont parked his horses at big springs , and his report to the government resulted in a mail route leading past the spot on its way to california .

reference_raw: In 1844, American explorer John C. Fremont parked his horse in Big Springs, and his report to the government led to a mail route that ran past the place on its way to California.

reference_spacy_tokens: In 1844 , American explorer John C. Fremont parked his horse in Big Springs , and his report to the government led to a mail route that ran past the place on its way to California .


fn_spacy_tokens_for_baseline: Then , obeying an impulse she barely understood , she took the silver medallion out of the inner pocket of her bag , where she 'd zipped it for safekeeping , and fastened the chain round her neck .

source_bert_toks: then , obey ##ing an impulse she barely understood , she took the silver medallion out of the inner pocket of her bag , where she ' d zip ##ped it for safe ##keeping , and fastened the chain round her neck .

reference_raw: Then, following an impulse she could barely understand, she took a silver medallion from the inside pocket of her bag, where she had turned it on to keep it safe, and fastened the chain around her neck.

reference_spacy_tokens: Then , following an impulse she could barely understand , she took a silver medallion from the inside pocket of her bag , where she had turned it on to keep it safe , and fastened the chain around her neck .


fn_spacy_tokens_for_baseline: Reports say the leader , pudgy at the time of his arrest , has gotten thinner in jail .

source_bert_toks: reports say the leader , pu ##d ##gy at the time of his arrest , has gotten thinner in jail .

reference_raw: According to the reports, the leader, puggy at the time of his arrest, got thinner in prison.

reference_spacy_tokens: According to the reports , the leader , puggy at the time of his arrest , got thinner in prison .


fn_spacy_tokens_for_baseline: The one exception to this recent trend was the defeat of 13 of the 52 freshman Republicans brought into office in 1980 by the Reagan revolution and running for re - election in 1982 .

source_bert_toks: the one exception to this recent trend was the defeat of 13 of the 52 freshman republicans brought into office in 1980 by the reagan revolution and running for re - election in 1982 .

reference_raw: The only exception to this latest trend was the defeat of 13 of the 52 freshmen Republicans that the Reagan Revolution launched in 1980 and ran for re-election in 1982.

reference_spacy_tokens: The only exception to this latest trend was the defeat of 13 of the 52 freshmen Republicans that the Reagan Revolution launched in 1980 and ran for re - election in 1982 .


fn_spacy_tokens_for_baseline: ' Have you filed notice of that application , Captain Jute ? '

source_bert_toks: ' have you filed notice of that application , captain ju ##te ? '

reference_raw: "Did you notice the request, Captain Jute?"

reference_spacy_tokens: " Did you notice the request , Captain Jute ? "


fn_spacy_tokens_for_baseline: Jimmy LaFave moves to a higher plane on his third release , aided by a polished new band and a passel of fine songs .

source_bert_toks: jimmy la ##fa ##ve moves to a higher plane on his third release , aided by a polished new band and a pass ##el of fine songs .

reference_raw: On the third edition, Jimmy LaFave is moving to a higher plane, with the help of a shiny new band and a belt of fine songs.

reference_spacy_tokens: On the third edition , Jimmy LaFave is moving to a higher plane , with the help of a shiny new band and a belt of fine songs .


fn_spacy_tokens_for_baseline: ' I feel like a drink now .

source_bert_toks: ' i feel like a drink now .

reference_raw: 'Now I think I'm drinking.

reference_spacy_tokens: ' Now I think I 'm drinking .


fn_spacy_tokens_for_baseline: I understood this the first time I read him , he wrote , in that smelly room in Hackney .

source_bert_toks: i understood this the first time i read him , he wrote , in that smell ##y room in hackney .

reference_raw: When I first read it, he wrote in that stinking room in Hackney.

reference_spacy_tokens: When I first read it , he wrote in that stinking room in Hackney .


fn_spacy_tokens_for_baseline: In fact , months of wrangling between the band 's manager and the record company usually ends with the band being dropped , by which time the other record companies who initially showed interest have gone cold .

source_bert_toks: in fact , months of wr ##ang ##ling between the band ' s manager and the record company usually ends with the band being dropped , by which time the other record companies who initially showed interest have gone cold .

reference_raw: In fact, months of squirming between a band manager and a record company usually end with the band being dropped, while other record companies that initially showed interest cooled down.

reference_spacy_tokens: In fact , months of squirming between a band manager and a record company usually end with the band being dropped , while other record companies that initially showed interest cooled down .


fn_spacy_tokens_for_baseline: He glanced the ball over Flowers head into the right corner of the net .

source_bert_toks: he glanced the ball over flowers head into the right corner of the net .

reference_raw: He looked at the ball over Flowers's head and into the correct corner of the net.

reference_spacy_tokens: He looked at the ball over Flowers 's head and into the correct corner of the net .


fn_spacy_tokens_for_baseline: SAN DIEGO - - Los Angeles Dodgers lefty Odalis Perez waffled about his need to get time off to clear his mind and invigorate his body , but his actions suggest otherwise .

source_bert_toks: san diego - - los angeles dodgers left ##y o ##dal ##is perez wa ##ffled about his need to get time off to clear his mind and in ##vi ##gor ##ate his body , but his actions suggest otherwise .

reference_raw: L.A. Dodgers lefty Odalis Perez wavered that he needed time off to clear his mind and refresh his body, but his actions suggested otherwise.

reference_spacy_tokens: L.A. Dodgers lefty Odalis Perez wavered that he needed time off to clear his mind and refresh his body , but his actions suggested otherwise .


fn_spacy_tokens_for_baseline: One of the most moving pictures printed in L'Illustration during the war was of one of these unhappy cuistots crawling on his stomach to the front at Verdun , with flasks of wine lashed to his belt .

source_bert_toks: one of the most moving pictures printed in l ' illustration during the war was of one of these unhappy cu ##isto ##ts crawling on his stomach to the front at ve ##rd ##un , with fl ##ask ##s of wine lashed to his belt .

reference_raw: One of L'Illustration's most moving paintings during the war was one of the unfortunate cuistots that crawled on his belly to the front of Verdun with bottles of wine tied to his belt.

reference_spacy_tokens: One of L'Illustration 's most moving paintings during the war was one of the unfortunate cuistots that crawled on his belly to the front of Verdun with bottles of wine tied to his belt .


fn_spacy_tokens_for_baseline: Geraci 's eyebrows wiggled briefly .

source_bert_toks: ge ##rac ##i ' s eyebrows wiggled briefly .

reference_raw: Geraci's eyebrows flickered briefly.

reference_spacy_tokens: Geraci 's eyebrows flickered briefly .


fn_spacy_tokens_for_baseline: That particular task needs a more outgoing personality .

source_bert_toks: that particular task needs a more outgoing personality .

reference_raw: This particular task requires a more distant personality.

reference_spacy_tokens: This particular task requires a more distant personality .


fn_spacy_tokens_for_baseline: There D'Arcy met an affable , mild - mannered man whom Roquelaure introduced simply as Hubert .

source_bert_toks: there d ' arc ##y met an af ##fa ##ble , mild - manner ##ed man whom ro ##quel ##aur ##e introduced simply as hubert .

reference_raw: There D'Arcy met the gentle, gentle man Roquelaure had introduced simply as Hubert.

reference_spacy_tokens: There D'Arcy met the gentle , gentle man Roquelaure had introduced simply as Hubert .


fn_spacy_tokens_for_baseline: It is all too easy to become discouraged , particularly if you are in an atmosphere of indifference or with people who lack insight .

source_bert_toks: it is all too easy to become discouraged , particularly if you are in an atmosphere of indifference or with people who lack insight .

reference_raw: It's too easy to be dissuaded, especially when you're in an atmosphere of indifference or with people who lack insight.

reference_spacy_tokens: It 's too easy to be dissuaded , especially when you 're in an atmosphere of indifference or with people who lack insight .


fn_spacy_tokens_for_baseline: That day brought the acquittal of a white police officer , William Lozano , of the killing of two black men in January 1989 .

source_bert_toks: that day brought the ac ##qui ##ttal of a white police officer , william lo ##zano , of the killing of two black men in january 1989 .

reference_raw: That day led to the exoneration of a white police officer, William Lozano, from the murder of two black men in January 1989.

reference_spacy_tokens: That day led to the exoneration of a white police officer , William Lozano , from the murder of two black men in January 1989 .


fn_spacy_tokens_for_baseline: The conclusion draws together themes treated in earlier chapters , including two general issues which are discussed extensively throughout the book : the relationship between crime and broad forces of social and economic change , and the effectiveness of the administration of law and order .

source_bert_toks: the conclusion draws together themes treated in earlier chapters , including two general issues which are discussed extensively throughout the book : the relationship between crime and broad forces of social and economic change , and the effectiveness of the administration of law and order .

reference_raw: This conclusion summarises the topics discussed in the previous chapters, including two general issues that are discussed extensively in the book: the relationship between crime and the wide forces of social and economic change and the effectiveness of the administration of law and order.

reference_spacy_tokens: This conclusion summarises the topics discussed in the previous chapters , including two general issues that are discussed extensively in the book : the relationship between crime and the wide forces of social and economic change and the effectiveness of the administration of law and order .


fn_spacy_tokens_for_baseline: Seen in this light de - industrialisation was not the onset of a foreign disease but the unavoidable expiation of past neglect .

source_bert_toks: seen in this light de - industrial ##isation was not the onset of a foreign disease but the una ##vo ##ida ##ble ex ##pia ##tion of past neglect .

reference_raw: Seen in this light, de-industrialization was not the onset of a foreign disease, but the inevitable expiration of past neglect.

reference_spacy_tokens: Seen in this light , de - industrialization was not the onset of a foreign disease , but the inevitable expiration of past neglect .


fn_spacy_tokens_for_baseline: In such a case where the true facts can only be known by the defence the prosecution could aver that the driver was unlicensed .

source_bert_toks: in such a case where the true facts can only be known by the defence the prosecution could ave ##r that the driver was un ##lice ##nsed .

reference_raw: In such a case, where the actual facts can only be known by the defence, the prosecution can avert the fact that the driver has not been licensed.

reference_spacy_tokens: In such a case , where the actual facts can only be known by the defence , the prosecution can avert the fact that the driver has not been licensed .


fn_spacy_tokens_for_baseline: Gradually as the person becomes more proficient , background noises and stimulation fade from attention , leaving the subject conscious and alert , but relaxed and calm .

source_bert_toks: gradually as the person becomes more proficient , background noises and stimulation fade from attention , leaving the subject conscious and alert , but relaxed and calm .

reference_raw: Gradually, as a person becomes more knowledgeable, the background noises and stimulation fade from attention, leaving the subject conscious and alert, but relaxed and calm.

reference_spacy_tokens: Gradually , as a person becomes more knowledgeable , the background noises and stimulation fade from attention , leaving the subject conscious and alert , but relaxed and calm .


fn_spacy_tokens_for_baseline: If Bouchard can pull off that feat , governing effectively as Quebec 's new premier while sustaining the fervor of the separatist movement , the result is likely to be another independence referendum within two years .

source_bert_toks: if bo ##uch ##ard can pull off that feat , governing effectively as quebec ' s new premier while sustaining the fe ##r ##vor of the sep ##arat ##ist movement , the result is likely to be another independence referendum within two years .

reference_raw: If Bouchard succeeds in doing so and manages effectively as the new Prime Minister of Quebec while maintaining the fervor of the separatist movement, the result is likely to be another independent referendum within two years.

reference_spacy_tokens: If Bouchard succeeds in doing so and manages effectively as the new Prime Minister of Quebec while maintaining the fervor of the separatist movement , the result is likely to be another independent referendum within two years .


fn_spacy_tokens_for_baseline: About 85 per cent of the 215 probate inventories which were appraised within the parish between 1521 and 1603 were valued at less than £ 50 and 68 per cent were priced under £ 30 .

source_bert_toks: about 85 per cent of the 215 pro ##bate inventor ##ies which were app ##rai ##sed within the parish between 152 ##1 and 1603 were valued at less than £5 ##0 and 68 per cent were priced under £3 ##0 .

reference_raw: About 85% of the 215 probate inventories assessed in the parish between 1521 and 1603 were valued at less than £50 and 68% were priced at less than £30.

reference_spacy_tokens: About 85 % of the 215 probate inventories assessed in the parish between 1521 and 1603 were valued at less than £ 50 and 68 % were priced at less than £ 30 .


fn_spacy_tokens_for_baseline: Practice is interpreted as repetition , and feedback consists mainly of approving reactions from the teacher .

source_bert_toks: practice is interpreted as repetition , and feedback consists mainly of app ##roving reactions from the teacher .

reference_raw: The practice is interpreted as a repetition and the feedback consists mainly of the approval of the teacher's response.

reference_spacy_tokens: The practice is interpreted as a repetition and the feedback consists mainly of the approval of the teacher 's response .


fn_spacy_tokens_for_baseline: Even the Leader of the Opposition is on record as saying that the rating system is the unfairest of taxes , yet we are led to believe that that is what the Labour party proposes .

source_bert_toks: even the leader of the opposition is on record as saying that the rating system is the unfair ##est of taxes , yet we are led to believe that that is what the labour party proposes .

reference_raw: Even the opposition leaders say that the rating system is the most unfair of taxes, but we have reason to believe that this is what the Labour Party suggests.

reference_spacy_tokens: Even the opposition leaders say that the rating system is the most unfair of taxes , but we have reason to believe that this is what the Labour Party suggests .


fn_spacy_tokens_for_baseline: On 30 June 1921 these elements coalesced and he suddenly saw that familiar landscape with new eyes .

source_bert_toks: on 30 june 1921 these elements coal ##es ##ced and he suddenly saw that familiar landscape with new eyes .

reference_raw: On June 30, 1921, these elements merged, and he saw the familiar landscape with new eyes.

reference_spacy_tokens: On June 30 , 1921 , these elements merged , and he saw the familiar landscape with new eyes .


fn_spacy_tokens_for_baseline: Currently an estimated 1,600 vessels carrying fuels and other hazardous materials pass through the strait annually .

source_bert_toks: currently an estimated 1 , 600 vessels carrying fuels and other hazardous materials pass through the strait annually .

reference_raw: At present, it is estimated that 1,600 vessels carrying fuel and other hazardous materials pass through the channel once a year.

reference_spacy_tokens: At present , it is estimated that 1,600 vessels carrying fuel and other hazardous materials pass through the channel once a year .


fn_spacy_tokens_for_baseline: I grabbed the empties and got back behind the bar .

source_bert_toks: i grabbed the em ##pt ##ies and got back behind the bar .

reference_raw: I picked up the blanks and went back to the bar.

reference_spacy_tokens: I picked up the blanks and went back to the bar .


fn_spacy_tokens_for_baseline: He was a tall heavy - set man of about sixty , bald , with a brick - red face and a walrus moustache .

source_bert_toks: he was a tall heavy - set man of about sixty , bald , with a brick - red face and a wal ##rus mo ##ust ##ache .

reference_raw: He was a tall, heavy man of about sixty, bald, with a brick-red face and a walrus mustache.

reference_spacy_tokens: He was a tall , heavy man of about sixty , bald , with a brick - red face and a walrus mustache .


fn_spacy_tokens_for_baseline: Firemen found the charred remains of the two sisters as they sifted through the debris .

source_bert_toks: fire ##men found the charred remains of the two sisters as they si ##fted through the debris .

reference_raw: The firemen found the charred remains of the two sisters as they passed through the rubble.

reference_spacy_tokens: The firemen found the charred remains of the two sisters as they passed through the rubble .


fn_spacy_tokens_for_baseline: Lava coursed through his arteries .

source_bert_toks: lava course ##d through his arteries .

reference_raw: Lava ran through the arteries.

reference_spacy_tokens: Lava ran through the arteries .


fn_spacy_tokens_for_baseline: The new batch of home - brew tasted better than the last lot , and stronger .

source_bert_toks: the new batch of home - brew tasted better than the last lot , and stronger .

reference_raw: The new batch of homebrew was better than the last batch, and stronger.

reference_spacy_tokens: The new batch of homebrew was better than the last batch , and stronger .


fn_spacy_tokens_for_baseline: ' I must go and telegraph Mama , ' he said suddenly .

source_bert_toks: ' i must go and telegraph mama , ' he said suddenly .

reference_raw: "I have to go and telegram my mother," he said abruptly.

reference_spacy_tokens: " I have to go and telegram my mother , " he said abruptly .


fn_spacy_tokens_for_baseline: They would wrap the lamb in a warm blanket , feed it from a bottle , and keep it near the heat of the kitchen fire , perhaps even on top of the oven , until it recovered .

source_bert_toks: they would wrap the lamb in a warm blanket , feed it from a bottle , and keep it near the heat of the kitchen fire , perhaps even on top of the oven , until it recovered .

reference_raw: They would pack the lamb in a warm blanket, feed it out of the bottle, and hold it close to the heat of the kitchen fire, perhaps even on the oven, until it recovered.

reference_spacy_tokens: They would pack the lamb in a warm blanket , feed it out of the bottle , and hold it close to the heat of the kitchen fire , perhaps even on the oven , until it recovered .


fn_spacy_tokens_for_baseline: He thrust one knee between hers ; felt for her breasts with his large hands ; stroked her down from neck to navel as if he owned her .

source_bert_toks: he thrust one knee between hers ; felt for her breasts with his large hands ; stroked her down from neck to nave ##l as if he owned her .

reference_raw: He put one knee between hers; his big hands reached for her breasts; he stroked her from neck to navel as if she were his own.

reference_spacy_tokens: He put one knee between hers ; his big hands reached for her breasts ; he stroked her from neck to navel as if she were his own .


fn_spacy_tokens_for_baseline: Malcolm Harris was aggrieved .

source_bert_toks: malcolm harris was ag ##gr ##ie ##ved .

reference_raw: Malcolm Harris was upset.

reference_spacy_tokens: Malcolm Harris was upset .


fn_spacy_tokens_for_baseline: There are several reasons why certain terrorist groups or individuals might favor the use of CBW over other kinds of weapons :

source_bert_toks: there are several reasons why certain terrorist groups or individuals might favor the use of cb ##w over other kinds of weapons :

reference_raw: There are several reasons why some terrorist groups or individuals may prefer the use of CBW to other types of weapons:

reference_spacy_tokens: There are several reasons why some terrorist groups or individuals may prefer the use of CBW to other types of weapons :


fn_spacy_tokens_for_baseline: She did look fetching in her fuchsia velour jumpsuit that deepened her speedwell eyes to a pansy purple .

source_bert_toks: she did look fetch ##ing in her fu ##chs ##ia ve ##lou ##r jumps ##uit that deepened her speed ##well eyes to a pan ##sy purple .

reference_raw: She looked fetching in her fuchsia velour suit, which deepened her speedwell eyes to a pansy violet.

reference_spacy_tokens: She looked fetching in her fuchsia velour suit , which deepened her speedwell eyes to a pansy violet .


fn_spacy_tokens_for_baseline: But satellite pictures received by the weather centre at the Falklands military base now show the iceberg moving straight towards the Falklands .

source_bert_toks: but satellite pictures received by the weather centre at the falkland ##s military base now show the ice ##berg moving straight towards the falkland ##s .

reference_raw: But satellite images received from the Falklands weather center now show that the glacier is moving directly toward the Falklands.

reference_spacy_tokens: But satellite images received from the Falklands weather center now show that the glacier is moving directly toward the Falklands .


fn_spacy_tokens_for_baseline: These powers have traditionally been regarded by the DES as ' dangerously punitive measures , difficult to enforce in the courts , and . measures of absolute last resort ' .

source_bert_toks: these powers have traditionally been regarded by the des as ' dangerously pun ##itive measures , difficult to enforce in the courts , and . measures of absolute last resort ' .

reference_raw: These powers have traditionally been considered by the DES to be "dangerously repressive measures, difficult to enforce in court, and "acts of absolute last resort".

reference_spacy_tokens: These powers have traditionally been considered by the DES to be " dangerously repressive measures , difficult to enforce in court , and " acts of absolute last resort " .


fn_spacy_tokens_for_baseline: She realised it was thoughtless of her to have rushed out and not said where she would be going , nor that she would n't want anything to eat .

source_bert_toks: she realised it was thought ##less of her to have rushed out and not said where she would be going , nor that she wouldn ' t want anything to eat .

reference_raw: She realized that it was inconsiderate of her to rush out without telling her where she was going, or that she wanted nothing to eat.

reference_spacy_tokens: She realized that it was inconsiderate of her to rush out without telling her where she was going , or that she wanted nothing to eat .


fn_spacy_tokens_for_baseline: Ignoring him , Guy let the impetus of his powerful swing carry the blade onwards to clash violently with the sword of the third soldier .

source_bert_toks: ignoring him , guy let the impetus of his powerful swing carry the blade onwards to clash violently with the sword of the third soldier .

reference_raw: Ignoring him, Guy allowed the impulse of his powerful swing to carry the blade forward and clatter violently with the third soldier's sword.

reference_spacy_tokens: Ignoring him , Guy allowed the impulse of his powerful swing to carry the blade forward and clatter violently with the third soldier 's sword .


fn_spacy_tokens_for_baseline: Behaviour is observed and measured from the outside , and propositions about behavioural patterns are readily testable and controllable .

source_bert_toks: behaviour is observed and measured from the outside , and proposition ##s about behaviour ##al patterns are readily test ##able and control ##lab ##le .

reference_raw: The behaviour is observed and measured from the outside and the suggestions about behavioural patterns are easily testable and manageable.

reference_spacy_tokens: The behaviour is observed and measured from the outside and the suggestions about behavioural patterns are easily testable and manageable .


fn_spacy_tokens_for_baseline: The group is still looking for possible partners for its optronics operations , though it insists that so far there have only been talks , not negotiations .

source_bert_toks: the group is still looking for possible partners for its opt ##ron ##ics operations , though it insists that so far there have only been talks , not negotiations .

reference_raw: The group is still looking for potential mates for its optronics operations, but insists that so far only talks have taken place, not negotiations.

reference_spacy_tokens: The group is still looking for potential mates for its optronics operations , but insists that so far only talks have taken place , not negotiations .


fn_spacy_tokens_for_baseline: ' And I do n't intend taking a flogging for a white bastard . '

source_bert_toks: ' and i don ' t intend taking a fl ##og ##ging for a white bastard . '

reference_raw: "And I'm not going to take a whip for a white bastard."

reference_spacy_tokens: " And I 'm not going to take a whip for a white bastard . "


fn_spacy_tokens_for_baseline: The boats may appear deceptively primitive , but many of them have their own electric generators and all the modern conveniences .

source_bert_toks: the boats may appear dec ##eptive ##ly primitive , but many of them have their own electric generators and all the modern convenience ##s .

reference_raw: Ships may look deceptively primitive, but many of them have their own electrical generators and all the modern equipment.

reference_spacy_tokens: Ships may look deceptively primitive , but many of them have their own electrical generators and all the modern equipment .


fn_spacy_tokens_for_baseline: The trouble with people like Dr Wyn was that there was really no answer to the jaw - dropping remarks they made .

source_bert_toks: the trouble with people like dr w ##yn was that there was really no answer to the jaw - dropping remarks they made .

reference_raw: The problem with people like Dr. Wyn was that they didn't really respond to their mouth-dropping remarks.

reference_spacy_tokens: The problem with people like Dr. Wyn was that they did n't really respond to their mouth - dropping remarks .


fn_spacy_tokens_for_baseline: He went out to his car carrying his jazzy jacket and tooted as he drove away .

source_bert_toks: he went out to his car carrying his jazz ##y jacket and too ##ted as he drove away .

reference_raw: He went to the car with his jazz jacket in his hand and took his teeth on the way out.

reference_spacy_tokens: He went to the car with his jazz jacket in his hand and took his teeth on the way out .


fn_spacy_tokens_for_baseline: Yet basically it was a team of people trying to wrest power , not a populist - based overthrow .

source_bert_toks: yet basically it was a team of people trying to wr ##est power , not a pop ##uli ##st - based overthrow .

reference_raw: But, in essence, it was a team of people trying to wrest power, not a populist topple.

reference_spacy_tokens: But , in essence , it was a team of people trying to wrest power , not a populist topple .


fn_spacy_tokens_for_baseline: This , the first extended Bush - Gorbachev summit , was hailed as a new beginning in US - Soviet relations , despite acknowledged and continuing differences on a number of key bilateral and international issues .

source_bert_toks: this , the first extended bush - go ##rba ##chev summit , was hailed as a new beginning in us - soviet relations , despite acknowledged and continuing differences on a number of key bilateral and international issues .

reference_raw: This, the first extension of the Bush-Gorbachev Summit, was hailed as a fresh start in US-Soviet relations, despite recognised and persistent differences on a number of key bilateral and international issues.

reference_spacy_tokens: This , the first extension of the Bush - Gorbachev Summit , was hailed as a fresh start in US - Soviet relations , despite recognised and persistent differences on a number of key bilateral and international issues .


fn_spacy_tokens_for_baseline: AS a pensioner and in common with many other townsfolk , I am incensed by the decision of local government to close eight old people 's homes .

source_bert_toks: as a pension ##er and in common with many other towns ##folk , i am incense ##d by the decision of local government to close eight old people ' s homes .

reference_raw: As a pensioner, and in common with many other townspeople, I am prompted by the decision of the local government to close the homes of eight old people.

reference_spacy_tokens: As a pensioner , and in common with many other townspeople , I am prompted by the decision of the local government to close the homes of eight old people .


fn_spacy_tokens_for_baseline: An edge of barely concealed displeasure to his tone , he answered , ' Turn our romantic little episode into a farce . '

source_bert_toks: an edge of barely concealed displeasure to his tone , he answered , ' turn our romantic little episode into a far ##ce . '

reference_raw: With an edge of barely hidden displeasure in his voice, he said, "Turn our romantic episode into a farce."

reference_spacy_tokens: With an edge of barely hidden displeasure in his voice , he said , " Turn our romantic episode into a farce . "


fn_spacy_tokens_for_baseline: The vagueness of some of the ' Activities ' tends to cause recurring difficulty , and I can only assume that Durant and Fabb have their own ways of making them work .

source_bert_toks: the vague ##ness of some of the ' activities ' tends to cause recurring difficulty , and i can only assume that duran ##t and fa ##bb have their own ways of making them work .

reference_raw: The vagueness of some activities tends to cause recurrent difficulties, and I can only assume that Durant and Fabb have their own way of making them work.

reference_spacy_tokens: The vagueness of some activities tends to cause recurrent difficulties , and I can only assume that Durant and Fabb have their own way of making them work .


fn_spacy_tokens_for_baseline: They pushed it into the classroom and stood it against a wall .

source_bert_toks: they pushed it into the classroom and stood it against a wall .

reference_raw: They pushed him into the classroom and put him against the wall.

reference_spacy_tokens: They pushed him into the classroom and put him against the wall .


fn_spacy_tokens_for_baseline: Fincara 's maddening laughter rippled out , and she stepped over to him as easily as a dancer .

source_bert_toks: fin ##car ##a ' s madden ##ing laughter rippled out , and she stepped over to him as easily as a dancer .

reference_raw: Fincara's mad laugh erupted, and she approached him as easily as a dancer.

reference_spacy_tokens: Fincara 's mad laugh erupted , and she approached him as easily as a dancer .


fn_spacy_tokens_for_baseline: She shrugged , slipped the one - piece off and kicked off her briefs , then stood there , her hands at her sides , making no effort to cover her nakedness .

source_bert_toks: she shrugged , slipped the one - piece off and kicked off her briefs , then stood there , her hands at her sides , making no effort to cover her naked ##ness .

reference_raw: Shrugging, she slipped the one-piece off and kicked off her shorts, then stood with her hands on her hips, not trying to hide her nakedness.

reference_spacy_tokens: Shrugging , she slipped the one - piece off and kicked off her shorts , then stood with her hands on her hips , not trying to hide her nakedness .


fn_spacy_tokens_for_baseline: In the exile it was decreed that circumcision was to be the official rite of initiation into Judaism and all that that now meant .

source_bert_toks: in the exile it was decreed that ci ##rc ##um ##cision was to be the official rite of initiation into judaism and all that that now meant .

reference_raw: In exile, it was decreed that circumcision would be the official ritual of commencing Judaism and all that now meant.

reference_spacy_tokens: In exile , it was decreed that circumcision would be the official ritual of commencing Judaism and all that now meant .


fn_spacy_tokens_for_baseline: Outside college , Esther 's life was eclectic , fragmented , secretive .

source_bert_toks: outside college , esther ' s life was eclectic , fragmented , secretive .

reference_raw: Outside the university, Esther's life had been ecclectic, fragmented, mysterious.

reference_spacy_tokens: Outside the university , Esther 's life had been ecclectic , fragmented , mysterious .


fn_spacy_tokens_for_baseline: Nephrite pebbles show up by their colour and translucency much more clearly when viewed through flowing water than they do when dry .

source_bert_toks: ne ##ph ##rite pebbles show up by their colour and trans ##lu ##cen ##cy much more clearly when viewed through flowing water than they do when dry .

reference_raw: Nephrite pebbles appear more clearly in colour and transparency when they are seen in flowing water than when they are dried.

reference_spacy_tokens: Nephrite pebbles appear more clearly in colour and transparency when they are seen in flowing water than when they are dried .


fn_spacy_tokens_for_baseline: The more those kids were deprived and maltreated , the more motivated they would be to get aboard the enterprise culture and start creating wealth .

source_bert_toks: the more those kids were deprived and mal ##tre ##ated , the more motivated they would be to get aboard the enterprise culture and start creating wealth .

reference_raw: The more these children were deprived and ill-treated, the more motivated they were to enter the corporate culture and begin to create wealth.

reference_spacy_tokens: The more these children were deprived and ill - treated , the more motivated they were to enter the corporate culture and begin to create wealth .


fn_spacy_tokens_for_baseline: I could actually feel Dawn ripping up the dead creatures as she sat on my fist and the blood was soaking through my glove .

source_bert_toks: i could actually feel dawn ripping up the dead creatures as she sat on my fist and the blood was soaking through my glove .

reference_raw: In fact, as she sat on my fist and the blood soaked in my glove, I felt Dawn tear up the dead creatures.

reference_spacy_tokens: In fact , as she sat on my fist and the blood soaked in my glove , I felt Dawn tear up the dead creatures .


fn_spacy_tokens_for_baseline: There 's nothing quite like sexy lingerie to put you in the mood so knock him dead on Valentine 's Day with some of this sizzling underwear from the latest Freemans Spring / Summer collection .

source_bert_toks: there ' s nothing quite like sexy linger ##ie to put you in the mood so knock him dead on valentine ' s day with some of this si ##zzling underwear from the latest freeman ##s spring / summer collection .

reference_raw: There's no such thing as a sexy underwear that puts you in the mood, so knock him to death on Valentine's Day with some of that hissing underwear from the latest Freeman Spring/Summer collection.

reference_spacy_tokens: There 's no such thing as a sexy underwear that puts you in the mood , so knock him to death on Valentine 's Day with some of that hissing underwear from the latest Freeman Spring / Summer collection .


fn_spacy_tokens_for_baseline: Example : a young minister at a church social announces ' Miss Jeannie MacPherson will now sing ' The Flowers of the Forest ' . '

source_bert_toks: example : a young minister at a church social announces ' miss jean ##nie mac ##pher ##son will now sing ' the flowers of the forest ' . '

reference_raw: Example: the young minister of the church community announces, "Miss Jeannie MacPherson is about to sing "The Flowers of the Forest."

reference_spacy_tokens: Example : the young minister of the church community announces , " Miss Jeannie MacPherson is about to sing " The Flowers of the Forest . "


fn_spacy_tokens_for_baseline: Oh ! ' she squealed as light dawned .

source_bert_toks: oh ! ' she squealed as light dawned .

reference_raw: Oh!' she screamed as the light began.

reference_spacy_tokens: Oh ! ' she screamed as the light began .


fn_spacy_tokens_for_baseline: Upon conviction , she ( I use the pronoun ' she ' for the sake of convenience here ) appealed on the ground that the statute expressly made the crime one which only a man could commit .

source_bert_toks: upon conviction , she ( i use the pro ##no ##un ' she ' for the sake of convenience here ) appealed on the ground that the statute express ##ly made the crime one which only a man could commit .

reference_raw: When she was convicted, she (I use the pronoun "she" for comfort here) made a complaint on the ground that the law expressly made a crime that only a man could commit.

reference_spacy_tokens: When she was convicted , she ( I use the pronoun " she " for comfort here ) made a complaint on the ground that the law expressly made a crime that only a man could commit .