fn_spacy_tokens_for_baseline: In the last chapter I said that the average consumption of fat in the Western world is about 130 grams ( over 4 UNC ounces ) a day .

source_bert_toks: in the last chapter i said that the average consumption of fat in the western world is about 130 grams ( over 4 un ##c ounce ##s ) a day .

reference_raw: In the last chapter I stated that the average consumption of fat in the Western world is about 130 g (more than 4 UNC ounces) per day.

reference_spacy_tokens: In the last chapter I stated that the average consumption of fat in the Western world is about 130 g ( more than 4 UNC ounces ) per day .


fn_spacy_tokens_for_baseline: Over a period of time she was seen by a number of psychotherapists and psychologists who adopted differing approaches to her varied problems .

source_bert_toks: over a period of time she was seen by a number of psycho ##ther ##ap ##ists and psychologists who adopted differing approaches to her varied problems .

reference_raw: Over time, many psychotherapists and psychologists have seen her, who have adopted different approaches to her diverse problems.

reference_spacy_tokens: Over time , many psychotherapists and psychologists have seen her , who have adopted different approaches to her diverse problems .


fn_spacy_tokens_for_baseline: They staggered together from the tunnel , whimpering with agony .

source_bert_toks: they staggered together from the tunnel , whimper ##ing with agony .

reference_raw: They staggered out of the tunnel together, whining in agony.

reference_spacy_tokens: They staggered out of the tunnel together , whining in agony .


fn_spacy_tokens_for_baseline: There are various types of switchboards available that do various things and no decision as to which one would be best for us has yet been made .

source_bert_toks: there are various types of switch ##boards available that do various things and no decision as to which one would be best for us has yet been made .

reference_raw: There are different kinds of switching boards that do different things, and so far, we haven't decided what's best for us.

reference_spacy_tokens: There are different kinds of switching boards that do different things , and so far , we have n't decided what 's best for us .


fn_spacy_tokens_for_baseline: The waistline on bikini bottoms has been pulled up while the usual high leg cut has fallen to something less severe .

source_bert_toks: the waist ##line on bikini bottoms has been pulled up while the usual high leg cut has fallen to something less severe .

reference_raw: The belt on the bottom of the bikini was pulled up while the usual high-legged cut fell into something less severe.

reference_spacy_tokens: The belt on the bottom of the bikini was pulled up while the usual high - legged cut fell into something less severe .


fn_spacy_tokens_for_baseline: Not then travelling in the comfort of an airliner to attend ceremonies marking an anniversary but actually taking part in the historic attacks against the mighty German battleship Tirpitz .

source_bert_toks: not then travelling in the comfort of an airline ##r to attend ceremonies marking an anniversary but actually taking part in the historic attacks against the mighty german battleship ti ##rp ##itz .

reference_raw: Then he didn't travel to the comfort of an airliner to attend an anniversary ceremony, but he actually participated in a historical attack on the mighty German battleship Tirpitz.

reference_spacy_tokens: Then he did n't travel to the comfort of an airliner to attend an anniversary ceremony , but he actually participated in a historical attack on the mighty German battleship Tirpitz .


fn_spacy_tokens_for_baseline: He opened his mouth to speak but Richard forestalled him .

source_bert_toks: he opened his mouth to speak but richard forest ##alle ##d him .

reference_raw: He opened his mouth to speak, but Richard foresaw him.

reference_spacy_tokens: He opened his mouth to speak , but Richard foresaw him .


fn_spacy_tokens_for_baseline: very nice we 've had a quite a warm last few days in fact it 's been in the in the well sixty sixty seven to seventy

source_bert_toks: very nice we ' ve had a quite a warm last few days in fact it ' s been in the in the well sixty sixty seven to seventy

reference_raw: it's very nice that we've had quite a bit of heat in the last few days, actually, in the well of sixty-seven to seventy.

reference_spacy_tokens: it 's very nice that we 've had quite a bit of heat in the last few days , actually , in the well of sixty - seven to seventy .


fn_spacy_tokens_for_baseline: Most kite designs specify the bridle line lengths and the attachment points .

source_bert_toks: most kite designs specify the br ##id ##le line lengths and the attachment points .

reference_raw: Most dragon designs specify the lengths of the bridle line and the mounting points.

reference_spacy_tokens: Most dragon designs specify the lengths of the bridle line and the mounting points .


fn_spacy_tokens_for_baseline: Establishments are no longer called " Royal , " Queen Elizabeth has vanished from the coinage , and the Union Jack has been replaced by the flag of China and the new Hong Kong flag with its bauhinia flower .

source_bert_toks: establishments are no longer called " royal , " queen elizabeth has vanished from the coinage , and the union jack has been replaced by the flag of china and the new hong kong flag with its ba ##uh ##inia flower .

reference_raw: The establishment is not called Royal anymore, Queen Elizabeth has disappeared from the coinage, and Union Jack has been replaced by a Chinese flag and a new Hong Kong flag with a bauhinian flower.

reference_spacy_tokens: The establishment is not called Royal anymore , Queen Elizabeth has disappeared from the coinage , and Union Jack has been replaced by a Chinese flag and a new Hong Kong flag with a bauhinian flower .


fn_spacy_tokens_for_baseline: In this case , though , when I totalled their length it came to 2,000 words ; and the books editor had asked for 700 .

source_bert_toks: in this case , though , when i total ##led their length it came to 2 , 000 words ; and the books editor had asked for 700 .

reference_raw: But in this case, when I summed up their length, it was two thousand words; and the editor of the book asked for seven hundred.

reference_spacy_tokens: But in this case , when I summed up their length , it was two thousand words ; and the editor of the book asked for seven hundred .


fn_spacy_tokens_for_baseline: WINE maker Johann Grimes , of Wotton - under - Edge , Glos , found his labrador legless after it had lapped up a bucket of his home brew .

source_bert_toks: wine maker johann grimes , of wo ##tton - under - edge , g ##los , found his labrador leg ##less after it had lap ##ped up a bucket of his home brew .

reference_raw: WINE maker Johann Grimes of Wotton-under-Edge, Glos, found his labrador legless after he had lashed out a bucket of homemade beer.

reference_spacy_tokens: WINE maker Johann Grimes of Wotton - under - Edge , Glos , found his labrador legless after he had lashed out a bucket of homemade beer .


fn_spacy_tokens_for_baseline: However , the US is concerned with the indirect assistance Iran could receive and is concerned that it is probably covertly seeking the construction of uranium conversion and enrichment facilities , other technical know - how , and technicians .

source_bert_toks: however , the us is concerned with the indirect assistance iran could receive and is concerned that it is probably covert ##ly seeking the construction of uranium conversion and enrichment facilities , other technical know - how , and technicians .

reference_raw: However, the US is concerned about the indirect assistance that Iran might receive and is concerned that it is likely to covertly seek to build uranium conversion and enrichment facilities, other technical knowledge and technicians.

reference_spacy_tokens: However , the US is concerned about the indirect assistance that Iran might receive and is concerned that it is likely to covertly seek to build uranium conversion and enrichment facilities , other technical knowledge and technicians .


fn_spacy_tokens_for_baseline: In addition , current and former American officials say that CIA operatives and equipment were sent into rebel - held areas to monitor the opposition forces ' activity even before the air bombardment began .

source_bert_toks: in addition , current and former american officials say that cia operatives and equipment were sent into rebel - held areas to monitor the opposition forces ' activity even before the air bombardment began .

reference_raw: Moreover, current and former U.S. officials claim that CIA agents and equipment were sent to rebel-held areas to monitor the activities of the opposition forces before the bombing began.

reference_spacy_tokens: Moreover , current and former U.S. officials claim that CIA agents and equipment were sent to rebel - held areas to monitor the activities of the opposition forces before the bombing began .


fn_spacy_tokens_for_baseline: He poured an inch of condensed milk into the mug plus four spoons of sugar and stirred the coffee before straining it .

source_bert_toks: he poured an inch of condensed milk into the mug plus four spoon ##s of sugar and stirred the coffee before straining it .

reference_raw: He poured an inch of condensed milk into his cup, plus four teaspoons of sugar, and stirred his coffee before he strained it.

reference_spacy_tokens: He poured an inch of condensed milk into his cup , plus four teaspoons of sugar , and stirred his coffee before he strained it .


fn_spacy_tokens_for_baseline: ' We have been very very supportive of the exchange and all the operations that have been going on .

source_bert_toks: ' we have been very very supportive of the exchange and all the operations that have been going on .

reference_raw: 'We supported the exchange very much, and all the operations that were going on.

reference_spacy_tokens: ' We supported the exchange very much , and all the operations that were going on .


fn_spacy_tokens_for_baseline: The decision was taken after other member countries refused to accept US demands for a reduction of its contribution to the ISO 's budget and for its redefinition as a ' study group ' rather than a body with price - stabilizing powers .

source_bert_toks: the decision was taken after other member countries refused to accept us demands for a reduction of its contribution to the iso ' s budget and for its red ##ef ##ini ##tion as a ' study group ' rather than a body with price - stab ##ili ##zing powers .

reference_raw: This decision was taken after other Member States refused to accept requests from the United States to reduce their contribution to the ISO budget and to redefine it as a "study group" rather than a price-stabilising entity.

reference_spacy_tokens: This decision was taken after other Member States refused to accept requests from the United States to reduce their contribution to the ISO budget and to redefine it as a " study group " rather than a price - stabilising entity .


fn_spacy_tokens_for_baseline: The elegant arabesque - style hotel skirts the Mediterranean shoreline on th east side of the island , with sweeping coastal plains and craggy mountains providing a dramatic backdrop .

source_bert_toks: the elegant arab ##es ##que - style hotel skirts the mediterranean shoreline on th east side of the island , with sweeping coastal plains and cr ##ag ##gy mountains providing a dramatic backdrop .

reference_raw: On the east side of the island, the elegant arabesque-style hotel circles the Mediterranean coast, and the sweeping coastal plains and rocky mountains provide a dramatic background.

reference_spacy_tokens: On the east side of the island , the elegant arabesque - style hotel circles the Mediterranean coast , and the sweeping coastal plains and rocky mountains provide a dramatic background .


fn_spacy_tokens_for_baseline: Hatch snickered , a touch of humour , responding well to Cowley 's cool cynicism .

source_bert_toks: hatch s ##nick ##ered , a touch of humour , responding well to cow ##ley ' s cool cy ##nic ##ism .

reference_raw: Hatch chuckled, a touch of humor, and responded well to Cowley's cold cynicism.

reference_spacy_tokens: Hatch chuckled , a touch of humor , and responded well to Cowley 's cold cynicism .


fn_spacy_tokens_for_baseline: Earlier this year , some 70 U.S. congressmen sent a letter to U. S. President Bill Clinton , calling for an end to the humanitarian crisis in Iraq by having the sanctions lifted .

source_bert_toks: earlier this year , some 70 u . s . congress ##men sent a letter to u . s . president bill clinton , calling for an end to the humanitarian crisis in iraq by having the sanctions lifted .

reference_raw: Earlier this year, about 70 U.S. Congressmen sent a letter to US President Bill Clinton calling for the abolition of the humanitarian crisis in Iraq.

reference_spacy_tokens: Earlier this year , about 70 U.S. Congressmen sent a letter to US President Bill Clinton calling for the abolition of the humanitarian crisis in Iraq .


fn_spacy_tokens_for_baseline: All the anger she had ever felt seemed to shrink into no more than fits of petty temper in the face of what she was feeling now .

source_bert_toks: all the anger she had ever felt seemed to shrink into no more than fits of petty temper in the face of what she was feeling now .

reference_raw: In the face of what she felt now, all the anger she had ever felt seemed to diminish to nothing more than a fit of petty temper.

reference_spacy_tokens: In the face of what she felt now , all the anger she had ever felt seemed to diminish to nothing more than a fit of petty temper .


fn_spacy_tokens_for_baseline: The mix forms a slurry which is rolled out and heated to remove water , then thickened into a solid strip .

source_bert_toks: the mix forms a sl ##ur ##ry which is rolled out and heated to remove water , then thick ##ened into a solid strip .

reference_raw: The mixture forms a slurry that is rolled out and heated to remove the water and then fattened to a solid strip.

reference_spacy_tokens: The mixture forms a slurry that is rolled out and heated to remove the water and then fattened to a solid strip .


fn_spacy_tokens_for_baseline: It has run into particular opposition from companies aligned with Nokia , which has developed a competing software .

source_bert_toks: it has run into particular opposition from companies aligned with nokia , which has developed a competing software .

reference_raw: It encountered specific objections from companies aligned with Nokia, which developed a competing software.

reference_spacy_tokens: It encountered specific objections from companies aligned with Nokia , which developed a competing software .


fn_spacy_tokens_for_baseline: This litter was whelped in the UK and several puppies remained here , while four accompanied their mother to Australia .

source_bert_toks: this litter was w ##hel ##ped in the uk and several pup ##pies remained here , while four accompanied their mother to australia .

reference_raw: The litter was wheeled in the United Kingdom, and there were a few puppies, and four of them accompanied their mother to Australia.

reference_spacy_tokens: The litter was wheeled in the United Kingdom , and there were a few puppies , and four of them accompanied their mother to Australia .


fn_spacy_tokens_for_baseline: Pamper him with a shave , facial , massage , pedicure , manicure and more !

source_bert_toks: pam ##per him with a shave , facial , massage , pe ##dic ##ure , mani ##cure and more !

reference_raw: Shave him, face, massage, pedicure, manicure and more!

reference_spacy_tokens: Shave him , face , massage , pedicure , manicure and more !


fn_spacy_tokens_for_baseline: The car purred smoothly on along a narrow lane lined with trees .

source_bert_toks: the car pu ##rred smoothly on along a narrow lane lined with trees .

reference_raw: The car moved smoothly along a narrow lane lined with trees.

reference_spacy_tokens: The car moved smoothly along a narrow lane lined with trees .


fn_spacy_tokens_for_baseline: Once more Daisy was knocked out by the fecundity of everything , the blackthorn purple with sloes , plump hazel nuts already shredded by squirrels , elderberries shiny as caviar hanging like shower fittings from their crimson stems .

source_bert_toks: once more daisy was knocked out by the fe ##cu ##ndi ##ty of everything , the black ##thor ##n purple with sl ##oes , plump hazel nuts already shredded by squirrels , elder ##berries shiny as ca ##via ##r hanging like shower fitting ##s from their crimson stems .

reference_raw: Daisy was struck again by the fecundity of everything, the blackthorn violet with sloes, the plump hazel nuts already torn apart by squirrels, the older berries gleaming like caviar hanging like shower fittings from their crimson stems.

reference_spacy_tokens: Daisy was struck again by the fecundity of everything , the blackthorn violet with sloes , the plump hazel nuts already torn apart by squirrels , the older berries gleaming like caviar hanging like shower fittings from their crimson stems .


fn_spacy_tokens_for_baseline: All I can say is that a bloke in a top - hat spoke to me .

source_bert_toks: all i can say is that a b ##lok ##e in a top - hat spoke to me .

reference_raw: All I can say is the guy in the top hat talked to me.

reference_spacy_tokens: All I can say is the guy in the top hat talked to me .


fn_spacy_tokens_for_baseline: Flake the tuna fish ; dispose of any brine , but if the fish is packed in olive oil it may be added to the dressing for the beans .

source_bert_toks: fl ##ake the tuna fish ; dispose of any br ##ine , but if the fish is packed in olive oil it may be added to the dressing for the beans .

reference_raw: Flak the tuna fish; discard any brine, but if the fish are wrapped in olive oil, it may be added to the bean dressing.

reference_spacy_tokens: Flak the tuna fish ; discard any brine , but if the fish are wrapped in olive oil , it may be added to the bean dressing .


fn_spacy_tokens_for_baseline: The chatter of machine gun fire is frequently heard in Srinagar after dark and the sandbagged pickets of the security forces lining Srinagar 's roads , once packed with tourists , are the liveliest centres of activity .

source_bert_toks: the chatter of machine gun fire is frequently heard in sri ##nagar after dark and the sand ##bag ##ged picket ##s of the security forces lining sri ##nagar ' s roads , once packed with tourists , are the live ##liest centres of activity .

reference_raw: The whisper of machine-gun fire is often heard in Srinagar after dark, and the sandbags of the security forces lining Srinagar's roads, once packed with tourists, are the most vivid centers of activity.

reference_spacy_tokens: The whisper of machine - gun fire is often heard in Srinagar after dark , and the sandbags of the security forces lining Srinagar 's roads , once packed with tourists , are the most vivid centers of activity .


fn_spacy_tokens_for_baseline: So once Posi had drifted the ship down near the surface , I prepared myself for my descent -- the cylinder in a carry - net slung over one shoulder , a hand raised to hold on to my hairpiece .

source_bert_toks: so once po ##si had drifted the ship down near the surface , i prepared myself for my descent - - the cylinder in a carry - net slung over one shoulder , a hand raised to hold on to my hair ##piece .

reference_raw: So, as soon as Posi had brought the ship close to the surface, I prepared to go down - the cylinder in the carry-net slung over one shoulder, my hand held up to hold my headpiece.

reference_spacy_tokens: So , as soon as Posi had brought the ship close to the surface , I prepared to go down - the cylinder in the carry - net slung over one shoulder , my hand held up to hold my headpiece .


fn_spacy_tokens_for_baseline: Two Darlington men were jailed for four months by magistrates yesterday for their part in an attempted burglary of a terraced house in the town .

source_bert_toks: two darlington men were jailed for four months by magistrates yesterday for their part in an attempted bu ##rg ##lary of a terrace ##d house in the town .

reference_raw: Two Darlington men were arrested by judges for four months yesterday for trying to break into a terraced house in the city.

reference_spacy_tokens: Two Darlington men were arrested by judges for four months yesterday for trying to break into a terraced house in the city .


fn_spacy_tokens_for_baseline: What they did n't realize was that granules of radioactive material left in the bottom of the dissolving vessel had evaporated the residual liquid and heated up the base .

source_bert_toks: what they didn ' t realize was that gran ##ules of radioactive material left in the bottom of the di ##sso ##lving vessel had eva ##por ##ated the residual liquid and heated up the base .

reference_raw: What they didn't realize was that the granules of radioactive material left at the bottom of the dissolving vessel vaporized the residual fluid and heated the base.

reference_spacy_tokens: What they did n't realize was that the granules of radioactive material left at the bottom of the dissolving vessel vaporized the residual fluid and heated the base .


fn_spacy_tokens_for_baseline: It is a good Christian well now , and the water is said to be curative .

source_bert_toks: it is a good christian well now , and the water is said to be cu ##rative .

reference_raw: Now it's a good Christian well, and the water's supposed to be healing.

reference_spacy_tokens: Now it 's a good Christian well , and the water 's supposed to be healing .


fn_spacy_tokens_for_baseline: We 're all men , if the ladies will excuse me saying that , we 're all men and men are human .

source_bert_toks: we ' re all men , if the ladies will excuse me saying that , we ' re all men and men are human .

reference_raw: We're all men, if the ladies don't mind my saying so, we're all men and men are men.

reference_spacy_tokens: We 're all men , if the ladies do n't mind my saying so , we 're all men and men are men .


fn_spacy_tokens_for_baseline: US and Belgian forces landed at the of Kismayu yesterday , scene of some of the country 's worst clan carnage .

source_bert_toks: us and belgian forces landed at the of ki ##sma ##yu yesterday , scene of some of the country ' s worst clan carnage .

reference_raw: U.S. and Belgian forces landed in Kismay yesterday, a scene of some of the worst clan massacres in the country.

reference_spacy_tokens: U.S. and Belgian forces landed in Kismay yesterday , a scene of some of the worst clan massacres in the country .


fn_spacy_tokens_for_baseline: Straddling boundaries , some wetlands still defy comprehensive administration .

source_bert_toks: st ##rad ##dling boundaries , some wetlands still def ##y comprehensive administration .

reference_raw: Boundary boundaries, some wetlands still resist comprehensive management.

reference_spacy_tokens: Boundary boundaries , some wetlands still resist comprehensive management .


fn_spacy_tokens_for_baseline: Four hundred troops are currently in the northwestern county guarding densely - populated areas , airports and power stations .

source_bert_toks: four hundred troops are currently in the northwestern county guarding densely - populated areas , airports and power stations .

reference_raw: There are now 400 troops in the northwest region, guarding densely populated areas, airfields, and power stations.

reference_spacy_tokens: There are now 400 troops in the northwest region , guarding densely populated areas , airfields , and power stations .


fn_spacy_tokens_for_baseline: Love is already turning into hate .

source_bert_toks: love is already turning into hate .

reference_raw: Love has become hate.

reference_spacy_tokens: Love has become hate .


fn_spacy_tokens_for_baseline: It agrees that Gore 's outer robotic - ness masks a warm jocularity , but argues that the warm jocularity itself masks Gore 's fundamental emotional coolness .

source_bert_toks: it agrees that gore ' s outer robotic - ness masks a warm jo ##cular ##ity , but argues that the warm jo ##cular ##ity itself masks gore ' s fundamental emotional cool ##ness .

reference_raw: He agrees that Gore's external robotic ness masks the warmth of jocularity, but claims that the warmth of jocularity itself masks Gore's basic emotional coolness.

reference_spacy_tokens: He agrees that Gore 's external robotic ness masks the warmth of jocularity , but claims that the warmth of jocularity itself masks Gore 's basic emotional coolness .


fn_spacy_tokens_for_baseline: According to the report , the two countries had also agreed on a date for Vietnam to restart repaying its debts to Japan .

source_bert_toks: according to the report , the two countries had also agreed on a date for vietnam to restart repay ##ing its debts to japan .

reference_raw: According to the report, both countries also agreed on a date for Vietnam to resume the repayment of their debts to Japan.

reference_spacy_tokens: According to the report , both countries also agreed on a date for Vietnam to resume the repayment of their debts to Japan .


fn_spacy_tokens_for_baseline: I remember the screech of the horn and the blur of the car as it passed in front of me .

source_bert_toks: i remember the sc ##ree ##ch of the horn and the blur of the car as it passed in front of me .

reference_raw: I remember the sound of the horn and the blur of the car as it passed before me.

reference_spacy_tokens: I remember the sound of the horn and the blur of the car as it passed before me .


fn_spacy_tokens_for_baseline: We shot the two men at the boat , and the captain shot another man .

source_bert_toks: we shot the two men at the boat , and the captain shot another man .

reference_raw: We fired two men on the boat, and the captain took out another man.

reference_spacy_tokens: We fired two men on the boat , and the captain took out another man .


fn_spacy_tokens_for_baseline: Doreen stepped out of her slip , and draped it over a chair .

source_bert_toks: do ##reen stepped out of her slip , and draped it over a chair .

reference_raw: Doreen stepped out of the slide and draped it over a chair.

reference_spacy_tokens: Doreen stepped out of the slide and draped it over a chair .


fn_spacy_tokens_for_baseline: The year - earlier results have been restated to reflect an accounting change .

source_bert_toks: the year - earlier results have been rest ##ated to reflect an accounting change .

reference_raw: Year - previous results were restated to reflect the change in accounting.

reference_spacy_tokens: Year - previous results were restated to reflect the change in accounting .


fn_spacy_tokens_for_baseline: There was former Clinton aide George Stephanopoulos on ABC 's This Week this morning , furrow - browed and " heartbroken with all the evidence coming out " against the president .

source_bert_toks: there was former clinton aide george stephan ##op ##oulos on abc ' s this week this morning , fur ##row - brow ##ed and " heart ##broken with all the evidence coming out " against the president .

reference_raw: This morning at ABC was former Clinton's assistant George Stephanopoulos, furrowed and "heartbroken by all the evidence that came out" against the President.

reference_spacy_tokens: This morning at ABC was former Clinton 's assistant George Stephanopoulos , furrowed and " heartbroken by all the evidence that came out " against the President .


fn_spacy_tokens_for_baseline: For Ryedale York tomorrow it will be like walking into the lions ' den .

source_bert_toks: for rye ##dale york tomorrow it will be like walking into the lions ' den .

reference_raw: Tomorrow it'll be like walking into a lion's lair for Ryedale York.

reference_spacy_tokens: Tomorrow it 'll be like walking into a lion 's lair for Ryedale York .


fn_spacy_tokens_for_baseline: Well , it 's about these two women and one of them 's married and the other one 's , like , she 's got a boyfriend .

source_bert_toks: well , it ' s about these two women and one of them ' s married and the other one ' s , like , she ' s got a boyfriend .

reference_raw: It's about these two women, and one of them is married, and the other is, like, a friend.

reference_spacy_tokens: It 's about these two women , and one of them is married , and the other is , like , a friend .


fn_spacy_tokens_for_baseline: I was getting through by starting to smoke dope and take acid .

source_bert_toks: i was getting through by starting to smoke do ##pe and take acid .

reference_raw: I've been trying to get through this by starting to smoke dope and take some sour.

reference_spacy_tokens: I 've been trying to get through this by starting to smoke dope and take some sour .


fn_spacy_tokens_for_baseline: ' Before , we 'd do clearing operations with sweeps through town but fail to hold ground once our troops left .

source_bert_toks: ' before , we ' d do clearing operations with sweeps through town but fail to hold ground once our troops left .

reference_raw: 'We used to do clean-ups through the city, but when our troops left, we wouldn't be able to hold back.

reference_spacy_tokens: ' We used to do clean - ups through the city , but when our troops left , we would n't be able to hold back .


fn_spacy_tokens_for_baseline: Later , when Aurangzeb ordered the decapitation of the naked fakir Sarmad , an Armenian Jew who had converted to Islam , the sage allegedly picked up his head and walked up the steps of the Jama Masjid .

source_bert_toks: later , when aura ##ng ##ze ##b ordered the dec ##ap ##itation of the naked fa ##kir sar ##mad , an armenian jew who had converted to islam , the sage allegedly picked up his head and walked up the steps of the jam ##a masjid .

reference_raw: Later, when Aurangzeb ordered the head of the naked fakir Sarmad, an Armenian Jew who had converted to Islam, the sage supposedly lifted his head and went up the steps of the Jama Masjid.

reference_spacy_tokens: Later , when Aurangzeb ordered the head of the naked fakir Sarmad , an Armenian Jew who had converted to Islam , the sage supposedly lifted his head and went up the steps of the Jama Masjid .


fn_spacy_tokens_for_baseline: If he stays there too long he will slip into the dirty wind like C , so he must tack off quickly .

source_bert_toks: if he stays there too long he will slip into the dirty wind like c , so he must tack off quickly .

reference_raw: If she stays there too long, she'll slip into the dirty wind like C, so she'll have to take off fast.

reference_spacy_tokens: If she stays there too long , she 'll slip into the dirty wind like C , so she 'll have to take off fast .


fn_spacy_tokens_for_baseline: A mixture of kerosene , petrol and heavy fuel oil was pumped from the shore through pipes , and ignited underwater by canisters of calcium phosphorus .

source_bert_toks: a mixture of ke ##rose ##ne , petrol and heavy fuel oil was pumped from the shore through pipes , and ignited underwater by can ##ister ##s of calcium phosphorus .

reference_raw: A mixture of kerosene, gasoline and heavy fuel oil has been pumped from the coast by pipes and ignited underwater with cans of calcium phosphorus.

reference_spacy_tokens: A mixture of kerosene , gasoline and heavy fuel oil has been pumped from the coast by pipes and ignited underwater with cans of calcium phosphorus .


fn_spacy_tokens_for_baseline: The government says local authorities can narrow the care gap by pushing down prices in the independent sector .

source_bert_toks: the government says local authorities can narrow the care gap by pushing down prices in the independent sector .

reference_raw: According to the government, local authorities can narrow the care gap by lowering prices in an independent sector.

reference_spacy_tokens: According to the government , local authorities can narrow the care gap by lowering prices in an independent sector .


fn_spacy_tokens_for_baseline: Instead , I shall be working on a novella and some short stories . that 's my kind of thing . '

source_bert_toks: instead , i shall be working on a novella and some short stories . that ' s my kind of thing . '

reference_raw: Instead, I'm going to work on a novel and a few short stories . . . that's my thing.'

reference_spacy_tokens: Instead , I 'm going to work on a novel and a few short stories . . . that 's my thing . '


fn_spacy_tokens_for_baseline: I was abominably ill - mannered , and I apologize .

source_bert_toks: i was ab ##omi ##na ##bly ill - manner ##ed , and i apologize .

reference_raw: I've been rude, and I'm sorry.

reference_spacy_tokens: I 've been rude , and I 'm sorry .


fn_spacy_tokens_for_baseline: It was surrounded by a splendid park , and its superb gardens ornamented with fountains and a magnificent cascade made of it a cool and airy summer residence .

source_bert_toks: it was surrounded by a splendid park , and its superb gardens or ##name ##nted with fountains and a magnificent cascade made of it a cool and air ##y summer residence .

reference_raw: It was surrounded by a beautiful park, its beautiful gardens decorated with fountains and a magnificent cascade made it a cool, airy summer residence.

reference_spacy_tokens: It was surrounded by a beautiful park , its beautiful gardens decorated with fountains and a magnificent cascade made it a cool , airy summer residence .


fn_spacy_tokens_for_baseline: Eliot asked to be shown the lavatory .

source_bert_toks: eliot asked to be shown the lava ##tory .

reference_raw: Eliot asked me to show him the bathroom.

reference_spacy_tokens: Eliot asked me to show him the bathroom .


fn_spacy_tokens_for_baseline: Two years later , Peyton commanded a regiment in William of Orange 's invasion force against James II .

source_bert_toks: two years later , peyton commanded a regiment in william of orange ' s invasion force against james ii .

reference_raw: Two years later, Peyton was in charge of the William of Orange invasion force against James II.

reference_spacy_tokens: Two years later , Peyton was in charge of the William of Orange invasion force against James II .


fn_spacy_tokens_for_baseline: She took off the voluminous apron Cook had lent her and went in search of her charge .

source_bert_toks: she took off the vol ##umi ##nous apron cook had lent her and went in search of her charge .

reference_raw: She removed the bulky apron Cook had lent her and went looking for her charge.

reference_spacy_tokens: She removed the bulky apron Cook had lent her and went looking for her charge .


fn_spacy_tokens_for_baseline: The approach to course design emphasises the development of understanding of key ideas rather than extensive memorisation of detailed factual information .

source_bert_toks: the approach to course design emphasis ##es the development of understanding of key ideas rather than extensive memo ##ris ##ation of detailed factual information .

reference_raw: The approach to course design highlights the development of understanding of key ideas rather than the extensive memorization of detailed factual information.

reference_spacy_tokens: The approach to course design highlights the development of understanding of key ideas rather than the extensive memorization of detailed factual information .


fn_spacy_tokens_for_baseline: However , the kick enjoys a measure of success because it can literally curl around an otherwise effective guard and thump into the back of the opponent 's head .

source_bert_toks: however , the kick enjoys a measure of success because it can literally curl around an otherwise effective guard and thump into the back of the opponent ' s head .

reference_raw: But the kick has a certain amount of success, because it can literally curl around the otherwise effective guard and hit the back of the opponent's head.

reference_spacy_tokens: But the kick has a certain amount of success , because it can literally curl around the otherwise effective guard and hit the back of the opponent 's head .


fn_spacy_tokens_for_baseline: ' Something has been killed and something has been burned .

source_bert_toks: ' something has been killed and something has been burned .

reference_raw: 'Something was killed and something was incinerated.

reference_spacy_tokens: ' Something was killed and something was incinerated .


fn_spacy_tokens_for_baseline: Two grey - haired ladies sat either side of a fire eating green soup from wide dishes on their knees .

source_bert_toks: two grey - haired ladies sat either side of a fire eating green soup from wide dishes on their knees .

reference_raw: Two gray-haired ladies sat on either side of the fire, eating green soup from the broad dishes on their knees.

reference_spacy_tokens: Two gray - haired ladies sat on either side of the fire , eating green soup from the broad dishes on their knees .


fn_spacy_tokens_for_baseline: Only that would explain his short lace - trimmed jerkin and the tight red hose .

source_bert_toks: only that would explain his short lace - trimmed jerk ##in and the tight red hose .

reference_raw: Only that would explain his short, lace-trimmed jacket and his tight red stocking.

reference_spacy_tokens: Only that would explain his short , lace - trimmed jacket and his tight red stocking .


fn_spacy_tokens_for_baseline: So much so that I bought his only copy of it , and earned his cordial loathing .

source_bert_toks: so much so that i bought his only copy of it , and earned his cord ##ial lo ##athing .

reference_raw: So much so that I bought his only copy and earned his heartfelt hatred.

reference_spacy_tokens: So much so that I bought his only copy and earned his heartfelt hatred .


fn_spacy_tokens_for_baseline: A nanny has been jailed after fracturing the skulls of two new born babies in her care .

source_bert_toks: a nanny has been jailed after fra ##cturing the skulls of two new born babies in her care .

reference_raw: The babysitter was arrested after breaking the skulls of two newborn babies in her care.

reference_spacy_tokens: The babysitter was arrested after breaking the skulls of two newborn babies in her care .


fn_spacy_tokens_for_baseline: " The Iranians are now willing to accept the installation of cameras only outside the cascade halls , which will not enable the IAEA to monitor the entire uranium enrichment process , " the diplomat said .

source_bert_toks: " the iranian ##s are now willing to accept the installation of cameras only outside the cascade halls , which will not enable the ia ##ea to monitor the entire uranium enrichment process , " the diplomat said .

reference_raw: "The Iranians are now willing to accept that cameras will only be installed outside the cascade halls, so that the IAEA will not be able to monitor the entire enrichment process of uranium," the diplomat said.

reference_spacy_tokens: " The Iranians are now willing to accept that cameras will only be installed outside the cascade halls , so that the IAEA will not be able to monitor the entire enrichment process of uranium , " the diplomat said .


fn_spacy_tokens_for_baseline: Even though now everyone knew the agent 's real name , they preferred his operational code - name .

source_bert_toks: even though now everyone knew the agent ' s real name , they preferred his operational code - name .

reference_raw: Although everyone knew the agent's real name now, they preferred his operational code name.

reference_spacy_tokens: Although everyone knew the agent 's real name now , they preferred his operational code name .


fn_spacy_tokens_for_baseline: These personnel have the potential to bring back a tremendous wealth of technical expertise and experience .

source_bert_toks: these personnel have the potential to bring back a tremendous wealth of technical expertise and experience .

reference_raw: These staff can bring back a great deal of technical expertise and experience.

reference_spacy_tokens: These staff can bring back a great deal of technical expertise and experience .


fn_spacy_tokens_for_baseline: It will also be used to help maintain the infrastructure that fosters and supports the development of effective relationships , including volunteer orientation and training and ongoing supervision and support by a professional staff .

source_bert_toks: it will also be used to help maintain the infrastructure that foster ##s and supports the development of effective relationships , including volunteer orientation and training and ongoing supervision and support by a professional staff .

reference_raw: It will also contribute to the maintenance of infrastructure supporting and supporting the development of effective relations, including voluntary orientation, training and ongoing supervision and support by professionals.

reference_spacy_tokens: It will also contribute to the maintenance of infrastructure supporting and supporting the development of effective relations , including voluntary orientation , training and ongoing supervision and support by professionals .


fn_spacy_tokens_for_baseline: In 1976 , a Danish film - maker called Jens Jorgen Thorsen came to Britain with the intention of making a film , provisionally entitled The Many Faces of Jesus .

source_bert_toks: in 1976 , a danish film - maker called jens jorge ##n thor ##sen came to britain with the intention of making a film , provisional ##ly entitled the many faces of jesus .

reference_raw: In 1976, a Danish filmmaker named Jens Jorgen Thorsen came to the United Kingdom with the intention of making a film, provisionally known as the Many Faces of Jesus.

reference_spacy_tokens: In 1976 , a Danish filmmaker named Jens Jorgen Thorsen came to the United Kingdom with the intention of making a film , provisionally known as the Many Faces of Jesus .


fn_spacy_tokens_for_baseline: The beacons went out , but as the Junkers taxied to its arrival area the pilot used a spotlight , and the spotlight swept over a flock of 109s , widely dispersed .

source_bert_toks: the beacon ##s went out , but as the junk ##ers taxi ##ed to its arrival area the pilot used a spotlight , and the spotlight swept over a flock of 109 ##s , widely dispersed .

reference_raw: The lighthouses went out, but as the Junkers rode into the landing area, the pilot used the spotlight, and the spotlight swept over a flock of 109s, widely dispersed.

reference_spacy_tokens: The lighthouses went out , but as the Junkers rode into the landing area , the pilot used the spotlight , and the spotlight swept over a flock of 109s , widely dispersed .


fn_spacy_tokens_for_baseline: But , as people began to ask , in what circumstances would such an act of out - and - out mass annihilation be justified ?

source_bert_toks: but , as people began to ask , in what circumstances would such an act of out - and - out mass ann ##ih ##ilation be justified ?

reference_raw: But, as people began to ask, under what circumstances would such an act of mass destruction be justified?

reference_spacy_tokens: But , as people began to ask , under what circumstances would such an act of mass destruction be justified ?


fn_spacy_tokens_for_baseline: U. S. warplanes and helicopters took off from Bagram air base , the headquarters of the U. S. -led coalition , throughout Saturday .

source_bert_toks: u . s . warp ##lane ##s and helicopters took off from bag ##ram air base , the headquarters of the u . s . - led coalition , throughout saturday .

reference_raw: U.S. warplanes and helicopters flew out of Bagram Air Force Base, U.S.-led coalition headquarters, all Saturday.

reference_spacy_tokens: U.S. warplanes and helicopters flew out of Bagram Air Force Base , U.S.-led coalition headquarters , all Saturday .


fn_spacy_tokens_for_baseline: Laura stared up at Ross in stupefied amazement .

source_bert_toks: laura stared up at ross in stu ##pe ##fied amazement .

reference_raw: Laura looked at Ross in stunned surprise.

reference_spacy_tokens: Laura looked at Ross in stunned surprise .


fn_spacy_tokens_for_baseline: Prince Charles is sitting with his legs spread but there is a give - away sign of his unease : he is nervously playing with his cuff - links .

source_bert_toks: prince charles is sitting with his legs spread but there is a give - away sign of his unease : he is nervously playing with his cuff - links .

reference_raw: Prince Charles sits with his legs outstretched, but there is a faint hint of his unease: he plays nervously with his cufflinks.

reference_spacy_tokens: Prince Charles sits with his legs outstretched , but there is a faint hint of his unease : he plays nervously with his cufflinks .


fn_spacy_tokens_for_baseline: Hazel held him down with both forepaws and he grew quieter .

source_bert_toks: hazel held him down with both fore ##pa ##ws and he grew quieter .

reference_raw: Hazel held him down with both front paws, and he fell silent.

reference_spacy_tokens: Hazel held him down with both front paws , and he fell silent .


fn_spacy_tokens_for_baseline: She was almost profligate in her generosity . '

source_bert_toks: she was almost prof ##liga ##te in her generosity . '

reference_raw: She was almost proficient in her generosity.'

reference_spacy_tokens: She was almost proficient in her generosity . '


fn_spacy_tokens_for_baseline: For example , Walter Laqueur , a terrorism specialist at the Center for Strategic and International Studies in Washington , D.C. , defines terrorism as : " The sub - state application of violence or threatened violence intended to sow panic in a society , to weaken or even overthrow the incumbents , and to bring about political change . "

source_bert_toks: for example , walter la ##que ##ur , a terrorism specialist at the center for strategic and international studies in washington , d . c . , defines terrorism as : " the sub - state application of violence or threatened violence intended to so ##w panic in a society , to weaken or even overthrow the incumbent ##s , and to bring about political change . "

reference_raw: For example, Walter Laqueur, a terrorist specialist at the Center for Strategic and International Studies in Washington, Washington, D.C., defines terrorism as "a sub-state application of violence or threat of violence aimed at sowing panic in society, weakening or even overthrowing incumbents, and bringing about political change."

reference_spacy_tokens: For example , Walter Laqueur , a terrorist specialist at the Center for Strategic and International Studies in Washington , Washington , D.C. , defines terrorism as " a sub - state application of violence or threat of violence aimed at sowing panic in society , weakening or even overthrowing incumbents , and bringing about political change . "


fn_spacy_tokens_for_baseline: No doubt this would be considered fashionable today but the thought of going out like that mortified me .

source_bert_toks: no doubt this would be considered fashionable today but the thought of going out like that mort ##ified me .

reference_raw: I'm sure it'd be considered fashionable today, but the thought of going out like this made me sick.

reference_spacy_tokens: I 'm sure it 'd be considered fashionable today , but the thought of going out like this made me sick .


fn_spacy_tokens_for_baseline: As the verdict was read , scores of Banda supporters in the court and about 400 waiting outside cheered and ululated , waving flags of his Malawi Congress Party .

source_bert_toks: as the verdict was read , scores of banda supporters in the court and about 400 waiting outside cheered and ul ##ulated , waving flags of his malawi congress party .

reference_raw: As the verdict was read, dozens of Banda supporters in the court and about four hundred waiting outside cheered and cheered, waving the flags of his Malawi Congressional Party.

reference_spacy_tokens: As the verdict was read , dozens of Banda supporters in the court and about four hundred waiting outside cheered and cheered , waving the flags of his Malawi Congressional Party .


fn_spacy_tokens_for_baseline: To be sure , the president is usually the dominant partner in the legislative process ; most major legislative initiatives come from him and little legislation of real consequence is likely to pass without his support .

source_bert_toks: to be sure , the president is usually the dominant partner in the legislative process ; most major legislative initiatives come from him and little legislation of real consequence is likely to pass without his support .

reference_raw: Of course, the President is usually the dominant partner in the legislative procedure; most important legislative initiatives come from him, and few laws with real implications are likely to pass without his support.

reference_spacy_tokens: Of course , the President is usually the dominant partner in the legislative procedure ; most important legislative initiatives come from him , and few laws with real implications are likely to pass without his support .


fn_spacy_tokens_for_baseline: The West Highland Way crosses vast tracts with no accommodation or other facilities ; the Southern Upland Way is a dreary slog over bleak , windswept and desolate hilltops , likely to attract only those who do it ' because it 's there ' .

source_bert_toks: the west highland way crosses vast tracts with no accommodation or other facilities ; the southern upland way is a dr ##ear ##y sl ##og over bleak , winds ##we ##pt and des ##olate hilltop ##s , likely to attract only those who do it ' because it ' s there ' .

reference_raw: The West Highland Road crosses vast tracts without accommodation or other facilities; the South Upland Road is a dreary slope over the bleak, wind-swept, deserted hilltops, which is likely to attract only those who do it because it is there.

reference_spacy_tokens: The West Highland Road crosses vast tracts without accommodation or other facilities ; the South Upland Road is a dreary slope over the bleak , wind - swept , deserted hilltops , which is likely to attract only those who do it because it is there .


fn_spacy_tokens_for_baseline: However , she had no intention of revealing her gratification to Anne .

source_bert_toks: however , she had no intention of revealing her gr ##ati ##fication to anne .

reference_raw: But she had no intention of revealing her satisfaction to Anna.

reference_spacy_tokens: But she had no intention of revealing her satisfaction to Anna .


fn_spacy_tokens_for_baseline: Sir Henry , it will be recalled , was the seventeenth - century poet and diplomat who defined an ambassador as ' an honest man sent to lie abroad for the the good of his country . '

source_bert_toks: sir henry , it will be recalled , was the seventeenth - century poet and diplomat who defined an ambassador as ' an honest man sent to lie abroad for the the good of his country . '

reference_raw: Sir Henry, as I recall, was a poet and diplomat of the seventeenth century who defined the ambassador as "an honorable man sent to lie abroad for the good of his country."

reference_spacy_tokens: Sir Henry , as I recall , was a poet and diplomat of the seventeenth century who defined the ambassador as " an honorable man sent to lie abroad for the good of his country . "


fn_spacy_tokens_for_baseline: We arrive exhausted , haul in our rucsacs , check in again and hike back along the corridor to the airport .

source_bert_toks: we arrive exhausted , haul in our ru ##cs ##ac ##s , check in again and hike back along the corridor to the airport .

reference_raw: We arrive exhausted, pull up our backpacks, check in again, and go back down the corridor to the airport.

reference_spacy_tokens: We arrive exhausted , pull up our backpacks , check in again , and go back down the corridor to the airport .


fn_spacy_tokens_for_baseline: On the back seat the two sherry glasses clinked as Rufus took a left turn rather too sharply .

source_bert_toks: on the back seat the two sherry glasses cl ##ink ##ed as rufus took a left turn rather too sharply .

reference_raw: Two sherry glasses clicked in the backseat as Rufus turned to the left a bit too sharply.

reference_spacy_tokens: Two sherry glasses clicked in the backseat as Rufus turned to the left a bit too sharply .


fn_spacy_tokens_for_baseline: ' Follow and find ! ' he hoots .

source_bert_toks: ' follow and find ! ' he ho ##ots .

reference_raw: "Follow and find!" he shouts.

reference_spacy_tokens: " Follow and find ! " he shouts .


fn_spacy_tokens_for_baseline: The sun sparkled on the plates and , wet - haired from the pool , the children were being unusually helpful in the kitchen .

source_bert_toks: the sun sparkled on the plates and , wet - haired from the pool , the children were being unusually helpful in the kitchen .

reference_raw: The sun was shining on the plates, and the children were unusually useful in the kitchen with wet hair from the pool.

reference_spacy_tokens: The sun was shining on the plates , and the children were unusually useful in the kitchen with wet hair from the pool .


fn_spacy_tokens_for_baseline: And the great lays -- you can learn them , meantime .

source_bert_toks: and the great lays - - you can learn them , meantime .

reference_raw: And the great lies -- in the meantime, you can learn them.

reference_spacy_tokens: And the great lies -- in the meantime , you can learn them .


fn_spacy_tokens_for_baseline: The dusty sheen of the glass made it stand out from the backing , made it look like a mirror into another room .

source_bert_toks: the dusty sheen of the glass made it stand out from the backing , made it look like a mirror into another room .

reference_raw: The dusty sheet of glass made him stand out from behind, making him look like a mirror in another room.

reference_spacy_tokens: The dusty sheet of glass made him stand out from behind , making him look like a mirror in another room .


fn_spacy_tokens_for_baseline: I got up and dressed in a sweater and pants , made my bed , then sat on the end and shook physically with anxiety .

source_bert_toks: i got up and dressed in a sweater and pants , made my bed , then sat on the end and shook physically with anxiety .

reference_raw: I got up, put on a sweater and trousers, made a bed, and sat on the end of it, shaking physically with anxiety.

reference_spacy_tokens: I got up , put on a sweater and trousers , made a bed , and sat on the end of it , shaking physically with anxiety .


fn_spacy_tokens_for_baseline: In 1900 there were thirty museums , but by 1950 the number had exploded to 410 .

source_bert_toks: in 1900 there were thirty museums , but by 1950 the number had exploded to 410 .

reference_raw: There were thirty museums in 1900, but in 1950 the number went up to 410.

reference_spacy_tokens: There were thirty museums in 1900 , but in 1950 the number went up to 410 .


fn_spacy_tokens_for_baseline: He also made some modest remark about his achievement , such as it was , and hazarded the opinion that he might best be remembered by his devotion to cheese .

source_bert_toks: he also made some modest remark about his achievement , such as it was , and hazard ##ed the opinion that he might best be remembered by his devotion to cheese .

reference_raw: He also made a modest remark about his success, for example, and risked thinking that his devotion to cheese would be the best way to remember him.

reference_spacy_tokens: He also made a modest remark about his success , for example , and risked thinking that his devotion to cheese would be the best way to remember him .


fn_spacy_tokens_for_baseline: Israeli incursion into UNIFIL area -- Subsequent rocket attacks into Israel

source_bert_toks: israeli inc ##urs ##ion into un ##if ##il area - - subsequent rocket attacks into israel

reference_raw: Israeli invasion of UNIFIL - Subsequent missile attacks on Israel


fn_spacy_tokens_for_baseline: His selflessness demonstrated that Debussy 's music can do without the fancy apparel that many other artists might unthinkingly have bestowed upon it . '

source_bert_toks: his self ##lessness demonstrated that de ##bus ##sy ' s music can do without the fancy apparel that many other artists might un ##thi ##nk ##ingly have bestowed upon it . '

reference_raw: His unselfishness showed that Debussy's music could do without the fancy clothing that many other artists could inadvertently give him.'

reference_spacy_tokens: His unselfishness showed that Debussy 's music could do without the fancy clothing that many other artists could inadvertently give him . '


fn_spacy_tokens_for_baseline: Follow Me , for example , was produced in association with several German television companies for a group of evening institutes in Germany .

source_bert_toks: follow me , for example , was produced in association with several german television companies for a group of evening institutes in germany .

reference_raw: Follow Me, for example, was created in association with a number of German television companies for a group of evening institutes in Germany.

reference_spacy_tokens: Follow Me , for example , was created in association with a number of German television companies for a group of evening institutes in Germany .


fn_spacy_tokens_for_baseline: The car reels and swerves up on to the pavement , crashing into a shopfront and shattering itself and the window panes .

source_bert_toks: the car reel ##s and sw ##er ##ves up on to the pavement , crashing into a shop ##front and shattering itself and the window pan ##es .

reference_raw: The car rolls and rolls onto the sidewalk, hits the storefront, shatters itself and the window panels.

reference_spacy_tokens: The car rolls and rolls onto the sidewalk , hits the storefront , shatters itself and the window panels .


fn_spacy_tokens_for_baseline: ' Oh , it is , ' Peter felt light - headed , tipsy on a small pink gin , but still completely in control .

source_bert_toks: ' oh , it is , ' peter felt light - headed , tips ##y on a small pink gin , but still completely in control .

reference_raw: "Oh, yes," Peter said, feeling light-headed and drunk on a small pink gin, but he was still in complete control.

reference_spacy_tokens: " Oh , yes , " Peter said , feeling light - headed and drunk on a small pink gin , but he was still in complete control .


fn_spacy_tokens_for_baseline: Mr Sugden got to his feet when his bonds were cut and straightened his tie before he spoke .

source_bert_toks: mr su ##g ##den got to his feet when his bonds were cut and straightened his tie before he spoke .

reference_raw: Mr. Sugden stood up as he cut the cuffs and straightened the tie before speaking.

reference_spacy_tokens: Mr. Sugden stood up as he cut the cuffs and straightened the tie before speaking .


fn_spacy_tokens_for_baseline: Fear in the North of environmental degradation provides the South with the leverage which did not exist before ' .

source_bert_toks: fear in the north of environmental degradation provides the south with the leverage which did not exist before ' .

reference_raw: Fear of environmental degradation in the north gives the southern a leverage that didn't exist before.

reference_spacy_tokens: Fear of environmental degradation in the north gives the southern a leverage that did n't exist before .


fn_spacy_tokens_for_baseline: Maybe she was hoping to asphyxiate him with carbon monoxide fumes .

source_bert_toks: maybe she was hoping to as ##phy ##xia ##te him with carbon mono ##xide fu ##mes .

reference_raw: Maybe she was hoping to smother him with carbon monoxide fumes.

reference_spacy_tokens: Maybe she was hoping to smother him with carbon monoxide fumes .


fn_spacy_tokens_for_baseline: The waterfront drive parallels the shore of a Chinese island , and boats headed to China pass through the narrow waterway .

source_bert_toks: the waterfront drive parallels the shore of a chinese island , and boats headed to china pass through the narrow waterway .

reference_raw: The coastline runs parallel to the coast of the Chinese island, and ships heading for China pass through the narrow waterway.

reference_spacy_tokens: The coastline runs parallel to the coast of the Chinese island , and ships heading for China pass through the narrow waterway .


fn_spacy_tokens_for_baseline: He would of course never dream of playing these tapes on the music centre at home , risking the derision of his children .

source_bert_toks: he would of course never dream of playing these tapes on the music centre at home , risking the der ##ision of his children .

reference_raw: Of course, he would never dream of playing these tapes at home at the music center, risking mocking his children.

reference_spacy_tokens: Of course , he would never dream of playing these tapes at home at the music center , risking mocking his children .


fn_spacy_tokens_for_baseline: When it was over , Hughes owned six casinos , an airport , and an airline , along with numerous plots of land stretching from the Strip to the mountains .

source_bert_toks: when it was over , hughes owned six casinos , an airport , and an airline , along with numerous plots of land stretching from the strip to the mountains .

reference_raw: When it was over, Hughes owned six casinos, an airport, and an airline, along with a lot of land stretching from the Strip to the mountains.

reference_spacy_tokens: When it was over , Hughes owned six casinos , an airport , and an airline , along with a lot of land stretching from the Strip to the mountains .


fn_spacy_tokens_for_baseline: Lying in each other 's arms in the afternoon , listening to the raindrops pattering on to the leaves of the shrubbery , draining a champagne bottle .

source_bert_toks: lying in each other ' s arms in the afternoon , listening to the rain ##drop ##s pat ##tering on to the leaves of the shrub ##bery , draining a champagne bottle .

reference_raw: They lay in each other's arms in the afternoon, listening to the raindrops splashing on the leaves of the bushes and draining a bottle of champagne.

reference_spacy_tokens: They lay in each other 's arms in the afternoon , listening to the raindrops splashing on the leaves of the bushes and draining a bottle of champagne .


fn_spacy_tokens_for_baseline: They are smooth and stiff but will serve if I scrunch them up before use .

source_bert_toks: they are smooth and stiff but will serve if i sc ##run ##ch them up before use .

reference_raw: They're smooth and stiff, but they'll work if I scratch them before use.

reference_spacy_tokens: They 're smooth and stiff , but they 'll work if I scratch them before use .


fn_spacy_tokens_for_baseline: The only force generally believed to be sufficiently powerful is the high - energy impact of a large asteroidal fragment on the Moon .

source_bert_toks: the only force generally believed to be sufficiently powerful is the high - energy impact of a large asteroid ##al fragment on the moon .

reference_raw: The only force generally believed to be strong enough is the high-energy impact of a large asteroid shard on the moon.

reference_spacy_tokens: The only force generally believed to be strong enough is the high - energy impact of a large asteroid shard on the moon .


fn_spacy_tokens_for_baseline: He heard a click and stepped back quickly as the bolt thudded into the wall of the derelict house behind him .

source_bert_toks: he heard a click and stepped back quickly as the bolt thud ##ded into the wall of the derelict house behind him .

reference_raw: He heard a click and backed away as the bolt slammed into the wall of the abandoned house behind him.

reference_spacy_tokens: He heard a click and backed away as the bolt slammed into the wall of the abandoned house behind him .


fn_spacy_tokens_for_baseline: The girls in their different ways wanted to gather their father and the whole , true , heartbreaking day into their arms .

source_bert_toks: the girls in their different ways wanted to gather their father and the whole , true , heartbreak ##ing day into their arms .

reference_raw: The girls, in their various ways, wanted to put their father and the whole, true, heart-breaking day in their arms.

reference_spacy_tokens: The girls , in their various ways , wanted to put their father and the whole , true , heart - breaking day in their arms .


fn_spacy_tokens_for_baseline: A man has been charged with causing death by careless driving after drinking excessively .

source_bert_toks: a man has been charged with causing death by careless driving after drinking excessive ##ly .

reference_raw: A man was accused of causing death by reckless driving after drinking too much.

reference_spacy_tokens: A man was accused of causing death by reckless driving after drinking too much .


fn_spacy_tokens_for_baseline: Another erring headsman , Meister Hans , guilty of treason , suffered the indignity of being decapitated by his own assistant in 1479 .

source_bert_toks: another er ##ring heads ##man , mei ##ster hans , guilty of treason , suffered the ind ##ign ##ity of being dec ##ap ##itated by his own assistant in 147 ##9 .

reference_raw: Another errand leader, Meister Hans, guilty of treason, was outraged by his own assistant's decapitation in 1479.

reference_spacy_tokens: Another errand leader , Meister Hans , guilty of treason , was outraged by his own assistant 's decapitation in 1479 .


fn_spacy_tokens_for_baseline: At this final glimpse , he was going to join a new mistress in Pisa , while Clairmont went on to Florence , then shrouded in thick fog .

source_bert_toks: at this final glimpse , he was going to join a new mistress in pisa , while clair ##mont went on to florence , then sh ##roud ##ed in thick fog .

reference_raw: At that last glance, he was about to join his new mistress in Pisa, and Clairmont went on to Florence, then wrapped in a thick mist.

reference_spacy_tokens: At that last glance , he was about to join his new mistress in Pisa , and Clairmont went on to Florence , then wrapped in a thick mist .


fn_spacy_tokens_for_baseline: Botham has been in pain since the fourth day of this 546-mile hike from Land 's End to Margate , with a deep - seated blister on his achilles tendon .

source_bert_toks: both ##am has been in pain since the fourth day of this 54 ##6 - mile hike from land ' s end to mar ##gate , with a deep - seated b ##list ##er on his achilles tend ##on .

reference_raw: Botham had been in pain since the fourth day of this 546-mile trip from Land's End to Margate, with a deep-seated blister on his Achilles tendon.

reference_spacy_tokens: Botham had been in pain since the fourth day of this 546-mile trip from Land 's End to Margate , with a deep - seated blister on his Achilles tendon .


fn_spacy_tokens_for_baseline: Mortar rounds arched toward the U. S. and Iraqi forces as they pressed into the warren of houses , offices and apartment blocks that surround Haifa Street .

source_bert_toks: mortar rounds arched toward the u . s . and iraqi forces as they pressed into the warren of houses , offices and apartment blocks that surround haifa street .

reference_raw: The mortar rounds curved toward the U.S. and Iraqi forces as they pushed into the corridor of buildings, offices, and apartment blocks surrounding Haifa Street.

reference_spacy_tokens: The mortar rounds curved toward the U.S. and Iraqi forces as they pushed into the corridor of buildings , offices , and apartment blocks surrounding Haifa Street .


fn_spacy_tokens_for_baseline: At the cessation of hostilities in 1945 , the works got back to its pre - war role .

source_bert_toks: at the ce ##ssa ##tion of hostilities in 1945 , the works got back to its pre - war role .

reference_raw: When the enmity ended in 1945, the work returned to its pre-war role.

reference_spacy_tokens: When the enmity ended in 1945 , the work returned to its pre - war role .


fn_spacy_tokens_for_baseline: This was the closest she had ever ventured to him , and she was forcefully aware of masculine warmth and cleanliness and an indefinable something else -- an aura , almost -- that for some reason made her nerve ends prickle warningly .

source_bert_toks: this was the closest she had ever ventured to him , and she was forcefully aware of masculine warmth and clean ##liness and an ind ##ef ##ina ##ble something else - - an aura , almost - - that for some reason made her nerve ends prick ##le warning ##ly .

reference_raw: It was the closest she'd ever ventured to him, and she was acutely aware of the man's warmth and purity and the indefinable something else - an aura, almost - that, for some reason, her nerve ends were prickly.

reference_spacy_tokens: It was the closest she 'd ever ventured to him , and she was acutely aware of the man 's warmth and purity and the indefinable something else - an aura , almost - that , for some reason , her nerve ends were prickly .


fn_spacy_tokens_for_baseline: Sir John , it appeared , had retained a sufficiently fond memory of his cousin , and was , besides , so moved by her plight that he went himself and fetched her back to Switham .

source_bert_toks: sir john , it appeared , had retained a sufficiently fond memory of his cousin , and was , besides , so moved by her plight that he went himself and fetch ##ed her back to sw ##itha ##m .

reference_raw: Sir John, it seemed, had kept a sufficiently fond memory of his cousin, and was so moved by her predicament that he went alone and brought her back to Switham.

reference_spacy_tokens: Sir John , it seemed , had kept a sufficiently fond memory of his cousin , and was so moved by her predicament that he went alone and brought her back to Switham .


fn_spacy_tokens_for_baseline: But the mulatto 's heart was with it , and he was driven back to it next day , when , on reconnoitering through the window , he found policeman Walters in possession .

source_bert_toks: but the mu ##lat ##to ' s heart was with it , and he was driven back to it next day , when , on rec ##on ##no ##iter ##ing through the window , he found policeman walters in possession .

reference_raw: But the mulatt's heart was with him, and he was driven back to it the next day, when, after exploring through the window, he found Officer Walters in his possession.

reference_spacy_tokens: But the mulatt 's heart was with him , and he was driven back to it the next day , when , after exploring through the window , he found Officer Walters in his possession .


fn_spacy_tokens_for_baseline: They 're camped on common land which everybody has access to .

source_bert_toks: they ' re camped on common land which everybody has access to .

reference_raw: They're encamped on a common ground that everyone has access to.

reference_spacy_tokens: They 're encamped on a common ground that everyone has access to .


fn_spacy_tokens_for_baseline: She had begun to feel quite horny herself reciting the exercise .

source_bert_toks: she had begun to feel quite horn ##y herself rec ##iting the exercise .

reference_raw: She was beginning to feel quite agitated herself, reciting the exercise.

reference_spacy_tokens: She was beginning to feel quite agitated herself , reciting the exercise .


fn_spacy_tokens_for_baseline: ' Your rudeness , your infuriating superiority , and your lack of patience with anyone who is n't psychic enough to know what you want before you ask for it . '

source_bert_toks: ' your rude ##ness , your in ##fur ##iating superiority , and your lack of patience with anyone who isn ' t psychic enough to know what you want before you ask for it . '

reference_raw: "Your rudeness, your outrageous superiority, and your lack of patience with someone who is not psychic enough to know what you want before you ask for it."

reference_spacy_tokens: " Your rudeness , your outrageous superiority , and your lack of patience with someone who is not psychic enough to know what you want before you ask for it . "


fn_spacy_tokens_for_baseline: Even though Marci gets to give him a cuddle from time to time and wash his favourite bright red undies .

source_bert_toks: even though marc ##i gets to give him a cu ##ddle from time to time and wash his favourite bright red und ##ies .

reference_raw: Although, from time to time, Marci caresses him and washes his favorite bright red underwear.

reference_spacy_tokens: Although , from time to time , Marci caresses him and washes his favorite bright red underwear .


fn_spacy_tokens_for_baseline: A return to the old plastic sack would presumably produce an equally instant reduction .

source_bert_toks: a return to the old plastic sack would presumably produce an equally instant reduction .

reference_raw: Returning to the old plastic bag would probably result in an equally immediate reduction.

reference_spacy_tokens: Returning to the old plastic bag would probably result in an equally immediate reduction .


fn_spacy_tokens_for_baseline: Lissa gazed up at him , at his vexed expression , and tried to quell the smile that pulled at her lips .

source_bert_toks: lissa gazed up at him , at his ve ##xed expression , and tried to que ##ll the smile that pulled at her lips .

reference_raw: Lissa looked up at him, at his venomous expression, and tried to suppress the smile on her lips.

reference_spacy_tokens: Lissa looked up at him , at his venomous expression , and tried to suppress the smile on her lips .


fn_spacy_tokens_for_baseline: Cnicht 's south - west ridge provides a rapid direct ascent to the summit , with some pleasant scrambling thrown in near the top , and as height is gained the views across Snowdonia gradually unfold .

source_bert_toks: cn ##ich ##t ' s south - west ridge provides a rapid direct ascent to the summit , with some pleasant scrambling thrown in near the top , and as height is gained the views across snow ##don ##ia gradually un ##fold .

reference_raw: The south-western ridge of Cnicht provides a quick straight climb to the top of the mountain, with a few pleasant scramblings to the top, and as the height gains, the view over Snowdonia gradually unfolds.

reference_spacy_tokens: The south - western ridge of Cnicht provides a quick straight climb to the top of the mountain , with a few pleasant scramblings to the top , and as the height gains , the view over Snowdonia gradually unfolds .


fn_spacy_tokens_for_baseline: Before he could say anything , the telephone on the Grecian plinth nearest to the girl gave a muted double purr .

source_bert_toks: before he could say anything , the telephone on the gr ##ec ##ian pl ##int ##h nearest to the girl gave a muted double pu ##rr .

reference_raw: Before he could say anything, the phone on the Greek plinth nearest the girl gave a muffled double whirr.

reference_spacy_tokens: Before he could say anything , the phone on the Greek plinth nearest the girl gave a muffled double whirr .


fn_spacy_tokens_for_baseline: Gone to Soldiers , however , is a book of dismaying sentimentality in which Piercy seems to have succumbed to enticing absolutes : heroism or cowardice ; innocence or culpability .

source_bert_toks: gone to soldiers , however , is a book of dismay ##ing sentimental ##ity in which pier ##cy seems to have succumbed to en ##tic ##ing absolute ##s : heroism or coward ##ice ; innocence or cu ##lp ##ability .

reference_raw: Going to the soldiers, however, is a book of terrible sentimentality, in which Piercy seems to have succumbed to the temptation of absolutes: heroism or cowardice, innocence or guilt.

reference_spacy_tokens: Going to the soldiers , however , is a book of terrible sentimentality , in which Piercy seems to have succumbed to the temptation of absolutes : heroism or cowardice , innocence or guilt .


fn_spacy_tokens_for_baseline: Philip would doubtless be gratified by an explicit recognition of his position as overlord of Aquitaine and Toulouse and might well concede something in return .

source_bert_toks: philip would doubt ##less be gr ##ati ##fied by an explicit recognition of his position as over ##lord of aquitaine and toulouse and might well con ##cede something in return .

reference_raw: Philip would undoubtedly be pleased with the explicit recognition of his position as ruler of Aquitaine and Toulouse, and he might well admit something in return.

reference_spacy_tokens: Philip would undoubtedly be pleased with the explicit recognition of his position as ruler of Aquitaine and Toulouse , and he might well admit something in return .


fn_spacy_tokens_for_baseline: Pressing her fingers to the knot of tension at the back of her neck , she massaged gently , then stretched her limbs to relieve some of her aching muscles .

source_bert_toks: pressing her fingers to the knot of tension at the back of her neck , she massage ##d gently , then stretched her limbs to relieve some of her aching muscles .

reference_raw: She pressed her fingers against the knot of tension at the back of her neck, rubbed gently, then stretched her limbs to relieve some of her aching muscles.

reference_spacy_tokens: She pressed her fingers against the knot of tension at the back of her neck , rubbed gently , then stretched her limbs to relieve some of her aching muscles .


fn_spacy_tokens_for_baseline: " Come , Fen . " he said , signalling him to come closer .

source_bert_toks: " come , fen . " he said , signalling him to come closer .

reference_raw: "Come on, Fen," he said, and motioned for him to approach.

reference_spacy_tokens: " Come on , Fen , " he said , and motioned for him to approach .


fn_spacy_tokens_for_baseline: She had worked strips of gold braid into the weave , and now she secured them in place .

source_bert_toks: she had worked strips of gold braid into the weave , and now she secured them in place .

reference_raw: She'd worked strips of gold wire into the weave, and now she'd secured them in place.

reference_spacy_tokens: She 'd worked strips of gold wire into the weave , and now she 'd secured them in place .


fn_spacy_tokens_for_baseline: Ed_Henry : What 's really going on is Democrats feel emboldened by the indictment of Vice President Cheney 's former chief of staff believing this is their chance to issue a broader indictment of the Bush administration .

source_bert_toks: ed _ henry : what ' s really going on is democrats feel em ##bold ##ened by the indictment of vice president cheney ' s former chief of staff believing this is their chance to issue a broader indictment of the bush administration .

reference_raw: Ed_Henry: What's really happening is that the democrats feel emboldened by the accusation that Vice President Cheney's ex-chief of staff believes that this is their chance to make a wider accusation against the Bush administration.

reference_spacy_tokens: Ed_Henry : What 's really happening is that the democrats feel emboldened by the accusation that Vice President Cheney 's ex - chief of staff believes that this is their chance to make a wider accusation against the Bush administration .


fn_spacy_tokens_for_baseline: The frequency of gap junctions in the gastric surface mucous cells of the patients with gastric ulcers and of healthy volunteers is shown in Table II .

source_bert_toks: the frequency of gap junctions in the gas ##tric surface mu ##cous cells of the patients with gas ##tric ul ##cer ##s and of healthy volunteers is shown in table ii .

reference_raw: The frequency of gaps in gastric surface mucosal cells in patients with gastric ulcers and in normal volunteers is shown in Table II.

reference_spacy_tokens: The frequency of gaps in gastric surface mucosal cells in patients with gastric ulcers and in normal volunteers is shown in Table II .


fn_spacy_tokens_for_baseline: The summer figures showed three rock climbing fatalities out of a total of 22 deaths in the mountains , of which five were accounted for by illness .

source_bert_toks: the summer figures showed three rock climbing fatalities out of a total of 22 deaths in the mountains , of which five were accounted for by illness .

reference_raw: Summer figures showed three rock-climbing deaths out of a total of 22 mountain deaths, five of which were due to disease.

reference_spacy_tokens: Summer figures showed three rock - climbing deaths out of a total of 22 mountain deaths , five of which were due to disease .


fn_spacy_tokens_for_baseline: These upstanding citizens are the Beatles of the balance - sheet , the Pavarottis of profit - and - loss .

source_bert_toks: these ups ##tan ##ding citizens are the beatles of the balance - sheet , the pa ##var ##otti ##s of profit - and - loss .

reference_raw: These honest citizens are the Beatles of the balance sheet, the Pavarottis of profit and loss.

reference_spacy_tokens: These honest citizens are the Beatles of the balance sheet , the Pavarottis of profit and loss .


fn_spacy_tokens_for_baseline: Melissa almost choked on a spoonful of yoghurt .

source_bert_toks: melissa almost choked on a spoon ##ful of yo ##gh ##urt .

reference_raw: Melissa nearly choked on the yogurt spoon.

reference_spacy_tokens: Melissa nearly choked on the yogurt spoon .


fn_spacy_tokens_for_baseline: At Hele , a mile east of the town centre , there is a sixteenth - century corn mill powered by an overshot waterwheel of 18-foot diameter .

source_bert_toks: at he ##le , a mile east of the town centre , there is a sixteenth - century corn mill powered by an overs ##hot water ##wheel of 18 - foot diameter .

reference_raw: There's a 16th-century corn mill in Hele, a mile west of the city centre, powered by an 18-foot water wheel.

reference_spacy_tokens: There 's a 16th - century corn mill in Hele , a mile west of the city centre , powered by an 18-foot water wheel .


fn_spacy_tokens_for_baseline: Yet , to this day , the estimation of future population size is a hazardous exercise ( though an essential one for local and national governments and indeed for the world as a whole ) .

source_bert_toks: yet , to this day , the estimation of future population size is a hazardous exercise ( though an essential one for local and national governments and indeed for the world as a whole ) .

reference_raw: However, to date, forecasting the future size of the population is a risky exercise (although necessary for local and national governments and even for the world as a whole).

reference_spacy_tokens: However , to date , forecasting the future size of the population is a risky exercise ( although necessary for local and national governments and even for the world as a whole ) .


fn_spacy_tokens_for_baseline: He pushes her on to the floor and lies on top of her , nearly smothering her .

source_bert_toks: he pushes her on to the floor and lies on top of her , nearly sm ##oth ##ering her .

reference_raw: He pushed her to the floor and lay on her, almost choking her.

reference_spacy_tokens: He pushed her to the floor and lay on her , almost choking her .


fn_spacy_tokens_for_baseline: She dabbed her lips with salt water again and crumbled some of the roasted chicken neck into her mouth .

source_bert_toks: she da ##bbed her lips with salt water again and cr ##umble ##d some of the roasted chicken neck into her mouth .

reference_raw: She dabbled her lips again with salt water, crumbling a piece of roasted chicken neck in her mouth.

reference_spacy_tokens: She dabbled her lips again with salt water , crumbling a piece of roasted chicken neck in her mouth .


fn_spacy_tokens_for_baseline: Her kids guzzle sugar all day , and the house is an absolute mess .

source_bert_toks: her kids gu ##zzle sugar all day , and the house is an absolute mess .

reference_raw: Her kids are drinking sugar all day, and the house is a total mess.

reference_spacy_tokens: Her kids are drinking sugar all day , and the house is a total mess .


fn_spacy_tokens_for_baseline: At one thirty - five by his watch , a small Citroen drove slowly down the slope from the road , crunching across the gravel and stopping within feet of his hiding place .

source_bert_toks: at one thirty - five by his watch , a small ci ##tro ##en drove slowly down the slope from the road , crunch ##ing across the gravel and stopping within feet of his hiding place .

reference_raw: At one thirty-five at his watch, a small Citroen rode slowly down the slope of the road, crumbling over the gravel and stopping just a few feet from his hiding place.

reference_spacy_tokens: At one thirty - five at his watch , a small Citroen rode slowly down the slope of the road , crumbling over the gravel and stopping just a few feet from his hiding place .


fn_spacy_tokens_for_baseline: The basic model for early Anglo - Saxon England is that small cohesive social units with low population densities merged by peaceful and forceful means into larger political agglomerations .

source_bert_toks: the basic model for early anglo - saxon england is that small co ##hesive social units with low population den ##sities merged by peaceful and forceful means into larger political ag ##gl ##ome ##rations .

reference_raw: The basic model of early Anglo-Saxon England is that small, cohesive social units with a low population density combine peacefully and forcefully into larger political agglomerations.

reference_spacy_tokens: The basic model of early Anglo - Saxon England is that small , cohesive social units with a low population density combine peacefully and forcefully into larger political agglomerations .


fn_spacy_tokens_for_baseline: A stronger team manager would have dealt quickly with what was obviously becoming an increasingly aggravating situation .

source_bert_toks: a stronger team manager would have dealt quickly with what was obviously becoming an increasingly ag ##gra ##vating situation .

reference_raw: A stronger team manager would be quick to deal with what seemed to be becoming an ever-increasing situation.

reference_spacy_tokens: A stronger team manager would be quick to deal with what seemed to be becoming an ever - increasing situation .


fn_spacy_tokens_for_baseline: Unsealed wooden slatted shelves can be treated with caustic cleaner , left in prolonged contact and pressure jet rinsed or brushed vigorously with hot clean water .

source_bert_toks: un ##sea ##led wooden sl ##att ##ed shelves can be treated with ca ##ust ##ic cleaner , left in prolonged contact and pressure jet ri ##nsed or brushed vigorously with hot clean water .

reference_raw: Unsealed wooden slatted shelves may be treated with a caustic cleaner, left in long-term contact and a pressure jet rinsed or washed vigorously with hot clean water.

reference_spacy_tokens: Unsealed wooden slatted shelves may be treated with a caustic cleaner , left in long - term contact and a pressure jet rinsed or washed vigorously with hot clean water .


fn_spacy_tokens_for_baseline: Most choreographers either have other responsibilities ( as a company director , for instance ) or are themselves tied to the strict daily schedule of a performer .

source_bert_toks: most choreographer ##s either have other responsibilities ( as a company director , for instance ) or are themselves tied to the strict daily schedule of a performer .

reference_raw: Most choreographers either have other responsibilities (e.g. as director of the company) or are themselves bound by the strict daily timetable of the performer.

reference_spacy_tokens: Most choreographers either have other responsibilities ( e.g. as director of the company ) or are themselves bound by the strict daily timetable of the performer .


fn_spacy_tokens_for_baseline: We doubt whether the shock - horror TV advertising campaign will directly stop youngsters sniffing solvents , but it should bring home the horrors of the practice to those who can do something about it parents .

source_bert_toks: we doubt whether the shock - horror tv advertising campaign will directly stop young ##sters sniffing solvent ##s , but it should bring home the horrors of the practice to those who can do something about it parents .

reference_raw: We doubt that a shocking television advertising campaign will directly stop young people from smelling solvents, but it should bring home the horrors of practice to those who can do something about their parents.

reference_spacy_tokens: We doubt that a shocking television advertising campaign will directly stop young people from smelling solvents , but it should bring home the horrors of practice to those who can do something about their parents .


fn_spacy_tokens_for_baseline: Despite saying he had no money they cracked his ribs . kicked his leg . stabbed him with a fork . and slashed at his face with a modelling knife .

source_bert_toks: despite saying he had no money they cracked his ribs . kicked his leg . stabbed him with a fork . and slashed at his face with a modelling knife .

reference_raw: Even though he said he didn't have any money, they broke his ribs... kicked him in the leg... stabbed him with a fork... and slashed him in the face with a modelling knife.

reference_spacy_tokens: Even though he said he did n't have any money , they broke his ribs ... kicked him in the leg ... stabbed him with a fork ... and slashed him in the face with a modelling knife .


fn_spacy_tokens_for_baseline: After months of fighting an enemy that stayed hundreds of yards away , the shock of facing them at a distance of twenty feet can not be overstated .

source_bert_toks: after months of fighting an enemy that stayed hundreds of yards away , the shock of facing them at a distance of twenty feet cannot be overs ##tated .

reference_raw: After months of fighting an enemy that was hundreds of yards away, it was impossible to overestimate the impact of facing them at a distance of twenty feet.

reference_spacy_tokens: After months of fighting an enemy that was hundreds of yards away , it was impossible to overestimate the impact of facing them at a distance of twenty feet .


fn_spacy_tokens_for_baseline: The aged , respectable leather - bound tomes of the Gould family library look down upon the nasty tale I have to tell with musty distaste .

source_bert_toks: the aged , respectable leather - bound tome ##s of the gould family library look down upon the nasty tale i have to tell with must ##y di ##sta ##ste .

reference_raw: The old, respectable, leather-bound toms of the Gould family library are looking down on the ugly story I must tell with stupendous distaste.

reference_spacy_tokens: The old , respectable , leather - bound toms of the Gould family library are looking down on the ugly story I must tell with stupendous distaste .


fn_spacy_tokens_for_baseline: Not surprisingly , despite poor resistance to water penetration and poor durability , 30,000 pairs of the new boots were sold in the first 12 months .

source_bert_toks: not surprisingly , despite poor resistance to water penetration and poor du ##ra ##bility , 30 , 000 pairs of the new boots were sold in the first 12 months .

reference_raw: It is not surprising that 30,000 pairs of new shoes were sold in the first 12 months, despite poor resistance to water penetration and poor endurance.

reference_spacy_tokens: It is not surprising that 30,000 pairs of new shoes were sold in the first 12 months , despite poor resistance to water penetration and poor endurance .


fn_spacy_tokens_for_baseline: Peter waved and herded Sebastian into the brightness of the clubhouse .

source_bert_toks: peter waved and herd ##ed sebastian into the brightness of the clubhouse .

reference_raw: Peter waved and pushed Sebastian into the light of the clubhouse.

reference_spacy_tokens: Peter waved and pushed Sebastian into the light of the clubhouse .


fn_spacy_tokens_for_baseline: The band were last seen flogging their wares around Europe , with no less than ex - Angelic Upstarts drummer ' Stix ' behind the kit , former drummer Nigel having scarpered when the going got rough .

source_bert_toks: the band were last seen fl ##og ##ging their ware ##s around europe , with no less than ex - angel ##ic ups ##tar ##ts drummer ' st ##ix ' behind the kit , former drummer nigel having scar ##per ##ed when the going got rough .

reference_raw: The band was last seen flogging their wares all over Europe, and at least the former Angelic Upstarts drummer "Stix" behind the set, and the former drummer Nigel had scarred when the journey was rough.

reference_spacy_tokens: The band was last seen flogging their wares all over Europe , and at least the former Angelic Upstarts drummer " Stix " behind the set , and the former drummer Nigel had scarred when the journey was rough .


fn_spacy_tokens_for_baseline: It was in Lucerne that you conducted what were by all accounts electrifying performances of the Honegger Symphonie liturgique , which you later recorded for Deutsche Grammophon .

source_bert_toks: it was in luce ##rne that you conducted what were by all accounts elect ##ri ##fying performances of the hon ##eg ##ger sy ##mp ##hon ##ie lit ##urg ##ique , which you later recorded for deutsche gram ##mo ##phon .

reference_raw: It was in Lucerne that you performed, by all accounts, the electrification of the Honegger Symphony liturgique, which you later recorded for Deutsche Grammophon.

reference_spacy_tokens: It was in Lucerne that you performed , by all accounts , the electrification of the Honegger Symphony liturgique , which you later recorded for Deutsche Grammophon .


fn_spacy_tokens_for_baseline: At its height , 130 firefighters were trying to control the fire at Gilkes Mill in the centre of Banbury .

source_bert_toks: at its height , 130 firefighters were trying to control the fire at gil ##kes mill in the centre of ban ##bury .

reference_raw: At its height, 130 firemen tried to manage the fire at Gilkes Mill in the middle of Banbury.

reference_spacy_tokens: At its height , 130 firemen tried to manage the fire at Gilkes Mill in the middle of Banbury .


fn_spacy_tokens_for_baseline: Synthetic cutting boards : These present special problems as organic soil physically sticks to the materials used so bonding occurs .

source_bert_toks: synthetic cutting boards : these present special problems as organic soil physically sticks to the materials used so bonding occurs .

reference_raw: Synthetic cutting boards: These present specific problems because organic soil is physically attached to the materials used to bond.

reference_spacy_tokens: Synthetic cutting boards : These present specific problems because organic soil is physically attached to the materials used to bond .


fn_spacy_tokens_for_baseline: But both he and the young lord had been carried off by smallpox , leaving this estranged son of the deceased youngest brother to inherit .

source_bert_toks: but both he and the young lord had been carried off by smallpox , leaving this estranged son of the deceased youngest brother to inherit .

reference_raw: But both he and the young master were carried away by smallpox, leaving the estranged son of the late youngest brother to inherit.

reference_spacy_tokens: But both he and the young master were carried away by smallpox , leaving the estranged son of the late youngest brother to inherit .


fn_spacy_tokens_for_baseline: NOEL CLEAL described his dismissal as Hull coach as a ' kick in the guts ' and forecast a gloomy future for the club , writes John Whalley .

source_bert_toks: noel cl ##eal described his dismissal as hull coach as a ' kick in the guts ' and forecast a gloom ##y future for the club , writes john w ##hall ##ey .

reference_raw: NOEL CLEAL describes his release as a Hull coach as a "kick in the guts" and predicts the grim future of the club and writes John Whalley.

reference_spacy_tokens: NOEL CLEAL describes his release as a Hull coach as a " kick in the guts " and predicts the grim future of the club and writes John Whalley .


fn_spacy_tokens_for_baseline: For example , in 1996 an ethnic Korean in Japan was caught exporting 50 kg of sodium fluoride to North Korea by way of cargo vessels bringing food aid to the DPRK .

source_bert_toks: for example , in 1996 an ethnic korean in japan was caught export ##ing 50 kg of sodium flu ##ori ##de to north korea by way of cargo vessels bringing food aid to the d ##pr ##k .

reference_raw: In 1996, for example, an ethnic Korean in Japan was caught exporting 50 kilograms of sodium fluoride to North Korea by freighters bringing food aid to the DPRK.

reference_spacy_tokens: In 1996 , for example , an ethnic Korean in Japan was caught exporting 50 kilograms of sodium fluoride to North Korea by freighters bringing food aid to the DPRK .


fn_spacy_tokens_for_baseline: A recent survey by the US Pharmaceutical Manufacturers Association showed a 60 per cent increase in biotechnology medicines under development in the US over the past four years .

source_bert_toks: a recent survey by the us pharmaceutical manufacturers association showed a 60 per cent increase in biotechnology medicines under development in the us over the past four years .

reference_raw: A recent study by the U.S. Pharmaceutical Manufacturers Association has shown that over the last four years the number of biotechnological medicinal products under development in the United States has increased by 60%.

reference_spacy_tokens: A recent study by the U.S. Pharmaceutical Manufacturers Association has shown that over the last four years the number of biotechnological medicinal products under development in the United States has increased by 60 % .


fn_spacy_tokens_for_baseline: ' We eventually tracked her down at this dreadful apartment block .

source_bert_toks: ' we eventually tracked her down at this dreadful apartment block .

reference_raw: 'In the end, we found her in this horrible apartment block.

reference_spacy_tokens: ' In the end , we found her in this horrible apartment block .


fn_spacy_tokens_for_baseline: The inside walls were plastered and painted .

source_bert_toks: the inside walls were plastered and painted .

reference_raw: The inner walls were plastered and painted.

reference_spacy_tokens: The inner walls were plastered and painted .


fn_spacy_tokens_for_baseline: It was said in Wickrithe that all Demdykes were crazy , but Aunt Sarah disproved that .

source_bert_toks: it was said in wi ##ck ##rith ##e that all dem ##dy ##kes were crazy , but aunt sarah di ##sp ##roved that .

reference_raw: Wickrithe said all the Demdykes were crazy, but Aunt Sarah denied it.

reference_spacy_tokens: Wickrithe said all the Demdykes were crazy , but Aunt Sarah denied it .


fn_spacy_tokens_for_baseline: Where is your vest and your liberty bodice ?

source_bert_toks: where is your vest and your liberty bo ##dice ?

reference_raw: Where's your vest and your free body?

reference_spacy_tokens: Where 's your vest and your free body ?


fn_spacy_tokens_for_baseline: 25 - 27 Instructions for making and furnishing the tabernacle

source_bert_toks: 25 - 27 instructions for making and fur ##nish ##ing the tab ##ern ##acle

reference_raw: 25-27 Tabernacle and furniture instructions

reference_spacy_tokens: 25 - 27 Tabernacle and furniture instructions


fn_spacy_tokens_for_baseline: He also ventured the opinion that Putt was now dangerously insane .

source_bert_toks: he also ventured the opinion that put ##t was now dangerously insane .

reference_raw: He also dared to believe that Putt was now dangerously insane.

reference_spacy_tokens: He also dared to believe that Putt was now dangerously insane .