fn_spacy_tokens_for_baseline: There was Libby , a middle - class city girl who lives in a log cabin in the sub - arctic woods .

source_bert_toks: there was libby , a middle - class city girl who lives in a log cabin in the sub - arctic woods .

reference_raw: There was Libby, a middle-class town girl who lived in a log hut in a sub-arctic forest.

reference_spacy_tokens: There was Libby , a middle - class town girl who lived in a log hut in a sub - arctic forest .


fn_spacy_tokens_for_baseline: He had discarded his uniform and wore his best suit , a light pearly grey , with a brightly - coloured necktie , and a rose in his buttonhole .

source_bert_toks: he had discarded his uniform and wore his best suit , a light pearl ##y grey , with a brightly - coloured neck ##tie , and a rose in his button ##hole .

reference_raw: He threw off his uniform and wore his best suit, a pale pearly gray with a brightly colored tie and a rose in a buttonhole.

reference_spacy_tokens: He threw off his uniform and wore his best suit , a pale pearly gray with a brightly colored tie and a rose in a buttonhole .


fn_spacy_tokens_for_baseline: Not only did it create jobs , but it also created Lake Mead , the massive reservoir that today provides water to all of southern Nevada .

source_bert_toks: not only did it create jobs , but it also created lake mead , the massive reservoir that today provides water to all of southern nevada .

reference_raw: Not only did it create jobs, it also created Lake Mead, a huge reservoir that now provides water to all of South Nevada.

reference_spacy_tokens: Not only did it create jobs , it also created Lake Mead , a huge reservoir that now provides water to all of South Nevada .


fn_spacy_tokens_for_baseline: His mantle flared , the spurs grated again .

source_bert_toks: his mantle flared , the spurs gr ##ated again .

reference_raw: His cloak flared, and the spurs flared again.

reference_spacy_tokens: His cloak flared , and the spurs flared again .


fn_spacy_tokens_for_baseline: ' She had a terrified look in her eyes , and was obviously going through a very , very bad trip .

source_bert_toks: ' she had a terrified look in her eyes , and was obviously going through a very , very bad trip .

reference_raw: She had a frightened look in her eyes and apparently had a very, very bad journey.

reference_spacy_tokens: She had a frightened look in her eyes and apparently had a very , very bad journey .


fn_spacy_tokens_for_baseline: Kurdish guerrillas reportedly shot dead 60 unarmed Iraqi soldiers on Oct. 7 following clashes around Sulaimaniya .

source_bert_toks: kurdish guerrillas reportedly shot dead 60 unarmed iraqi soldiers on oct . 7 following clashes around sul ##ai ##mani ##ya .

reference_raw: The Kurdish guerrillas reportedly shot 60 armed Iraqi soldiers on October 7 after a collision around Sulaimaniya.

reference_spacy_tokens: The Kurdish guerrillas reportedly shot 60 armed Iraqi soldiers on October 7 after a collision around Sulaimaniya .


fn_spacy_tokens_for_baseline: I suppose we were the first people in the 1960s to target our market and bring to people things that were well designed at an affordable price .

source_bert_toks: i suppose we were the first people in the 1960s to target our market and bring to people things that were well designed at an affordable price .

reference_raw: In the 1960s, I think we were the first people to focus on our market and bring people things that were well designed for a reasonable price.

reference_spacy_tokens: In the 1960s , I think we were the first people to focus on our market and bring people things that were well designed for a reasonable price .


fn_spacy_tokens_for_baseline: The provincials regarded us as a gassy , protesting , quarrelsome , cantankerous crowd , very good at cursing the enemy and cursing ourselves , but no good at effective fighting against the well organised political parties .

source_bert_toks: the provincial ##s regarded us as a gas ##sy , protesting , quarrel ##some , can ##tan ##ker ##ous crowd , very good at cursing the enemy and cursing ourselves , but no good at effective fighting against the well organised political parties .

reference_raw: The provincials regarded us as a gassy, protesting, quarrelsome, cantankerous mob, very good at cursing the enemy and cursing ourselves, but not good at effective combat against well-organized political parties.

reference_spacy_tokens: The provincials regarded us as a gassy , protesting , quarrelsome , cantankerous mob , very good at cursing the enemy and cursing ourselves , but not good at effective combat against well - organized political parties .


fn_spacy_tokens_for_baseline: The PRC is allegedly aiding Iran in the development of a nuclear bomb ( 5880 ) . ; according to French and US intelligence sources , the PRC supplied technology for Iran 's Isfahan reactor .

source_bert_toks: the prc is allegedly aiding iran in the development of a nuclear bomb ( 58 ##80 ) . ; according to french and us intelligence sources , the prc supplied technology for iran ' s is ##fahan reactor .

reference_raw: The PRC is alleged to be assisting Iran in developing a nuclear bomb (5880); according to French and US intelligence sources, the PRC has supplied technology to the Iranian Isfahan reactor.

reference_spacy_tokens: The PRC is alleged to be assisting Iran in developing a nuclear bomb ( 5880 ) ; according to French and US intelligence sources , the PRC has supplied technology to the Iranian Isfahan reactor .


fn_spacy_tokens_for_baseline: In a leaflet distributed in the Gaza Strip , the group , which belongs to Palestinian Authority President Mahmoud Abbas 's Fatah Party , said the weapons were the result of a three - year effort .

source_bert_toks: in a leaf ##let distributed in the gaza strip , the group , which belongs to palestinian authority president mahmoud abbas ' s fat ##ah party , said the weapons were the result of a three - year effort .

reference_raw: In a leaflet published in the Gaza Strip, a group belonging to the Fatah Party of Palestinian Authority President Mahmoud Abbas stated that the weapons were the result of a three-year effort.

reference_spacy_tokens: In a leaflet published in the Gaza Strip , a group belonging to the Fatah Party of Palestinian Authority President Mahmoud Abbas stated that the weapons were the result of a three - year effort .


fn_spacy_tokens_for_baseline: And the sheaves getting stuck together er sprouting and getting stuck yes .

source_bert_toks: and the shea ##ves getting stuck together er sp ##rou ##ting and getting stuck yes .

reference_raw: And the sheaves are glued together, er sprouts, and they're trapped, yes.

reference_spacy_tokens: And the sheaves are glued together , er sprouts , and they 're trapped , yes .


fn_spacy_tokens_for_baseline: This small formerly residential island , beautifully shaded by banyan trees , was the home of the closed community of the foreign colony in the era of " concessions . "

source_bert_toks: this small formerly residential island , beautifully shaded by ban ##yan trees , was the home of the closed community of the foreign colony in the era of " concessions . "

reference_raw: This small, formerly residential island, beautifully shadowed by the banyan trees, was the home of a closed community of a foreign settlement in the era of "concession."

reference_spacy_tokens: This small , formerly residential island , beautifully shadowed by the banyan trees , was the home of a closed community of a foreign settlement in the era of " concession . "


fn_spacy_tokens_for_baseline: It would run to the north of Eton Wick and the south of Chalvey along the south side of the M4 , crossing the main A355 Slough to Windsor road .

source_bert_toks: it would run to the north of eton wi ##ck and the south of cha ##l ##vey along the south side of the m ##4 , crossing the main a ##35 ##5 sl ##ough to windsor road .

reference_raw: He would run north of Eton Wick and south of Chalvey on the south side of the M4 and cross the main A355 Slow to Windsor Road.

reference_spacy_tokens: He would run north of Eton Wick and south of Chalvey on the south side of the M4 and cross the main A355 Slow to Windsor Road .


fn_spacy_tokens_for_baseline: Palms were spat upon and smacked together .

source_bert_toks: palms were spat upon and smacked together .

reference_raw: The palms were spat on and slapped together.

reference_spacy_tokens: The palms were spat on and slapped together .


fn_spacy_tokens_for_baseline: Two of these are always present in the head , and varying degrees of coalescence of the thoracic and abdominal ganglia are revealed by a comparative study of the nervous system in different orders of insects .

source_bert_toks: two of these are always present in the head , and varying degrees of coal ##escence of the thor ##ac ##ic and abdominal gang ##lia are revealed by a comparative study of the nervous system in different orders of insects .

reference_raw: Two of them are always present in the head, and different degrees of coalescence in the chest and abdominal ganglia are revealed by a comparative study of the nervous system in various insect sequences.

reference_spacy_tokens: Two of them are always present in the head , and different degrees of coalescence in the chest and abdominal ganglia are revealed by a comparative study of the nervous system in various insect sequences .


fn_spacy_tokens_for_baseline: He emptied his flagon and after a minute 's hesitation she took it over to the table to refill it .

source_bert_toks: he emptied his flag ##on and after a minute ' s hesitation she took it over to the table to ref ##ill it .

reference_raw: He emptied the bottle, and after a moment's hesitation she took it to the table to refill it.

reference_spacy_tokens: He emptied the bottle , and after a moment 's hesitation she took it to the table to refill it .


fn_spacy_tokens_for_baseline: But the small and easily hidden EFPs , which often are powered by C-4 plastic explosives , are not just a more powerful IED .

source_bert_toks: but the small and easily hidden e ##fp ##s , which often are powered by c - 4 plastic explosives , are not just a more powerful ie ##d .

reference_raw: But the small and easily concealed EFPs, which are often powered by C-4 plastic explosives, are not only more powerful EDs.

reference_spacy_tokens: But the small and easily concealed EFPs , which are often powered by C-4 plastic explosives , are not only more powerful EDs .


fn_spacy_tokens_for_baseline: Renwick bent to tie his shoelace , straightened up when the ambulance 's motor merged with the traffic outside .

source_bert_toks: ren ##wick bent to tie his shoe ##lace , straightened up when the ambulance ' s motor merged with the traffic outside .

reference_raw: Renwick bent to tie his lace and straightened as the ambulance's engine merged with the traffic outside.

reference_spacy_tokens: Renwick bent to tie his lace and straightened as the ambulance 's engine merged with the traffic outside .


fn_spacy_tokens_for_baseline: However , now that it has been decided that a Sunday game of 50 overs per side is a better idea ' for cricket ' , many are already beginning to rue the demise of the 40-overs game .

source_bert_toks: however , now that it has been decided that a sunday game of 50 overs per side is a better idea ' for cricket ' , many are already beginning to rue the demise of the 40 - overs game .

reference_raw: But now that it has been decided that a Sunday game of 50 overs is a better idea for cricket, many have already begun to regret the loss of the 40-over game.

reference_spacy_tokens: But now that it has been decided that a Sunday game of 50 overs is a better idea for cricket , many have already begun to regret the loss of the 40-over game .


fn_spacy_tokens_for_baseline: The Central Council of Church Bell Ringers , a sort of parliament of ringing groups , aims to improve relations with vicars , says John C. Baldwin , president .

source_bert_toks: the central council of church bell ring ##ers , a sort of parliament of ringing groups , aims to improve relations with vicar ##s , says john c . baldwin , president .

reference_raw: According to John C. Baldwin, President, the Central Council of Church Bell Ringers, a kind of parliament of ringing groups, is seeking to enhance relations with the vicars.

reference_spacy_tokens: According to John C. Baldwin , President , the Central Council of Church Bell Ringers , a kind of parliament of ringing groups , is seeking to enhance relations with the vicars .


fn_spacy_tokens_for_baseline: Blue whales are no longer hunted , but their numbers were depleted to such an extent in the past that present populations ( perhaps of only a few hundred individuals ) may be too small to recover .

source_bert_toks: blue whales are no longer hunted , but their numbers were depleted to such an extent in the past that present populations ( perhaps of only a few hundred individuals ) may be too small to recover .

reference_raw: Blue whales are no longer hunted, but their number has been so exhausted in the past that the current population (perhaps only a few hundred individuals) may be too small to recover.

reference_spacy_tokens: Blue whales are no longer hunted , but their number has been so exhausted in the past that the current population ( perhaps only a few hundred individuals ) may be too small to recover .


fn_spacy_tokens_for_baseline: One of the most worrying aspects of the CIA 's morality is the special brand of patriotism it bestows upon itself .

source_bert_toks: one of the most worrying aspects of the cia ' s morality is the special brand of patriot ##ism it best ##ows upon itself .

reference_raw: One of the most disturbing aspects of the CIA's morality is the special sign of patriotism that it gives itself.

reference_spacy_tokens: One of the most disturbing aspects of the CIA 's morality is the special sign of patriotism that it gives itself .


fn_spacy_tokens_for_baseline: And now , on a clear morning , Graham Little and I are sitting at the bottom of the wall , fit and ready to go , and the wall is plastered with verglas .

source_bert_toks: and now , on a clear morning , graham little and i are sitting at the bottom of the wall , fit and ready to go , and the wall is plastered with ve ##rg ##las .

reference_raw: And now, on a bright morning, Graham Little and I sit at the foot of the wall, fit and ready to go, and the wall is covered with verglas.

reference_spacy_tokens: And now , on a bright morning , Graham Little and I sit at the foot of the wall , fit and ready to go , and the wall is covered with verglas .


fn_spacy_tokens_for_baseline: His first , 11 weeks after the crash took place on December 20 when he was gently transferred from hospital by ambulance , strapped to a stretcher .

source_bert_toks: his first , 11 weeks after the crash took place on december 20 when he was gently transferred from hospital by ambulance , strapped to a stretch ##er .

reference_raw: His first time, 11 weeks after the accident, was on December 20th, when he was gently taken out of the hospital by an ambulance strapped to a stretcher.

reference_spacy_tokens: His first time , 11 weeks after the accident , was on December 20th , when he was gently taken out of the hospital by an ambulance strapped to a stretcher .


fn_spacy_tokens_for_baseline: Clothes , newspapers and nameless rubbish littered the floor and over everything a radio blasted away at fall strength .

source_bert_toks: clothes , newspapers and name ##less rubbish littered the floor and over everything a radio blasted away at fall strength .

reference_raw: Clothes, newspapers, and nameless garbage littered the floor, and the radio blew away with the power of autumn.

reference_spacy_tokens: Clothes , newspapers , and nameless garbage littered the floor , and the radio blew away with the power of autumn .


fn_spacy_tokens_for_baseline: Although she had little time to help organize the newspaper project , as she buzzed around discussing it with friends and jotting down ideas it began to get up steam .

source_bert_toks: although she had little time to help organize the newspaper project , as she buzzed around discussing it with friends and jo ##tting down ideas it began to get up steam .

reference_raw: Though she didn't have much time to help organize the news project, she hummed around to discuss it with her friends and to write down ideas, it was getting steamy.

reference_spacy_tokens: Though she did n't have much time to help organize the news project , she hummed around to discuss it with her friends and to write down ideas , it was getting steamy .


fn_spacy_tokens_for_baseline: Soon the chain was singing out through the foliage , cutting empty avenues through the greenery .

source_bert_toks: soon the chain was singing out through the foliage , cutting empty avenues through the greene ##ry .

reference_raw: Soon the chain sang through the leaves, slashing empty avenues through the greenery.

reference_spacy_tokens: Soon the chain sang through the leaves , slashing empty avenues through the greenery .


fn_spacy_tokens_for_baseline: With rail service in place and forty blocks of private property , it was ready to become a real town .

source_bert_toks: with rail service in place and forty blocks of private property , it was ready to become a real town .

reference_raw: With the railways in place and forty blocks of private property, the city was ready to become a real city.

reference_spacy_tokens: With the railways in place and forty blocks of private property , the city was ready to become a real city .


fn_spacy_tokens_for_baseline: Japan , Peru , and the Faroe Islands , Greenland and Arctic regions , and Caribbean countries , are all actively hunting dolphins and small whales for food .

source_bert_toks: japan , peru , and the far ##oe islands , greenland and arctic regions , and caribbean countries , are all actively hunting dolphins and small whales for food .

reference_raw: Japan, Peru, the Faroe Islands, Greenland, the Arctic, and the Caribbean are all actively fishing for dolphins and small whales.

reference_spacy_tokens: Japan , Peru , the Faroe Islands , Greenland , the Arctic , and the Caribbean are all actively fishing for dolphins and small whales .


fn_spacy_tokens_for_baseline: She added said that she had believed Allen had homosexual tendencies and she had concerns that he would sexually abuse Satchel .

source_bert_toks: she added said that she had believed allen had homosexual tendencies and she had concerns that he would sexually abuse sat ##chel .

reference_raw: She added that she believed that Allen had homosexual tendencies and that she was afraid of sexually assaulting Satchel.

reference_spacy_tokens: She added that she believed that Allen had homosexual tendencies and that she was afraid of sexually assaulting Satchel .


fn_spacy_tokens_for_baseline: Bunny saw me and gave me a brief nod , then went back to talking to a young black dude wearing a blue trenchcoat and nursing a colour - co - ordinated Filofax .

source_bert_toks: bunny saw me and gave me a brief nod , then went back to talking to a young black dude wearing a blue trench ##coat and nursing a colour - co - or ##dina ##ted fi ##lo ##fa ##x .

reference_raw: Bunny saw me and nodded briefly, then went back to talking to a young black man in a blue trenchcoat and nursing a color-coordinated Filofax.

reference_spacy_tokens: Bunny saw me and nodded briefly , then went back to talking to a young black man in a blue trenchcoat and nursing a color - coordinated Filofax .


fn_spacy_tokens_for_baseline: Manufacturers dispatch vials of vaccine -- along with frozen carbon dioxide for cooling -- in large , insulated cartons which must be tested for both strength and the efficiency of the insulation .

source_bert_toks: manufacturers dispatch vial ##s of vaccine - - along with frozen carbon dioxide for cooling - - in large , ins ##ulated cart ##ons which must be tested for both strength and the efficiency of the insulation .

reference_raw: Manufacturers dispatch vaccine bottles - together with frozen carbon dioxide for refrigeration - in large, insulated boxes, which must be tested for both the strength and effectiveness of the insulation.

reference_spacy_tokens: Manufacturers dispatch vaccine bottles - together with frozen carbon dioxide for refrigeration - in large , insulated boxes , which must be tested for both the strength and effectiveness of the insulation .


fn_spacy_tokens_for_baseline: Benjamin nudged me with his knee so I looked away .

source_bert_toks: benjamin nudged me with his knee so i looked away .

reference_raw: Benjamin prodded me with his knee, and I turned away.

reference_spacy_tokens: Benjamin prodded me with his knee , and I turned away .


fn_spacy_tokens_for_baseline: In the backwoods of southwest Virginia there 's a little noticed struggle going on - complete with camouflage , weaponry and mercenaries - between the mine owners and the local communities .

source_bert_toks: in the back ##woods of southwest virginia there ' s a little noticed struggle going on - complete with camouflage , weaponry and mercenaries - between the mine owners and the local communities .

reference_raw: In the back forests of Southwest Virginia, there is a slight note of struggle between the mine owners and the local community, complete with camouflage, weapons and mercenaries.

reference_spacy_tokens: In the back forests of Southwest Virginia , there is a slight note of struggle between the mine owners and the local community , complete with camouflage , weapons and mercenaries .


fn_spacy_tokens_for_baseline: The train station is in the newer business district ; nearby is Asia 's third - tallest building , at 83 stories , which will often be pointed out to you .

source_bert_toks: the train station is in the newer business district ; nearby is asia ' s third - tallest building , at 83 stories , which will often be pointed out to you .

reference_raw: The train station is in a newer business district; nearby is the third Asian-highest building on 83 floors, which you will often find.

reference_spacy_tokens: The train station is in a newer business district ; nearby is the third Asian - highest building on 83 floors , which you will often find .


fn_spacy_tokens_for_baseline: I mean , I 'm well aware you do n't have to face single - handed and prattling , blowing your own cor - anglais and generally acting up before a captive crowd of thousands .

source_bert_toks: i mean , i ' m well aware you don ' t have to face single - handed and pratt ##ling , blowing your own co ##r - ang ##lais and generally acting up before a captive crowd of thousands .

reference_raw: I know you don't have to stand up to a single-handed, prattling, blowing your own cor-anglais, and generally appearing in front of a crowd of thousands of prisoners.

reference_spacy_tokens: I know you do n't have to stand up to a single - handed , prattling , blowing your own cor - anglais , and generally appearing in front of a crowd of thousands of prisoners .


fn_spacy_tokens_for_baseline: The work of those seventeenth - century poets who created poems in the shape of diamonds or butterflies would be largely incomprehensible if the form were not preserved .

source_bert_toks: the work of those seventeenth - century poets who created poems in the shape of diamonds or butterflies would be largely inc ##omp ##re ##hen ##sible if the form were not preserved .

reference_raw: The work of the seventeenth-century poets who created poems in the form of diamonds and butterflies would have been largely unintelligible if the form had not been preserved.

reference_spacy_tokens: The work of the seventeenth - century poets who created poems in the form of diamonds and butterflies would have been largely unintelligible if the form had not been preserved .


fn_spacy_tokens_for_baseline: You 'll be overjoyed to see a child or youngster living life to the full and getting every ounce of pleasure out of every moment of the day .

source_bert_toks: you ' ll be over ##joy ##ed to see a child or young ##ster living life to the full and getting every ounce of pleasure out of every moment of the day .

reference_raw: You'll be so happy to see a child or a young man living his life to the fullest, and you'll get every bit of joy from every moment of the day.

reference_spacy_tokens: You 'll be so happy to see a child or a young man living his life to the fullest , and you 'll get every bit of joy from every moment of the day .


fn_spacy_tokens_for_baseline: In western movies they all seem to be chewing tobacco or smoking brown cheroots but a cigar sits well in Elliot 's lips .

source_bert_toks: in western movies they all seem to be chewing tobacco or smoking brown cher ##oot ##s but a cigar sits well in elliot ' s lips .

reference_raw: In Western films, everyone looks like they're chewing cigarettes or smoking brown cheroots, but Elliot's mouth is full of cigars.

reference_spacy_tokens: In Western films , everyone looks like they 're chewing cigarettes or smoking brown cheroots , but Elliot 's mouth is full of cigars .


fn_spacy_tokens_for_baseline: The girl , who happened never to enjoy this activity , ground her teeth together .

source_bert_toks: the girl , who happened never to enjoy this activity , ground her teeth together .

reference_raw: A girl who, by chance, never enjoyed the activity, brushed her teeth together.

reference_spacy_tokens: A girl who , by chance , never enjoyed the activity , brushed her teeth together .


fn_spacy_tokens_for_baseline: Peter Bibby has retired as deputy director of social services in Brent .

source_bert_toks: peter bi ##bby has retired as deputy director of social services in brent .

reference_raw: Peter Bibby resigned from Brent as Deputy Director of Social Services.

reference_spacy_tokens: Peter Bibby resigned from Brent as Deputy Director of Social Services .


fn_spacy_tokens_for_baseline: It is possible to inject ' free - hand ' but , particularly for younger embryos , holding the injection pipette in a Singer manipulator produces a more reliable and steadier motion .

source_bert_toks: it is possible to in ##ject ' free - hand ' but , particularly for younger embryo ##s , holding the injection pipe ##tte in a singer mani ##pu ##lat ##or produces a more reliable and ste ##adi ##er motion .

reference_raw: The free hand may be used, but, especially in the case of younger embryos, the holding of the injection tube in the Singer manipulator produces a more reliable and stable movement.

reference_spacy_tokens: The free hand may be used , but , especially in the case of younger embryos , the holding of the injection tube in the Singer manipulator produces a more reliable and stable movement .


fn_spacy_tokens_for_baseline: After about five minutes a light went on in back .

source_bert_toks: after about five minutes a light went on in back .

reference_raw: After about five minutes there was a light in the rear.

reference_spacy_tokens: After about five minutes there was a light in the rear .


fn_spacy_tokens_for_baseline: Yeremi , Tundrish , and Akbar shot down others who had survived the crystal slivers and the death cloud but who had slowed in apparent shock .

source_bert_toks: yer ##emi , tun ##dr ##ish , and akbar shot down others who had survived the crystal sl ##iver ##s and the death cloud but who had slowed in apparent shock .

reference_raw: Yeremi, Tundrish, and Akbar shot down others who had survived the crystal splinters and the deadly cloud, but who had slowed in apparent shock.

reference_spacy_tokens: Yeremi , Tundrish , and Akbar shot down others who had survived the crystal splinters and the deadly cloud , but who had slowed in apparent shock .


fn_spacy_tokens_for_baseline: The rest of the year , life goes on at its accustomed pace : rickety machines chugging in two - man factories , children in school uniforms being ferried home to houseboats , and the old fishermen stirring shrimp paste .

source_bert_toks: the rest of the year , life goes on at its accustomed pace : rick ##ety machines chu ##gging in two - man factories , children in school uniforms being fe ##rrie ##d home to house ##boats , and the old fishermen stirring shrimp paste .

reference_raw: For the rest of the year, life continues at its usual pace: rickety machines chugging in two-man factories, children in school uniforms being ferried home to houseboats, and old fishermen mixing shrimp paste.

reference_spacy_tokens: For the rest of the year , life continues at its usual pace : rickety machines chugging in two - man factories , children in school uniforms being ferried home to houseboats , and old fishermen mixing shrimp paste .


fn_spacy_tokens_for_baseline: These institutions would henceforward all be financed directly from Exchequer funds disbursed by a central body , appointed by the Secretary of State .

source_bert_toks: these institutions would hence ##for ##ward all be financed directly from exchequer funds di ##sb ##urse ##d by a central body , appointed by the secretary of state .

reference_raw: From now on, all these institutions would be financed directly from the Exchequer funds paid by the central authority designated by the Secretary of State.

reference_spacy_tokens: From now on , all these institutions would be financed directly from the Exchequer funds paid by the central authority designated by the Secretary of State .


fn_spacy_tokens_for_baseline: A Roman Jew of the mid eleventh century was inspired to baptism by Pope Leo IX , and took the Christian name of Leo .

source_bert_toks: a roman jew of the mid eleventh century was inspired to baptism by pope leo ix , and took the christian name of leo .

reference_raw: The Roman Jew of the mid-Eleventh Century was inspired by Pope Leo IX to christen him, and he took Leo's first name.

reference_spacy_tokens: The Roman Jew of the mid - Eleventh Century was inspired by Pope Leo IX to christen him , and he took Leo 's first name .


fn_spacy_tokens_for_baseline: When they 'd drained the last drop from the teapot Edward said , ' Run upstairs and get yourself a coat .

source_bert_toks: when they ' d drained the last drop from the tea ##pot edward said , ' run upstairs and get yourself a coat .

reference_raw: When they had finished the last drop from the teapot, Edward said, "Go up and get your coat.

reference_spacy_tokens: When they had finished the last drop from the teapot , Edward said , " Go up and get your coat .


fn_spacy_tokens_for_baseline: It claimed that Ms Oruene had failed to show she was treated less favourably than any other candidate and that there was not a shred of evidence to show that it had deviated from normal procedures .

source_bert_toks: it claimed that ms or ##uen ##e had failed to show she was treated less favour ##ably than any other candidate and that there was not a sh ##red of evidence to show that it had devi ##ated from normal procedures .

reference_raw: It stated that Ms Oruene had not shown that she had been treated less favourably than any other candidate and that there was no evidence to show that she had deviated from the normal procedure.

reference_spacy_tokens: It stated that Ms Oruene had not shown that she had been treated less favourably than any other candidate and that there was no evidence to show that she had deviated from the normal procedure .


fn_spacy_tokens_for_baseline: In this case , if the adventurers feign friendship and allegiance , Gerd will become almost pitifully talkative .

source_bert_toks: in this case , if the adventurer ##s fei ##gn friendship and allegiance , ge ##rd will become almost pit ##iful ##ly talk ##ative .

reference_raw: In this case, if the adventurers pretend to be friendly and loyal, Gerd will be almost pitifully chattable.

reference_spacy_tokens: In this case , if the adventurers pretend to be friendly and loyal , Gerd will be almost pitifully chattable .


fn_spacy_tokens_for_baseline: By blending different essential oils , we not only improve the aroma of a single essence , but more interestingly , we can control the mind - body effect of the oil .

source_bert_toks: by blending different essential oils , we not only improve the aroma of a single essence , but more interesting ##ly , we can control the mind - body effect of the oil .

reference_raw: By mixing different basic oils, we can not only enhance the aroma of one essence, but also, more interestingly, control the mind-body effect of the oil.

reference_spacy_tokens: By mixing different basic oils , we can not only enhance the aroma of one essence , but also , more interestingly , control the mind - body effect of the oil .


fn_spacy_tokens_for_baseline: He had been blown up by a landmine in the ' 73 war and he was held together , he told us , with metal pins .

source_bert_toks: he had been blown up by a land ##mine in the ' 73 war and he was held together , he told us , with metal pins .

reference_raw: In the war of '73, he was bombed by a mine and held together, he said, with metal pins.

reference_spacy_tokens: In the war of ' 73 , he was bombed by a mine and held together , he said , with metal pins .


fn_spacy_tokens_for_baseline: It goes without saying that any infringements of these new restrictions will imperil what is already an extremely sensitive access agreement .

source_bert_toks: it goes without saying that any infringement ##s of these new restrictions will imp ##eri ##l what is already an extremely sensitive access agreement .

reference_raw: It goes without saying that any breach of these new restrictions would endanger what is already a very sensitive access agreement.

reference_spacy_tokens: It goes without saying that any breach of these new restrictions would endanger what is already a very sensitive access agreement .


fn_spacy_tokens_for_baseline: I zipped up the flaps , not daring to show my anger .

source_bert_toks: i zip ##ped up the flaps , not daring to show my anger .

reference_raw: I turned the flaps on, not daring to show my anger.

reference_spacy_tokens: I turned the flaps on , not daring to show my anger .


fn_spacy_tokens_for_baseline: He squatted down beside her and took one of her hands in his and waited for her to go on .

source_bert_toks: he squat ##ted down beside her and took one of her hands in his and waited for her to go on .

reference_raw: He crouched beside her, took one hand in his, and waited for her to continue.

reference_spacy_tokens: He crouched beside her , took one hand in his , and waited for her to continue .


fn_spacy_tokens_for_baseline: In the torrent of replies that followed , one woman ringer from Solihull observed that " the average male ringer leaves quite a lot to be desired : badly dressed , decorated with acne and a large beer - belly , frequently unwashed and unbearably flatulent in peals .

source_bert_toks: in the torre ##nt of replies that followed , one woman ring ##er from sol ##ih ##ull observed that " the average male ring ##er leaves quite a lot to be desired : badly dressed , decorated with ac ##ne and a large beer - belly , frequently un ##washed and un ##be ##ara ##bly flat ##ulent in pea ##ls .

reference_raw: In the torrent of answers that followed, one of Solihull's ringers remarked that "the average male ringer leaves much to be desired: ill-dressed, decorated with acne and a large beer belly, often unwashed and unbearably flatulent in peals.

reference_spacy_tokens: In the torrent of answers that followed , one of Solihull 's ringers remarked that " the average male ringer leaves much to be desired : ill - dressed , decorated with acne and a large beer belly , often unwashed and unbearably flatulent in peals .


fn_spacy_tokens_for_baseline: Officers also wrote 461 traffic citations at LAX in June and July for such infractions as running red lights or making unsafe lane changes , up 56 % from the 295 issued in the early summer of 2001 .

source_bert_toks: officers also wrote 46 ##1 traffic citations at lax in june and july for such in ##fra ##ctions as running red lights or making unsafe lane changes , up 56 % from the 295 issued in the early summer of 2001 .

reference_raw: In June and July, officers also wrote 461 traffic citations at LAX for offences such as running red lights or making dangerous lane changes, up to 56% of the 295 issued in the early summer of 2001.

reference_spacy_tokens: In June and July , officers also wrote 461 traffic citations at LAX for offences such as running red lights or making dangerous lane changes , up to 56 % of the 295 issued in the early summer of 2001 .


fn_spacy_tokens_for_baseline: He held my wrists in one hand as easily as a bunch of flowers and I was pinned beneath his bulk .

source_bert_toks: he held my wrists in one hand as easily as a bunch of flowers and i was pinned beneath his bulk .

reference_raw: He held my wrists in one hand as easily as a bunch of flowers, and I was stuck under his bulk.

reference_spacy_tokens: He held my wrists in one hand as easily as a bunch of flowers , and I was stuck under his bulk .


fn_spacy_tokens_for_baseline: China 's abstention also won it freedom from ' US concern ' over its dismal human rights record and any criticism of its ongoing prosecution of prominent pro - democracy activists .

source_bert_toks: china ' s abs ##ten ##tion also won it freedom from ' us concern ' over its di ##sma ##l human rights record and any criticism of its ongoing prosecution of prominent pro - democracy activists .

reference_raw: China's abstinence has also gained its freedom from "U.S. concern" over its dismal human rights record and any criticism of the ongoing prosecution of prominent pro-democracy activists.

reference_spacy_tokens: China 's abstinence has also gained its freedom from " U.S. concern " over its dismal human rights record and any criticism of the ongoing prosecution of prominent pro - democracy activists .


fn_spacy_tokens_for_baseline: Before setting out she had buried her husband , two sons and a daughter -- all of them having starved to death .

source_bert_toks: before setting out she had buried her husband , two sons and a daughter - - all of them having starved to death .

reference_raw: Before she knew it, she had buried her husband, two sons, and a daughter, all of them hungry.

reference_spacy_tokens: Before she knew it , she had buried her husband , two sons , and a daughter , all of them hungry .


fn_spacy_tokens_for_baseline: We must use our freedom to become enlightened , or we are doomed .

source_bert_toks: we must use our freedom to become en ##light ##ened , or we are doomed .

reference_raw: We have to use our freedom to become illuminated, or we're lost.

reference_spacy_tokens: We have to use our freedom to become illuminated , or we 're lost .


fn_spacy_tokens_for_baseline: Such a shock wave , called Cerenkov radiation , could be detected from the ground as a flash of visible light .

source_bert_toks: such a shock wave , called ce ##ren ##kov radiation , could be detected from the ground as a flash of visible light .

reference_raw: Such a shock wave, called Cerenkov's radiation, could be detected from the ground as a flicker of visible light.

reference_spacy_tokens: Such a shock wave , called Cerenkov 's radiation , could be detected from the ground as a flicker of visible light .


fn_spacy_tokens_for_baseline: This was wrong of me , I acknowledge it . '

source_bert_toks: this was wrong of me , i acknowledge it . '

reference_raw: That was a bad thing for me, I admit.'

reference_spacy_tokens: That was a bad thing for me , I admit . '


fn_spacy_tokens_for_baseline: That demand was reportedly knocked down by the Clinton administration to a series of satellite launches and some food aid , but the potential deal still lacked a key component - how to verify that North Korea was honouring the bargain - when the Clinton team ran out of time .

source_bert_toks: that demand was reportedly knocked down by the clinton administration to a series of satellite launches and some food aid , but the potential deal still lacked a key component - how to verify that north korea was honour ##ing the bargain - when the clinton team ran out of time .

reference_raw: The Clinton administration supposedly reduced this demand to a series of satellite launches and some food support, but the potential agreement still lacked the key element to verify that North Korea was honoring the deal-when the Clinton team ran out of time.

reference_spacy_tokens: The Clinton administration supposedly reduced this demand to a series of satellite launches and some food support , but the potential agreement still lacked the key element to verify that North Korea was honoring the deal - when the Clinton team ran out of time .


fn_spacy_tokens_for_baseline: It is easy to see why the ancient art is on the ropes .

source_bert_toks: it is easy to see why the ancient art is on the ropes .

reference_raw: It's easy to understand why there's an ancient skill on the ropes.

reference_spacy_tokens: It 's easy to understand why there 's an ancient skill on the ropes .


fn_spacy_tokens_for_baseline: The site of the Temple eventually became identified as Mt. Moriah , on which it stood , where Abraham was called to sacrifice his son Isaac .

source_bert_toks: the site of the temple eventually became identified as mt . mori ##ah , on which it stood , where abraham was called to sacrifice his son isaac .

reference_raw: The place of the temple was finally identified as Mount Moriah, where Abraham was summoned to sacrifice his son Isaac.

reference_spacy_tokens: The place of the temple was finally identified as Mount Moriah , where Abraham was summoned to sacrifice his son Isaac .


fn_spacy_tokens_for_baseline: 120g/4½oz fresh or defrosted raspberries

source_bert_toks: 120 ##g / 4 ##½ ##oz fresh or def ##ros ##ted ras ##p ##berries

reference_raw: 120g/41.5oz fresh or frozen raspberries

reference_spacy_tokens: 120g/41.5 oz fresh or frozen raspberries


fn_spacy_tokens_for_baseline: He 's going to spew . '

source_bert_toks: he ' s going to sp ##ew . '

reference_raw: He'll be spouting.'

reference_spacy_tokens: He 'll be spouting . '


fn_spacy_tokens_for_baseline: His is a fury fanned by insensitive press coverage of homosexuality and the Aids epidemic ; the director best known for films like Caravaggio has leapt at the opportunity of reacting against ' licensed queer bashing ' .

source_bert_toks: his is a fury fan ##ned by ins ##ens ##itive press coverage of homosexuality and the aids epidemic ; the director best known for films like cara ##va ##ggio has leapt at the opportunity of reacting against ' licensed queer bash ##ing ' .

reference_raw: His rage is fueled by the unfeeling press coverage of homosexuality and the AIDS epidemic; the director, best known for films like Caravaggio, has jumped at the opportunity to respond to "licensed queer punching".

reference_spacy_tokens: His rage is fueled by the unfeeling press coverage of homosexuality and the AIDS epidemic ; the director , best known for films like Caravaggio , has jumped at the opportunity to respond to " licensed queer punching " .


fn_spacy_tokens_for_baseline: Grinning , she took up a seductive pose and started to wriggle her hips for him , swirling round sensually and then slowly undoing the clasp at her back .

source_bert_toks: grinning , she took up a seductive pose and started to wr ##ig ##gle her hips for him , swirling round sensual ##ly and then slowly undo ##ing the clasp at her back .

reference_raw: Grinning, she took a seductive pose and began twisting her hips for him, whirling around sensually, then slowly unfastening the grip behind her.

reference_spacy_tokens: Grinning , she took a seductive pose and began twisting her hips for him , whirling around sensually , then slowly unfastening the grip behind her .


fn_spacy_tokens_for_baseline: Rationally , Diana understood , but emotionally , the Queen was still her mother - in - law and the relationship was as difficult as for any new wife .

source_bert_toks: rational ##ly , diana understood , but emotionally , the queen was still her mother - in - law and the relationship was as difficult as for any new wife .

reference_raw: Rationally, Diana understood, but emotionally, the Queen was still her father-in-law, and her relationship was as difficult as any new woman's.

reference_spacy_tokens: Rationally , Diana understood , but emotionally , the Queen was still her father - in - law , and her relationship was as difficult as any new woman 's .


fn_spacy_tokens_for_baseline: Produces chemical agents and is capable of use on limited scale .

source_bert_toks: produces chemical agents and is capable of use on limited scale .

reference_raw: It produces chemical agents and can be used on a limited scale.

reference_spacy_tokens: It produces chemical agents and can be used on a limited scale .


fn_spacy_tokens_for_baseline: He stashed the Nikon back inside his coat and rose to his feet , brushing damp mud from his jeans as he did so .

source_bert_toks: he st ##ash ##ed the nik ##on back inside his coat and rose to his feet , brushing damp mud from his jeans as he did so .

reference_raw: He put the Nikon back in his coat and stood up, brushing the damp mud from his jeans.

reference_spacy_tokens: He put the Nikon back in his coat and stood up , brushing the damp mud from his jeans .


fn_spacy_tokens_for_baseline: Ringers memorize patterns of changes , known as " methods , " which have odd - sounding names like Kent Treble Bob Major or Grandsire Caters .

source_bert_toks: ring ##ers memo ##rize patterns of changes , known as " methods , " which have odd - sounding names like kent tre ##ble bob major or grand ##sir ##e cater ##s .

reference_raw: The ringers remember models of change, known as "methods," with strange-sounding names like Kent Treble Bob Major or Grandsire Caters.

reference_spacy_tokens: The ringers remember models of change , known as " methods , " with strange - sounding names like Kent Treble Bob Major or Grandsire Caters .


fn_spacy_tokens_for_baseline: She was awful at school .

source_bert_toks: she was awful at school .

reference_raw: She was terrible at school.

reference_spacy_tokens: She was terrible at school .


fn_spacy_tokens_for_baseline: The man holding her was short and chubby .

source_bert_toks: the man holding her was short and chu ##bby .

reference_raw: The man holding her was small and plump.

reference_spacy_tokens: The man holding her was small and plump .


fn_spacy_tokens_for_baseline: In the very off chance that you come across archaeological finds such as ancient anchors , wine - jars , even sculpture , they must be reported to local municipal authorities .

source_bert_toks: in the very off chance that you come across archaeological finds such as ancient anchors , wine - jars , even sculpture , they must be reported to local municipal authorities .

reference_raw: If you encounter archaeological discoveries like old anchors, wine jars, even statues, you have to report them to the local community.

reference_spacy_tokens: If you encounter archaeological discoveries like old anchors , wine jars , even statues , you have to report them to the local community .


fn_spacy_tokens_for_baseline: Magnus was either dragged out of sanctuary from a church on Egilsay or he voluntarily surrendered himself to his enemies .

source_bert_toks: magnus was either dragged out of sanctuary from a church on e ##gil ##say or he voluntarily surrendered himself to his enemies .

reference_raw: Magnus was either dragged from the sanctuary of the Church on Egilsay, or he volunteered to give himself up to his enemies.

reference_spacy_tokens: Magnus was either dragged from the sanctuary of the Church on Egilsay , or he volunteered to give himself up to his enemies .


fn_spacy_tokens_for_baseline: It was certain from the first , however , that they would eventually be detected , as the cook , from the evidence of one or two tradespeople who have caught a glimpse of him through the window , was a man of most remarkable appearance - being a huge and hideous mulatto , with yellowish features of a pronounced negroid type .

source_bert_toks: it was certain from the first , however , that they would eventually be detected , as the cook , from the evidence of one or two trades ##pe ##ople who have caught a glimpse of him through the window , was a man of most remarkable appearance - being a huge and hideous mu ##lat ##to , with yellowish features of a pronounced negro ##id type .

reference_raw: From the first, however, it was certain that they would eventually be discovered, because the cook, from the evidence of one or two merchants who had seen him through the window, was a man of the most remarkable appearance - a large and ugly mulatto with yellowish features of a pronounced black type.

reference_spacy_tokens: From the first , however , it was certain that they would eventually be discovered , because the cook , from the evidence of one or two merchants who had seen him through the window , was a man of the most remarkable appearance - a large and ugly mulatto with yellowish features of a pronounced black type .


fn_spacy_tokens_for_baseline: The bag was bumping against her legs as she turned into Corporation Lane .

source_bert_toks: the bag was bump ##ing against her legs as she turned into corporation lane .

reference_raw: When she turned into Corporation Lane, the bag hit her feet.

reference_spacy_tokens: When she turned into Corporation Lane , the bag hit her feet .


fn_spacy_tokens_for_baseline: The three servicemen accused of abducting the girl from an Okinawa street and raping her on a local beach are being held in a maximum security brig at a Marine base on the southern Japanese island .

source_bert_toks: the three servicemen accused of abd ##uc ##ting the girl from an okinawa street and rap ##ing her on a local beach are being held in a maximum security brig at a marine base on the southern japanese island .

reference_raw: Three servicemen accused of kidnapping a girl from Okinawa Street and raping her on a local beach are being held in a maximum security detail at a naval base on the South Japanese island.

reference_spacy_tokens: Three servicemen accused of kidnapping a girl from Okinawa Street and raping her on a local beach are being held in a maximum security detail at a naval base on the South Japanese island .


fn_spacy_tokens_for_baseline: Careful management of such clumps can result in the production of high - quality timber while the areas in between are available for the natural regeneration of trees , shrubs and ground flora .

source_bert_toks: careful management of such cl ##ump ##s can result in the production of high - quality timber while the areas in between are available for the natural regeneration of trees , shrubs and ground flora .

reference_raw: Careful management of these clusters may lead to the production of high-quality wood, while areas in the meantime are available for natural regeneration of trees, bushes and ground flora.

reference_spacy_tokens: Careful management of these clusters may lead to the production of high - quality wood , while areas in the meantime are available for natural regeneration of trees , bushes and ground flora .


fn_spacy_tokens_for_baseline: They clattered their spoons dutifully around their plates .

source_bert_toks: they cl ##atter ##ed their spoon ##s du ##ti ##fully around their plates .

reference_raw: They trudged their spoons obediently around the plates.

reference_spacy_tokens: They trudged their spoons obediently around the plates .


fn_spacy_tokens_for_baseline: Montedison currently owns about 72 % of Erbamont 's common shares outstanding .

source_bert_toks: monte ##dis ##on currently owns about 72 % of er ##ba ##mont ' s common shares outstanding .

reference_raw: Montedison currently owns approximately 72% of the ordinary shares outstanding in Erbamont.

reference_spacy_tokens: Montedison currently owns approximately 72 % of the ordinary shares outstanding in Erbamont .


fn_spacy_tokens_for_baseline: The pairing was the one feared most , because of painful memories of violence at last year 's European championship in West Germany .

source_bert_toks: the pairing was the one feared most , because of painful memories of violence at last year ' s european championship in west germany .

reference_raw: The pairing was the one most feared, due to the painful recollections of the violence of last year's European Championship in West Germany.

reference_spacy_tokens: The pairing was the one most feared , due to the painful recollections of the violence of last year 's European Championship in West Germany .


fn_spacy_tokens_for_baseline: This information is incomplete however , as stool excretion was not regularly monitored and the latter two children only had single stools examined .

source_bert_toks: this information is incomplete however , as stool ex ##cre ##tion was not regularly monitored and the latter two children only had single stool ##s examined .

reference_raw: However, this information is not complete since the excretion of stools was not regularly monitored and only one stool was examined in the last two children.

reference_spacy_tokens: However , this information is not complete since the excretion of stools was not regularly monitored and only one stool was examined in the last two children .


fn_spacy_tokens_for_baseline: Among the many challenges now facing Libya 's transitional government is to prevent bloodshed between pro- and anti - Kadafi Libyans , and even among the competing factions that fought to overthrow him .

source_bert_toks: among the many challenges now facing libya ' s transitional government is to prevent blood ##shed between pro - and anti - ka ##da ##fi libyan ##s , and even among the competing factions that fought to overthrow him .

reference_raw: One of the many challenges that Libya's transition government now faces is to prevent a bloodbath among pro- and anti-Kadafi Libyans, and even among competing factions that fought to overthrow it.

reference_spacy_tokens: One of the many challenges that Libya 's transition government now faces is to prevent a bloodbath among pro- and anti - Kadafi Libyans , and even among competing factions that fought to overthrow it .


fn_spacy_tokens_for_baseline: On the basis set out below , the Offer values Palatine at £ 54,150,000 , and each Palatine ordinary share at £ 3.00 .

source_bert_toks: on the basis set out below , the offer values palatine at £5 ##4 , 150 , 000 , and each palatine ordinary share at £3 . 00 .

reference_raw: On the basis of the following, the offer prices Palatine at £54,150,000 and each of the Palatine ordinary shares at £3.00.

reference_spacy_tokens: On the basis of the following , the offer prices Palatine at £ 54,150,000 and each of the Palatine ordinary shares at £ 3.00 .


fn_spacy_tokens_for_baseline: Pedicabs were once the most common form of transportation in Macau , but today they are mainly a tourist attraction .

source_bert_toks: pe ##dic ##ab ##s were once the most common form of transportation in macau , but today they are mainly a tourist attraction .

reference_raw: The pedicabs used to be the most common mode of transport in Macao, but today they're the most popular tour attraction.

reference_spacy_tokens: The pedicabs used to be the most common mode of transport in Macao , but today they 're the most popular tour attraction .


fn_spacy_tokens_for_baseline: But nearly everybody in this hotel uses crack .

source_bert_toks: but nearly everybody in this hotel uses crack .

reference_raw: But almost everyone in this hotel uses junk.

reference_spacy_tokens: But almost everyone in this hotel uses junk .


fn_spacy_tokens_for_baseline: But she did n't want Karen 's reassurance now , for she turned her back , furious that anyone had seen her upset .

source_bert_toks: but she didn ' t want karen ' s re ##ass ##urance now , for she turned her back , furious that anyone had seen her upset .

reference_raw: But she did not want Karen's assurance now, for she turned her back, angry that someone had seen her angry.

reference_spacy_tokens: But she did not want Karen 's assurance now , for she turned her back , angry that someone had seen her angry .


fn_spacy_tokens_for_baseline: A heavy door swung open and a figure beckoned them into a warm lozenge of light .

source_bert_toks: a heavy door swung open and a figure beck ##oned them into a warm lo ##zen ##ge of light .

reference_raw: The heavy door opened and a figure motioned to them in a warm haze of light.

reference_spacy_tokens: The heavy door opened and a figure motioned to them in a warm haze of light .


fn_spacy_tokens_for_baseline: The countryside south of Tabor is mainly cereal - growing , dotted here and there with little lakes .

source_bert_toks: the countryside south of tab ##or is mainly cereal - growing , dotted here and there with little lakes .

reference_raw: The countryside south of Tabor is mainly cereal-growing, speckled here and there with small lakes.

reference_spacy_tokens: The countryside south of Tabor is mainly cereal - growing , speckled here and there with small lakes .


fn_spacy_tokens_for_baseline: Some victims were resuscitated after being hanged , others reprieved and pardoned after mishaps with faulty traps or frayed ropes .

source_bert_toks: some victims were res ##us ##cit ##ated after being hanged , others rep ##rie ##ved and pardon ##ed after mis ##ha ##ps with faulty traps or fray ##ed ropes .

reference_raw: Some of the victims were resurrected after hanging, others reprieved and pardoned after an accident with faulty traps or frayed ropes.

reference_spacy_tokens: Some of the victims were resurrected after hanging , others reprieved and pardoned after an accident with faulty traps or frayed ropes .


fn_spacy_tokens_for_baseline: Severe winters greatly inflate the numbers of nearly all wintering wildfowl .

source_bert_toks: severe winters greatly in ##fl ##ate the numbers of nearly all winter ##ing wild ##fo ##wl .

reference_raw: Severe winters greatly increase the number of almost all winter poultry.

reference_spacy_tokens: Severe winters greatly increase the number of almost all winter poultry .


fn_spacy_tokens_for_baseline: To my jaded ears it is a stupendous musical achievement .

source_bert_toks: to my jade ##d ears it is a stu ##pen ##dou ##s musical achievement .

reference_raw: It's a stunning musical success for my jaded ears.

reference_spacy_tokens: It 's a stunning musical success for my jaded ears .


fn_spacy_tokens_for_baseline: The little boy pattered along beside me , looking up and smiling .

source_bert_toks: the little boy pat ##tered along beside me , looking up and smiling .

reference_raw: The little boy patted beside me, looked up and smiled.

reference_spacy_tokens: The little boy patted beside me , looked up and smiled .


fn_spacy_tokens_for_baseline: COMPUTER wizard Colin Saunders has won £ 2,000 worth of hardware and software in an Auto CAD user - of - the - year competition .

source_bert_toks: computer wizard colin saunders has won £2 , 000 worth of hardware and software in an auto cad user - of - the - year competition .

reference_raw: COMPUTER Magician Colin Saunders won £2,000 worth of hardware and software in a year's Auto CAD competition.

reference_spacy_tokens: COMPUTER Magician Colin Saunders won £ 2,000 worth of hardware and software in a year 's Auto CAD competition .


fn_spacy_tokens_for_baseline: ( a ) The protocerebral lobes are fused together along the mid line to form a bilobed ganglion .

source_bert_toks: ( a ) the proto ##cer ##eb ##ral lobes are fused together along the mid line to form a bi ##lo ##bed gang ##lion .

reference_raw: The protocerebral lobes shall be merged along the middle line to form a bilobed ganglion.

reference_spacy_tokens: The protocerebral lobes shall be merged along the middle line to form a bilobed ganglion .


fn_spacy_tokens_for_baseline: As she felt her hair being yanked , she screamed .

source_bert_toks: as she felt her hair being yanked , she screamed .

reference_raw: She screamed as she felt her hair jerk.

reference_spacy_tokens: She screamed as she felt her hair jerk .


fn_spacy_tokens_for_baseline: The Remote Control - Overcoming Your Dependency 24 .

source_bert_toks: the remote control - overcoming your dependency 24 .

reference_raw: Remote Management - Overcoming your dependency 24.

reference_spacy_tokens: Remote Management - Overcoming your dependency 24 .


fn_spacy_tokens_for_baseline: Some people become ' procedure police ' at meetings ; they dodge joining in discussion of matters under consideration by constantly raising ' points of order ' .

source_bert_toks: some people become ' procedure police ' at meetings ; they dodge joining in discussion of matters under consideration by constantly raising ' points of order ' .

reference_raw: Some people become "procedure police" at meetings; they avoid joining in the discussion of the matter under consideration by constantly raising "points of order".

reference_spacy_tokens: Some people become " procedure police " at meetings ; they avoid joining in the discussion of the matter under consideration by constantly raising " points of order " .


fn_spacy_tokens_for_baseline: The terms of section 40 seem to me strongly to support the conclusions reached so far .

source_bert_toks: the terms of section 40 seem to me strongly to support the conclusions reached so far .

reference_raw: In my view, the wording of Article 40 strongly endorses the conclusions reached so far.

reference_spacy_tokens: In my view , the wording of Article 40 strongly endorses the conclusions reached so far .


fn_spacy_tokens_for_baseline: I 'm hitting my head repeatedly against something that is n't there and I suppose that that could be a definition of insanity .

source_bert_toks: i ' m hitting my head repeatedly against something that isn ' t there and i suppose that that could be a definition of insanity .

reference_raw: I'm banging my head over and over again with something that's not there, and I think it might be the definition of madness.

reference_spacy_tokens: I 'm banging my head over and over again with something that 's not there , and I think it might be the definition of madness .


fn_spacy_tokens_for_baseline: The recruits hurried below to pack into the on - ship chapel , where incense burned before a lambent golden icon of the Emperor and an alabaster idol of Rogal Dorn , the founding Primarch of the Imperial Fists .

source_bert_toks: the recruits hurried below to pack into the on - ship chapel , where incense burned before a lamb ##ent golden icon of the emperor and an ala ##bas ##ter idol of ro ##gal do ##rn , the founding prima ##rch of the imperial fists .

reference_raw: The recruits hurried down to the ship's chapel, where the incense burned in front of the Emperor's pale golden icon and the alabaster idol of Rogal Dorn, the founding Primarch of the Imperial Fists.

reference_spacy_tokens: The recruits hurried down to the ship 's chapel , where the incense burned in front of the Emperor 's pale golden icon and the alabaster idol of Rogal Dorn , the founding Primarch of the Imperial Fists .


fn_spacy_tokens_for_baseline: The violence seethed inside him , like milk bubbling in a saucepan , trying to boil over and escape the unendurable heat .

source_bert_toks: the violence see ##thed inside him , like milk bubbling in a sauce ##pan , trying to boil over and escape the une ##nd ##urable heat .

reference_raw: Violence seeped in him, like milk boiling in a saucepan, trying to boil and escape the unendurable heat.

reference_spacy_tokens: Violence seeped in him , like milk boiling in a saucepan , trying to boil and escape the unendurable heat .


fn_spacy_tokens_for_baseline: He was swigging hot chocolate , his tatty carrier bag on one side of him and the tin of biscuits on the other .

source_bert_toks: he was sw ##ig ##ging hot chocolate , his ta ##tty carrier bag on one side of him and the tin of biscuits on the other .

reference_raw: He was smoking hot chocolate, with a tatty carrier bag on one side and a can of cookies on the other.

reference_spacy_tokens: He was smoking hot chocolate , with a tatty carrier bag on one side and a can of cookies on the other .


fn_spacy_tokens_for_baseline: We teamed up with Age Concern to find Britain 's best grandparent and were delighted by the avalanche of heart - warming nomina you sent in .

source_bert_toks: we teamed up with age concern to find britain ' s best grandpa ##rent and were delighted by the avalanche of heart - warming no ##mina you sent in .

reference_raw: We've teamed up with Age Concern to find the best grandparents in Britain, and we've been pleased with the avalanche of heart-warming candidates you've sent.

reference_spacy_tokens: We 've teamed up with Age Concern to find the best grandparents in Britain , and we 've been pleased with the avalanche of heart - warming candidates you 've sent .


fn_spacy_tokens_for_baseline: FIVE men were killed and two seriously injured when two vans smashed head - on yesterday .

source_bert_toks: five men were killed and two seriously injured when two vans smashed head - on yesterday .

reference_raw: Five men were killed and two were seriously wounded when two vans hit their heads last night.

reference_spacy_tokens: Five men were killed and two were seriously wounded when two vans hit their heads last night .


fn_spacy_tokens_for_baseline: The largest , by far , is the modern section and the center of this , clustered around the palm trees and fountains of the Parque de la Alameda , is taken up with busy sidewalk cafes , smart boutiques , banks , and real estate agents ' offices .

source_bert_toks: the largest , by far , is the modern section and the center of this , clustered around the palm trees and fountains of the par ##que de la alam ##eda , is taken up with busy sidewalk cafes , smart boutique ##s , banks , and real estate agents ' offices .

reference_raw: The largest, by far, is the modern section, and the center of it, clustered around the palm trees and fountains of the Parque de la Alameda, is occupied by busy sidewalk cafes, intelligent boutiques, banks, and real estate agencies.

reference_spacy_tokens: The largest , by far , is the modern section , and the center of it , clustered around the palm trees and fountains of the Parque de la Alameda , is occupied by busy sidewalk cafes , intelligent boutiques , banks , and real estate agencies .


fn_spacy_tokens_for_baseline: And welfare reform is an uncertain solution with an unknown starting date .

source_bert_toks: and welfare reform is an uncertain solution with an unknown starting date .

reference_raw: And social reform is a precarious solution with an unrecognizable start date.

reference_spacy_tokens: And social reform is a precarious solution with an unrecognizable start date .


fn_spacy_tokens_for_baseline: Three cups of neat Malibu mixed well with the rose wine and Armagnac I had drunk at supper and I felt garrulous and cheerful , confiding in strangers and telling the story of my life .

source_bert_toks: three cups of neat malibu mixed well with the rose wine and arm ##ag ##nac i had drunk at supper and i felt ga ##rr ##ulous and cheerful , con ##fi ##ding in strangers and telling the story of my life .

reference_raw: Three cups of neat Malibu blended well with rose wine and Armagnac, which I drank at dinner, and made me feel bright and happy, confiding in strangers and telling the story of my life.

reference_spacy_tokens: Three cups of neat Malibu blended well with rose wine and Armagnac , which I drank at dinner , and made me feel bright and happy , confiding in strangers and telling the story of my life .


fn_spacy_tokens_for_baseline: Adoptive children should nurse at the breast of one of the immediate family in order to have the freedom of the family when they are adult .

source_bert_toks: adoptive children should nurse at the breast of one of the immediate family in order to have the freedom of the family when they are adult .

reference_raw: Adoptive children should breast-feed at the breast of one of the immediate families so that they can be free of the family when they grow up.

reference_spacy_tokens: Adoptive children should breast - feed at the breast of one of the immediate families so that they can be free of the family when they grow up .


fn_spacy_tokens_for_baseline: It was the first report of an improvement in Mandela 's condition since he was admitted to a hospital in Pretoria early Saturday after suffering a recurrence of a persistent lung ailment , a legacy of the tuberculosis he contracted during the 27 years he was imprisoned for opposing apartheid .

source_bert_toks: it was the first report of an improvement in mandela ' s condition since he was admitted to a hospital in pretoria early saturday after suffering a rec ##ur ##rence of a persistent lung ai ##lm ##ent , a legacy of the tuberculosis he contracted during the 27 years he was imprisoned for opposing apartheid .

reference_raw: It was the first report of an improvement in Mandela's condition since he had been admitted to a hospital in Pretoria at the beginning of Saturday after he had suffered a recurrence of persistent lung disease, a legacy of tuberculosis he had contracted during his 27 years incarcerated for opposition to apartheid.

reference_spacy_tokens: It was the first report of an improvement in Mandela 's condition since he had been admitted to a hospital in Pretoria at the beginning of Saturday after he had suffered a recurrence of persistent lung disease , a legacy of tuberculosis he had contracted during his 27 years incarcerated for opposition to apartheid .


fn_spacy_tokens_for_baseline: Ellis pushed away his dish of cherry pie and whipped cream .

source_bert_toks: ellis pushed away his dish of cherry pie and whipped cream .

reference_raw: Ellis pushed away a bowl of cherry pie and cream.

reference_spacy_tokens: Ellis pushed away a bowl of cherry pie and cream .


fn_spacy_tokens_for_baseline: Cleanse your face as usual and take off any residue with toner .

source_bert_toks: clean ##se your face as usual and take off any residue with tone ##r .

reference_raw: Clean your face as usual and remove any residue with toner.

reference_spacy_tokens: Clean your face as usual and remove any residue with toner .


fn_spacy_tokens_for_baseline: But Warrington have warned they may cite Jones for a different challenge in the same game .

source_bert_toks: but warrington have warned they may cite jones for a different challenge in the same game .

reference_raw: But Warrington warned that Jones could be quoted for another challenge in the same game.

reference_spacy_tokens: But Warrington warned that Jones could be quoted for another challenge in the same game .


fn_spacy_tokens_for_baseline: I often wonder when a really great fictional book will be written about this era ( probably decades and decades hence as it is too close ) .

source_bert_toks: i often wonder when a really great fictional book will be written about this era ( probably decades and decades hence as it is too close ) .

reference_raw: I often wonder when a really great fictional book will be written on this era (probably decades and decades, because it's too close).

reference_spacy_tokens: I often wonder when a really great fictional book will be written on this era ( probably decades and decades , because it 's too close ) .


fn_spacy_tokens_for_baseline: Little lines of crawling blue fire crackled over Jekub 's battered paintwork .

source_bert_toks: little lines of crawling blue fire crack ##led over je ##ku ##b ' s battered paint ##work .

reference_raw: Little rows of creeping blue fire creaked across Jekub's battered paintwork.

reference_spacy_tokens: Little rows of creeping blue fire creaked across Jekub 's battered paintwork .


fn_spacy_tokens_for_baseline: Stir in yeast , make a well in the centre and slowly pour in the onion liquid and one teaspoon of the olive oil , stirring constantly to form a smooth dough .

source_bert_toks: stir in yeast , make a well in the centre and slowly pour in the onion liquid and one tea ##sp ##oon of the olive oil , stirring constantly to form a smooth dough .

reference_raw: Stir in the yeast, make a well in the middle and pour slowly into the onion fluid and one spoon of olive oil, which is constantly stirred to form a smooth dough.

reference_spacy_tokens: Stir in the yeast , make a well in the middle and pour slowly into the onion fluid and one spoon of olive oil , which is constantly stirred to form a smooth dough .


fn_spacy_tokens_for_baseline: The corruption and moral crisis revealed in the foreign policy of the United State . , is such that we women raise our voices in protest against the insulting and base behaviour of Mr Christopher Dodd [ Democrat Senator ] , who committed the crass error of calling our country a ' nest of rats ' .

source_bert_toks: the corruption and moral crisis revealed in the foreign policy of the united state . , is such that we women raise our voices in protest against the insulting and base behaviour of mr christopher dodd [ democrat senator ] , who committed the cr ##ass error of calling our country a ' nest of rats ' .

reference_raw: The corruption and moral crisis revealed by the foreign policy of the United States is such that we women raise our voices in protest of the insult and fundamental behavior of Mr Christopher Dodd [Democrat Senator], who made a crazy mistake by calling our country a rat's nest.

reference_spacy_tokens: The corruption and moral crisis revealed by the foreign policy of the United States is such that we women raise our voices in protest of the insult and fundamental behavior of Mr Christopher Dodd [ Democrat Senator ] , who made a crazy mistake by calling our country a rat 's nest .


fn_spacy_tokens_for_baseline: Paros and Andros contributed to the Persian armory , while others supported Athens .

source_bert_toks: par ##os and and ##ros contributed to the persian armory , while others supported athens .

reference_raw: Paros and Andros contributed to the Persian Armory, while the rest supported Athens.

reference_spacy_tokens: Paros and Andros contributed to the Persian Armory , while the rest supported Athens .


fn_spacy_tokens_for_baseline: In order to incite her husband against her stepson , Sigistrix , she claimed that the prince intended to kill his father , to take over Burgundy and subsequently Italy .

source_bert_toks: in order to inc ##ite her husband against her steps ##on , si ##gist ##rix , she claimed that the prince intended to kill his father , to take over burgundy and subsequently italy .

reference_raw: To provoke her husband against her stepson, Sigistrix, she claimed that the prince intended to kill his father, take over Burgundy, and then Italy.

reference_spacy_tokens: To provoke her husband against her stepson , Sigistrix , she claimed that the prince intended to kill his father , take over Burgundy , and then Italy .


fn_spacy_tokens_for_baseline: The complete interior of the house could not be occupied until the final months of 1985 and the owners stayed for only one further year before the challenge of converting a local barn tempted them away !

source_bert_toks: the complete interior of the house could not be occupied until the final months of 1985 and the owners stayed for only one further year before the challenge of converting a local barn tempted them away !

reference_raw: The whole inside of the house could not be occupied until the last months of 1985, and the owners stayed only another year until they were tempted by the challenge of converting the local barn!

reference_spacy_tokens: The whole inside of the house could not be occupied until the last months of 1985 , and the owners stayed only another year until they were tempted by the challenge of converting the local barn !


fn_spacy_tokens_for_baseline: I had nothing to do but paddle , and my fingers blistered as we canoed around Laguna Grande while the Australian , crouched in the bow with his bazooka lens , shook his head and tutted at each audible paddle stroke .

source_bert_toks: i had nothing to do but paddle , and my fingers b ##list ##ered as we canoe ##d around laguna grande while the australian , crouched in the bow with his ba ##zoo ##ka lens , shook his head and tu ##tted at each audible paddle stroke .

reference_raw: I had nothing to do but paddle, and my fingers were blistering as we made our way around the Laguna Grande, while the Australian, crouched in the bow with his bazooka lens, shook his head and tugged at every sound paddle stroke.

reference_spacy_tokens: I had nothing to do but paddle , and my fingers were blistering as we made our way around the Laguna Grande , while the Australian , crouched in the bow with his bazooka lens , shook his head and tugged at every sound paddle stroke .


fn_spacy_tokens_for_baseline: It upset him , as much as it would have upset his wife , to know that the boy had eavesdropped on this most intimate family moment .

source_bert_toks: it upset him , as much as it would have upset his wife , to know that the boy had ea ##ves ##drop ##ped on this most intimate family moment .

reference_raw: It irritated him, as much as it would upset his wife, to know that the boy had been listening to this most intimate family moment.

reference_spacy_tokens: It irritated him , as much as it would upset his wife , to know that the boy had been listening to this most intimate family moment .


fn_spacy_tokens_for_baseline: Libya first acquired Scud - B missiles in the early 1970 s from the Soviet Union .

source_bert_toks: libya first acquired sc ##ud - b missiles in the early 1970 s from the soviet union .

reference_raw: Libya first acquired Scud-B rockets from the Soviet Union in the early 1970s.

reference_spacy_tokens: Libya first acquired Scud - B rockets from the Soviet Union in the early 1970s .


fn_spacy_tokens_for_baseline: He weighed the evidence very carefully .

source_bert_toks: he weighed the evidence very carefully .

reference_raw: He considered the evidence very carefully.

reference_spacy_tokens: He considered the evidence very carefully .


fn_spacy_tokens_for_baseline: Turntable is recessed into oven floor and it can be switched off when grilling or microwaving food in square or rectangular dishes .

source_bert_toks: turn ##table is recess ##ed into oven floor and it can be switched off when grill ##ing or micro ##wa ##ving food in square or rectangular dishes .

reference_raw: The turntable shall be inserted into the floor of the oven and may be turned off during grilling or micro-waving meals in square or rectangular dishes.

reference_spacy_tokens: The turntable shall be inserted into the floor of the oven and may be turned off during grilling or micro - waving meals in square or rectangular dishes .


fn_spacy_tokens_for_baseline: Pineau informed de Gaulle about the strongly republican and socialist trend of resistance ideology and tried to persuade him to abandon his political reticence , which was causing concern among resisters .

source_bert_toks: pine ##au informed de gaulle about the strongly republican and socialist trend of resistance ideology and tried to persuade him to abandon his political re ##tic ##ence , which was causing concern among resist ##ers .

reference_raw: Pineau informed de Gaulle of a strong Republican and socialist trend in resistance ideology and tried to convince him to abandon his political restraint, which was a source of concern among the resistors.

reference_spacy_tokens: Pineau informed de Gaulle of a strong Republican and socialist trend in resistance ideology and tried to convince him to abandon his political restraint , which was a source of concern among the resistors .


fn_spacy_tokens_for_baseline: He has no time to waste .

source_bert_toks: he has no time to waste .

reference_raw: He doesn't have time to waste.

reference_spacy_tokens: He does n't have time to waste .


fn_spacy_tokens_for_baseline: 1980:302 -- 3 ) , while Dawson draws attention to the probable importance of parent demand ( a Political factor ) in determining ' differences in expenditure per pupil ' ( Dawson 1976 : 14 ) .

source_bert_toks: 1980 : 302 - - 3 ) , while dawson draws attention to the probable importance of parent demand ( a political factor ) in determining ' differences in expenditure per pupil ' ( dawson 1976 : 14 ) .

reference_raw: 1980:302 - 3), whereas Dawson draws attention to the likely importance of the need for parents (a political factor) in determining "differences in spending per pupil" (Dawson 1976: 14).

reference_spacy_tokens: 1980:302 - 3 ) , whereas Dawson draws attention to the likely importance of the need for parents ( a political factor ) in determining " differences in spending per pupil " ( Dawson 1976 : 14 ) .


fn_spacy_tokens_for_baseline: You can walk around the peak for impressive views of Hong Kong , the coastline , and the islands in 45 minutes on Lugard and Harlech roads .

source_bert_toks: you can walk around the peak for impressive views of hong kong , the coastline , and the islands in 45 minutes on lu ##gard and ha ##rle ##ch roads .

reference_raw: In 45 minutes, on the roads of Lugard and Harlech, you can walk around the top for impressive views of Hong Kong, the coastline, and the islands.

reference_spacy_tokens: In 45 minutes , on the roads of Lugard and Harlech , you can walk around the top for impressive views of Hong Kong , the coastline , and the islands .


fn_spacy_tokens_for_baseline: The sky was black over the mountains .

source_bert_toks: the sky was black over the mountains .

reference_raw: Above the mountains the sky was dark.

reference_spacy_tokens: Above the mountains the sky was dark .


fn_spacy_tokens_for_baseline: There had been a phenomenally heavy snowstorm in Baldersdale , and especially on the loftier peaks .

source_bert_toks: there had been a phenomena ##lly heavy snow ##storm in bald ##ers ##dale , and especially on the loft ##ier peaks .

reference_raw: There was a phenomenally heavy storm in Baldersdale, especially on higher peaks.

reference_spacy_tokens: There was a phenomenally heavy storm in Baldersdale , especially on higher peaks .


fn_spacy_tokens_for_baseline: All thoughts of Seal Sands Lock were stashed away , safe from the mockery of people like Gazzer .

source_bert_toks: all thoughts of seal sands lock were st ##ash ##ed away , safe from the mock ##ery of people like ga ##zz ##er .

reference_raw: All thoughts of the Seal Sands Lock were hidden away, safe from mocking people like Gazzer.

reference_spacy_tokens: All thoughts of the Seal Sands Lock were hidden away , safe from mocking people like Gazzer .


fn_spacy_tokens_for_baseline: Meanwhile another Dollfus , great - grandson of the founder , entered another local family firm , Schlumberger et Cie .

source_bert_toks: meanwhile another doll ##fus , great - grandson of the founder , entered another local family firm , sc ##hl ##umber ##ger et ci ##e .

reference_raw: Meanwhile, another Dollfus, the founder's great-great-grandson, entered another local family company, Schlumberger et Cie.

reference_spacy_tokens: Meanwhile , another Dollfus , the founder 's great - great - grandson , entered another local family company , Schlumberger et Cie .


fn_spacy_tokens_for_baseline: Mussels and oysters are usually canned in cotton seed oil which is very strong , so they should be well rinsed before use and , if necessary , tossed in a little olive oil to restore their flavour .

source_bert_toks: mu ##ssel ##s and oyster ##s are usually canned in cotton seed oil which is very strong , so they should be well ri ##nsed before use and , if necessary , tossed in a little olive oil to restore their flavour .

reference_raw: The mussels and oysters are usually preserved in cotton seed oil, which is very strong, so that they should be well rinsed prior to use and, if necessary, disposed of with a small amount of olive oil to restore their flavour.

reference_spacy_tokens: The mussels and oysters are usually preserved in cotton seed oil , which is very strong , so that they should be well rinsed prior to use and , if necessary , disposed of with a small amount of olive oil to restore their flavour .


fn_spacy_tokens_for_baseline: Without waiting to be invited , Venables sat down on the one unoccupied chair , facing the detective inspector across the table .

source_bert_toks: without waiting to be invited , ve ##nable ##s sat down on the one uno ##cc ##up ##ied chair , facing the detective inspector across the table .

reference_raw: Without waiting for an invitation, Venables sat in a single empty chair and faced the detective inspector across the table.

reference_spacy_tokens: Without waiting for an invitation , Venables sat in a single empty chair and faced the detective inspector across the table .


fn_spacy_tokens_for_baseline: Had he been , he would have made Michael Codron 's chastisement seem like a love paean .

source_bert_toks: had he been , he would have made michael cod ##ron ' s cha ##stis ##ement seem like a love pa ##ean .

reference_raw: If he were, he'd make Michael Codron's chastity look like a paean of love.

reference_spacy_tokens: If he were , he 'd make Michael Codron 's chastity look like a paean of love .


fn_spacy_tokens_for_baseline: Hamlyn continues its All Colour series with volumes on Herbs and Aromatics and Greenhouse Gardening .

source_bert_toks: ham ##lyn continues its all colour series with volumes on herbs and aromatic ##s and greenhouse gardening .

reference_raw: Hamlyn continues the All-Colour series of Herbs, Aromatics and Greenhouse Gardening.

reference_spacy_tokens: Hamlyn continues the All - Colour series of Herbs , Aromatics and Greenhouse Gardening .


fn_spacy_tokens_for_baseline: But Coleco bounced back with the introduction of the Cabbage Patch dolls , whose sales hit $ 600 million in 1985 .

source_bert_toks: but cole ##co bounced back with the introduction of the cabbage patch dolls , whose sales hit $ 600 million in 1985 .

reference_raw: But Coleco bounced back with the introduction of Cabbage Patch dolls, the sale of which reached $600 million in 1985.

reference_spacy_tokens: But Coleco bounced back with the introduction of Cabbage Patch dolls , the sale of which reached $ 600 million in 1985 .


fn_spacy_tokens_for_baseline: The current can jump across the gap because the tip is so close .

source_bert_toks: the current can jump across the gap because the tip is so close .

reference_raw: The current can leap across the gap because the tip is so close.

reference_spacy_tokens: The current can leap across the gap because the tip is so close .


fn_spacy_tokens_for_baseline: There were times when his grandma or his aunties made trouble for him behind his back , or when someone would comment on his lack of height and Sweetheart would punish him for the embarrassment he caused her .

source_bert_toks: there were times when his grandma or his aunt ##ies made trouble for him behind his back , or when someone would comment on his lack of height and sweetheart would punish him for the embarrassment he caused her .

reference_raw: There was a time when his grandmother or aunts would make trouble behind his back, or when someone would comment on his lack of height, and Sweetheart would punish him for the embarrassment he had caused her.

reference_spacy_tokens: There was a time when his grandmother or aunts would make trouble behind his back , or when someone would comment on his lack of height , and Sweetheart would punish him for the embarrassment he had caused her .


fn_spacy_tokens_for_baseline: QN : Did Vaughn use a gun to kill the four hostages ?

source_bert_toks: q ##n : did vaughn use a gun to kill the four hostages ?

reference_raw: Did Vaughn use a weapon to kill four hostages?

reference_spacy_tokens: Did Vaughn use a weapon to kill four hostages ?


fn_spacy_tokens_for_baseline: It had rained , the earth was soggy

source_bert_toks: it had rained , the earth was so ##ggy

reference_raw: It was raining, the ground was wet.

reference_spacy_tokens: It was raining , the ground was wet .


fn_spacy_tokens_for_baseline: For 60 years Jerusalem lay in ruins , until the Roman Emperor Hadrian ordered the city rebuilt as a Roman town dedicated to Jupiter .

source_bert_toks: for 60 years jerusalem lay in ruins , until the roman emperor had ##rian ordered the city rebuilt as a roman town dedicated to jupiter .

reference_raw: Jerusalem lay in ruins for sixty years, until the Roman Empire of Hadrian ordered the city to be rebuilt as a Roman city dedicated to Jupiter.

reference_spacy_tokens: Jerusalem lay in ruins for sixty years , until the Roman Empire of Hadrian ordered the city to be rebuilt as a Roman city dedicated to Jupiter .


fn_spacy_tokens_for_baseline: Mr Jencks argues that while long - term male joblessness and unwed parenthood have got worse , school drop - out rates have improved ; and the number of violent crimes ( other than homicide ) and the proportion of the population on welfare are at least not getting worse .

source_bert_toks: mr jen ##cks argues that while long - term male job ##lessness and un ##wed parent ##hood have got worse , school drop - out rates have improved ; and the number of violent crimes ( other than homicide ) and the proportion of the population on welfare are at least not getting worse .

reference_raw: According to Mr Jencks, while long-term male unemployment and unmarried parenthood have deteriorated, school drop-out rates have improved; and at least the number of violent crimes (other than murder) and the share of the population in well-being has not deteriorated.

reference_spacy_tokens: According to Mr Jencks , while long - term male unemployment and unmarried parenthood have deteriorated , school drop - out rates have improved ; and at least the number of violent crimes ( other than murder ) and the share of the population in well - being has not deteriorated .


fn_spacy_tokens_for_baseline: The servant girl came into my chamber and told me that there was a ' sort of demon ' downstairs , jabbering in a strange tongue .

source_bert_toks: the servant girl came into my chamber and told me that there was a ' sort of demon ' downstairs , ja ##bber ##ing in a strange tongue .

reference_raw: A maid came into my room and told me there was a "sort of demon" down there, babbling in a strange language.

reference_spacy_tokens: A maid came into my room and told me there was a " sort of demon " down there , babbling in a strange language .


fn_spacy_tokens_for_baseline: In the last chapter I said that the average consumption of fat in the Western world is about 130 grams ( over 4 UNC ounces ) a day .

source_bert_toks: in the last chapter i said that the average consumption of fat in the western world is about 130 grams ( over 4 un ##c ounce ##s ) a day .

reference_raw: In the last chapter I stated that the average consumption of fat in the Western world is about 130 g (more than 4 UNC ounces) per day.

reference_spacy_tokens: In the last chapter I stated that the average consumption of fat in the Western world is about 130 g ( more than 4 UNC ounces ) per day .


fn_spacy_tokens_for_baseline: Over a period of time she was seen by a number of psychotherapists and psychologists who adopted differing approaches to her varied problems .

source_bert_toks: over a period of time she was seen by a number of psycho ##ther ##ap ##ists and psychologists who adopted differing approaches to her varied problems .

reference_raw: Over time, many psychotherapists and psychologists have seen her, who have adopted different approaches to her diverse problems.

reference_spacy_tokens: Over time , many psychotherapists and psychologists have seen her , who have adopted different approaches to her diverse problems .


fn_spacy_tokens_for_baseline: They staggered together from the tunnel , whimpering with agony .

source_bert_toks: they staggered together from the tunnel , whimper ##ing with agony .

reference_raw: They staggered out of the tunnel together, whining in agony.

reference_spacy_tokens: They staggered out of the tunnel together , whining in agony .


fn_spacy_tokens_for_baseline: There are various types of switchboards available that do various things and no decision as to which one would be best for us has yet been made .

source_bert_toks: there are various types of switch ##boards available that do various things and no decision as to which one would be best for us has yet been made .

reference_raw: There are different kinds of switching boards that do different things, and so far, we haven't decided what's best for us.

reference_spacy_tokens: There are different kinds of switching boards that do different things , and so far , we have n't decided what 's best for us .


fn_spacy_tokens_for_baseline: The waistline on bikini bottoms has been pulled up while the usual high leg cut has fallen to something less severe .

source_bert_toks: the waist ##line on bikini bottoms has been pulled up while the usual high leg cut has fallen to something less severe .

reference_raw: The belt on the bottom of the bikini was pulled up while the usual high-legged cut fell into something less severe.

reference_spacy_tokens: The belt on the bottom of the bikini was pulled up while the usual high - legged cut fell into something less severe .


fn_spacy_tokens_for_baseline: Not then travelling in the comfort of an airliner to attend ceremonies marking an anniversary but actually taking part in the historic attacks against the mighty German battleship Tirpitz .

source_bert_toks: not then travelling in the comfort of an airline ##r to attend ceremonies marking an anniversary but actually taking part in the historic attacks against the mighty german battleship ti ##rp ##itz .

reference_raw: Then he didn't travel to the comfort of an airliner to attend an anniversary ceremony, but he actually participated in a historical attack on the mighty German battleship Tirpitz.

reference_spacy_tokens: Then he did n't travel to the comfort of an airliner to attend an anniversary ceremony , but he actually participated in a historical attack on the mighty German battleship Tirpitz .


fn_spacy_tokens_for_baseline: He opened his mouth to speak but Richard forestalled him .

source_bert_toks: he opened his mouth to speak but richard forest ##alle ##d him .

reference_raw: He opened his mouth to speak, but Richard foresaw him.

reference_spacy_tokens: He opened his mouth to speak , but Richard foresaw him .


fn_spacy_tokens_for_baseline: very nice we 've had a quite a warm last few days in fact it 's been in the in the well sixty sixty seven to seventy

source_bert_toks: very nice we ' ve had a quite a warm last few days in fact it ' s been in the in the well sixty sixty seven to seventy

reference_raw: it's very nice that we've had quite a bit of heat in the last few days, actually, in the well of sixty-seven to seventy.

reference_spacy_tokens: it 's very nice that we 've had quite a bit of heat in the last few days , actually , in the well of sixty - seven to seventy .


fn_spacy_tokens_for_baseline: Most kite designs specify the bridle line lengths and the attachment points .

source_bert_toks: most kite designs specify the br ##id ##le line lengths and the attachment points .

reference_raw: Most dragon designs specify the lengths of the bridle line and the mounting points.

reference_spacy_tokens: Most dragon designs specify the lengths of the bridle line and the mounting points .


fn_spacy_tokens_for_baseline: Establishments are no longer called " Royal , " Queen Elizabeth has vanished from the coinage , and the Union Jack has been replaced by the flag of China and the new Hong Kong flag with its bauhinia flower .

source_bert_toks: establishments are no longer called " royal , " queen elizabeth has vanished from the coinage , and the union jack has been replaced by the flag of china and the new hong kong flag with its ba ##uh ##inia flower .

reference_raw: The establishment is not called Royal anymore, Queen Elizabeth has disappeared from the coinage, and Union Jack has been replaced by a Chinese flag and a new Hong Kong flag with a bauhinian flower.

reference_spacy_tokens: The establishment is not called Royal anymore , Queen Elizabeth has disappeared from the coinage , and Union Jack has been replaced by a Chinese flag and a new Hong Kong flag with a bauhinian flower .


fn_spacy_tokens_for_baseline: In this case , though , when I totalled their length it came to 2,000 words ; and the books editor had asked for 700 .

source_bert_toks: in this case , though , when i total ##led their length it came to 2 , 000 words ; and the books editor had asked for 700 .

reference_raw: But in this case, when I summed up their length, it was two thousand words; and the editor of the book asked for seven hundred.

reference_spacy_tokens: But in this case , when I summed up their length , it was two thousand words ; and the editor of the book asked for seven hundred .


fn_spacy_tokens_for_baseline: WINE maker Johann Grimes , of Wotton - under - Edge , Glos , found his labrador legless after it had lapped up a bucket of his home brew .

source_bert_toks: wine maker johann grimes , of wo ##tton - under - edge , g ##los , found his labrador leg ##less after it had lap ##ped up a bucket of his home brew .

reference_raw: WINE maker Johann Grimes of Wotton-under-Edge, Glos, found his labrador legless after he had lashed out a bucket of homemade beer.

reference_spacy_tokens: WINE maker Johann Grimes of Wotton - under - Edge , Glos , found his labrador legless after he had lashed out a bucket of homemade beer .


fn_spacy_tokens_for_baseline: However , the US is concerned with the indirect assistance Iran could receive and is concerned that it is probably covertly seeking the construction of uranium conversion and enrichment facilities , other technical know - how , and technicians .

source_bert_toks: however , the us is concerned with the indirect assistance iran could receive and is concerned that it is probably covert ##ly seeking the construction of uranium conversion and enrichment facilities , other technical know - how , and technicians .

reference_raw: However, the US is concerned about the indirect assistance that Iran might receive and is concerned that it is likely to covertly seek to build uranium conversion and enrichment facilities, other technical knowledge and technicians.

reference_spacy_tokens: However , the US is concerned about the indirect assistance that Iran might receive and is concerned that it is likely to covertly seek to build uranium conversion and enrichment facilities , other technical knowledge and technicians .