fn_spacy_tokens_for_baseline: Despite all his brilliance as illustrator of Fielding , Milton , Richardson , Shakespeare , Spenser , Pope and the rest , there is now little demand for Stothard .

source_bert_toks: despite all his brilliance as illustrator of fielding , milton , richardson , shakespeare , sp ##ense ##r , pope and the rest , there is now little demand for st ##oth ##ard .

reference_raw: Despite his genius as an illustrator of Fielding, Milton, Richardson, Shakespeare, Spenser, Pope and the others, there is no demand for Stothard now.

reference_spacy_tokens: Despite his genius as an illustrator of Fielding , Milton , Richardson , Shakespeare , Spenser , Pope and the others , there is no demand for Stothard now .


fn_spacy_tokens_for_baseline: Traction alopecia is caused by tightly pulled pony - tails , braids and chignons ; friction alopecia occurs when hair bands , wigs or hats are too tight and the hair breaks off .

source_bert_toks: traction al ##ope ##cia is caused by tightly pulled pony - tails , braid ##s and chi ##gnon ##s ; friction al ##ope ##cia occurs when hair bands , wig ##s or hats are too tight and the hair breaks off .

reference_raw: Traction alopecia is due to tight-drawn ponytails, ponytails and chignons; friction alopecia occurs when the hair bands, wigs or hats are too tight and the hair breaks off.

reference_spacy_tokens: Traction alopecia is due to tight - drawn ponytails , ponytails and chignons ; friction alopecia occurs when the hair bands , wigs or hats are too tight and the hair breaks off .


fn_spacy_tokens_for_baseline: While China has publicly declared to be consistently in compliance with the BTWC , past U.S. government reports have alleged that China not only has a small - scale offensive biological weapons program , but has also transferred controlled biological weapons - related items to nations of proliferation concern such as Iran .

source_bert_toks: while china has publicly declared to be consistently in compliance with the bt ##wc , past u . s . government reports have alleged that china not only has a small - scale offensive biological weapons program , but has also transferred controlled biological weapons - related items to nations of proliferation concern such as iran .

reference_raw: While China has publicly declared that it is consistent with the BTWC, past US government reports claim that China has not only a small-scale offensive biological weapons program, but also transferred controlled biological weapons - related objects to proliferation-related countries such as Iran.

reference_spacy_tokens: While China has publicly declared that it is consistent with the BTWC , past US government reports claim that China has not only a small - scale offensive biological weapons program , but also transferred controlled biological weapons - related objects to proliferation - related countries such as Iran .


fn_spacy_tokens_for_baseline: This underscores the need for it to provide more than musical training for its members .

source_bert_toks: this under ##sco ##res the need for it to provide more than musical training for its members .

reference_raw: This underlines the need for it to provide its members with more than musical training.

reference_spacy_tokens: This underlines the need for it to provide its members with more than musical training .


fn_spacy_tokens_for_baseline: One of the armourers was known as Spike , and he petrified me .

source_bert_toks: one of the armour ##ers was known as spike , and he pet ##rified me .

reference_raw: One of the armorers was known as Spike, and he froze me.

reference_spacy_tokens: One of the armorers was known as Spike , and he froze me .


fn_spacy_tokens_for_baseline: Oliver assumed an expression of extreme penitence .

source_bert_toks: oliver assumed an expression of extreme pen ##ite ##nce .

reference_raw: Oliver took on an expression of extreme repentance.

reference_spacy_tokens: Oliver took on an expression of extreme repentance .


fn_spacy_tokens_for_baseline: The prophecy that the chief Ringwraith will not fall ' by the hand of man ' , and his check when he realises Dernhelm is a woman , similarly parallels the Witches ' assurance to Macbeth and his disconcertment when told ' Macduff was from his mother 's womb / Untimely ripped . '

source_bert_toks: the prophecy that the chief ring ##wr ##aith will not fall ' by the hand of man ' , and his check when he realises der ##nh ##el ##m is a woman , similarly parallels the witches ' assurance to macbeth and his disco ##nce ##rt ##ment when told ' mac ##du ##ff was from his mother ' s womb / un ##time ##ly ripped . '

reference_raw: The prophecy that the leader of the Ringwraith would not fall "by the hand of man," and his check when he realized that Dernhelm was a woman, similarly paralleled the witch's assurance to Macbeth and his disquiet when he said, "Macduff was from his mother's womb/Untimely torn."

reference_spacy_tokens: The prophecy that the leader of the Ringwraith would not fall " by the hand of man , " and his check when he realized that Dernhelm was a woman , similarly paralleled the witch 's assurance to Macbeth and his disquiet when he said , " Macduff was from his mother 's womb / Untimely torn . "


fn_spacy_tokens_for_baseline: Burkett was rather small , rather bow - legged , a low centre of gravity .

source_bert_toks: burke ##tt was rather small , rather bow - legged , a low centre of gravity .

reference_raw: Burkett was quite small, rather bowlegged, with a low center of gravity.

reference_spacy_tokens: Burkett was quite small , rather bowlegged , with a low center of gravity .


fn_spacy_tokens_for_baseline: Jamaican music ska -- and , especially , reggae -- has since the 1970s been exported and enjoyed around the world .

source_bert_toks: jamaican music ska - - and , especially , reggae - - has since the 1970s been exported and enjoyed around the world .

reference_raw: Jamaican music ska - and reggae in particular - has been exported and entertained throughout the world since the 1970s.

reference_spacy_tokens: Jamaican music ska - and reggae in particular - has been exported and entertained throughout the world since the 1970s .


fn_spacy_tokens_for_baseline: QN : Does MG Rover make cars ?

source_bert_toks: q ##n : does mg rover make cars ?

reference_raw: QN: Is MG Rover a car manufacturer?

reference_spacy_tokens: QN : Is MG Rover a car manufacturer ?


fn_spacy_tokens_for_baseline: The clotted cream on the rhubarb had curdled .

source_bert_toks: the cl ##otted cream on the r ##hu ##bar ##b had cu ##rd ##led .

reference_raw: The clotted cream on the rhubarb curled.

reference_spacy_tokens: The clotted cream on the rhubarb curled .


fn_spacy_tokens_for_baseline: I 'm not prejudging Thorpe , of course , and I think the whole affair stinks of a bungle and a vendetta and a silly witch hunt but there it is .

source_bert_toks: i ' m not pre ##ju ##d ##ging thorpe , of course , and i think the whole affair stink ##s of a bun ##gle and a ve ##nde ##tta and a silly witch hunt but there it is .

reference_raw: Of course, I'm not prejudiced by Thorpe, and I think the whole thing smells like bungles and revenge and stupid witch hunts, but that's it.

reference_spacy_tokens: Of course , I 'm not prejudiced by Thorpe , and I think the whole thing smells like bungles and revenge and stupid witch hunts , but that 's it .


fn_spacy_tokens_for_baseline: At the same time his pathological detestation of ' popery ' guaranteed that he would vote with the Whigs over great questions of policy , such as the Hanoverian succession and the war with France .

source_bert_toks: at the same time his path ##ological det ##est ##ation of ' pope ##ry ' guaranteed that he would vote with the whig ##s over great questions of policy , such as the hanover ##ian succession and the war with france .

reference_raw: At the same time, his pathological hatred of "popery" guaranteed that he would vote with the Whigs on major political issues, such as the Hanoverian succession and the French war.

reference_spacy_tokens: At the same time , his pathological hatred of " popery " guaranteed that he would vote with the Whigs on major political issues , such as the Hanoverian succession and the French war .


fn_spacy_tokens_for_baseline: Gambling provides almost 40 percent of the government 's tax revenues , and is a major source of employment .

source_bert_toks: gambling provides almost 40 percent of the government ' s tax revenues , and is a major source of employment .

reference_raw: Gambling accounts for almost 40% of the government's tax receipts and is the main source of employment.

reference_spacy_tokens: Gambling accounts for almost 40 % of the government 's tax receipts and is the main source of employment .


fn_spacy_tokens_for_baseline: My senses were confused by this new experience , having previously associated sightseeing with sights to see , not to mention hear and smell .

source_bert_toks: my senses were confused by this new experience , having previously associated sights ##ee ##ing with sights to see , not to mention hear and smell .

reference_raw: My senses were perplexed by this new experience, for I had previously associated sightseeing with sightseeing, not to mention hearing and smelling.

reference_spacy_tokens: My senses were perplexed by this new experience , for I had previously associated sightseeing with sightseeing , not to mention hearing and smelling .


fn_spacy_tokens_for_baseline: The situation and its elements foreshadow the later confrontation of Sweeney and Doris on their ' cannibal isle ' .

source_bert_toks: the situation and its elements fore ##sha ##do ##w the later confrontation of sweeney and doris on their ' can ##ni ##bal isle ' .

reference_raw: The situation and its elements preceded the later confrontation between Sweeney and Doris on their cannibal island.

reference_spacy_tokens: The situation and its elements preceded the later confrontation between Sweeney and Doris on their cannibal island .


fn_spacy_tokens_for_baseline: You 'll find Hong Kong easy to get around , the people helpful , English spoken everywhere , and food that lives up to its reputation .

source_bert_toks: you ' ll find hong kong easy to get around , the people helpful , english spoken everywhere , and food that lives up to its reputation .

reference_raw: Hong Kong is easy to get around, people who help, English talk all over the place, and food that lives up to its reputation.

reference_spacy_tokens: Hong Kong is easy to get around , people who help , English talk all over the place , and food that lives up to its reputation .


fn_spacy_tokens_for_baseline: For these superlative players it is a position of great privilege , but also intense pressure .

source_bert_toks: for these super ##lative players it is a position of great privilege , but also intense pressure .

reference_raw: It's a very privileged position for these super-lative players, but it's also a strong pressure.

reference_spacy_tokens: It 's a very privileged position for these super - lative players , but it 's also a strong pressure .


fn_spacy_tokens_for_baseline: As a kid I was one of those little wiry lads with thin legs , and they all said , ' He 's puny , is that lad .

source_bert_toks: as a kid i was one of those little wi ##ry lads with thin legs , and they all said , ' he ' s pun ##y , is that lad .

reference_raw: When I was a kid, I was one of those wiry little boys with thin legs, and everyone said, "He's a little boy, he's a little boy.

reference_spacy_tokens: When I was a kid , I was one of those wiry little boys with thin legs , and everyone said , " He 's a little boy , he 's a little boy .


fn_spacy_tokens_for_baseline: Add a scoop of vanilla ice cream to each glass , then spoon or pipe on 30ml ( 2 tbsp ) of the whipped cream

source_bert_toks: add a scoop of vanilla ice cream to each glass , then spoon or pipe on 30 ##ml ( 2 tbs ##p ) of the whipped cream

reference_raw: Add a vanilla ice cream spoon to each glass and then a spoon or pipe to 30 ml (2 tbsp) cream

reference_spacy_tokens: Add a vanilla ice cream spoon to each glass and then a spoon or pipe to 30 ml ( 2 tbsp ) cream


fn_spacy_tokens_for_baseline: Far above in the belfry , the huge bronze bells , mounted on wheels , swing madly through a full 360 degrees , starting and ending , surprisingly , in the inverted , or mouth - up position .

source_bert_toks: far above in the bel ##fr ##y , the huge bronze bells , mounted on wheels , swing madly through a full 360 degrees , starting and ending , surprisingly , in the inverted , or mouth - up position .

reference_raw: Far above the bells, huge bronze bells, mounted on wheels, swing madly over a full 360 degrees, starting and ending, surprisingly, in an inverted or mouth-up position.

reference_spacy_tokens: Far above the bells , huge bronze bells , mounted on wheels , swing madly over a full 360 degrees , starting and ending , surprisingly , in an inverted or mouth - up position .


fn_spacy_tokens_for_baseline: She brought up both her fists and pummelled him on the chest .

source_bert_toks: she brought up both her fists and pu ##mmel ##led him on the chest .

reference_raw: She raised both fists and pounded him on the chest.

reference_spacy_tokens: She raised both fists and pounded him on the chest .


fn_spacy_tokens_for_baseline: Berdichev huffed impatiently and looked up at the overhead camera .

source_bert_toks: be ##rdi ##chev huffed impatiently and looked up at the overhead camera .

reference_raw: Berdichev shrugged impatiently and looked up at the overhead camera.

reference_spacy_tokens: Berdichev shrugged impatiently and looked up at the overhead camera .


fn_spacy_tokens_for_baseline: The light switches clicked but nothing happened .

source_bert_toks: the light switches clicked but nothing happened .

reference_raw: Light switches snapped, but nothing happened.

reference_spacy_tokens: Light switches snapped , but nothing happened .


fn_spacy_tokens_for_baseline: Over the next four months , the weather veered from intense heat to snowstorms .

source_bert_toks: over the next four months , the weather ve ##ered from intense heat to snow ##storm ##s .

reference_raw: For the next four months, the weather shifted from intense heat to snowstorms.

reference_spacy_tokens: For the next four months , the weather shifted from intense heat to snowstorms .


fn_spacy_tokens_for_baseline: By this time , the valley was in much the same geographic state as it exists in today , with one exception -- the presence of artesian springs that bubbled to the surface in several areas .

source_bert_toks: by this time , the valley was in much the same geographic state as it exists in today , with one exception - - the presence of arte ##sian springs that bubble ##d to the surface in several areas .

reference_raw: By that time, the valley was in much the same geographical state as it is now, with one exception: the existence of artesian springs that bubbled to the surface in several areas.

reference_spacy_tokens: By that time , the valley was in much the same geographical state as it is now , with one exception : the existence of artesian springs that bubbled to the surface in several areas .


fn_spacy_tokens_for_baseline: There remained a sniff of Nigel .

source_bert_toks: there remained a sniff of nigel .

reference_raw: Nigel was still smelling.

reference_spacy_tokens: Nigel was still smelling .


fn_spacy_tokens_for_baseline: Occasionally in our rambles we came across Inspector Baynes .

source_bert_toks: occasionally in our ram ##bles we came across inspector bay ##nes .

reference_raw: From time to time, we encountered Inspector Baynes.

reference_spacy_tokens: From time to time , we encountered Inspector Baynes .


fn_spacy_tokens_for_baseline: ' Bush walks , ' Lucy informed him briefly , rubbing the arm that had been clawed by Doreen .

source_bert_toks: ' bush walks , ' lucy informed him briefly , rubbing the arm that had been clawed by do ##reen .

reference_raw: 'Bush is walking,' said Lucy briefly, rubbing Doreen's hand.

reference_spacy_tokens: ' Bush is walking , ' said Lucy briefly , rubbing Doreen 's hand .


fn_spacy_tokens_for_baseline: The test is what to do when a deadly sarin gas has been released in a meeting room infecting dozens .

source_bert_toks: the test is what to do when a deadly sar ##in gas has been released in a meeting room in ##fect ##ing dozens .

reference_raw: The test is what to do when a lethal sarin gas is released in a conference room that infects dozens of people.

reference_spacy_tokens: The test is what to do when a lethal sarin gas is released in a conference room that infects dozens of people .


fn_spacy_tokens_for_baseline: Girls wishing to avoid such a fate should shun wearing or passing near fairy flowers , such as clumps of harebells or love - in - idleness .

source_bert_toks: girls wishing to avoid such a fate should shu ##n wearing or passing near fairy flowers , such as cl ##ump ##s of hare ##bell ##s or love - in - idle ##ness .

reference_raw: Girls who wish to avoid such a fate should avoid wearing or passing fairy flowers, such as clusters of harebells or indulgence.

reference_spacy_tokens: Girls who wish to avoid such a fate should avoid wearing or passing fairy flowers , such as clusters of harebells or indulgence .


fn_spacy_tokens_for_baseline: After a final bloody defeat by the Muslims in 1309 , Christian forces were forced from the Holy Land .

source_bert_toks: after a final bloody defeat by the muslims in 130 ##9 , christian forces were forced from the holy land .

reference_raw: After the last bloody defeat of the Muslims in 1309, Christian forces were forced out of the Holy Land.

reference_spacy_tokens: After the last bloody defeat of the Muslims in 1309 , Christian forces were forced out of the Holy Land .


fn_spacy_tokens_for_baseline: Zola slalomed through two opponents and crossed the ball which was headed into the Lithuanian net by defender Raimondas Vainoras .

source_bert_toks: z ##ola slalom ##ed through two opponents and crossed the ball which was headed into the lithuanian net by defender rai ##mond ##as vain ##ora ##s .

reference_raw: Zola slammed through two opponents and crossed the ball that the defender Raimondas Vainoras was heading into the Lithuanian net.

reference_spacy_tokens: Zola slammed through two opponents and crossed the ball that the defender Raimondas Vainoras was heading into the Lithuanian net .


fn_spacy_tokens_for_baseline: AMMAN , Jordan ( AP ) U.S. Representative Tony Hall arrived in Jordan on Saturday en route to Iraq , where he is expected to look into the plight of Iraqis after nearly 10 years of U.N. trade sanctions .

source_bert_toks: amman , jordan ( ap ) u . s . representative tony hall arrived in jordan on saturday en route to iraq , where he is expected to look into the plight of iraqi ##s after nearly 10 years of u . n . trade sanctions .

reference_raw: AMMAN, Jordan (AP) US representative Tony Hall arrived in Jordan on Saturday on his way to Iraq, where he is expected to look into the situation of Iraqis after almost 10 years of UN trade sanctions.

reference_spacy_tokens: AMMAN , Jordan ( AP ) US representative Tony Hall arrived in Jordan on Saturday on his way to Iraq , where he is expected to look into the situation of Iraqis after almost 10 years of UN trade sanctions .


fn_spacy_tokens_for_baseline: Sometimes slate was also mined in caverns as at Carnglaze .

source_bert_toks: sometimes slate was also mined in cavern ##s as at car ##ng ##laze .

reference_raw: Sometimes the slate was dug up in caves like Carnglaze.

reference_spacy_tokens: Sometimes the slate was dug up in caves like Carnglaze .


fn_spacy_tokens_for_baseline: The problem is that boards like AskMe.com do n't do a good job of matching lawyers who are licensed in a particular jurisdiction ( or , in the case of LawGuy1975 , licensed at all ) with clients in the same area .

source_bert_toks: the problem is that boards like ask ##me . com don ' t do a good job of matching lawyers who are licensed in a particular jurisdiction ( or , in the case of law ##gu ##y ##19 ##75 , licensed at all ) with clients in the same area .

reference_raw: The problem is that councils such as AskMe.com do not do well to match lawyers licensed in a specific jurisdiction (or, in the case of LawGuy1975, licensed at all) with clients in the same area.

reference_spacy_tokens: The problem is that councils such as AskMe.com do not do well to match lawyers licensed in a specific jurisdiction ( or , in the case of LawGuy1975 , licensed at all ) with clients in the same area .


fn_spacy_tokens_for_baseline: As I panted in the thin air , a herdboy passed me on the broken steps which zigzagged up the mountainside , joining the smooth terraces with their retaining walls of stone .

source_bert_toks: as i panted in the thin air , a herd ##boy passed me on the broken steps which z ##ig ##za ##gged up the mountains ##ide , joining the smooth terraces with their retaining walls of stone .

reference_raw: As I breathed in the thin air, one of the herdsmen walked past me on the broken steps that wound up the slope and joined the smooth terraces with their stone walls.

reference_spacy_tokens: As I breathed in the thin air , one of the herdsmen walked past me on the broken steps that wound up the slope and joined the smooth terraces with their stone walls .


fn_spacy_tokens_for_baseline: ' There was plenty a cutpurse at the fair .

source_bert_toks: ' there was plenty a cut ##pur ##se at the fair .

reference_raw: 'There was a lot of cutbacks in the marketplace.

reference_spacy_tokens: ' There was a lot of cutbacks in the marketplace .


fn_spacy_tokens_for_baseline: Make a loose fist with your right hand and firmly slide your knuckles from the outside edge of the heel to the base of the toes .

source_bert_toks: make a loose fist with your right hand and firmly slide your knuckles from the outside edge of the heel to the base of the toes .

reference_raw: Make a free fist with your right hand and slide your ankles firmly from the outer edge of the base to the base of the toes.

reference_spacy_tokens: Make a free fist with your right hand and slide your ankles firmly from the outer edge of the base to the base of the toes .


fn_spacy_tokens_for_baseline: Critics seem to view this as a cowardice , as if a boxer should want his brains pulped .

source_bert_toks: critics seem to view this as a coward ##ice , as if a boxer should want his brains pulp ##ed .

reference_raw: The critics see it as cowardice, as if a boxer should have his brain crushed.

reference_spacy_tokens: The critics see it as cowardice , as if a boxer should have his brain crushed .


fn_spacy_tokens_for_baseline: These include , but are not limited to : Necessities of war and the short distance to Iraqi strategic targets .

source_bert_toks: these include , but are not limited to : nec ##ess ##ities of war and the short distance to iraqi strategic targets .

reference_raw: These include, but are not limited to: the need for war and the brief distance from the strategic objectives of Iraq.

reference_spacy_tokens: These include , but are not limited to : the need for war and the brief distance from the strategic objectives of Iraq .


fn_spacy_tokens_for_baseline: ' Course y'll hafta get off the ship , ' she said .

source_bert_toks: ' course y ' ll ha ##ft ##a get off the ship , ' she said .

reference_raw: "Of course you'll get off the boat," she said.

reference_spacy_tokens: " Of course you 'll get off the boat , " she said .


fn_spacy_tokens_for_baseline: Blemishes on your back and sometimes on the buttocks can be caused by friction , perspiration and micro - organisms .

source_bert_toks: b ##lem ##ish ##es on your back and sometimes on the butt ##ocks can be caused by friction , per ##sp ##ira ##tion and micro - organisms .

reference_raw: Bleeding on the back and sometimes on the buttocks can be caused by friction, sweat and micro-organisms.

reference_spacy_tokens: Bleeding on the back and sometimes on the buttocks can be caused by friction , sweat and micro - organisms .


fn_spacy_tokens_for_baseline: Dearly though he loved his wife , her early morning lethargy never failed to rankle .

source_bert_toks: dear ##ly though he loved his wife , her early morning let ##har ##gy never failed to rank ##le .

reference_raw: Dear as he loved his wife, her early-morning lethargy never failed to rank.

reference_spacy_tokens: Dear as he loved his wife , her early - morning lethargy never failed to rank .


fn_spacy_tokens_for_baseline: Truman was blunt and straightforward where Roosevelt had been subtle and evasive .

source_bert_toks: truman was blunt and straightforward where roosevelt had been subtle and eva ##sive .

reference_raw: Truman was blunt and direct where Roosevelt was gentle and evasive.

reference_spacy_tokens: Truman was blunt and direct where Roosevelt was gentle and evasive .


fn_spacy_tokens_for_baseline: Russia is assisting Iran to construct a light water reactor at Bushehr , which is now nearing completion , and will supply the nuclear fuel needed to run it .

source_bert_toks: russia is assisting iran to construct a light water reactor at bush ##eh ##r , which is now nearing completion , and will supply the nuclear fuel needed to run it .

reference_raw: Russia is helping Iran build a light-water reactor in Bushehr, which is coming to an end, and will provide the nuclear fuel needed to operate it.

reference_spacy_tokens: Russia is helping Iran build a light - water reactor in Bushehr , which is coming to an end , and will provide the nuclear fuel needed to operate it .


fn_spacy_tokens_for_baseline: ' And you think you can beat the British by ambushes and blowing up police barracks ? '

source_bert_toks: ' and you think you can beat the british by ambush ##es and blowing up police barracks ? '

reference_raw: "And you think you can beat the Brits by ambushing them and blowing up the police station?"

reference_spacy_tokens: " And you think you can beat the Brits by ambushing them and blowing up the police station ? "


fn_spacy_tokens_for_baseline: ' I tell you it went down that last passage on the right , ' hissed Kring in a voice like the scrape of a blade over stone .

source_bert_toks: ' i tell you it went down that last passage on the right , ' hissed k ##ring in a voice like the scrape of a blade over stone .

reference_raw: 'I'm telling you, it went down the last passage to the right,' Kring hissed, hissing like a knife scratch on a stone.

reference_spacy_tokens: ' I 'm telling you , it went down the last passage to the right , ' Kring hissed , hissing like a knife scratch on a stone .


fn_spacy_tokens_for_baseline: This provokes awareness of and gives practice in those features of language which provide links within sentences or across sentence boundaries : the glue that makes them stick together .

source_bert_toks: this provoke ##s awareness of and gives practice in those features of language which provide links within sentences or across sentence boundaries : the glue that makes them stick together .

reference_raw: This creates awareness of, and gives practice to, the characteristics of the language that provide a link between sentences or between sentences: the glue that binds them together.

reference_spacy_tokens: This creates awareness of , and gives practice to , the characteristics of the language that provide a link between sentences or between sentences : the glue that binds them together .


fn_spacy_tokens_for_baseline: One response to this affront is to erect an alternative system of belief ; to fabricate another , esoteric world of ideas that seems to challenge and in turn to trivialise the ideas that are proving so bothersome .

source_bert_toks: one response to this af ##front is to erect an alternative system of belief ; to fabric ##ate another , es ##oteric world of ideas that seems to challenge and in turn to trivial ##ise the ideas that are proving so bother ##some .

reference_raw: One response to this insult is to create an alternative system of faith; to create a new, esoteric world of ideas that seem to challenge and, in turn, to trivialize ideas that turn out to be so annoying.

reference_spacy_tokens: One response to this insult is to create an alternative system of faith ; to create a new , esoteric world of ideas that seem to challenge and , in turn , to trivialize ideas that turn out to be so annoying .


fn_spacy_tokens_for_baseline: The sun illuminating the canopy of heaven , reflects its lustre on the earth below , and gives a delicate distinction to every distance on the picture , and to every object its due place , in all the regular gradation of aerial perspective . '

source_bert_toks: the sun illuminating the canopy of heaven , reflects its lust ##re on the earth below , and gives a delicate distinction to every distance on the picture , and to every object its due place , in all the regular gr ##ada ##tion of aerial perspective . '

reference_raw: The sun illuminates the canopy of the sky, reflects its brightness on the ground below, and gives a delicate distinction to every distance in the image, and to every object in its proper place, in all the regular grading of the aerial perspective.'

reference_spacy_tokens: The sun illuminates the canopy of the sky , reflects its brightness on the ground below , and gives a delicate distinction to every distance in the image , and to every object in its proper place , in all the regular grading of the aerial perspective . '


fn_spacy_tokens_for_baseline: Explanations for their increased susceptibility include the impairment of humoral and cellular host defences , defective reticuloendothelial phagocytic function and impaired complement activity .

source_bert_toks: explanations for their increased su ##sc ##ept ##ibility include the impairment of humor ##al and cellular host defences , defective re ##tic ##ulo ##end ##oth ##elial ph ##ago ##cy ##tic function and impaired complement activity .

reference_raw: Reasons for their increased sensitivity include impaired fungal and cellular host defenses, defective reticuloendothelial phagocytic function and impaired complement activity.

reference_spacy_tokens: Reasons for their increased sensitivity include impaired fungal and cellular host defenses , defective reticuloendothelial phagocytic function and impaired complement activity .


fn_spacy_tokens_for_baseline: A rustic bench surrounding it gave me the foothold I needed to get up into its branches and I sat there hidden among the blossoms while the baulked beast quested in the flower beds .

source_bert_toks: a rustic bench surrounding it gave me the foot ##hold i needed to get up into its branches and i sat there hidden among the blossoms while the ba ##ul ##ked beast quest ##ed in the flower beds .

reference_raw: The rusty bench that surrounded him gave me the foothold I needed to climb into the branches, and I sat there, hidden in the flowers, while the baulked beast sought out the flower beds.

reference_spacy_tokens: The rusty bench that surrounded him gave me the foothold I needed to climb into the branches , and I sat there , hidden in the flowers , while the baulked beast sought out the flower beds .


fn_spacy_tokens_for_baseline: In the mid - 1970s , Iran initiated a nuclear power program , though there are reports that it also began a small nuclear weapon research program at the same time .

source_bert_toks: in the mid - 1970s , iran initiated a nuclear power program , though there are reports that it also began a small nuclear weapon research program at the same time .

reference_raw: Iran launched a nuclear power program in the middle of the 1970s, although there are reports that it also launched a small nuclear weapons research programme.

reference_spacy_tokens: Iran launched a nuclear power program in the middle of the 1970s , although there are reports that it also launched a small nuclear weapons research programme .


fn_spacy_tokens_for_baseline: Benjamin ignored my warnings : he went into the box , talking gently to the horse , smoothing its flanks whilst he examined its underbelly .

source_bert_toks: benjamin ignored my warnings : he went into the box , talking gently to the horse , smoothing its flanks whilst he examined its under ##bell ##y .

reference_raw: Benjamin ignored my warning: he stepped into the box and spoke gently to his horse, smoothing his hips while he examined his belly.

reference_spacy_tokens: Benjamin ignored my warning : he stepped into the box and spoke gently to his horse , smoothing his hips while he examined his belly .


fn_spacy_tokens_for_baseline: During a summer romance together , the couple spent time at Oxford punting down the river , taking drives in the country and visiting local pubs .

source_bert_toks: during a summer romance together , the couple spent time at oxford punt ##ing down the river , taking drives in the country and visiting local pubs .

reference_raw: During a summer romance with him, the couple spent time in Oxford piercing the river, taking trips in the countryside and visiting local pubs.

reference_spacy_tokens: During a summer romance with him , the couple spent time in Oxford piercing the river , taking trips in the countryside and visiting local pubs .


fn_spacy_tokens_for_baseline: People began throwing suggestions at him , some kindly , some less so , as the same shops came zinging past for the third and fourth times .

source_bert_toks: people began throwing suggestions at him , some kindly , some less so , as the same shops came z ##inging past for the third and fourth times .

reference_raw: People began to throw suggestions at him, some kindly, some less so, as the same shops passed for the third and fourth times.

reference_spacy_tokens: People began to throw suggestions at him , some kindly , some less so , as the same shops passed for the third and fourth times .


fn_spacy_tokens_for_baseline: Planks and logs are being saturated , not with water but with aqueous solutions of heat - setting resins .

source_bert_toks: plank ##s and logs are being saturated , not with water but with a ##que ##ous solutions of heat - setting resin ##s .

reference_raw: The boards and logs are fed, not with water, but with aqueous solutions of heat-setting resins.

reference_spacy_tokens: The boards and logs are fed , not with water , but with aqueous solutions of heat - setting resins .


fn_spacy_tokens_for_baseline: By way of formal tourist attractions , Pak Tai Temple , built in 1783 , has some fine carvings and a great iron sword said to be 600 years old .

source_bert_toks: by way of formal tourist attractions , pak tai temple , built in 1783 , has some fine carvings and a great iron sword said to be 600 years old .

reference_raw: By way of official tourist attractions, the Pak Tai Temple, built in 1783, has a few fine carvings and a large steel sword, said to be 600 years old.

reference_spacy_tokens: By way of official tourist attractions , the Pak Tai Temple , built in 1783 , has a few fine carvings and a large steel sword , said to be 600 years old .


fn_spacy_tokens_for_baseline: An Edinburgh man who 's fought for eight years to overturn a conviction for armed robbery says he 's prepared to go the European Court of Human Rights .

source_bert_toks: an edinburgh man who ' s fought for eight years to over ##turn a conviction for armed robbery says he ' s prepared to go the european court of human rights .

reference_raw: An Edinburgh man who's been fighting for eight years for overturning a conviction for armed theft says he's ready to go to the European Court of Human Rights.

reference_spacy_tokens: An Edinburgh man who 's been fighting for eight years for overturning a conviction for armed theft says he 's ready to go to the European Court of Human Rights .


fn_spacy_tokens_for_baseline: Gold - edged clouds sailed in a sea of cold blue sky , violently eclipsed by sleet - scudding showers slashing up Loch Torridon .

source_bert_toks: gold - edged clouds sailed in a sea of cold blue sky , violently eclipse ##d by sl ##eet - sc ##uddin ##g showers slash ##ing up loch tor ##rid ##on .

reference_raw: Clouds with golden edges floated in a sea of cold blue sky, violently obscured by the sleety showers that slashed Loch Torridon.

reference_spacy_tokens: Clouds with golden edges floated in a sea of cold blue sky , violently obscured by the sleety showers that slashed Loch Torridon .


fn_spacy_tokens_for_baseline: But the porridge ' peepshow ' was slammed as ' barbaric ' by penal reformers yesterday .

source_bert_toks: but the por ##ridge ' pee ##ps ##how ' was slammed as ' bar ##bari ##c ' by penal reformer ##s yesterday .

reference_raw: But the porridge 'peepshow' was struck yesterday by criminal reformers as 'barbaric'.

reference_spacy_tokens: But the porridge ' peepshow ' was struck yesterday by criminal reformers as ' barbaric ' .


fn_spacy_tokens_for_baseline: Between Piccadilly and Putney , where he lived in the basement of a decaying Victorian house , he progressed through his usual states of somnolence , sick juddering wakefulness , and increasing worry about Val .

source_bert_toks: between pic ##ca ##dilly and put ##ney , where he lived in the basement of a decay ##ing victorian house , he progressed through his usual states of so ##m ##no ##lence , sick judd ##ering wake ##fulness , and increasing worry about val .

reference_raw: Between Piccadilly and Putney, where he lived in the cellar of the decaying Victorian house, he went through his usual state of sleepiness, a sick judgment of wakefulness, and a growing concern for Val.

reference_spacy_tokens: Between Piccadilly and Putney , where he lived in the cellar of the decaying Victorian house , he went through his usual state of sleepiness , a sick judgment of wakefulness , and a growing concern for Val .


fn_spacy_tokens_for_baseline: To be twisted , as it were , around Carnelian 's little finger : that was abominable .

source_bert_toks: to be twisted , as it were , around car ##nel ##ian ' s little finger : that was ab ##omi ##nable .

reference_raw: To be twisted around Carnelian's little finger as it was: it was disgusting.

reference_spacy_tokens: To be twisted around Carnelian 's little finger as it was : it was disgusting .


fn_spacy_tokens_for_baseline: And morphine from opium is illegally converted to the highly addictive drug . heroin , widely abused in Western societies .

source_bert_toks: and mor ##phine from opium is illegally converted to the highly addict ##ive drug . heroin , widely abused in western societies .

reference_raw: And opium morphia is illegally converted into a highly addictive drug, heroin, widely abused in Western society.

reference_spacy_tokens: And opium morphia is illegally converted into a highly addictive drug , heroin , widely abused in Western society .


fn_spacy_tokens_for_baseline: A strangely - deserted sidewalk , Rex noted as he leapt out of the cab and stalked over to the fallen driver .

source_bert_toks: a strangely - deserted sidewalk , rex noted as he leapt out of the cab and stalked over to the fallen driver .

reference_raw: A strangely deserted walkway, Rex saw, leaping from the cab and stalking toward the fallen driver.

reference_spacy_tokens: A strangely deserted walkway , Rex saw , leaping from the cab and stalking toward the fallen driver .


fn_spacy_tokens_for_baseline: Allen saw the lightning gleam on the blade of his knife as they passed and made ready to snatch at it .

source_bert_toks: allen saw the lightning gleam on the blade of his knife as they passed and made ready to snatch at it .

reference_raw: As they passed, Allen saw the lightning flash on the blade of his knife and prepared to grab it.

reference_spacy_tokens: As they passed , Allen saw the lightning flash on the blade of his knife and prepared to grab it .


fn_spacy_tokens_for_baseline: He cut the correct length of fuse , and set it , and lit it , and looked to see how John was doing .

source_bert_toks: he cut the correct length of fuse , and set it , and lit it , and looked to see how john was doing .

reference_raw: He cut the right length of the fuse, set it, lit it, and looked to see how John was doing.

reference_spacy_tokens: He cut the right length of the fuse , set it , lit it , and looked to see how John was doing .


fn_spacy_tokens_for_baseline: Her hair , braided into a long plait which fell over one shoulder , looked dusty and lustreless .

source_bert_toks: her hair , braid ##ed into a long pl ##ai ##t which fell over one shoulder , looked dusty and lust ##rel ##ess .

reference_raw: Her hair, tangled in a long plait that fell over one shoulder, looked dusty and shiny.

reference_spacy_tokens: Her hair , tangled in a long plait that fell over one shoulder , looked dusty and shiny .


fn_spacy_tokens_for_baseline: Some of the questions concerned frequency , so answers ranging from ' Never ' to ' Always ' were available to assertions such as ' Dreams can foretell the future ' .

source_bert_toks: some of the questions concerned frequency , so answers ranging from ' never ' to ' always ' were available to assertion ##s such as ' dreams can fore ##tell the future ' .

reference_raw: Some of the questions related to frequency, so the answers from 'Never' to 'Always' were available to allegations like 'Dreams can predict the future'.

reference_spacy_tokens: Some of the questions related to frequency , so the answers from ' Never ' to ' Always ' were available to allegations like ' Dreams can predict the future ' .


fn_spacy_tokens_for_baseline: The cause of the fire is not known .

source_bert_toks: the cause of the fire is not known .

reference_raw: The cause of the fire is unknown.

reference_spacy_tokens: The cause of the fire is unknown .


fn_spacy_tokens_for_baseline: When they were ready the car glided out of the warehouse , Zack himself now back behind the wheel , and headed towards their hideaway .

source_bert_toks: when they were ready the car glided out of the warehouse , zack himself now back behind the wheel , and headed towards their hide ##away .

reference_raw: When they were ready, the car slid out of the warehouse, Zack himself, behind the wheel, and headed for their hiding place.

reference_spacy_tokens: When they were ready , the car slid out of the warehouse , Zack himself , behind the wheel , and headed for their hiding place .


fn_spacy_tokens_for_baseline: Secondly , the viral genetic material must be replicated many times to provide a copy for each new virus particle ( E ) .

source_bert_toks: secondly , the viral genetic material must be replicate ##d many times to provide a copy for each new virus particle ( e ) .

reference_raw: Second, viral genetic material has to be reproduced many times in order to produce a copy of each new viral particle (E).

reference_spacy_tokens: Second , viral genetic material has to be reproduced many times in order to produce a copy of each new viral particle ( E ) .


fn_spacy_tokens_for_baseline: The last visitor was then- U.S. Rep. Bill Richardson of New Mexico , who went to help a pair of U.S. oilmen in diplomatic trouble .

source_bert_toks: the last visitor was then - u . s . rep . bill richardson of new mexico , who went to help a pair of u . s . oil ##men in diplomatic trouble .

reference_raw: The last guest was U.S. Deputy Bill Richardson of New Mexico, who went to help two American oilmen with diplomatic problems.

reference_spacy_tokens: The last guest was U.S. Deputy Bill Richardson of New Mexico , who went to help two American oilmen with diplomatic problems .


fn_spacy_tokens_for_baseline: There are a number of similar species from early Cambrian rocks distinguished on the size of the eyes and details of the thorax .

source_bert_toks: there are a number of similar species from early cambrian rocks distinguished on the size of the eyes and details of the thor ##ax .

reference_raw: There are many similar species in the early Cambrian rocks, distinguished by the size of the eyes and the details of the chest.

reference_spacy_tokens: There are many similar species in the early Cambrian rocks , distinguished by the size of the eyes and the details of the chest .


fn_spacy_tokens_for_baseline: At the beginning of the last century , when repairs were being carried out to embankment walls enclosing the loch , a Pictish canoe hewn from a single , solid piece of wood was dug from exposed silt .

source_bert_toks: at the beginning of the last century , when repairs were being carried out to embankment walls en ##cl ##osing the loch , a pic ##tish canoe he ##wn from a single , solid piece of wood was dug from exposed si ##lt .

reference_raw: In the early part of the last century, when repairs had been made to the embankment walls surrounding the lake, a Pictish canoe had been dug out of the exposed mud from a single solid piece of wood.

reference_spacy_tokens: In the early part of the last century , when repairs had been made to the embankment walls surrounding the lake , a Pictish canoe had been dug out of the exposed mud from a single solid piece of wood .


fn_spacy_tokens_for_baseline: Judge Renfren Paisano , in the northeastern province of Gracias a Dios , last November sentenced Salazar for skimming 11 pounds ( five kilos ) of cocaine from a July 1994 drug bust .

source_bert_toks: judge ren ##fr ##en pa ##isan ##o , in the northeastern province of gr ##ac ##ias a di ##os , last november sentenced salazar for ski ##mming 11 pounds ( five ki ##los ) of cocaine from a july 1994 drug bust .

reference_raw: Judge Renfren Paisano, in the northeast province of Gracias a Dios, last November sentenced Salazar to skip 11 pounds (five kilos) of cocaine in a drug bust in July 1994.

reference_spacy_tokens: Judge Renfren Paisano , in the northeast province of Gracias a Dios , last November sentenced Salazar to skip 11 pounds ( five kilos ) of cocaine in a drug bust in July 1994 .


fn_spacy_tokens_for_baseline: Woodsmoke drifted low on the light westerly wind and on the railway tracks great trains clanked by rhythmically , somehow accentuating the serenity of the place .

source_bert_toks: woods ##mo ##ke drifted low on the light west ##erly wind and on the railway tracks great trains clan ##ked by rhythmic ##ally , somehow accent ##uating the ser ##enity of the place .

reference_raw: Woodsmoke floated low in the west breeze, and on the rails the great trains rattled rhythmically, somehow accentuating the calmness of the place.

reference_spacy_tokens: Woodsmoke floated low in the west breeze , and on the rails the great trains rattled rhythmically , somehow accentuating the calmness of the place .


fn_spacy_tokens_for_baseline: A small beard grew around the mouth and a pony tail weaved down his back .

source_bert_toks: a small beard grew around the mouth and a pony tail weave ##d down his back .

reference_raw: There was a small beard around his mouth, and a pony tail pulled down his back.

reference_spacy_tokens: There was a small beard around his mouth , and a pony tail pulled down his back .


fn_spacy_tokens_for_baseline: -- " Community involvement " is an even worse idea .

source_bert_toks: - - " community involvement " is an even worse idea .

reference_raw: -- "Community involvement" is even more of a bad idea.

reference_spacy_tokens: -- " Community involvement " is even more of a bad idea .


fn_spacy_tokens_for_baseline: Michels , who is now no longer even on the SCO board , has reportedly retained his own lawyer to fight the suit , determined to keep SCO 's involvement to a minimum .

source_bert_toks: michel ##s , who is now no longer even on the sc ##o board , has reportedly retained his own lawyer to fight the suit , determined to keep sc ##o ' s involvement to a minimum .

reference_raw: Michels, who is no longer a member of the SCO's board, reportedly kept his own lawyer to fight the suit, and was determined to keep the SCO's involvement to a minimum.

reference_spacy_tokens: Michels , who is no longer a member of the SCO 's board , reportedly kept his own lawyer to fight the suit , and was determined to keep the SCO 's involvement to a minimum .


fn_spacy_tokens_for_baseline: The bedlam in no way flustered Boxer Sullivan .

source_bert_toks: the bed ##lam in no way flu ##stered boxer sullivan .

reference_raw: Boxer Sullivan wasn't fluttered by the bedlam.

reference_spacy_tokens: Boxer Sullivan was n't fluttered by the bedlam .


fn_spacy_tokens_for_baseline: I 'm downright flabbergasted to know you 're treatin ' Dolly so unkind an ' beatin ' ' er as well .

source_bert_toks: i ' m down ##right fl ##ab ##berg ##ast ##ed to know you ' re treat ##in ' dolly so un ##kind an ' beat ##in ' ' er as well .

reference_raw: I'm flattered to know that you treat Dolly so unkindly and beating 'er, too.

reference_spacy_tokens: I 'm flattered to know that you treat Dolly so unkindly and beating ' er , too .


fn_spacy_tokens_for_baseline: As it changed from mob gambling town to corporate gaming venue , the population of Las Vegas skyrocketed .

source_bert_toks: as it changed from mob gambling town to corporate gaming venue , the population of las vegas sky ##rock ##ete ##d .

reference_raw: The population of Las Vegas skyrocketed as it changed from a mob gambling city to a corporate playground.

reference_spacy_tokens: The population of Las Vegas skyrocketed as it changed from a mob gambling city to a corporate playground .


fn_spacy_tokens_for_baseline: But the thoughts sickened her .

source_bert_toks: but the thoughts sick ##ened her .

reference_raw: But the thought made her sick.

reference_spacy_tokens: But the thought made her sick .


fn_spacy_tokens_for_baseline: Angry feet slapped against the stone stairs .

source_bert_toks: angry feet slapped against the stone stairs .

reference_raw: Angry feet hit the stone steps.

reference_spacy_tokens: Angry feet hit the stone steps .


fn_spacy_tokens_for_baseline: Overlay both of these religions with a strong dose of animism , and you have a thoroughly inscrutable religious milieu in which Hindus and Buddhists worship at the same temples , and rocks , trees , and waterfalls take on mystical importance .

source_bert_toks: over ##lay both of these religions with a strong dose of an ##imi ##sm , and you have a thoroughly ins ##cr ##utable religious mil ##ieu in which hindus and buddhist ##s worship at the same temples , and rocks , trees , and waterfalls take on mystical importance .

reference_raw: Overlay both religions with a great deal of animism, and you have a highly unspeakable religious milieu in which Hindus and Buddhists worship at the same temples, and rocks, trees, and waterfalls take mystical importance.

reference_spacy_tokens: Overlay both religions with a great deal of animism , and you have a highly unspeakable religious milieu in which Hindus and Buddhists worship at the same temples , and rocks , trees , and waterfalls take mystical importance .


fn_spacy_tokens_for_baseline: He was staring at her over a tray of empty glasses .

source_bert_toks: he was staring at her over a tray of empty glasses .

reference_raw: He stared at her across the bowl of empty glasses.

reference_spacy_tokens: He stared at her across the bowl of empty glasses .


fn_spacy_tokens_for_baseline: She remained unwell , with recurrent headaches , sleepiness , fatigue and inexplicable bouts of fainting .

source_bert_toks: she remained un ##well , with rec ##urrent headache ##s , sleep ##iness , fatigue and in ##ex ##pl ##ica ##ble bouts of faint ##ing .

reference_raw: She remained unwell, with repeated headaches, somnolence, fatigue, and unexplained bouts of fainting.

reference_spacy_tokens: She remained unwell , with repeated headaches , somnolence , fatigue , and unexplained bouts of fainting .


fn_spacy_tokens_for_baseline: Hilda seemed to be getting more animated as her own bafflement and distress increased .

source_bert_toks: hilda seemed to be getting more animated as her own ba ##ffle ##ment and distress increased .

reference_raw: As her confusion and anxiety increased, Hilda seemed to grow more animated.

reference_spacy_tokens: As her confusion and anxiety increased , Hilda seemed to grow more animated .


fn_spacy_tokens_for_baseline: They defy the stereotypes of Chinese women who migrate to Shenzhen to net a Hong Kong sugar daddy , and Hong Kong businessmen who come here for cheap sex and cheap factory labor .

source_bert_toks: they def ##y the stereotypes of chinese women who migrate to shenzhen to net a hong kong sugar daddy , and hong kong businessmen who come here for cheap sex and cheap factory labor .

reference_raw: They resist the stereotypes of Chinese women who move to Shenzhen to network Hong Kong's sugar dad and Hong Kong businessmen who come here for cheap sex and cheap factory work.

reference_spacy_tokens: They resist the stereotypes of Chinese women who move to Shenzhen to network Hong Kong 's sugar dad and Hong Kong businessmen who come here for cheap sex and cheap factory work .


fn_spacy_tokens_for_baseline: Rose left it on the coffee table by her husband 's chair , and when he had had his usual mixed fry - up and was preparing to have his snooze , his eye caught it as it lay there .

source_bert_toks: rose left it on the coffee table by her husband ' s chair , and when he had had his usual mixed fry - up and was preparing to have his s ##no ##oz ##e , his eye caught it as it lay there .

reference_raw: Rose left it on the coffee table next to her husband's chair, and when he had his usual mixture of frying and was about to take a nap, he caught her in his eye as she lay there.

reference_spacy_tokens: Rose left it on the coffee table next to her husband 's chair , and when he had his usual mixture of frying and was about to take a nap , he caught her in his eye as she lay there .


fn_spacy_tokens_for_baseline: Seed must be gathered from freshly ripened seed pods .

source_bert_toks: seed must be gathered from freshly ripe ##ned seed pods .

reference_raw: The seed must be collected from freshly matured seed pods.

reference_spacy_tokens: The seed must be collected from freshly matured seed pods .


fn_spacy_tokens_for_baseline: Nor did he have to present himself as piteous in order to feed his everlasting hunger for sympathy .

source_bert_toks: nor did he have to present himself as pit ##eous in order to feed his ever ##las ##ting hunger for sympathy .

reference_raw: He didn't even have to pretend to be sorry to feed his eternal desire for compassion.

reference_spacy_tokens: He did n't even have to pretend to be sorry to feed his eternal desire for compassion .


fn_spacy_tokens_for_baseline: Frozen pasta rarely has to be defrosted before use .

source_bert_toks: frozen pasta rarely has to be def ##ros ##ted before use .

reference_raw: Frozen pasta must rarely be frozen before use.

reference_spacy_tokens: Frozen pasta must rarely be frozen before use .


fn_spacy_tokens_for_baseline: Classes are a relaxed , collaborative affair , with much time spent contemplating plans and frequent breaks to discuss the stock at a local wood supplier or how to fake a Stradivarius .

source_bert_toks: classes are a relaxed , collaborative affair , with much time spent contemplating plans and frequent breaks to discuss the stock at a local wood supplier or how to fake a st ##rad ##ivar ##ius .

reference_raw: Classes are a loose, cooperative affair, with a lot of time spent contemplating plans and frequent breaks to discuss stocks with a local wood supplier or pretending to be a Stradivarius.

reference_spacy_tokens: Classes are a loose , cooperative affair , with a lot of time spent contemplating plans and frequent breaks to discuss stocks with a local wood supplier or pretending to be a Stradivarius .


fn_spacy_tokens_for_baseline: Licensed hawkers were circulating , braying the merits of spiced sausages containing only real animal protein -- so they claimed .

source_bert_toks: licensed hawker ##s were circulating , bray ##ing the merits of spice ##d sausage ##s containing only real animal protein - - so they claimed .

reference_raw: Licensed hawkers circulated, braiding the merit of spiced sausages that contained only real animal protein, so they said.

reference_spacy_tokens: Licensed hawkers circulated , braiding the merit of spiced sausages that contained only real animal protein , so they said .


fn_spacy_tokens_for_baseline: A string quintet played in the largest of the reception rooms , and guests spilled out into the garden in between light showers .

source_bert_toks: a string quintet played in the largest of the reception rooms , and guests spilled out into the garden in between light showers .

reference_raw: In the largest of the reception rooms, a string of quintets played, and guests poured out into the garden in the midst of light showers.

reference_spacy_tokens: In the largest of the reception rooms , a string of quintets played , and guests poured out into the garden in the midst of light showers .


fn_spacy_tokens_for_baseline: Nate Cocello , President of United Motors , had flown into London from Detroit with a posse of Vice Presidents to attend the bi - monthly meeting of the European Planning committee .

source_bert_toks: nate co ##cel ##lo , president of united motors , had flown into london from detroit with a posse of vice presidents to attend the bi - monthly meeting of the european planning committee .

reference_raw: Nate Cocello, president of United Motors, flew from Detroit to London to attend a bimonthly meeting of the European Planning Committee.

reference_spacy_tokens: Nate Cocello , president of United Motors , flew from Detroit to London to attend a bimonthly meeting of the European Planning Committee .


fn_spacy_tokens_for_baseline: A few days later we passed the desiccated corpse of another brigand hanging on a gibbet beside the track .

source_bert_toks: a few days later we passed the des ##ic ##cated corpse of another brig ##and hanging on a gi ##bbe ##t beside the track .

reference_raw: A few days later we passed the dried-up corpse of another bandit hanging on a gallows beside the track.

reference_spacy_tokens: A few days later we passed the dried - up corpse of another bandit hanging on a gallows beside the track .


fn_spacy_tokens_for_baseline: When the elder members of the family began to die , Mrs Thwaites did most , if not all of the baking and catering for the funerals .

source_bert_toks: when the elder members of the family began to die , mrs th ##waite ##s did most , if not all of the baking and catering for the funeral ##s .

reference_raw: When the older family members began to die, Mrs. Thwaites did the most, if not all, cooking and catering for funerals.

reference_spacy_tokens: When the older family members began to die , Mrs. Thwaites did the most , if not all , cooking and catering for funerals .


fn_spacy_tokens_for_baseline: This also meant searching for remains on offshore islands , reached by kayak through seas teeming with porpoises , albatrosses , sea lions and jackass penguins .

source_bert_toks: this also meant searching for remains on offshore islands , reached by kay ##ak through seas tee ##ming with por ##po ##ises , alba ##tro ##sse ##s , sea lions and jack ##ass penguins .

reference_raw: It also meant looking for the remains of the coastal islands that Kayak had reached through seas filled with porpoises, albatrosses, sea lions and jackass penguins.

reference_spacy_tokens: It also meant looking for the remains of the coastal islands that Kayak had reached through seas filled with porpoises , albatrosses , sea lions and jackass penguins .


fn_spacy_tokens_for_baseline: In 1982 , Greece joined the European Common Market ( now the European Union ) .

source_bert_toks: in 1982 , greece joined the european common market ( now the european union ) .

reference_raw: Greece acceded to the European common market (now the EU) in 1982.

reference_spacy_tokens: Greece acceded to the European common market ( now the EU ) in 1982 .


fn_spacy_tokens_for_baseline: yeah but i 'm even talking i 'm i 'm not even i 'm not even talking about higher education we 're i 'm talking about the the kids that we 've got now they come out of high school that ca n't read and write

source_bert_toks: yeah but i ' m even talking i ' m i ' m not even i ' m not even talking about higher education we ' re i ' m talking about the the kids that we ' ve got now they come out of high school that can ' t read and write

reference_raw: Yeah, but I'm even talking about I'm not talking about high school, I'm talking about the kids we have now come from high school who can't read and type.

reference_spacy_tokens: Yeah , but I 'm even talking about I 'm not talking about high school , I 'm talking about the kids we have now come from high school who ca n't read and type .


fn_spacy_tokens_for_baseline: Isaac 's outstretched hands clawed at the muddy earth , then they relaxed .

source_bert_toks: isaac ' s outstretched hands clawed at the muddy earth , then they relaxed .

reference_raw: Isaac's outstretched hands dug into the muddy ground, then relaxed.

reference_spacy_tokens: Isaac 's outstretched hands dug into the muddy ground , then relaxed .


fn_spacy_tokens_for_baseline: Asia 's currency markets , soaked for years in liquidity , have gone as dry as the desert , desiccated by the currency crises sweeping the region .

source_bert_toks: asia ' s currency markets , soaked for years in liquid ##ity , have gone as dry as the desert , des ##ic ##cated by the currency crises sweeping the region .

reference_raw: Asian currency markets, soaked in liquidity for years, have become as dry as the desert, dryed by the currency crisis that swept the region.

reference_spacy_tokens: Asian currency markets , soaked in liquidity for years , have become as dry as the desert , dryed by the currency crisis that swept the region .


fn_spacy_tokens_for_baseline: It is reported an Argentina - Spanish - German holding company will bid on Bushehr , but that its involvement will go beyond Bushehr . ( 1911 ) .

source_bert_toks: it is reported an argentina - spanish - german holding company will bid on bush ##eh ##r , but that its involvement will go beyond bush ##eh ##r . ( 1911 ) .

reference_raw: Argentine - Spanish - German holding company is reported to be bidding on Bushehr, but its participation will exceed Bushehr (1911).

reference_spacy_tokens: Argentine - Spanish - German holding company is reported to be bidding on Bushehr , but its participation will exceed Bushehr ( 1911 ) .


fn_spacy_tokens_for_baseline: A number of trials are said to have put the instigators in prison and security measures have been enhanced , but their actions did a great deal of damage from which Egypt will be slow to recover .

source_bert_toks: a number of trials are said to have put the ins ##ti ##gat ##ors in prison and security measures have been enhanced , but their actions did a great deal of damage from which egypt will be slow to recover .

reference_raw: Many attempts have been made to put the instigators in jail and security measures have been strengthened, but their actions have done much damage, from which Egypt will be slow to recover.

reference_spacy_tokens: Many attempts have been made to put the instigators in jail and security measures have been strengthened , but their actions have done much damage , from which Egypt will be slow to recover .


fn_spacy_tokens_for_baseline: Four fire helicopters have been deployed .

source_bert_toks: four fire helicopters have been deployed .

reference_raw: Four fire choppers have been deployed.

reference_spacy_tokens: Four fire choppers have been deployed .


fn_spacy_tokens_for_baseline: On the journey our eldest child picked up bubonic plague , and when the steamer moored at Chauk my wife managed to get medicines from the BOC Hospital shortly before it closed .

source_bert_toks: on the journey our eldest child picked up bu ##bon ##ic plague , and when the steamer moore ##d at cha ##uk my wife managed to get medicines from the bo ##c hospital shortly before it closed .

reference_raw: On the way, our eldest child picked up a bubonic plague, and when the steamer docked in Chauk, my wife managed to get meds from the BOC hospital shortly before it was closed.

reference_spacy_tokens: On the way , our eldest child picked up a bubonic plague , and when the steamer docked in Chauk , my wife managed to get meds from the BOC hospital shortly before it was closed .


fn_spacy_tokens_for_baseline: EMMA and RICHARD are in various states of undress as they go to bed .

source_bert_toks: emma and richard are in various states of und ##ress as they go to bed .

reference_raw: EMMA and RICHARD go to bed in different states of nakedness.

reference_spacy_tokens: EMMA and RICHARD go to bed in different states of nakedness .


fn_spacy_tokens_for_baseline: It yowled piteously again , and Virginia stood uncertain , gazing .

source_bert_toks: it yo ##wled pit ##eous ##ly again , and virginia stood uncertain , gazing .

reference_raw: She howled regretfully again, and Virginia stood unsteadily, staring.

reference_spacy_tokens: She howled regretfully again , and Virginia stood unsteadily , staring .


fn_spacy_tokens_for_baseline: And when the snow thawed and took with it the paint they had daubed it with , he was out there picking off the remaining flakes of paint , and cursing with disappointment .

source_bert_toks: and when the snow tha ##wed and took with it the paint they had da ##ub ##ed it with , he was out there picking off the remaining fl ##akes of paint , and cursing with disappointment .

reference_raw: And when the snow melted and took with it the paint with which it had been daubed, he was out there, picking out the remaining flakes of paint and cursing in frustration.

reference_spacy_tokens: And when the snow melted and took with it the paint with which it had been daubed , he was out there , picking out the remaining flakes of paint and cursing in frustration .


fn_spacy_tokens_for_baseline: In some magazines they ask men to fill in questionnaires about beauty , and loads of men seem to be using cleansers and having facials .

source_bert_toks: in some magazines they ask men to fill in question ##naire ##s about beauty , and loads of men seem to be using clean ##ser ##s and having facial ##s .

reference_raw: In some magazines, people are asked to fill out beauty questionnaires, and a lot of people seem to use cleaners and have faces.

reference_spacy_tokens: In some magazines , people are asked to fill out beauty questionnaires , and a lot of people seem to use cleaners and have faces .


fn_spacy_tokens_for_baseline: His health broke down under the strain of overwork , and he returned to Ortona in 1869 to convalesce .

source_bert_toks: his health broke down under the strain of over ##work , and he returned to orton ##a in 1869 to con ##vale ##sc ##e .

reference_raw: His health had collapsed under the strain of labor, and he had returned to Ortona in 1869 to convalescence.

reference_spacy_tokens: His health had collapsed under the strain of labor , and he had returned to Ortona in 1869 to convalescence .


fn_spacy_tokens_for_baseline: Lie across the bench with the dumb - bell overhead and the elbows slightly bent .

source_bert_toks: lie across the bench with the dumb - bell overhead and the elbows slightly bent .

reference_raw: He lay across the bench, his stupid bell above his head, his elbows slightly bent.

reference_spacy_tokens: He lay across the bench , his stupid bell above his head , his elbows slightly bent .


fn_spacy_tokens_for_baseline: Hurriedly she finished her ablutions , pulled on her clothes and went to investigate .

source_bert_toks: hurriedly she finished her ab ##lu ##tions , pulled on her clothes and went to investigate .

reference_raw: She quickly finished her bruises, put on her clothes, and went to investigate.

reference_spacy_tokens: She quickly finished her bruises , put on her clothes , and went to investigate .


fn_spacy_tokens_for_baseline: ' I would n't go as far as to say that but I 'll admit you were in a rather nasty pickle . '

source_bert_toks: ' i wouldn ' t go as far as to say that but i ' ll admit you were in a rather nasty pick ##le . '

reference_raw: "I wouldn't go so far as to tell you this, but I'll admit you've been in a pretty nasty mess."

reference_spacy_tokens: " I would n't go so far as to tell you this , but I 'll admit you 've been in a pretty nasty mess . "


fn_spacy_tokens_for_baseline: Helen was in the kitchen preparing a sweet savour as an offering to her lord .

source_bert_toks: helen was in the kitchen preparing a sweet sa ##vo ##ur as an offering to her lord .

reference_raw: Helen was in the kitchen preparing a sweet savor as an offering to her master.

reference_spacy_tokens: Helen was in the kitchen preparing a sweet savor as an offering to her master .


fn_spacy_tokens_for_baseline: The Cook . is an art movie , referring as much to Rembrandt , Vermeer , Frans Hals and Dutch / Flemish still - life painting as to films noirs about brutal gangsters and downtrodden molls .

source_bert_toks: the cook . is an art movie , referring as much to re ##mb ##rand ##t , ve ##rm ##eer , fran ##s hal ##s and dutch / flemish still - life painting as to films noir ##s about brutal gangster ##s and down ##tro ##dden mo ##lls .

reference_raw: Cook . is an art film which refers to Rembrandt, Vermeer, Frans Hals and Dutch/Flemish still-living paintings as well as to the noirs of brutal gangsters and downtrodden molts.

reference_spacy_tokens: Cook . is an art film which refers to Rembrandt , Vermeer , Frans Hals and Dutch / Flemish still - living paintings as well as to the noirs of brutal gangsters and downtrodden molts .


fn_spacy_tokens_for_baseline: The virtuous Scottish doctor would certainly have been shocked by our modern profligacy .

source_bert_toks: the vi ##rt ##uous scottish doctor would certainly have been shocked by our modern prof ##liga ##cy .

reference_raw: I'm sure a virtuous Scottish doctor would be shocked by our modern skills.

reference_spacy_tokens: I 'm sure a virtuous Scottish doctor would be shocked by our modern skills .


fn_spacy_tokens_for_baseline: " They were a self - perpetuating club that treated the tower as sort of a separate premises , " the Vicar Hummerstone says .

source_bert_toks: " they were a self - per ##pet ##uating club that treated the tower as sort of a separate premises , " the vicar hum ##mers ##tone says .

reference_raw: "It was a self-perpetuating group that treated the tower as a sort of separate space," says the vicar Hummerstone.

reference_spacy_tokens: " It was a self - perpetuating group that treated the tower as a sort of separate space , " says the vicar Hummerstone .


fn_spacy_tokens_for_baseline: They splashed into the shallows and slipped on the smooth stones .

source_bert_toks: they splashed into the shallow ##s and slipped on the smooth stones .

reference_raw: They splattered into the shallows and slid down the smooth rocks.

reference_spacy_tokens: They splattered into the shallows and slid down the smooth rocks .


fn_spacy_tokens_for_baseline: Like the smaller copepods , euphausiids are mainly herbivorous , combing algal cells from the water and gathering them in a basket - like arrangement of bristles on their many - jointed forelimbs .

source_bert_toks: like the smaller cope ##pods , eu ##pha ##us ##ii ##ds are mainly herb ##ivo ##rous , comb ##ing al ##gal cells from the water and gathering them in a basket - like arrangement of br ##istles on their many - joint ##ed fore ##lim ##bs .

reference_raw: Like smaller coppods, euphausiids are mainly herbivorous, combing algae cells out of the water and collecting them in a basket of bristles on their many-jointed front limbs.

reference_spacy_tokens: Like smaller coppods , euphausiids are mainly herbivorous , combing algae cells out of the water and collecting them in a basket of bristles on their many - jointed front limbs .


fn_spacy_tokens_for_baseline: New construction is everywhere , the streets buzz , traffic is increasingly congested , and in the frenetic pace of rush hour everyone in Dublin seems intent on changing places with everyone else .

source_bert_toks: new construction is everywhere , the streets buzz , traffic is increasingly cong ##ested , and in the fr ##ene ##tic pace of rush hour everyone in dublin seems intent on changing places with everyone else .

reference_raw: New buildings are everywhere, streets are buzzing, traffic is getting more and more crowded, and at the frenetic speed of rush time, everyone in Dublin seems to want to change places with everyone else.

reference_spacy_tokens: New buildings are everywhere , streets are buzzing , traffic is getting more and more crowded , and at the frenetic speed of rush time , everyone in Dublin seems to want to change places with everyone else .


fn_spacy_tokens_for_baseline: For a few minutes the sun glimmered through the mist to my right , a red ball just risen above the mountain .

source_bert_toks: for a few minutes the sun g ##lim ##mere ##d through the mist to my right , a red ball just risen above the mountain .

reference_raw: For several minutes the sun was shining through the fog to my right, and a red ball had just risen over the mountain.

reference_spacy_tokens: For several minutes the sun was shining through the fog to my right , and a red ball had just risen over the mountain .


fn_spacy_tokens_for_baseline: The Cotswold style , with its relatively severe details and blunt forms , created a very different setting from French Provincial , which tended to have more delicate details , from Free Style with its almost rustic atmosphere , or from sturdy Colonial .

source_bert_toks: the cot ##sw ##old style , with its relatively severe details and blunt forms , created a very different setting from french provincial , which tended to have more delicate details , from free style with its almost rustic atmosphere , or from sturdy colonial .

reference_raw: The Cotswold style, with its relatively strict details and blunt forms, created a very different environment from the French province, which tended to have more delicate details, from the Free Style with its almost rustic atmosphere, or from the sturdy Colonial.

reference_spacy_tokens: The Cotswold style , with its relatively strict details and blunt forms , created a very different environment from the French province , which tended to have more delicate details , from the Free Style with its almost rustic atmosphere , or from the sturdy Colonial .


fn_spacy_tokens_for_baseline: The copper anklet was probably the only thing of value she had possessed , and it was curious that it had not been stolen , for all metal was valuable in the Black Land .

source_bert_toks: the copper ankle ##t was probably the only thing of value she had possessed , and it was curious that it had not been stolen , for all metal was valuable in the black land .

reference_raw: The copper bracelet was probably the only thing of value she had, and it was odd that it hadn't been stolen, since all the metal was valuable in the Black Land.

reference_spacy_tokens: The copper bracelet was probably the only thing of value she had , and it was odd that it had n't been stolen , since all the metal was valuable in the Black Land .


fn_spacy_tokens_for_baseline: It perhaps is typical of his approach that he held lavish dinner - parties at his home for the Ecclesiological Society , to which distinguished architects were invited .

source_bert_toks: it perhaps is typical of his approach that he held lavish dinner - parties at his home for the ec ##cles ##iol ##ogical society , to which distinguished architects were invited .

reference_raw: Perhaps it was typical of his attitude that he had a lavish dinner party at home for the Church Society, to which distinguished architects had been invited.

reference_spacy_tokens: Perhaps it was typical of his attitude that he had a lavish dinner party at home for the Church Society , to which distinguished architects had been invited .


fn_spacy_tokens_for_baseline: Things were very simple and this list made that precise point very well but of course this journalist was being somewhat disingenuous as well as cynical .

source_bert_toks: things were very simple and this list made that precise point very well but of course this journalist was being somewhat di ##sing ##en ##uous as well as cynical .

reference_raw: It was very simple, and the list was very precise, but, of course, the reporter was both a little disincentive and cynical.

reference_spacy_tokens: It was very simple , and the list was very precise , but , of course , the reporter was both a little disincentive and cynical .


fn_spacy_tokens_for_baseline: When we finally make proposals to build a repository we must be confident they will satisfy safety standards that are amongst the toughest in the world .

source_bert_toks: when we finally make proposals to build a repository we must be confident they will satisfy safety standards that are amongst the tough ##est in the world .

reference_raw: When we finally make proposals to build a storage facility, we need to be confident that it will meet the security standards that are among the toughest in the world.

reference_spacy_tokens: When we finally make proposals to build a storage facility , we need to be confident that it will meet the security standards that are among the toughest in the world .


fn_spacy_tokens_for_baseline: Part of the answer , Chafee said , might be giving more flexibility with the money , rather than more funds , Chafee suggested after the hearing .

source_bert_toks: part of the answer , cha ##fe ##e said , might be giving more flexibility with the money , rather than more funds , cha ##fe ##e suggested after the hearing .

reference_raw: Part of the answer, Chafee said, could be more flexible with money than with more money, Chafee suggested at the hearing.

reference_spacy_tokens: Part of the answer , Chafee said , could be more flexible with money than with more money , Chafee suggested at the hearing .


fn_spacy_tokens_for_baseline: Proteins tend to coagulate and form large particles when heated , but this is controlled using a high shear process ( intensive blending ) .

source_bert_toks: proteins tend to coa ##gul ##ate and form large particles when heated , but this is controlled using a high shear process ( intensive blending ) .

reference_raw: When heated, proteins tend to clot and form large particles, but are controlled by a high scissor process (intensive mixing).

reference_spacy_tokens: When heated , proteins tend to clot and form large particles , but are controlled by a high scissor process ( intensive mixing ) .


fn_spacy_tokens_for_baseline: You deceived me completely , did n't you ?

source_bert_toks: you dec ##ei ##ved me completely , didn ' t you ?

reference_raw: You totally cheated on me, didn't you?

reference_spacy_tokens: You totally cheated on me , did n't you ?


fn_spacy_tokens_for_baseline: The laconic demolition of the Russian 's argument was rapturously applauded .

source_bert_toks: the lac ##onic demolition of the russian ' s argument was rap ##tur ##ously app ##lau ##ded .

reference_raw: The laconical demolition of the Russian's argument was applauded.

reference_spacy_tokens: The laconical demolition of the Russian 's argument was applauded .


fn_spacy_tokens_for_baseline: In Europe , it used to be believed that devils took up residence inside pigs by entering through a tiny hole in the forefoot .

source_bert_toks: in europe , it used to be believed that devils took up residence inside pigs by entering through a tiny hole in the fore ##foot .

reference_raw: In Europe, it was believed that the devils had taken up residence in the pigs by entering a small hole in the front leg.

reference_spacy_tokens: In Europe , it was believed that the devils had taken up residence in the pigs by entering a small hole in the front leg .


fn_spacy_tokens_for_baseline: The eyewitness accounts came from calls made from the rear of the plane , from passengers originally seated further forward in the cabin , a sign that passengers and perhaps crew had been moved to the back of the aircraft .

source_bert_toks: the eye ##wi ##tness accounts came from calls made from the rear of the plane , from passengers originally seated further forward in the cabin , a sign that passengers and perhaps crew had been moved to the back of the aircraft .

reference_raw: The eyewitness accounts were based on the calls made by the back of the aircraft, the passengers who had originally sat farther ahead in the cabin, a sign that the passengers and possibly the crew had been moved to the rear of the aircraft.

reference_spacy_tokens: The eyewitness accounts were based on the calls made by the back of the aircraft , the passengers who had originally sat farther ahead in the cabin , a sign that the passengers and possibly the crew had been moved to the rear of the aircraft .


fn_spacy_tokens_for_baseline: A few blocks up Nathan Road is Kowloon Park ( open daily 6 am - midnight ) , elegantly laid out with fountains , promenades , and ornamental gardens ; be sure to go up the steps to see the Sculpture Walk .

source_bert_toks: a few blocks up nathan road is ko ##wl ##oon park ( open daily 6 am - midnight ) , elegant ##ly laid out with fountains , promenade ##s , and ornamental gardens ; be sure to go up the steps to see the sculpture walk .

reference_raw: A few blocks from Nathan Road is Kowloon Park (open at 6:00 a.m. every day), neatly arranged with fountains, promenades, and ornamental gardens; make sure to go up the stairs and look at the statue walk.

reference_spacy_tokens: A few blocks from Nathan Road is Kowloon Park ( open at 6:00 a.m. every day ) , neatly arranged with fountains , promenades , and ornamental gardens ; make sure to go up the stairs and look at the statue walk .


fn_spacy_tokens_for_baseline: Meanwhile in Brownsville , Texas , townsfolk anxiously await an invasion no amount of six - shooters can repel -- the coming of a particularly nasty strain of killer bee , whose sting is nearly ten times more deadly than the ' common or garden ' variety .

source_bert_toks: meanwhile in browns ##ville , texas , towns ##folk anxiously await an invasion no amount of six - shooters can rep ##el - - the coming of a particularly nasty strain of killer bee , whose sting is nearly ten times more deadly than the ' common or garden ' variety .

reference_raw: In the meantime, in Brownsville, Texas, the townspeople are anxiously waiting for an invasion that can't be repressed by a number of six-shooters-the arrival of a particularly nasty strain of killer bees, whose stings are almost ten times more lethal than the "common or garden" variety.

reference_spacy_tokens: In the meantime , in Brownsville , Texas , the townspeople are anxiously waiting for an invasion that ca n't be repressed by a number of six - shooters - the arrival of a particularly nasty strain of killer bees , whose stings are almost ten times more lethal than the " common or garden " variety .


fn_spacy_tokens_for_baseline: I think that I have seen all that I wish in this house , and that my time may be more profitably employed elsewhere .

source_bert_toks: i think that i have seen all that i wish in this house , and that my time may be more profit ##ably employed elsewhere .

reference_raw: I think I've seen everything I want in this house, and that my time can be more profitable elsewhere.

reference_spacy_tokens: I think I 've seen everything I want in this house , and that my time can be more profitable elsewhere .


fn_spacy_tokens_for_baseline: Instead , I made my way back along the sand , watching some evidently exhilarated surfers .

source_bert_toks: instead , i made my way back along the sand , watching some evidently ex ##hila ##rated surfer ##s .

reference_raw: Instead, I made my way back along the sand and watched some of the apparently cheery surfers.

reference_spacy_tokens: Instead , I made my way back along the sand and watched some of the apparently cheery surfers .


fn_spacy_tokens_for_baseline: Canadian international merchandise trade

source_bert_toks: canadian international merchandise trade

reference_raw: International Trade in Goods in Canada

reference_spacy_tokens: International Trade in Goods in Canada


fn_spacy_tokens_for_baseline: The door hissed shut .

source_bert_toks: the door hissed shut .

reference_raw: The door sizzled shut.

reference_spacy_tokens: The door sizzled shut .


fn_spacy_tokens_for_baseline: It disturbed him that she had n't broken the news by saying she was pregnant .

source_bert_toks: it disturbed him that she hadn ' t broken the news by saying she was pregnant .

reference_raw: He was upset that she didn't break the news when she said she was pregnant.

reference_spacy_tokens: He was upset that she did n't break the news when she said she was pregnant .


fn_spacy_tokens_for_baseline: These systems have provided Taiwanese scientists with experience and a technological base in areas such as composite materials and guidance and fire control systems , which are essential for development of longer range surface -to - surface missiles .

source_bert_toks: these systems have provided taiwanese scientists with experience and a technological base in areas such as composite materials and guidance and fire control systems , which are essential for development of longer range surface - to - surface missiles .

reference_raw: These systems have provided Taiwanese scientists with experience and a technical basis in areas such as composite materials and guidance and fire control systems, which are essential for the development of long range-to-surface missiles.

reference_spacy_tokens: These systems have provided Taiwanese scientists with experience and a technical basis in areas such as composite materials and guidance and fire control systems , which are essential for the development of long range - to - surface missiles .


fn_spacy_tokens_for_baseline: There was only the sound of the fountain plashing away .

source_bert_toks: there was only the sound of the fountain pl ##ashi ##ng away .

reference_raw: There was only the sound of a fountain crashing away.

reference_spacy_tokens: There was only the sound of a fountain crashing away .


fn_spacy_tokens_for_baseline: Shelley had been watching them , amused at this family banter , knowing that it was no business of hers to stay , now that she knew the old man was all right .

source_bert_toks: shelley had been watching them , amused at this family ban ##ter , knowing that it was no business of hers to stay , now that she knew the old man was all right .

reference_raw: Shelley watched them, amused by the family bant, knowing that it was not her place to stay, knowing that the old man was all right.

reference_spacy_tokens: Shelley watched them , amused by the family bant , knowing that it was not her place to stay , knowing that the old man was all right .


fn_spacy_tokens_for_baseline: Money has been rolling in from a very wide range of fund raising activities undertaken by JM sites and individuals around the country .

source_bert_toks: money has been rolling in from a very wide range of fund raising activities undertaken by j ##m sites and individuals around the country .

reference_raw: Money has flown from a wide range of fund-raising activities carried out by JM sites and individuals across the country.

reference_spacy_tokens: Money has flown from a wide range of fund - raising activities carried out by JM sites and individuals across the country .


fn_spacy_tokens_for_baseline: Mrs Sugar used to curl her hair with rags and take snuff , and every Saturday she had a bet on the horses .

source_bert_toks: mrs sugar used to curl her hair with rags and take s ##nu ##ff , and every saturday she had a bet on the horses .

reference_raw: Mrs. Sugar used to curl her hair in rags and smoke, and every Saturday she made a bet on a horse.

reference_spacy_tokens: Mrs. Sugar used to curl her hair in rags and smoke , and every Saturday she made a bet on a horse .


fn_spacy_tokens_for_baseline: Four hundred troops are currently in the northwestern county guarding densely - populated areas , airports and power stations .

source_bert_toks: four hundred troops are currently in the northwestern county guarding densely - populated areas , airports and power stations .

reference_raw: There are now 400 troops in the northwest region, guarding densely populated areas, airports, and power stations.

reference_spacy_tokens: There are now 400 troops in the northwest region , guarding densely populated areas , airports , and power stations .


fn_spacy_tokens_for_baseline: Blanch the fish in a large pan of boiling water for 2 minutes .

source_bert_toks: blanc ##h the fish in a large pan of boiling water for 2 minutes .

reference_raw: Blanc the fish for two minutes in a big pan of boiling water.

reference_spacy_tokens: Blanc the fish for two minutes in a big pan of boiling water .


fn_spacy_tokens_for_baseline: Even work which concentrates on the social flexibility of gender relations , often ends up making biological determinants the core of its project .

source_bert_toks: even work which concentrate ##s on the social flexibility of gender relations , often ends up making biological deter ##mina ##nts the core of its project .

reference_raw: Even work that focuses on socially flexible relationships between men and women often ends up making biological determinants at the heart of the project.

reference_spacy_tokens: Even work that focuses on socially flexible relationships between men and women often ends up making biological determinants at the heart of the project .


fn_spacy_tokens_for_baseline: I see the way the snow is kicked up off the paws of the dogs , the way their breath explodes around their heads .

source_bert_toks: i see the way the snow is kicked up off the paws of the dogs , the way their breath explodes around their heads .

reference_raw: I can see the snow coming out of the dog's hands, the way their breath explodes around their heads.

reference_spacy_tokens: I can see the snow coming out of the dog 's hands , the way their breath explodes around their heads .


fn_spacy_tokens_for_baseline: She shut her eyes again .

source_bert_toks: she shut her eyes again .

reference_raw: She closed her eyes again.

reference_spacy_tokens: She closed her eyes again .


fn_spacy_tokens_for_baseline: This film may be a shocker , but as well as being very sexy it 's also pretty funny at times .

source_bert_toks: this film may be a shock ##er , but as well as being very sexy it ' s also pretty funny at times .

reference_raw: This movie may be shocking, but even if it's very sexy, sometimes it's kind of funny.

reference_spacy_tokens: This movie may be shocking , but even if it 's very sexy , sometimes it 's kind of funny .


fn_spacy_tokens_for_baseline: The establishment magazines began by deprecating the film 's free and easy attitude to drugs and sex , and especially to violence .

source_bert_toks: the establishment magazines began by de ##pre ##cating the film ' s free and easy attitude to drugs and sex , and especially to violence .

reference_raw: The business journals began by depreciating the film's free and easy access to drugs and sex, especially violence.

reference_spacy_tokens: The business journals began by depreciating the film 's free and easy access to drugs and sex , especially violence .


fn_spacy_tokens_for_baseline: In this very flat area the water level rises about 2 m during floods , suggesting a minimum subsidence of 4 m over about 70 years .

source_bert_toks: in this very flat area the water level rises about 2 m during floods , suggesting a minimum sub ##side ##nce of 4 m over about 70 years .

reference_raw: In this very flat area, the volume of water rises by about 2 m during flooding, indicating a minimum subsidisation of 4 m over approximately 70 years.

reference_spacy_tokens: In this very flat area , the volume of water rises by about 2 m during flooding , indicating a minimum subsidisation of 4 m over approximately 70 years .


fn_spacy_tokens_for_baseline: It still revels in its own identity , which is now internationally recognized through such influential cultural products as the Rastafarian religion and reggae music .

source_bert_toks: it still rev ##els in its own identity , which is now internationally recognized through such influential cultural products as the ras ##ta ##far ##ian religion and reggae music .

reference_raw: It still enjoys its own identity, which is now internationally recognised by such powerful cultural products as the Rastafarian religion and reggae.

reference_spacy_tokens: It still enjoys its own identity , which is now internationally recognised by such powerful cultural products as the Rastafarian religion and reggae .


fn_spacy_tokens_for_baseline: Mr Kronweiser sprang into his earlier stance of crouching flabby tiger , then with a deprecatory smile he relaxed stiffly and began rummaging in the top drawer .

source_bert_toks: mr k ##ron ##wei ##ser sprang into his earlier stance of crouch ##ing fl ##ab ##by tiger , then with a de ##pre ##cat ##ory smile he relaxed stiffly and began rum ##ma ##ging in the top drawer .

reference_raw: Mr. Kronweiser jumped into his former position as a squat tiger, then relaxed stiffly with a wry smile and began to rummage through the top drawer.

reference_spacy_tokens: Mr. Kronweiser jumped into his former position as a squat tiger , then relaxed stiffly with a wry smile and began to rummage through the top drawer .


fn_spacy_tokens_for_baseline: All of those present who had shed their masks activated their own identical tattoos then willed the image to vanish again .

source_bert_toks: all of those present who had shed their masks activated their own identical tattoos then willed the image to vanish again .

reference_raw: All those who had hidden their masks had activated their own tattoos, and then they were willing to make the image disappear again.

reference_spacy_tokens: All those who had hidden their masks had activated their own tattoos , and then they were willing to make the image disappear again .


fn_spacy_tokens_for_baseline: Outside the northern Iraqi city of Kirkuk , at least nine police officers were killed and three were wounded when a bomb detonated on an oil pipeline as they were trying to defuse it .

source_bert_toks: outside the northern iraqi city of kirk ##uk , at least nine police officers were killed and three were wounded when a bomb detonated on an oil pipeline as they were trying to def ##use it .

reference_raw: At least nine police officers were killed outside the northern Iraqi city of Kirkuk, and three were injured when a bomb exploded in an oil pipeline in an attempt to defuse it.

reference_spacy_tokens: At least nine police officers were killed outside the northern Iraqi city of Kirkuk , and three were injured when a bomb exploded in an oil pipeline in an attempt to defuse it .


fn_spacy_tokens_for_baseline: 2 ) Congressional representatives have two basic responsibilities while voting in office -- dealing with national issues ( programmatic actions such as casting roll call votes on legislation that imposes costs and/or confers benefits on the population at large ) and attending to local issues ( constituency service and pork barrel ) .

source_bert_toks: 2 ) congressional representatives have two basic responsibilities while voting in office - - dealing with national issues ( program ##matic actions such as casting roll call votes on legislation that impose ##s costs and / or con ##fers benefits on the population at large ) and attending to local issues ( constituency service and pork barrel ) .

reference_raw: 2) Congressional delegates have two basic responsibilities when they vote in office - dealing with national issues (programmatic measures such as the casting of roll-call votes on legislation that imposes costs and/or benefits for the general population) and taking part in local issues (constituency service and pork barrels).

reference_spacy_tokens: 2 ) Congressional delegates have two basic responsibilities when they vote in office - dealing with national issues ( programmatic measures such as the casting of roll - call votes on legislation that imposes costs and/or benefits for the general population ) and taking part in local issues ( constituency service and pork barrels ) .


fn_spacy_tokens_for_baseline: I had fallen asleep , squatting behind a buttress of the church of St Nicholas long after curfew , my lips blue , my teeth chattering with the cold .

source_bert_toks: i had fallen asleep , squat ##ting behind a butt ##ress of the church of st nicholas long after cu ##rf ##ew , my lips blue , my teeth chatter ##ing with the cold .

reference_raw: I fell asleep and crouched behind the buttress of St. Nicholas' church long after curfew, my lips blue, my teeth chattering with cold.

reference_spacy_tokens: I fell asleep and crouched behind the buttress of St. Nicholas ' church long after curfew , my lips blue , my teeth chattering with cold .


fn_spacy_tokens_for_baseline: He lifted a pacifying hand to the Sergeant and barked at the rifleman .

source_bert_toks: he lifted a pac ##ifying hand to the sergeant and barked at the rifle ##man .

reference_raw: He raised his pacific hand to the sergeant and barked at the shooter.

reference_spacy_tokens: He raised his pacific hand to the sergeant and barked at the shooter .


fn_spacy_tokens_for_baseline: In the long , frightening night after Tuesday 's devastating earthquake , Bay Area residents searched for comfort and solace wherever they could .

source_bert_toks: in the long , frightening night after tuesday ' s devastating earthquake , bay area residents searched for comfort and sol ##ace wherever they could .

reference_raw: In the long, gruesome night of Tuesday's devastating quake, the inhabitants of the Bay Area sought comfort and comfort wherever they could.

reference_spacy_tokens: In the long , gruesome night of Tuesday 's devastating quake , the inhabitants of the Bay Area sought comfort and comfort wherever they could .


fn_spacy_tokens_for_baseline: From there on , the topography is less demanding , the road undulating gently all the way to Monmouth .

source_bert_toks: from there on , the topography is less demanding , the road und ##ulating gently all the way to monmouth .

reference_raw: From now on, the topography is less demanding, and the road rolls gently all the way to Monmouth.

reference_spacy_tokens: From now on , the topography is less demanding , and the road rolls gently all the way to Monmouth .