fn_spacy_tokens_for_baseline: The last he saw was a gloat in his sibling 's eyes , and a final , spiteful , vengeful lunge in his direction before he was taken away .

source_bert_toks: the last he saw was a g ##lo ##at in his sibling ' s eyes , and a final , spite ##ful , ve ##nge ##ful lung ##e in his direction before he was taken away .

reference_raw: The last thing he saw was a glee in his sibling's eyes, and a final, vicious, revengeful leap in his direction before he was taken away.

reference_spacy_tokens: The last thing he saw was a glee in his sibling 's eyes , and a final , vicious , revengeful leap in his direction before he was taken away .


fn_spacy_tokens_for_baseline: Jetfoils leave every 15 to 30 minutes 24 hours a day .

source_bert_toks: jet ##foil ##s leave every 15 to 30 minutes 24 hours a day .

reference_raw: The jets leave every 15-30 minutes 24-hours a day.

reference_spacy_tokens: The jets leave every 15 - 30 minutes 24-hours a day .


fn_spacy_tokens_for_baseline: I suppose the choir at Beverley should be thankful he did not think of performing the nine lessons and carols up there on top of the tower .

source_bert_toks: i suppose the choir at beverley should be thankful he did not think of performing the nine lessons and carol ##s up there on top of the tower .

reference_raw: I think the Beverley Glee Club should be grateful that he didn't think to do the nine lessons and carols at the top of the tower.

reference_spacy_tokens: I think the Beverley Glee Club should be grateful that he did n't think to do the nine lessons and carols at the top of the tower .


fn_spacy_tokens_for_baseline: The primary aim of land law was the preservation of families as viable economic units .

source_bert_toks: the primary aim of land law was the preservation of families as viable economic units .

reference_raw: The main objective of land law was to maintain families as viable economic units.

reference_spacy_tokens: The main objective of land law was to maintain families as viable economic units .


fn_spacy_tokens_for_baseline: False hope was duly dashed .

source_bert_toks: false hope was duly dashed .

reference_raw: Falsified hope has been properly dashed.

reference_spacy_tokens: Falsified hope has been properly dashed .


fn_spacy_tokens_for_baseline: A leaflet entitled Information for Industry was produced and mailed to almost 1,000 companies in Scotland .

source_bert_toks: a leaf ##let entitled information for industry was produced and mail ##ed to almost 1 , 000 companies in scotland .

reference_raw: A leaflet called Information for Industry has been produced and sent to nearly 1,000 companies in Scotland.

reference_spacy_tokens: A leaflet called Information for Industry has been produced and sent to nearly 1,000 companies in Scotland .


fn_spacy_tokens_for_baseline: One thing about Zosie 's pilfering , she never stole rubbish .

source_bert_toks: one thing about z ##osi ##e ' s pi ##lf ##ering , she never stole rubbish .

reference_raw: One thing about Zosie's pillaging is she didn't steal garbage.

reference_spacy_tokens: One thing about Zosie 's pillaging is she did n't steal garbage .


fn_spacy_tokens_for_baseline: Her car seat squeaked as Blanche reached up to switch out the light .

source_bert_toks: her car seat squeak ##ed as blanche reached up to switch out the light .

reference_raw: When Blanche reached out to turn off the light, her car seat creaked.

reference_spacy_tokens: When Blanche reached out to turn off the light , her car seat creaked .


fn_spacy_tokens_for_baseline: Players on tour are normally paired together as room - mates , a simple organisational expedient that over the years has created an explosive chemistry of scandal and misbehaviour .

source_bert_toks: players on tour are normally paired together as room - mates , a simple organisation ##al ex ##ped ##ient that over the years has created an explosive chemistry of scandal and mis ##be ##ha ##vio ##ur .

reference_raw: Players on tours are usually paired up as roommates, a simple organisational skill that has created an explosive chemical of scandal and misbehavior over the years.

reference_spacy_tokens: Players on tours are usually paired up as roommates , a simple organisational skill that has created an explosive chemical of scandal and misbehavior over the years .


fn_spacy_tokens_for_baseline: The new , better - trained and better - equipped Iraqi forces include police who have defended their stations during insurgent attacks in Baghdad -- though some officers abandoned their posts in Mosul this month .

source_bert_toks: the new , better - trained and better - equipped iraqi forces include police who have defended their stations during ins ##urgent attacks in baghdad - - though some officers abandoned their posts in mo ##sul this month .

reference_raw: The new, better trained and better equipped Iraqi forces include the police who defended their stations during the rebel attacks in Baghdad - although some of the officers left Mosul this month.

reference_spacy_tokens: The new , better trained and better equipped Iraqi forces include the police who defended their stations during the rebel attacks in Baghdad - although some of the officers left Mosul this month .


fn_spacy_tokens_for_baseline: The great German superiority in artillery made the outcome inevitable : the Russians abandoned Warsaw and the city was occupied by the Germans on 5 August .

source_bert_toks: the great german superiority in artillery made the outcome inevitable : the russians abandoned warsaw and the city was occupied by the germans on 5 august .

reference_raw: The result was inevitable because of the great German superiority in artillery: the Russians left Warsaw and the city was occupied by the Germans on August 5th.

reference_spacy_tokens: The result was inevitable because of the great German superiority in artillery : the Russians left Warsaw and the city was occupied by the Germans on August 5th .


fn_spacy_tokens_for_baseline: Sometime during 1988 , it is believed that the PRC agreed to assist Iran modernize and expand its facilities at Parchin and Semnan to enable the design and manufacture of solid fuel artillery rockets and missiles of indigenous design .

source_bert_toks: sometime during 1988 , it is believed that the prc agreed to assist iran modern ##ize and expand its facilities at parc ##hin and se ##m ##nan to enable the design and manufacture of solid fuel artillery rockets and missiles of indigenous design .

reference_raw: Some time in 1988, the People's Republic of China is expected to assist Iran in modernising and expanding its facilities in Parchin and Semnan to allow the design and production of solid-fuel artillery rockets and domestically designed missiles.

reference_spacy_tokens: Some time in 1988 , the People 's Republic of China is expected to assist Iran in modernising and expanding its facilities in Parchin and Semnan to allow the design and production of solid - fuel artillery rockets and domestically designed missiles .


fn_spacy_tokens_for_baseline: To her bewilderment they both dissolved into giggles .

source_bert_toks: to her be ##wil ##der ##ment they both dissolved into giggles .

reference_raw: To her confusion, they both melted into giggles.

reference_spacy_tokens: To her confusion , they both melted into giggles .


fn_spacy_tokens_for_baseline: An emissary would be permitted to leave Berwick to apprise the so - called Regent of this arrangement .

source_bert_toks: an emi ##ssar ##y would be permitted to leave berwick to app ##rise the so - called regent of this arrangement .

reference_raw: The Ambassador will be allowed to leave Berwick to inform the so-called Regent of this arrangement.

reference_spacy_tokens: The Ambassador will be allowed to leave Berwick to inform the so - called Regent of this arrangement .


fn_spacy_tokens_for_baseline: She had been completely naked .

source_bert_toks: she had been completely naked .

reference_raw: She was completely nude.

reference_spacy_tokens: She was completely nude .


fn_spacy_tokens_for_baseline: Inevitably , deconstructing the titles of individual papers was a challenging exercise in itself .

source_bert_toks: inevitably , deco ##nst ##ru ##cting the titles of individual papers was a challenging exercise in itself .

reference_raw: Unnecessarily, the deconstruction of the titles of each document was a difficult exercise in itself.

reference_spacy_tokens: Unnecessarily , the deconstruction of the titles of each document was a difficult exercise in itself .


fn_spacy_tokens_for_baseline: ( JFMIP Standardization Project ) Unobligated balances expire ( cease to be available for obligation ) for : -- 1-year accounts at the end of the fiscal year ; -- multiple - year accounts at the end of the period specified ; -- no - year accounts only when they are 1 ) rescinded by law , 2 ) purpose is accomplished , or 3 ) when disbursements against the appropriation have not been made for 2 full consecutive years .

source_bert_toks: ( j ##fm ##ip standardization project ) uno ##bl ##igate ##d balance ##s ex ##pire ( cease to be available for obligation ) for : - - 1 - year accounts at the end of the fiscal year ; - - multiple - year accounts at the end of the period specified ; - - no - year accounts only when they are 1 ) res ##cin ##ded by law , 2 ) purpose is accomplished , or 3 ) when di ##sb ##urse ##ments against the app ##ropriation have not been made for 2 full consecutive years .

reference_raw: (JFMIP Standardisation Project) Unobligated balances expire (ceasing to be available for commitment) for: - one-year accounts at the end of the financial year; - multiple-year accounts at the end of the specified period; - non-year accounts only if they are 1) cancelled by law, 2) the purpose is achieved, or 3) if payments against the appropriations are not made for two whole consecutive years.

reference_spacy_tokens: ( JFMIP Standardisation Project ) Unobligated balances expire ( ceasing to be available for commitment ) for : - one - year accounts at the end of the financial year ; - multiple - year accounts at the end of the specified period ; - non - year accounts only if they are 1 ) cancelled by law , 2 ) the purpose is achieved , or 3 ) if payments against the appropriations are not made for two whole consecutive years .


fn_spacy_tokens_for_baseline: The jagged edges gashed their fingers : the rag round Gazzer 's hand was bright with fresh blood .

source_bert_toks: the jagged edges gas ##hed their fingers : the rag round ga ##zz ##er ' s hand was bright with fresh blood .

reference_raw: The jagged edges flickered their fingers: the rag around Gazzer's hand was bright with fresh blood.

reference_spacy_tokens: The jagged edges flickered their fingers : the rag around Gazzer 's hand was bright with fresh blood .


fn_spacy_tokens_for_baseline: " He said he had problems in his marriage , " says Stephanopoulos , correcting Donaldson 's deviation from the pre - scripted fudge - phrase of the day . ( Today , of course , the president 's defenders claim that Clinton admitted infidelity on 60 Minutes and that the fully informed voters simply did n't care . )

source_bert_toks: " he said he had problems in his marriage , " says stephan ##op ##oulos , correct ##ing donaldson ' s deviation from the pre - scripted fu ##dge - phrase of the day . ( today , of course , the president ' s defenders claim that clinton admitted in ##fide ##lity on 60 minutes and that the fully informed voters simply didn ' t care . )

reference_raw: "He says he's having trouble getting married," says Stephanopoulos, correcting Donaldson's deviation from the prescribed fudge phrase of the day. (Today, of course, the President's defenders claim that Clinton admitted infidelity within sixty minutes and that the fully-informed voters simply didn't care.)

reference_spacy_tokens: " He says he 's having trouble getting married , " says Stephanopoulos , correcting Donaldson 's deviation from the prescribed fudge phrase of the day . ( Today , of course , the President 's defenders claim that Clinton admitted infidelity within sixty minutes and that the fully - informed voters simply did n't care . )


fn_spacy_tokens_for_baseline: With a premonition of his fate he had refused to take me with him .

source_bert_toks: with a prem ##oni ##tion of his fate he had refused to take me with him .

reference_raw: He said he wouldn't take me with him on the premonition of his fate.

reference_spacy_tokens: He said he would n't take me with him on the premonition of his fate .


fn_spacy_tokens_for_baseline: The rim of my hat , while effectually shading my eyes , did not obstruct my vision , and inch by inch I scanned every bit of the jungle within my range of view .

source_bert_toks: the rim of my hat , while effect ##ually sha ##ding my eyes , did not ob ##st ##ru ##ct my vision , and inch by inch i scanned every bit of the jungle within my range of view .

reference_raw: While effectively shielding my eyes, the edge of my hat did not block my vision, and inch by inch I scanned every part of the jungle in sight.

reference_spacy_tokens: While effectively shielding my eyes , the edge of my hat did not block my vision , and inch by inch I scanned every part of the jungle in sight .


fn_spacy_tokens_for_baseline: Left , the exterior of The Pen and Parchment , Stratford -upon - Avon : Georgian windows masked by large blinds on the left , with what remains of the Georgian barn on the right .

source_bert_toks: left , the exterior of the pen and parchment , stratford - upon - avon : georgian windows masked by large blinds on the left , with what remains of the georgian barn on the right .

reference_raw: Left, outside Pen and Parchment, Stratford -upon-Avon: Georgian windows covered with large blinds on the left, with what was left of the Georgian barn on the right.

reference_spacy_tokens: Left , outside Pen and Parchment , Stratford -upon - Avon : Georgian windows covered with large blinds on the left , with what was left of the Georgian barn on the right .


fn_spacy_tokens_for_baseline: Where the victim was under the age of consent , the prosecution would frequently charge the defendant with buggery or indecent assault to avoid the burden of proving lack of consent .

source_bert_toks: where the victim was under the age of consent , the prosecution would frequently charge the defendant with bug ##ger ##y or ind ##ece ##nt assault to avoid the burden of proving lack of consent .

reference_raw: If the victim was under the age of consent, the prosecution would often accuse the defendant of fraudulent or indignant attack in order to avoid the burden of proof of lack of consent.

reference_spacy_tokens: If the victim was under the age of consent , the prosecution would often accuse the defendant of fraudulent or indignant attack in order to avoid the burden of proof of lack of consent .


fn_spacy_tokens_for_baseline: In spring 1991 the biennial Scottish Young People 's Survey will contact a representative sample of young people in Scotland who completed their last compulsory school year in 1990 .

source_bert_toks: in spring 1991 the biennial scottish young people ' s survey will contact a representative sample of young people in scotland who completed their last compulsory school year in 1990 .

reference_raw: In the spring of 1991, the two-year Scottish Youth Survey will contact a representative sample of young people from Scotland who completed their last compulsory school year in 1990.

reference_spacy_tokens: In the spring of 1991 , the two - year Scottish Youth Survey will contact a representative sample of young people from Scotland who completed their last compulsory school year in 1990 .


fn_spacy_tokens_for_baseline: She did her best to make light of it , describing in detail the dinner they had eaten , and only hesitated a little when it came to the stroll along the promenade .

source_bert_toks: she did her best to make light of it , describing in detail the dinner they had eaten , and only hesitated a little when it came to the stroll along the promenade .

reference_raw: She did her best to make it light, to describe in detail the dinner they had eaten, and hesitated only a little when it came to walking along the promenade.

reference_spacy_tokens: She did her best to make it light , to describe in detail the dinner they had eaten , and hesitated only a little when it came to walking along the promenade .


fn_spacy_tokens_for_baseline: The two countries decided to advance cooperation in the areas of bioterrorism , aviation security , biometrics , cyber - security and terrorism , WMD - terrorism , terrorist finance and money laundering and violent extremism , a release issued by the Embassy of India said .

source_bert_toks: the two countries decided to advance cooperation in the areas of bio ##ter ##ror ##ism , aviation security , bio ##metric ##s , cyber - security and terrorism , w ##md - terrorism , terrorist finance and money laundering and violent ex ##tre ##mism , a release issued by the embassy of india said .

reference_raw: Both countries decided to advance cooperation in the fields of bioterrorism, aviation security, biometrics, cyber security and terrorism, weapons of mass destruction, terrorism, terrorist financing, money laundering and violent extremism.

reference_spacy_tokens: Both countries decided to advance cooperation in the fields of bioterrorism , aviation security , biometrics , cyber security and terrorism , weapons of mass destruction , terrorism , terrorist financing , money laundering and violent extremism .


fn_spacy_tokens_for_baseline: It is a fact that the issues and situations of conflict which most unsettle , pressurise and perplex us have their roots deep within our inner selves .

source_bert_toks: it is a fact that the issues and situations of conflict which most un ##sett ##le , press ##uri ##se and per ##plex us have their roots deep within our inner se ##lves .

reference_raw: It is true that the problems and situations of conflict that most disturb us, pressurize us, and confuse us have their roots deep in our inner selves.

reference_spacy_tokens: It is true that the problems and situations of conflict that most disturb us , pressurize us , and confuse us have their roots deep in our inner selves .


fn_spacy_tokens_for_baseline: Within a few days he was a pitiful sight , white - faced with huge puffy red - rimmed eyes , his thin hair plastered to his head with sweat and the comfortable roundness of his baby tummy melted away .

source_bert_toks: within a few days he was a pit ##iful sight , white - faced with huge puff ##y red - rim ##med eyes , his thin hair plastered to his head with sweat and the comfortable round ##ness of his baby tu ##mmy melted away .

reference_raw: In a few days he was a pitiful sight, white-faced with huge, swollen red-rimmed eyes, his thin hair covered with sweat, and the comfortable roundness of his child's belly melted away.

reference_spacy_tokens: In a few days he was a pitiful sight , white - faced with huge , swollen red - rimmed eyes , his thin hair covered with sweat , and the comfortable roundness of his child 's belly melted away .


fn_spacy_tokens_for_baseline: Letterman has filled his suite with striking vases of flowers .

source_bert_toks: letterman has filled his suite with striking vase ##s of flowers .

reference_raw: Letterman refilled his room with striking vases of flowers.

reference_spacy_tokens: Letterman refilled his room with striking vases of flowers .


fn_spacy_tokens_for_baseline: According to an intelligence report , cited by the Washington Times on 30 October 1997 , China completed construction in June 1997 of a dual - use plant in Iran for making glass - lined equipment used in producing chemical weapons .

source_bert_toks: according to an intelligence report , cited by the washington times on 30 october 1997 , china completed construction in june 1997 of a dual - use plant in iran for making glass - lined equipment used in producing chemical weapons .

reference_raw: According to a report from the Washington Times on 30 October 1997, China completed the construction of a dual-use facility in Iran for the manufacture of glass-lined equipment used in the manufacture of chemical weapons in June 1997.

reference_spacy_tokens: According to a report from the Washington Times on 30 October 1997 , China completed the construction of a dual - use facility in Iran for the manufacture of glass - lined equipment used in the manufacture of chemical weapons in June 1997 .


fn_spacy_tokens_for_baseline: " It was just one of those things that come off once in a blue moon , " Australian international Mori said Thursday .

source_bert_toks: " it was just one of those things that come off once in a blue moon , " australian international mori said thursday .

reference_raw: "It's just one of those things that pops up once in a blue moon," the Australian International Mori said on Thursday.

reference_spacy_tokens: " It 's just one of those things that pops up once in a blue moon , " the Australian International Mori said on Thursday .


fn_spacy_tokens_for_baseline: Their diligent enforcement of the Government 's industrial laws has helped to transform the role of the trade unions ; their role as guarantors of public order has led them into bitter conflict with pickets and demonstrators .

source_bert_toks: their dil ##igen ##t enforcement of the government ' s industrial laws has helped to transform the role of the trade unions ; their role as gu ##aran ##tors of public order has led them into bitter conflict with picket ##s and demonstrators .

reference_raw: Their careful enforcement of government industrial law has helped to change the role of trade unions; their role as guarantors of public order has led them to a bitter conflict with patrols and protestors.

reference_spacy_tokens: Their careful enforcement of government industrial law has helped to change the role of trade unions ; their role as guarantors of public order has led them to a bitter conflict with patrols and protestors .


fn_spacy_tokens_for_baseline: The Iraqi government has agreed to let U.S. Rep. Tony Hall visit the country next week to assess a humanitarian crisis that has festered since the Gulf War of 1990 , Hall 's office said Monday .

source_bert_toks: the iraqi government has agreed to let u . s . rep . tony hall visit the country next week to assess a humanitarian crisis that has fest ##ered since the gulf war of 1990 , hall ' s office said monday .

reference_raw: The Iraqi government has agreed to allow U.S. Deputy Tony Hall to visit the country next week to assess the humanitarian emergency that has been spreading since the Gulf War of 1990, according to Hall's office on Monday.

reference_spacy_tokens: The Iraqi government has agreed to allow U.S. Deputy Tony Hall to visit the country next week to assess the humanitarian emergency that has been spreading since the Gulf War of 1990 , according to Hall 's office on Monday .


fn_spacy_tokens_for_baseline: Viewed in this light a meticulous observance of these laws could inspire confidence in God .

source_bert_toks: viewed in this light a met ##ic ##ulous ob ##ser ##vance of these laws could inspire confidence in god .

reference_raw: When viewed in this light, careful compliance with these laws could inspire trust in God.

reference_spacy_tokens: When viewed in this light , careful compliance with these laws could inspire trust in God .


fn_spacy_tokens_for_baseline: Critical acclaim at the 1862 international exhibition , and reviews in the leading art and photographic journals , encouraged sales of his photographs throughout Britain .

source_bert_toks: critical acclaim at the 1862 international exhibition , and reviews in the leading art and photographic journals , encouraged sales of his photographs throughout britain .

reference_raw: Critical recognition at the International Exhibition of 1862 and reviews in leading art and photographic journals encouraged the sale of his photographs throughout the United Kingdom.

reference_spacy_tokens: Critical recognition at the International Exhibition of 1862 and reviews in leading art and photographic journals encouraged the sale of his photographs throughout the United Kingdom .


fn_spacy_tokens_for_baseline: Well now , I had a complaint about you this morning .

source_bert_toks: well now , i had a complaint about you this morning .

reference_raw: I complained about you this morning.

reference_spacy_tokens: I complained about you this morning .


fn_spacy_tokens_for_baseline: The pungent smell gives the impression of a powerful cleaning agent .

source_bert_toks: the pun ##gent smell gives the impression of a powerful cleaning agent .

reference_raw: The strong smell gives the impression of a strong cleaning agent.

reference_spacy_tokens: The strong smell gives the impression of a strong cleaning agent .


fn_spacy_tokens_for_baseline: ' You and I are going to be strong against temptation .

source_bert_toks: ' you and i are going to be strong against temptation .

reference_raw: 'You and I will be powerful against temptation.

reference_spacy_tokens: ' You and I will be powerful against temptation .


fn_spacy_tokens_for_baseline: The cicadas rasped in the surrounding pines , the heat hammered down outside the cool arches .

source_bert_toks: the ci ##ca ##das rasped in the surrounding pines , the heat hammered down outside the cool arches .

reference_raw: The cicadas rustled in the pines around them, the heat hammered down in front of the cold arcs.

reference_spacy_tokens: The cicadas rustled in the pines around them , the heat hammered down in front of the cold arcs .


fn_spacy_tokens_for_baseline: You will see flour being milled here just as it was in Captain Cook 's day .

source_bert_toks: you will see flour being mill ##ed here just as it was in captain cook ' s day .

reference_raw: You'll see that the flour is minced here, just like Captain Cook's day.

reference_spacy_tokens: You 'll see that the flour is minced here , just like Captain Cook 's day .


fn_spacy_tokens_for_baseline: Brian Wilson , the former Beach Boy who ingested Grade A drugs at the same rate his fellow Californians gulped down vitamins has brought out his autobiography .

source_bert_toks: brian wilson , the former beach boy who ing ##ested grade a drugs at the same rate his fellow california ##ns gulped down vitamin ##s has brought out his autobiography .

reference_raw: Brian Wilson, an ex-Beach Boy who swallowed Grade A drugs at the same rate as his fellow Californians swallowed vitamins, produced his autobiography.

reference_spacy_tokens: Brian Wilson , an ex - Beach Boy who swallowed Grade A drugs at the same rate as his fellow Californians swallowed vitamins , produced his autobiography .


fn_spacy_tokens_for_baseline: A French court freezes the 550 million - franc payment that the International Chamber of Commerce ordered Framatome to pay Iran in 1/91 .

source_bert_toks: a french court freeze ##s the 550 million - fran ##c payment that the international chamber of commerce ordered fra ##mat ##ome to pay iran in 1 / 91 .

reference_raw: The French court has suspended a payment of 550 million - francs, which was ordered by the International Chamber of Commerce to pay Iran in 1/91.

reference_spacy_tokens: The French court has suspended a payment of 550 million - francs , which was ordered by the International Chamber of Commerce to pay Iran in 1/91 .


fn_spacy_tokens_for_baseline: More than 100 Japanese walked across the infamous Death Railway bridge to mark the end of World War II and seek atonement for the crimes of their countrymen .

source_bert_toks: more than 100 japanese walked across the infamous death railway bridge to mark the end of world war ii and seek at ##one ##ment for the crimes of their country ##men .

reference_raw: More than a hundred Japanese crossed the notorious Death Railroad Bridge to mark the end of the Second World War and seek compensation for the crimes of their countrymen.

reference_spacy_tokens: More than a hundred Japanese crossed the notorious Death Railroad Bridge to mark the end of the Second World War and seek compensation for the crimes of their countrymen .


fn_spacy_tokens_for_baseline: Undecided and still bent over towards her he became aware of the patter of running feet , approaching fast .

source_bert_toks: und ##ec ##ided and still bent over towards her he became aware of the pat ##ter of running feet , approaching fast .

reference_raw: Undecided, still bent toward her, he became aware of the thump of running feet, coming fast.

reference_spacy_tokens: Undecided , still bent toward her , he became aware of the thump of running feet , coming fast .


fn_spacy_tokens_for_baseline: He was full of an incandescence that ' no pails of cold water ' could put out .

source_bert_toks: he was full of an inca ##nde ##sc ##ence that ' no pa ##ils of cold water ' could put out .

reference_raw: It was filled with a fire that "no buckets of cold water" could extinguish.

reference_spacy_tokens: It was filled with a fire that " no buckets of cold water " could extinguish .


fn_spacy_tokens_for_baseline: He escaped with gardening equipment worth £ 300 including three pairs of green wellies .

source_bert_toks: he escaped with gardening equipment worth £3 ##00 including three pairs of green well ##ies .

reference_raw: He ran off with three hundred pounds of gardening equipment, including three pairs of green wells.

reference_spacy_tokens: He ran off with three hundred pounds of gardening equipment , including three pairs of green wells .


fn_spacy_tokens_for_baseline: China , North Korea , and , to a certain extent , Syria emerged as major suppliers of conventional arms to Iran .

source_bert_toks: china , north korea , and , to a certain extent , syria emerged as major suppliers of conventional arms to iran .

reference_raw: China, North Korea, and, to some extent, Syria have become the main suppliers of conventional weapons to Iran.

reference_spacy_tokens: China , North Korea , and , to some extent , Syria have become the main suppliers of conventional weapons to Iran .


fn_spacy_tokens_for_baseline: Too obviously he had lunched well on a dish laced with garlic , and he kept twirling his dark moustache , of which he seemed inordinately proud , while in halting French I explained my purpose .

source_bert_toks: too obviously he had lunch ##ed well on a dish laced with garlic , and he kept t ##wi ##rling his dark mo ##ust ##ache , of which he seemed in ##ord ##inate ##ly proud , while in halt ##ing french i explained my purpose .

reference_raw: It was too obvious that he had eaten well on a plate laced with garlic, and that he was still twisting his dark mustache, which he seemed uncharacteristically proud of, and when I stopped French, I explained my purpose.

reference_spacy_tokens: It was too obvious that he had eaten well on a plate laced with garlic , and that he was still twisting his dark mustache , which he seemed uncharacteristically proud of , and when I stopped French , I explained my purpose .


fn_spacy_tokens_for_baseline: By 1980 he was working in Central America , where he befriended Gen Noriega 's predecessor , Omar Torrijos .

source_bert_toks: by 1980 he was working in central america , where he befriended gen nor ##ieg ##a ' s predecessor , omar tor ##ri ##jos .

reference_raw: In 1980 he worked in Central America, where he became friends with Gen Noriega's predecessor, Omar Torrijos.

reference_spacy_tokens: In 1980 he worked in Central America , where he became friends with Gen Noriega 's predecessor , Omar Torrijos .


fn_spacy_tokens_for_baseline: All marched , or rather advanced in small steps , zigzagging as if intoxicated .

source_bert_toks: all marched , or rather advanced in small steps , z ##ig ##za ##gging as if into ##xi ##cated .

reference_raw: They were all marching, or rather moving in small steps, swinging as if drunk.

reference_spacy_tokens: They were all marching , or rather moving in small steps , swinging as if drunk .


fn_spacy_tokens_for_baseline: It was the whistle from the gloom behind him that alerted Chant to the fact that his escape had not gone unnoticed .

source_bert_toks: it was the whistle from the gloom behind him that alerted chant to the fact that his escape had not gone unnoticed .

reference_raw: It was the whine of the darkness behind him that warned Chant that his escape had not gone unnoticed.

reference_spacy_tokens: It was the whine of the darkness behind him that warned Chant that his escape had not gone unnoticed .


fn_spacy_tokens_for_baseline: Caressed by warm waters , 770 miles 1,240 km of golden sand ring the island .

source_bert_toks: caressed by warm waters , 770 miles 1 , 240 km of golden sand ring the island .

reference_raw: Wrapped in warm water, 770 miles of golden sand circles the island.

reference_spacy_tokens: Wrapped in warm water , 770 miles of golden sand circles the island .


fn_spacy_tokens_for_baseline: I hope Patti can help you soon .

source_bert_toks: i hope patti can help you soon .

reference_raw: Hopefully Patti will be able to help you soon.

reference_spacy_tokens: Hopefully Patti will be able to help you soon .


fn_spacy_tokens_for_baseline: During the spring and autumn festivals , when people traditionally seek out the hilltops , the throngs are so large you would be better advised to try another time .

source_bert_toks: during the spring and autumn festivals , when people traditionally seek out the hilltop ##s , the th ##rong ##s are so large you would be better advised to try another time .

reference_raw: During the spring and autumn festivals, when people traditionally look for hilltops, the crowds are so big that you'd better try again.

reference_spacy_tokens: During the spring and autumn festivals , when people traditionally look for hilltops , the crowds are so big that you 'd better try again .


fn_spacy_tokens_for_baseline: Clicking the heels of his glossy boots once more , he crammed the cap with its oversized peak hastily on his head and made for the door .

source_bert_toks: clicking the heels of his glossy boots once more , he cr ##ammed the cap with its oversized peak hastily on his head and made for the door .

reference_raw: He clasped the heels of his shiny boots again, hastily stuffed the cap with its oversized peak on his head, and headed for the door.

reference_spacy_tokens: He clasped the heels of his shiny boots again , hastily stuffed the cap with its oversized peak on his head , and headed for the door .


fn_spacy_tokens_for_baseline: The Senate chamber was locked down , television cameras shut off , so law makers could go into secret session to debate .

source_bert_toks: the senate chamber was locked down , television cameras shut off , so law makers could go into secret session to debate .

reference_raw: The Senate Chamber has been shut down, the TV cameras have been turned off, so the legislators can go to a secret meeting to discuss it.

reference_spacy_tokens: The Senate Chamber has been shut down , the TV cameras have been turned off , so the legislators can go to a secret meeting to discuss it .


fn_spacy_tokens_for_baseline: Although the military said insurgent fire is presumed to have caused the downing of the helicopter , it also said the precise cause of the crash remains under investigation .

source_bert_toks: although the military said ins ##urgent fire is presumed to have caused the downing of the helicopter , it also said the precise cause of the crash remains under investigation .

reference_raw: Although the military said that the rebel fire was believed to have caused the helicopter to fall, it also stated that the exact cause of the accident was still being investigated.

reference_spacy_tokens: Although the military said that the rebel fire was believed to have caused the helicopter to fall , it also stated that the exact cause of the accident was still being investigated .


fn_spacy_tokens_for_baseline: ' I 've got crackers .

source_bert_toks: ' i ' ve got crack ##ers .

reference_raw: 'I have biscuits.

reference_spacy_tokens: ' I have biscuits .


fn_spacy_tokens_for_baseline: The electronic cheep from the alarm chiselled into his skull at precisely a quarter to seven .

source_bert_toks: the electronic che ##ep from the alarm chi ##selle ##d into his skull at precisely a quarter to seven .

reference_raw: The electronic chisel from the alarm chiseled into his skull at exactly one-quarter to seven.

reference_spacy_tokens: The electronic chisel from the alarm chiseled into his skull at exactly one - quarter to seven .


fn_spacy_tokens_for_baseline: Basque food is traditionally based more on sauces than stews , although you should look out for marmitako , tunny fish stewed with tomatoes , potatoes , green peppers and bread .

source_bert_toks: basque food is traditionally based more on sauce ##s than stew ##s , although you should look out for mar ##mit ##ako , tun ##ny fish stew ##ed with tomatoes , potatoes , green peppers and bread .

reference_raw: Traditionally, basque food is based on sauces rather than stews, but you should keep an eye on marmitako, sunny fish roasted with tomatoes, potatoes, green peppers and bread.

reference_spacy_tokens: Traditionally , basque food is based on sauces rather than stews , but you should keep an eye on marmitako , sunny fish roasted with tomatoes , potatoes , green peppers and bread .


fn_spacy_tokens_for_baseline: Conyers evidently formed a bridge between the Middleham affinity and its new lord : the first men whom Gloucester retained there were virtu ally all kinsmen of Sir John .

source_bert_toks: con ##yer ##s evidently formed a bridge between the middle ##ham affinity and its new lord : the first men whom gloucester retained there were vi ##rt ##u ally all kin ##sm ##en of sir john .

reference_raw: The Conyers seemed to form the bridge between Middleham's affinity and his new master: the first men Gloucester had left behind were virtu allies of Sir John's kin.

reference_spacy_tokens: The Conyers seemed to form the bridge between Middleham 's affinity and his new master : the first men Gloucester had left behind were virtu allies of Sir John 's kin .


fn_spacy_tokens_for_baseline: Old buildings are being recycled ; for example , the 17th - century Royal Hospital now holds the Museum of Modern Art .

source_bert_toks: old buildings are being recycled ; for example , the 17th - century royal hospital now holds the museum of modern art .

reference_raw: Old buildings are being recycled; for instance, the 17th-century Royal Hospital now owns a museum of modern art.

reference_spacy_tokens: Old buildings are being recycled ; for instance , the 17th - century Royal Hospital now owns a museum of modern art .


fn_spacy_tokens_for_baseline: Emily Grenfell clasped her hands together , sitting on the edge of her seat gazing through the small window of the coach as it rumbled along Mumbles Road in the fashionable area of Swansea .

source_bert_toks: emily gr ##en ##fell clasped her hands together , sitting on the edge of her seat gazing through the small window of the coach as it rumbled along mum ##bles road in the fashionable area of swansea .

reference_raw: Emily Grenfell clasped her hands together and sat on the edge of her seat, staring out the small window of the carriage as it thundered along Mumbles Road in the fashionable area of Swansea.

reference_spacy_tokens: Emily Grenfell clasped her hands together and sat on the edge of her seat , staring out the small window of the carriage as it thundered along Mumbles Road in the fashionable area of Swansea .


fn_spacy_tokens_for_baseline: The scribe was dressed in the white garb of mourning , and his lined face looked worn .

source_bert_toks: the scribe was dressed in the white ga ##rb of mourning , and his lined face looked worn .

reference_raw: The scribe was dressed in a white mourning gown, and his wrinkled face looked worn.

reference_spacy_tokens: The scribe was dressed in a white mourning gown , and his wrinkled face looked worn .


fn_spacy_tokens_for_baseline: The cave - man got fed - up with walking

source_bert_toks: the cave - man got fed - up with walking

reference_raw: The caveman was tired of walking.

reference_spacy_tokens: The caveman was tired of walking .


fn_spacy_tokens_for_baseline: The fact is that old Uncle Dan , who lives with me , is a bit queer in the head , and I 'm afraid he talked a lot of nonsense .

source_bert_toks: the fact is that old uncle dan , who lives with me , is a bit queer in the head , and i ' m afraid he talked a lot of nonsense .

reference_raw: The truth is, old Uncle Dan, who lives with me, he's a little weird, and I'm afraid he's been saying a lot of nonsense.

reference_spacy_tokens: The truth is , old Uncle Dan , who lives with me , he 's a little weird , and I 'm afraid he 's been saying a lot of nonsense .


fn_spacy_tokens_for_baseline: He passed the church of St. Giles , turned into another winding street and almost walked into the two figures standing there .

source_bert_toks: he passed the church of st . giles , turned into another winding street and almost walked into the two figures standing there .

reference_raw: He passed St. Giles' church, turned into another twisting street, and almost walked into the two figures standing there.

reference_spacy_tokens: He passed St. Giles ' church , turned into another twisting street , and almost walked into the two figures standing there .


fn_spacy_tokens_for_baseline: 1- Preserving the unity of AL QAEDA is an important and legitimate goal , which occurs by fearing God in private as well as in public . ( Surat 65 , 5 ) .

source_bert_toks: 1 - preserving the unity of al qaeda is an important and legitimate goal , which occurs by fearing god in private as well as in public . ( sur ##at 65 , 5 ) .

reference_raw: 1- Maintaining the unity of AL QAEDA is a significant and legitimate objective that is pursued by fear of God both in private and in public (Surat 65, 5).

reference_spacy_tokens: 1- Maintaining the unity of AL QAEDA is a significant and legitimate objective that is pursued by fear of God both in private and in public ( Surat 65 , 5 ) .


fn_spacy_tokens_for_baseline: To advocates of the ' resolute approach ' , crime is simply a choice to do wrong ; it is never the squalid last gasp of the outsider .

source_bert_toks: to advocates of the ' res ##ol ##ute approach ' , crime is simply a choice to do wrong ; it is never the sq ##ual ##id last gasp of the outsider .

reference_raw: For "resolute approach" advocates, crime is simply an option to make a mistake; it is never the last squalid gasp of an outsider.

reference_spacy_tokens: For " resolute approach " advocates , crime is simply an option to make a mistake ; it is never the last squalid gasp of an outsider .


fn_spacy_tokens_for_baseline: The state was concerned with the alleviation of poverty but its direct participation in welfare programmes was small ; most of this was left to private charity .

source_bert_toks: the state was concerned with the all ##ev ##iation of poverty but its direct participation in welfare programmes was small ; most of this was left to private charity .

reference_raw: The state was concerned about poverty reduction, but its direct participation in social programs was small; most of it was left to private charity.

reference_spacy_tokens: The state was concerned about poverty reduction , but its direct participation in social programs was small ; most of it was left to private charity .


fn_spacy_tokens_for_baseline: But with alcohol - related crashes claiming over 17 , 000 lives a year -- accounting for 41 percent of all traffic fatalities-- 16 states have dropped that level to 0 . 08 percent .

source_bert_toks: but with alcohol - related crashes claiming over 17 , 000 lives a year - - accounting for 41 percent of all traffic fatalities - - 16 states have dropped that level to 0 . 08 percent .

reference_raw: But with alcohol-related accidents claiming more than 17,000 lifetimes per year, which accounts for 41% of all traffic deaths, 16 countries have dropped this level to 0.08%.

reference_spacy_tokens: But with alcohol - related accidents claiming more than 17,000 lifetimes per year , which accounts for 41 % of all traffic deaths , 16 countries have dropped this level to 0.08 % .


fn_spacy_tokens_for_baseline: Blanche looked round her at the wallpapered walls and the flounced pink curtains and said , ' How very nice .

source_bert_toks: blanche looked round her at the wall ##paper ##ed walls and the fl ##oun ##ced pink curtains and said , ' how very nice .

reference_raw: Blanche looked around at the wall-papered walls and fluttered pink curtains and said, "That's very nice.

reference_spacy_tokens: Blanche looked around at the wall - papered walls and fluttered pink curtains and said , " That 's very nice .


fn_spacy_tokens_for_baseline: While Janine and John cooked supper , he led us on a trek through the woods and around the two - mile meadow .

source_bert_toks: while jan ##ine and john cooked supper , he led us on a trek through the woods and around the two - mile meadow .

reference_raw: While Janine and John were making dinner, he led us through the forest and around a two-mile meadow.

reference_spacy_tokens: While Janine and John were making dinner , he led us through the forest and around a two - mile meadow .


fn_spacy_tokens_for_baseline: The peasants ' ' redemption dues ' were calculated not on the basis of the land which came into their possession but on the basis of the rents and services that they owed under serfdom .

source_bert_toks: the peasants ' ' redemption due ##s ' were calculated not on the basis of the land which came into their possession but on the basis of the rents and services that they owed under ser ##f ##dom .

reference_raw: The payment dues of the farmers were calculated not on the basis of the land they had acquired, but on the basis of the rents and services they owed under slavery.

reference_spacy_tokens: The payment dues of the farmers were calculated not on the basis of the land they had acquired , but on the basis of the rents and services they owed under slavery .


fn_spacy_tokens_for_baseline: He was wearing a shiny black suit and white - and - black golfing shoes , but he was shirtless and sockless .

source_bert_toks: he was wearing a shiny black suit and white - and - black golf ##ing shoes , but he was shirt ##less and sock ##less .

reference_raw: He wore a shiny black suit and white and black golf boots, but he had no shirt and no socks.

reference_spacy_tokens: He wore a shiny black suit and white and black golf boots , but he had no shirt and no socks .


fn_spacy_tokens_for_baseline: A low - flying German plane could hop over a hangar and massacre a squad with one sudden burst .

source_bert_toks: a low - flying german plane could hop over a hangar and massacre a squad with one sudden burst .

reference_raw: A low-flying German aircraft could jump over the hangar and slaughter the squad in one sudden burst.

reference_spacy_tokens: A low - flying German aircraft could jump over the hangar and slaughter the squad in one sudden burst .


fn_spacy_tokens_for_baseline: Contrast the situation which pertains when a group of men celebrate the eucharist together , as has often been the case for example in a monastic setting .

source_bert_toks: contrast the situation which per ##tain ##s when a group of men celebrate the eu ##cha ##rist together , as has often been the case for example in a monastic setting .

reference_raw: In contrast to the situation in which a group of men celebrates eucharists together, as is often the case in a monastic environment.

reference_spacy_tokens: In contrast to the situation in which a group of men celebrates eucharists together , as is often the case in a monastic environment .


fn_spacy_tokens_for_baseline: But it remained to be seen whether the ambitious plan would withstand the impact of possible future austerity measures .

source_bert_toks: but it remained to be seen whether the ambitious plan would withstand the impact of possible future aus ##ter ##ity measures .

reference_raw: However, it remains to be seen whether the ambitious plan will withstand the impact of possible future savings measures.

reference_spacy_tokens: However , it remains to be seen whether the ambitious plan will withstand the impact of possible future savings measures .


fn_spacy_tokens_for_baseline: But he was ' bogus , a sham , an imposter ' and was totally unqualified for his job as a senior house doctor , the prosecution claimed .

source_bert_toks: but he was ' bog ##us , a sham , an imp ##ost ##er ' and was totally un ##qual ##ified for his job as a senior house doctor , the prosecution claimed .

reference_raw: But he was "a fake, a fraud, a fraud," and he was completely unqualified for his job as a high-ranking house doctor, the prosecution said.

reference_spacy_tokens: But he was " a fake , a fraud , a fraud , " and he was completely unqualified for his job as a high - ranking house doctor , the prosecution said .


fn_spacy_tokens_for_baseline: Most parents eschew diplomacy completely when dealing with their children , and opt for the Jimmy Cagney approach .

source_bert_toks: most parents es ##che ##w diplomacy completely when dealing with their children , and opt for the jimmy ca ##gne ##y approach .

reference_raw: Most parents completely escalate diplomacy when dealing with their children and choose Jimmy Cagney's attitude.

reference_spacy_tokens: Most parents completely escalate diplomacy when dealing with their children and choose Jimmy Cagney 's attitude .


fn_spacy_tokens_for_baseline: It was held that the seller made a misrepresentation .

source_bert_toks: it was held that the seller made a mis ##re ##pres ##entation .

reference_raw: The seller was found to have made a distortion.

reference_spacy_tokens: The seller was found to have made a distortion .


fn_spacy_tokens_for_baseline: Something erupted with a soft boom , like a distant starting - gun , and the aircraft crumpled .

source_bert_toks: something erupted with a soft boom , like a distant starting - gun , and the aircraft crumpled .

reference_raw: Something exploded with a soft thump, like a distant launcher, and the plane collapsed.

reference_spacy_tokens: Something exploded with a soft thump , like a distant launcher , and the plane collapsed .


fn_spacy_tokens_for_baseline: Moreover , the thorny question of additionality will have to be solved .

source_bert_toks: moreover , the thorn ##y question of additional ##ity will have to be solved .

reference_raw: In addition, the thorn question of additionality will need to be addressed.

reference_spacy_tokens: In addition , the thorn question of additionality will need to be addressed .


fn_spacy_tokens_for_baseline: It was not every night , she reflected , that she dined with a secret agent .

source_bert_toks: it was not every night , she reflected , that she din ##ed with a secret agent .

reference_raw: She thought it wasn't every night she had dinner with a secret agent.

reference_spacy_tokens: She thought it was n't every night she had dinner with a secret agent .


fn_spacy_tokens_for_baseline: How should we counsel young people to respond when a parent seems unreasonable in a particular demand or request ?

source_bert_toks: how should we counsel young people to respond when a parent seems unreasonable in a particular demand or request ?

reference_raw: How should we advise young people to respond when a parent appears to be disproportionate to a particular request or request?

reference_spacy_tokens: How should we advise young people to respond when a parent appears to be disproportionate to a particular request or request ?


fn_spacy_tokens_for_baseline: ' We were n't worried when we set out .

source_bert_toks: ' we weren ' t worried when we set out .

reference_raw: 'When we left, we weren't afraid.

reference_spacy_tokens: ' When we left , we were n't afraid .


fn_spacy_tokens_for_baseline: Evidence is given on oath and witnesses are subject to cross - examination .

source_bert_toks: evidence is given on oath and witnesses are subject to cross - examination .

reference_raw: The evidence is given on oath and the witnesses are cross-examined.

reference_spacy_tokens: The evidence is given on oath and the witnesses are cross - examined .


fn_spacy_tokens_for_baseline: He rapped the desk .

source_bert_toks: he rap ##ped the desk .

reference_raw: He knocked on the table.

reference_spacy_tokens: He knocked on the table .


fn_spacy_tokens_for_baseline: He escaped as you have just described .

source_bert_toks: he escaped as you have just described .

reference_raw: He ran away, as you just told him.

reference_spacy_tokens: He ran away , as you just told him .


fn_spacy_tokens_for_baseline: ' Look at that expression -- it 's Uncle Harold ! ' they 'll say or ' She 's the spitting image of her mum ' .

source_bert_toks: ' look at that expression - - it ' s uncle harold ! ' they ' ll say or ' she ' s the spitting image of her mum ' .

reference_raw: 'Look at the look - it's Uncle Harold!' they say, or 'She's a splattering picture of her mother.'

reference_spacy_tokens: ' Look at the look - it 's Uncle Harold ! ' they say , or ' She 's a splattering picture of her mother . '


fn_spacy_tokens_for_baseline: She scolded incessantly but never beat her children .

source_bert_toks: she sc ##old ##ed inc ##ess ##antly but never beat her children .

reference_raw: She kept scoffing, but she never beat her kids.

reference_spacy_tokens: She kept scoffing , but she never beat her kids .


fn_spacy_tokens_for_baseline: Demonstrations in support of this move had been organized by religious parties in Islamabad , and it was construed as an attempt by the increasingly fragile ruling coalition to win backing from Islamic parties .

source_bert_toks: demonstrations in support of this move had been organized by religious parties in islamabad , and it was con ##st ##rued as an attempt by the increasingly fragile ruling coalition to win backing from islamic parties .

reference_raw: Religious parties in Islamabad organised demonstrations in support of this movement, and this was interpreted as an attempt by an increasingly fragile ruling coalition to gain support from Islamic parties.

reference_spacy_tokens: Religious parties in Islamabad organised demonstrations in support of this movement , and this was interpreted as an attempt by an increasingly fragile ruling coalition to gain support from Islamic parties .


fn_spacy_tokens_for_baseline: These voluble oaths echoing across the river have burst upon the ears of the Castle 's occupants , enjoying a little peace and quiet while sitting on the terrace in the afternoon sun , and sparks have flown .

source_bert_toks: these vol ##ub ##le oath ##s echoing across the river have burst upon the ears of the castle ' s occupants , enjoying a little peace and quiet while sitting on the terrace in the afternoon sun , and sparks have flown .

reference_raw: Those voluble oaths that echoed across the river burst into the ears of the people of the castle, enjoying some peace and quiet as they sat on the terrace in the afternoon sun, and sparks flew.

reference_spacy_tokens: Those voluble oaths that echoed across the river burst into the ears of the people of the castle , enjoying some peace and quiet as they sat on the terrace in the afternoon sun , and sparks flew .


fn_spacy_tokens_for_baseline: A few months ago , Carl Newton and I wrote a letter asking you to consider a financial contribution to graduate Endodontics at Indiana University .

source_bert_toks: a few months ago , carl newton and i wrote a letter asking you to consider a financial contribution to graduate end ##odon ##tics at indiana university .

reference_raw: A few months ago, Carl Newton and I sent a letter asking you to consider a financial contribution to the University of Indiana for Endodontics.

reference_spacy_tokens: A few months ago , Carl Newton and I sent a letter asking you to consider a financial contribution to the University of Indiana for Endodontics .


fn_spacy_tokens_for_baseline: After she gained her private pilot 's licence , she was an instructor at a flying school at Biggin Hill before sitting for her commercial ticket at the age of twenty - one .

source_bert_toks: after she gained her private pilot ' s licence , she was an instructor at a flying school at big ##gin hill before sitting for her commercial ticket at the age of twenty - one .

reference_raw: When she got her private pilot's license, she was an instructor at a flying school in Biggin Hill before she sat on a commercial ticket when she was twenty-one.

reference_spacy_tokens: When she got her private pilot 's license , she was an instructor at a flying school in Biggin Hill before she sat on a commercial ticket when she was twenty - one .


fn_spacy_tokens_for_baseline: Her mouth dropped open .

source_bert_toks: her mouth dropped open .

reference_raw: She opened her mouth.

reference_spacy_tokens: She opened her mouth .


fn_spacy_tokens_for_baseline: ' Why did he quarrel with his family ?

source_bert_toks: ' why did he quarrel with his family ?

reference_raw: 'Why was he arguing with his family?

reference_spacy_tokens: ' Why was he arguing with his family ?


fn_spacy_tokens_for_baseline: He got away from the subject when I pounced upon it .

source_bert_toks: he got away from the subject when i po ##unced upon it .

reference_raw: He got away from the subject when I hit him.

reference_spacy_tokens: He got away from the subject when I hit him .


fn_spacy_tokens_for_baseline: The many shops and bars at this exceptionally pretty little resort are close to the hotel , which features a large sun terrace where drinks can be enjoyed against the backdrop of the incomparable beauty of Lake Garda .

source_bert_toks: the many shops and bars at this exceptionally pretty little resort are close to the hotel , which features a large sun terrace where drinks can be enjoyed against the backdrop of the inc ##omp ##arable beauty of lake ga ##rda .

reference_raw: Many shops and bars in this extraordinarily beautiful little resort are close to the hotel, which features a large sun terrace, where drinks can be used against the unparalleled beauty of Lake Garda.

reference_spacy_tokens: Many shops and bars in this extraordinarily beautiful little resort are close to the hotel , which features a large sun terrace , where drinks can be used against the unparalleled beauty of Lake Garda .


fn_spacy_tokens_for_baseline: It was Barney who returned to it first , dribbling cream into his coffee and watching it swirl into a spiral on the surface .

source_bert_toks: it was barney who returned to it first , dr ##ib ##bling cream into his coffee and watching it swirl into a spiral on the surface .

reference_raw: It was Barney who went back to him first, dripping cream into his coffee, and watching it swirl into a spiral on the surface.

reference_spacy_tokens: It was Barney who went back to him first , dripping cream into his coffee , and watching it swirl into a spiral on the surface .


fn_spacy_tokens_for_baseline: Above all , fidelity to the ' open justice ' principle keeps Britain free from the reproach that it permits ' secret courts ' of the kind which have been instruments of repression in so many other countries .

source_bert_toks: above all , fidelity to the ' open justice ' principle keeps britain free from the rep ##ro ##ach that it permits ' secret courts ' of the kind which have been instruments of repression in so many other countries .

reference_raw: First of all, loyalty to the principle of open justice protects Britain from the accusation that it allows secret courts of the kind that have been instruments of repression in many other countries.

reference_spacy_tokens: First of all , loyalty to the principle of open justice protects Britain from the accusation that it allows secret courts of the kind that have been instruments of repression in many other countries .


fn_spacy_tokens_for_baseline: Working through these difficult times is a challenge for all our staff who have maintained their integrity , application and cheerfulness .

source_bert_toks: working through these difficult times is a challenge for all our staff who have maintained their integrity , application and cheerful ##ness .

reference_raw: Working in these difficult times is a challenge for all of our employees who have maintained their integrity, application and cheerfulness.

reference_spacy_tokens: Working in these difficult times is a challenge for all of our employees who have maintained their integrity , application and cheerfulness .


fn_spacy_tokens_for_baseline: The clinical teacher can become knowledgeable about a particular specialty , and will be aware of the demands of the ward .

source_bert_toks: the clinical teacher can become knowledge ##able about a particular specialty , and will be aware of the demands of the ward .

reference_raw: A clinical teacher may become aware of a specific specialty and be aware of the requirements of the department.

reference_spacy_tokens: A clinical teacher may become aware of a specific specialty and be aware of the requirements of the department .


fn_spacy_tokens_for_baseline: ' But your dad was rich by the time you came along , ' said Constance , ' and mine was dead .

source_bert_toks: ' but your dad was rich by the time you came along , ' said constance , ' and mine was dead .

reference_raw: 'But when you arrived, your father was wealthy,' said Constance, 'and mine was dead.

reference_spacy_tokens: ' But when you arrived , your father was wealthy , ' said Constance , ' and mine was dead .


fn_spacy_tokens_for_baseline: President Bush has agreed to meet within 90 days with Mr. Barco , President Alan Garcia of Peru and President Jaime Paz Zamora of Bolivia to discuss the drug problem .

source_bert_toks: president bush has agreed to meet within 90 days with mr . bar ##co , president alan garcia of peru and president jaime paz za ##mora of bolivia to discuss the drug problem .

reference_raw: President Bush has agreed to meet with Mr. Barco, President Alan Garcia of Peru and President Jaime Paz Zamora of Bolivia in 90 days to discuss the issue of narcotics.

reference_spacy_tokens: President Bush has agreed to meet with Mr. Barco , President Alan Garcia of Peru and President Jaime Paz Zamora of Bolivia in 90 days to discuss the issue of narcotics .


fn_spacy_tokens_for_baseline: In the Bible , Genesis 14:18 - 20 records that Abraham visited the city of " Salem " in approximately 1800 b.c . and was blessed by the city 's ruler , Melchzedik , who offered him bread and wine .

source_bert_toks: in the bible , genesis 14 : 18 - 20 records that abraham visited the city of " salem " in approximately 1800 b . c . and was blessed by the city ' s ruler , mel ##ch ##zed ##ik , who offered him bread and wine .

reference_raw: In the Bible, Genesis 14:18 - 20 notes that Abraham visited the town of Salem in approximately 1800 B.C., and was blessed by the ruler of the city, Melchzedik, who offered him bread and wine.

reference_spacy_tokens: In the Bible , Genesis 14:18 - 20 notes that Abraham visited the town of Salem in approximately 1800 B.C. , and was blessed by the ruler of the city , Melchzedik , who offered him bread and wine .


fn_spacy_tokens_for_baseline: We are becoming a degenerate race , even in the simplest things .

source_bert_toks: we are becoming a de ##gen ##erate race , even in the simplest things .

reference_raw: We're becoming a perverted race, even in the simplest of things.

reference_spacy_tokens: We 're becoming a perverted race , even in the simplest of things .


fn_spacy_tokens_for_baseline: Now , in the age of hypalon rafts and life - jackets , ice chests and propane stoves , the trip has become a popular vacation activity .

source_bert_toks: now , in the age of h ##yp ##alo ##n raft ##s and life - jackets , ice chests and prop ##ane stove ##s , the trip has become a popular vacation activity .

reference_raw: Now, in the age of hypalon rafts and life jackets, ice boxes and propane stoves, the trip became a popular holiday activity.

reference_spacy_tokens: Now , in the age of hypalon rafts and life jackets , ice boxes and propane stoves , the trip became a popular holiday activity .


fn_spacy_tokens_for_baseline: You just kill me .

source_bert_toks: you just kill me .

reference_raw: All you have to do is shoot me.

reference_spacy_tokens: All you have to do is shoot me .


fn_spacy_tokens_for_baseline: Our Mosquito squadron had gone out to bomb one of the usual targets in western France and when they began to come back , the first crew to come into the Met Office told us the news ,

source_bert_toks: our mosquito squadron had gone out to bomb one of the usual targets in western france and when they began to come back , the first crew to come into the met office told us the news ,

reference_raw: Our Mosquito squadron went off to blow up one of the usual targets in Western France, and when they started coming back, the first crew to arrive at the Met Office told us the news:

reference_spacy_tokens: Our Mosquito squadron went off to blow up one of the usual targets in Western France , and when they started coming back , the first crew to arrive at the Met Office told us the news :


fn_spacy_tokens_for_baseline: He rubbed his nose .

source_bert_toks: he rubbed his nose .

reference_raw: He scratched his nose.

reference_spacy_tokens: He scratched his nose .


fn_spacy_tokens_for_baseline: The first burst from his machine - gun hammered through Dangerfield 's weary back and smashed his instrument panel .

source_bert_toks: the first burst from his machine - gun hammered through danger ##field ' s weary back and smashed his instrument panel .

reference_raw: The first burst of the machine gun hammered into Dangerfield's tired back and smashed the instrument panel.

reference_spacy_tokens: The first burst of the machine gun hammered into Dangerfield 's tired back and smashed the instrument panel .


fn_spacy_tokens_for_baseline: PERHAPS feeling somewhat piscine at the time the organisers of North - East Norwegian Week insisted on announcing that something fishy would mark its start at the MetroCentre .

source_bert_toks: perhaps feeling somewhat pi ##sc ##ine at the time the organise ##rs of north - east norwegian week insisted on announcing that something fish ##y would mark its start at the metro ##cent ##re .

reference_raw: PERHAPS felt a little piscine when the organizers of North-East Norway Week insisted on announcing that something fish would mark the beginning of the MetroCentre.

reference_spacy_tokens: PERHAPS felt a little piscine when the organizers of North - East Norway Week insisted on announcing that something fish would mark the beginning of the MetroCentre .


fn_spacy_tokens_for_baseline: Among the objects discovered were coats made of jaguar and cheetah skin , sea turtle shells , ivory trinkets and stuffed rare birds .

source_bert_toks: among the objects discovered were coats made of jaguar and che ##eta ##h skin , sea turtle shells , ivory tri ##nk ##ets and stuffed rare birds .

reference_raw: Among the objects found were jaguar and cheetah-skin coats, sea turtle shells, ivory trinkets, and stuffed rare birds.

reference_spacy_tokens: Among the objects found were jaguar and cheetah - skin coats , sea turtle shells , ivory trinkets , and stuffed rare birds .


fn_spacy_tokens_for_baseline: The fat undertaker had closed down the tailgate of the hearse and stood about on the gravel , twirling his keys .

source_bert_toks: the fat undertaker had closed down the tail ##gate of the hears ##e and stood about on the gravel , t ##wi ##rling his keys .

reference_raw: The fat undertaker closed the hearse's tailgate and stood on the gravel, twisting the keys.

reference_spacy_tokens: The fat undertaker closed the hearse 's tailgate and stood on the gravel , twisting the keys .


fn_spacy_tokens_for_baseline: The Dean of St Patrick 's had strolled through these streets with muddied cloak , doffing his beaver hat in salute to the fond greetings of beggar and artisan .

source_bert_toks: the dean of st patrick ' s had strolled through these streets with mud ##die ##d cloak , do ##ffin ##g his beaver hat in salute to the fond greeting ##s of beg ##gar and art ##isan .

reference_raw: The Dean of St. Patrick's walked through the streets in a muddy cloak, wearing a beaver's hat to salute the fond greetings of beggars and craftsmen.

reference_spacy_tokens: The Dean of St. Patrick 's walked through the streets in a muddy cloak , wearing a beaver 's hat to salute the fond greetings of beggars and craftsmen .


fn_spacy_tokens_for_baseline: He had a patch over one eye and wore a row of medals sewn lopsidedly to the lapels of his ragged jacket .

source_bert_toks: he had a patch over one eye and wore a row of medals se ##wn lo ##ps ##ided ##ly to the lap ##els of his ragged jacket .

reference_raw: He wore a patch over one eye and wore a row of medals stitched lopsided to the lapels of his ragged jacket.

reference_spacy_tokens: He wore a patch over one eye and wore a row of medals stitched lopsided to the lapels of his ragged jacket .


fn_spacy_tokens_for_baseline: To the north and west are the ancient sites of Ireland : Malahide Castle , the evocative hill of Tara , and the long barrows of Knowth and Newgrange .

source_bert_toks: to the north and west are the ancient sites of ireland : mala ##hide castle , the ev ##oca ##tive hill of tara , and the long barrow ##s of know ##th and new ##gra ##nge .

reference_raw: Northern and western are the ancient sites of Ireland: the castle of Malahide, Tara's evocative hill, and the long barrows of Knowth and Newgrange.

reference_spacy_tokens: Northern and western are the ancient sites of Ireland : the castle of Malahide , Tara 's evocative hill , and the long barrows of Knowth and Newgrange .


fn_spacy_tokens_for_baseline: About a second before a subject moves a part of his body , a slow negative shift in the electrical potential generated by the brain begins .

source_bert_toks: about a second before a subject moves a part of his body , a slow negative shift in the electrical potential generated by the brain begins .

reference_raw: About a second before the object moves part of the body, a slow negative change in the electrical potential generated by the brain begins.

reference_spacy_tokens: About a second before the object moves part of the body , a slow negative change in the electrical potential generated by the brain begins .


fn_spacy_tokens_for_baseline: Your father was always good to me , and his uncle .

source_bert_toks: your father was always good to me , and his uncle .

reference_raw: Your father has always been kind to me and to my uncle.

reference_spacy_tokens: Your father has always been kind to me and to my uncle .


fn_spacy_tokens_for_baseline: Both explained that small packs of products were not only more convenient but also meant less wasted packaging .

source_bert_toks: both explained that small packs of products were not only more convenient but also meant less wasted packaging .

reference_raw: Both explained that small product packages were not only more convenient, but also meant less wasteful packaging.

reference_spacy_tokens: Both explained that small product packages were not only more convenient , but also meant less wasteful packaging .


fn_spacy_tokens_for_baseline: But he was as cunning as he was cruel , and at the first whisper of coming trouble he had secretly conveyed his treasures aboard a ship which was manned by devoted adherents .

source_bert_toks: but he was as cunning as he was cruel , and at the first whisper of coming trouble he had secretly conveyed his treasures aboard a ship which was manned by devoted adherents .

reference_raw: But he was as cunning as he was cruel, and at the first whisper of trouble he secretly carried his treasures aboard a ship manned by loyal followers.

reference_spacy_tokens: But he was as cunning as he was cruel , and at the first whisper of trouble he secretly carried his treasures aboard a ship manned by loyal followers .


fn_spacy_tokens_for_baseline: Frederick was dancing round Mister Johnny , twisting one side of his face in grotesque imitation and fluttering his hands .

source_bert_toks: frederick was dancing round mister johnny , twisting one side of his face in grotesque imitation and fluttering his hands .

reference_raw: Frederick danced around Mr. Johnny, twisting one side of his face in grotesque imitations and waving his hands.

reference_spacy_tokens: Frederick danced around Mr. Johnny , twisting one side of his face in grotesque imitations and waving his hands .


fn_spacy_tokens_for_baseline: The girl hijacker stood watching them with her gun .

source_bert_toks: the girl hi ##jack ##er stood watching them with her gun .

reference_raw: The girl abductor stood looking at them with a gun.

reference_spacy_tokens: The girl abductor stood looking at them with a gun .


fn_spacy_tokens_for_baseline: Fez - topped men tried to entice them to enter their tiny emporiums but the Roberts spent the first hour simply taking in the atmosphere .

source_bert_toks: fe ##z - topped men tried to en ##tic ##e them to enter their tiny em ##por ##ium ##s but the roberts spent the first hour simply taking in the atmosphere .

reference_raw: Fez-covered men tried to lure them into their tiny emporiums, but for the first hour the Roberts simply took up the atmosphere.

reference_spacy_tokens: Fez - covered men tried to lure them into their tiny emporiums , but for the first hour the Roberts simply took up the atmosphere .


fn_spacy_tokens_for_baseline: Old armchairs were imaginatively re - covered and secondhand Lloyd Loom furniture was restored with a lick of paint , with simple gloss or matt painted walls as a background .

source_bert_toks: old armchair ##s were imaginative ##ly re - covered and second ##hand lloyd lo ##om furniture was restored with a lick of paint , with simple gloss or matt painted walls as a background .

reference_raw: The old chairs had been imaginatively recovered, and the second-hand furniture of Lloyd Loom had been refurbished with a lick of paint, with simple shiny or matt-painted walls.

reference_spacy_tokens: The old chairs had been imaginatively recovered , and the second - hand furniture of Lloyd Loom had been refurbished with a lick of paint , with simple shiny or matt - painted walls .


fn_spacy_tokens_for_baseline: Then his fingers fumbled to unfasten the small buttons of her suit jacket .

source_bert_toks: then his fingers fumbled to un ##fast ##en the small buttons of her suit jacket .

reference_raw: Then he fumbled with his fingers to unbutton the small knobs of her suit jacket.

reference_spacy_tokens: Then he fumbled with his fingers to unbutton the small knobs of her suit jacket .


fn_spacy_tokens_for_baseline: It is an abstract art , which we none the less consume as readers rather than as connoisseurs of pure form .

source_bert_toks: it is an abstract art , which we none the less consume as readers rather than as con ##no ##isse ##urs of pure form .

reference_raw: It's an abstract art that we use as readers rather than as pure-form experts.

reference_spacy_tokens: It 's an abstract art that we use as readers rather than as pure - form experts .


fn_spacy_tokens_for_baseline: At these points there are also constrictions in the blood vessels and nerves , and weaknesses in the connective tissues .

source_bert_toks: at these points there are also con ##st ##ric ##tions in the blood vessels and nerves , and weaknesses in the connect ##ive tissues .

reference_raw: At these points, blood vessels and nerves are also constricted and connective tissues are weak.

reference_spacy_tokens: At these points , blood vessels and nerves are also constricted and connective tissues are weak .


fn_spacy_tokens_for_baseline: The Pope did officiate at a public mass at the Lighthouse on Oct. 11 .

source_bert_toks: the pope did off ##icia ##te at a public mass at the lighthouse on oct . 11 .

reference_raw: The Pope made a public appearance at the Lighthouse on October 11th.

reference_spacy_tokens: The Pope made a public appearance at the Lighthouse on October 11th .


fn_spacy_tokens_for_baseline: I knew I was being bewitched , laid under a spell so intensely personal , so thrilling , I did not have the power to resist it , or to judge if it were good or evil .

source_bert_toks: i knew i was being be ##wi ##tched , laid under a spell so intensely personal , so thrilling , i did not have the power to resist it , or to judge if it were good or evil .

reference_raw: I knew I was under a spell so intensely personal, so exciting, that I couldn't resist it, or judge whether it was good or evil.

reference_spacy_tokens: I knew I was under a spell so intensely personal , so exciting , that I could n't resist it , or judge whether it was good or evil .


fn_spacy_tokens_for_baseline: The House of Lords has solemnly decided that ' ordinary readers ' do not read very carefully -- at least when they are skimming through ' The Sun ' .

source_bert_toks: the house of lords has solemnly decided that ' ordinary readers ' do not read very carefully - - at least when they are ski ##mming through ' the sun ' .

reference_raw: The House of Lords solemnly decided that ordinary readers don't read very carefully - at least when they're passing through the sun.

reference_spacy_tokens: The House of Lords solemnly decided that ordinary readers do n't read very carefully - at least when they 're passing through the sun .


fn_spacy_tokens_for_baseline: The following profile attempts to piece together an objective overview of allegations surrounding Iran and its CW capabilities by mining through reports in open source literature from a variety of sources .

source_bert_toks: the following profile attempts to piece together an objective overview of allegations surrounding iran and its cw capabilities by mining through reports in open source literature from a variety of sources .

reference_raw: The following profile attempts to compile an objective overview of the allegations concerning Iran and its CW capabilities by extracting reports from open source literature from various sources.

reference_spacy_tokens: The following profile attempts to compile an objective overview of the allegations concerning Iran and its CW capabilities by extracting reports from open source literature from various sources .


fn_spacy_tokens_for_baseline: She turned and saw the man in the bowler .

source_bert_toks: she turned and saw the man in the bowler .

reference_raw: Turning, she saw the man in the bowl.

reference_spacy_tokens: Turning , she saw the man in the bowl .


fn_spacy_tokens_for_baseline: PARENTS are facing an agonizing six - week wait after it was revealed that a hospital paediatrician is suffering from tuberculosis .

source_bert_toks: parents are facing an ago ##ni ##zing six - week wait after it was revealed that a hospital pa ##ed ##ia ##tric ##ian is suffering from tuberculosis .

reference_raw: PARENTS faces a painful six-week wait until it is discovered that a hospital pediatrician suffers from tuberculosis.

reference_spacy_tokens: PARENTS faces a painful six - week wait until it is discovered that a hospital pediatrician suffers from tuberculosis .


fn_spacy_tokens_for_baseline: Nor is it impossible that she believed this legend .

source_bert_toks: nor is it impossible that she believed this legend .

reference_raw: And there's no way she believed the legend.

reference_spacy_tokens: And there 's no way she believed the legend .


fn_spacy_tokens_for_baseline: By tomorrow night that pile of stones will have been pulled down and this pagan nonsense completely done away with .

source_bert_toks: by tomorrow night that pile of stones will have been pulled down and this pagan nonsense completely done away with .

reference_raw: By tomorrow night, the heap of stones will be pulled down, and this pagan nonsense will be completely over.

reference_spacy_tokens: By tomorrow night , the heap of stones will be pulled down , and this pagan nonsense will be completely over .


fn_spacy_tokens_for_baseline: ' It is that hard , ' he said ominously , and I thought of John Maggovertski 's sadness for a pretty girl who had whored herself to pay for the white powder .

source_bert_toks: ' it is that hard , ' he said ominous ##ly , and i thought of john mag ##go ##vert ##ski ' s sadness for a pretty girl who had whore ##d herself to pay for the white powder .

reference_raw: 'It's so hard,' he said ominously, and I thought of John Maggovertski's sorrow for a pretty girl who had been slutting herself to pay for the white powder.

reference_spacy_tokens: ' It 's so hard , ' he said ominously , and I thought of John Maggovertski 's sorrow for a pretty girl who had been slutting herself to pay for the white powder .


fn_spacy_tokens_for_baseline: Carelessness could be dangerous .

source_bert_toks: careless ##ness could be dangerous .

reference_raw: Careless can be dangerous.

reference_spacy_tokens: Careless can be dangerous .


fn_spacy_tokens_for_baseline: Again there was a problem of lawlessness even greater than the average over the country as a whole , exacerbated by the disorders which had followed the Glyn Dwr revolt .

source_bert_toks: again there was a problem of law ##lessness even greater than the average over the country as a whole , ex ##ace ##rba ##ted by the disorders which had followed the g ##lyn d ##wr revolt .

reference_raw: Once again, the problem of injustice was even higher than the average in the country as a whole, exacerbated by the disorders that followed the Glyn Dwr rebellion.

reference_spacy_tokens: Once again , the problem of injustice was even higher than the average in the country as a whole , exacerbated by the disorders that followed the Glyn Dwr rebellion .


fn_spacy_tokens_for_baseline: Her long black tresses were to go and her hair restyled with a soft perm .

source_bert_toks: her long black tres ##ses were to go and her hair rest ##yle ##d with a soft per ##m .

reference_raw: Her long black dress should have gone, and her hair would have been rested in a soft perm.

reference_spacy_tokens: Her long black dress should have gone , and her hair would have been rested in a soft perm .


fn_spacy_tokens_for_baseline: Ignatius , however , was not to be disheartened by the lack of confidence shown in him , and set about his new task with vigour and determination .

source_bert_toks: ignatius , however , was not to be dish ##ear ##ten ##ed by the lack of confidence shown in him , and set about his new task with vi ##go ##ur and determination .

reference_raw: But Ignatius should not be displeased by his lack of confidence, and he began his new task of vigour and determination.

reference_spacy_tokens: But Ignatius should not be displeased by his lack of confidence , and he began his new task of vigour and determination .


fn_spacy_tokens_for_baseline: Real - estate moguls , the only folks who made real money in D.C. until recently , were shut out of power Washington - except for sports team owners Jack Kent Cooke and Abe Pollin .

source_bert_toks: real - estate mo ##gul ##s , the only folks who made real money in d . c . until recently , were shut out of power washington - except for sports team owners jack kent cooke and abe poll ##in .

reference_raw: The real estate moguls, the only people who had made real money in Washington until recently, had been shut down in Washington - except for the owners of the sports team, Jack Kent Cooke and Abe Pollin.

reference_spacy_tokens: The real estate moguls , the only people who had made real money in Washington until recently , had been shut down in Washington - except for the owners of the sports team , Jack Kent Cooke and Abe Pollin .


fn_spacy_tokens_for_baseline: And the FCC 's rate rollback , which happened around the same time , put a real dent into TCI 's cash flow .

source_bert_toks: and the fcc ' s rate roll ##back , which happened around the same time , put a real dent into tc ##i ' s cash flow .

reference_raw: And the FCC tariff rollback, which happened around the same time, put a real dent in TCI's cash flow.

reference_spacy_tokens: And the FCC tariff rollback , which happened around the same time , put a real dent in TCI 's cash flow .


fn_spacy_tokens_for_baseline: Visitors entering the temple are confronted by a dense pall of smoke from all the burning joss sticks and the incense coils hanging from the ceiling ( these will burn for as long as a month ) .

source_bert_toks: visitors entering the temple are confronted by a dense pal ##l of smoke from all the burning jo ##ss sticks and the incense coil ##s hanging from the ceiling ( these will burn for as long as a month ) .

reference_raw: Visitors who enter the temple face a thick cloud of smoke from all the burning joss sticks and incense coils that hang from the roof (they burn for up to one month).

reference_spacy_tokens: Visitors who enter the temple face a thick cloud of smoke from all the burning joss sticks and incense coils that hang from the roof ( they burn for up to one month ) .


fn_spacy_tokens_for_baseline: As a massive explosion ripped through the plant , eyewitness Joyce Colgan heard a rumbling like a train which got louder and louder .

source_bert_toks: as a massive explosion ripped through the plant , eye ##wi ##tness joyce col ##gan heard a rumbling like a train which got louder and louder .

reference_raw: As a massive explosion burst through the factory, the eyewitness Joyce Colgan heard the roar of a train that grew louder and louder.

reference_spacy_tokens: As a massive explosion burst through the factory , the eyewitness Joyce Colgan heard the roar of a train that grew louder and louder .


fn_spacy_tokens_for_baseline: ' But , as for these & hellip ; " with a gesture of contempt she held up the copies of the agreement ' & hellip ; there 's no way in the world I 'm going to sign these , so you can make a bonfire with them , if you like ! "

source_bert_toks: ' but , as for these & hell ##ip ; " with a gesture of contempt she held up the copies of the agreement ' & hell ##ip ; there ' s no way in the world i ' m going to sign these , so you can make a bonfire with them , if you like ! "

reference_raw: "But as far as this &Hellip is concerned," she said with a contemptuous gesture, holding up the copies of the contract "… there's no way in the world I'll sign them, so you can set fire to them, if you want!"

reference_spacy_tokens: " But as far as this & Hellip is concerned , " she said with a contemptuous gesture , holding up the copies of the contract " & hellip ; there 's no way in the world I 'll sign them , so you can set fire to them , if you want ! "


fn_spacy_tokens_for_baseline: Happily , the Department of the Environment was so appalled at being cast as the number one villain that the certificates came almost by return of post and the Coal Board now felt isolated and exposed .

source_bert_toks: happily , the department of the environment was so appalled at being cast as the number one villain that the certificates came almost by return of post and the coal board now felt isolated and exposed .

reference_raw: Fortunately, the Ministry of the Environment was so dismayed at being cast as the first bad guy that the certificates had almost come back to work, and now the Coal Council felt isolated and exposed.

reference_spacy_tokens: Fortunately , the Ministry of the Environment was so dismayed at being cast as the first bad guy that the certificates had almost come back to work , and now the Coal Council felt isolated and exposed .


fn_spacy_tokens_for_baseline: Jane sat upright and sipped gratefully .

source_bert_toks: jane sat upright and sipped grateful ##ly .

reference_raw: Jane straightened up and sipped gratefully.

reference_spacy_tokens: Jane straightened up and sipped gratefully .


fn_spacy_tokens_for_baseline: The beam illuminated an altar carved from a block of solid jade , where a knife and a whisk and a chalice were laid upon cloth of gold .

source_bert_toks: the beam illuminated an altar carved from a block of solid jade , where a knife and a w ##his ##k and a cha ##lice were laid upon cloth of gold .

reference_raw: The beam illuminated an altar cut from a block of solid jade, where a knife, whisk, and chalice lay on a cloth of gold.

reference_spacy_tokens: The beam illuminated an altar cut from a block of solid jade , where a knife , whisk , and chalice lay on a cloth of gold .


fn_spacy_tokens_for_baseline: ' You dare to answer me so ? ' shrilled Matilda .

source_bert_toks: ' you dare to answer me so ? ' shrill ##ed matilda .

reference_raw: 'Do you dare answer that?' snapped Matilda.

reference_spacy_tokens: ' Do you dare answer that ? ' snapped Matilda .


fn_spacy_tokens_for_baseline: True to the myth , the reclusive Hughes immediately cloistered himself in the Desert Inn 's penthouse .

source_bert_toks: true to the myth , the rec ##lus ##ive hughes immediately cl ##ois ##tered himself in the desert inn ' s penthouse .

reference_raw: The truth of the myth was that the solitary Hughes had immediately cloistered himself in the penthouse of the desert inn.

reference_spacy_tokens: The truth of the myth was that the solitary Hughes had immediately cloistered himself in the penthouse of the desert inn .


fn_spacy_tokens_for_baseline: She looked up into his face , anger seething through her , and was surprised to see that he was smiling .

source_bert_toks: she looked up into his face , anger see ##thing through her , and was surprised to see that he was smiling .

reference_raw: She looked up at his face, anger seeping through her, and was surprised to see that he was smiling.

reference_spacy_tokens: She looked up at his face , anger seeping through her , and was surprised to see that he was smiling .


fn_spacy_tokens_for_baseline: I was having Rob and Jen at the same time , and I used to get very wrapped up in myself when I was pregnant , you know -- just not interested in things like sisters - in - law .

source_bert_toks: i was having rob and jen at the same time , and i used to get very wrapped up in myself when i was pregnant , you know - - just not interested in things like sisters - in - law .

reference_raw: I was with Rob and Jen at the same time, and when I was pregnant, I was so wrapped up in myself, you know, I just didn't care about things like my sister-in-law.

reference_spacy_tokens: I was with Rob and Jen at the same time , and when I was pregnant , I was so wrapped up in myself , you know , I just did n't care about things like my sister - in - law .


fn_spacy_tokens_for_baseline: Others had , and were experiencing mixed feelings .

source_bert_toks: others had , and were experiencing mixed feelings .

reference_raw: Others did, and felt mixed feelings.

reference_spacy_tokens: Others did , and felt mixed feelings .


fn_spacy_tokens_for_baseline: The lack of clean drinking water also poses a ' severe risk ' of diarrhea , salmonella and hepatitis , Iraq 's health minister , Mohamed Sayed , told Britain 's Observer newspaper .

source_bert_toks: the lack of clean drinking water also poses a ' severe risk ' of dia ##rr ##hea , salmon ##ella and hepatitis , iraq ' s health minister , mohamed say ##ed , told britain ' s observer newspaper .

reference_raw: The lack of clean drinking water also poses a "severe danger" of diarrhoea, salmonella and hepatitis, and the Iraqi Minister of Health, Mohamed Sayed, told the British Observer newspaper.

reference_spacy_tokens: The lack of clean drinking water also poses a " severe danger " of diarrhoea , salmonella and hepatitis , and the Iraqi Minister of Health , Mohamed Sayed , told the British Observer newspaper .


fn_spacy_tokens_for_baseline: But he bemoaned the fratricide that has forced millions of refugees from Rwanda and Burundi since last year .

source_bert_toks: but he be ##mo ##ane ##d the fra ##tric ##ide that has forced millions of refugees from rwanda and burundi since last year .

reference_raw: But he humiliated the brotherhood that had driven millions of refugees from Rwanda and Burundi since last year.

reference_spacy_tokens: But he humiliated the brotherhood that had driven millions of refugees from Rwanda and Burundi since last year .


fn_spacy_tokens_for_baseline: The United States and Israel have both accused Iran of using its atomic energy program as cover for a plan to develop nuclear arms .

source_bert_toks: the united states and israel have both accused iran of using its atomic energy program as cover for a plan to develop nuclear arms .

reference_raw: Both the United States and Israel accused Iran of using its nuclear power program as cover for a plan for the development of nuclear weapons.

reference_spacy_tokens: Both the United States and Israel accused Iran of using its nuclear power program as cover for a plan for the development of nuclear weapons .


fn_spacy_tokens_for_baseline: Pare 4 strips of zest from the lemon using a vegetable peeler .

source_bert_toks: par ##e 4 strips of ze ##st from the lemon using a vegetable peel ##er .

reference_raw: Prepare four strips of zest from lemon using a vegetable peeler.

reference_spacy_tokens: Prepare four strips of zest from lemon using a vegetable peeler .


fn_spacy_tokens_for_baseline: They returned to their seats ; Maurice puffed at his pipe and seemed more relaxed .

source_bert_toks: they returned to their seats ; maurice puff ##ed at his pipe and seemed more relaxed .

reference_raw: They went back to their seats; Maurice blew on his pipe and seemed more relaxed.

reference_spacy_tokens: They went back to their seats ; Maurice blew on his pipe and seemed more relaxed .


fn_spacy_tokens_for_baseline: It soared into the air .

source_bert_toks: it soared into the air .

reference_raw: It floated into the air.

reference_spacy_tokens: It floated into the air .


fn_spacy_tokens_for_baseline: Her shoelace came undone .

source_bert_toks: her shoe ##lace came undone .

reference_raw: Her lace was undone.

reference_spacy_tokens: Her lace was undone .


fn_spacy_tokens_for_baseline: By the late 19th century , hard - knotted rugs had almost ceased to be made in Europe , as the advent of weaving machines meant that rugs could be produced much more quickly at a fraction of the cost .

source_bert_toks: by the late 19th century , hard - knotted rug ##s had almost ceased to be made in europe , as the advent of weaving machines meant that rug ##s could be produced much more quickly at a fraction of the cost .

reference_raw: By the end of the 19th century, hard-knotted carpets in Europe had almost stopped, because the arrival of weaving machines meant that carpets could be made much faster at a fraction of the price.

reference_spacy_tokens: By the end of the 19th century , hard - knotted carpets in Europe had almost stopped , because the arrival of weaving machines meant that carpets could be made much faster at a fraction of the price .


fn_spacy_tokens_for_baseline: I hesitated , then went back for the indigo wrap .

source_bert_toks: i hesitated , then went back for the indigo wrap .

reference_raw: I hesitated, then went back to get the indigo bag.

reference_spacy_tokens: I hesitated , then went back to get the indigo bag .


fn_spacy_tokens_for_baseline: The old man was wearing a plastic raincoat but was hatless .

source_bert_toks: the old man was wearing a plastic rain ##coat but was hat ##less .

reference_raw: The old man wore a plastic coat, but he had no hat.

reference_spacy_tokens: The old man wore a plastic coat , but he had no hat .


fn_spacy_tokens_for_baseline: He got down off the cart to pick a leaf from a roadside bush , and hoisting himself back into his seat resumed his journey , sucking on the leaf as he started to explain .

source_bert_toks: he got down off the cart to pick a leaf from a roadside bush , and ho ##ist ##ing himself back into his seat resumed his journey , sucking on the leaf as he started to explain .

reference_raw: He got out of the cart to get a leaf out of the brush by the side of the road, and hoisted himself back into his seat again, sucking on the leaves as he began to explain.

reference_spacy_tokens: He got out of the cart to get a leaf out of the brush by the side of the road , and hoisted himself back into his seat again , sucking on the leaves as he began to explain .


fn_spacy_tokens_for_baseline: This change will become effective from 1 July 1987 .

source_bert_toks: this change will become effective from 1 july 1987 .

reference_raw: This amendment shall take effect on 1 July 1987.

reference_spacy_tokens: This amendment shall take effect on 1 July 1987 .


fn_spacy_tokens_for_baseline: Stir for 5 minutes , until the vegetables are warmed through and coated with the sauce .

source_bert_toks: stir for 5 minutes , until the vegetables are warmed through and coated with the sauce .

reference_raw: Stir for five minutes until the vegetables are warmed up and covered with sauce.

reference_spacy_tokens: Stir for five minutes until the vegetables are warmed up and covered with sauce .


fn_spacy_tokens_for_baseline: By this time Lawford had divorced Pat Kennedy and married Deborah Gould .

source_bert_toks: by this time law ##ford had divorced pat kennedy and married deborah gould .

reference_raw: By that time, Lawford had split up with Pat Kennedy and married Deborah Gould.

reference_spacy_tokens: By that time , Lawford had split up with Pat Kennedy and married Deborah Gould .


fn_spacy_tokens_for_baseline: Then we started down the rapids .

source_bert_toks: then we started down the rapids .

reference_raw: Then we started down the fasts.

reference_spacy_tokens: Then we started down the fasts .


fn_spacy_tokens_for_baseline: She herself had plastic bangles .

source_bert_toks: she herself had plastic bang ##les .

reference_raw: She had plastic bracelets herself.

reference_spacy_tokens: She had plastic bracelets herself .


fn_spacy_tokens_for_baseline: She said nothing , but turned and led the way into the living room , where it was almost dark and the coals glowed bright red between the bars of the stove .

source_bert_toks: she said nothing , but turned and led the way into the living room , where it was almost dark and the coal ##s glowed bright red between the bars of the stove .

reference_raw: She said nothing, but turned and led the way to the living room, where it was almost dark, and the coals glowed brilliantly red between the bars of the stove.

reference_spacy_tokens: She said nothing , but turned and led the way to the living room , where it was almost dark , and the coals glowed brilliantly red between the bars of the stove .