fn_spacy_tokens_for_baseline: Stefan darted a suspicious glance across the table at him .

source_bert_toks: stefan darted a suspicious glance across the table at him .

reference_raw: Stefan looked at him suspiciously across the table.

reference_spacy_tokens: Stefan looked at him suspiciously across the table .


fn_spacy_tokens_for_baseline: ' That idiot Amanda ' , Hortensia said , ' has let her long hair grow even longer during the hols and her mother has plaited it into pigtails .

source_bert_toks: ' that idiot amanda ' , ho ##rte ##ns ##ia said , ' has let her long hair grow even longer during the ho ##ls and her mother has pl ##ai ##ted it into pig ##tails .

reference_raw: 'That idiot Amanda,' Hortensia said, 'let her long hair grow even longer in the hols, and her mother put it in pigtails.

reference_spacy_tokens: ' That idiot Amanda , ' Hortensia said , ' let her long hair grow even longer in the hols , and her mother put it in pigtails .


fn_spacy_tokens_for_baseline: Her hair , which was long and fair , was almost entirely covered by her white veil .

source_bert_toks: her hair , which was long and fair , was almost entirely covered by her white veil .

reference_raw: Her hair, long and fair, was almost entirely obscured by a white veil.

reference_spacy_tokens: Her hair , long and fair , was almost entirely obscured by a white veil .


fn_spacy_tokens_for_baseline: No such complexities for the Stereo MC 's ( can we officially quit calling them ' the underrated Stereo MC 's now then ? ) .

source_bert_toks: no such complex ##ities for the stereo mc ' s ( can we officially quit calling them ' the under ##rated stereo mc ' s now then ? ) .

reference_raw: There are no such complexities for Stereo MC (can we officially stop calling them "underrated Stereo MC now?).

reference_spacy_tokens: There are no such complexities for Stereo MC ( can we officially stop calling them " underrated Stereo MC now ? ) .


fn_spacy_tokens_for_baseline: The general public prosector has ordered the release of Mr Wolfgang Vogel , a prominent lawyer and former close aide of Mr Honecker who was detained on Tuesday on suspicion of ' criminal blackmail ' .

source_bert_toks: the general public prose ##ctor has ordered the release of mr wolfgang vogel , a prominent lawyer and former close aide of mr hon ##eck ##er who was detained on tuesday on suspicion of ' criminal blackmail ' .

reference_raw: The general public sector has ordered the release of Mr. Wolfgang Vogel, a prominent lawyer and former close assistant to Mr. Honecker, who was arrested on Tuesday on suspicion of "criminal extortion."

reference_spacy_tokens: The general public sector has ordered the release of Mr. Wolfgang Vogel , a prominent lawyer and former close assistant to Mr. Honecker , who was arrested on Tuesday on suspicion of " criminal extortion . "


fn_spacy_tokens_for_baseline: In other words , does English criminal law pick out the most heinous forms of killing as murders and manslaughters , or are the boundaries frozen by tradition ?

source_bert_toks: in other words , does english criminal law pick out the most he ##ino ##us forms of killing as murders and mans ##lau ##ght ##ers , or are the boundaries frozen by tradition ?

reference_raw: In other words, does English criminal law choose the most horrific forms of murder as murder and murder, or is the boundary frozen by tradition?

reference_spacy_tokens: In other words , does English criminal law choose the most horrific forms of murder as murder and murder , or is the boundary frozen by tradition ?


fn_spacy_tokens_for_baseline: As a relief engine was hastily summoned the trainload of passengers were merrily singing ' We sha n't get home til morning ' .

source_bert_toks: as a relief engine was hastily summoned the train ##load of passengers were mer ##rily singing ' we shan ' t get home til morning ' .

reference_raw: As the rescue engine was hastily called in, the passenger train was singing happily, "We won't be home until morning."

reference_spacy_tokens: As the rescue engine was hastily called in , the passenger train was singing happily , " We wo n't be home until morning . "


fn_spacy_tokens_for_baseline: The X - ray image produced is nothing more than a large amorphous black mass . I fear that for every trash truck caught carrying contraband into Michigan , many more get through undetected with drugs , medical waste or other illegal material .

source_bert_toks: the x - ray image produced is nothing more than a large amor ##ph ##ous black mass . i fear that for every trash truck caught carrying contra ##band into michigan , many more get through und ##ete ##cted with drugs , medical waste or other illegal material .

reference_raw: The X-ray image produced is nothing more than a large amorphous black mass. I'm afraid that for every garbage car caught carrying contraband to Michigan, a lot of others will pass undetected by drugs, medical waste, or other illegal materials.

reference_spacy_tokens: The X - ray image produced is nothing more than a large amorphous black mass . I 'm afraid that for every garbage car caught carrying contraband to Michigan , a lot of others will pass undetected by drugs , medical waste , or other illegal materials .


fn_spacy_tokens_for_baseline: The name of the local pub , Live and Let Live , seemed like a good omen the first time she drove past it .

source_bert_toks: the name of the local pub , live and let live , seemed like a good om ##en the first time she drove past it .

reference_raw: When she first passed it, the name of the local pub, Live and Let Live, seemed like a good sign.

reference_spacy_tokens: When she first passed it , the name of the local pub , Live and Let Live , seemed like a good sign .


fn_spacy_tokens_for_baseline: Under s 24 of the Bills of Exchange Act 1882 , a cheque bearing the forged signature of the drawer , however skilful , is wholly inoperative .

source_bert_toks: under s 24 of the bills of exchange act 1882 , a che ##que bearing the forged signature of the drawer , however ski ##lf ##ul , is wholly in ##oper ##ative .

reference_raw: In accordance with Article 24 of the Law on Exchange of Letters 1882, a check with the forged sign of a drawer, however skillful it may be, is completely inoperative.

reference_spacy_tokens: In accordance with Article 24 of the Law on Exchange of Letters 1882 , a check with the forged sign of a drawer , however skillful it may be , is completely inoperative .


fn_spacy_tokens_for_baseline: As they reached the outer suburbs it began to drizzle slightly and Preston switched the wipers on .

source_bert_toks: as they reached the outer suburbs it began to dr ##iz ##zle slightly and preston switched the wipe ##rs on .

reference_raw: When they reached the outskirts of the city, it began to drip a little, and Preston switched on the wipers.

reference_spacy_tokens: When they reached the outskirts of the city , it began to drip a little , and Preston switched on the wipers .


fn_spacy_tokens_for_baseline: You dreaded anyone coming in for fabric because you knew you would n't be able to get more than three yards without a fault . '

source_bert_toks: you dread ##ed anyone coming in for fabric because you knew you wouldn ' t be able to get more than three yards without a fault . '

reference_raw: You were afraid that someone would come for cloth because you knew you couldn't get more than three yards without a mistake.'

reference_spacy_tokens: You were afraid that someone would come for cloth because you knew you could n't get more than three yards without a mistake . '


fn_spacy_tokens_for_baseline: He defeated three other candidates , one of them being leading Sajudis member Romualdas Ozalas .

source_bert_toks: he defeated three other candidates , one of them being leading sa ##ju ##dis member rom ##ual ##das oz ##ala ##s .

reference_raw: He beat three other candidates, one of them leading a member of the Sajudis, Romualdas Ozalas.

reference_spacy_tokens: He beat three other candidates , one of them leading a member of the Sajudis , Romualdas Ozalas .


fn_spacy_tokens_for_baseline: EXPENSE -Outflows or other using up of assets or incurrences of liabilities ( or a combination of both ) during a period from providing goods , rendering services , or carrying out other activities related to an entity 's programs and missions , the benefits from which do not extend beyond the present operating period .

source_bert_toks: expense - out ##flow ##s or other using up of assets or inc ##ur ##rence ##s of lia ##bilities ( or a combination of both ) during a period from providing goods , rendering services , or carrying out other activities related to an entity ' s programs and missions , the benefits from which do not extend beyond the present operating period .

reference_raw: EXPLANATORY MEMORANDUM - Outflows or other uses of assets or incurrences of liabilities (or both) during the period between the provision of goods, the provision of services or the performance of other activities related to the programmes and missions of the entity, the benefits of which do not exceed the current operating period.

reference_spacy_tokens: EXPLANATORY MEMORANDUM - Outflows or other uses of assets or incurrences of liabilities ( or both ) during the period between the provision of goods , the provision of services or the performance of other activities related to the programmes and missions of the entity , the benefits of which do not exceed the current operating period .


fn_spacy_tokens_for_baseline: She had thin , straggly , dirty blonde rats - tail hair and wore wellingtons , faded pink jeans and a baggy knitted pullover with a row of pink pigs across the bosom .

source_bert_toks: she had thin , st ##rag ##gly , dirty blonde rats - tail hair and wore wellington ##s , faded pink jeans and a bag ##gy knit ##ted pull ##over with a row of pink pigs across the bo ##som .

reference_raw: Her hair was thin, straggly, dirty blond, rat-tailed, and she was wearing wellings, faded pink jeans, and a baggy knitted pullover with a row of pink pigs across her breasts.

reference_spacy_tokens: Her hair was thin , straggly , dirty blond , rat - tailed , and she was wearing wellings , faded pink jeans , and a baggy knitted pullover with a row of pink pigs across her breasts .


fn_spacy_tokens_for_baseline: MELBOURNE , Australia ( AP ) --- Coincidence or commentary , songbirds warbled sweetly when Martina Hingis served , then quieted and let the crows caw crazily when it was Lisa Raymond 's turn .

source_bert_toks: melbourne , australia ( ap ) - - - coincidence or commentary , song ##birds war ##bled sweetly when martina hi ##ng ##is served , then quiet ##ed and let the crows ca ##w cr ##azi ##ly when it was lisa raymond ' s turn .

reference_raw: MELBOURNE, Australia (AP) - Coincidence or commentary, while Martina Hingis was serving, the songbirds wriggled sweetly, then quieted and allowed the crows to crow madly when it was Lisa Raymond's turn.

reference_spacy_tokens: MELBOURNE , Australia ( AP ) - Coincidence or commentary , while Martina Hingis was serving , the songbirds wriggled sweetly , then quieted and allowed the crows to crow madly when it was Lisa Raymond 's turn .


fn_spacy_tokens_for_baseline: The Women 's and Minors ' Section at the Ministry of Labour employs a staff of five .

source_bert_toks: the women ' s and minors ' section at the ministry of labour employs a staff of five .

reference_raw: The Department of Women and Minors of the Ministry of Labour has five employees.

reference_spacy_tokens: The Department of Women and Minors of the Ministry of Labour has five employees .


fn_spacy_tokens_for_baseline: He drank a glass of white wine with it : French habits had stayed with him .

source_bert_toks: he drank a glass of white wine with it : french habits had stayed with him .

reference_raw: He took a glass of white wine with him: the French customs remained with him.

reference_spacy_tokens: He took a glass of white wine with him : the French customs remained with him .


fn_spacy_tokens_for_baseline: The press may have labelled them all Brats , but not all of them had any great desire to raise hell and make headlines .

source_bert_toks: the press may have labelled them all brat ##s , but not all of them had any great desire to raise hell and make headlines .

reference_raw: The press might have marked them all Brats, but not everyone wanted to raise hell and make headlines.

reference_spacy_tokens: The press might have marked them all Brats , but not everyone wanted to raise hell and make headlines .


fn_spacy_tokens_for_baseline: Dilatation was resumed after a gap of three to four weeks and the strictures were successfully dilated to 45 FG in all without further complication .

source_bert_toks: dil ##ata ##tion was resumed after a gap of three to four weeks and the strict ##ures were successfully dil ##ated to 45 f ##g in all without further com ##plication .

reference_raw: After a three-to-four-week gap, the dilatation was resumed and the strictures were successfully extended to 45 FG without further complications.

reference_spacy_tokens: After a three - to - four - week gap , the dilatation was resumed and the strictures were successfully extended to 45 FG without further complications .


fn_spacy_tokens_for_baseline: Due to challenges posed by a limited source of indigenously produced precursors for CW agents , it is believed that North Korea emphasizes production of phosgene , mustard , sarin , and V - agents . ( Previous reports have also alleged a large stock of sarin nerve agent . ) In 2001 , it was estimated that there are 12 facilities in the DPRK where raw chemicals , precursors , and CW agents are produced and / or stored .

source_bert_toks: due to challenges posed by a limited source of indigenous ##ly produced precursor ##s for cw agents , it is believed that north korea emphasizes production of ph ##os ##gen ##e , mustard , sar ##in , and v - agents . ( previous reports have also alleged a large stock of sar ##in nerve agent . ) in 2001 , it was estimated that there are 12 facilities in the d ##pr ##k where raw chemicals , precursor ##s , and cw agents are produced and / or stored .

reference_raw: Due to the problems posed by the limited source of indigenous precursors to CW agents, it is believed that North Korea highlights the production of phosgenes, mustards, sarins and V-agents. (Previous reports also claim that a large stock of sarin nerves is being produced and/or stored in the DPRK) in 2001, it is estimated that there are 12 facilities where raw chemicals, precursors and CW agents are produced and/s.

reference_spacy_tokens: Due to the problems posed by the limited source of indigenous precursors to CW agents , it is believed that North Korea highlights the production of phosgenes , mustards , sarins and V - agents . ( Previous reports also claim that a large stock of sarin nerves is being produced and/or stored in the DPRK ) in 2001 , it is estimated that there are 12 facilities where raw chemicals , precursors and CW agents are produced and / s .


fn_spacy_tokens_for_baseline: Under the wise reign of Solomon , the city flourished as the capital of an empire that stretched from Damascus to the Red Sea and controlled the trade routes from Egypt to Phoenicia .

source_bert_toks: under the wise reign of solomon , the city flourished as the capital of an empire that stretched from damascus to the red sea and controlled the trade routes from egypt to ph ##oe ##nic ##ia .

reference_raw: Under Solomon's wise reign, the city flourished like the capital of a realm that stretched from Damascus to the Red Sea and controlled the trade routes from Egypt to Phoenicia.

reference_spacy_tokens: Under Solomon 's wise reign , the city flourished like the capital of a realm that stretched from Damascus to the Red Sea and controlled the trade routes from Egypt to Phoenicia .


fn_spacy_tokens_for_baseline: The king 's son had a young man 's idea of a joke : he thought he 'd test the courage and much - vaunted toughness of Albuin .

source_bert_toks: the king ' s son had a young man ' s idea of a joke : he thought he ' d test the courage and much - va ##unt ##ed tough ##ness of al ##bu ##in .

reference_raw: The King's son had a young man's idea of a joke: he thought he would test Albuin's bravery and much-vaunted hardship.

reference_spacy_tokens: The King 's son had a young man 's idea of a joke : he thought he would test Albuin 's bravery and much - vaunted hardship .


fn_spacy_tokens_for_baseline: As a basis for approving T and A data , supervisors are required to obtain reasonable assurance that employees working at remote sites are working when scheduled and that T and A information accurately reflects time worked and absences from scheduled tours of duty .

source_bert_toks: as a basis for app ##roving t and a data , supervisors are required to obtain reasonable assurance that employees working at remote sites are working when scheduled and that t and a information accurately reflects time worked and absence ##s from scheduled tours of duty .

reference_raw: As a basis for the approval of T and A data, the supervisory authorities are required to obtain reasonable assurance that the employees working in remote locations are working when planned and that the T and A information accurately reflects the time worked and lack of scheduled service visits.

reference_spacy_tokens: As a basis for the approval of T and A data , the supervisory authorities are required to obtain reasonable assurance that the employees working in remote locations are working when planned and that the T and A information accurately reflects the time worked and lack of scheduled service visits .


fn_spacy_tokens_for_baseline: Britain 's goat population is on the up . there are now more than a hundred thousand kept in this country .

source_bert_toks: britain ' s goat population is on the up . there are now more than a hundred thousand kept in this country .

reference_raw: There is an increase in the number of goats in Britain. There are now over a hundred thousand people in this country.

reference_spacy_tokens: There is an increase in the number of goats in Britain . There are now over a hundred thousand people in this country .


fn_spacy_tokens_for_baseline: The artillery Colonel jerked round , stared at Rebecque for an instant , then bellowed his own orders , but instead of ordering a killing volley into the tall rye , he commanded his men to retreat .

source_bert_toks: the artillery colonel jerked round , stared at re ##be ##c ##que for an instant , then bellowed his own orders , but instead of ordering a killing volley into the tall rye , he commanded his men to retreat .

reference_raw: The artillery colonel turned and stared at Rebecque for a moment, then shouted his own orders, but instead of ordering a killing volley into the high rye, he ordered his men to retreat.

reference_spacy_tokens: The artillery colonel turned and stared at Rebecque for a moment , then shouted his own orders , but instead of ordering a killing volley into the high rye , he ordered his men to retreat .


fn_spacy_tokens_for_baseline: The eighth one was n't quite so credulous , so he forged her will and smothered her . '

source_bert_toks: the eighth one wasn ' t quite so cr ##ed ##ulous , so he forged her will and sm ##oth ##ered her . '

reference_raw: Eighth wasn't so trusting, so he falsified her will and smothered her.'

reference_spacy_tokens: Eighth was n't so trusting , so he falsified her will and smothered her . '


fn_spacy_tokens_for_baseline: He pulled on an old army tracksuit and finally tied up his gym shoes .

source_bert_toks: he pulled on an old army tracks ##uit and finally tied up his gym shoes .

reference_raw: He put on his old military tracksuit and finally put on his gym boots.

reference_spacy_tokens: He put on his old military tracksuit and finally put on his gym boots .


fn_spacy_tokens_for_baseline: He waved the matter away with a gracious gesture .

source_bert_toks: he waved the matter away with a gr ##acious gesture .

reference_raw: With a gentle gesture, he waved the matter away.

reference_spacy_tokens: With a gentle gesture , he waved the matter away .


fn_spacy_tokens_for_baseline: Three years ago France 's president , Francois Mitterrand , made a similar speech about Africa at La Baule .

source_bert_toks: three years ago france ' s president , francois mit ##ter ##rand , made a similar speech about africa at la ba ##ule .

reference_raw: Three years ago, French Chairman Francois Mitterrand made a similar speech in La Baule about Africa.

reference_spacy_tokens: Three years ago , French Chairman Francois Mitterrand made a similar speech in La Baule about Africa .


fn_spacy_tokens_for_baseline: 32 P is the most widely used isotope in molecular biology laboratories and a high - energy beta - emitter .

source_bert_toks: 32 p is the most widely used isotope in molecular biology laboratories and a high - energy beta - emi ##tter .

reference_raw: 32 P is the most widely used isotope in molecular biology labs and high-energy beta emitters.

reference_spacy_tokens: 32 P is the most widely used isotope in molecular biology labs and high - energy beta emitters .


fn_spacy_tokens_for_baseline: Startled , Tal flew from his perch straight past her head , swerving at the last moment , flapping a wing in her face .

source_bert_toks: startled , tal flew from his perch straight past her head , sw ##erving at the last moment , flap ##ping a wing in her face .

reference_raw: Tal, startled, flew out of his perch right behind her head, swiveled at the last moment, swinging his wings in her face.

reference_spacy_tokens: Tal , startled , flew out of his perch right behind her head , swiveled at the last moment , swinging his wings in her face .


fn_spacy_tokens_for_baseline: On February 6 , 1958 , Gregg saw many friends and team - mates die in that fateful crash which stunned the nation .

source_bert_toks: on february 6 , 1958 , gregg saw many friends and team - mates die in that fate ##ful crash which stunned the nation .

reference_raw: On February 6, 1958, Gregg saw a lot of friends and teammates die in a fatal accident that shocked the nation.

reference_spacy_tokens: On February 6 , 1958 , Gregg saw a lot of friends and teammates die in a fatal accident that shocked the nation .


fn_spacy_tokens_for_baseline: The liver was enlarged by 2 - 3 cm .

source_bert_toks: the liver was enlarged by 2 - 3 cm .

reference_raw: Liver's been increased by two to three centimeters.

reference_spacy_tokens: Liver 's been increased by two to three centimeters .


fn_spacy_tokens_for_baseline: U. S. troops were trying to identify the men and determine their motives , King said .

source_bert_toks: u . s . troops were trying to identify the men and determine their motives , king said .

reference_raw: The U.S. soldiers tried to identify the men and identify their motives, King said.

reference_spacy_tokens: The U.S. soldiers tried to identify the men and identify their motives , King said .


fn_spacy_tokens_for_baseline: They have thus become the animal equivalents of the plants which are force - fed with artificial fertilizers and sprayed with herbicides and pesticides .

source_bert_toks: they have thus become the animal equivalent ##s of the plants which are force - fed with artificial fe ##rti ##lizer ##s and sprayed with herb ##icides and pest ##icides .

reference_raw: They have therefore become the animal equivalent of plants that are forcibly fed with artificial fertilisers and sprinkled with herbicides and pesticides.

reference_spacy_tokens: They have therefore become the animal equivalent of plants that are forcibly fed with artificial fertilisers and sprinkled with herbicides and pesticides .


fn_spacy_tokens_for_baseline: In time , the kingdom of Babylon was overthrown and the Israelites were permitted to return to Jerusalem in 539 b.c . The city was now under the more tolerant rule of the Persians , but rebuilding was slow work .

source_bert_toks: in time , the kingdom of babylon was overthrow ##n and the israeli ##tes were permitted to return to jerusalem in 53 ##9 b . c . the city was now under the more tolerant rule of the persians , but rebuilding was slow work .

reference_raw: In time, Babylon's kingdom was overthrown, and the Israelis were allowed to return to Jerusalem in 539 B.C., the city was now under a more tolerable Persian government, but the reconstruction was slow work.

reference_spacy_tokens: In time , Babylon 's kingdom was overthrown , and the Israelis were allowed to return to Jerusalem in 539 B.C. , the city was now under a more tolerable Persian government , but the reconstruction was slow work .


fn_spacy_tokens_for_baseline: Julian II snarled and stabbed the arm of his chair with a pencil , snapping it .

source_bert_toks: julian ii snarled and stabbed the arm of his chair with a pencil , snapping it .

reference_raw: Julian II grunted, jabbed a pencil into the back of his chair and cracked it.

reference_spacy_tokens: Julian II grunted , jabbed a pencil into the back of his chair and cracked it .


fn_spacy_tokens_for_baseline: " He even lets me put make - up on his face . "

source_bert_toks: " he even lets me put make - up on his face . "

reference_raw: "He even lets me put makeup on his face."

reference_spacy_tokens: " He even lets me put makeup on his face . "


fn_spacy_tokens_for_baseline: No doubt wider access to the Internet has had the greatest effect , making available not just independent news about Libya particularly from opposition websites such as Libya Alyoum but also communication among Libyans .

source_bert_toks: no doubt wider access to the internet has had the greatest effect , making available not just independent news about libya particularly from opposition websites such as libya al ##you ##m but also communication among libyan ##s .

reference_raw: There is no doubt that the most important effect has been the wider availability of the Internet by providing not only independent information on Libya, in particular on opposition websites such as Libya Alyum, but also on communication between Libyans.

reference_spacy_tokens: There is no doubt that the most important effect has been the wider availability of the Internet by providing not only independent information on Libya , in particular on opposition websites such as Libya Alyum , but also on communication between Libyans .


fn_spacy_tokens_for_baseline: I squeak my resistance and yank that particular limb away from the offending direction hoping that they wo n't do it again .

source_bert_toks: i squeak my resistance and yank that particular limb away from the off ##ending direction hoping that they won ' t do it again .

reference_raw: I squeal my resistance and yank this particular limb out of the insulting direction, hoping they'd never do it again.

reference_spacy_tokens: I squeal my resistance and yank this particular limb out of the insulting direction , hoping they 'd never do it again .


fn_spacy_tokens_for_baseline: Dice up the leaves and feed only as much as the fish will consume in ten minutes .

source_bert_toks: dice up the leaves and feed only as much as the fish will consume in ten minutes .

reference_raw: Cut the leaves and feed just as much as the fish can eat in ten minutes.

reference_spacy_tokens: Cut the leaves and feed just as much as the fish can eat in ten minutes .


fn_spacy_tokens_for_baseline: Alice rolled her eyes upward rudely .

source_bert_toks: alice rolled her eyes upward rude ##ly .

reference_raw: Alice's eyes went up uncomfortably.

reference_spacy_tokens: Alice 's eyes went up uncomfortably .


fn_spacy_tokens_for_baseline: Hundreds of Californians made their way to their computers after the quake , and checked in with each other on electronic bulletin boards , which link computers CB - radio - style , via phone lines .

source_bert_toks: hundreds of california ##ns made their way to their computers after the quake , and checked in with each other on electronic bulletin boards , which link computers cb - radio - style , via phone lines .

reference_raw: After the earthquake, hundreds of Californians made their way to their computers and checked in with each other on electronic bulletin boards that connect CB-radio computers through telephone lines.

reference_spacy_tokens: After the earthquake , hundreds of Californians made their way to their computers and checked in with each other on electronic bulletin boards that connect CB - radio computers through telephone lines .


fn_spacy_tokens_for_baseline: It was a programme about evaluations and the learned gentleman posed the question : ' Would you rather live for five years with two legs or twenty - five years with one leg ? '

source_bert_toks: it was a programme about evaluation ##s and the learned gentleman posed the question : ' would you rather live for five years with two legs or twenty - five years with one leg ? '

reference_raw: It was an evaluation program, and the learned man asked, "Would you rather live five years with two legs or twenty-five with one leg?"

reference_spacy_tokens: It was an evaluation program , and the learned man asked , " Would you rather live five years with two legs or twenty - five with one leg ? "


fn_spacy_tokens_for_baseline: The river was generally utilised to make water defences and it is these which give to the chateaux the picturesque quality which so many possess .

source_bert_toks: the river was generally ut ##ilised to make water defences and it is these which give to the chateau ##x the picturesque quality which so many possess .

reference_raw: The river was generally used to create water defenses, and it is these that give the chateaux the quaint quality that so many have.

reference_spacy_tokens: The river was generally used to create water defenses , and it is these that give the chateaux the quaint quality that so many have .


fn_spacy_tokens_for_baseline: Montgomery gave a short exhalation which could have represented disbelief , frustration or simple boredom .

source_bert_toks: montgomery gave a short ex ##hala ##tion which could have represented disbelief , frustration or simple boredom .

reference_raw: Montgomery let out a brief breath that might have been incredulity, frustration, or simple boredom.

reference_spacy_tokens: Montgomery let out a brief breath that might have been incredulity , frustration , or simple boredom .


fn_spacy_tokens_for_baseline: Normally he could go for weeks without being so indulgent ; but the MacQuillan case had brought Rain Morgan back into his life and with her some poignant memories .

source_bert_toks: normally he could go for weeks without being so ind ##ul ##gent ; but the mac ##quil ##lan case had brought rain morgan back into his life and with her some po ##ignant memories .

reference_raw: Normally, he could have gone for weeks without so much indulgence; but the MacQuillan case had brought Rain Morgan back into his life, and with it a few poignant memories.

reference_spacy_tokens: Normally , he could have gone for weeks without so much indulgence ; but the MacQuillan case had brought Rain Morgan back into his life , and with it a few poignant memories .


fn_spacy_tokens_for_baseline: I 'll take you to a lawyer tomorrow morning . '

source_bert_toks: i ' ll take you to a lawyer tomorrow morning . '

reference_raw: I'll get you to the lawyer's office in the morning.'

reference_spacy_tokens: I 'll get you to the lawyer 's office in the morning . '


fn_spacy_tokens_for_baseline: She is still a bit shy but she 's tremendous with me .

source_bert_toks: she is still a bit shy but she ' s tremendous with me .

reference_raw: She's still a little shy, but she's great with me.

reference_spacy_tokens: She 's still a little shy , but she 's great with me .


fn_spacy_tokens_for_baseline: The hapless passenger travelling on Sunday from Paris to the southern town of Toulouse dropped his wallet down the toilet , bent to scoop it out and trapped his hand in the bowl .

source_bert_toks: the ha ##ples ##s passenger travelling on sunday from paris to the southern town of toulouse dropped his wallet down the toilet , bent to scoop it out and trapped his hand in the bowl .

reference_raw: A hapless passenger who travels from Paris to Toulouse's southern city on Sunday dropped his purse into the bathroom, bent down to pick it up, and put his hand in the bowl.

reference_spacy_tokens: A hapless passenger who travels from Paris to Toulouse 's southern city on Sunday dropped his purse into the bathroom , bent down to pick it up , and put his hand in the bowl .


fn_spacy_tokens_for_baseline: He would have shamed an angel with his table manners . )

source_bert_toks: he would have shame ##d an angel with his table manners . )

reference_raw: He'd disgrace an angel with his table manners.)

reference_spacy_tokens: He 'd disgrace an angel with his table manners . )


fn_spacy_tokens_for_baseline: Sufferers from diabetes and epilepsy , or those given counterfeit antibiotics , could be particularly at risk , said the Association of the British Pharmaceutical Industry .

source_bert_toks: suffer ##ers from diabetes and ep ##ile ##psy , or those given counter ##feit antibiotics , could be particularly at risk , said the association of the british pharmaceutical industry .

reference_raw: Suffers from diabetes and epilepsy, or forged antibiotics, may be particularly at risk, said the British Pharmaceutical Industry Association.

reference_spacy_tokens: Suffers from diabetes and epilepsy , or forged antibiotics , may be particularly at risk , said the British Pharmaceutical Industry Association .


fn_spacy_tokens_for_baseline: California should therefore begin immediately to phase the utility out of the procurement function entirely , with the goal of having all customers served by a non - utility provider within 36 months .

source_bert_toks: california should therefore begin immediately to phase the utility out of the procurement function entirely , with the goal of having all customers served by a non - utility provider within 36 months .

reference_raw: California should therefore immediately begin to phase out the public service obligation in full, in order to have all customers served by a non-utility provider within 36 months.

reference_spacy_tokens: California should therefore immediately begin to phase out the public service obligation in full , in order to have all customers served by a non - utility provider within 36 months .


fn_spacy_tokens_for_baseline: Whenever Shiva considered the word he saw in his mind 's eye a grinning Mephistopheles with small , curly ram 's horns , capering in frock coat .

source_bert_toks: whenever shiva considered the word he saw in his mind ' s eye a grinning me ##phi ##sto ##ph ##eles with small , curly ram ' s horns , cape ##ring in fr ##ock coat .

reference_raw: Whenever Shiva considered the word, he saw in his mind a grinning Mephistophele with the horns of a small, curly ram caping in a frock coat.

reference_spacy_tokens: Whenever Shiva considered the word , he saw in his mind a grinning Mephistophele with the horns of a small , curly ram caping in a frock coat .


fn_spacy_tokens_for_baseline: On the other hand , Groove Tubes ' primary motivation is serving the music community by offering a product for the artist and musician who can hear the difference between guitars , amps , pickups and tubes .

source_bert_toks: on the other hand , groove tubes ' primary motivation is serving the music community by offering a product for the artist and musician who can hear the difference between guitars , amp ##s , pickup ##s and tubes .

reference_raw: On the other hand, the main motive for Groove Tubes is to serve the music community by offering a product to an artist and a musician who can hear the difference between guitars, amps, pickups and pipes.

reference_spacy_tokens: On the other hand , the main motive for Groove Tubes is to serve the music community by offering a product to an artist and a musician who can hear the difference between guitars , amps , pickups and pipes .


fn_spacy_tokens_for_baseline: Men , women and children desperate for food had been systematically annihilated by the burning toxins .

source_bert_toks: men , women and children desperate for food had been systematically ann ##ih ##ila ##ted by the burning toxin ##s .

reference_raw: Men, women and children desperate for food were systematically destroyed by burning toxins.

reference_spacy_tokens: Men , women and children desperate for food were systematically destroyed by burning toxins .


fn_spacy_tokens_for_baseline: Roman power was declining generally , but it was still strong in Zurich , and the beheading of Felix and his sister Regula , two Christians , was ordered by the governor .

source_bert_toks: roman power was declining generally , but it was still strong in zurich , and the be ##head ##ing of felix and his sister reg ##ula , two christians , was ordered by the governor .

reference_raw: Roman power fell in general, but in Zurich it was still strong, and the governor ordered the execution of Felix and his sister Regula, two Christians.

reference_spacy_tokens: Roman power fell in general , but in Zurich it was still strong , and the governor ordered the execution of Felix and his sister Regula , two Christians .


fn_spacy_tokens_for_baseline: The Khedive had his Prime Minister , his Ministers and his Ministries .

source_bert_toks: the k ##hed ##ive had his prime minister , his ministers and his ministries .

reference_raw: He had his prime minister, ministers, and ministers.

reference_spacy_tokens: He had his prime minister , ministers , and ministers .


fn_spacy_tokens_for_baseline: A surge of adrenalin banished the early morning queasiness , and the feeling of excitement came back as we examined this new land through binoculars .

source_bert_toks: a surge of ad ##ren ##ali ##n banished the early morning que ##asi ##ness , and the feeling of excitement came back as we examined this new land through binoculars .

reference_raw: A rush of adrenalin drove the morning's discomfort away, and the sensation of excitement returned as we examined the new country through the telescope.

reference_spacy_tokens: A rush of adrenalin drove the morning 's discomfort away , and the sensation of excitement returned as we examined the new country through the telescope .


fn_spacy_tokens_for_baseline: Arriving late to find all moving stairways were out of order a panicky half mile sprint was needed to catch our plane .

source_bert_toks: arriving late to find all moving stairway ##s were out of order a panic ##ky half mile sprint was needed to catch our plane .

reference_raw: It was too late to find that all the stairwells were out of order for a panicky half-mile run to catch our plane.

reference_spacy_tokens: It was too late to find that all the stairwells were out of order for a panicky half - mile run to catch our plane .


fn_spacy_tokens_for_baseline: The oxygen and air cylinders were covered and a three way tap attached to the nasal cannulas .

source_bert_toks: the oxygen and air cylinders were covered and a three way tap attached to the nasal can ##nu ##las .

reference_raw: Oxygen and air bottles were covered, and a three-way tap was attached to the nasal cannula.

reference_spacy_tokens: Oxygen and air bottles were covered , and a three - way tap was attached to the nasal cannula .


fn_spacy_tokens_for_baseline: He was chained to a rock and his liver , though continually devoured by an eagle , never diminished .

source_bert_toks: he was chained to a rock and his liver , though continually dev ##oured by an eagle , never diminished .

reference_raw: He was bound to the stone and his liver, though still eaten by the eagle, was never diminished.

reference_spacy_tokens: He was bound to the stone and his liver , though still eaten by the eagle , was never diminished .


fn_spacy_tokens_for_baseline: Many in the Latin American / Caribbean Group of staff , in discussing this paper , disagreed strongly that scholarships usually efficiently strengthen the poor .

source_bert_toks: many in the latin american / caribbean group of staff , in discussing this paper , disagreed strongly that scholarships usually efficiently strengthen the poor .

reference_raw: Many in the Latin American/Caribbean staff group, when discussing this document, strongly disagreed with the fact that scholarships are usually effective in boosting the poor.

reference_spacy_tokens: Many in the Latin American / Caribbean staff group , when discussing this document , strongly disagreed with the fact that scholarships are usually effective in boosting the poor .


fn_spacy_tokens_for_baseline: Ernest ' Honest ' Johns approached us as we slunk out of the club .

source_bert_toks: ernest ' honest ' johns approached us as we sl ##unk out of the club .

reference_raw: As we ducked out of the club, Ernest 'Honest' Johns approached us.

reference_spacy_tokens: As we ducked out of the club , Ernest ' Honest ' Johns approached us .


fn_spacy_tokens_for_baseline: Dozens of impresarios got a piece of the now clandestine action , battling , often bloodily , for control over neighbourhoods .

source_bert_toks: dozens of imp ##res ##ario ##s got a piece of the now clandestine action , battling , often blood ##ily , for control over neighbourhoods .

reference_raw: Dozens of impresarios received part of what was now a secret act, fighting, often bloodily, to control the neighborhood.

reference_spacy_tokens: Dozens of impresarios received part of what was now a secret act , fighting , often bloodily , to control the neighborhood .


fn_spacy_tokens_for_baseline: Harmonic lines are most commonly in two forms : ( 1 ) Parallels that may be straight , or curves of similar radius , concentric curves or mixtures of these .

source_bert_toks: harmonic lines are most commonly in two forms : ( 1 ) parallels that may be straight , or curves of similar radius , con ##centric curves or mixture ##s of these .

reference_raw: Harmonic lines are usually in two forms: (1) Parallels which can be straight, or curvatures of similar radius, concentric curvatures or combinations thereof.

reference_spacy_tokens: Harmonic lines are usually in two forms : ( 1 ) Parallels which can be straight , or curvatures of similar radius , concentric curvatures or combinations thereof .


fn_spacy_tokens_for_baseline: Speaking to reporters Saturday , he suggested France was being opportunistic by making the proposal to Bonn after it had resumed the nuclear tests .

source_bert_toks: speaking to reporters saturday , he suggested france was being op ##port ##uni ##stic by making the proposal to bonn after it had resumed the nuclear tests .

reference_raw: He spoke to the reporters on Saturday and suggested that France would be opportunistic by proposing to Bonn after the nuclear tests were resumed.

reference_spacy_tokens: He spoke to the reporters on Saturday and suggested that France would be opportunistic by proposing to Bonn after the nuclear tests were resumed .


fn_spacy_tokens_for_baseline: When he died shortly after his eightieth birthday , Oskar Reinhart bequeathed the entire Am Romerholz treasury of painting to the people of Winterthur .

source_bert_toks: when he died shortly after his eight ##ie ##th birthday , oskar rein ##hart bequeathed the entire am rome ##rh ##ol ##z treasury of painting to the people of winter ##th ##ur .

reference_raw: When Oscar Reinhart died shortly after his 80th birthday, he left the entire Am Romerholz treasure of painting to the people of Winterthur.

reference_spacy_tokens: When Oscar Reinhart died shortly after his 80th birthday , he left the entire Am Romerholz treasure of painting to the people of Winterthur .


fn_spacy_tokens_for_baseline: She clung to me , and then she ran away ; she dashed through the flowers in the long grass , she twirled around a tree and sent lizards scuttling , she skipped along a sandy path .

source_bert_toks: she clung to me , and then she ran away ; she dashed through the flowers in the long grass , she t ##wi ##rled around a tree and sent lizards sc ##ut ##tling , she skipped along a sandy path .

reference_raw: She clung to me, then ran away, ran through the flowers in the long grass, turned around the tree, sent the lizards scuttling, and skipped down the sandy path.

reference_spacy_tokens: She clung to me , then ran away , ran through the flowers in the long grass , turned around the tree , sent the lizards scuttling , and skipped down the sandy path .


fn_spacy_tokens_for_baseline: In the case of divorced couples who have remarried the vote will go to both natural parents and the spouse of the natural parent who has custody of the child .

source_bert_toks: in the case of divorced couples who have remarried the vote will go to both natural parents and the spouse of the natural parent who has custody of the child .

reference_raw: In the case of divorced couples who have remarried, the vote shall be taken by both the natural parents and the husband of the natural parent who has custody of the child.

reference_spacy_tokens: In the case of divorced couples who have remarried , the vote shall be taken by both the natural parents and the husband of the natural parent who has custody of the child .


fn_spacy_tokens_for_baseline: At the time we saw her , Jean was living in a hostel in North London and attending a psychiatric day centre .

source_bert_toks: at the time we saw her , jean was living in a hostel in north london and attending a psychiatric day centre .

reference_raw: When we saw her, Jean lived in a hotel in North London and went to the Psychiatric Day Center.

reference_spacy_tokens: When we saw her , Jean lived in a hotel in North London and went to the Psychiatric Day Center .


fn_spacy_tokens_for_baseline: Posing as a financial adviser , he told them he could make a quick fortune on the house , farm and flats left by her husband Peter .

source_bert_toks: posing as a financial adviser , he told them he could make a quick fortune on the house , farm and flats left by her husband peter .

reference_raw: He pretended to be a financial advisor and told them that he could make a quick fortune on the house, farm, and apartments that her husband, Peter, had abandoned.

reference_spacy_tokens: He pretended to be a financial advisor and told them that he could make a quick fortune on the house , farm , and apartments that her husband , Peter , had abandoned .


fn_spacy_tokens_for_baseline: 15 days after the killing , thousands mourned today in Liverpool .

source_bert_toks: 15 days after the killing , thousands mo ##urne ##d today in liverpool .

reference_raw: Fifteen days after the murder, thousands of people in Liverpool were grieving today.

reference_spacy_tokens: Fifteen days after the murder , thousands of people in Liverpool were grieving today .


fn_spacy_tokens_for_baseline: Mr Workman was a tall rangy Presbyterian with crew - cut greying hair and was an inveterate pipe - smoker .

source_bert_toks: mr work ##man was a tall rang ##y presbyterian with crew - cut grey ##ing hair and was an in ##vet ##erate pipe - smoke ##r .

reference_raw: Mr. Workman was a tall, ranged Presbyterian with a crew-cut gray hair and a pipe smoker.

reference_spacy_tokens: Mr. Workman was a tall , ranged Presbyterian with a crew - cut gray hair and a pipe smoker .


fn_spacy_tokens_for_baseline: The body carries no identification .

source_bert_toks: the body carries no identification .

reference_raw: There's no I.D. on the body.

reference_spacy_tokens: There 's no I.D. on the body .


fn_spacy_tokens_for_baseline: Despite numerous firefights with the insurgents , none of the Bravo Company Marines has been wounded .

source_bert_toks: despite numerous fire ##fight ##s with the insurgents , none of the bravo company marines has been wounded .

reference_raw: Despite many shootings with the rebels, none of Bravo's Marines were injured.

reference_spacy_tokens: Despite many shootings with the rebels , none of Bravo 's Marines were injured .


fn_spacy_tokens_for_baseline: After two weeks it started snowing and the ground froze .

source_bert_toks: after two weeks it started snow ##ing and the ground froze .

reference_raw: Two weeks later it began to snow and the ground stiffened.

reference_spacy_tokens: Two weeks later it began to snow and the ground stiffened .


fn_spacy_tokens_for_baseline: It will be our object in this book to combine the insights from these approaches in a multilevel , multifunction view of style which will be applicable to the practical study of texts .

source_bert_toks: it will be our object in this book to combine the insights from these approaches in a multi ##lev ##el , multi ##fu ##nction view of style which will be applicable to the practical study of texts .

reference_raw: Our purpose in this book is to combine the insights of these approaches in a multi-level, multi-functional view of style that will be used for the practical study of texts.

reference_spacy_tokens: Our purpose in this book is to combine the insights of these approaches in a multi - level , multi - functional view of style that will be used for the practical study of texts .


fn_spacy_tokens_for_baseline: This fine example of a 16th - century longhouse , with thick cob walls and open fireplaces , is set in fifteen acres of rolling countryside and commands magnificent panoramic views .

source_bert_toks: this fine example of a 16th - century long ##house , with thick co ##b walls and open fireplace ##s , is set in fifteen acres of rolling countryside and commands magnificent pan ##ora ##mic views .

reference_raw: This fine example of a 16th century long house with thick cob walls and open hearths is set in fifteen acres of rolling countryside and commands magnificent panoramic views.

reference_spacy_tokens: This fine example of a 16th century long house with thick cob walls and open hearths is set in fifteen acres of rolling countryside and commands magnificent panoramic views .


fn_spacy_tokens_for_baseline: Our makeshift seat had consisted of cases of wine while bottles of brandy were distributed liberally amongst the boys ' bedding , none of which had been declared to us , of course .

source_bert_toks: our makeshift seat had consisted of cases of wine while bottles of brandy were distributed liberal ##ly amongst the boys ' bed ##ding , none of which had been declared to us , of course .

reference_raw: Our makeshift seat consisted of boxes of wine, while the bottles of brandy were liberally distributed among the boys' beds, none of which, of course, had been reported to us.

reference_spacy_tokens: Our makeshift seat consisted of boxes of wine , while the bottles of brandy were liberally distributed among the boys ' beds , none of which , of course , had been reported to us .


fn_spacy_tokens_for_baseline: I put this down to having lots of plants for the fry to hide in , and my practice of leaving a very dim light on during the night which is controlled by a dimmer switch .

source_bert_toks: i put this down to having lots of plants for the fry to hide in , and my practice of leaving a very dim light on during the night which is controlled by a dim ##mer switch .

reference_raw: I've put it down to having a lot of plants to hide in, and my practice of keeping a very faint light on during the night, which is controlled by a dark switch.

reference_spacy_tokens: I 've put it down to having a lot of plants to hide in , and my practice of keeping a very faint light on during the night , which is controlled by a dark switch .


fn_spacy_tokens_for_baseline: Conditions stayed favourable and when we got to the headland of Volunteer Point , the small boat was launched and we were ferried ashore with only the odd wet foot resulting from the landing .

source_bert_toks: conditions stayed favourable and when we got to the head ##land of volunteer point , the small boat was launched and we were fe ##rrie ##d ashore with only the odd wet foot resulting from the landing .

reference_raw: The conditions remained favourable, and when we reached the headland of Volunteer Point, the small ship was released and we were ferryed to shore with only the odd wet foot of the landing.

reference_spacy_tokens: The conditions remained favourable , and when we reached the headland of Volunteer Point , the small ship was released and we were ferryed to shore with only the odd wet foot of the landing .


fn_spacy_tokens_for_baseline: We headed out along the waterfront towards the port , but it felt as if I was treading water .

source_bert_toks: we headed out along the waterfront towards the port , but it felt as if i was tread ##ing water .

reference_raw: We walked along the waterfront to the harbor, but I felt like I was treading water.

reference_spacy_tokens: We walked along the waterfront to the harbor , but I felt like I was treading water .


fn_spacy_tokens_for_baseline: Audiences might like to quiz him about his favourite sporting moment .

source_bert_toks: audiences might like to quiz him about his favourite sporting moment .

reference_raw: The audience would like to question him about his favorite sporting moment.

reference_spacy_tokens: The audience would like to question him about his favorite sporting moment .


fn_spacy_tokens_for_baseline: Portable kit developed to screen nerve agent

source_bert_toks: portable kit developed to screen nerve agent

reference_raw: Portability set developed for the screening of nerve agents


fn_spacy_tokens_for_baseline: New anti - terrorism laws give police a freer hand to round up suspects and hold them indefinitely without trial .

source_bert_toks: new anti - terrorism laws give police a free ##r hand to round up suspects and hold them indefinitely without trial .

reference_raw: The new anti-terrorist laws give the police a freer hand to gather suspects and hold them indefinitely without a trial.

reference_spacy_tokens: The new anti - terrorist laws give the police a freer hand to gather suspects and hold them indefinitely without a trial .


fn_spacy_tokens_for_baseline: Coughing was a bleak thought , the way my chest hurt .

source_bert_toks: coughing was a bleak thought , the way my chest hurt .

reference_raw: The coughing was a sad thought, the pain in my chest.

reference_spacy_tokens: The coughing was a sad thought , the pain in my chest .


fn_spacy_tokens_for_baseline: The house was built in 1865 by a member of the Man clan who achieved the rank of tai fu ( mandarin ) by doing well in the Imperial Examinations .

source_bert_toks: the house was built in 1865 by a member of the man clan who achieved the rank of tai fu ( mandarin ) by doing well in the imperial examinations .

reference_raw: The house was built in 1865 by a member of the Man-Clan, who achieved the status of tai fu (mandarin) by doing well in the Imperial Examinations.

reference_spacy_tokens: The house was built in 1865 by a member of the Man - Clan , who achieved the status of tai fu ( mandarin ) by doing well in the Imperial Examinations .


fn_spacy_tokens_for_baseline: The man had a rasping cough that exploded from his lungs in noisy barks which often left him groaning and gasping for breath .

source_bert_toks: the man had a ras ##ping cough that exploded from his lungs in noisy bark ##s which often left him groaning and gasping for breath .

reference_raw: The man had a rasping cough that exploded out of his lungs in loud barks that often left him groaning and gasping.

reference_spacy_tokens: The man had a rasping cough that exploded out of his lungs in loud barks that often left him groaning and gasping .


fn_spacy_tokens_for_baseline: ' I do n't have all that much spending money for this holiday , ' she explained , seeing a flicker of surprised cynicism in Guy Sterne 's eyes , and flushing a little .

source_bert_toks: ' i don ' t have all that much spending money for this holiday , ' she explained , seeing a flicker of surprised cy ##nic ##ism in guy stern ##e ' s eyes , and flushing a little .

reference_raw: "I don't spend so much money on this holiday," she said, seeing a flash of surprised cynicism in Guy Sterne's eyes and blushing a bit.

reference_spacy_tokens: " I do n't spend so much money on this holiday , " she said , seeing a flash of surprised cynicism in Guy Sterne 's eyes and blushing a bit .


fn_spacy_tokens_for_baseline: But have only one centimetre of bare flesh in contact -- and the building would absorb you .

source_bert_toks: but have only one cent ##ime ##tre of bare flesh in contact - - and the building would absorb you .

reference_raw: But only an inch of naked flesh is in contact - and the building will absorb you.

reference_spacy_tokens: But only an inch of naked flesh is in contact - and the building will absorb you .


fn_spacy_tokens_for_baseline: Add the chopped pepper and the cumin seeds to the saucepan and bubble gently over a medium heat for 8 - 10 minutes until the pepper is soft .

source_bert_toks: add the chopped pepper and the cum ##in seeds to the sauce ##pan and bubble gently over a medium heat for 8 - 10 minutes until the pepper is soft .

reference_raw: Add the sliced paprika and cumin seeds to the saucepan and bubble gently over the medium temperature for 8 to 10 minutes until it is soft.

reference_spacy_tokens: Add the sliced paprika and cumin seeds to the saucepan and bubble gently over the medium temperature for 8 to 10 minutes until it is soft .


fn_spacy_tokens_for_baseline: We can not discern a bird at this altitude , but the vulture is able to survey the land for many kilometres around it , and locate a fresh kill .

source_bert_toks: we can not disc ##ern a bird at this altitude , but the vulture is able to survey the land for many kilometres around it , and locate a fresh kill .

reference_raw: We can't make out a bird at this altitude, but the vulture can search the ground for miles around it and find a new kill.

reference_spacy_tokens: We ca n't make out a bird at this altitude , but the vulture can search the ground for miles around it and find a new kill .


fn_spacy_tokens_for_baseline: As Emer Colleran , chairperson of An Taisce , noted , Gold EIA contained members of national and local bodies involved in towns , agriculture , aquaculture , recreational use of the environment and environmental conservation .

source_bert_toks: as em ##er col ##ler ##an , chairperson of an tai ##sc ##e , noted , gold e ##ia contained members of national and local bodies involved in towns , agriculture , aqua ##culture , recreational use of the environment and environmental conservation .

reference_raw: As Emer Colleran, President of the Taisce, noted, the Gold Environmental Impact Assessment included members of national and local authorities involved in cities, agriculture, aquaculture, recreational use of the environment and the protection of the environment.

reference_spacy_tokens: As Emer Colleran , President of the Taisce , noted , the Gold Environmental Impact Assessment included members of national and local authorities involved in cities , agriculture , aquaculture , recreational use of the environment and the protection of the environment .


fn_spacy_tokens_for_baseline: He pondered over how to refuse old Igor 's invitation .

source_bert_toks: he pondered over how to refuse old igor ' s invitation .

reference_raw: He considered rejecting old Igor's invitation.

reference_spacy_tokens: He considered rejecting old Igor 's invitation .


fn_spacy_tokens_for_baseline: At around 3500 b.c . , a sophisticated culture evolved in the Cyclades islands .

source_bert_toks: at around 350 ##0 b . c . , a sophisticated culture evolved in the cy ##cl ##ades islands .

reference_raw: Around 3,500 B.C., an advanced culture developed on the islands of Cyclades.

reference_spacy_tokens: Around 3,500 B.C. , an advanced culture developed on the islands of Cyclades .


fn_spacy_tokens_for_baseline: Sometimes the tunes are ethereal and somnolent like Brian Eno after a whole bottle of Actifed .

source_bert_toks: sometimes the tunes are ether ##eal and so ##m ##no ##lent like brian en ##o after a whole bottle of act ##ife ##d .

reference_raw: Sometimes the melodies are ethereal and sleepy, like Brian Eno after a bottle of Actifed.

reference_spacy_tokens: Sometimes the melodies are ethereal and sleepy , like Brian Eno after a bottle of Actifed .


fn_spacy_tokens_for_baseline: They are ready to work , hungry to act , full of love for their humble craft , keen , eager and centred .

source_bert_toks: they are ready to work , hungry to act , full of love for their humble craft , keen , eager and centred .

reference_raw: They're ready to work, starving to act, full of love for their humble craft, eager, eager and centered.

reference_spacy_tokens: They 're ready to work , starving to act , full of love for their humble craft , eager , eager and centered .


fn_spacy_tokens_for_baseline: She felt suddenly more secure despite the fact that she was flanked by men with knives .

source_bert_toks: she felt suddenly more secure despite the fact that she was flanked by men with knives .

reference_raw: She felt suddenly safer, despite the fact that she was surrounded by men with knives.

reference_spacy_tokens: She felt suddenly safer , despite the fact that she was surrounded by men with knives .


fn_spacy_tokens_for_baseline: Away from Mogadishu , aid workers were reported by mid - December to be urging the US forces to speed up their arrival and there were reports of continuing attacks on aid centres and workers by armed looters .

source_bert_toks: away from mo ##ga ##dis ##hu , aid workers were reported by mid - december to be urging the us forces to speed up their arrival and there were reports of continuing attacks on aid centres and workers by armed lo ##ote ##rs .

reference_raw: In mid-December, outside Mogadishu, aid workers were reported to urge the US forces to speed up their arrival, and there were reports of continued attacks on aid centers and workers by armored looters.

reference_spacy_tokens: In mid - December , outside Mogadishu , aid workers were reported to urge the US forces to speed up their arrival , and there were reports of continued attacks on aid centers and workers by armored looters .


fn_spacy_tokens_for_baseline: ' What about Sunday , we could have a picnic , ' Mary continued with a slight plea in her voice .

source_bert_toks: ' what about sunday , we could have a picnic , ' mary continued with a slight plea in her voice .

reference_raw: "Sunday, maybe we'll have a party," Mary went on with a slight plea in her voice.

reference_spacy_tokens: " Sunday , maybe we 'll have a party , " Mary went on with a slight plea in her voice .


fn_spacy_tokens_for_baseline: He tossed his head disgustedly .

source_bert_toks: he tossed his head disgusted ##ly .

reference_raw: He shook his head in disgust.

reference_spacy_tokens: He shook his head in disgust .


fn_spacy_tokens_for_baseline: Mussels can live for several years , but are very sensitive to ammonia and nitrite .

source_bert_toks: mu ##ssel ##s can live for several years , but are very sensitive to ammonia and ni ##tri ##te .

reference_raw: The mussels may live for a few years, but they're very susceptible to ammonia and nitrite.

reference_spacy_tokens: The mussels may live for a few years , but they 're very susceptible to ammonia and nitrite .


fn_spacy_tokens_for_baseline: Impatiently she pulled off the blouse and unhooked the brassiere , throwing them out of sight into the pool house .

source_bert_toks: impatiently she pulled off the blouse and un ##ho ##oked the brass ##iere , throwing them out of sight into the pool house .

reference_raw: Impatiently, she removed her blouse and unhooked the brazier and threw it out of sight into the pool house.

reference_spacy_tokens: Impatiently , she removed her blouse and unhooked the brazier and threw it out of sight into the pool house .


fn_spacy_tokens_for_baseline: Being now the proud possessors of these shocking and daring items , they were determined to try them out .

source_bert_toks: being now the proud possess ##ors of these shocking and daring items , they were determined to try them out .

reference_raw: Now that they were proud possessors of these appalling and daring things, they were determined to test them.

reference_spacy_tokens: Now that they were proud possessors of these appalling and daring things , they were determined to test them .


fn_spacy_tokens_for_baseline: Sofia 's cosmopolitan flair was evident at Machu Picchu , a bustling Mexican restaurant .

source_bert_toks: sofia ' s cosmopolitan flair was evident at mach ##u pic ##chu , a bust ##ling mexican restaurant .

reference_raw: Sofia's cosmopolitan taste was obvious in Machu Picchu, a busy Mexican restaurant.

reference_spacy_tokens: Sofia 's cosmopolitan taste was obvious in Machu Picchu , a busy Mexican restaurant .


fn_spacy_tokens_for_baseline: Total abstinence from any sweeteners can cure a sweet tooth permanently -- which is much better in the long term .

source_bert_toks: total abs ##tine ##nce from any sweet ##ener ##s can cure a sweet tooth permanently - - which is much better in the long term .

reference_raw: The complete absence of any sweetener can cure the sweet tooth permanently - which is much better in the long run.

reference_spacy_tokens: The complete absence of any sweetener can cure the sweet tooth permanently - which is much better in the long run .


fn_spacy_tokens_for_baseline: Fuel flow is easily controlled by a knob on top of the cartridge attachment .

source_bert_toks: fuel flow is easily controlled by a knob on top of the cartridge attachment .

reference_raw: The fuel flow is easily controlled by a button at the top of the cartridge.

reference_spacy_tokens: The fuel flow is easily controlled by a button at the top of the cartridge .


fn_spacy_tokens_for_baseline: She says working as a shiatsu therapist is also risky because the treatment is expensive and people are not always willing to pay when money is short .

source_bert_toks: she says working as a shia ##tsu therapist is also risky because the treatment is expensive and people are not always willing to pay when money is short .

reference_raw: He says that working as a shiatsu therapy therapy is also risky because it's expensive and people don't always want to pay when the money's short.

reference_spacy_tokens: He says that working as a shiatsu therapy therapy is also risky because it 's expensive and people do n't always want to pay when the money 's short .


fn_spacy_tokens_for_baseline: Ca n't you just hear the children 's playful squabbles at the rabbit hutches over whether to have that fluffy grey one as a pet , or as a casserole ?

source_bert_toks: can ' t you just hear the children ' s playful sq ##ua ##bble ##s at the rabbit hut ##ches over whether to have that fluffy grey one as a pet , or as a cass ##ero ##le ?

reference_raw: Can't you hear the children's playful squawks in rabbit huts about whether to wear the fluffy gray one as a pet or as a casserole?

reference_spacy_tokens: Ca n't you hear the children 's playful squawks in rabbit huts about whether to wear the fluffy gray one as a pet or as a casserole ?


fn_spacy_tokens_for_baseline: Chesarynth thought it was her own screaming and embarrassment boiled through her but when she looked round , bodies were twitching and smoking everywhere as the computer - banks sparked into flame .

source_bert_toks: che ##sar ##yn ##th thought it was her own screaming and embarrassment boiled through her but when she looked round , bodies were twitching and smoking everywhere as the computer - banks sparked into flame .

reference_raw: Chesarynth thought it was her own scream and shame, but when she looked around, the bodies twitched and smoked everywhere as the computer banks flared.

reference_spacy_tokens: Chesarynth thought it was her own scream and shame , but when she looked around , the bodies twitched and smoked everywhere as the computer banks flared .


fn_spacy_tokens_for_baseline: The huge hydro - electric dam project at Konable will flood good farming land , but the flow of investment dollars has financed a boom in luxury goods for the rich minority .

source_bert_toks: the huge hydro - electric dam project at ko ##nable will flood good farming land , but the flow of investment dollars has financed a boom in luxury goods for the rich minority .

reference_raw: The huge hydroelectric dam project in Konable will overflow good agricultural land, but the flow of investment dollars has funded the boom in luxury goods for the rich minority.

reference_spacy_tokens: The huge hydroelectric dam project in Konable will overflow good agricultural land , but the flow of investment dollars has funded the boom in luxury goods for the rich minority .


fn_spacy_tokens_for_baseline: Today 's development is that the country 's spy agency will help ensure compliance .

source_bert_toks: today ' s development is that the country ' s spy agency will help ensure compliance .

reference_raw: Today's evolution is that the country's intelligence agency will help to ensure compliance.

reference_spacy_tokens: Today 's evolution is that the country 's intelligence agency will help to ensure compliance .


fn_spacy_tokens_for_baseline: A fine stone bridge spans the beck below Swinner Gill Kirk and I crossed it to follow the gill back below Moss Dam Hags and out along the top of Arn Gill Scar .

source_bert_toks: a fine stone bridge spans the beck below sw ##inn ##er gill kirk and i crossed it to follow the gill back below moss dam ha ##gs and out along the top of ar ##n gill scar .

reference_raw: A fine stone bridge spans the deck below Swinner Gill Kirk, and I crossed it to follow the gill below the Moss Dam Hags and along the top of Arn Gill Scar.

reference_spacy_tokens: A fine stone bridge spans the deck below Swinner Gill Kirk , and I crossed it to follow the gill below the Moss Dam Hags and along the top of Arn Gill Scar .


fn_spacy_tokens_for_baseline: Caroline 's brothers grinned alongside her , clones of their father .

source_bert_toks: caroline ' s brothers grinned alongside her , clones of their father .

reference_raw: Caroline's brothers smiled with her, their father's clons.

reference_spacy_tokens: Caroline 's brothers smiled with her , their father 's clons .


fn_spacy_tokens_for_baseline: Motivation : The terrorist groups of greatest concern are motivated to inflict indiscriminate mass casualties ( random ; not targeting a specific person or persons ) and to engage in innovative and risky tactics .

source_bert_toks: motivation : the terrorist groups of greatest concern are motivated to in ##flict ind ##is ##cr ##imi ##nate mass casualties ( random ; not targeting a specific person or persons ) and to engage in innovative and risky tactics .

reference_raw: Motivation: Terrorist groups of greatest concern are encouraged to cause indiscriminate mass casualties (random; not targeting a particular person or persons) and to engage in innovative and risky tactics.

reference_spacy_tokens: Motivation : Terrorist groups of greatest concern are encouraged to cause indiscriminate mass casualties ( random ; not targeting a particular person or persons ) and to engage in innovative and risky tactics .


fn_spacy_tokens_for_baseline: ' It is very pleasant to see the first green shoots upon the hedges and the catkins on the hazels once again .

source_bert_toks: ' it is very pleasant to see the first green shoots upon the hedges and the cat ##kins on the hazel ##s once again .

reference_raw: 'It's very nice to see the first red fires on the hedges and the catkins on the hazels again.

reference_spacy_tokens: ' It 's very nice to see the first red fires on the hedges and the catkins on the hazels again .


fn_spacy_tokens_for_baseline: I want to fix waney - edged boards on my house .

source_bert_toks: i want to fix wan ##ey - edged boards on my house .

reference_raw: I want to make waney boards in my house.

reference_spacy_tokens: I want to make waney boards in my house .


fn_spacy_tokens_for_baseline: In 1651 Parliament appointed commissioners to sell Exmoor Forest , which was reported to be ' mountainous and cold ground , much beclouded with thick fogges and mists and . overgrown with heath and yielding but a poor kind of turf of little value there . '

source_bert_toks: in 1651 parliament appointed commissioners to sell ex ##moor forest , which was reported to be ' mountainous and cold ground , much be ##cl ##oud ##ed with thick fog ##ges and mist ##s and . overgrown with heath and yielding but a poor kind of turf of little value there . '

reference_raw: In 1651, Parliament appointed a commissioner to sell the Exmoor Forest, which was said to be 'mountainous and cold ground, much covered with thick mists and fogs and .. overgrown with heath and yielding, but poor grass of little value.'

reference_spacy_tokens: In 1651 , Parliament appointed a commissioner to sell the Exmoor Forest , which was said to be ' mountainous and cold ground , much covered with thick mists and fogs and .. overgrown with heath and yielding , but poor grass of little value . '


fn_spacy_tokens_for_baseline: To conclude , our analysis suggests that the current proposals for the reform of UK competition policy are broadly consistent with the goal of improving economic efficiency in the market place .

source_bert_toks: to conclude , our analysis suggests that the current proposals for the reform of uk competition policy are broadly consistent with the goal of improving economic efficiency in the market place .

reference_raw: In conclusion, our analysis suggests that the current proposals to reform UK competition policy are broadly in line with the objective of improving economic efficiency in the marketplace.

reference_spacy_tokens: In conclusion , our analysis suggests that the current proposals to reform UK competition policy are broadly in line with the objective of improving economic efficiency in the marketplace .


fn_spacy_tokens_for_baseline: Though Polly had little sympathy for Clive after what he had put her through , this merciless dismissal of another man 's entire future made her skin crawl .

source_bert_toks: though polly had little sympathy for clive after what he had put her through , this mer ##ci ##less dismissal of another man ' s entire future made her skin crawl .

reference_raw: Although Polly didn't sympathize with Clive after what he'd put her through, the merciless rejection of another man's entire future made her skin crawl.

reference_spacy_tokens: Although Polly did n't sympathize with Clive after what he 'd put her through , the merciless rejection of another man 's entire future made her skin crawl .


fn_spacy_tokens_for_baseline: Surely the person against whom the criminal enterprise was directed .

source_bert_toks: surely the person against whom the criminal enterprise was directed .

reference_raw: I'm sure it's the person against whom the criminal enterprise was targeted.

reference_spacy_tokens: I 'm sure it 's the person against whom the criminal enterprise was targeted .


fn_spacy_tokens_for_baseline: Carrying a tray of glasses would have been easier if the floor had been stable but I made it to the far end with only a lurch or two and delivered the goods as required .

source_bert_toks: carrying a tray of glasses would have been easier if the floor had been stable but i made it to the far end with only a lu ##rch or two and delivered the goods as required .

reference_raw: It would have been easier to carry a tray of glasses if the floor had been stable, but I reached the other end with only a lurch or two and delivered the goods as required.

reference_spacy_tokens: It would have been easier to carry a tray of glasses if the floor had been stable , but I reached the other end with only a lurch or two and delivered the goods as required .


fn_spacy_tokens_for_baseline: A TOP British pilot has died of altitude sickness in the Himalayas while leading a probe into an air crash .

source_bert_toks: a top british pilot has died of altitude sickness in the himalayas while leading a probe into an air crash .

reference_raw: A TOP British pilot died of altitude disease in the Himalayas as he led the probe into an air crash.

reference_spacy_tokens: A TOP British pilot died of altitude disease in the Himalayas as he led the probe into an air crash .


fn_spacy_tokens_for_baseline: Rhino penises can fetch as much as $ 700 on the open market , while powdered horn is prescribed for everything from high blood pressure to fevers , nose bleeds and insomnia .

source_bert_toks: rhino penis ##es can fetch as much as $ 700 on the open market , while powder ##ed horn is prescribed for everything from high blood pressure to fever ##s , nose bleed ##s and ins ##om ##nia .

reference_raw: Rhino penises can bring up to $700 in the open market, while dusty horns are prescribed for everything from high blood pressure to fever, nose bleeds, and insomnia.

reference_spacy_tokens: Rhino penises can bring up to $ 700 in the open market , while dusty horns are prescribed for everything from high blood pressure to fever , nose bleeds , and insomnia .


fn_spacy_tokens_for_baseline: Helicopters and infantrymen from the 101st Airborne Division captured 41 Iraqi soldiers in separate attacks on Iraqi positions .

source_bert_toks: helicopters and infantry ##men from the 101 ##st airborne division captured 41 iraqi soldiers in separate attacks on iraqi positions .

reference_raw: The helicopters and infantrymen of the 101st Airborne Division captured 41 Iraqi soldiers in separate attacks on Iraqi posts.

reference_spacy_tokens: The helicopters and infantrymen of the 101st Airborne Division captured 41 Iraqi soldiers in separate attacks on Iraqi posts .


fn_spacy_tokens_for_baseline: These claims have yet to be fully investigated , much less verified .

source_bert_toks: these claims have yet to be fully investigated , much less verified .

reference_raw: These allegations have not yet been fully examined, let alone verified.

reference_spacy_tokens: These allegations have not yet been fully examined , let alone verified .


fn_spacy_tokens_for_baseline: Take , I beg you , a word of explanation to Elizabeth Lavenza , my betrothed . '

source_bert_toks: take , i beg you , a word of explanation to elizabeth la ##ven ##za , my bet ##rot ##hed . '

reference_raw: Take a word, please, to Elizabeth Lavenza, my engagement.'

reference_spacy_tokens: Take a word , please , to Elizabeth Lavenza , my engagement . '


fn_spacy_tokens_for_baseline: Back over on Emmerdale ( 9.64 million ) only the ducks have gone quackers !

source_bert_toks: back over on em ##mer ##dale ( 9 . 64 million ) only the ducks have gone qu ##acker ##s !

reference_raw: Back to Emmerdale (9.64 million) only ducks have become quackers!

reference_spacy_tokens: Back to Emmerdale ( 9.64 million ) only ducks have become quackers !


fn_spacy_tokens_for_baseline: The Gombe rainforest is not the sort of Eden we might fondly imagine .

source_bert_toks: the go ##mbe rainforest is not the sort of eden we might fond ##ly imagine .

reference_raw: The Gombe rain forest isn't the kind of paradise we'd like to imagine.

reference_spacy_tokens: The Gombe rain forest is n't the kind of paradise we 'd like to imagine .


fn_spacy_tokens_for_baseline: She buckled a stiff hard belt around Alexandra 's waist and stood back to admire the effect .

source_bert_toks: she buckled a stiff hard belt around alexandra ' s waist and stood back to admire the effect .

reference_raw: She put a stiff, hard belt around Alexandra's waist and stepped back to admire the effect.

reference_spacy_tokens: She put a stiff , hard belt around Alexandra 's waist and stepped back to admire the effect .


fn_spacy_tokens_for_baseline: The Big Three US carmakers , who controlled more than 85 per cent of the luxury market 10 years ago , saw their share drop to below 50 per cent last year .

source_bert_toks: the big three us car ##makers , who controlled more than 85 per cent of the luxury market 10 years ago , saw their share drop to below 50 per cent last year .

reference_raw: Ten years ago, the big three carmakers in the U.S., who controlled over 85 percent of the luxury market, saw their share fall to less than 50 percent last year.

reference_spacy_tokens: Ten years ago , the big three carmakers in the U.S. , who controlled over 85 percent of the luxury market , saw their share fall to less than 50 percent last year .


fn_spacy_tokens_for_baseline: The two soldiers were sprawled there half - asleep .

source_bert_toks: the two soldiers were sprawled there half - asleep .

reference_raw: The two soldiers lay half asleep.

reference_spacy_tokens: The two soldiers lay half asleep .


fn_spacy_tokens_for_baseline: IT IS a beguiling place , Japan : no sooner have westerners worked out how things work there than the country slips from their grasp .

source_bert_toks: it is a beg ##uil ##ing place , japan : no sooner have western ##ers worked out how things work there than the country slips from their grasp .

reference_raw: IT is a fascinating place in Japan: no sooner have the Westerners worked out the way things work here than the country slips out of hand.

reference_spacy_tokens: IT is a fascinating place in Japan : no sooner have the Westerners worked out the way things work here than the country slips out of hand .


fn_spacy_tokens_for_baseline: It was in this highly charged political and military context , which precipitated a " bunker " or " laager " mentality , that Coast was secretly initiated in 1981 under the aegis of the SADF Special Forces .

source_bert_toks: it was in this highly charged political and military context , which pre ##ci ##pit ##ated a " bunker " or " la ##ager " mental ##ity , that coast was secretly initiated in 1981 under the ae ##gis of the sad ##f special forces .

reference_raw: It was in this highly charged political and military context that prompted the "bunker" or "laager" mentality that the coast was secretly launched in 1981 under the auspices of the Special Forces of the SADF.

reference_spacy_tokens: It was in this highly charged political and military context that prompted the " bunker " or " laager " mentality that the coast was secretly launched in 1981 under the auspices of the Special Forces of the SADF .


fn_spacy_tokens_for_baseline: First , could somebody be impersonating a member ?

source_bert_toks: first , could somebody be imp ##erson ##ating a member ?

reference_raw: First of all, can someone pretend to be a member?

reference_spacy_tokens: First of all , can someone pretend to be a member ?


fn_spacy_tokens_for_baseline: There was a sharp crack , and the broken glass fell from his hand , tinkling on to the table and spilling its golden liquid on to the pristine white cloth .

source_bert_toks: there was a sharp crack , and the broken glass fell from his hand , tin ##kling on to the table and spilling its golden liquid on to the pristine white cloth .

reference_raw: There was a sharp crack, and the broken glass fell from his hand, clinking on the table, spilling its golden liquid onto the pristine white cloth.

reference_spacy_tokens: There was a sharp crack , and the broken glass fell from his hand , clinking on the table , spilling its golden liquid onto the pristine white cloth .


fn_spacy_tokens_for_baseline: The butterfly is easier to seduce with a wealth of plants such as the sweet scented hyssopus , with its charming flower spikes and small aromatic leaves .

source_bert_toks: the butterfly is easier to seduce with a wealth of plants such as the sweet scented h ##ys ##sop ##us , with its charming flower spikes and small aromatic leaves .

reference_raw: A butterfly can be more easily seduced by a wealth of plants, such as a sweet-smelling hyssopus, with its charming flower spikes and small flavouring leaves.

reference_spacy_tokens: A butterfly can be more easily seduced by a wealth of plants , such as a sweet - smelling hyssopus , with its charming flower spikes and small flavouring leaves .


fn_spacy_tokens_for_baseline: There are not many , a tiny minority , who have done outrageous things , who 've misbehaved outrageously and who 've been allowed to persist in their misbehaviour .

source_bert_toks: there are not many , a tiny minority , who have done outrageous things , who ' ve mis ##be ##ha ##ved outrageous ##ly and who ' ve been allowed to persist in their mis ##be ##ha ##vio ##ur .

reference_raw: There aren't many of them, a small minority, who've done outrageous things, who've acted outrageously, and who've been allowed to persist in their misbehavior.

reference_spacy_tokens: There are n't many of them , a small minority , who 've done outrageous things , who 've acted outrageously , and who 've been allowed to persist in their misbehavior .


fn_spacy_tokens_for_baseline: The famous Lisbon earthquake of 1755 , which had faint reverberations as far north as Scotland , led George II to issue a solemn admonition to his people to the effect that ' the manifold Sins and Wickedness of these Kingdoms have most justly deserved heavy and severe Punishments from the Hand of Heaven . '

source_bert_toks: the famous lisbon earthquake of 1755 , which had faint rev ##er ##ber ##ations as far north as scotland , led george ii to issue a solemn ad ##mon ##ition to his people to the effect that ' the manifold sins and wicked ##ness of these kingdoms have most just ##ly deserved heavy and severe punishments from the hand of heaven . '

reference_raw: The famous Lisbon earthquake of 1755, with faint echoes as far north as Scotland, led George II to issue a solemn warning to his people that "the manifold sins and evils of these kingdoms deserve the heavy and heavy punishments of the Hand of Heaven."

reference_spacy_tokens: The famous Lisbon earthquake of 1755 , with faint echoes as far north as Scotland , led George II to issue a solemn warning to his people that " the manifold sins and evils of these kingdoms deserve the heavy and heavy punishments of the Hand of Heaven . "


fn_spacy_tokens_for_baseline: Each commander began to beseech his immediate superior for reinforcements .

source_bert_toks: each commander began to be ##see ##ch his immediate superior for reinforcements .

reference_raw: Each commander began begging his immediate superior for reinforcements.

reference_spacy_tokens: Each commander began begging his immediate superior for reinforcements .


fn_spacy_tokens_for_baseline: Mao Zedong himself directed the institute in 1926 , and gave lectures on geography , rural education , and " The Problem of the Chinese Peasantry . "

source_bert_toks: mao ze ##dong himself directed the institute in 1926 , and gave lectures on geography , rural education , and " the problem of the chinese peasant ##ry . "

reference_raw: In 1926, Mao Zedong himself directed the institution and gave lectures on geography, rural education, and "The Trouble of China's Peasantry."

reference_spacy_tokens: In 1926 , Mao Zedong himself directed the institution and gave lectures on geography , rural education , and " The Trouble of China 's Peasantry . "


fn_spacy_tokens_for_baseline: There are , says the paper , a total of 40 such suits on file , with Minnesota 's turn coming next week .

source_bert_toks: there are , says the paper , a total of 40 such suits on file , with minnesota ' s turn coming next week .

reference_raw: There are, says the newspapers, 40 suits in the file, and next week Minnesota will be next.

reference_spacy_tokens: There are , says the newspapers , 40 suits in the file , and next week Minnesota will be next .


fn_spacy_tokens_for_baseline: A ranking opposition legislator was also indicted in connection with the case but the court deferred ruling on his case , because he was involved in another criminal case .

source_bert_toks: a ranking opposition legislator was also indicted in connection with the case but the court def ##erre ##d ruling on his case , because he was involved in another criminal case .

reference_raw: The ranking opposition legislature was also charged with the case, but the court postponed the decision on his case because he was involved in another criminal case.

reference_spacy_tokens: The ranking opposition legislature was also charged with the case , but the court postponed the decision on his case because he was involved in another criminal case .


fn_spacy_tokens_for_baseline: Perhaps because it seems so obvious , the theorists did not bother to try to find out whether delinquents did in fact hold delinquent values , but concentrated more on explaining how these values came about .

source_bert_toks: perhaps because it seems so obvious , the theorists did not bother to try to find out whether del ##in ##quent ##s did in fact hold del ##in ##quent values , but concentrated more on explaining how these values came about .

reference_raw: Perhaps because it seems so obvious, the theorists didn't bother to see if the offenders actually had delinquent values, but concentrated more on explaining how those values came about.

reference_spacy_tokens: Perhaps because it seems so obvious , the theorists did n't bother to see if the offenders actually had delinquent values , but concentrated more on explaining how those values came about .


fn_spacy_tokens_for_baseline: I often wonder when a really great fictional book will be written about this era ( probably decades and decades hence as it is too close ) .

source_bert_toks: i often wonder when a really great fictional book will be written about this era ( probably decades and decades hence as it is too close ) .

reference_raw: I often think about when a really great fictional book will be written about this era (probably decades and decades, because it's too close).

reference_spacy_tokens: I often think about when a really great fictional book will be written about this era ( probably decades and decades , because it 's too close ) .


fn_spacy_tokens_for_baseline: She watched him sifting the batch of cards , momentarily intrigued .

source_bert_toks: she watched him si ##fting the batch of cards , momentarily intrigued .

reference_raw: She watched him sift a stack of cards, fascinated for a moment.

reference_spacy_tokens: She watched him sift a stack of cards , fascinated for a moment .


fn_spacy_tokens_for_baseline: We will crush you into submission .

source_bert_toks: we will crush you into submission .

reference_raw: We'll smash you into submission.

reference_spacy_tokens: We 'll smash you into submission .


fn_spacy_tokens_for_baseline: For a short time , at least 100 hikers were trapped in the mountains and a boy scout camp was also threatened by the blaze .

source_bert_toks: for a short time , at least 100 hike ##rs were trapped in the mountains and a boy scout camp was also threatened by the blaze .

reference_raw: For a short time, a hundred tourists had been trapped in the mountains, and the fire had also threatened the boy scout camp.

reference_spacy_tokens: For a short time , a hundred tourists had been trapped in the mountains , and the fire had also threatened the boy scout camp .


fn_spacy_tokens_for_baseline: The boys standing in the doorway tittered .

source_bert_toks: the boys standing in the doorway ti ##ttered .

reference_raw: The boys standing in the doorway twitched.

reference_spacy_tokens: The boys standing in the doorway twitched .


fn_spacy_tokens_for_baseline: ' We have just got to accept the situation , which is the result of being a successful side , ' said Robinson .

source_bert_toks: ' we have just got to accept the situation , which is the result of being a successful side , ' said robinson .

reference_raw: 'We just have to accept the situation, which is the result of our success,' Robinson said.

reference_spacy_tokens: ' We just have to accept the situation , which is the result of our success , ' Robinson said .


fn_spacy_tokens_for_baseline: AOL would never have existed if it had been founded here , I am sure , since its employees would have been mocked into obscurity by the digerati .

source_bert_toks: ao ##l would never have existed if it had been founded here , i am sure , since its employees would have been mocked into ob ##scu ##rity by the dig ##era ##ti .

reference_raw: I'm sure AOL would not have existed if it had been established here, for its employees would have been mocked by the digerati into obscurity.

reference_spacy_tokens: I 'm sure AOL would not have existed if it had been established here , for its employees would have been mocked by the digerati into obscurity .


fn_spacy_tokens_for_baseline: The birth was so difficult and took so long that she was starved of oxygen and had to be delivered by emergency caesarian .

source_bert_toks: the birth was so difficult and took so long that she was starved of oxygen and had to be delivered by emergency caesar ##ian .

reference_raw: The birth was so difficult, it took her so long that she was hungry for oxygen and had to be delivered by an emergency caesar.

reference_spacy_tokens: The birth was so difficult , it took her so long that she was hungry for oxygen and had to be delivered by an emergency caesar .


fn_spacy_tokens_for_baseline: What 's so terrible for IMP in that ? ' she blustered , still bewildered why he should find the idea of it so important .

source_bert_toks: what ' s so terrible for imp in that ? ' she blu ##stered , still bewildered why he should find the idea of it so important .

reference_raw: What's so terrible about the IMP?' she blurted, still wondering why the idea was so important to him.

reference_spacy_tokens: What 's so terrible about the IMP ? ' she blurted , still wondering why the idea was so important to him .


fn_spacy_tokens_for_baseline: Stirling 's decision not to continue writer in residence is ill - advised

source_bert_toks: stirling ' s decision not to continue writer in residence is ill - advised

reference_raw: Stirling's decision not to continue writing is not recommended.

reference_spacy_tokens: Stirling 's decision not to continue writing is not recommended .


fn_spacy_tokens_for_baseline: The Friar was bewildered by his loss and could not bring himself to think clearly about the disaster .

source_bert_toks: the friar was bewildered by his loss and could not bring himself to think clearly about the disaster .

reference_raw: His loss puzzled the Friar, and he could not bring himself to think clearly of the catastrophe.

reference_spacy_tokens: His loss puzzled the Friar , and he could not bring himself to think clearly of the catastrophe .


fn_spacy_tokens_for_baseline: And the rabbits were bolting out from their house .

source_bert_toks: and the rabbits were bolt ##ing out from their house .

reference_raw: And the rabbits ran out of the house.

reference_spacy_tokens: And the rabbits ran out of the house .


fn_spacy_tokens_for_baseline: Even here , if the defendant has ( for example ) used more force than was reasonably necessary , he can ( if appropriately charged ) be convicted of the offence of simple assault .

source_bert_toks: even here , if the defendant has ( for example ) used more force than was reasonably necessary , he can ( if appropriately charged ) be convicted of the offence of simple assault .

reference_raw: Even in the present case, if (e.g.) the defendant has used more force than is reasonably necessary, he may, if appropriate, be convicted of a simple attack.

reference_spacy_tokens: Even in the present case , if ( e.g. ) the defendant has used more force than is reasonably necessary , he may , if appropriate , be convicted of a simple attack .


fn_spacy_tokens_for_baseline: Residents along the corridor worry that the highway would open up huge areas of land for new development .

source_bert_toks: residents along the corridor worry that the highway would open up huge areas of land for new development .

reference_raw: The residents along the corridor are worried that the road will open up large areas of ground for new development.

reference_spacy_tokens: The residents along the corridor are worried that the road will open up large areas of ground for new development .


fn_spacy_tokens_for_baseline: The unfit person will tend to be flabby and possibly fat .

source_bert_toks: the unfit person will tend to be fl ##ab ##by and possibly fat .

reference_raw: The incompetent person tends to be weak and possibly fat.

reference_spacy_tokens: The incompetent person tends to be weak and possibly fat .


fn_spacy_tokens_for_baseline: He spoke of high levels of crime , and of violence perpetrated by the security forces against peaceful demonstrations , but also called for an end to ' mindless violence ' between township factions .

source_bert_toks: he spoke of high levels of crime , and of violence per ##pet ##rated by the security forces against peaceful demonstrations , but also called for an end to ' mind ##less violence ' between township factions .

reference_raw: He spoke of high levels of crime and violence committed by security forces against peaceful demonstrations, but he also called for the end of the mindless violence of the city factions.

reference_spacy_tokens: He spoke of high levels of crime and violence committed by security forces against peaceful demonstrations , but he also called for the end of the mindless violence of the city factions .


fn_spacy_tokens_for_baseline: While there are a number of on - screen drawing programs which allow the creation and manipulation of an image but they can not be used to copy a picture from a sheet of paper .

source_bert_toks: while there are a number of on - screen drawing programs which allow the creation and manipulation of an image but they can not be used to copy a picture from a sheet of paper .

reference_raw: Although there are many drawing programs on the screen that enable the image to be created and manipulated, they cannot be used to duplicate the image from a sheet of paper.

reference_spacy_tokens: Although there are many drawing programs on the screen that enable the image to be created and manipulated , they can not be used to duplicate the image from a sheet of paper .


fn_spacy_tokens_for_baseline: ' We operate a menu to get the best out of the rations , ' Lamb says .

source_bert_toks: ' we operate a menu to get the best out of the rations , ' lamb says .

reference_raw: 'We're running the menu to get the best of the rations,' said Lamb.

reference_spacy_tokens: ' We 're running the menu to get the best of the rations , ' said Lamb .


fn_spacy_tokens_for_baseline: The man mopped his forehead with his handkerchief and agave a long sigh of relief .

source_bert_toks: the man mo ##pped his forehead with his handkerchief and ag ##ave a long sigh of relief .

reference_raw: The man wiped his brow with his handkerchief and let out a long sigh of relief.

reference_spacy_tokens: The man wiped his brow with his handkerchief and let out a long sigh of relief .