fn_spacy_tokens_for_baseline: The bedroom is wallpapered , both on walls and ceiling , with a delicate tiny pink flower motif on a white background .

source_bert_toks: the bedroom is wall ##paper ##ed , both on walls and ceiling , with a delicate tiny pink flower motif on a white background .

reference_raw: The bedroom is wall-papered, on the walls and ceiling, with a delicate pink flower motif on the white background.

reference_spacy_tokens: The bedroom is wall - papered , on the walls and ceiling , with a delicate pink flower motif on the white background .


fn_spacy_tokens_for_baseline: Mike and I had quickly established a routine : our day would start at 4.30am , when I would cook a massive breakfast to last Mike the whole day .

source_bert_toks: mike and i had quickly established a routine : our day would start at 4 . 30 ##am , when i would cook a massive breakfast to last mike the whole day .

reference_raw: Mike and I quickly set up a routine: our day would begin at 4:30 in the morning, when I would make a big breakfast that would last Mike all day.

reference_spacy_tokens: Mike and I quickly set up a routine : our day would begin at 4:30 in the morning , when I would make a big breakfast that would last Mike all day .


fn_spacy_tokens_for_baseline: Mammals were first domesticated for their milk around 6000BC and cheesemaking was a natural progression from the acid that formed naturally in the milk and curdled it .

source_bert_toks: mammals were first domestic ##ated for their milk around 6000 ##bc and cheese ##making was a natural progression from the acid that formed naturally in the milk and cu ##rd ##led it .

reference_raw: The mammals were first domesticated for milk around 6000 BC, and the cheese-making process was the natural progression of the acid naturally formed in the milk and curded it.

reference_spacy_tokens: The mammals were first domesticated for milk around 6000 BC , and the cheese - making process was the natural progression of the acid naturally formed in the milk and curded it .


fn_spacy_tokens_for_baseline: A simple tweak on , say , the treble slider gives you enough of a change , but without biting your head off , as some acoustic graphics are prone to doing .

source_bert_toks: a simple t ##we ##ak on , say , the tre ##ble slide ##r gives you enough of a change , but without biting your head off , as some acoustic graphics are prone to doing .

reference_raw: A simple twist on, let's say, a triple slider gives you a lot of change, but without biting off your head, as some acoustic graphics tend to do.

reference_spacy_tokens: A simple twist on , let 's say , a triple slider gives you a lot of change , but without biting off your head , as some acoustic graphics tend to do .


fn_spacy_tokens_for_baseline: Nan saw Benny 's mystification and explained .

source_bert_toks: nan saw benny ' s my ##sti ##fication and explained .

reference_raw: Nan saw Benny's confusion and explained it to him.

reference_spacy_tokens: Nan saw Benny 's confusion and explained it to him .


fn_spacy_tokens_for_baseline: The American military declined to release any details about where the helicopter had taken off , where it was bound or what its mission was .

source_bert_toks: the american military declined to release any details about where the helicopter had taken off , where it was bound or what its mission was .

reference_raw: The U.S. Army refused to disclose any details of where the helicopter had gone, where it was bound, or what its mission was.

reference_spacy_tokens: The U.S. Army refused to disclose any details of where the helicopter had gone , where it was bound , or what its mission was .


fn_spacy_tokens_for_baseline: It was Blackberry who bullied the stupefied Pipkin to his feet and forced him to limp the few yards to the gravel spit .

source_bert_toks: it was blackberry who bull ##ied the stu ##pe ##fied pip ##kin to his feet and forced him to limp the few yards to the gravel spit .

reference_raw: It was Blackberry who bullied the stupendous Pipkin to his feet and forced him to limp a few yards to the gravel spit.

reference_spacy_tokens: It was Blackberry who bullied the stupendous Pipkin to his feet and forced him to limp a few yards to the gravel spit .


fn_spacy_tokens_for_baseline: ' I 'm going down Mouncy Street , ' he said to his sibling .

source_bert_toks: ' i ' m going down mo ##un ##cy street , ' he said to his sibling .

reference_raw: "I'll go down Mounty Street," he told his brother.

reference_spacy_tokens: " I 'll go down Mounty Street , " he told his brother .


fn_spacy_tokens_for_baseline: He checked the time of arrival on a big gold bracelet watch , and there were handsome cuff - links with a shamrock in tiny emeralds in each shirt - sleeve .

source_bert_toks: he checked the time of arrival on a big gold bracelet watch , and there were handsome cuff - links with a shamrock in tiny emerald ##s in each shirt - sleeve .

reference_raw: He checked his arrival time with a large gold bracelet watch, and each shirt sleeve had handsome cufflinks with shamrock in tiny emeralds.

reference_spacy_tokens: He checked his arrival time with a large gold bracelet watch , and each shirt sleeve had handsome cufflinks with shamrock in tiny emeralds .


fn_spacy_tokens_for_baseline: It catches several eel - pout and a couple of butterfish which it eats on the surface , sometimes holding the fish between its forepaws in order to control their writhing .

source_bert_toks: it catches several eel - po ##ut and a couple of butter ##fish which it eats on the surface , sometimes holding the fish between its fore ##pa ##ws in order to control their writhing .

reference_raw: He catches a few eel-pouts and a few butterfish that he eats on the surface, sometimes holding the fish between his front paws to control his squirming.

reference_spacy_tokens: He catches a few eel - pouts and a few butterfish that he eats on the surface , sometimes holding the fish between his front paws to control his squirming .


fn_spacy_tokens_for_baseline: Reality was starting to change Wall Street 's profligate ways last year .

source_bert_toks: reality was starting to change wall street ' s prof ##liga ##te ways last year .

reference_raw: Reality began to change the prosperous ways of Wall Street last year.

reference_spacy_tokens: Reality began to change the prosperous ways of Wall Street last year .


fn_spacy_tokens_for_baseline: Bridget Freemantle 's letter , however , indicates that by February 21 , 1749 , she had already supplied all the manuscripts in her possession :

source_bert_toks: bridget freeman ##tle ' s letter , however , indicates that by february 21 , 1749 , she had already supplied all the manuscripts in her possession :

reference_raw: However, it is clear from Bridget Freemantle's letter that, on February 21, 1749, she had already delivered all the manuscripts at her disposal:

reference_spacy_tokens: However , it is clear from Bridget Freemantle 's letter that , on February 21 , 1749 , she had already delivered all the manuscripts at her disposal :


fn_spacy_tokens_for_baseline: He was shirtless , a great hairy muscular figure with bad scarring on his upper arms .

source_bert_toks: he was shirt ##less , a great hairy muscular figure with bad scar ##ring on his upper arms .

reference_raw: He had no shirt, a large, muscular figure with a bad scar on his upper arms.

reference_spacy_tokens: He had no shirt , a large , muscular figure with a bad scar on his upper arms .


fn_spacy_tokens_for_baseline: So the crab fishermen go out and massacre dolphins .

source_bert_toks: so the crab fishermen go out and massacre dolphins .

reference_raw: So crab fishermen go out and slaughter dolphins.

reference_spacy_tokens: So crab fishermen go out and slaughter dolphins .


fn_spacy_tokens_for_baseline: South Africa acceded to the Treaty on the Non - Proliferation of Nuclear Weapons ( NPT ) as a non - nuclear weapon state in 1991 , and International Atomic Energy Agency ( IAEA ) inspectors subsequently verified the completeness of its nuclear dismantlement .

source_bert_toks: south africa acc ##eded to the treaty on the non - proliferation of nuclear weapons ( np ##t ) as a non - nuclear weapon state in 1991 , and international atomic energy agency ( ia ##ea ) inspectors subsequently verified the complete ##ness of its nuclear di ##sman ##tlement .

reference_raw: South Africa acceded to the Treaty on the Non-Proliferation of Nuclear Weapons (NPT) as a non-nuclear state in 1991, and the International Atomic Energy Agency (IAEA) inspectors subsequently verified that its nuclear dismantling was complete.

reference_spacy_tokens: South Africa acceded to the Treaty on the Non - Proliferation of Nuclear Weapons ( NPT ) as a non - nuclear state in 1991 , and the International Atomic Energy Agency ( IAEA ) inspectors subsequently verified that its nuclear dismantling was complete .


fn_spacy_tokens_for_baseline: ' Stop patronising me , ' she had shouted , ' stop pitying me ! '

source_bert_toks: ' stop patron ##ising me , ' she had shouted , ' stop pity ##ing me ! '

reference_raw: "Stop condescending me," she cried, "stop feeling sorry for me!"

reference_spacy_tokens: " Stop condescending me , " she cried , " stop feeling sorry for me ! "


fn_spacy_tokens_for_baseline: To an incoming Minister , who may owe his appointment more to adeptness in handling argument on paper or on the floor of the House of Commons , such inhibitions can come as an unwelcome surprise .

source_bert_toks: to an incoming minister , who may owe his appointment more to adept ##ness in handling argument on paper or on the floor of the house of commons , such inhibition ##s can come as an un ##we ##lco ##me surprise .

reference_raw: To the incoming minister, who may owe his appointment more to his ability to deal with arguments on paper or on the floor of the House of Commons, such restraints may be an unwelcome surprise.

reference_spacy_tokens: To the incoming minister , who may owe his appointment more to his ability to deal with arguments on paper or on the floor of the House of Commons , such restraints may be an unwelcome surprise .


fn_spacy_tokens_for_baseline: " We are not happy about being released as it was done just to fool Europe , " Yurtdas told reporters in front of the Ankara jailhouse .

source_bert_toks: " we are not happy about being released as it was done just to fool europe , " yu ##rt ##das told reporters in front of the ankara jail ##house .

reference_raw: "We don't like being released, just to fool Europe," Yurtdas said to the reporters outside the Ankara prison.

reference_spacy_tokens: " We do n't like being released , just to fool Europe , " Yurtdas said to the reporters outside the Ankara prison .


fn_spacy_tokens_for_baseline: The fourth and final haul is a splendid casket of mahogany and teak which is bound with silver filigree and lined with red velvet .

source_bert_toks: the fourth and final haul is a splendid casket of mahogany and tea ##k which is bound with silver fi ##li ##gree and lined with red velvet .

reference_raw: The fourth and last haul is a beautiful coffin of mahogany and teak, bound with silver filigree and lined with red velvet.

reference_spacy_tokens: The fourth and last haul is a beautiful coffin of mahogany and teak , bound with silver filigree and lined with red velvet .


fn_spacy_tokens_for_baseline: On March 12th the Volynsky Regiment mutinied and added more weight to the revolutionary machine and they broke into the arsenal in Petrograd and handed out weapons .

source_bert_toks: on march 12th the vol ##yn ##sky regiment mu ##tin ##ied and added more weight to the revolutionary machine and they broke into the arsenal in pet ##ro ##grad and handed out weapons .

reference_raw: On March 12th, the Volynsky regiment rebelled and added more weight to the revolutionary machine, breaking into the Petrograd arsenal and handing out weapons.

reference_spacy_tokens: On March 12th , the Volynsky regiment rebelled and added more weight to the revolutionary machine , breaking into the Petrograd arsenal and handing out weapons .


fn_spacy_tokens_for_baseline: Conde Nast has also created a class of mandarin journalists , writers who live much better than they ever could if they wrote only for normal magazines .

source_bert_toks: conde nas ##t has also created a class of mandarin journalists , writers who live much better than they ever could if they wrote only for normal magazines .

reference_raw: Conde Nast has also created a class of mandarin journalists, writers who have a much better life than they can ever have if they only write for regular magazines.

reference_spacy_tokens: Conde Nast has also created a class of mandarin journalists , writers who have a much better life than they can ever have if they only write for regular magazines .


fn_spacy_tokens_for_baseline: Bramble decided to follow , and when he entered the office , which was also the village shop , he found the stranger in earnest colloquy with the postmaster , one Algy Brind .

source_bert_toks: bram ##ble decided to follow , and when he entered the office , which was also the village shop , he found the stranger in earnest col ##lo ##qu ##y with the postmaster , one al ##gy br ##ind .

reference_raw: Bramble decided to follow him, and when he entered the office, which was also a village store, he found the stranger in serious contact with the postmaster, an Algy Brind.

reference_spacy_tokens: Bramble decided to follow him , and when he entered the office , which was also a village store , he found the stranger in serious contact with the postmaster , an Algy Brind .


fn_spacy_tokens_for_baseline: ' It is not , ' yelped Auguste , wishing Egbert would help .

source_bert_toks: ' it is not , ' ye ##lp ##ed auguste , wishing e ##gb ##ert would help .

reference_raw: 'No,' said Auguste, wishing Egbert could help.

reference_spacy_tokens: ' No , ' said Auguste , wishing Egbert could help .


fn_spacy_tokens_for_baseline: Of course , during the war , the 1787 Constitution remained nominally in force .

source_bert_toks: of course , during the war , the 1787 constitution remained nominally in force .

reference_raw: Of course, the 1787 Constitution remained nominally valid during the war.

reference_spacy_tokens: Of course , the 1787 Constitution remained nominally valid during the war .


fn_spacy_tokens_for_baseline: His mother seemed slightly affronted .

source_bert_toks: his mother seemed slightly af ##front ##ed .

reference_raw: His mother seemed a little offended.

reference_spacy_tokens: His mother seemed a little offended .


fn_spacy_tokens_for_baseline: QN : Does Iran intend to become a Nuclear State ?

source_bert_toks: q ##n : does iran intend to become a nuclear state ?

reference_raw: QN: Is Iran planning to become a nuclear state?

reference_spacy_tokens: QN : Is Iran planning to become a nuclear state ?


fn_spacy_tokens_for_baseline: During 19 - 21 April 2004 , North Korean National Defense Commission Chairman Kim Jong Il visited China and reportedly told Chinese President Hu Jintao that " the DRPK side will continue to adopt a patient and flexible manner and actively participate in the six - party talks process , and make its own contributions to the progress of the talks . "

source_bert_toks: during 19 - 21 april 2004 , north korean national defense commission chairman kim jong il visited china and reportedly told chinese president hu jin ##tao that " the dr ##p ##k side will continue to adopt a patient and flexible manner and actively participate in the six - party talks process , and make its own contributions to the progress of the talks . "

reference_raw: In the course of 19-21 April 2004, Chairman of the North Korean National Defence Commission Kim Jong II visited China and reportedly informed Chinese President Hu Jintao that "the DRPK Party will continue to take a patient and flexible approach and actively participate in the six-party negotiations and contribute to the progress of the negotiations."

reference_spacy_tokens: In the course of 19 - 21 April 2004 , Chairman of the North Korean National Defence Commission Kim Jong II visited China and reportedly informed Chinese President Hu Jintao that " the DRPK Party will continue to take a patient and flexible approach and actively participate in the six - party negotiations and contribute to the progress of the negotiations . "


fn_spacy_tokens_for_baseline: Spoon into the prepared baking dish , season with the nutmeg and then sprinkle over the Parmesan .

source_bert_toks: spoon into the prepared baking dish , season with the nut ##me ##g and then sp ##rin ##kle over the par ##mes ##an .

reference_raw: A spoon in a prepared baking dish, a season with a nutmeg, and then a sprinkle on the Parmesan.

reference_spacy_tokens: A spoon in a prepared baking dish , a season with a nutmeg , and then a sprinkle on the Parmesan .


fn_spacy_tokens_for_baseline: Marathon runners finishing after 2 hours 45 minutes found that they could not get into the stadium after a 26 mile 385 yard slog in 90F temperatures .

source_bert_toks: marathon runners finishing after 2 hours 45 minutes found that they could not get into the stadium after a 26 mile 385 yard sl ##og in 90 ##f temperatures .

reference_raw: The marathon runners who finished two hours 45 minutes later found they couldn't get into the stadium after a 26-mile 385-meter slag at 90F temperatures.

reference_spacy_tokens: The marathon runners who finished two hours 45 minutes later found they could n't get into the stadium after a 26-mile 385-meter slag at 90F temperatures .


fn_spacy_tokens_for_baseline: Bogus applicants offend ethnic minorities as much as anyone else .

source_bert_toks: bog ##us applicants off ##end ethnic minorities as much as anyone else .

reference_raw: The false applicants insult ethnic minorities as much as anyone else.

reference_spacy_tokens: The false applicants insult ethnic minorities as much as anyone else .


fn_spacy_tokens_for_baseline: But he firmly eschewed political involvement and devoted his time to his diocese and to building .

source_bert_toks: but he firmly es ##che ##wed political involvement and devoted his time to his diocese and to building .

reference_raw: But he firmly ejected political engagement and devoted his time to his diocese and construction.

reference_spacy_tokens: But he firmly ejected political engagement and devoted his time to his diocese and construction .


fn_spacy_tokens_for_baseline: The false pretence ( or ' deception , ' to use the new term ) was no long confined to pretence about an existing fact and no longer excluded a misrepresentation as to the offender 's intention .

source_bert_toks: the false pre ##ten ##ce ( or ' deception , ' to use the new term ) was no long confined to pre ##ten ##ce about an existing fact and no longer excluded a mis ##re ##pres ##entation as to the offender ' s intention .

reference_raw: The false pretense (or "deception" to use the new term) was no longer limited to pretending to exist and no longer ruled out a distortion of the intentions of the offender.

reference_spacy_tokens: The false pretense ( or " deception " to use the new term ) was no longer limited to pretending to exist and no longer ruled out a distortion of the intentions of the offender .


fn_spacy_tokens_for_baseline: But few motor cars , no big city life : instead , an almost uncanny , disconcerting stillness , the only constant sound the distant boom of waves on the reef .

source_bert_toks: but few motor cars , no big city life : instead , an almost uncanny , disco ##nce ##rting stillness , the only constant sound the distant boom of waves on the reef .

reference_raw: But few motor vehicles, no big city life: instead, an almost mysterious, disturbing silence, the only constant sound of distant waves on the cliffs.

reference_spacy_tokens: But few motor vehicles , no big city life : instead , an almost mysterious , disturbing silence , the only constant sound of distant waves on the cliffs .


fn_spacy_tokens_for_baseline: They need to struggle with the thorny issue of whose interests come first , and they must be ready to let go of some aspirations and commitments if they are to enjoy what they decide to do .

source_bert_toks: they need to struggle with the thorn ##y issue of whose interests come first , and they must be ready to let go of some aspirations and commitments if they are to enjoy what they decide to do .

reference_raw: They must fight the thorn question of whose interests come first, and they must be prepared to give up a few ambitions and commitments if they want to enjoy what they choose to do.

reference_spacy_tokens: They must fight the thorn question of whose interests come first , and they must be prepared to give up a few ambitions and commitments if they want to enjoy what they choose to do .


fn_spacy_tokens_for_baseline: Within minutes , he has told me he will be seeing the PM this afternoon , and that he dined with Mrs Thatcher the previous evening .

source_bert_toks: within minutes , he has told me he will be seeing the pm this afternoon , and that he din ##ed with mrs thatcher the previous evening .

reference_raw: He told me in a few minutes that he was going to see the Prime Minister this afternoon and that he and Mrs. Thatcher had had dinner last night.

reference_spacy_tokens: He told me in a few minutes that he was going to see the Prime Minister this afternoon and that he and Mrs. Thatcher had had dinner last night .


fn_spacy_tokens_for_baseline: It offers a case in point from one of the 17 volumes of The Lives of the Saints , a massive work written between 1872 and 1889 by Sabine Baring - Gould ( 1834- 1924 ) , the English clergyman who is best remembered as the author of the hymn , " Onward , Christian Soldiers . "

source_bert_toks: it offers a case in point from one of the 17 volumes of the lives of the saints , a massive work written between 1872 and 1889 by sabine bari ##ng - gould ( 1834 - 1924 ) , the english clergyman who is best remembered as the author of the hymn , " onward , christian soldiers . "

reference_raw: It presents a case in point from one of the 17 volumes of the Life of the Saints, a massive piece written between 1872 and 1889 by Sabine Baring-Gould (1834-1924), an English priest best known as the author of the hymn, "Onward, Christian Soldiers."

reference_spacy_tokens: It presents a case in point from one of the 17 volumes of the Life of the Saints , a massive piece written between 1872 and 1889 by Sabine Baring - Gould ( 1834 - 1924 ) , an English priest best known as the author of the hymn , " Onward , Christian Soldiers . "


fn_spacy_tokens_for_baseline: The land is just as beautiful , and their heroes strut across the world , but only the stupid still feel proud .

source_bert_toks: the land is just as beautiful , and their heroes st ##rut across the world , but only the stupid still feel proud .

reference_raw: The country is just as beautiful, and their heroes are all over the world, but only the fools still feel proud.

reference_spacy_tokens: The country is just as beautiful , and their heroes are all over the world , but only the fools still feel proud .


fn_spacy_tokens_for_baseline: The Borough , willing enough to disparage and hunt down Grimes , cares little for the fate of his apprentices , though Crabbe is never as explicit as Slater is in the libretto .

source_bert_toks: the borough , willing enough to di ##spar ##age and hunt down grimes , cares little for the fate of his apprentice ##s , though crab ##be is never as explicit as slater is in the libretto .

reference_raw: Borough, willing enough to despise and hunt Grimes, cares little for the fate of his disciples, though Crabbe is never as clear as Slater is in the libretto.

reference_spacy_tokens: Borough , willing enough to despise and hunt Grimes , cares little for the fate of his disciples , though Crabbe is never as clear as Slater is in the libretto .


fn_spacy_tokens_for_baseline: The fourth managed to elude his pursuers by escaping into a bog where no horse could follow .

source_bert_toks: the fourth managed to el ##ude his pursue ##rs by escaping into a bog where no horse could follow .

reference_raw: The fourth managed to escape his pursuers by fleeing into the swamp where no horse could follow.

reference_spacy_tokens: The fourth managed to escape his pursuers by fleeing into the swamp where no horse could follow .


fn_spacy_tokens_for_baseline: The major new documentary series of the year was Granada 's widely acclaimed ' Disappearing World ' in which Brian Moser set off in search of native tribes in the remotest parts of the world .

source_bert_toks: the major new documentary series of the year was granada ' s widely acclaimed ' disappearing world ' in which brian mo ##ser set off in search of native tribes in the remote ##st parts of the world .

reference_raw: The main new documentary series of the year was Granada's widely known "Disappearing World", where Brian Moser began to search for native tribes in the most remote parts of the world.

reference_spacy_tokens: The main new documentary series of the year was Granada 's widely known " Disappearing World " , where Brian Moser began to search for native tribes in the most remote parts of the world .


fn_spacy_tokens_for_baseline: ' His gratification was almost unbounded when on arriving at the Belts of the Murray he found not only numerous new Species but new forms of Birds .

source_bert_toks: ' his gr ##ati ##fication was almost un ##bound ##ed when on arriving at the belts of the murray he found not only numerous new species but new forms of birds .

reference_raw: When he reached Murray's Belts, he found not only a number of new species, but also new forms of birds, his satisfaction was almost unbound.

reference_spacy_tokens: When he reached Murray 's Belts , he found not only a number of new species , but also new forms of birds , his satisfaction was almost unbound .


fn_spacy_tokens_for_baseline: ' I 'll show these scoundrels I 'm an honest woman , ' said my mother .

source_bert_toks: ' i ' ll show these sc ##ound ##rel ##s i ' m an honest woman , ' said my mother .

reference_raw: "I'm going to show these bastards that I'm an honorable woman," my mother said.

reference_spacy_tokens: " I 'm going to show these bastards that I 'm an honorable woman , " my mother said .


fn_spacy_tokens_for_baseline: ' Are you admitting I 've hit the nail on the head ? '

source_bert_toks: ' are you admitting i ' ve hit the nail on the head ? '

reference_raw: "Do you admit that I struck a nail in the head?"

reference_spacy_tokens: " Do you admit that I struck a nail in the head ? "


fn_spacy_tokens_for_baseline: Darren Nichol is accused of attempting to murder coast - to- coast walker Josephine Chandler as she hiked through Catterick Bridge , North Yorkshire .

source_bert_toks: darren nic ##hol is accused of attempting to murder coast - to - coast walker josephine chandler as she hike ##d through cat ##ter ##ick bridge , north yorkshire .

reference_raw: Darren Nichol is charged with the attempted murder of coast-to-coast pedestrian Josephine Chandler on a trip through the Catterick Bridge in North Yorkshire.

reference_spacy_tokens: Darren Nichol is charged with the attempted murder of coast - to - coast pedestrian Josephine Chandler on a trip through the Catterick Bridge in North Yorkshire .


fn_spacy_tokens_for_baseline: ' However , on this occasion I thought it not unreasonable to take a risk .

source_bert_toks: ' however , on this occasion i thought it not unreasonable to take a risk .

reference_raw: 'But on this occasion, I didn't think it wise to take the risk.

reference_spacy_tokens: ' But on this occasion , I did n't think it wise to take the risk .


fn_spacy_tokens_for_baseline: They became engaged in England and next year Miss Brooke set out for New York chaperoned by her brother Edgar , a solicitor .

source_bert_toks: they became engaged in england and next year miss brooke set out for new york cha ##per ##oned by her brother edgar , a solicitor .

reference_raw: They got engaged in England, and next year Miss Brooke went to New York with her brother Edgar, a lawyer.

reference_spacy_tokens: They got engaged in England , and next year Miss Brooke went to New York with her brother Edgar , a lawyer .


fn_spacy_tokens_for_baseline: Frederick Ratcliffe then subjected Mrs James to a vigorous cross - examination .

source_bert_toks: frederick rat ##cliffe then subjected mrs james to a vigorous cross - examination .

reference_raw: Frederick Ratcliffe then tested Mrs. James vigorously.

reference_spacy_tokens: Frederick Ratcliffe then tested Mrs. James vigorously .


fn_spacy_tokens_for_baseline: ' There is a great interest in driving ranges , " he says .

source_bert_toks: ' there is a great interest in driving ranges , " he says .

reference_raw: "He's very interested in driving distances," he says.

reference_spacy_tokens: " He 's very interested in driving distances , " he says .


fn_spacy_tokens_for_baseline: Benjamin rapped the top of the table .

source_bert_toks: benjamin rap ##ped the top of the table .

reference_raw: Benjamin tapped the top of his desk.

reference_spacy_tokens: Benjamin tapped the top of his desk .


fn_spacy_tokens_for_baseline: The Bible describes how David 's soldiers conquered Jerusalem by discovering a water tunnel under the walls and using it to take the city by surprise .

source_bert_toks: the bible describes how david ' s soldiers conquered jerusalem by discovering a water tunnel under the walls and using it to take the city by surprise .

reference_raw: The Bible tells of how David's soldiers conquered Jerusalem by discovering a water tunnel beneath the walls and using it to surprise the city.

reference_spacy_tokens: The Bible tells of how David 's soldiers conquered Jerusalem by discovering a water tunnel beneath the walls and using it to surprise the city .


fn_spacy_tokens_for_baseline: This slight deeply embittered Waismann .

source_bert_toks: this slight deeply em ##bit ##tered wai ##sman ##n .

reference_raw: Waismann's little, deeply embroidered.

reference_spacy_tokens: Waismann 's little , deeply embroidered .


fn_spacy_tokens_for_baseline: Historically and culturally this north - south distinction has always been significant , and it still is today , with a dose of good - humored rivalry between the two areas .

source_bert_toks: historically and culturally this north - south distinction has always been significant , and it still is today , with a dose of good - humor ##ed rivalry between the two areas .

reference_raw: Historically and culturally, this distinction between the north and the south has always been significant, and it is still today, with a great deal of popular competition between the two regions.

reference_spacy_tokens: Historically and culturally , this distinction between the north and the south has always been significant , and it is still today , with a great deal of popular competition between the two regions .


fn_spacy_tokens_for_baseline: The best canned fish is further improved if it is steeped in olive oil rather than a cheaper vegetable oil .

source_bert_toks: the best canned fish is further improved if it is steep ##ed in olive oil rather than a cheaper vegetable oil .

reference_raw: The best preserved fish will be further improved if it is precipitated in olive oil rather than cheaper vegetable oil.

reference_spacy_tokens: The best preserved fish will be further improved if it is precipitated in olive oil rather than cheaper vegetable oil .


fn_spacy_tokens_for_baseline: Shelley gave him a smile that deflated his compliment without being ungracious .

source_bert_toks: shelley gave him a smile that def ##lated his compliment without being un ##gra ##cious .

reference_raw: Shelley smiled at him, deflating his compliment without being rude.

reference_spacy_tokens: Shelley smiled at him , deflating his compliment without being rude .


fn_spacy_tokens_for_baseline: Ruthven cradled his cat and stroked the back of its head , his hand moving faster and faster across the animal 's fur until it stirred restlessly and mewed in protest .

source_bert_toks: ruth ##ven cradled his cat and stroked the back of its head , his hand moving faster and faster across the animal ' s fur until it stirred restless ##ly and me ##wed in protest .

reference_raw: Ruthven cradled the cat in his arms and stroked the back of his head, his hand moving faster and faster over the animal's fur until it moved uneasily and mowed in protest.

reference_spacy_tokens: Ruthven cradled the cat in his arms and stroked the back of his head , his hand moving faster and faster over the animal 's fur until it moved uneasily and mowed in protest .


fn_spacy_tokens_for_baseline: i could n't really conceptualize how hard it was to understand that until i until i met with them and i realized that they some of the information that i just you know do n't even realize and know is information

source_bert_toks: i couldn ' t really conceptual ##ize how hard it was to understand that until i until i met with them and i realized that they some of the information that i just you know don ' t even realize and know is information

reference_raw: I couldn't imagine how hard it was to understand that until I met them and realized that some of the information you just knew didn't realize and knew was information.

reference_spacy_tokens: I could n't imagine how hard it was to understand that until I met them and realized that some of the information you just knew did n't realize and knew was information .


fn_spacy_tokens_for_baseline: Then they are trucked long distances to toil on remote plantations where they are held prisoner and compelled to work at gunpoint .

source_bert_toks: then they are truck ##ed long distances to to ##il on remote plantations where they are held prisoner and compelled to work at gun ##point .

reference_raw: Then they're taken long distances to work on remote plantations, where they're held captive and forced to work at gunpoint.

reference_spacy_tokens: Then they 're taken long distances to work on remote plantations , where they 're held captive and forced to work at gunpoint .


fn_spacy_tokens_for_baseline: ' We 've got a good team , on paper , ' said vice - captain Rogers .

source_bert_toks: ' we ' ve got a good team , on paper , ' said vice - captain rogers .

reference_raw: "We have a good team on paper," Vice-Captain Rogers said.

reference_spacy_tokens: " We have a good team on paper , " Vice - Captain Rogers said .


fn_spacy_tokens_for_baseline: For two sleepless nights , rugby player and fitness fanatic Brian lived with the fear that Joanna 's lifeless body would be found and he would be charged with murder .

source_bert_toks: for two sleep ##less nights , rugby player and fitness fan ##atic brian lived with the fear that joanna ' s lifeless body would be found and he would be charged with murder .

reference_raw: For two sleepless nights, rugby player and fitness fanatic Brian lived with the fear of finding Joanna's dead body and being charged with murder.

reference_spacy_tokens: For two sleepless nights , rugby player and fitness fanatic Brian lived with the fear of finding Joanna 's dead body and being charged with murder .


fn_spacy_tokens_for_baseline: The prisoner , a woman who had refused to confess her adultery to the Inquisitor , was brought out in chains and bound to a post set in the ground .

source_bert_toks: the prisoner , a woman who had refused to confess her adultery to the in ##qui ##sitor , was brought out in chains and bound to a post set in the ground .

reference_raw: The prisoner, a woman who refused to confess her adultery to the Inquisitor, was chained and chained to a place in the ground.

reference_spacy_tokens: The prisoner , a woman who refused to confess her adultery to the Inquisitor , was chained and chained to a place in the ground .


fn_spacy_tokens_for_baseline: The Supreme Constitutional Court judged on May 19 that the People 's Assembly had been unconstitutionally elected in 1987 because a 1986 amendment to the 1972 electoral law had unfairly discriminated against independent candidates .

source_bert_toks: the supreme constitutional court judged on may 19 that the people ' s assembly had been unconstitutional ##ly elected in 1987 because a 1986 amendment to the 1972 electoral law had unfair ##ly disc ##rim ##inated against independent candidates .

reference_raw: On May 19, the Supreme Constitutional Court decided that the People's Assembly was unconstitutionally elected in 1987 because the 1986 amendment to the 1972 electoral law discriminated unfairly against independent candidates.

reference_spacy_tokens: On May 19 , the Supreme Constitutional Court decided that the People 's Assembly was unconstitutionally elected in 1987 because the 1986 amendment to the 1972 electoral law discriminated unfairly against independent candidates .


fn_spacy_tokens_for_baseline: Needlessly Herr Nordern cleared his throat again , frowning at Paul who was goggling at him while stuffing himself with cheese and cold ham .

source_bert_toks: needles ##sl ##y herr nord ##ern cleared his throat again , frowning at paul who was go ##gg ##ling at him while stuffing himself with cheese and cold ham .

reference_raw: Unnecessarily, Herr Nordern cleared his throat again, frowning at Paul, who was gagging at him as he filled himself with cheese and cold ham.

reference_spacy_tokens: Unnecessarily , Herr Nordern cleared his throat again , frowning at Paul , who was gagging at him as he filled himself with cheese and cold ham .


fn_spacy_tokens_for_baseline: The next thing Shiona did was phone Glasgow Central Station and book two sleepers on the overnight train that left just before midnight .

source_bert_toks: the next thing shi ##ona did was phone glasgow central station and book two sleeper ##s on the overnight train that left just before midnight .

reference_raw: The next thing Shiona did was call Glasgow Central Station and book two sleepers on the night train, which left just before nightfall.

reference_spacy_tokens: The next thing Shiona did was call Glasgow Central Station and book two sleepers on the night train , which left just before nightfall .


fn_spacy_tokens_for_baseline: But a body with a particular temperature must emit radiation at a certain rate .

source_bert_toks: but a body with a particular temperature must emi ##t radiation at a certain rate .

reference_raw: But a body with a certain temperature has to give off radiation at a certain rate.

reference_spacy_tokens: But a body with a certain temperature has to give off radiation at a certain rate .


fn_spacy_tokens_for_baseline: And then as Brett 's teeth clinked uncomfortably on the edge of the drinking glass , something strange happened .

source_bert_toks: and then as brett ' s teeth cl ##ink ##ed uncomfortably on the edge of the drinking glass , something strange happened .

reference_raw: And then, as Brett's teeth twitched uncomfortably at the edge of the glass, something strange happened.

reference_spacy_tokens: And then , as Brett 's teeth twitched uncomfortably at the edge of the glass , something strange happened .


fn_spacy_tokens_for_baseline: Although the lights of the pleasure cruisers sparkling from the water make the river look attractive , Baedeker 's advice is forthright : ' Bathing in the Rhine should be avoided at all costs . '

source_bert_toks: although the lights of the pleasure cruisers sparkling from the water make the river look attractive , bae ##dek ##er ' s advice is forth ##right : ' bathing in the rhine should be avoided at all costs . '

reference_raw: Though the lights of the pleasure cruisers glittering from the water make the river look attractive, Baedeker's advice is clear: 'Bathing on the Rhine should be avoided at all costs.'

reference_spacy_tokens: Though the lights of the pleasure cruisers glittering from the water make the river look attractive , Baedeker 's advice is clear : ' Bathing on the Rhine should be avoided at all costs . '


fn_spacy_tokens_for_baseline: And on his lips there died the cheery lay .

source_bert_toks: and on his lips there died the cheer ##y lay .

reference_raw: And there died on his lips a happy lie.

reference_spacy_tokens: And there died on his lips a happy lie .


fn_spacy_tokens_for_baseline: THE HALIFAX , Britain 's biggest building society , yesterday attempted to stem a wholesale move to 15 per cent mortgage rates by announcing a comparatively modest 1-point hike in its own lending rate to 14.5 per cent .

source_bert_toks: the halifax , britain ' s biggest building society , yesterday attempted to stem a wholesale move to 15 per cent mortgage rates by announcing a comparatively modest 1 - point hike in its own lending rate to 14 . 5 per cent .

reference_raw: HALIFAX, the largest construction company in Britain, yesterday tried to stop the wholesale shift to 15% of mortgage rates by announcing a relatively modest one-point increase in its lending rate to 14.5%.

reference_spacy_tokens: HALIFAX , the largest construction company in Britain , yesterday tried to stop the wholesale shift to 15 % of mortgage rates by announcing a relatively modest one - point increase in its lending rate to 14.5 % .


fn_spacy_tokens_for_baseline: Fortunately a lorry driver was washing in the basin , so while he went off to have a shit in one of the cabinets , I rifled his spongebag and pinched a disposable razor .

source_bert_toks: fortunately a lo ##rry driver was washing in the basin , so while he went off to have a shit in one of the cabinets , i rifle ##d his sponge ##bag and pinched a di ##sp ##osa ##ble razor .

reference_raw: Luckily, the truck driver was washing in the sink, so while he was going to take a shit in one of the cupboards, I rifled his spongebag and stabbed him with a disposable razor.

reference_spacy_tokens: Luckily , the truck driver was washing in the sink , so while he was going to take a shit in one of the cupboards , I rifled his spongebag and stabbed him with a disposable razor .


fn_spacy_tokens_for_baseline: A huge choice and plenty of Information Centres for casual strollers or energetic backpackers .

source_bert_toks: a huge choice and plenty of information centres for casual stroll ##ers or energetic backpack ##ers .

reference_raw: It's a big choice and a lot of information centers for casual strollers or energy packs.

reference_spacy_tokens: It 's a big choice and a lot of information centers for casual strollers or energy packs .


fn_spacy_tokens_for_baseline: The actual knee is concealed beneath the plumage and is almost contiguous with the body .

source_bert_toks: the actual knee is concealed beneath the plumage and is almost contiguous with the body .

reference_raw: The real knee is hidden under the feathers, and it's almost contiguous to the body.

reference_spacy_tokens: The real knee is hidden under the feathers , and it 's almost contiguous to the body .


fn_spacy_tokens_for_baseline: Samuel argued strongly and persuasively in favour of a National as opposed to a purely Conservative Government , and considerably influenced a receptive King .

source_bert_toks: samuel argued strongly and per ##su ##asi ##vel ##y in favour of a national as opposed to a purely conservative government , and considerably influenced a rec ##eptive king .

reference_raw: Samuel argued strongly and convincingly in favour of the national, rather than a purely conservative government, and had a significant impact on the receptive king.

reference_spacy_tokens: Samuel argued strongly and convincingly in favour of the national , rather than a purely conservative government , and had a significant impact on the receptive king .


fn_spacy_tokens_for_baseline: Students dress in colourful garb for the display to show their allegiance to Singapore .

source_bert_toks: students dress in colourful ga ##rb for the display to show their allegiance to singapore .

reference_raw: Students wear colorful clothes to show their loyalty to Singapore.

reference_spacy_tokens: Students wear colorful clothes to show their loyalty to Singapore .


fn_spacy_tokens_for_baseline: ' American health costs have been exploding .

source_bert_toks: ' american health costs have been exploding .

reference_raw: 'The cost of American health is explosive.

reference_spacy_tokens: ' The cost of American health is explosive .


fn_spacy_tokens_for_baseline: I hazard a guess that there are not only pure stallions on the moor ; fate and carelessness always complicates herd life .

source_bert_toks: i hazard a guess that there are not only pure stallion ##s on the moor ; fate and careless ##ness always com ##pl ##icate ##s herd life .

reference_raw: I risk guessing that there are not only pure stallions on the moor; fate and carelessness always complicate herd life.

reference_spacy_tokens: I risk guessing that there are not only pure stallions on the moor ; fate and carelessness always complicate herd life .


fn_spacy_tokens_for_baseline: The first records of Slav incursions into the Balkans refer to plundering raids on the Byzantine settlements and fortresses of the Danubian lowlands and the Vardar - Morava corridor .

source_bert_toks: the first records of sl ##av inc ##urs ##ions into the balkans refer to pl ##under ##ing raids on the byzantine settlements and fortress ##es of the dan ##ub ##ian lowlands and the var ##dar - mora ##va corridor .

reference_raw: First records of Slav invasions into the Balkans refer to raids on Byzantine settlements and fortresses in the Danubian lowlands and in the Vardar-Morava Corridor.

reference_spacy_tokens: First records of Slav invasions into the Balkans refer to raids on Byzantine settlements and fortresses in the Danubian lowlands and in the Vardar - Morava Corridor .


fn_spacy_tokens_for_baseline: Everyone know the tale behind the ' Made in Taiwan ' label which appears on everything from designer apparel to high - tech equipment .

source_bert_toks: everyone know the tale behind the ' made in taiwan ' label which appears on everything from designer apparel to high - tech equipment .

reference_raw: Everyone knows the story behind the "Made in Taiwan" label that appears on everything from designer clothing to high-tech equipment.

reference_spacy_tokens: Everyone knows the story behind the " Made in Taiwan " label that appears on everything from designer clothing to high - tech equipment .


fn_spacy_tokens_for_baseline: As the new group begins to develop a clear idea of its own aims and objectives they might well decide to produce a video film of their own to explain their story .

source_bert_toks: as the new group begins to develop a clear idea of its own aims and objectives they might well decide to produce a video film of their own to explain their story .

reference_raw: As the new group begins to develop a clear idea of its own goals and objectives, they may well decide to make their own video film to explain their story.

reference_spacy_tokens: As the new group begins to develop a clear idea of its own goals and objectives , they may well decide to make their own video film to explain their story .


fn_spacy_tokens_for_baseline: Legal sources said an underground cell was being prepared for him on a maximum security row at the federal penitentiary in Marion , Illinois , America 's most chilling jail .

source_bert_toks: legal sources said an underground cell was being prepared for him on a maximum security row at the federal penitentiary in marion , illinois , america ' s most chilling jail .

reference_raw: According to legal sources, a subterranean cell is being prepared for him on a maximum security line at the federal prison in Marion, illinois, the coolest prison in America.

reference_spacy_tokens: According to legal sources , a subterranean cell is being prepared for him on a maximum security line at the federal prison in Marion , illinois , the coolest prison in America .


fn_spacy_tokens_for_baseline: We taxied towards the buildings and a little party of figures came to meet us as if they were welcoming a foreign diplomat .

source_bert_toks: we taxi ##ed towards the buildings and a little party of figures came to meet us as if they were welcoming a foreign diplomat .

reference_raw: We took a cab to the buildings, and a small group of figures came to us, as if welcoming a foreign diplomat.

reference_spacy_tokens: We took a cab to the buildings , and a small group of figures came to us , as if welcoming a foreign diplomat .


fn_spacy_tokens_for_baseline: But these six descended on them like the Dynamos on a loose ball , flattened them into the floorboards , and trussed them in sash - cord in twenty seconds .

source_bert_toks: but these six descended on them like the dynamo ##s on a loose ball , flattened them into the floor ##boards , and truss ##ed them in sash - cord in twenty seconds .

reference_raw: But the six came down on them like a dynamo on a loose ball, flattened them on the floorboards, and in twenty seconds they were crushed into a sash cord.

reference_spacy_tokens: But the six came down on them like a dynamo on a loose ball , flattened them on the floorboards , and in twenty seconds they were crushed into a sash cord .


fn_spacy_tokens_for_baseline: This assessment ranks North Korea among the largest possessors of chemical weaponry in the world .

source_bert_toks: this assessment ranks north korea among the largest possess ##ors of chemical weaponry in the world .

reference_raw: According to this assessment, North Korea is one of the world's largest owners of chemical weapons.

reference_spacy_tokens: According to this assessment , North Korea is one of the world 's largest owners of chemical weapons .


fn_spacy_tokens_for_baseline: It is now a grand little farmhouse forming part of a courtyard together with its outbuildings and set against the prevailing wind from the northwest .

source_bert_toks: it is now a grand little farmhouse forming part of a courtyard together with its out ##building ##s and set against the prevailing wind from the northwest .

reference_raw: It is now a large small farmhouse that forms part of the courtyard, along with its buildings, and is set against the prevailing north-west wind.

reference_spacy_tokens: It is now a large small farmhouse that forms part of the courtyard , along with its buildings , and is set against the prevailing north - west wind .


fn_spacy_tokens_for_baseline: The spitting image of Luciano Pavarotti begins a fresh career on Tuesday at Sir James Smith School in Camelford , Cornwall .

source_bert_toks: the spitting image of luciano pa ##var ##otti begins a fresh career on tuesday at sir james smith school in camel ##ford , cornwall .

reference_raw: Luciano Pavarotti's salivating image begins his new career on Tuesday at Sir James Smith School in Camelford, Cornwall.

reference_spacy_tokens: Luciano Pavarotti 's salivating image begins his new career on Tuesday at Sir James Smith School in Camelford , Cornwall .


fn_spacy_tokens_for_baseline: The Pope 's Vicar of Rome , Cardinal Ugo Poletti , has taken to scolding the Christian Democrats for their divisions which may bring victory for the secular parties and the Communists in city elections on 29 October .

source_bert_toks: the pope ' s vicar of rome , cardinal u ##go pole ##tti , has taken to sc ##old ##ing the christian democrats for their divisions which may bring victory for the secular parties and the communists in city elections on 29 october .

reference_raw: The Pope's vicar of Rome, Cardinal Ugo Poletti, has taken a stand against the Christian Democrats for their divisions, which may bring victory to the secular parties and communists in the municipal elections of 29 October.

reference_spacy_tokens: The Pope 's vicar of Rome , Cardinal Ugo Poletti , has taken a stand against the Christian Democrats for their divisions , which may bring victory to the secular parties and communists in the municipal elections of 29 October .


fn_spacy_tokens_for_baseline: This clause was construed by both Evershed J and the Court of Appeal to include acting as a consultant .

source_bert_toks: this clause was con ##st ##rued by both ever ##shed j and the court of appeal to include acting as a consultant .

reference_raw: Both Evershed J and the Court of Appeal interpreted that provision as including a consultant.

reference_spacy_tokens: Both Evershed J and the Court of Appeal interpreted that provision as including a consultant .


fn_spacy_tokens_for_baseline: A transfer can only be effected in respect of a new tenant or occupant of ' licensed premises ' and licensed premises are premises in respect of which a licence is in force .

source_bert_toks: a transfer can only be effect ##ed in respect of a new tenant or o ##cc ##up ##ant of ' licensed premises ' and licensed premises are premises in respect of which a licence is in force .

reference_raw: The transfer may take place only in respect of the new tenant or tenant of the licensed premises and the licensed premises are the premises for which the licence is valid.

reference_spacy_tokens: The transfer may take place only in respect of the new tenant or tenant of the licensed premises and the licensed premises are the premises for which the licence is valid .


fn_spacy_tokens_for_baseline: write this long detailed letter and everything like that to them you know and then it takes three weeks and all and i 'm like baloney

source_bert_toks: write this long detailed letter and everything like that to them you know and then it takes three weeks and all and i ' m like bal ##oney

reference_raw: text them a long, detailed letter and all, you know, and then it takes three weeks and everything, and I'm like a baloney.

reference_spacy_tokens: text them a long , detailed letter and all , you know , and then it takes three weeks and everything , and I 'm like a baloney .


fn_spacy_tokens_for_baseline: I watched in alarm as the rapidly rotating bundle crashed down the slope , jettisoning bits and pieces as it went .

source_bert_toks: i watched in alarm as the rapidly rotating bundle crashed down the slope , jett ##ison ##ing bits and pieces as it went .

reference_raw: I watched in alarm as the fast-rotating bundle fell down the slope, scattering bits and pieces as it went.

reference_spacy_tokens: I watched in alarm as the fast - rotating bundle fell down the slope , scattering bits and pieces as it went .


fn_spacy_tokens_for_baseline: The pilots were told to divert towards India but it is believed they turned north by mistake and hit the mountains .

source_bert_toks: the pilots were told to divert towards india but it is believed they turned north by mistake and hit the mountains .

reference_raw: Pilots have been told to turn to India, but it is believed that they have accidentally turned north and struck the mountains.

reference_spacy_tokens: Pilots have been told to turn to India , but it is believed that they have accidentally turned north and struck the mountains .


fn_spacy_tokens_for_baseline: Jen thinks : I do n't think I 'm very tipsy at all .

source_bert_toks: jen thinks : i don ' t think i ' m very tips ##y at all .

reference_raw: Jen says, "I don't think I'm drunk at all.

reference_spacy_tokens: Jen says , " I do n't think I 'm drunk at all .


fn_spacy_tokens_for_baseline: While she is occupied in examining the gift , he quickly scuttles over her and ties her to the ground with bonds of silk before he risks an embrace .

source_bert_toks: while she is occupied in examining the gift , he quickly sc ##ut ##tle ##s over her and ties her to the ground with bonds of silk before he risks an embrace .

reference_raw: While she was busy examining the gift, he scuttled quickly over her, tying her to the ground with silk cuffs before risking a hug.

reference_spacy_tokens: While she was busy examining the gift , he scuttled quickly over her , tying her to the ground with silk cuffs before risking a hug .


fn_spacy_tokens_for_baseline: Fifth , the theory may provide at least a partial reason for why ticket splitting has been particularly pronounced in the South .

source_bert_toks: fifth , the theory may provide at least a partial reason for why ticket splitting has been particularly pronounced in the south .

reference_raw: Fifthly, the theory may give at least a partial reason why the distribution of tickets is particularly pronounced in the southern part.

reference_spacy_tokens: Fifthly , the theory may give at least a partial reason why the distribution of tickets is particularly pronounced in the southern part .


fn_spacy_tokens_for_baseline: The relentless , time - consuming nature of his work literally asphyxiates the self - reflective side of his personality .

source_bert_toks: the relentless , time - consuming nature of his work literally as ##phy ##xia ##tes the self - reflective side of his personality .

reference_raw: The inexorable, time-consuming nature of his work literally suffocates the self-reflective side of his personality.

reference_spacy_tokens: The inexorable , time - consuming nature of his work literally suffocates the self - reflective side of his personality .


fn_spacy_tokens_for_baseline: Well , she thought , it wo n't be difficult to judge how right I am , if I pay out a few yards of line for him .

source_bert_toks: well , she thought , it won ' t be difficult to judge how right i am , if i pay out a few yards of line for him .

reference_raw: Well, she thought, it wouldn't be hard to judge how right I was if I paid him a few meters.

reference_spacy_tokens: Well , she thought , it would n't be hard to judge how right I was if I paid him a few meters .


fn_spacy_tokens_for_baseline: Creed had smiled to himself as he had slid the Xerox copies back into the envelope .

source_bert_toks: creed had smiled to himself as he had slid the x ##ero ##x copies back into the envelope .

reference_raw: Creed smiled to himself as he slipped the Xerox printouts back into the envelope.

reference_spacy_tokens: Creed smiled to himself as he slipped the Xerox printouts back into the envelope .


fn_spacy_tokens_for_baseline: His voice followed her as she stomped back to the cabin , but she was not listening .

source_bert_toks: his voice followed her as she stomped back to the cabin , but she was not listening .

reference_raw: His voice followed her as she stumbled back into the cabin, but she didn't listen.

reference_spacy_tokens: His voice followed her as she stumbled back into the cabin , but she did n't listen .


fn_spacy_tokens_for_baseline: I know that three days before they were killed , twenty - five people were invited to that house for the mass whipping of a dealer from Sunset Strip who 'd given them some bad dope .

source_bert_toks: i know that three days before they were killed , twenty - five people were invited to that house for the mass whipping of a dealer from sunset strip who ' d given them some bad do ##pe .

reference_raw: I know that, three days before they were killed, 25 people were invited to this house for the mass whipping of the Sunset Strip dealer who gave them the wrong drugs.

reference_spacy_tokens: I know that , three days before they were killed , 25 people were invited to this house for the mass whipping of the Sunset Strip dealer who gave them the wrong drugs .


fn_spacy_tokens_for_baseline: Although such figures might create public alarm , the main reason given for non - reporting was because the offence was considered too trivial to waste police time ( 38 per cent of reasons given ) , or that the police could do nothing about it ( 16 per cent ) .

source_bert_toks: although such figures might create public alarm , the main reason given for non - reporting was because the offence was considered too trivial to waste police time ( 38 per cent of reasons given ) , or that the police could do nothing about it ( 16 per cent ) .

reference_raw: While such data may give rise to public alarms, the main cause of non-reporting was that the crime was considered too trivial to waste police time (38% of the grounds given) or that the police could do nothing about it (16%).

reference_spacy_tokens: While such data may give rise to public alarms , the main cause of non - reporting was that the crime was considered too trivial to waste police time ( 38 % of the grounds given ) or that the police could do nothing about it ( 16 % ) .


fn_spacy_tokens_for_baseline: ' I join in it because there is no other way in the world by which justice can be gained .

source_bert_toks: ' i join in it because there is no other way in the world by which justice can be gained .

reference_raw: 'I'm joining him because there's no other way in the world to get justice.

reference_spacy_tokens: ' I 'm joining him because there 's no other way in the world to get justice .


fn_spacy_tokens_for_baseline: Fred dropped his head and groaned .

source_bert_toks: fred dropped his head and groaned .

reference_raw: Fred lowered his head and moaned.

reference_spacy_tokens: Fred lowered his head and moaned .


fn_spacy_tokens_for_baseline: They quarrelled about art .

source_bert_toks: they quarrel ##led about art .

reference_raw: They were arguing about art.

reference_spacy_tokens: They were arguing about art .


fn_spacy_tokens_for_baseline: If the bird 's head disappears behind some small obstruction , the cat can be seen to rush forward and pounce , as though it knows that at that moment the bird can not see its rapid advance .

source_bert_toks: if the bird ' s head disappears behind some small obstruction , the cat can be seen to rush forward and po ##unce , as though it knows that at that moment the bird can not see its rapid advance .

reference_raw: When the bird's head disappears behind a small obstacle, you can see the cat rushing forward and pounding, as if it knew that at that moment the bird could not see its rapid progress.

reference_spacy_tokens: When the bird 's head disappears behind a small obstacle , you can see the cat rushing forward and pounding , as if it knew that at that moment the bird could not see its rapid progress .


fn_spacy_tokens_for_baseline: Under the wise reign of Solomon , the city flourished as the capital of an empire that stretched from Damascus to the Red Sea and controlled the trade routes from Egypt to Phoenicia .

source_bert_toks: under the wise reign of solomon , the city flourished as the capital of an empire that stretched from damascus to the red sea and controlled the trade routes from egypt to ph ##oe ##nic ##ia .

reference_raw: Under Solomon's wise reign, the city flourished like the capital of an empire that stretched from Damascus to the Red Sea and ruled the trade routes from Egypt to Phoenicia.

reference_spacy_tokens: Under Solomon 's wise reign , the city flourished like the capital of an empire that stretched from Damascus to the Red Sea and ruled the trade routes from Egypt to Phoenicia .


fn_spacy_tokens_for_baseline: The blood came pumping out and I was sure I was going to die .

source_bert_toks: the blood came pumping out and i was sure i was going to die .

reference_raw: The blood was coming out, and I knew I was gonna die.

reference_spacy_tokens: The blood was coming out , and I knew I was gon na die .


fn_spacy_tokens_for_baseline: The London - based firm was responsible for melding Encina with CICS .

source_bert_toks: the london - based firm was responsible for mel ##ding en ##cina with ci ##cs .

reference_raw: The company established in London was responsible for mixing Encina with CICS.

reference_spacy_tokens: The company established in London was responsible for mixing Encina with CICS .


fn_spacy_tokens_for_baseline: No , the first thing he launched into was a harangue about how Gillian 's mother would n't tell him where we were staying .

source_bert_toks: no , the first thing he launched into was a hara ##ng ##ue about how gillian ' s mother wouldn ' t tell him where we were staying .

reference_raw: No, the first thing he started to do was talk about Gillian's mother not telling him where we live.

reference_spacy_tokens: No , the first thing he started to do was talk about Gillian 's mother not telling him where we live .


fn_spacy_tokens_for_baseline: A 12-year - old boy reports seeing a man launch a rubber boat from a car parked at the harbor .

source_bert_toks: a 12 - year - old boy reports seeing a man launch a rubber boat from a car parked at the harbor .

reference_raw: A 12-year-old boy reports seeing a man take a rubber ship out of a car parked in the harbor.

reference_spacy_tokens: A 12-year - old boy reports seeing a man take a rubber ship out of a car parked in the harbor .


fn_spacy_tokens_for_baseline: He added : ' We will do it to express our derision for this Treasury bench of limpets , clinging on to office after breaking every promise that got them into it .

source_bert_toks: he added : ' we will do it to express our der ##ision for this treasury bench of limp ##ets , clinging on to office after breaking every promise that got them into it .

reference_raw: He added, "We're going to do this to express our mockery of this treasure bench of limpets, and we're going to stick to the office after breaking every promise they've made.

reference_spacy_tokens: He added , " We 're going to do this to express our mockery of this treasure bench of limpets , and we 're going to stick to the office after breaking every promise they 've made .


fn_spacy_tokens_for_baseline: The small Chapel of St. Francis Xavier is dedicated to the 16th - century patron saint of missionaries , and has on display the elbow of the saint , along with the bones of numerous Japanese and Vietnamese martyrs .

source_bert_toks: the small chapel of st . francis xavier is dedicated to the 16th - century patron saint of missionaries , and has on display the elbow of the saint , along with the bones of numerous japanese and vietnamese martyrs .

reference_raw: St. Francis Xavier's little chapel is dedicated to the 16th-century patron saint of missionaries, with the bones of many Japanese and Vietnamese martyrs on display.

reference_spacy_tokens: St. Francis Xavier 's little chapel is dedicated to the 16th - century patron saint of missionaries , with the bones of many Japanese and Vietnamese martyrs on display .


fn_spacy_tokens_for_baseline: Hail pattered on the window , quick as morse .

source_bert_toks: hail pat ##tered on the window , quick as morse .

reference_raw: Hail patted the window, quick as morse.

reference_spacy_tokens: Hail patted the window , quick as morse .


fn_spacy_tokens_for_baseline: Flora blew her nose into the pristine handkerchief , scrunched it into a ball and threw it onto the linoleum floor .

source_bert_toks: flora blew her nose into the pristine handkerchief , sc ##run ##ched it into a ball and threw it onto the lin ##ole ##um floor .

reference_raw: Flora blew her nose into a pristine handkerchief, scraped it into a ball, and tossed it to the linoleum floor.

reference_spacy_tokens: Flora blew her nose into a pristine handkerchief , scraped it into a ball , and tossed it to the linoleum floor .


fn_spacy_tokens_for_baseline: A tiny fragment of the Dead Sea Scrolls is causing a row between experts here and in America .

source_bert_toks: a tiny fragment of the dead sea scrolls is causing a row between experts here and in america .

reference_raw: A small fraction of the Dead Sea Scrolls creates a line of experts here and in America.

reference_spacy_tokens: A small fraction of the Dead Sea Scrolls creates a line of experts here and in America .


fn_spacy_tokens_for_baseline: Simon Gray 's The Holy Terror was good , but Beckett is incomparable , and Barry McGovern 's reading of Stirrings Still is an owl in the belfry of my memory .

source_bert_toks: simon gray ' s the holy terror was good , but beckett is inc ##omp ##arable , and barry mc ##go ##vern ' s reading of stirring ##s still is an owl in the bel ##fr ##y of my memory .

reference_raw: Simon Gray's Holy Terror was good, but Beckett is unparalleled, and Barry McGovern's reading of Stirrings is still an owl in my memory.

reference_spacy_tokens: Simon Gray 's Holy Terror was good , but Beckett is unparalleled , and Barry McGovern 's reading of Stirrings is still an owl in my memory .


fn_spacy_tokens_for_baseline: That increases the surface tension on the top of the coffee -- or is it the specific gravity ? -- so that when you dribble the cream slowly down over the back of the spoon it stays on the top . "

source_bert_toks: that increases the surface tension on the top of the coffee - - or is it the specific gravity ? - - so that when you dr ##ib ##ble the cream slowly down over the back of the spoon it stays on the top . "

reference_raw: This increases the surface tension at the top of the coffee - or is it a special gravity? - so that if you drip the cream slowly over the back of the spoon, it stays on the top.'

reference_spacy_tokens: This increases the surface tension at the top of the coffee - or is it a special gravity ? - so that if you drip the cream slowly over the back of the spoon , it stays on the top . '


fn_spacy_tokens_for_baseline: If dialogue is being taped in stereo , the signals from the individual speakers should not be given a pronounced left and right stereo bias as this would conflict with the performers ' relative positioning as seen in shot .

source_bert_toks: if dialogue is being taped in stereo , the signals from the individual speakers should not be given a pronounced left and right stereo bias as this would conflict with the performers ' relative positioning as seen in shot .

reference_raw: If the dialogue is recorded in stereo, the signals of the individual speakers should not be given a clear left and right stereo bias, as this would be contrary to the relative position of the performers as seen in the shot.

reference_spacy_tokens: If the dialogue is recorded in stereo , the signals of the individual speakers should not be given a clear left and right stereo bias , as this would be contrary to the relative position of the performers as seen in the shot .


fn_spacy_tokens_for_baseline: The Zuckerman books help one to imagine how Roth has faced the reproach that he has derided his family and sold their secrets .

source_bert_toks: the zu ##cker ##man books help one to imagine how roth has faced the rep ##ro ##ach that he has der ##ided his family and sold their secrets .

reference_raw: The Zuckerman books help you imagine how Roth faced the accusation that he had ridiculed his family and sold their secrets.

reference_spacy_tokens: The Zuckerman books help you imagine how Roth faced the accusation that he had ridiculed his family and sold their secrets .


fn_spacy_tokens_for_baseline: The jury began deliberating upon its verdict on April 23 .

source_bert_toks: the jury began del ##ibe ##rating upon its verdict on april 23 .

reference_raw: The jury began to consider the verdict on April 23rd.

reference_spacy_tokens: The jury began to consider the verdict on April 23rd .


fn_spacy_tokens_for_baseline: I walked along Shattuck between Delaware and Cedar at a few minutes before eight this morning .

source_bert_toks: i walked along sha ##tt ##uck between delaware and cedar at a few minutes before eight this morning .

reference_raw: A few minutes before eight in the morning, I followed Shattuck from Delaware to Cedar.

reference_spacy_tokens: A few minutes before eight in the morning , I followed Shattuck from Delaware to Cedar .


fn_spacy_tokens_for_baseline: I 'm the club 's President for life -- great honour , that -- and in 1985 we launched the bi - annual Max Boyce Classic to raise money for improvements .

source_bert_toks: i ' m the club ' s president for life - - great honour , that - - and in 1985 we launched the bi - annual max boy ##ce classic to raise money for improvements .

reference_raw: I am the president of the club for the rest of my life - a great honor, that - and in 1985 we launched a six-year Max Boyce classic to raise money for improvement.

reference_spacy_tokens: I am the president of the club for the rest of my life - a great honor , that - and in 1985 we launched a six - year Max Boyce classic to raise money for improvement .


fn_spacy_tokens_for_baseline: This meadowland or mead land was usually low - lying and damp for much of the year , but it produced an abundance of grass which was cut for hay .

source_bert_toks: this meadow ##land or mead land was usually low - lying and damp for much of the year , but it produced an abundance of grass which was cut for hay .

reference_raw: For most of the year, the meadowland or the meadowland was mostly low-lying and wet, but it produced a lot of grass that had been cut for hay.

reference_spacy_tokens: For most of the year , the meadowland or the meadowland was mostly low - lying and wet , but it produced a lot of grass that had been cut for hay .


fn_spacy_tokens_for_baseline: Much of it , of course , using the standards of top newspapers , can not be used since it is largely gossip we are repeating , although it certainly could make for some very good stories .

source_bert_toks: much of it , of course , using the standards of top newspapers , can not be used since it is largely gossip we are repeating , although it certainly could make for some very good stories .

reference_raw: Most of it, of course, can't be used by the standards of the best papers, because it's mostly rumors that we repeat, although it can certainly make up some very good stories.

reference_spacy_tokens: Most of it , of course , ca n't be used by the standards of the best papers , because it 's mostly rumors that we repeat , although it can certainly make up some very good stories .


fn_spacy_tokens_for_baseline: His own self - discovery of being different had been too painful , too crabbed and silently traumatising for him to be able lightly to throw off his mask of slightly Wildean , slightly dandified but wholly oppressed compliance in society 's view that he was an oddity .

source_bert_toks: his own self - discovery of being different had been too painful , too crab ##bed and silently trauma ##tis ##ing for him to be able lightly to throw off his mask of slightly wilde ##an , slightly dan ##di ##fied but wholly op ##pressed compliance in society ' s view that he was an odd ##ity .

reference_raw: His self-discovering that he was different was so painful, so crabbed, and so silently traumatized that he could easily throw off the mask of a slightly wild, slightly dandified, but completely oppressed, society's view of him as a strange thing.

reference_spacy_tokens: His self - discovering that he was different was so painful , so crabbed , and so silently traumatized that he could easily throw off the mask of a slightly wild , slightly dandified , but completely oppressed , society 's view of him as a strange thing .


fn_spacy_tokens_for_baseline: They are said to squabble endlessly about personnel appointments and propaganda slogans .

source_bert_toks: they are said to sq ##ua ##bble endless ##ly about personnel appointments and propaganda slogan ##s .

reference_raw: They're supposed to be arguing endlessly about staff meetings and propaganda slogans.

reference_spacy_tokens: They 're supposed to be arguing endlessly about staff meetings and propaganda slogans .


fn_spacy_tokens_for_baseline: Let 's take the moderately humongous million , for starters .

source_bert_toks: let ' s take the moderately hum ##ong ##ous million , for starters .

reference_raw: Let's start with a moderately modest million.

reference_spacy_tokens: Let 's start with a moderately modest million .


fn_spacy_tokens_for_baseline: A popular hotel on the seafront the Royal has a garden , swimming pool and private underpass to the beach opposite .

source_bert_toks: a popular hotel on the sea ##front the royal has a garden , swimming pool and private under ##pass to the beach opposite .

reference_raw: The Royal's favorite hotel has a garden, a swimming pool, and a private subway to the beach opposite.

reference_spacy_tokens: The Royal 's favorite hotel has a garden , a swimming pool , and a private subway to the beach opposite .


fn_spacy_tokens_for_baseline: By a curiously symmetrical piece of political manoeuvring , the KDPI , in revolt against Tehran , was succoured by Baghdad , while the KDP , in revolt against Baghdad , was succoured by Tehran .

source_bert_toks: by a curiously symmetrical piece of political man ##oe ##u ##vr ##ing , the k ##dp ##i , in revolt against tehran , was su ##cco ##ured by baghdad , while the k ##dp , in revolt against baghdad , was su ##cco ##ured by tehran .

reference_raw: With a curiously symmetrical piece of political maneuvering, the KDPI succumbed to Baghdad in revolt against Tehran, while the KDP succumbed to Tehran in revolt against Baghdad.

reference_spacy_tokens: With a curiously symmetrical piece of political maneuvering , the KDPI succumbed to Baghdad in revolt against Tehran , while the KDP succumbed to Tehran in revolt against Baghdad .


fn_spacy_tokens_for_baseline: Frayed or cut wires , for instance , can kill by electrocution .

source_bert_toks: fray ##ed or cut wires , for instance , can kill by electro ##cut ##ion .

reference_raw: Fraying or cutting wires, for example, can be electrocuted.

reference_spacy_tokens: Fraying or cutting wires , for example , can be electrocuted .


fn_spacy_tokens_for_baseline: Labour will embrace the goal of sustainable development , with environmental modernisation an integral part of our industrial strategy .

source_bert_toks: labour will embrace the goal of sustainable development , with environmental modern ##isation an integral part of our industrial strategy .

reference_raw: Labour will accept the objective of sustainable development and modernise the environment is an integral part of our industrial strategy.

reference_spacy_tokens: Labour will accept the objective of sustainable development and modernise the environment is an integral part of our industrial strategy .


fn_spacy_tokens_for_baseline: Marching along the street , with boots thudding and fingers slapping ( a peculiarly skinhead mannerism ) , all wearing the same clothes and the same haircut , the skinheads presented an image of power .

source_bert_toks: marching along the street , with boots thud ##ding and fingers slapping ( a peculiar ##ly skin ##head manner ##ism ) , all wearing the same clothes and the same hair ##cut , the skin ##heads presented an image of power .

reference_raw: The leatherheads marched along the street, their boots thumping and their fingers slapping (a strangely leathery mannerism), all wearing the same clothes and the same haircut, displaying an image of strength.

reference_spacy_tokens: The leatherheads marched along the street , their boots thumping and their fingers slapping ( a strangely leathery mannerism ) , all wearing the same clothes and the same haircut , displaying an image of strength .


fn_spacy_tokens_for_baseline: I supposed , during those brief , heady moments after your heartbreaking apology that you had wanted to come to me tonight as much as I wanted you to come .

source_bert_toks: i supposed , during those brief , head ##y moments after your heartbreak ##ing apology that you had wanted to come to me tonight as much as i wanted you to come .

reference_raw: In those short, heady moments after your heart-breaking apology, I thought you wanted to come to me tonight as much as I wanted you to.

reference_spacy_tokens: In those short , heady moments after your heart - breaking apology , I thought you wanted to come to me tonight as much as I wanted you to .


fn_spacy_tokens_for_baseline: There have been lots of accusations about how party headquarters has been very careless in allowing damaging material to leak out in recent months .

source_bert_toks: there have been lots of accusations about how party headquarters has been very careless in allowing damaging material to leak out in recent months .

reference_raw: There's been a lot of allegations about how the party's headquarters has been very reckless in allowing harmful material to leak out in the last few months.

reference_spacy_tokens: There 's been a lot of allegations about how the party 's headquarters has been very reckless in allowing harmful material to leak out in the last few months .


fn_spacy_tokens_for_baseline: WHEN WYCLIFFE ARRIVED next morning the town was shrouded in a fine mist with a salty tang .

source_bert_toks: when w ##y ##cliffe arrived next morning the town was sh ##roud ##ed in a fine mist with a salty tang .

reference_raw: The next morning the city was covered in a fine fog with a salty tang.

reference_spacy_tokens: The next morning the city was covered in a fine fog with a salty tang .


fn_spacy_tokens_for_baseline: Due to challenges posed by a limited source of indigenously produced precursors for CW agents , it is believed that North Korea emphasizes production of phosgene , mustard , sarin , and V - agents . ( Previous reports have also alleged a large stock of sarin nerve agent . ) In 2001 , it was estimated that there are 12 facilities in the DPRK where raw chemicals , precursors , and CW agents are produced and / or stored .

source_bert_toks: due to challenges posed by a limited source of indigenous ##ly produced precursor ##s for cw agents , it is believed that north korea emphasizes production of ph ##os ##gen ##e , mustard , sar ##in , and v - agents . ( previous reports have also alleged a large stock of sar ##in nerve agent . ) in 2001 , it was estimated that there are 12 facilities in the d ##pr ##k where raw chemicals , precursor ##s , and cw agents are produced and / or stored .

reference_raw: Due to the problems posed by the limited source of indigenous precursors to CW agents, it is believed that North Korea highlights the production of phosgenes, mustards, sarins and V-agents. (Previous reports also reported a large stock of sarin nerve agents) in 2001, it is estimated that there are 12 facilities in the DPRK where raw chemicals, precursors, and CW agents are manufactured and/reserved.

reference_spacy_tokens: Due to the problems posed by the limited source of indigenous precursors to CW agents , it is believed that North Korea highlights the production of phosgenes , mustards , sarins and V - agents . ( Previous reports also reported a large stock of sarin nerve agents ) in 2001 , it is estimated that there are 12 facilities in the DPRK where raw chemicals , precursors , and CW agents are manufactured and / reserved .


fn_spacy_tokens_for_baseline: Consequently , over the years , I have become knowledgeable about many of the world 's remote places .

source_bert_toks: consequently , over the years , i have become knowledge ##able about many of the world ' s remote places .

reference_raw: As a result, over the years, I became aware of many of the remote locations in the world.

reference_spacy_tokens: As a result , over the years , I became aware of many of the remote locations in the world .


fn_spacy_tokens_for_baseline: Direct taxes are , as a group , progressive in the UK , taking a larger proportion of the income of richer households .

source_bert_toks: direct taxes are , as a group , progressive in the uk , taking a larger proportion of the income of richer households .

reference_raw: Direct taxes, as a group, are progressive in the United Kingdom and account for a larger share of the income of wealthier households.

reference_spacy_tokens: Direct taxes , as a group , are progressive in the United Kingdom and account for a larger share of the income of wealthier households .


fn_spacy_tokens_for_baseline: We carried her upstairs , laid her on the sofa , and a couple of cups of the strongest coffee soon cleared her brain from the mists of the drug .

source_bert_toks: we carried her upstairs , laid her on the sofa , and a couple of cups of the strongest coffee soon cleared her brain from the mist ##s of the drug .

reference_raw: We carried her up, put her on the couch, and a few cups of the strongest coffee soon cleared her mind of the fog.

reference_spacy_tokens: We carried her up , put her on the couch , and a few cups of the strongest coffee soon cleared her mind of the fog .


fn_spacy_tokens_for_baseline: Mother 's and father 's names , mother 's address , and father 's occupation are routinely recorded on the birth certificate .

source_bert_toks: mother ' s and father ' s names , mother ' s address , and father ' s occupation are routinely recorded on the birth certificate .

reference_raw: The mother's and father's names, mother's address, and father's profession are routinely entered in the birth certificate.

reference_spacy_tokens: The mother 's and father 's names , mother 's address , and father 's profession are routinely entered in the birth certificate .


fn_spacy_tokens_for_baseline: This was music spawned in secret clubs that thronged with gay blacks and Latins .

source_bert_toks: this was music spawned in secret clubs that th ##rong ##ed with gay blacks and latin ##s .

reference_raw: It was music spawned in secret clubs crowded with gay blacks and Latins.

reference_spacy_tokens: It was music spawned in secret clubs crowded with gay blacks and Latins .


fn_spacy_tokens_for_baseline: Lady Diana 's engagement to Prince Charles really put Althorp on the map , and it became a full - time job for me .

source_bert_toks: lady diana ' s engagement to prince charles really put alt ##hor ##p on the map , and it became a full - time job for me .

reference_raw: Lady Diana's commitment to Prince Charles has really put Althorp on the map, and it's become my full-time job.

reference_spacy_tokens: Lady Diana 's commitment to Prince Charles has really put Althorp on the map , and it 's become my full - time job .


fn_spacy_tokens_for_baseline: Catastrophe losses reduced Aetna 's net income by $ 50 million , including $ 36 million from Hugo .

source_bert_toks: catastrophe losses reduced ae ##t ##na ' s net income by $ 50 million , including $ 36 million from hugo .

reference_raw: Catastrophic casualties reduced Aetna's net income by $50 million, including $36 million from Hugo.

reference_spacy_tokens: Catastrophic casualties reduced Aetna 's net income by $ 50 million , including $ 36 million from Hugo .


fn_spacy_tokens_for_baseline: The early 1980s also marks the beginning of high explosives test that are required for the triggering mechanism in a nuclear bomb .

source_bert_toks: the early 1980s also marks the beginning of high explosives test that are required for the triggering mechanism in a nuclear bomb .

reference_raw: The early 1980s also mark the start of a high-explosive test needed to trigger a nuclear bomb.

reference_spacy_tokens: The early 1980s also mark the start of a high - explosive test needed to trigger a nuclear bomb .


fn_spacy_tokens_for_baseline: Dublin has international restaurants galore , and the New Irish Cuisine is built upon fresh products of Ireland 's seas , rivers , and farms .

source_bert_toks: dublin has international restaurants gal ##ore , and the new irish cuisine is built upon fresh products of ireland ' s seas , rivers , and farms .

reference_raw: Dublin has a galore of international restaurants, and New Ireland's cuisine is based on fresh products from Ireland's seas, rivers and farms.

reference_spacy_tokens: Dublin has a galore of international restaurants , and New Ireland 's cuisine is based on fresh products from Ireland 's seas , rivers and farms .


fn_spacy_tokens_for_baseline: Two Mirage fighter jets from Libya landed on the Mediterranean island nation of Malta , and the pilots asked for political asylum .

source_bert_toks: two mirage fighter jets from libya landed on the mediterranean island nation of malta , and the pilots asked for political asylum .

reference_raw: Two Mirage fighters from Libya have arrived in Malta's Mediterranean island country, and pilots have requested political asylum.

reference_spacy_tokens: Two Mirage fighters from Libya have arrived in Malta 's Mediterranean island country , and pilots have requested political asylum .


fn_spacy_tokens_for_baseline: ' I 'm worried that the pills might get into the hands of children . '

source_bert_toks: ' i ' m worried that the pills might get into the hands of children . '

reference_raw: "I'm afraid the pills will reach the children."

reference_spacy_tokens: " I 'm afraid the pills will reach the children . "


fn_spacy_tokens_for_baseline: The conclusion of scholars is that the passage on the Holy Name and the addition to chapter seventy is original to Hilton whereas the shorter passages were probably originated and incorporated by transcribers as glosses on the text .

source_bert_toks: the conclusion of scholars is that the passage on the holy name and the addition to chapter seventy is original to hilton whereas the shorter passages were probably originated and incorporated by trans ##cr ##ibe ##rs as gloss ##es on the text .

reference_raw: The conclusion of the scholars is that the passage of the Holy Name and the addition of Chapter 70 is original for Hilton, while the shorter passages are likely to have come from the transcribers as a gloss on the text.

reference_spacy_tokens: The conclusion of the scholars is that the passage of the Holy Name and the addition of Chapter 70 is original for Hilton , while the shorter passages are likely to have come from the transcribers as a gloss on the text .


fn_spacy_tokens_for_baseline: Nothing really extraordinary happens , and most of the young people are very decent and honest .

source_bert_toks: nothing really extraordinary happens , and most of the young people are very decent and honest .

reference_raw: There's nothing unusual going on, and most young people are very polite and honest.

reference_spacy_tokens: There 's nothing unusual going on , and most young people are very polite and honest .


fn_spacy_tokens_for_baseline: Every man , woman , and child in the country would own about 100 of them , but garaging them would be no problem as each car would be little bigger than a matchbox .

source_bert_toks: every man , woman , and child in the country would own about 100 of them , but ga ##rag ##ing them would be no problem as each car would be little bigger than a match ##box .

reference_raw: Every man, woman, and child in the country would own about a hundred of them, but it wouldn't be a problem to garner them, because every car was no bigger than a matchbox.

reference_spacy_tokens: Every man , woman , and child in the country would own about a hundred of them , but it would n't be a problem to garner them , because every car was no bigger than a matchbox .


fn_spacy_tokens_for_baseline: The document " defines the act of nuclear terrorism as the use or threat to use nuclear material , nuclear fuel , radioactive products or waste , or any other radioactive substances with toxic , explosive , or other dangerous properties , " and outlines measures aimed to prevent terrorist acts involving the use of nuclear or other radioactive materials . ( Russian News and Information Agency Novosti , 26Jun06 ) http://en.rian.ru/ russia /20060626/50069639.html

source_bert_toks: the document " defines the act of nuclear terrorism as the use or threat to use nuclear material , nuclear fuel , radioactive products or waste , or any other radioactive substances with toxic , explosive , or other dangerous properties , " and outlines measures aimed to prevent terrorist acts involving the use of nuclear or other radioactive materials . ( russian news and information agency novo ##sti , 26 ##jun ##0 ##6 ) http : / / en . ri ##an . ru / russia / 2006 ##0 ##6 ##26 / 500 ##6 ##9 ##6 ##39 . html

reference_raw: The document "defines the act of nuclear terrorism as the use or threat of the use of nuclear material, nuclear fuel, radioactive products or waste, or other radioactive substances with toxic, exploding or other hazardous properties" and outlines measures to prevent acts of terrorism involving the use of nuclear or other radioactive materials (Russian News and Information Agency Novosti, 26 June 2006) http://en.rian.ru/Russia 2006/06/06/06/06/2006/06/06) 50069639.html

reference_spacy_tokens: The document " defines the act of nuclear terrorism as the use or threat of the use of nuclear material , nuclear fuel , radioactive products or waste , or other radioactive substances with toxic , exploding or other hazardous properties " and outlines measures to prevent acts of terrorism involving the use of nuclear or other radioactive materials ( Russian News and Information Agency Novosti , 26 June 2006 ) http://en.rian.ru/Russia 2006/06/06/06/06/2006/06/06 ) 50069639.html


fn_spacy_tokens_for_baseline: As Darrow left the courthouse after the guilty pleas , an angry crowd pressed in around him .

source_bert_toks: as dar ##row left the courthouse after the guilty pleas , an angry crowd pressed in around him .

reference_raw: As Darrow left the courthouse after the guilty pleas, an angry crowd crowded around him.

reference_spacy_tokens: As Darrow left the courthouse after the guilty pleas , an angry crowd crowded around him .


fn_spacy_tokens_for_baseline: The resolution , drafted by the Islamic Conference group of countries , calls for ' a comprehensive political solution ' and a ' cessation of hostilities ' but contains no initiatives of substance , diplomats said .

source_bert_toks: the resolution , drafted by the islamic conference group of countries , calls for ' a comprehensive political solution ' and a ' ce ##ssa ##tion of hostilities ' but contains no initiatives of substance , diplomats said .

reference_raw: The resolution, drawn up by the Islamic Conference Group of States, calls for "comprehensive political solution" and "ceasing hostility", but does not contain substantive initiatives, the diplomats said.

reference_spacy_tokens: The resolution , drawn up by the Islamic Conference Group of States , calls for " comprehensive political solution " and " ceasing hostility " , but does not contain substantive initiatives , the diplomats said .


fn_spacy_tokens_for_baseline: Because I retained a few French words and phrases and could make myself understood in his language he had assumed a much wider knowledge than I possessed .

source_bert_toks: because i retained a few french words and phrases and could make myself understood in his language he had assumed a much wider knowledge than i possessed .

reference_raw: Since I had kept a few French words and phrases, and was able to understand in his own language, he had taken on more knowledge than I had.

reference_spacy_tokens: Since I had kept a few French words and phrases , and was able to understand in his own language , he had taken on more knowledge than I had .


fn_spacy_tokens_for_baseline: One of the duke 's groundsmen advised me to reconnoitre a nearby converted abbey which has recently been turned into a hotel .

source_bert_toks: one of the duke ' s grounds ##men advised me to rec ##on ##no ##it ##re a nearby converted abbey which has recently been turned into a hotel .

reference_raw: One of the Duke's landlords advised me to explore a nearby converted abbey that had recently become a hotel.

reference_spacy_tokens: One of the Duke 's landlords advised me to explore a nearby converted abbey that had recently become a hotel .


fn_spacy_tokens_for_baseline: I have complete confidence in your filial love , and know that you have taken all possible care of your devoted mother .

source_bert_toks: i have complete confidence in your fi ##lia ##l love , and know that you have taken all possible care of your devoted mother .

reference_raw: I have complete confidence in your loyal love, and I know you've taken care of your devoted mother.

reference_spacy_tokens: I have complete confidence in your loyal love , and I know you 've taken care of your devoted mother .


fn_spacy_tokens_for_baseline: Moonlight glinted off the rifles of the sentries as they patrolled the area in front of the house , lighting up the long black Mercedes that waited , chauffeur at the ready in case of emergency .

source_bert_toks: moonlight glint ##ed off the rifles of the sent ##ries as they patrol ##led the area in front of the house , lighting up the long black mercedes that waited , cha ##uf ##fe ##ur at the ready in case of emergency .

reference_raw: The moonlight gleamed from the guards' rifles as they patrolled the area in front of the house, illuminating the long black Mercedes waiting, the driver ready in case of emergency.

reference_spacy_tokens: The moonlight gleamed from the guards ' rifles as they patrolled the area in front of the house , illuminating the long black Mercedes waiting , the driver ready in case of emergency .


fn_spacy_tokens_for_baseline: Only 35 minutes by ferry from Central , Lamma Island is perfect for swimming , hiking , picnicking , birdwatching , or just sitting back to watch the bananas grow .

source_bert_toks: only 35 minutes by ferry from central , lam ##ma island is perfect for swimming , hiking , picnic ##king , bird ##watch ##ing , or just sitting back to watch the bananas grow .

reference_raw: Only 35 minutes on the ferry from Central, the Isle of Lamma is ideal for swimming, hiking, picnic, bird-watching, or just sitting back and watching bananas grow.

reference_spacy_tokens: Only 35 minutes on the ferry from Central , the Isle of Lamma is ideal for swimming , hiking , picnic , bird - watching , or just sitting back and watching bananas grow .


fn_spacy_tokens_for_baseline: Anyway , in that desolate chamber at Sheen I removed soft buskins from the corpse 's feet , carefully pushing back the blue robe and the white cotton shift beneath .

source_bert_toks: anyway , in that des ##olate chamber at sheen i removed soft bus ##kins from the corpse ' s feet , carefully pushing back the blue robe and the white cotton shift beneath .

reference_raw: In any case, in that deserted room in Sheen, I removed the soft skins from the body's feet and carefully pushed back the blue robe and the white cotton shift under it.

reference_spacy_tokens: In any case , in that deserted room in Sheen , I removed the soft skins from the body 's feet and carefully pushed back the blue robe and the white cotton shift under it .


fn_spacy_tokens_for_baseline: The high quality of the seam on Milos ensured that the area remained popular with early travelers .

source_bert_toks: the high quality of the seam on milos ensured that the area remained popular with early travelers .

reference_raw: The high quality of the seam on Milos ensures that the area is still popular with premature travellers.

reference_spacy_tokens: The high quality of the seam on Milos ensures that the area is still popular with premature travellers .


fn_spacy_tokens_for_baseline: But there 's no substitute for its warm aromatic bouquet .

source_bert_toks: but there ' s no substitute for its warm aromatic bouquet .

reference_raw: But there's no substitute for her warm, aromatic flower.

reference_spacy_tokens: But there 's no substitute for her warm , aromatic flower .