fn_spacy_tokens_for_baseline: He had a long , brown , American - style overcoat , a woollen scarf against the cold , the usual hat , and the sword - stick , perhaps an imitation , which was no doubt a present .

source_bert_toks: he had a long , brown , american - style over ##coat , a wool ##len scarf against the cold , the usual hat , and the sword - stick , perhaps an imitation , which was no doubt a present .

reference_raw: He was wearing a long, brown, American-style coat, a woolen scarf against the cold, a customary hat, and a swordstick, perhaps an imitation, which was no doubt a gift.

reference_spacy_tokens: He was wearing a long , brown , American - style coat , a woolen scarf against the cold , a customary hat , and a swordstick , perhaps an imitation , which was no doubt a gift .


fn_spacy_tokens_for_baseline: After breakfast he drove his hired car , a glistening Mercedes , out into the island .

source_bert_toks: after breakfast he drove his hired car , a glistening mercedes , out into the island .

reference_raw: After breakfast, he drove his hired car, a gleaming Mercedes, to the island.

reference_spacy_tokens: After breakfast , he drove his hired car , a gleaming Mercedes , to the island .


fn_spacy_tokens_for_baseline: That was the message delivered by government and private security experts at an all - day conference on corporate electronic espionage .

source_bert_toks: that was the message delivered by government and private security experts at an all - day conference on corporate electronic espionage .

reference_raw: This was a message delivered by government and private security experts at a daily meeting on corporate electronic espionage.

reference_spacy_tokens: This was a message delivered by government and private security experts at a daily meeting on corporate electronic espionage .


fn_spacy_tokens_for_baseline: In an attempt to swell the accounts , Branson desperately began to call in money from abroad .

source_bert_toks: in an attempt to swell the accounts , bran ##son desperately began to call in money from abroad .

reference_raw: In an attempt to expand the accounts, Branson began desperately calling for money from abroad.

reference_spacy_tokens: In an attempt to expand the accounts , Branson began desperately calling for money from abroad .


fn_spacy_tokens_for_baseline: The Soviet Union also established a so - called anti - plague system , whose primary objective was to control endemic diseases and prevent the importation of exotic pathogens that could threaten crops , animals , and humans .

source_bert_toks: the soviet union also established a so - called anti - plague system , whose primary objective was to control endemic diseases and prevent the import ##ation of exotic pathogen ##s that could threaten crops , animals , and humans .

reference_raw: The Soviet Union has also set up a so-called anti-pestile system whose primary objective is to control endemic diseases and prevent the introduction of exotic pathogens that could endanger crops, animals, and people.

reference_spacy_tokens: The Soviet Union has also set up a so - called anti - pestile system whose primary objective is to control endemic diseases and prevent the introduction of exotic pathogens that could endanger crops , animals , and people .


fn_spacy_tokens_for_baseline: Heat the oil in a large shallow pan and cook the onion until soft and transparent .

source_bert_toks: heat the oil in a large shallow pan and cook the onion until soft and transparent .

reference_raw: Heat the oil in a large shallow pelvis and boil the onion until it is soft and transparent.

reference_spacy_tokens: Heat the oil in a large shallow pelvis and boil the onion until it is soft and transparent .


fn_spacy_tokens_for_baseline: But if white people do n't need degrees from tony colleges to succeed , why do Thernstrom and her cohorts care so much about these schools ' efforts to level the playing field ?

source_bert_toks: but if white people don ' t need degrees from tony colleges to succeed , why do the ##rn ##strom and her co ##hort ##s care so much about these schools ' efforts to level the playing field ?

reference_raw: But if white people don't need Tony College diplomas to be successful, why are Thernstrom and her cohorts so interested in their efforts to level the playing field?

reference_spacy_tokens: But if white people do n't need Tony College diplomas to be successful , why are Thernstrom and her cohorts so interested in their efforts to level the playing field ?


fn_spacy_tokens_for_baseline: ' God , what an accursed night ! ' mumbled Mr Beckenham , and , sipping his liquor , he looked over the makeshift meal with revulsion .

source_bert_toks: ' god , what an acc ##urse ##d night ! ' mumbled mr beck ##enham , and , sipping his liquor , he looked over the makeshift meal with rev ##ulsion .

reference_raw: 'God, what a damn night!' muttered Mr. Beckenham, sipping his drink and looking at the makeshift food with disgust.

reference_spacy_tokens: ' God , what a damn night ! ' muttered Mr. Beckenham , sipping his drink and looking at the makeshift food with disgust .


fn_spacy_tokens_for_baseline: In Thomas Hardy 's The Hand of Ethelberta , it is suggested by Ethelberta that she and some others go to see Milton 's tomb in Cripplegate church .

source_bert_toks: in thomas hardy ' s the hand of ethel ##bert ##a , it is suggested by ethel ##bert ##a that she and some others go to see milton ' s tomb in cr ##ip ##ple ##gate church .

reference_raw: In Thomas Hardy's Hand of Ethelbert, Ethelberta proposes that he and some others visit Milton's grave in the Church of Cripplegate.

reference_spacy_tokens: In Thomas Hardy 's Hand of Ethelbert , Ethelberta proposes that he and some others visit Milton 's grave in the Church of Cripplegate .


fn_spacy_tokens_for_baseline: Some of the males were injected with morphine for a few days and some were given other drugs .

source_bert_toks: some of the males were injected with mor ##phine for a few days and some were given other drugs .

reference_raw: Some men have been given morphine for several days, and some have been given other drugs.

reference_spacy_tokens: Some men have been given morphine for several days , and some have been given other drugs .


fn_spacy_tokens_for_baseline: At 15 , he started to dabble with heroin and within 12 months he was using it daily .

source_bert_toks: at 15 , he started to da ##bble with heroin and within 12 months he was using it daily .

reference_raw: When he was 15, he started dabbling with heroin, and in 12 months he took it every day.

reference_spacy_tokens: When he was 15 , he started dabbling with heroin , and in 12 months he took it every day .


fn_spacy_tokens_for_baseline: Appalling weather conditions forced Lauda to withdraw after just two laps -- a decision few , except Enzo Ferrari , criticized .

source_bert_toks: app ##all ##ing weather conditions forced lau ##da to withdraw after just two laps - - a decision few , except enzo ferrari , criticized .

reference_raw: The terrible weather conditions forced Lauda to withdraw after only two rounds - a decision that few criticized except Enzo Ferrari.

reference_spacy_tokens: The terrible weather conditions forced Lauda to withdraw after only two rounds - a decision that few criticized except Enzo Ferrari .


fn_spacy_tokens_for_baseline: He drew a breath , then puffed it out .

source_bert_toks: he drew a breath , then puff ##ed it out .

reference_raw: He took a deep breath and blew it out.

reference_spacy_tokens: He took a deep breath and blew it out .


fn_spacy_tokens_for_baseline: He did not speak to reporters in Jordan , but he told The Associated Press before leaving the United States that he hopes to " separate the humanitarian work from the political issues . "

source_bert_toks: he did not speak to reporters in jordan , but he told the associated press before leaving the united states that he hopes to " separate the humanitarian work from the political issues . "

reference_raw: He didn't talk to reporters in Jordan, but before he left the United States, he told the Associated Press that he hoped to "separate humanitarian work from political matters."

reference_spacy_tokens: He did n't talk to reporters in Jordan , but before he left the United States , he told the Associated Press that he hoped to " separate humanitarian work from political matters . "


fn_spacy_tokens_for_baseline: FROM their very beginnings therefore , and increasingly as they went on , the Iran and contra policies departed even from the strange norms of covert operations .

source_bert_toks: from their very beginnings therefore , and increasingly as they went on , the iran and contra policies departed even from the strange norms of covert operations .

reference_raw: As a result, and more and more as they continued, Iran's and contra-policy departed even from the strange norms of secret operations.

reference_spacy_tokens: As a result , and more and more as they continued , Iran 's and contra - policy departed even from the strange norms of secret operations .


fn_spacy_tokens_for_baseline: Iran 's progress toward nuclear weapons , though irreversible , might be hampered by a combined effort on three fronts .

source_bert_toks: iran ' s progress toward nuclear weapons , though ir ##re ##vers ##ible , might be hampered by a combined effort on three fronts .

reference_raw: While irreversible, Iran's progress towards nuclear weapons could be hindered by a combined effort on three fronts.

reference_spacy_tokens: While irreversible , Iran 's progress towards nuclear weapons could be hindered by a combined effort on three fronts .


fn_spacy_tokens_for_baseline: Suddenly there it was , right in front of him , fleeing in the dark , a faint glowing figure seeming to float over the ground , hatted and cloaked .

source_bert_toks: suddenly there it was , right in front of him , fleeing in the dark , a faint glowing figure seeming to float over the ground , hat ##ted and cloak ##ed .

reference_raw: Suddenly, just ahead of him, he was fleeing in the darkness, a faintly glowing figure that seemed to float over the ground, capped and cloaked.

reference_spacy_tokens: Suddenly , just ahead of him , he was fleeing in the darkness , a faintly glowing figure that seemed to float over the ground , capped and cloaked .


fn_spacy_tokens_for_baseline: He looked at them defiantly as though they would deny a man the right to such freedom .

source_bert_toks: he looked at them defiant ##ly as though they would deny a man the right to such freedom .

reference_raw: He looked at them defiantly, as if they were going to deprive a man of his right to such freedom.

reference_spacy_tokens: He looked at them defiantly , as if they were going to deprive a man of his right to such freedom .


fn_spacy_tokens_for_baseline: The food dribbled out and she had to scoop it off his chin and shove it back in .

source_bert_toks: the food dr ##ib ##bled out and she had to scoop it off his chin and shove it back in .

reference_raw: The food was dripping, and she had to take it from his chin and shove it back inside.

reference_spacy_tokens: The food was dripping , and she had to take it from his chin and shove it back inside .


fn_spacy_tokens_for_baseline: The majority further contend that a wife who has reported a rape by her husband to the police may subsequently regret having done so and may wish to be reconciled with him .

source_bert_toks: the majority further contend that a wife who has reported a rape by her husband to the police may subsequently regret having done so and may wish to be reconciled with him .

reference_raw: Most of them also argue that a woman who has notified the police of her husband's violence may subsequently regret that she has done so and may wish to be reconciled with him.

reference_spacy_tokens: Most of them also argue that a woman who has notified the police of her husband 's violence may subsequently regret that she has done so and may wish to be reconciled with him .


fn_spacy_tokens_for_baseline: A rat that goes on screeching ,

source_bert_toks: a rat that goes on sc ##ree ##ching ,

reference_raw: A rat that screams all the time,

reference_spacy_tokens: A rat that screams all the time ,


fn_spacy_tokens_for_baseline: The Government still have not come clean about the information revealed in a Select Committee appendix .

source_bert_toks: the government still have not come clean about the information revealed in a select committee appendix .

reference_raw: The government has not yet confessed to the information disclosed in the Appendix to the Select Committee.

reference_spacy_tokens: The government has not yet confessed to the information disclosed in the Appendix to the Select Committee .


fn_spacy_tokens_for_baseline: In World War I he served in the Royal Army Medical Corps as temporary captain in charge of the base laboratory at Salonika ( 1916 ) , and later in Northern Ireland as bacteriologist ( 1918 ) .

source_bert_toks: in world war i he served in the royal army medical corps as temporary captain in charge of the base laboratory at salon ##ika ( 1916 ) , and later in northern ireland as ba ##cter ##iol ##ogist ( 1918 ) .

reference_raw: During World War I, he served in the Royal Army Medical Corps as a temporary commander in charge of a base laboratory in Salonika (1916) and later in Northern Ireland as a bacteriologist (1918).

reference_spacy_tokens: During World War I , he served in the Royal Army Medical Corps as a temporary commander in charge of a base laboratory in Salonika ( 1916 ) and later in Northern Ireland as a bacteriologist ( 1918 ) .


fn_spacy_tokens_for_baseline: The agreement became possible when Spain lifted its veto after agreement had been reached on setting up a fund to help the Community 's poorer members to pay for environmental protection measures .

source_bert_toks: the agreement became possible when spain lifted its veto after agreement had been reached on setting up a fund to help the community ' s poorer members to pay for environmental protection measures .

reference_raw: The agreement became possible when Spain withdrew its veto after an agreement was reached on the establishment of a fund to assist the poorer members of the Community in paying for environmental protection measures.

reference_spacy_tokens: The agreement became possible when Spain withdrew its veto after an agreement was reached on the establishment of a fund to assist the poorer members of the Community in paying for environmental protection measures .


fn_spacy_tokens_for_baseline: Aberdeen , the island 's oldest settlement , once a pirate lair , is home to the " floating population " - the boat people who spend their entire lives on the junks in the harbor , some proudly claiming never to have set foot on land ( except for funerals , which do n't count ) .

source_bert_toks: aberdeen , the island ' s oldest settlement , once a pirate lair , is home to the " floating population " - the boat people who spend their entire lives on the junk ##s in the harbor , some proudly claiming never to have set foot on land ( except for funeral ##s , which don ' t count ) .

reference_raw: Aberdeen, the oldest village on the island, once a pirate's lair, is the home of the "floating population" - the ship's people who spend their whole lives on junk in the harbor, some proudly claim that they never set foot on the ground (except for funerals that don't count).

reference_spacy_tokens: Aberdeen , the oldest village on the island , once a pirate 's lair , is the home of the " floating population " - the ship 's people who spend their whole lives on junk in the harbor , some proudly claim that they never set foot on the ground ( except for funerals that do n't count ) .


fn_spacy_tokens_for_baseline: ' Confidential informant ' , like ' cooperating individual ' , usually means that the snitch in question was , or is , engaged in drug trafficking and cooperating with the DEA in order to avoid imprisonment .

source_bert_toks: ' confidential informant ' , like ' cooper ##ating individual ' , usually means that the s ##ni ##tch in question was , or is , engaged in drug trafficking and cooper ##ating with the dea in order to avoid imprisonment .

reference_raw: "Confidential informant" , such as "cooperating individual" , usually means that the informant concerned has been or has been involved in drug trafficking and cooperated with the DEA in order to prevent imprisonment.

reference_spacy_tokens: " Confidential informant " , such as " cooperating individual " , usually means that the informant concerned has been or has been involved in drug trafficking and cooperated with the DEA in order to prevent imprisonment .


fn_spacy_tokens_for_baseline: That God might enter the pain of the beaten or raped woman , or be privy both to that pain and the power of healing from that pain , is a revelatory insight .

source_bert_toks: that god might enter the pain of the beaten or raped woman , or be privy both to that pain and the power of healing from that pain , is a rev ##ela ##tory insight .

reference_raw: The fact that God may enter the pain of a woman who has been beaten or abused, or be privy to both that pain and the power to heal from it, is a reveling insight.

reference_spacy_tokens: The fact that God may enter the pain of a woman who has been beaten or abused , or be privy to both that pain and the power to heal from it , is a reveling insight .


fn_spacy_tokens_for_baseline: An early government land surveyor mis - spelled Mosgiel with a single 's ' and so it has remained .

source_bert_toks: an early government land surveyor mis - spelled mo ##sg ##iel with a single ' s ' and so it has remained .

reference_raw: The first government land inspector misspelled Mosgiel with one 's', so he stayed.

reference_spacy_tokens: The first government land inspector misspelled Mosgiel with one ' s ' , so he stayed .


fn_spacy_tokens_for_baseline: They could all fairly be described as " pap " courses .

source_bert_toks: they could all fairly be described as " pa ##p " courses .

reference_raw: All of them might just as well be described as "pap" courses.

reference_spacy_tokens: All of them might just as well be described as " pap " courses .


fn_spacy_tokens_for_baseline: As Wimbledon again approaches , the arguments about why British tennis is so poor still rage on , and are getting even more heated .

source_bert_toks: as wimbledon again approaches , the arguments about why british tennis is so poor still rage on , and are getting even more heated .

reference_raw: As Wimbledon approaches again, the arguments about why British tennis is so poor continue to rage and become even more heated.

reference_spacy_tokens: As Wimbledon approaches again , the arguments about why British tennis is so poor continue to rage and become even more heated .


fn_spacy_tokens_for_baseline: She tried to back away and , at once , the Melanisms seemed to wriggle and chuckle , to slop forward with a dreadful , glutinous , squelching sound .

source_bert_toks: she tried to back away and , at once , the mel ##ani ##sms seemed to wr ##ig ##gle and chuckle , to sl ##op forward with a dreadful , g ##lu ##tino ##us , sq ##uel ##ching sound .

reference_raw: She tried to back away, and at once the Melanisms seemed to wriggle and laugh, to fall forward with a terrible, sticky, squealing sound.

reference_spacy_tokens: She tried to back away , and at once the Melanisms seemed to wriggle and laugh , to fall forward with a terrible , sticky , squealing sound .


fn_spacy_tokens_for_baseline: For all he knew the decoration could have been left there years ago , when Alice used to see the foresters in their peculiar finery .

source_bert_toks: for all he knew the decoration could have been left there years ago , when alice used to see the forest ##ers in their peculiar finer ##y .

reference_raw: As far as he knew, the decorations might have been left there years ago, when Alice had seen the woodsmen in their strange beauty.

reference_spacy_tokens: As far as he knew , the decorations might have been left there years ago , when Alice had seen the woodsmen in their strange beauty .


fn_spacy_tokens_for_baseline: But to immature minds , the message may be simply that brutality is cool and funny .

source_bert_toks: but to immature minds , the message may be simply that brutality is cool and funny .

reference_raw: But for immature minds, the message can only be that brutality is cold and funny.

reference_spacy_tokens: But for immature minds , the message can only be that brutality is cold and funny .


fn_spacy_tokens_for_baseline: As time passed she could be halted for longer and longer intervals , and eventually she forgot her rearing habit altogether .

source_bert_toks: as time passed she could be halted for longer and longer intervals , and eventually she forgot her rear ##ing habit altogether .

reference_raw: As time passed, she could be stopped for longer and longer, and eventually she forgot her breeding habit.

reference_spacy_tokens: As time passed , she could be stopped for longer and longer , and eventually she forgot her breeding habit .


fn_spacy_tokens_for_baseline: Just for the first few seconds she was back in the days after Hugh 's desertion .

source_bert_toks: just for the first few seconds she was back in the days after hugh ' s desert ##ion .

reference_raw: Only for the first few seconds did she return to the days after Hugh's departure.

reference_spacy_tokens: Only for the first few seconds did she return to the days after Hugh 's departure .


fn_spacy_tokens_for_baseline: I recollect one girl putting on dark glasses as a disguise in the hope that she would be luckier than Oliver Twist .

source_bert_toks: i rec ##oll ##ect one girl putting on dark glasses as a disguise in the hope that she would be luck ##ier than oliver twist .

reference_raw: I remember a girl wearing dark glasses as a disguise, hoping she'd be happier than Oliver Twist.

reference_spacy_tokens: I remember a girl wearing dark glasses as a disguise , hoping she 'd be happier than Oliver Twist .


fn_spacy_tokens_for_baseline: He noticed the shrewd examination Dame Sybil gave them , and hoped she would believe that Isabel 's worn gown and his stained raiment were the clothing of impoverished nobility .

source_bert_toks: he noticed the sh ##rew ##d examination dame sy ##bil gave them , and hoped she would believe that isabel ' s worn gown and his stained rai ##ment were the clothing of impoverished nobility .

reference_raw: He noticed the shrewd examination Dame Sybil had given them, hoping to believe that Isabel's worn robe and stained clothing were the clothes of a poor nobleman.

reference_spacy_tokens: He noticed the shrewd examination Dame Sybil had given them , hoping to believe that Isabel 's worn robe and stained clothing were the clothes of a poor nobleman .


fn_spacy_tokens_for_baseline: Some were taking boxes and drums off the lorries .

source_bert_toks: some were taking boxes and drums off the lo ##rries .

reference_raw: Some of them took crates and drums from trucks.

reference_spacy_tokens: Some of them took crates and drums from trucks .


fn_spacy_tokens_for_baseline: Photographs of his wife and two pretty blond children were displayed in silver frames on his desk .

source_bert_toks: photographs of his wife and two pretty blond children were displayed in silver frames on his desk .

reference_raw: The silver frames on the table showed photographs of his wife and two beautiful blonde children.

reference_spacy_tokens: The silver frames on the table showed photographs of his wife and two beautiful blonde children .


fn_spacy_tokens_for_baseline: Those glaciations were the most obviously catastrophic events in Our history and produced in their tills and periglacial deposits some of the most persistent facies of all .

source_bert_toks: those g ##la ##ciation ##s were the most obviously catastrophic events in our history and produced in their till ##s and per ##ig ##la ##cial deposits some of the most persistent fa ##cies of all .

reference_raw: These glaciations have been the most clearly disastrous event in our history and have produced some of the most persistent manifestations of all in their tills and periglacial deposits.

reference_spacy_tokens: These glaciations have been the most clearly disastrous event in our history and have produced some of the most persistent manifestations of all in their tills and periglacial deposits .


fn_spacy_tokens_for_baseline: However , no one had pushed him and there was no point in bickering over trifles .

source_bert_toks: however , no one had pushed him and there was no point in bi ##cker ##ing over tri ##fles .

reference_raw: But no one pushed him, and there was no point in arguing about things.

reference_spacy_tokens: But no one pushed him , and there was no point in arguing about things .


fn_spacy_tokens_for_baseline: One old lady seems to eat only roast beef .

source_bert_toks: one old lady seems to eat only roast beef .

reference_raw: Looks like an old lady only eats roasted meat.

reference_spacy_tokens: Looks like an old lady only eats roasted meat .


fn_spacy_tokens_for_baseline: IT 'S tragic to see Hindus and Moslems clashing .

source_bert_toks: it ' s tragic to see hindus and mo ##sle ##ms clash ##ing .

reference_raw: It's tragic to see Hindus and Muslims fight.

reference_spacy_tokens: It 's tragic to see Hindus and Muslims fight .


fn_spacy_tokens_for_baseline: The Collector wondered whether the garrison , too , would become covered in green mould .

source_bert_toks: the collector wondered whether the garrison , too , would become covered in green mo ##uld .

reference_raw: The Collector wondered if the crew would be coated with green mold.

reference_spacy_tokens: The Collector wondered if the crew would be coated with green mold .


fn_spacy_tokens_for_baseline: Edna is hardly your obvious casual daytime high street dresser , lounging around in jeans or velour tracksuits though , is she ?

source_bert_toks: edna is hardly your obvious casual daytime high street dresser , lou ##nging around in jeans or ve ##lou ##r tracks ##uit ##s though , is she ?

reference_raw: But Edna's hardly your obvious casual daytime high-street, lying around in jeans or velour track suits, is she?

reference_spacy_tokens: But Edna 's hardly your obvious casual daytime high - street , lying around in jeans or velour track suits , is she ?


fn_spacy_tokens_for_baseline: He pulled hard on the cigarette .

source_bert_toks: he pulled hard on the cigarette .

reference_raw: He drew hard on his cigarette.

reference_spacy_tokens: He drew hard on his cigarette .


fn_spacy_tokens_for_baseline: He has insulted me !

source_bert_toks: he has insulted me !

reference_raw: He's offended me!

reference_spacy_tokens: He 's offended me !


fn_spacy_tokens_for_baseline: Previously , Libya signed Comprehensive Test Ban Treaty in November 2001 and ratified it in January 2004 .

source_bert_toks: previously , libya signed comprehensive test ban treaty in november 2001 and ratified it in january 2004 .

reference_raw: In November 2001, Libya signed the Comprehensive Test Ban Agreement and ratified it in January 2004.

reference_spacy_tokens: In November 2001 , Libya signed the Comprehensive Test Ban Agreement and ratified it in January 2004 .


fn_spacy_tokens_for_baseline: As one , the six typewriters began clacking again , not perhaps quite so loudly as their operators strained to hear the rest of the conversation .

source_bert_toks: as one , the six type ##writer ##s began cl ##ack ##ing again , not perhaps quite so loudly as their operators strained to hear the rest of the conversation .

reference_raw: As one, the six typewriters began to click again, not so loudly as their operators strained to hear the rest of the conversation.

reference_spacy_tokens: As one , the six typewriters began to click again , not so loudly as their operators strained to hear the rest of the conversation .


fn_spacy_tokens_for_baseline: The land was leased by Edinburgh District Council from the Foulis Trust , but the 99-year lease expired in 1990 .

source_bert_toks: the land was leased by edinburgh district council from the foul ##is trust , but the 99 - year lease expired in 1990 .

reference_raw: The land was rented from the Foulis Trust by the Edinburgh District Council, but the 99-year rent expired in 1990.

reference_spacy_tokens: The land was rented from the Foulis Trust by the Edinburgh District Council , but the 99-year rent expired in 1990 .


fn_spacy_tokens_for_baseline: The whole notion of " creativity " in education was ( and is ) part and parcel of a romantic rebellion against disciplined instruction , which was ( and is ) regarded as " authoritarian , " a repression and frustration of the latent talents and the wonderful , if as yet undefined , potentialities inherent in the souls of all our children .

source_bert_toks: the whole notion of " creativity " in education was ( and is ) part and parcel of a romantic rebellion against disciplined instruction , which was ( and is ) regarded as " authoritarian , " a repression and frustration of the late ##nt talents and the wonderful , if as yet und ##efined , potential ##ities inherent in the souls of all our children .

reference_raw: The whole concept of "creativity" in education was (and is) part of a romantic rebellion against disciplined training, which was (and is) considered "authoritarian," repression and frustration of latent talents and wonderful, if not yet defined, potentials inherent in the souls of all our children.

reference_spacy_tokens: The whole concept of " creativity " in education was ( and is ) part of a romantic rebellion against disciplined training , which was ( and is ) considered " authoritarian , " repression and frustration of latent talents and wonderful , if not yet defined , potentials inherent in the souls of all our children .


fn_spacy_tokens_for_baseline: In the shopping centre , the Conservative candidate and his supporters , decked in blue rosettes , thrust their campaign leaflets into largely willing hands and launched into a well - practised patter .

source_bert_toks: in the shopping centre , the conservative candidate and his supporters , deck ##ed in blue rose ##ttes , thrust their campaign leaflets into largely willing hands and launched into a well - practised pat ##ter .

reference_raw: In the mall, the conservative candidate and his supporters, dressed in blue rosets, placed their campaign leaflets in largely willing hands and launched into a well-practiced patter.

reference_spacy_tokens: In the mall , the conservative candidate and his supporters , dressed in blue rosets , placed their campaign leaflets in largely willing hands and launched into a well - practiced patter .


fn_spacy_tokens_for_baseline: Sections were then dehydrated in ethanol and air dried .

source_bert_toks: sections were then de ##hy ##dra ##ted in ethanol and air dried .

reference_raw: The sections were then dried with ethanol and air-dried.

reference_spacy_tokens: The sections were then dried with ethanol and air - dried .


fn_spacy_tokens_for_baseline: In Brazil , the Communist party was illegal from 1922 to 1945 , and the abortive Communist - led uprising in 1935 ( see page 41 ) provided a pretext for a comprehensive crackdown on the entire left .

source_bert_toks: in brazil , the communist party was illegal from 1922 to 1945 , and the ab ##ort ##ive communist - led uprising in 1935 ( see page 41 ) provided a pre ##text for a comprehensive crack ##down on the entire left .

reference_raw: In Brazil, the Communist Party was illegal between 1922 and 1945, and the abortive communist-led rebellion of 1935 (see page 41) provided an excuse for a comprehensive crackdown on the left.

reference_spacy_tokens: In Brazil , the Communist Party was illegal between 1922 and 1945 , and the abortive communist - led rebellion of 1935 ( see page 41 ) provided an excuse for a comprehensive crackdown on the left .


fn_spacy_tokens_for_baseline: From childhood to manhood Jerry and I wore hand - knitted socks , jerseys , and on occasion underwear , all made by Mother .

source_bert_toks: from childhood to man ##hood jerry and i wore hand - knit ##ted socks , jerseys , and on occasion underwear , all made by mother .

reference_raw: From childhood to masculinity, Jerry and I wore hand-knitted stockings, sweaters, and occasionally undergarments, all made by our mother.

reference_spacy_tokens: From childhood to masculinity , Jerry and I wore hand - knitted stockings , sweaters , and occasionally undergarments , all made by our mother .


fn_spacy_tokens_for_baseline: Both sisters looked alarmed at the thought of possible further deterioration .

source_bert_toks: both sisters looked alarmed at the thought of possible further deterioration .

reference_raw: The two sisters looked startled at the thought of a possible further deterioration.

reference_spacy_tokens: The two sisters looked startled at the thought of a possible further deterioration .


fn_spacy_tokens_for_baseline: Your article on the Joint IED Neutralizer ( which can destroy roadside improvised explosive devices ) showed how the Army has become mired in bureaucracy .

source_bert_toks: your article on the joint ie ##d neutral ##izer ( which can destroy roadside improvised explosive devices ) showed how the army has become mir ##ed in bureaucracy .

reference_raw: Your article on the Joint IED Neutralizer (which can destroy roadside impromptu explosive devices) has shown how the military has become mired in bureaucracy.

reference_spacy_tokens: Your article on the Joint IED Neutralizer ( which can destroy roadside impromptu explosive devices ) has shown how the military has become mired in bureaucracy .


fn_spacy_tokens_for_baseline: Another group combs the refuse for tins , bottles and plastic containers to be sold on junk stalls .

source_bert_toks: another group comb ##s the refuse for tin ##s , bottles and plastic containers to be sold on junk stalls .

reference_raw: Another group brushes the rejection of cans, bottles and plastic containers for sale in junk stalls.

reference_spacy_tokens: Another group brushes the rejection of cans , bottles and plastic containers for sale in junk stalls .


fn_spacy_tokens_for_baseline: Having stopped a couple of times for refreshment , Fabia returned to her hotel around six o'clock , and realised that she had found Marianske Lazne quite enchanting .

source_bert_toks: having stopped a couple of times for ref ##resh ##ment , fa ##bia returned to her hotel around six o ' clock , and realised that she had found marian ##ske la ##z ##ne quite en ##chan ##ting .

reference_raw: After stopping several times for refreshment, Fabia returned to the hotel around six o'clock and realized that Marianske Lazne was quite charming.

reference_spacy_tokens: After stopping several times for refreshment , Fabia returned to the hotel around six o'clock and realized that Marianske Lazne was quite charming .


fn_spacy_tokens_for_baseline: Are Belfast shoppers reluctant to moan to shops ?

source_bert_toks: are belfast shop ##pers reluctant to moan to shops ?

reference_raw: Do Belfast merchants hesitate to groan to the stores?

reference_spacy_tokens: Do Belfast merchants hesitate to groan to the stores ?


fn_spacy_tokens_for_baseline: The largest planned for Regional Railways would mastermind train movements on about 100 miles of track .

source_bert_toks: the largest planned for regional railways would master ##mind train movements on about 100 miles of track .

reference_raw: The largest planned for regional railways will guide the movement of trains on about 100 km of track.

reference_spacy_tokens: The largest planned for regional railways will guide the movement of trains on about 100 km of track .


fn_spacy_tokens_for_baseline: Willi 's strong , stocky body inserted itself under the Direktor 's arm and he supported him out through the theatre door towards the car .

source_bert_toks: will ##i ' s strong , stock ##y body inserted itself under the dire ##kt ##or ' s arm and he supported him out through the theatre door towards the car .

reference_raw: Willi's strong, sturdy body slipped under the Director's arm and supported him through the theater door to the car.

reference_spacy_tokens: Willi 's strong , sturdy body slipped under the Director 's arm and supported him through the theater door to the car .


fn_spacy_tokens_for_baseline: After recovering from an attack of shallow breathing he recovered and one nurse said he was smiling and cooing in his cot .

source_bert_toks: after recovering from an attack of shallow breathing he recovered and one nurse said he was smiling and co ##oin ##g in his cot .

reference_raw: When he recovered from the shock of shallow breathing, he recovered, and one of the nurses said that he was smiling and resting in his bed.

reference_spacy_tokens: When he recovered from the shock of shallow breathing , he recovered , and one of the nurses said that he was smiling and resting in his bed .


fn_spacy_tokens_for_baseline: Yet even more of parliament 's time was occupied dispensing justice in response to petitions from the king 's subjects on all manner of grievances .

source_bert_toks: yet even more of parliament ' s time was occupied di ##sp ##ens ##ing justice in response to petitions from the king ' s subjects on all manner of gr ##ie ##vances .

reference_raw: But even more of Parliament's time was occupied with the dispensing of justice in response to requests from the King's subjects about all sorts of complaints.

reference_spacy_tokens: But even more of Parliament 's time was occupied with the dispensing of justice in response to requests from the King 's subjects about all sorts of complaints .


fn_spacy_tokens_for_baseline: Dunadd fort clings to an isolated rocky hillock near Kilmartin , starkly visible from the road between Lochgilphead and Oban , above what must once have been a naturally protective boggy valley .

source_bert_toks: dun ##ad ##d fort cl ##ings to an isolated rocky hill ##ock near ki ##lma ##rti ##n , stark ##ly visible from the road between loch ##gil ##ph ##ead and ob ##an , above what must once have been a naturally protective bog ##gy valley .

reference_raw: Dunadd Fortress clings to an isolated rocky hill near Kilmartin, clearly visible from the road between Lochgilphead and Oban, above what must once have been a naturally protective boggy valley.

reference_spacy_tokens: Dunadd Fortress clings to an isolated rocky hill near Kilmartin , clearly visible from the road between Lochgilphead and Oban , above what must once have been a naturally protective boggy valley .


fn_spacy_tokens_for_baseline: There was a deep belief , even amongst many women , that biology had incapacitated them , and this was sustained by expert opinion .

source_bert_toks: there was a deep belief , even amongst many women , that biology had inca ##pac ##itated them , and this was sustained by expert opinion .

reference_raw: There was a deep belief, even among many women, that biology had failed them, and that was confirmed by expert opinion.

reference_spacy_tokens: There was a deep belief , even among many women , that biology had failed them , and that was confirmed by expert opinion .


fn_spacy_tokens_for_baseline: The Butlins Empire has now had to market itself anew for the experienced package tourist ; a move from wooden chalets to brick - built country suites , from the Minehead Camp to Summerwest World .

source_bert_toks: the but ##lins empire has now had to market itself an ##ew for the experienced package tourist ; a move from wooden cha ##lets to brick - built country suites , from the mine ##head camp to summer ##west world .

reference_raw: The Butlins Empire now had to sell again for experienced package tourists; the transition from wooden huts to brick-built country apartments, from the Minehead Camp to the Summerwest World.

reference_spacy_tokens: The Butlins Empire now had to sell again for experienced package tourists ; the transition from wooden huts to brick - built country apartments , from the Minehead Camp to the Summerwest World .


fn_spacy_tokens_for_baseline: Masklin cut the lid off a container of milk .

source_bert_toks: mask ##lin cut the lid off a container of milk .

reference_raw: Masklin cut the lid off the milk bottle.

reference_spacy_tokens: Masklin cut the lid off the milk bottle .


fn_spacy_tokens_for_baseline: Cornell found a number of employment options that he never dreamed existed after a work - site injury forced him out of his job at a foundry .

source_bert_toks: cornell found a number of employment options that he never dreamed existed after a work - site injury forced him out of his job at a foundry .

reference_raw: Cornell had found a number of job opportunities he had never dreamed would exist after the job-site injuries had made him lose his job at the foundry.

reference_spacy_tokens: Cornell had found a number of job opportunities he had never dreamed would exist after the job - site injuries had made him lose his job at the foundry .


fn_spacy_tokens_for_baseline: It was in this highly charged political and military context , which precipitated a " bunker " or " laager " mentality , that Coast was secretly initiated in 1981 under the aegis of the SADF Special Forces .

source_bert_toks: it was in this highly charged political and military context , which pre ##ci ##pit ##ated a " bunker " or " la ##ager " mental ##ity , that coast was secretly initiated in 1981 under the ae ##gis of the sad ##f special forces .

reference_raw: It was in this highly charged political and military context that precipitated the "bunker" or "laager" mentality that the coast began in secret in 1981 under the auspices of the Special Forces of the SADF.

reference_spacy_tokens: It was in this highly charged political and military context that precipitated the " bunker " or " laager " mentality that the coast began in secret in 1981 under the auspices of the Special Forces of the SADF .


fn_spacy_tokens_for_baseline: With Monet , ' Money is ephemeral , art is eternal '

source_bert_toks: with mon ##et , ' money is ep ##hem ##eral , art is eternal '

reference_raw: With the Monet, 'Money is ephemeral, art is everlasting'

reference_spacy_tokens: With the Monet , ' Money is ephemeral , art is everlasting '


fn_spacy_tokens_for_baseline: The chimpanzee extracts the stem with the termites conveniently attached by their jaws , and then pulls it either through its mouth or hand to remove them .

source_bert_toks: the chi ##mp ##an ##zee extracts the stem with the term ##ites convenient ##ly attached by their jaws , and then pulls it either through its mouth or hand to remove them .

reference_raw: The chimpanzee extracts the stem with the termites conveniently attached to the teeth and then pulls it either through the mouth or through the hand to remove it.

reference_spacy_tokens: The chimpanzee extracts the stem with the termites conveniently attached to the teeth and then pulls it either through the mouth or through the hand to remove it .


fn_spacy_tokens_for_baseline: He promptly dipped his nose into my water pot and drank the lot .

source_bert_toks: he promptly dipped his nose into my water pot and drank the lot .

reference_raw: Instantly he put his nose in my pot of water and drank a lot of it.

reference_spacy_tokens: Instantly he put his nose in my pot of water and drank a lot of it .


fn_spacy_tokens_for_baseline: In developing surreptitious techniques to break up the beat monotony , superiors were not always what they seemed .

source_bert_toks: in developing sur ##re ##pt ##iti ##ous techniques to break up the beat mono ##ton ##y , superiors were not always what they seemed .

reference_raw: The superiors weren't always what they seemed to be when they developed stealth techniques to break the beat monotony.

reference_spacy_tokens: The superiors were n't always what they seemed to be when they developed stealth techniques to break the beat monotony .


fn_spacy_tokens_for_baseline: One great challenge in producing new dental materials is the achievement and maintenance of adhesion of these biomaterials to vital tissues .

source_bert_toks: one great challenge in producing new dental materials is the achievement and maintenance of ad ##hesion of these bio ##mate ##rial ##s to vital tissues .

reference_raw: One major challenge in the production of new dental materials is to achieve and maintain the adhesiveness of these biomaterials to vital tissues.

reference_spacy_tokens: One major challenge in the production of new dental materials is to achieve and maintain the adhesiveness of these biomaterials to vital tissues .


fn_spacy_tokens_for_baseline: He walked away to the desk , collecting his key , and as he walked towards the lifts he flicked a quick glance back to the girl who 'd been brought up as his daughter .

source_bert_toks: he walked away to the desk , collecting his key , and as he walked towards the lifts he flicked a quick glance back to the girl who ' d been brought up as his daughter .

reference_raw: He went to the table, picked up the key, and as he walked to the elevators he glanced quickly back at the girl who had been raised as his daughter.

reference_spacy_tokens: He went to the table , picked up the key , and as he walked to the elevators he glanced quickly back at the girl who had been raised as his daughter .


fn_spacy_tokens_for_baseline: The museum has an art collection , and displays of toys and other artifacts .

source_bert_toks: the museum has an art collection , and displays of toys and other artifacts .

reference_raw: There's a collection of art in the museum and displays of toys and other artifacts.

reference_spacy_tokens: There 's a collection of art in the museum and displays of toys and other artifacts .


fn_spacy_tokens_for_baseline: The term is also ambiguous between the composing aspects of writing and the secretarial aspects , such as good handwriting and spelling .

source_bert_toks: the term is also ambiguous between the composing aspects of writing and the secret ##aria ##l aspects , such as good handwriting and spelling .

reference_raw: The term is also unclear between the composing aspects of writing and the secretarial aspects, such as good handwriting and spelling.

reference_spacy_tokens: The term is also unclear between the composing aspects of writing and the secretarial aspects , such as good handwriting and spelling .


fn_spacy_tokens_for_baseline: ' He was a middle - aged guy and I was beginning to think that he never saw a guy with long hair before .

source_bert_toks: ' he was a middle - aged guy and i was beginning to think that he never saw a guy with long hair before .

reference_raw: He was a middle-aged man, and I was beginning to think he'd never seen a long-haired man before.

reference_spacy_tokens: He was a middle - aged man , and I was beginning to think he 'd never seen a long - haired man before .


fn_spacy_tokens_for_baseline: He gave a squeal of delight , turning round on the spot and throwing his little arms around her .

source_bert_toks: he gave a sq ##ue ##al of delight , turning round on the spot and throwing his little arms around her .

reference_raw: He squealed with pleasure, turned on the spot, and flung his small arms around her.

reference_spacy_tokens: He squealed with pleasure , turned on the spot , and flung his small arms around her .


fn_spacy_tokens_for_baseline: Begging , sometimes very ingenious , is rife , in urban areas where most familes live in one or 2 rooms in unfinished blocks of flats .

source_bert_toks: begging , sometimes very ing ##eni ##ous , is ri ##fe , in urban areas where most fa ##mi ##les live in one or 2 rooms in unfinished blocks of flats .

reference_raw: In urban areas where most families live in one or two rooms in unfinished apartment blocks, begging is sometimes very sophisticated.

reference_spacy_tokens: In urban areas where most families live in one or two rooms in unfinished apartment blocks , begging is sometimes very sophisticated .


fn_spacy_tokens_for_baseline: 4:30 a.m. KIM : I got home , let the dogs into the house and noticed some sounds above my head , as if someone were walking on the roof , or upstairs .

source_bert_toks: 4 : 30 a . m . kim : i got home , let the dogs into the house and noticed some sounds above my head , as if someone were walking on the roof , or upstairs .

reference_raw: 4:30 a.m. Kim: I came home, let the dogs into the house, and saw a sound over my head, as if someone were walking on the roof or up the stairs.

reference_spacy_tokens: 4:30 a.m. Kim : I came home , let the dogs into the house , and saw a sound over my head , as if someone were walking on the roof or up the stairs .


fn_spacy_tokens_for_baseline: Michael Fallon has issued a bullish response to town doctors who accused him of making ' fallacious and irresponsible ' comments about the NHS .

source_bert_toks: michael fallon has issued a bull ##ish response to town doctors who accused him of making ' fall ##acious and ir ##res ##pon ##sible ' comments about the nhs .

reference_raw: Michael Fallon gave a bullying reaction to city doctors who accused him of making "falling and irresponsible" remarks about the NHS.

reference_spacy_tokens: Michael Fallon gave a bullying reaction to city doctors who accused him of making " falling and irresponsible " remarks about the NHS .


fn_spacy_tokens_for_baseline: I have a hunch that true life starts at the point of recognizing our failure .

source_bert_toks: i have a hu ##nch that true life starts at the point of recognizing our failure .

reference_raw: I have a feeling that real life begins when we recognize our failure.

reference_spacy_tokens: I have a feeling that real life begins when we recognize our failure .


fn_spacy_tokens_for_baseline: Fourth : Reward and Punishment ( T.C : Koranic verse )

source_bert_toks: fourth : reward and punishment ( t . c : ko ##rani ##c verse )

reference_raw: Fourth: Rewards and penalties (T.C.: Korean verse)

reference_spacy_tokens: Fourth : Rewards and penalties ( T.C. : Korean verse )


fn_spacy_tokens_for_baseline: Faldo ruined his chances with a 76 on Saturday -- and even a 67 on the last day could only put him in joint second place .

source_bert_toks: fa ##ld ##o ruined his chances with a 76 on saturday - - and even a 67 on the last day could only put him in joint second place .

reference_raw: Faldo destroyed his chances with a 76 on Saturday - and even a 67 on the last day could only put him in second place.

reference_spacy_tokens: Faldo destroyed his chances with a 76 on Saturday - and even a 67 on the last day could only put him in second place .


fn_spacy_tokens_for_baseline: EC loan package agreement -- Japanese loan pledge

source_bert_toks: ec loan package agreement - - japanese loan pledge

reference_raw: EC Credit Package Agreement - Japanese Loan Guarantee


fn_spacy_tokens_for_baseline: There appear to be several major faults in the reasoning that animal decline was the result of such plant disappearances .

source_bert_toks: there appear to be several major faults in the reasoning that animal decline was the result of such plant disappearance ##s .

reference_raw: There appear to be a number of serious flaws in the statement that the decline of the animals was the result of those plants disappearing.

reference_spacy_tokens: There appear to be a number of serious flaws in the statement that the decline of the animals was the result of those plants disappearing .


fn_spacy_tokens_for_baseline: There was great diversity in the density of parietal cells between specimens of different maturities ( Fig 1 ) .

source_bert_toks: there was great diversity in the density of par ##ie ##tal cells between specimens of different mat ##urities ( fig 1 ) .

reference_raw: The density of parietal cells between samples of different maturities was very different (Figure 1).

reference_spacy_tokens: The density of parietal cells between samples of different maturities was very different ( Figure 1 ) .


fn_spacy_tokens_for_baseline: Now since the number of waves a second is unlimited , this would mean that the total energy radiated would be infinite .

source_bert_toks: now since the number of waves a second is unlimited , this would mean that the total energy radiated would be infinite .

reference_raw: Since the number of waves per second is unlimited, that would mean that the total amount of energy emitted is infinite.

reference_spacy_tokens: Since the number of waves per second is unlimited , that would mean that the total amount of energy emitted is infinite .


fn_spacy_tokens_for_baseline: His hands were manacled behind his back except when he ate or slept .

source_bert_toks: his hands were mana ##cle ##d behind his back except when he ate or slept .

reference_raw: His hands were handcuffed behind his back, except when he ate or slept.

reference_spacy_tokens: His hands were handcuffed behind his back , except when he ate or slept .


fn_spacy_tokens_for_baseline: He attacks them with flame - throwers .

source_bert_toks: he attacks them with flame - throw ##ers .

reference_raw: He's attacking them with flame throwers.

reference_spacy_tokens: He 's attacking them with flame throwers .


fn_spacy_tokens_for_baseline: Many of its employees were part of U. S. Special Forces , and it has taken on some of the most dangerous missions .

source_bert_toks: many of its employees were part of u . s . special forces , and it has taken on some of the most dangerous missions .

reference_raw: Many of his staff were members of the U.S. Special Forces, and he had embarked on some of the most dangerous missions.

reference_spacy_tokens: Many of his staff were members of the U.S. Special Forces , and he had embarked on some of the most dangerous missions .


fn_spacy_tokens_for_baseline: I came to jammed into the corner of the work room , squatting , fists clenched , staring up at a ribbon of orange light across the ceiling and a stack of timber beside me .

source_bert_toks: i came to jammed into the corner of the work room , squat ##ting , fists clenched , staring up at a ribbon of orange light across the ceiling and a stack of timber beside me .

reference_raw: I came to the corner of the workroom, squatting with my fists clenched, staring at the band of orange light on the ceiling and the pile of wood beside me.

reference_spacy_tokens: I came to the corner of the workroom , squatting with my fists clenched , staring at the band of orange light on the ceiling and the pile of wood beside me .


fn_spacy_tokens_for_baseline: Each of these records is divided up into a number of fields , each holding one item of information such as name or address , or author or title .

source_bert_toks: each of these records is divided up into a number of fields , each holding one item of information such as name or address , or author or title .

reference_raw: Each of these records is subdivided into several fields, each containing a single item of information, such as the name, address, author or title.

reference_spacy_tokens: Each of these records is subdivided into several fields , each containing a single item of information , such as the name , address , author or title .


fn_spacy_tokens_for_baseline: In a weaker sense , the same message is projected to American children , who grow up being told that it is not acceptable to be violent to one another , but who simultaneously have to endure corporal punishment and media messages about how " the enemies of freedom " are punished .

source_bert_toks: in a weaker sense , the same message is projected to american children , who grow up being told that it is not acceptable to be violent to one another , but who simultaneously have to endure corporal punishment and media messages about how " the enemies of freedom " are punished .

reference_raw: In a weaker way, the same message is expected for American children, who grow up to be told that it is unacceptable to be violent with each other, but who also have to suffer corporal punishment and media reports on how "the enemy of liberty" is punished.

reference_spacy_tokens: In a weaker way , the same message is expected for American children , who grow up to be told that it is unacceptable to be violent with each other , but who also have to suffer corporal punishment and media reports on how " the enemy of liberty " is punished .


fn_spacy_tokens_for_baseline: Maybe he represents the fact that youth rebellion has learnt its lesson , that it has returned in a stronger , more considered , more intelligent format .

source_bert_toks: maybe he represents the fact that youth rebellion has learnt its lesson , that it has returned in a stronger , more considered , more intelligent format .

reference_raw: Perhaps it is the fact that the young rebels have learned their lesson, that they have returned in a stronger, more thoughtful, more intelligent form.

reference_spacy_tokens: Perhaps it is the fact that the young rebels have learned their lesson , that they have returned in a stronger , more thoughtful , more intelligent form .


fn_spacy_tokens_for_baseline: When he turned to attack landscape he would either include a figure smudged on the periphery , dwindling in the distance , or portray anonymous couples or figures imprisoned by fences and obstructed by walls and trees .

source_bert_toks: when he turned to attack landscape he would either include a figure sm ##udged on the periphery , d ##wind ##ling in the distance , or portray anonymous couples or figures imprisoned by fences and ob ##st ##ru ##cted by walls and trees .

reference_raw: When he turned to attack the countryside, he would either contain a figure smeared on the edge, dwindling in the distance, or portray anonymous couples or figures trapped by fences and blocked by walls and trees.

reference_spacy_tokens: When he turned to attack the countryside , he would either contain a figure smeared on the edge , dwindling in the distance , or portray anonymous couples or figures trapped by fences and blocked by walls and trees .


fn_spacy_tokens_for_baseline: There are round , flat tarts , full of concentric circles of apple slices , thin as whispers , or fat little apricot halves , under a sticky glaze of jam .

source_bert_toks: there are round , flat tar ##ts , full of con ##centric circles of apple slices , thin as whispers , or fat little apr ##ico ##t halves , under a sticky g ##laze of jam .

reference_raw: Under the sticky glaze of jam, there are round, flat tarts filled with concentric rings of apple slices, thin as whispers, or fat little apricot half.

reference_spacy_tokens: Under the sticky glaze of jam , there are round , flat tarts filled with concentric rings of apple slices , thin as whispers , or fat little apricot half .


fn_spacy_tokens_for_baseline: The first couple of songs are effective but so - so , the only real interest being the size of Matt 's guitar .

source_bert_toks: the first couple of songs are effective but so - so , the only real interest being the size of matt ' s guitar .

reference_raw: The first few songs are effective, but so the only real concern is the size of Matt's guitar.

reference_spacy_tokens: The first few songs are effective , but so the only real concern is the size of Matt 's guitar .


fn_spacy_tokens_for_baseline: After all , physicians can wander where they wish and prise secrets from others .

source_bert_toks: after all , physicians can wander where they wish and pri ##se secrets from others .

reference_raw: After all, doctors can wander wherever they want and keep secrets from others.

reference_spacy_tokens: After all , doctors can wander wherever they want and keep secrets from others .


fn_spacy_tokens_for_baseline: One of the greatest love stories of all time and amongst the most enthralling romances in literature -- JANE EYRE is compulsive entertainment for both those who know the story and for those to whom it is unfamiliar .

source_bert_toks: one of the greatest love stories of all time and amongst the most en ##th ##ral ##ling romance ##s in literature - - jane eyre is com ##pu ##ls ##ive entertainment for both those who know the story and for those to whom it is unfamiliar .

reference_raw: One of the greatest love stories of all time and among the most fascinating romances in literature-Jane Eyre is a compulsive entertainment for both those who know the story and those who do not know it.

reference_spacy_tokens: One of the greatest love stories of all time and among the most fascinating romances in literature - Jane Eyre is a compulsive entertainment for both those who know the story and those who do not know it .


fn_spacy_tokens_for_baseline: Noel Edmonds presides over a launch party in London , but the demo machine does n't function all that well .

source_bert_toks: noel edmond ##s pre ##side ##s over a launch party in london , but the demo machine doesn ' t function all that well .

reference_raw: Noel Edmonds is running a launch party in London, but the demo machine doesn't work very well.

reference_spacy_tokens: Noel Edmonds is running a launch party in London , but the demo machine does n't work very well .


fn_spacy_tokens_for_baseline: Despite it , I am quite satisfied that their evenings , their sleep and their general comfort were greatly disturbed .

source_bert_toks: despite it , i am quite satisfied that their evenings , their sleep and their general comfort were greatly disturbed .

reference_raw: However, I am quite convinced that their evenings, sleep, and general comfort have been greatly disturbed.

reference_spacy_tokens: However , I am quite convinced that their evenings , sleep , and general comfort have been greatly disturbed .


fn_spacy_tokens_for_baseline: A student starts at tenth class , which is called ' kup ' and works his way towards the level of proficiency of an instructor and his first dan , or black belt .

source_bert_toks: a student starts at tenth class , which is called ' ku ##p ' and works his way towards the level of proficiency of an instructor and his first dan , or black belt .

reference_raw: The student starts in the tenth grade, which is called "kup", and works his way up to the level of competence of the instructor and his first dan or black belt.

reference_spacy_tokens: The student starts in the tenth grade , which is called " kup " , and works his way up to the level of competence of the instructor and his first dan or black belt .


fn_spacy_tokens_for_baseline: It was dark and the sea was rising rapidly as I came up the firth , keeping the bows in the direction of the flashing lighthouse on the White Hill of Vatster .

source_bert_toks: it was dark and the sea was rising rapidly as i came up the firth , keeping the bows in the direction of the flashing lighthouse on the white hill of va ##ts ##ter .

reference_raw: It was dark and the sea was rising fast as I climbed the firth, keeping my bows in the direction of the gleaming beacon on Vatster's White Hill.

reference_spacy_tokens: It was dark and the sea was rising fast as I climbed the firth , keeping my bows in the direction of the gleaming beacon on Vatster 's White Hill .


fn_spacy_tokens_for_baseline: But the King for prevention of offences may by proclamation admonish his subjects that they keep the laws , and do not offend them ; upon punishment to be inflicted by the law , .

source_bert_toks: but the king for prevention of offences may by proclamation ad ##mon ##ish his subjects that they keep the laws , and do not off ##end them ; upon punishment to be inflicted by the law , .

reference_raw: But a king for the prevention of crime can declare to his subjects that he respects the law and does not offend them; a punishment to be imposed by the law.

reference_spacy_tokens: But a king for the prevention of crime can declare to his subjects that he respects the law and does not offend them ; a punishment to be imposed by the law .


fn_spacy_tokens_for_baseline: Spinoza 's ethics is closely related to his metaphysical views .

source_bert_toks: spin ##oza ' s ethics is closely related to his metaphysical views .

reference_raw: Spinoza's ethics are closely linked to his metaphysical views.

reference_spacy_tokens: Spinoza 's ethics are closely linked to his metaphysical views .


fn_spacy_tokens_for_baseline: Fill a paper piping bag with royal icing that has been thinned slightly .

source_bert_toks: fill a paper pip ##ing bag with royal ic ##ing that has been thin ##ned slightly .

reference_raw: Fill a paper pipe bag with a king's icing, which has been reduced slightly.

reference_spacy_tokens: Fill a paper pipe bag with a king 's icing , which has been reduced slightly .


fn_spacy_tokens_for_baseline: The country is decked in lights and banners while parades , exhibitions and shows show the Malaysians pride in their country .

source_bert_toks: the country is deck ##ed in lights and banners while parades , exhibitions and shows show the malaysian ##s pride in their country .

reference_raw: The country is flooded with lights and banners, and parades, exhibitions, and shows Malaysian pride in their country.

reference_spacy_tokens: The country is flooded with lights and banners , and parades , exhibitions , and shows Malaysian pride in their country .


fn_spacy_tokens_for_baseline: Stephen asked Christina for a splash of rum in his lime squash and Michael Stein followed suit .

source_bert_toks: stephen asked christina for a splash of rum in his lime squash and michael stein followed suit .

reference_raw: Stephen asked Christine to sprinkle the rum in the lime squash, and Michael Stein followed.

reference_spacy_tokens: Stephen asked Christine to sprinkle the rum in the lime squash , and Michael Stein followed .


fn_spacy_tokens_for_baseline: So , if you want a descent of 600 ft / min you will reduce power by 600 rpm .

source_bert_toks: so , if you want a descent of 600 ft / min you will reduce power by 600 rpm .

reference_raw: So if you want to go down 600 ft/min, you're going to reduce power by 600 rpm.

reference_spacy_tokens: So if you want to go down 600 ft / min , you 're going to reduce power by 600 rpm .


fn_spacy_tokens_for_baseline: Batches of about sixty samples , each sealed in a pure silica tube , are irradiated , together with six samples of a standard clay of already known chemical composition .

source_bert_toks: batch ##es of about sixty samples , each sealed in a pure si ##lica tube , are ir ##rad ##iated , together with six samples of a standard clay of already known chemical composition .

reference_raw: Around 60 samples, each sealed in a clean silica tube, are irradiated with six samples of standard clay of known chemical composition.

reference_spacy_tokens: Around 60 samples , each sealed in a clean silica tube , are irradiated with six samples of standard clay of known chemical composition .


fn_spacy_tokens_for_baseline: Celia ran into the playroom , crying .

source_bert_toks: celia ran into the play ##room , crying .

reference_raw: Celia ran into the room and began to cry.

reference_spacy_tokens: Celia ran into the room and began to cry .


fn_spacy_tokens_for_baseline: The court 's heard that she had been taking cocaine and drinking whisky .

source_bert_toks: the court ' s heard that she had been taking cocaine and drinking whisky .

reference_raw: The court heard she was taking coke and drinking whiskey.

reference_spacy_tokens: The court heard she was taking coke and drinking whiskey .


fn_spacy_tokens_for_baseline: May L.J. recognised that the phrase had no intelligible meaning in a wholly common law context , which suggested that attention had to be given to the civil law origins of the phrase .

source_bert_toks: may l . j . recognised that the phrase had no intel ##li ##gible meaning in a wholly common law context , which suggested that attention had to be given to the civil law origins of the phrase .

reference_raw: May L.J. acknowledged that the phrase had no understandable meaning in a perfectly common legal context, which suggested that attention should be paid to the origin of the phrase in civil law.

reference_spacy_tokens: May L.J. acknowledged that the phrase had no understandable meaning in a perfectly common legal context , which suggested that attention should be paid to the origin of the phrase in civil law .


fn_spacy_tokens_for_baseline: A few rotted buckets lie around the well , which has a 3-foot high stone wall around it .

source_bert_toks: a few rot ##ted bucket ##s lie around the well , which has a 3 - foot high stone wall around it .

reference_raw: There are several rotten buckets around a well with a three-foot-high stone wall around it.

reference_spacy_tokens: There are several rotten buckets around a well with a three - foot - high stone wall around it .


fn_spacy_tokens_for_baseline: Although she 'd been enchanted by the boisterous reunions , her attention was immediately arrested by the man 's striking colouring .

source_bert_toks: although she ' d been enchanted by the bois ##ter ##ous reunion ##s , her attention was immediately arrested by the man ' s striking colour ##ing .

reference_raw: Though fascinated by the boisterous encounters, her attention was instantly caught by the man's striking color.

reference_spacy_tokens: Though fascinated by the boisterous encounters , her attention was instantly caught by the man 's striking color .


fn_spacy_tokens_for_baseline: Turning to your job description , Mrs Taylor is highly experienced in automated library systems , albeit the Soutron system as distinct from BookShelf , but the two are not too dissimilar .

source_bert_toks: turning to your job description , mrs taylor is highly experienced in automated library systems , albeit the so ##ut ##ron system as distinct from books ##hel ##f , but the two are not too di ##ssi ##mi ##lar .

reference_raw: Turning to your job description, Mrs. Taylor has a great deal of experience in automated library systems, although the Soutron system is different from the BookShelf system, but they are not very different.

reference_spacy_tokens: Turning to your job description , Mrs. Taylor has a great deal of experience in automated library systems , although the Soutron system is different from the BookShelf system , but they are not very different .


fn_spacy_tokens_for_baseline: Short of declaring Iran in violation of the NPT , the IAEA Director - General Mohamed ElBaradei stated , " Iran has failed to meet its obligations under its Safeguards Agreement " and criticized Iran for not being transparent with the construction of its nuclear - related facilities and import of nuclear material .

source_bert_toks: short of declaring iran in violation of the np ##t , the ia ##ea director - general mohamed el ##bara ##de ##i stated , " iran has failed to meet its obligations under its safeguard ##s agreement " and criticized iran for not being transparent with the construction of its nuclear - related facilities and import of nuclear material .

reference_raw: Shortly before declaring Iran to be in breach of the NPT, the Director of the International Atomic Energy Agency - General Mohamed ElBaradei said, "Iran has failed to fulfil its obligations under the Safeguards Agreement" and criticized Iran for not being transparent about the construction of its nuclear-related equipment and the importation of nuclear material.

reference_spacy_tokens: Shortly before declaring Iran to be in breach of the NPT , the Director of the International Atomic Energy Agency - General Mohamed ElBaradei said , " Iran has failed to fulfil its obligations under the Safeguards Agreement " and criticized Iran for not being transparent about the construction of its nuclear - related equipment and the importation of nuclear material .


fn_spacy_tokens_for_baseline: It 's hard to accept that it 's over and only took 15 seconds .

source_bert_toks: it ' s hard to accept that it ' s over and only took 15 seconds .

reference_raw: It's hard to accept that this is the end, and it's only been 15 seconds.

reference_spacy_tokens: It 's hard to accept that this is the end , and it 's only been 15 seconds .


fn_spacy_tokens_for_baseline: South of the terminal moraine many powerful meltwater streams were moving some of the loose stones , sand and mud of the older sheets of boulder clay .

source_bert_toks: south of the terminal mora ##ine many powerful melt ##water streams were moving some of the loose stones , sand and mud of the older sheets of boulder clay .

reference_raw: South of the terminal moraine, some of the loose rock, sand, and mud of the old sheets of rocky clay were being moved by a number of strong meltwater currents.

reference_spacy_tokens: South of the terminal moraine , some of the loose rock , sand , and mud of the old sheets of rocky clay were being moved by a number of strong meltwater currents .


fn_spacy_tokens_for_baseline: FTCWatch newsletter says FTC 's committee has forwarded its recommendations on the Microsoft Corp investigation to its commissioners .

source_bert_toks: ft ##c ##watch newsletter says ft ##c ' s committee has forward ##ed its recommendations on the microsoft corp investigation to its commissioners .

reference_raw: According to the FTCWatch Newsletter, the FTC Committee sent its recommendations on the Microsoft Corp investigation to its Commissioners.

reference_spacy_tokens: According to the FTCWatch Newsletter , the FTC Committee sent its recommendations on the Microsoft Corp investigation to its Commissioners .


fn_spacy_tokens_for_baseline: She thought his attic bedroom was absolutely fabulous .

source_bert_toks: she thought his attic bedroom was absolutely fabulous .

reference_raw: She thought his attic room was absolutely wonderful.

reference_spacy_tokens: She thought his attic room was absolutely wonderful .


fn_spacy_tokens_for_baseline: You do n't look like a woman who would falsify a document to get a job , but you did .

source_bert_toks: you don ' t look like a woman who would fa ##ls ##ify a document to get a job , but you did .

reference_raw: You don't look like a woman who faked a document to get a job, but you did.

reference_spacy_tokens: You do n't look like a woman who faked a document to get a job , but you did .


fn_spacy_tokens_for_baseline: Neither the identities of those talking nor their precise location was known .

source_bert_toks: neither the identities of those talking nor their precise location was known .

reference_raw: Neither the identity of those who spoke nor their exact position were known.

reference_spacy_tokens: Neither the identity of those who spoke nor their exact position were known .


fn_spacy_tokens_for_baseline: Lyndon Bolton , the managing director , yesterday described prospects as more encouraging than they were at the time of the interim report in August .

source_bert_toks: lyndon bolton , the managing director , yesterday described prospects as more encouraging than they were at the time of the interim report in august .

reference_raw: The CEO of Lyndon Bolton yesterday described the prospects as more stimulating than at the time of the interim report in August.

reference_spacy_tokens: The CEO of Lyndon Bolton yesterday described the prospects as more stimulating than at the time of the interim report in August .


fn_spacy_tokens_for_baseline: Martha bolted out of the door and crashed through the hedge into Mada Joyce 's yard , expecting to hear her grandmother 's shout of rage behind her and all the more fearful when only silence pursued her .

source_bert_toks: martha bolted out of the door and crashed through the hedge into mad ##a joyce ' s yard , expecting to hear her grandmother ' s shout of rage behind her and all the more fearful when only silence pursued her .

reference_raw: Martha ran out the door, crashing through the hedge into Mada Joyce's backyard, expecting to hear her grandmother's scream of anger behind her, all the more fearful when she was haunted by silence.

reference_spacy_tokens: Martha ran out the door , crashing through the hedge into Mada Joyce 's backyard , expecting to hear her grandmother 's scream of anger behind her , all the more fearful when she was haunted by silence .


fn_spacy_tokens_for_baseline: It was only the first of many devices that articulated party opinion against governments that the party theoretically supported .

source_bert_toks: it was only the first of many devices that articulated party opinion against governments that the party theoretically supported .

reference_raw: The party's theoretical support was only the first of many devices to express the party's opinion against governments.

reference_spacy_tokens: The party 's theoretical support was only the first of many devices to express the party 's opinion against governments .


fn_spacy_tokens_for_baseline: " Mother . " he croaked in a broken voice .

source_bert_toks: " mother . " he cr ##oa ##ked in a broken voice .

reference_raw: "Mother," he groaned, his voice broken.

reference_spacy_tokens: " Mother , " he groaned , his voice broken .


fn_spacy_tokens_for_baseline: That way , the conference gets off to a good start because people are raring to go and in the right frame of mind .

source_bert_toks: that way , the conference gets off to a good start because people are ra ##ring to go and in the right frame of mind .

reference_raw: That's how the conference gets to a good start, because people have the courage to go and in the right frame of mind.

reference_spacy_tokens: That 's how the conference gets to a good start , because people have the courage to go and in the right frame of mind .


fn_spacy_tokens_for_baseline: Thus not only can the dichotic listening paradigm be employed as a tool for investigating brain asymmetry but it can also be used to probe the nature of speech perception .

source_bert_toks: thus not only can the di ##cho ##tic listening paradigm be employed as a tool for investigating brain as ##ym ##metry but it can also be used to probe the nature of speech perception .

reference_raw: Thus, not only can a dichotic listening paradigm be used as a tool to investigate brain asymmetry, but can also be used to explore the nature of speech perception.

reference_spacy_tokens: Thus , not only can a dichotic listening paradigm be used as a tool to investigate brain asymmetry , but can also be used to explore the nature of speech perception .


fn_spacy_tokens_for_baseline: Since 2004 , China has been engaged in consultation with the MTCR ; however , its application for membership has so far not been successful and suspicions , especially in the United States , about Chinese missile technology transfers remain .

source_bert_toks: since 2004 , china has been engaged in consultation with the mt ##cr ; however , its application for membership has so far not been successful and suspicions , especially in the united states , about chinese missile technology transfers remain .

reference_raw: Since 2004, China has been consulted with the MTCR; however, its request for membership has not been successful so far and there are still concerns, particularly in the United States, about the transfer of Chinese missile technology.

reference_spacy_tokens: Since 2004 , China has been consulted with the MTCR ; however , its request for membership has not been successful so far and there are still concerns , particularly in the United States , about the transfer of Chinese missile technology .


fn_spacy_tokens_for_baseline: Those old ladies selling bunches of flowers on the Nevsky Prospekt ?

source_bert_toks: those old ladies selling bunch ##es of flowers on the ne ##vsky pro ##sp ##ek ##t ?

reference_raw: The old ladies who sell lots of flowers on the Nevsky Prospekt?

reference_spacy_tokens: The old ladies who sell lots of flowers on the Nevsky Prospekt ?


fn_spacy_tokens_for_baseline: The rest of this chapter will describe some of the resultant advantages for the historian of recent times .

source_bert_toks: the rest of this chapter will describe some of the resultant advantages for the historian of recent times .

reference_raw: The remainder of this chapter describes some of the resulting benefits to the historian of the past.

reference_spacy_tokens: The remainder of this chapter describes some of the resulting benefits to the historian of the past .


fn_spacy_tokens_for_baseline: As the dance finished we curtsied again and the Duke of Edinburgh stopped to congratulate us .

source_bert_toks: as the dance finished we curt ##sie ##d again and the duke of edinburgh stopped to cong ##rat ##ulate us .

reference_raw: When the dance was over, we bowed again, and the Duke of Edinburgh stopped to congratulate us.

reference_spacy_tokens: When the dance was over , we bowed again , and the Duke of Edinburgh stopped to congratulate us .


fn_spacy_tokens_for_baseline: Maurice vaulted the stile and , by a miracle , landed steadily on his feet .

source_bert_toks: maurice vaulted the stil ##e and , by a miracle , landed steadily on his feet .

reference_raw: Maurice swung the stile around and, miraculously, landed on his feet.

reference_spacy_tokens: Maurice swung the stile around and , miraculously , landed on his feet .


fn_spacy_tokens_for_baseline: The window frames rattled violently and glass cracked with the sound of a pistol shot .

source_bert_toks: the window frames rattled violently and glass cracked with the sound of a pistol shot .

reference_raw: The window frames clattered violently, and the glass cracked with the sound of a pistol blast.

reference_spacy_tokens: The window frames clattered violently , and the glass cracked with the sound of a pistol blast .


fn_spacy_tokens_for_baseline: Their numbers were still listed in his address book , just a phone call away , but he felt squeamish about making contact .

source_bert_toks: their numbers were still listed in his address book , just a phone call away , but he felt sq ##ue ##ami ##sh about making contact .

reference_raw: Their numbers were still listed in his directory, only a phone call away, but he felt squeaky about getting in touch.

reference_spacy_tokens: Their numbers were still listed in his directory , only a phone call away , but he felt squeaky about getting in touch .


fn_spacy_tokens_for_baseline: The lady with the upright hair who Gloria said had a screw loose , clattered into the bedroom holding out a steaming jug on a tray .

source_bert_toks: the lady with the upright hair who gloria said had a screw loose , cl ##atter ##ed into the bedroom holding out a steaming jug on a tray .

reference_raw: The woman with the upright hair Gloria had said had a screw loose and was clattering into the bedroom, holding out a steaming mug on a tray.

reference_spacy_tokens: The woman with the upright hair Gloria had said had a screw loose and was clattering into the bedroom , holding out a steaming mug on a tray .


fn_spacy_tokens_for_baseline: What Gov. Clinton is advocating , in effect , is extending the educational system down to the pre - kindergarten years .

source_bert_toks: what gov . clinton is advocating , in effect , is extending the educational system down to the pre - kindergarten years .

reference_raw: In fact, what Gov. Clinton advocates is an extension of education to pre-school years.

reference_spacy_tokens: In fact , what Gov. Clinton advocates is an extension of education to pre - school years .


fn_spacy_tokens_for_baseline: Iran 's biological warfare program began during the Iran - Iraq war .

source_bert_toks: iran ' s biological warfare program began during the iran - iraq war .

reference_raw: Iran's Bio-War Program started during the Iran-Iraq War.

reference_spacy_tokens: Iran 's Bio - War Program started during the Iran - Iraq War .


fn_spacy_tokens_for_baseline: U.N. officials said Travnik was hit by a cluster bomb launched from a rocket - launcher , which U.N. military spokesman Lt . Col Chris Vernon called a " very lethal weapon . "

source_bert_toks: u . n . officials said tr ##av ##nik was hit by a cluster bomb launched from a rocket - launcher , which u . n . military spokesman lt . col chris vernon called a " very lethal weapon . "

reference_raw: According to U.N. officials, Travnik was hit by a cluster of bombs fired from a rocket-launcher that Lieutenant Colonel Chris Vernon called a "very deadly weapon."

reference_spacy_tokens: According to U.N. officials , Travnik was hit by a cluster of bombs fired from a rocket - launcher that Lieutenant Colonel Chris Vernon called a " very deadly weapon . "


fn_spacy_tokens_for_baseline: ' Sometimes I forget that you are not native to this land , Alexei .

source_bert_toks: ' sometimes i forget that you are not native to this land , alexei .

reference_raw: 'Sometimes I forget you're not born in this country, Alexei.

reference_spacy_tokens: ' Sometimes I forget you 're not born in this country , Alexei .


fn_spacy_tokens_for_baseline: Describing the disturbances , the Financial Times of Feb. 20 reported that ' rampaging opposition members smashed windows , overturned furniture and scuffled with police ' .

source_bert_toks: describing the disturbances , the financial times of feb . 20 reported that ' ramp ##aging opposition members smashed windows , overturned furniture and sc ##uf ##fle ##d with police ' .

reference_raw: Describing the riots, the Financial Times of February 20 reported that the rioting members of the opposition had broken the windows, overturned the furniture, and fought with the police.

reference_spacy_tokens: Describing the riots , the Financial Times of February 20 reported that the rioting members of the opposition had broken the windows , overturned the furniture , and fought with the police .


fn_spacy_tokens_for_baseline: The process did n't perturb him for the simple reason that it did n't repel Willie .

source_bert_toks: the process didn ' t per ##tur ##b him for the simple reason that it didn ' t rep ##el willie .

reference_raw: The process did not disturb him simply because it did not repel Willie.

reference_spacy_tokens: The process did not disturb him simply because it did not repel Willie .


fn_spacy_tokens_for_baseline: The Maggot flew me back , because if we want to leave on Sunday morning then we 've got a heap of work to do first .

source_bert_toks: the mag ##go ##t flew me back , because if we want to leave on sunday morning then we ' ve got a heap of work to do first .

reference_raw: The worm flew me back because if we wanted to leave on Sunday morning, we had a lot of work to do first.

reference_spacy_tokens: The worm flew me back because if we wanted to leave on Sunday morning , we had a lot of work to do first .


fn_spacy_tokens_for_baseline: You 'll find Hong Kong easy to get around , the people helpful , English spoken everywhere , and food that lives up to its reputation .

source_bert_toks: you ' ll find hong kong easy to get around , the people helpful , english spoken everywhere , and food that lives up to its reputation .

reference_raw: Hong Kong is easy to get around, people who are useful, English spoken everywhere, and food that lives up to its repute.

reference_spacy_tokens: Hong Kong is easy to get around , people who are useful , English spoken everywhere , and food that lives up to its repute .


fn_spacy_tokens_for_baseline: The show catalogue featured a cover picture on a youthful Leslie Thomas , leading the Dyfed - based family 's Dairy Shorthorn bull which won at Aberystwyth before gaining championship laurels at the Royal and Royal Welsh shows .

source_bert_toks: the show catalogue featured a cover picture on a youthful leslie thomas , leading the d ##y ##fed - based family ' s dairy short ##horn bull which won at abe ##rys ##t ##wy ##th before gaining championship laurel ##s at the royal and royal welsh shows .

reference_raw: The catalogue of the show showed a cover image of young Leslie Thomas, who ran the Dairy Shorthorn Bull of the Dyfed family, who won at Aberystwyth before winning the Royal and Royal Welsh Championship Laurels.

reference_spacy_tokens: The catalogue of the show showed a cover image of young Leslie Thomas , who ran the Dairy Shorthorn Bull of the Dyfed family , who won at Aberystwyth before winning the Royal and Royal Welsh Championship Laurels .


fn_spacy_tokens_for_baseline: If two loops or mumps are visible across the warp on which the knot has been tied , the Turkish knot has probably been employed .

source_bert_toks: if two loops or mum ##ps are visible across the warp on which the knot has been tied , the turkish knot has probably been employed .

reference_raw: If two loops or mumps can be seen over the warp at which the node is bound, the Turkish node is likely to be used.

reference_spacy_tokens: If two loops or mumps can be seen over the warp at which the node is bound , the Turkish node is likely to be used .


fn_spacy_tokens_for_baseline: Armenia is begging Russia to recommission two old reactors that had been shut down for good in 1988 under popular pressure .

source_bert_toks: armenia is begging russia to rec ##om ##mission two old reactors that had been shut down for good in 1988 under popular pressure .

reference_raw: Armenia is asking Russia to shut down two old reactors that were shut down for good in 1988 under popular pressure.

reference_spacy_tokens: Armenia is asking Russia to shut down two old reactors that were shut down for good in 1988 under popular pressure .


fn_spacy_tokens_for_baseline: That 's where you - and Goodwill - come in .

source_bert_toks: that ' s where you - and goodwill - come in .

reference_raw: There you - and Goodwill - enter.

reference_spacy_tokens: There you - and Goodwill - enter .


fn_spacy_tokens_for_baseline: Altho ' his physiognomy was European , he was clad in the turban and loose trousers of a Malay .

source_bert_toks: alt ##ho ' his ph ##ys ##io ##gno ##my was european , he was clad in the tu ##rba ##n and loose trousers of a malay .

reference_raw: Alth's physiognomy was European, wearing a turban and loose Malay pants.

reference_spacy_tokens: Alth 's physiognomy was European , wearing a turban and loose Malay pants .


fn_spacy_tokens_for_baseline: North Korean government statements and media reports often cite a " nuclear threat from the United States , " and continue to claim that the United States has about 1,000 nuclear weapons deployed in South Korea .

source_bert_toks: north korean government statements and media reports often cite a " nuclear threat from the united states , " and continue to claim that the united states has about 1 , 000 nuclear weapons deployed in south korea .

reference_raw: North Korean government statements and media reports often refer to the "nuclear threat of the US" and still claim that the US has around 1,000 nuclear weapons deployed in South Korea.

reference_spacy_tokens: North Korean government statements and media reports often refer to the " nuclear threat of the US " and still claim that the US has around 1,000 nuclear weapons deployed in South Korea .


fn_spacy_tokens_for_baseline: The Labour leaflet compared the numbers going to the Royal Shakespeare Company with attendances at Wembley Stadium , Aida with the Ideal Home Exhibition , and ballet , somewhat incongruously , with Rugby Union .

source_bert_toks: the labour leaf ##let compared the numbers going to the royal shakespeare company with attendance ##s at wembley stadium , aid ##a with the ideal home exhibition , and ballet , somewhat inc ##ong ##ru ##ously , with rugby union .

reference_raw: The Labour Leaflet compared the numbers of the Royal Shakespeare Company with those of the Wembley Stadium, Aida with the Ideal Home Exhibition, and ballet with the Rugby Union.

reference_spacy_tokens: The Labour Leaflet compared the numbers of the Royal Shakespeare Company with those of the Wembley Stadium , Aida with the Ideal Home Exhibition , and ballet with the Rugby Union .


fn_spacy_tokens_for_baseline: If you insert three blank rows at the top of the spreadsheet you can use B2 to record the average inflation per year that you expect for the life of the savings plan .

source_bert_toks: if you insert three blank rows at the top of the spreads ##hee ##t you can use b ##2 to record the average inflation per year that you expect for the life of the savings plan .

reference_raw: If you put three blank rows at the top of the table, you can use B2 to record the average annual inflation you expect for the life of the savings plan.

reference_spacy_tokens: If you put three blank rows at the top of the table , you can use B2 to record the average annual inflation you expect for the life of the savings plan .


fn_spacy_tokens_for_baseline: This time , the editor is played by Andre Leon Talley , a large , genial black man in Dior sequinned pants who is the real - life creative director of US Vogue .

source_bert_toks: this time , the editor is played by andre leon tall ##ey , a large , gen ##ial black man in di ##or se ##quin ##ned pants who is the real - life creative director of us vogue .

reference_raw: This time, the editor is played by Andre Leon Talley, the big genius black man in Dior sequins, who is the real creative director of U.S. Vogue.

reference_spacy_tokens: This time , the editor is played by Andre Leon Talley , the big genius black man in Dior sequins , who is the real creative director of U.S. Vogue .


fn_spacy_tokens_for_baseline: Sadly , so many dogs seem to end up in classes run by loud , aggressive people , where they are yanked cruelly on choke chains and punished physically if they do n't do as they 're told .

source_bert_toks: sadly , so many dogs seem to end up in classes run by loud , aggressive people , where they are yanked cruel ##ly on choke chains and punished physically if they don ' t do as they ' re told .

reference_raw: Unfortunately, so many dogs seem to end up in classrooms run by noisy, aggressive people, where they're being cruelly yanked on choking chains and physically disciplined when they don't do what they're told to do.

reference_spacy_tokens: Unfortunately , so many dogs seem to end up in classrooms run by noisy , aggressive people , where they 're being cruelly yanked on choking chains and physically disciplined when they do n't do what they 're told to do .


fn_spacy_tokens_for_baseline: The woman thief arrived with an accomplice at the house at Camlough and told the elderly woman she was thirsty .

source_bert_toks: the woman thief arrived with an acc ##omp ##lice at the house at cam ##lou ##gh and told the elderly woman she was thirsty .

reference_raw: The woman theft came to the house in Camlough with an accomplice and told the old woman she was thirsty.

reference_spacy_tokens: The woman theft came to the house in Camlough with an accomplice and told the old woman she was thirsty .


fn_spacy_tokens_for_baseline: The others here today live elsewhere .

source_bert_toks: the others here today live elsewhere .

reference_raw: The rest of us live somewhere else today.

reference_spacy_tokens: The rest of us live somewhere else today .


fn_spacy_tokens_for_baseline: On one occasion a furious blizzard howled across a landscape illuminated by a sunset of bloodshot gold .

source_bert_toks: on one occasion a furious blizzard howled across a landscape illuminated by a sunset of blood ##shot gold .

reference_raw: On one occasion, a fierce storm roared across the landscape, illuminated by a sunset of bloodshot gold.

reference_spacy_tokens: On one occasion , a fierce storm roared across the landscape , illuminated by a sunset of bloodshot gold .


fn_spacy_tokens_for_baseline: The sky was all around them , orange and crimson , passionate and dangerous .

source_bert_toks: the sky was all around them , orange and crimson , passionate and dangerous .

reference_raw: The sky was all about them, orange and crimson, hot and dangerous.

reference_spacy_tokens: The sky was all about them , orange and crimson , hot and dangerous .


fn_spacy_tokens_for_baseline: The strike was typical in that it killed bystanders rather than soldiers , who patrol the city in heavily armored vehicles .

source_bert_toks: the strike was typical in that it killed by ##stand ##ers rather than soldiers , who patrol the city in heavily armored vehicles .

reference_raw: The attack was typical in that it killed bystanders rather than soldiers guarding the city in heavy-armoured vehicles.

reference_spacy_tokens: The attack was typical in that it killed bystanders rather than soldiers guarding the city in heavy - armoured vehicles .


fn_spacy_tokens_for_baseline: Anyway , it was good that Taff was back to his old self .

source_bert_toks: anyway , it was good that ta ##ff was back to his old self .

reference_raw: In any case, it was a good thing Taff was back to his old self.

reference_spacy_tokens: In any case , it was a good thing Taff was back to his old self .


fn_spacy_tokens_for_baseline: ' And now you say I 've thieved from you ?

source_bert_toks: ' and now you say i ' ve th ##ie ##ved from you ?

reference_raw: 'And now you're saying that I stole from you?

reference_spacy_tokens: ' And now you 're saying that I stole from you ?


fn_spacy_tokens_for_baseline: We must now look at these hamlets : when they originated , how they developed and how they managed the landscape .

source_bert_toks: we must now look at these hamlets : when they originated , how they developed and how they managed the landscape .

reference_raw: Now we have to look at these villages: where they came from, how they evolved and managed the countryside.

reference_spacy_tokens: Now we have to look at these villages : where they came from , how they evolved and managed the countryside .


fn_spacy_tokens_for_baseline: Women policed each other , stopping rebellious acts with cold and disapproving stares .

source_bert_toks: women police ##d each other , stopping rebellious acts with cold and di ##sa ##pp ##roving stares .

reference_raw: The women policed each other, stopping rebellious acts with cold, disapproval.

reference_spacy_tokens: The women policed each other , stopping rebellious acts with cold , disapproval .


fn_spacy_tokens_for_baseline: Hence a pre - processing level is required which determines the probable sequence ( Wright , 1989 ) .

source_bert_toks: hence a pre - processing level is required which determines the probable sequence ( wright , 1989 ) .

reference_raw: A pre-processing level is therefore necessary to determine the probable sequence (Wright, 1989).

reference_spacy_tokens: A pre - processing level is therefore necessary to determine the probable sequence ( Wright , 1989 ) .