fn_spacy_tokens_for_baseline: Leave large margins at the top and bottom of pages , preferably separated by some device such as a rule to draw the eye into the page .

source_bert_toks: leave large margins at the top and bottom of pages , prefer ##ably separated by some device such as a rule to draw the eye into the page .

reference_raw: Leave large margins at the top and bottom of the page, preferably detached by some device, for example, to draw the eye to the page.

reference_spacy_tokens: Leave large margins at the top and bottom of the page , preferably detached by some device , for example , to draw the eye to the page .


fn_spacy_tokens_for_baseline: Jacqui gurgled something incomprehensible , as Kattina 's tongue shot into her mouth to save her the embarrassment of replying .

source_bert_toks: ja ##c ##qui gu ##rg ##led something inc ##omp ##re ##hen ##sible , as kat ##tina ' s tongue shot into her mouth to save her the embarrassment of reply ##ing .

reference_raw: Jacqui grunted something incomprehensible as Kattina's tongue shot into her mouth to save her the embarrassment of replying.

reference_spacy_tokens: Jacqui grunted something incomprehensible as Kattina 's tongue shot into her mouth to save her the embarrassment of replying .


fn_spacy_tokens_for_baseline: They like to watch a tough woman up there on the screen and comfort themselves with the thought that they 'll never have to live with her . '

source_bert_toks: they like to watch a tough woman up there on the screen and comfort themselves with the thought that they ' ll never have to live with her . '

reference_raw: "They like to watch a hard woman upstairs on the screen and console themselves with the idea that they'll never have to live with her."

reference_spacy_tokens: " They like to watch a hard woman upstairs on the screen and console themselves with the idea that they 'll never have to live with her . "


fn_spacy_tokens_for_baseline: So reconcile this piece of French policy , if thou can , and foretell its consequences .

source_bert_toks: so reconcile this piece of french policy , if thou can , and fore ##tell its consequences .

reference_raw: So reconcile this piece of French policy, if possible, and predict the consequences.

reference_spacy_tokens: So reconcile this piece of French policy , if possible , and predict the consequences .


fn_spacy_tokens_for_baseline: Rapid and accurate methods are needed for the diagnosis of Plasmodium falciparum malaria [ 1 2 ] as malaria is estimated to kill between 1.4 and 2.6 million people each year [ 1]. WHO South East Asian regional office estimates 19500 deaths due to malaria in India annually [ 3]. P. falciparum infections in children may become life threatening making rapid diagnosis of extreme importance [ 4]. No clinical diagnostic criteria are both sensitive and specific for malaria , an undifferentiated febrile illness [ 5 ] which may result in the erroneous treatment of millions of non - malaria cases with antimalarial drugs in the absence of diagnostic malaria microscopy .

source_bert_toks: rapid and accurate methods are needed for the diagnosis of pl ##as ##mo ##dium fa ##lc ##ip ##aru ##m malaria [ 1 2 ] as malaria is estimated to kill between 1 . 4 and 2 . 6 million people each year [ 1 ] . who south east asian regional office estimates 1950 ##0 deaths due to malaria in india annually [ 3 ] . p . fa ##lc ##ip ##aru ##m infections in children may become life threatening making rapid diagnosis of extreme importance [ 4 ] . no clinical diagnostic criteria are both sensitive and specific for malaria , an und ##iff ##ere ##nti ##ated feb ##ril ##e illness [ 5 ] which may result in the er ##rone ##ous treatment of millions of non - malaria cases with anti ##mal ##aria ##l drugs in the absence of diagnostic malaria microscopy .

reference_raw: Fast and accurate methods are needed to diagnose Plasmodium falciparum malaria [12], as malaria is estimated to kill between 1.4 million and 2.6 million people each year [1]. WHO Southeast Asian Regional Office estimates that 19500 deaths due to malaria in India every year [3]. malaria, a non-differentiated febrile disease [5], which can lead to mistreatment of millions of non-malaria cases with antimalarial medicinal products in the absence of diagnostic malaria microscopes.

reference_spacy_tokens: Fast and accurate methods are needed to diagnose Plasmodium falciparum malaria [ 12 ] , as malaria is estimated to kill between 1.4 million and 2.6 million people each year [ 1]. WHO Southeast Asian Regional Office estimates that 19500 deaths due to malaria in India every year [ 3]. malaria , a non - differentiated febrile disease [ 5 ] , which can lead to mistreatment of millions of non - malaria cases with antimalarial medicinal products in the absence of diagnostic malaria microscopes .


fn_spacy_tokens_for_baseline: Its senior partner , the Communist Party , has not carried all its followers with it this summer , and last month had to purge the entire leadership of its youth movement ( KNE ) .

source_bert_toks: its senior partner , the communist party , has not carried all its followers with it this summer , and last month had to purge the entire leadership of its youth movement ( kn ##e ) .

reference_raw: His senior partner, the Communist Party, did not bring all his followers this summer, and last month he had to cleanse the entire leadership of his Youth Movement (KNE).

reference_spacy_tokens: His senior partner , the Communist Party , did not bring all his followers this summer , and last month he had to cleanse the entire leadership of his Youth Movement ( KNE ) .


fn_spacy_tokens_for_baseline: They catch them and pickle them or pin them on cards ; they put them in various sorts of cages and study their responses to different environments and different stimuli .

source_bert_toks: they catch them and pick ##le them or pin them on cards ; they put them in various sorts of cages and study their responses to different environments and different stimuli .

reference_raw: They catch them, pick them up, or put them on cards; they put them in different cages and study their reactions to different environments and different stimuli.

reference_spacy_tokens: They catch them , pick them up , or put them on cards ; they put them in different cages and study their reactions to different environments and different stimuli .


fn_spacy_tokens_for_baseline: Diana daubed luminous paint on the eyes of her cuddly green hippo so that at night it seemed as though he was keeping watch and looking after her .

source_bert_toks: diana da ##ub ##ed luminous paint on the eyes of her cu ##dd ##ly green hip ##po so that at night it seemed as though he was keeping watch and looking after her .

reference_raw: Diana smeared bright paint across her cuddly green hippo's eyes, making it look like he was watching her at night.

reference_spacy_tokens: Diana smeared bright paint across her cuddly green hippo 's eyes , making it look like he was watching her at night .


fn_spacy_tokens_for_baseline: ' And she had this baby and it had a birthmark like a cat 's face on its stomach . '

source_bert_toks: ' and she had this baby and it had a birth ##mark like a cat ' s face on its stomach . '

reference_raw: "And she had a child with a mole on her belly like a cat's face."

reference_spacy_tokens: " And she had a child with a mole on her belly like a cat 's face . "


fn_spacy_tokens_for_baseline: Very little has been discovered of the gates , although their sites can be predicted with tolerable certainty .

source_bert_toks: very little has been discovered of the gates , although their sites can be predicted with to ##ler ##able certainty .

reference_raw: Very little has been discovered about the gates, though their locations can be predicted with acceptable certainty.

reference_spacy_tokens: Very little has been discovered about the gates , though their locations can be predicted with acceptable certainty .


fn_spacy_tokens_for_baseline: The constantly crowded and busy Grafton street is the most visible center for shopping , but there are shops all over that carry an international array of goods as well as the Irish crafts and souvenirs you expect .

source_bert_toks: the constantly crowded and busy grafton street is the most visible center for shopping , but there are shops all over that carry an international array of goods as well as the irish crafts and so ##uven ##irs you expect .

reference_raw: The ever-crowded and busy Grafton Street is the most visible shopping center, but there are shops everywhere that have an international range of goods, as well as the Irish crafts and souvenirs you expect.

reference_spacy_tokens: The ever - crowded and busy Grafton Street is the most visible shopping center , but there are shops everywhere that have an international range of goods , as well as the Irish crafts and souvenirs you expect .


fn_spacy_tokens_for_baseline: Baffled , he scratched his greasy white hair and wondered what it could be and why it should have been stored in a beer keg .

source_bert_toks: baffled , he scratched his greasy white hair and wondered what it could be and why it should have been stored in a beer ke ##g .

reference_raw: He rubbed his greasy white hair in confusion, wondering what it might be and why it should be stored in a beer barrel.

reference_spacy_tokens: He rubbed his greasy white hair in confusion , wondering what it might be and why it should be stored in a beer barrel .


fn_spacy_tokens_for_baseline: But I like the crowd I work with -- some of them , anyhow .

source_bert_toks: but i like the crowd i work with - - some of them , any ##how .

reference_raw: But I like the crowd I'm working with -- some of them, anyway.

reference_spacy_tokens: But I like the crowd I 'm working with -- some of them , anyway .


fn_spacy_tokens_for_baseline: If she started to strew the floor with objects she received a firm warning then , if she persisted , her mother took her wrists and made her pick up and replace each object .

source_bert_toks: if she started to st ##rew the floor with objects she received a firm warning then , if she persisted , her mother took her wrists and made her pick up and replace each object .

reference_raw: When she began to strangle the floor with objects, she would receive a strong warning that if she persisted, her mother would take her wrists and force her to lift and replace every object.

reference_spacy_tokens: When she began to strangle the floor with objects , she would receive a strong warning that if she persisted , her mother would take her wrists and force her to lift and replace every object .


fn_spacy_tokens_for_baseline: For Perkin , making arrows would have been like filing his nails , and he 'd had a stove right in his workroom for the charring .

source_bert_toks: for per ##kin , making arrows would have been like filing his nails , and he ' d had a stove right in his work ##room for the char ##ring .

reference_raw: For Perkin, making arrows would be like filing nails, and he had a stove right in his office to burn.

reference_spacy_tokens: For Perkin , making arrows would be like filing nails , and he had a stove right in his office to burn .


fn_spacy_tokens_for_baseline: Place names are often based on the distance to the nearest mile - post , as measured from the tip of the Kowloon peninsula .

source_bert_toks: place names are often based on the distance to the nearest mile - post , as measured from the tip of the ko ##wl ##oon peninsula .

reference_raw: The names of the locations are often based on the range to the nearest mile point measured from the tip of the Kowloon peninsula.

reference_spacy_tokens: The names of the locations are often based on the range to the nearest mile point measured from the tip of the Kowloon peninsula .


fn_spacy_tokens_for_baseline: On the other hand , Libya has declined to join the Chemical Weapons Convention , which was opened for signature in January 1993 and entered into force on April 29 , 1997 QN : Has Libya ratified the Chemical Weapons Convention ?

source_bert_toks: on the other hand , libya has declined to join the chemical weapons convention , which was opened for signature in january 1993 and entered into force on april 29 , 1997 q ##n : has libya ratified the chemical weapons convention ?

reference_raw: On the other hand, Libya refused to accede to the CWC, which was opened for signature in January 1993 and entered into force on April 29, 1997 QN: Has Libya ratified the CWC?

reference_spacy_tokens: On the other hand , Libya refused to accede to the CWC , which was opened for signature in January 1993 and entered into force on April 29 , 1997 QN : Has Libya ratified the CWC ?


fn_spacy_tokens_for_baseline: She fingered the edge of her dressing - gown .

source_bert_toks: she fingered the edge of her dressing - gown .

reference_raw: She touched the edge of her robe.

reference_spacy_tokens: She touched the edge of her robe .


fn_spacy_tokens_for_baseline: The Ukrainian national leadership was fatally weakened by being restricted to the intelligentsia and without the dedication to escape from this .

source_bert_toks: the ukrainian national leadership was fatally weakened by being restricted to the intelligent ##sia and without the dedication to escape from this .

reference_raw: Ukraine's national leadership has been fatally undermined by the fact that it is limited to intelligence and that it is not committed to escaping it.

reference_spacy_tokens: Ukraine 's national leadership has been fatally undermined by the fact that it is limited to intelligence and that it is not committed to escaping it .


fn_spacy_tokens_for_baseline: The fire has spread extensively and it is estimated that approximately 2,500 acres of forest have been damaged .

source_bert_toks: the fire has spread extensively and it is estimated that approximately 2 , 500 acres of forest have been damaged .

reference_raw: The fire is widespread and approximately 2,500 acres of forest are estimated to have been damaged.

reference_spacy_tokens: The fire is widespread and approximately 2,500 acres of forest are estimated to have been damaged .


fn_spacy_tokens_for_baseline: And this year of all years , with its great debate on what constitutes family values you will want to make sure to order your Thanksgiving turkey well ahead of time .

source_bert_toks: and this year of all years , with its great debate on what constitutes family values you will want to make sure to order your thanksgiving turkey well ahead of time .

reference_raw: And this year, with a big debate about what's family value, you're going to want to make sure you order your Thanksgiving Turkish in advance.

reference_spacy_tokens: And this year , with a big debate about what 's family value , you 're going to want to make sure you order your Thanksgiving Turkish in advance .


fn_spacy_tokens_for_baseline: For recently the random eruptions and scattered pustules that had decked my chin and brows for the past year had begun to mass , forming formidably ugly scarps and weeping lesions .

source_bert_toks: for recently the random eruptions and scattered pu ##st ##ules that had deck ##ed my chin and brows for the past year had begun to mass , forming form ##ida ##bly ugly scar ##ps and weeping lesions .

reference_raw: Recently, the random eruptions and dispersals that had covered my chin and eyebrows over the last year had begun to mass, creating hideous scars and sobbing lesions.

reference_spacy_tokens: Recently , the random eruptions and dispersals that had covered my chin and eyebrows over the last year had begun to mass , creating hideous scars and sobbing lesions .


fn_spacy_tokens_for_baseline: The Wardak police chief , Gen. Abdul Qayuum Baqizoi , said the American strike was aimed at a clandestine meeting of insurgent figures in the village Jaw - e - Mekh Zareen , which is considered a perilous locale .

source_bert_toks: the ward ##ak police chief , gen . abdul q ##ay ##u ##um ba ##qi ##zo ##i , said the american strike was aimed at a clandestine meeting of ins ##urgent figures in the village jaw - e - me ##kh za ##reen , which is considered a per ##ilo ##us local ##e .

reference_raw: Chief of the Wardak Police, General Abdul Qayuum Baqizoi, said that the American attack was aimed at a secret meeting of rebels in the village of Jaw-e-Mekh Zareen, which is considered a dangerous place.

reference_spacy_tokens: Chief of the Wardak Police , General Abdul Qayuum Baqizoi , said that the American attack was aimed at a secret meeting of rebels in the village of Jaw - e - Mekh Zareen , which is considered a dangerous place .


fn_spacy_tokens_for_baseline: The Middle Kingdom is a recreated " living " history of China 's past , presented through a number of full - size replicas of shrines , temples , pagodas , palaces , and street scenes .

source_bert_toks: the middle kingdom is a recreated " living " history of china ' s past , presented through a number of full - size replica ##s of shrines , temples , pagoda ##s , palaces , and street scenes .

reference_raw: The Middle Kingdom is the recreation of the "living" history of the Chinese past, presented in a series of full-size replications of shrines, temples, pagodas, palaces, and street scenes.

reference_spacy_tokens: The Middle Kingdom is the recreation of the " living " history of the Chinese past , presented in a series of full - size replications of shrines , temples , pagodas , palaces , and street scenes .


fn_spacy_tokens_for_baseline: ' Now , ' Jinkwa shushed them .

source_bert_toks: ' now , ' jin ##k ##wa shu ##shed them .

reference_raw: 'Now,' said Jinkwa.

reference_spacy_tokens: ' Now , ' said Jinkwa .


fn_spacy_tokens_for_baseline: Your gift to Goodwill is important because people with physical and Mental disabilities sometimes need an extra hand to know the pride that comes with work .

source_bert_toks: your gift to goodwill is important because people with physical and mental disabilities sometimes need an extra hand to know the pride that comes with work .

reference_raw: Your talent for good will is important because people with physical and mental disabilities sometimes need extra help to know the pride of work.

reference_spacy_tokens: Your talent for good will is important because people with physical and mental disabilities sometimes need extra help to know the pride of work .


fn_spacy_tokens_for_baseline: What income he has comes from heroin , extortion and other people 's thieving .

source_bert_toks: what income he has comes from heroin , ex ##tort ##ion and other people ' s th ##ieving .

reference_raw: What kind of income he gets from heroin, blackmail, and theft of other people.

reference_spacy_tokens: What kind of income he gets from heroin , blackmail , and theft of other people .


fn_spacy_tokens_for_baseline: Troops found triggering devices hidden in his refrigerator .

source_bert_toks: troops found triggering devices hidden in his refrigerator .

reference_raw: Troops found the launchers hidden in the fridge.

reference_spacy_tokens: Troops found the launchers hidden in the fridge .


fn_spacy_tokens_for_baseline: Since Broca 's pioneering work , a variety of studies have confirmed that the left hemisphere plays a dominant role in the comprehension and expression of written and spoken language .

source_bert_toks: since bro ##ca ' s pioneering work , a variety of studies have confirmed that the left hemisphere plays a dominant role in the comprehension and expression of written and spoken language .

reference_raw: Since Broca's pioneering work, various studies have confirmed that the left hemisphere plays a dominant role in understanding and expressing written and spoken language.

reference_spacy_tokens: Since Broca 's pioneering work , various studies have confirmed that the left hemisphere plays a dominant role in understanding and expressing written and spoken language .


fn_spacy_tokens_for_baseline: A flame of pain and anger enveloped him .

source_bert_toks: a flame of pain and anger enveloped him .

reference_raw: A flame of pain and anger swept over him.

reference_spacy_tokens: A flame of pain and anger swept over him .


fn_spacy_tokens_for_baseline: She was about seventeen years old , with long dark hair in disarray around her face .

source_bert_toks: she was about seventeen years old , with long dark hair in di ##sar ##ray around her face .

reference_raw: She was about seventeen, with long dark hair curled around her face.

reference_spacy_tokens: She was about seventeen , with long dark hair curled around her face .


fn_spacy_tokens_for_baseline: He wore a navy fisherman 's jersey and gumboots , and a heavy anorak , shiny and running with wet .

source_bert_toks: he wore a navy fisherman ' s jersey and gum ##boot ##s , and a heavy an ##ora ##k , shiny and running with wet .

reference_raw: He was wearing a navy fisherman's sweater and rubber boots, and a heavy anorak, shiny and wet.

reference_spacy_tokens: He was wearing a navy fisherman 's sweater and rubber boots , and a heavy anorak , shiny and wet .


fn_spacy_tokens_for_baseline: The conference was jointly sponsored by the New York Institute of Technology School of Management and the Armed Forces Communications and Electronics Association , a joint industry - government trade group .

source_bert_toks: the conference was jointly sponsored by the new york institute of technology school of management and the armed forces communications and electronics association , a joint industry - government trade group .

reference_raw: The conference was co-sponsored by the New York Institute of Technology School of Management and the Association of Arms and Communications and Electronics, a joint business group of industry and government.

reference_spacy_tokens: The conference was co - sponsored by the New York Institute of Technology School of Management and the Association of Arms and Communications and Electronics , a joint business group of industry and government .


fn_spacy_tokens_for_baseline: One elderly woman , Anna Bencinich , the mother of Evelyn , was rescued by neighbors who helped her from the burning house .

source_bert_toks: one elderly woman , anna ben ##cini ##ch , the mother of evelyn , was rescued by neighbors who helped her from the burning house .

reference_raw: An elderly woman, Anna Bencinich, Evelyn's mother, was rescued by neighbours who helped her out of a burning house.

reference_spacy_tokens: An elderly woman , Anna Bencinich , Evelyn 's mother , was rescued by neighbours who helped her out of a burning house .


fn_spacy_tokens_for_baseline: She felt rather riled .

source_bert_toks: she felt rather ri ##led .

reference_raw: She felt a little ridden.

reference_spacy_tokens: She felt a little ridden .


fn_spacy_tokens_for_baseline: We 're all laughing , but , I mean , it , it , it 's absolutely er , enraging , is n't it ?

source_bert_toks: we ' re all laughing , but , i mean , it , it , it ' s absolutely er , en ##rag ##ing , isn ' t it ?

reference_raw: We all laugh, but, you know, it's totally er, angry, right?

reference_spacy_tokens: We all laugh , but , you know , it 's totally er , angry , right ?


fn_spacy_tokens_for_baseline: Bake spanakopitta for about 40 minutes , then increase the heat for another 5 minutes to crisp the top .

source_bert_toks: ba ##ke span ##ako ##pit ##ta for about 40 minutes , then increase the heat for another 5 minutes to crisp the top .

reference_raw: Make a spanakopitta for about 40 minutes, then increase the temperature for another five minutes to break the top.

reference_spacy_tokens: Make a spanakopitta for about 40 minutes , then increase the temperature for another five minutes to break the top .


fn_spacy_tokens_for_baseline: Ideally , every trailer should be anchored by the ball hitch on to a ball mounted in the ground .

source_bert_toks: ideally , every trailer should be anchored by the ball hitch on to a ball mounted in the ground .

reference_raw: Ideally, each trailer should be docked by a hitch on a ball mounted on the ground.

reference_spacy_tokens: Ideally , each trailer should be docked by a hitch on a ball mounted on the ground .


fn_spacy_tokens_for_baseline: Passers- by might expect a few satin teddies in the window .

source_bert_toks: pass ##ers - by might expect a few satin ted ##dies in the window .

reference_raw: The passers-by could expect some satin bears in the window.

reference_spacy_tokens: The passers - by could expect some satin bears in the window .


fn_spacy_tokens_for_baseline: The dung - collector ambled slowly over , one eye on Sir John .

source_bert_toks: the dung - collector am ##bled slowly over , one eye on sir john .

reference_raw: The manure collector moved slowly, one eye on Sir John.

reference_spacy_tokens: The manure collector moved slowly , one eye on Sir John .


fn_spacy_tokens_for_baseline: Jen 's involvement with her job was such that she could not bear to leave it and would have motored through the day on a couple of sandwiches .

source_bert_toks: jen ' s involvement with her job was such that she could not bear to leave it and would have motor ##ed through the day on a couple of sandwiches .

reference_raw: Jen's involvement in her work was such that she couldn't stand to leave it, and she could drive two sandwiches all day.

reference_spacy_tokens: Jen 's involvement in her work was such that she could n't stand to leave it , and she could drive two sandwiches all day .


fn_spacy_tokens_for_baseline: Casting a disgusted glance at the buckled trike and at the throng pouring past him , south - bound , Grimm trotted northwards after the Assassin .

source_bert_toks: casting a disgusted glance at the buckled tri ##ke and at the th ##rong pouring past him , south - bound , grimm tr ##otted northwards after the assassin .

reference_raw: Grimm cast a distasteful glance at the buckled trike and the crowd that flowed around him in the south, trotting north after the Assassin.

reference_spacy_tokens: Grimm cast a distasteful glance at the buckled trike and the crowd that flowed around him in the south , trotting north after the Assassin .


fn_spacy_tokens_for_baseline: And the RUC have reiterated a warning made two months ago that they believe the terrorists have large stocks of explosives .

source_bert_toks: and the ru ##c have reiterated a warning made two months ago that they believe the terrorists have large stocks of explosives .

reference_raw: And two months ago, the RUC repeated the warning that they believed the terrorists had a large stock of explosives.

reference_spacy_tokens: And two months ago , the RUC repeated the warning that they believed the terrorists had a large stock of explosives .


fn_spacy_tokens_for_baseline: Small protests also broke out in the southern city of Assiut , which were dispersed quickly by security forces .

source_bert_toks: small protests also broke out in the southern city of ass ##iu ##t , which were dispersed quickly by security forces .

reference_raw: In the southern city of Assiut, which was quickly dispersed by the security forces, there were also small objections.

reference_spacy_tokens: In the southern city of Assiut , which was quickly dispersed by the security forces , there were also small objections .


fn_spacy_tokens_for_baseline: Taiwan 's nuclear weapons program was established under the direction of the Institute of Nuclear Energy Research ( INER ) and the Chungshan Institute of Science and Technology following the People 's Republic of China 's first nuclear test in October 1964 .

source_bert_toks: taiwan ' s nuclear weapons program was established under the direction of the institute of nuclear energy research ( in ##er ) and the chung ##shan institute of science and technology following the people ' s republic of china ' s first nuclear test in october 1964 .

reference_raw: Following the first nuclear test carried out by the People's Republic of China in October 1964, Taiwan's nuclear weapons programme was set up under the direction of the Institute for Nuclear Energy Research (INER) and the Chungshan Institute for Science and Technology.

reference_spacy_tokens: Following the first nuclear test carried out by the People 's Republic of China in October 1964 , Taiwan 's nuclear weapons programme was set up under the direction of the Institute for Nuclear Energy Research ( INER ) and the Chungshan Institute for Science and Technology .


fn_spacy_tokens_for_baseline: Immediately after the Last Supper , Jesus and his disciples went out to the Mount of Olives .

source_bert_toks: immediately after the last supper , jesus and his disciples went out to the mount of olive ##s .

reference_raw: Right after the Last Supper, Jesus and his disciples went to the Olive Mountain.

reference_spacy_tokens: Right after the Last Supper , Jesus and his disciples went to the Olive Mountain .


fn_spacy_tokens_for_baseline: The Duty Officer , elderly and paunchy , raised a lumpy face from a crime sheet , or a sports paper , both of which were on his desk , looked again , and stood up .

source_bert_toks: the duty officer , elderly and pau ##nch ##y , raised a lump ##y face from a crime sheet , or a sports paper , both of which were on his desk , looked again , and stood up .

reference_raw: The duty officer, old and stiff, lifted a lumpy face from a crime sheet or a sports paper, both of which were on the table, looked again, and stood up.

reference_spacy_tokens: The duty officer , old and stiff , lifted a lumpy face from a crime sheet or a sports paper , both of which were on the table , looked again , and stood up .


fn_spacy_tokens_for_baseline: As for whether the Macintosh will ever oust the PC from the corporate market , well that 's another matter .

source_bert_toks: as for whether the macintosh will ever ou ##st the pc from the corporate market , well that ' s another matter .

reference_raw: When it comes to whether the Macintosh will ever expel the computer from the corporate market, well, that's another matter.

reference_spacy_tokens: When it comes to whether the Macintosh will ever expel the computer from the corporate market , well , that 's another matter .


fn_spacy_tokens_for_baseline: The author 's writing style carries you through the journey and technical detail with commendable pace and his footplate experience is clearly in evidence .

source_bert_toks: the author ' s writing style carries you through the journey and technical detail with com ##men ##dable pace and his foot ##plate experience is clearly in evidence .

reference_raw: The writing style of the author will carry you through the journey and the technical details with an admirable pace, and his record experience is clearly evidenced.

reference_spacy_tokens: The writing style of the author will carry you through the journey and the technical details with an admirable pace , and his record experience is clearly evidenced .


fn_spacy_tokens_for_baseline: Another accuses his dad of being a bit stingy .

source_bert_toks: another accuse ##s his dad of being a bit sting ##y .

reference_raw: Another accuses his father of being a little prickly.

reference_spacy_tokens: Another accuses his father of being a little prickly .


fn_spacy_tokens_for_baseline: Every week their sleep was rationed on two nights to between 0 and 7.5 hours , and they spent the subsequent days being tested in the laboratory on vigilance and adding tasks .

source_bert_toks: every week their sleep was ratio ##ned on two nights to between 0 and 7 . 5 hours , and they spent the subsequent days being tested in the laboratory on vi ##gil ##ance and adding tasks .

reference_raw: Each week their sleep was rationed for two nights to between 0 and 7.5 hours, and they spent the next few days being examined in the lab for vigilance and additional tasks.

reference_spacy_tokens: Each week their sleep was rationed for two nights to between 0 and 7.5 hours , and they spent the next few days being examined in the lab for vigilance and additional tasks .


fn_spacy_tokens_for_baseline: These dogs have good hearing and scenting ability and are able to locate rabbits and ferrets and indeed any commotion that occurs underground .

source_bert_toks: these dogs have good hearing and scent ##ing ability and are able to locate rabbits and fe ##rret ##s and indeed any commotion that occurs underground .

reference_raw: These dogs have good hearing and aroma and are able to find rabbits and ferrets and even any commotion that goes underground.

reference_spacy_tokens: These dogs have good hearing and aroma and are able to find rabbits and ferrets and even any commotion that goes underground .


fn_spacy_tokens_for_baseline: Les and Peg seemed to have uncovered a simple truth which has evaded so many of us .

source_bert_toks: les and peg seemed to have uncovered a simple truth which has evade ##d so many of us .

reference_raw: Les and Peg seemed to have discovered the simple truth that had escaped so many of us.

reference_spacy_tokens: Les and Peg seemed to have discovered the simple truth that had escaped so many of us .


fn_spacy_tokens_for_baseline: Putin signed the International Convention for the Suppression of Acts of Nuclear Terrorism in New York on September 14 , 2005 .

source_bert_toks: putin signed the international convention for the suppression of acts of nuclear terrorism in new york on september 14 , 2005 .

reference_raw: On September 14, 2005, Putin signed an international agreement on the suppression of acts of nuclear terrorism in New York.

reference_spacy_tokens: On September 14 , 2005 , Putin signed an international agreement on the suppression of acts of nuclear terrorism in New York .


fn_spacy_tokens_for_baseline: Finally I was left in doubt as to whether it was animal or human .

source_bert_toks: finally i was left in doubt as to whether it was animal or human .

reference_raw: In the end, I was left in doubt as to whether it was a beast or a man.

reference_spacy_tokens: In the end , I was left in doubt as to whether it was a beast or a man .


fn_spacy_tokens_for_baseline: For ten minutes I vomited elaborately , with steamhammer convulsions that I had no strength to resist or contain .

source_bert_toks: for ten minutes i vomit ##ed elaborate ##ly , with steam ##hammer con ##vu ##ls ##ions that i had no strength to resist or contain .

reference_raw: For ten minutes I threw up elaborately, with steam-hammer spasms that I had no strength to resist or contain.

reference_spacy_tokens: For ten minutes I threw up elaborately , with steam - hammer spasms that I had no strength to resist or contain .


fn_spacy_tokens_for_baseline: Additionally , personnel from Saghand University cooperate with AEOI staff to conduct research in mining and milling of uranium at BHRC laboratories .

source_bert_toks: additionally , personnel from sa ##ghan ##d university cooperate with ae ##oi staff to conduct research in mining and milling of uranium at b ##hr ##c laboratories .

reference_raw: In addition, Saghand University staff work with AEOI staff to conduct uranium mining and milling research in the BHRC laboratories.

reference_spacy_tokens: In addition , Saghand University staff work with AEOI staff to conduct uranium mining and milling research in the BHRC laboratories .


fn_spacy_tokens_for_baseline: The traditionally parsimonious Florentines , always depressed by the appearance of the Boboli Gardens , are furious about the forthcoming entry charge ( L2000 is rumoured as likely ) in spite of vaunted annual concessions for residents .

source_bert_toks: the traditionally par ##si ##mon ##ious fl ##ore ##ntine ##s , always depressed by the appearance of the bobo ##li gardens , are furious about the forthcoming entry charge ( l ##200 ##0 is rum ##oured as likely ) in spite of va ##unt ##ed annual concessions for residents .

reference_raw: Traditionally parsimonious Florentines, always depressed by the appearance of the Boboli Gardens, are furious with the upcoming entry fee (L2000 is said to be likely) despite the vaunted annual concessions granted to residents.

reference_spacy_tokens: Traditionally parsimonious Florentines , always depressed by the appearance of the Boboli Gardens , are furious with the upcoming entry fee ( L2000 is said to be likely ) despite the vaunted annual concessions granted to residents .


fn_spacy_tokens_for_baseline: Artefacts , that is objects that were produced in the past , have great value for the teaching of history .

source_bert_toks: artefacts , that is objects that were produced in the past , have great value for the teaching of history .

reference_raw: Artefacts, i.e. objects that have been created in the past, are very valuable in teaching history.

reference_spacy_tokens: Artefacts , i.e. objects that have been created in the past , are very valuable in teaching history .


fn_spacy_tokens_for_baseline: If you encounter difficulties in this respect , do not hesitate to seek the advice of an animal behaviourist , since individual cases may benefit immensely from specific advice .

source_bert_toks: if you encounter difficulties in this respect , do not hesitate to seek the advice of an animal behaviour ##ist , since individual cases may benefit immensely from specific advice .

reference_raw: If you experience difficulties in this regard, do not hesitate to seek the advice of an animal behaviourist, as specific advice can be very useful on a case-by-case basis.

reference_spacy_tokens: If you experience difficulties in this regard , do not hesitate to seek the advice of an animal behaviourist , as specific advice can be very useful on a case - by - case basis .


fn_spacy_tokens_for_baseline: This means that Iran will place the Natanz facility , and any enriched uranium it produces , under IAEA inspection but that , as long as no nuclear materials are present , the IAEA would have no ability to examine locations in Iran where it believed nuclear weapons design research might be under way .

source_bert_toks: this means that iran will place the nat ##an ##z facility , and any enriched uranium it produces , under ia ##ea inspection but that , as long as no nuclear materials are present , the ia ##ea would have no ability to examine locations in iran where it believed nuclear weapons design research might be under way .

reference_raw: This means that Iran will place the Natanz facility and any enriched uranium it produces under the control of the IAEA, but that until there is no nuclear material, the IAEA will not be able to examine the locations in Iran where it believes that research on the development of nuclear weapons may be ongoing.

reference_spacy_tokens: This means that Iran will place the Natanz facility and any enriched uranium it produces under the control of the IAEA , but that until there is no nuclear material , the IAEA will not be able to examine the locations in Iran where it believes that research on the development of nuclear weapons may be ongoing .


fn_spacy_tokens_for_baseline: Almost half of Ireland 's population is under twenty - five , and with its universities and professional schools , Dublin also has a large student population .

source_bert_toks: almost half of ireland ' s population is under twenty - five , and with its universities and professional schools , dublin also has a large student population .

reference_raw: Nearly half of the Irish population is under twenty-five, and Dublin also has a large student population with its universities and professional schools.

reference_spacy_tokens: Nearly half of the Irish population is under twenty - five , and Dublin also has a large student population with its universities and professional schools .


fn_spacy_tokens_for_baseline: But there was a secret smile beneath the bland expression , and she worried about his intentions , feeling in her heart that she could never entirely trust Lucenzo .

source_bert_toks: but there was a secret smile beneath the bland expression , and she worried about his intentions , feeling in her heart that she could never entirely trust luce ##nzo .

reference_raw: But there was a secret smile under his expressionless expression, and she was worried about his intentions, and she felt in her heart that she could never quite believe Lucenzo.

reference_spacy_tokens: But there was a secret smile under his expressionless expression , and she was worried about his intentions , and she felt in her heart that she could never quite believe Lucenzo .


fn_spacy_tokens_for_baseline: In some cases , transcription factors may bind cooperatively to adjacent DNA sites via direct physical interaction [ 3 4]. In other cases , multiple transcription factors that bind independently may recruit a common co - activator [ 5 ] , or may act independently of one another to alter gene expression in response to distinct cellular cues [ 6]. Recent studies have also suggested that nearby transcription factors may collaboratively compete with nucleosomes , thus enhancing the binding of individual transcription factors [ 7 8]. Many experiments in yeast have shown that specific pairs of factors must be bound near each other for multifactorial regulation to occur [ 7 8 9 10 ] , and it is on these spatial constraints that we focus here .

source_bert_toks: in some cases , transcription factors may bind cooperative ##ly to adjacent dna sites via direct physical interaction [ 3 4 ] . in other cases , multiple transcription factors that bind independently may recruit a common co - act ##iva ##tor [ 5 ] , or may act independently of one another to alter gene expression in response to distinct cellular cues [ 6 ] . recent studies have also suggested that nearby transcription factors may collaborative ##ly compete with nu ##cle ##oso ##mes , thus enhancing the binding of individual transcription factors [ 7 8 ] . many experiments in yeast have shown that specific pairs of factors must be bound near each other for multi ##fa ##ctor ##ial regulation to occur [ 7 8 9 10 ] , and it is on these spatial constraints that we focus here .

reference_raw: In some cases, transcription factors may co-operate with adjacent DNA sites through direct physical interaction [34]. In other cases, multiple transcription factors that bind independently may recruit a joint co-activator [5] or act independently of each other to change the gene expression in response to different cellular patterns [6] Recent studies have also suggested that close transcription factors may collaboratively compete with nucleosomes, thereby increasing the binding of individual transcriptions. Factors [7 8]. Many experiments in the yeast show that certain pairs of factors must be bound close to each other in order for multifactorial regulation to occur [7 8 9 10], and we focus on these spatial limitations.

reference_spacy_tokens: In some cases , transcription factors may co - operate with adjacent DNA sites through direct physical interaction [ 34]. In other cases , multiple transcription factors that bind independently may recruit a joint co - activator [ 5 ] or act independently of each other to change the gene expression in response to different cellular patterns [ 6 ] Recent studies have also suggested that close transcription factors may collaboratively compete with nucleosomes , thereby increasing the binding of individual transcriptions . Factors [ 7 8]. Many experiments in the yeast show that certain pairs of factors must be bound close to each other in order for multifactorial regulation to occur [ 7 8 9 10 ] , and we focus on these spatial limitations .


fn_spacy_tokens_for_baseline: The minister who has a personal website on the internet , further said that he wanted Dubai to become the best place in the world for the advanced ( hitech ) technological companies .

source_bert_toks: the minister who has a personal website on the internet , further said that he wanted dubai to become the best place in the world for the advanced ( hit ##ech ) technological companies .

reference_raw: The Minister, who had a personal website online, also said that he wanted Dubai to be the world's greatest place for modern (hitech) technology companies.

reference_spacy_tokens: The Minister , who had a personal website online , also said that he wanted Dubai to be the world 's greatest place for modern ( hitech ) technology companies .


fn_spacy_tokens_for_baseline: ' You 're all so smug you repel me .

source_bert_toks: ' you ' re all so smug you rep ##el me .

reference_raw: 'You are all so arrogant that you repulse me.

reference_spacy_tokens: ' You are all so arrogant that you repulse me .


fn_spacy_tokens_for_baseline: The demolition squad from No.6 Troop were blowing up the guns , four Belgian 75 mm field pieces , their wheels shackled to turntables for anti - ship fire .

source_bert_toks: the demolition squad from no . 6 troop were blowing up the guns , four belgian 75 ##mm field pieces , their wheels shack ##led to turn ##table ##s for anti - ship fire .

reference_raw: The demolition squad of Unit No.6 blew up their weapons, four Belgian 75-mm field-pieces, their wheels chained to turntables for anti-ship fire.

reference_spacy_tokens: The demolition squad of Unit No.6 blew up their weapons , four Belgian 75-mm field - pieces , their wheels chained to turntables for anti - ship fire .


fn_spacy_tokens_for_baseline: Whip up this delicious sweet in five minutes and see Hubby 's eyes sparkle . '

source_bert_toks: whip up this delicious sweet in five minutes and see hub ##by ' s eyes sparkle . '

reference_raw: "Whip this delicious sweet in five minutes and see the sparkle in Hubby's eyes."

reference_spacy_tokens: " Whip this delicious sweet in five minutes and see the sparkle in Hubby 's eyes . "


fn_spacy_tokens_for_baseline: Sandinistas Thomas Borge and the Ortega brothers are Castro proteges ; he backed their takeover of Nicaragua .

source_bert_toks: sand ##ini ##sta ##s thomas borg ##e and the ortega brothers are castro protege ##s ; he backed their takeover of nicaragua .

reference_raw: Sandinistas Thomas Borge and the Ortega brothers are protégés of Castro; he supported their takeover of Nicaragua.

reference_spacy_tokens: Sandinistas Thomas Borge and the Ortega brothers are proteges of Castro ; he supported their takeover of Nicaragua .


fn_spacy_tokens_for_baseline: The air was heavy with incense from the many swinging censers .

source_bert_toks: the air was heavy with incense from the many swinging ce ##nse ##rs .

reference_raw: The air was heavy with the incense of many swinging censors.

reference_spacy_tokens: The air was heavy with the incense of many swinging censors .


fn_spacy_tokens_for_baseline: We have cooperated with the IAEA based on the safeguards and we will continue to do so in the framework of cooperation and treaties , " said a senior Iranian diplomat in Tehran .

source_bert_toks: we have cooperate ##d with the ia ##ea based on the safeguard ##s and we will continue to do so in the framework of cooperation and treaties , " said a senior iranian diplomat in tehran .

reference_raw: We have cooperated with the IAEA on the basis of security measures and will continue to do so in the framework of cooperation and agreements,' said one of the leading Iranian diplomats in Tehran.

reference_spacy_tokens: We have cooperated with the IAEA on the basis of security measures and will continue to do so in the framework of cooperation and agreements , ' said one of the leading Iranian diplomats in Tehran .


fn_spacy_tokens_for_baseline: The Crown , niggardly with salaries , was often generous with occasional douceurs and indirect payments .

source_bert_toks: the crown , ni ##gga ##rd ##ly with salaries , was often generous with occasional do ##uce ##urs and indirect payments .

reference_raw: The crown, black with wages, was often generous with occasional douceurs and indirect payments.

reference_spacy_tokens: The crown , black with wages , was often generous with occasional douceurs and indirect payments .


fn_spacy_tokens_for_baseline: But a religious court convicted him of using insulting language and ordered 50 lashes with a 6 ft bamboo cane .

source_bert_toks: but a religious court convicted him of using insulting language and ordered 50 lashes with a 6 ##ft bamboo cane .

reference_raw: But the religious court sentenced him to use offensive language and ordered 50 whips with the 6th bamboo stick.

reference_spacy_tokens: But the religious court sentenced him to use offensive language and ordered 50 whips with the 6th bamboo stick .


fn_spacy_tokens_for_baseline: SHARES in holiday groups Airtours and Owners Abroad surged as newly confident Brits shook off recession blues and started poring over travel brochures .

source_bert_toks: shares in holiday groups air ##tour ##s and owners abroad surged as newly confident brit ##s shook off recession blues and started por ##ing over travel bro ##chu ##res .

reference_raw: SHARES in holiday groups Airtours and owners Abroad surged as the newly-confident British shook off the recession blues and began pouring through travel brochures.

reference_spacy_tokens: SHARES in holiday groups Airtours and owners Abroad surged as the newly - confident British shook off the recession blues and began pouring through travel brochures .


fn_spacy_tokens_for_baseline: The surface was paved with massive stones and on these watery foundations Venice was built -- a floating city !

source_bert_toks: the surface was paved with massive stones and on these watery foundations venice was built - - a floating city !

reference_raw: The surface was covered with massive stones, and Venice was built on these watery foundations - a floating city!

reference_spacy_tokens: The surface was covered with massive stones , and Venice was built on these watery foundations - a floating city !


fn_spacy_tokens_for_baseline: The idea is , I 'll present it you and you you can I wo n't try and astound you with it because it is hard to do that under these contexts .

source_bert_toks: the idea is , i ' ll present it you and you you can i won ' t try and as ##tou ##nd you with it because it is hard to do that under these contexts .

reference_raw: The point is, I'm going to give it to you, and you can I'm not going to try to impress you, because it's hard to do it in these circumstances.

reference_spacy_tokens: The point is , I 'm going to give it to you , and you can I 'm not going to try to impress you , because it 's hard to do it in these circumstances .


fn_spacy_tokens_for_baseline: Muslim human rights activists and Mbugua Mureithi , a lawyer for three of the suspects , who were sent to Uganda in late July , accused the police of bypassing normal procedures in the transfer .

source_bert_toks: muslim human rights activists and mb ##ug ##ua mu ##re ##ith ##i , a lawyer for three of the suspects , who were sent to uganda in late july , accused the police of bypass ##ing normal procedures in the transfer .

reference_raw: Muslim human rights activists and Mbugua Mureithi, lawyer of three suspects who were sent to Uganda at the end of July, accused the police of circumventing normal transfer procedures.

reference_spacy_tokens: Muslim human rights activists and Mbugua Mureithi , lawyer of three suspects who were sent to Uganda at the end of July , accused the police of circumventing normal transfer procedures .


fn_spacy_tokens_for_baseline: The release of nerve gas on the Tokyo subway by a Japanese cult on March 20 , 1995 , the terrorist attacks of September 11 , 2001 , and the sending of anthrax - tainted letters have made policymakers and the general public concerned that terrorists could use chemical or biological weapons ( CBW ) to inflict mass casualties .

source_bert_toks: the release of nerve gas on the tokyo subway by a japanese cult on march 20 , 1995 , the terrorist attacks of september 11 , 2001 , and the sending of ant ##hra ##x - tainted letters have made policy ##makers and the general public concerned that terrorists could use chemical or biological weapons ( cb ##w ) to in ##flict mass casualties .

reference_raw: The release of nerve gas on the Tokyo Metro by Japan's cult on March 20, 1995, the terrorist attacks of September 11, 2001, and the sending of anthrax-tainted letters have led politicians and the general public concerned to believe that terrorists could use chemical or biological weapons (CBW) to cause mass casualties.

reference_spacy_tokens: The release of nerve gas on the Tokyo Metro by Japan 's cult on March 20 , 1995 , the terrorist attacks of September 11 , 2001 , and the sending of anthrax - tainted letters have led politicians and the general public concerned to believe that terrorists could use chemical or biological weapons ( CBW ) to cause mass casualties .


fn_spacy_tokens_for_baseline: They may giggle and act as though they have not a serious thought in their heads , but they know exactly what they are up to .

source_bert_toks: they may giggle and act as though they have not a serious thought in their heads , but they know exactly what they are up to .

reference_raw: They can laugh and act like they don't think seriously, but they know exactly what they're up to.

reference_spacy_tokens: They can laugh and act like they do n't think seriously , but they know exactly what they 're up to .


fn_spacy_tokens_for_baseline: In their December , 1995 review of the nation 's best charities , U.S. News and World Report called Goodwill one of the five " Standout Good Guys . "

source_bert_toks: in their december , 1995 review of the nation ' s best charities , u . s . news and world report called goodwill one of the five " stand ##out good guys . "

reference_raw: In November, 1995, a review of the nation's finest charities, the American News and the World Report called Goodwill one of the five "Standout Good Men."

reference_spacy_tokens: In November , 1995 , a review of the nation 's finest charities , the American News and the World Report called Goodwill one of the five " Standout Good Men . "


fn_spacy_tokens_for_baseline: Colleagues described Dorrance as a gentlemanly , compassionate man with a lot of moral commitment .

source_bert_toks: colleagues described do ##rran ##ce as a gentleman ##ly , compassionate man with a lot of moral commitment .

reference_raw: The colleagues described Dorrance as a gentlemanly, sympathetic man with a great deal of moral commitment.

reference_spacy_tokens: The colleagues described Dorrance as a gentlemanly , sympathetic man with a great deal of moral commitment .


fn_spacy_tokens_for_baseline: Jelka went across and knelt over her , letting her hand rest on the woman 's arm .

source_bert_toks: je ##lka went across and knelt over her , letting her hand rest on the woman ' s arm .

reference_raw: Jelka crossed to her, dropped to her knees, and rested her hand on the woman's arm.

reference_spacy_tokens: Jelka crossed to her , dropped to her knees , and rested her hand on the woman 's arm .


fn_spacy_tokens_for_baseline: Nick 's pale face glimmered as he looked up at her .

source_bert_toks: nick ' s pale face g ##lim ##mere ##d as he looked up at her .

reference_raw: Nick's pale face flashed as he looked up at her.

reference_spacy_tokens: Nick 's pale face flashed as he looked up at her .


fn_spacy_tokens_for_baseline: Engineers are putting the finishing touches to a roomful of scientific equipment in Oxford which will use a new technique to measure the amount of radioactive carbon in an ancient specimen .

source_bert_toks: engineers are putting the finishing touches to a room ##ful of scientific equipment in oxford which will use a new technique to measure the amount of radioactive carbon in an ancient specimen .

reference_raw: Engineers put the finishing touches in a room full of scientific equipment at Oxford, using a new technique to measure the amount of radioactive carbon in an ancient sample.

reference_spacy_tokens: Engineers put the finishing touches in a room full of scientific equipment at Oxford , using a new technique to measure the amount of radioactive carbon in an ancient sample .


fn_spacy_tokens_for_baseline: His name was Mr Moule and , being a reverend , was promptly christened , ' Holy Moly ' by all the children .

source_bert_toks: his name was mr mo ##ule and , being a reverend , was promptly christ ##ened , ' holy mo ##ly ' by all the children .

reference_raw: His name was Mr. Moule, and since he was a reverend, he was immediately baptized by all the children, "Holy Moly."

reference_spacy_tokens: His name was Mr. Moule , and since he was a reverend , he was immediately baptized by all the children , " Holy Moly . "


fn_spacy_tokens_for_baseline: The story of the Nez Perce struggle to defend their ancient homeland is one of the most outstanding in American history .

source_bert_toks: the story of the ne ##z per ##ce struggle to defend their ancient homeland is one of the most outstanding in american history .

reference_raw: The story of the Nez Perce struggle to defend their old country is one of the best in American history.

reference_spacy_tokens: The story of the Nez Perce struggle to defend their old country is one of the best in American history .


fn_spacy_tokens_for_baseline: She sounded really respectful and seemed to have the greatest reverence for that ancient custom .

source_bert_toks: she sounded really respectful and seemed to have the greatest rev ##erence for that ancient custom .

reference_raw: She sounded very respectful, and she seemed to have the greatest respect for this ancient habit.

reference_spacy_tokens: She sounded very respectful , and she seemed to have the greatest respect for this ancient habit .


fn_spacy_tokens_for_baseline: No one was sure whether he had deliberately set a trap , or whether it was merely a chance remark that brought about such astounding results .

source_bert_toks: no one was sure whether he had deliberately set a trap , or whether it was merely a chance remark that brought about such as ##tou ##nding results .

reference_raw: No one was sure that he had deliberately set a trap, or that it was merely a random remark that had produced such astonishing results.

reference_spacy_tokens: No one was sure that he had deliberately set a trap , or that it was merely a random remark that had produced such astonishing results .


fn_spacy_tokens_for_baseline: Once she had stripped off her top clothes she slapped the monitor pads on and connected up the leads .

source_bert_toks: once she had stripped off her top clothes she slapped the monitor pads on and connected up the leads .

reference_raw: As soon as she undressed her top clothes, she slapped on the monitor pads and hooked up the leads.

reference_spacy_tokens: As soon as she undressed her top clothes , she slapped on the monitor pads and hooked up the leads .


fn_spacy_tokens_for_baseline: We must have been right out in the sticks .

source_bert_toks: we must have been right out in the sticks .

reference_raw: We had to be right on the poles.

reference_spacy_tokens: We had to be right on the poles .


fn_spacy_tokens_for_baseline: Colin and Eamon Meehan claimed that they were not guilty of trying to buy weapons in the US for the Provisional IRA because their internment by the British in the 1970s drove them insane .

source_bert_toks: colin and ea ##mon me ##ehan claimed that they were not guilty of trying to buy weapons in the us for the provisional ira because their internment by the british in the 1970s drove them insane .

reference_raw: Colin and Eamon Meehan claimed that they were innocent of trying to buy weapons in the United States for the Provisional IRA, because their internship with the British in the 1970s drove them mad.

reference_spacy_tokens: Colin and Eamon Meehan claimed that they were innocent of trying to buy weapons in the United States for the Provisional IRA , because their internship with the British in the 1970s drove them mad .


fn_spacy_tokens_for_baseline: Sometimes , he knew , she would bruise herself with a rock to get morph - plus out of him .

source_bert_toks: sometimes , he knew , she would bruise herself with a rock to get mor ##ph - plus out of him .

reference_raw: Sometimes, he knew, she'd cut herself with a stone to get the morph-plus out of him.

reference_spacy_tokens: Sometimes , he knew , she 'd cut herself with a stone to get the morph - plus out of him .


fn_spacy_tokens_for_baseline: We had a roll call just after dinner once , and the sergeant - major got to a bloke whose monicker was Rafferty .

source_bert_toks: we had a roll call just after dinner once , and the sergeant - major got to a b ##lok ##e whose mon ##ick ##er was raf ##fer ##ty .

reference_raw: One time we got a roll call just after dinner, and the sergeant-major got to a guy whose nickname was Rafferty.

reference_spacy_tokens: One time we got a roll call just after dinner , and the sergeant - major got to a guy whose nickname was Rafferty .


fn_spacy_tokens_for_baseline: Imagine how much time and effort would be required if each speaker had to establish the denotation of each term he produced on each occasion of use .

source_bert_toks: imagine how much time and effort would be required if each speaker had to establish the den ##ota ##tion of each term he produced on each occasion of use .

reference_raw: Imagine how much time and effort it would take each speaker to determine the description of each term he produces every time he uses it.

reference_spacy_tokens: Imagine how much time and effort it would take each speaker to determine the description of each term he produces every time he uses it .


fn_spacy_tokens_for_baseline: In general , these groups are more prepared to inflict indiscriminate casualties because they are not driven by specific political goals but rather by irrational belief systems , extremist ideologies ( such as neo - Nazism ) , apocalyptic prophecy ( predicting the end of the world ) , or religious fundamentalism .

source_bert_toks: in general , these groups are more prepared to in ##flict ind ##is ##cr ##imi ##nate casualties because they are not driven by specific political goals but rather by irrational belief systems , ex ##tre ##mist id ##eo ##logies ( such as neo - nazis ##m ) , apocalyptic prophecy ( predicting the end of the world ) , or religious fundamental ##ism .

reference_raw: In general, these groups are more prepared to inflict indiscriminate losses because they are not guided by specific political objectives, but by irrational belief systems, extremist ideologies (such as neo-Nazism), apocalyptic prophecy (predicting the end of the world), or religious fundamentalism.

reference_spacy_tokens: In general , these groups are more prepared to inflict indiscriminate losses because they are not guided by specific political objectives , but by irrational belief systems , extremist ideologies ( such as neo - Nazism ) , apocalyptic prophecy ( predicting the end of the world ) , or religious fundamentalism .


fn_spacy_tokens_for_baseline: Cinzia brought them both large measures of whisky and sat down astride the wicker chair in front of the writing desk , facing him over the ridged wooden back . < pb n=170 >

source_bert_toks: ci ##nz ##ia brought them both large measures of whisky and sat down astrid ##e the wi ##cker chair in front of the writing desk , facing him over the ridge ##d wooden back . < p ##b n = 170 >

reference_raw: Cinzia brought them both a large measure of whiskey and sat down on the wicker chair in front of the desk, facing him across the ridged wooden back. <pb n=170>

reference_spacy_tokens: Cinzia brought them both a large measure of whiskey and sat down on the wicker chair in front of the desk , facing him across the ridged wooden back . < pb n=170 >


fn_spacy_tokens_for_baseline: This wicker hamper is packed with delicious goodies and costs £ 64.92 , inclusive of nationwide delivery .

source_bert_toks: this wi ##cker ham ##per is packed with delicious good ##ies and costs £ ##64 . 92 , inclusive of nationwide delivery .

reference_raw: This wicker basket is full of delicious goods and costs £64.92, including national delivery.

reference_spacy_tokens: This wicker basket is full of delicious goods and costs £ 64.92 , including national delivery .


fn_spacy_tokens_for_baseline: Amounts are converted at $ 0.77 to the Canadian dollar .

source_bert_toks: amounts are converted at $ 0 . 77 to the canadian dollar .

reference_raw: The amount is transferred to the Canadian dollar at $0.77.

reference_spacy_tokens: The amount is transferred to the Canadian dollar at $ 0.77 .


fn_spacy_tokens_for_baseline: The motel ridge , made of fortress rock , sits pretty on the edge of the mire .

source_bert_toks: the motel ridge , made of fortress rock , sits pretty on the edge of the mir ##e .

reference_raw: A motel ridge, made of fort rock, sits beautifully on the edge of the mud.

reference_spacy_tokens: A motel ridge , made of fort rock , sits beautifully on the edge of the mud .


fn_spacy_tokens_for_baseline: Only a year after the invention of balloons , a book was written describing a voyage , by balloon , to the newly discovered planet Uranus .

source_bert_toks: only a year after the invention of balloons , a book was written describing a voyage , by balloon , to the newly discovered planet ur ##anus .

reference_raw: Only a year after the balloons were invented, a book was written describing a balloon voyage to the newly discovered planet Uranus.

reference_spacy_tokens: Only a year after the balloons were invented , a book was written describing a balloon voyage to the newly discovered planet Uranus .


fn_spacy_tokens_for_baseline: And even the most hardened cynic must agree that lying down with your eyes closed listening to music is a lot more appealing than grunting and straining over a set of weights in your local sports centre .

source_bert_toks: and even the most hardened cy ##nic must agree that lying down with your eyes closed listening to music is a lot more appealing than grunt ##ing and straining over a set of weights in your local sports centre .

reference_raw: Even the toughest cynics have to agree that lying down with their eyes closed and listening to music is much more appealing than grumbling and straining over the weight of your local sports center.

reference_spacy_tokens: Even the toughest cynics have to agree that lying down with their eyes closed and listening to music is much more appealing than grumbling and straining over the weight of your local sports center .


fn_spacy_tokens_for_baseline: RICHMOND , Virginia ( AP ) --- Besieged by intractable depression , Don Loving cinched a bed sheet around his neck and tied the other end to a mirror mount on the ceiling of his hospital room .

source_bert_toks: richmond , virginia ( ap ) - - - besieged by intra ##ctable depression , don loving ci ##nched a bed sheet around his neck and tied the other end to a mirror mount on the ceiling of his hospital room .

reference_raw: RICHMOND, Virginia (AP) - Besieged by intractable depression, Don Loving put a blanket around his neck and tied the other end to a mirror mount on the ceiling of his hospital room.

reference_spacy_tokens: RICHMOND , Virginia ( AP ) - Besieged by intractable depression , Don Loving put a blanket around his neck and tied the other end to a mirror mount on the ceiling of his hospital room .


fn_spacy_tokens_for_baseline: Cindy is said to have been spurred on to achieve by the death of her four - year - old brother Jeff , a leukaemia victim .

source_bert_toks: cindy is said to have been spurred on to achieve by the death of her four - year - old brother jeff , a le ##uka ##emia victim .

reference_raw: They say Cindy was motivated to do so by the death of her four-year-old brother, Jeff, the victim of leukemia.

reference_spacy_tokens: They say Cindy was motivated to do so by the death of her four - year - old brother , Jeff , the victim of leukemia .


fn_spacy_tokens_for_baseline: how 'd you win radio contests

source_bert_toks: how ' d you win radio contests

reference_raw: how did you get the radio competition?

reference_spacy_tokens: how did you get the radio competition ?


fn_spacy_tokens_for_baseline: Financial institutions , he feels , would be deserted by their private clients while companies would lose international work on sheer emotional grounds .

source_bert_toks: financial institutions , he feels , would be deserted by their private clients while companies would lose international work on sheer emotional grounds .

reference_raw: They believe that financial corporations would be abandoned by their private clients, while companies would lose international jobs for purely emotional reasons.

reference_spacy_tokens: They believe that financial corporations would be abandoned by their private clients , while companies would lose international jobs for purely emotional reasons .


fn_spacy_tokens_for_baseline: A friend of mine was in an underground computer center in downtown SF when the quake hit .

source_bert_toks: a friend of mine was in an underground computer center in downtown sf when the quake hit .

reference_raw: My friend was at an underground computer center in downtown SF when the earthquake hit.

reference_spacy_tokens: My friend was at an underground computer center in downtown SF when the earthquake hit .


fn_spacy_tokens_for_baseline: Change hands , push to where you were sitting , crouch in the middle of the boat and straighten up on the new course .

source_bert_toks: change hands , push to where you were sitting , crouch in the middle of the boat and straighten up on the new course .

reference_raw: Change your hands, push to where you've been sitting, get in the middle of the boat, and get up on a new course.

reference_spacy_tokens: Change your hands , push to where you 've been sitting , get in the middle of the boat , and get up on a new course .


fn_spacy_tokens_for_baseline: Rep. Tony Hall , D- Ohio , did not call for a lifting of sanctions imposed on Iraq for its 1990 invasion of Kuwait , but said the United Nations should make sure that sanctions do not hurt innocent Iraqis .

source_bert_toks: rep . tony hall , d - ohio , did not call for a lifting of sanctions imposed on iraq for its 1990 invasion of kuwait , but said the united nations should make sure that sanctions do not hurt innocent iraqi ##s .

reference_raw: Deputy Tony Hall, D-Ohio, did not call for the abolition of sanctions imposed on Iraq for the invasion of Kuwait in 1990, but said that the United Nations should ensure that sanctions do not harm innocent Iraqis.

reference_spacy_tokens: Deputy Tony Hall , D - Ohio , did not call for the abolition of sanctions imposed on Iraq for the invasion of Kuwait in 1990 , but said that the United Nations should ensure that sanctions do not harm innocent Iraqis .


fn_spacy_tokens_for_baseline: A transition is currently underway from relatively inaccurate , liquid - fueled , silo / cave - based missiles ( DF-3 , DF -4 , DF -5 ) to more accurate , solid - fueled , mobile missiles ( DF-11 , DF-15 , and DF-21 , and a new ICBM [ the DF-31 ] and SLBM [ the JL-2 ] , which are currently under development ) .

source_bert_toks: a transition is currently underway from relatively inaccurate , liquid - fueled , si ##lo / cave - based missiles ( d ##f - 3 , d ##f - 4 , d ##f - 5 ) to more accurate , solid - fueled , mobile missiles ( d ##f - 11 , d ##f - 15 , and d ##f - 21 , and a new ic ##bm [ the d ##f - 31 ] and sl ##bm [ the j ##l - 2 ] , which are currently under development ) .

reference_raw: The transition from relatively imprecisive, liquid-fuelled, silicon/cave-based missiles (DF-3, DF-4, DF-5) to more accurate, solid-fuelled, mobile missiles (DF-11, DF-15, DF-21, and the new ICBM [DF-31] and SLBM [JL-2] currently under development).

reference_spacy_tokens: The transition from relatively imprecisive , liquid - fuelled , silicon / cave - based missiles ( DF-3 , DF-4 , DF-5 ) to more accurate , solid - fuelled , mobile missiles ( DF-11 , DF-15 , DF-21 , and the new ICBM [ DF-31 ] and SLBM [ JL-2 ] currently under development ) .


fn_spacy_tokens_for_baseline: The pinched woman in a pink overall and blue mittens in the ticket office squinted at our passes and nodded us on .

source_bert_toks: the pinched woman in a pink overall and blue mit ##tens in the ticket office squinted at our passes and nodded us on .

reference_raw: The pinched woman in the pink overalls and blue gloves of the ticket office squinted at our tickets and nodded.

reference_spacy_tokens: The pinched woman in the pink overalls and blue gloves of the ticket office squinted at our tickets and nodded .


fn_spacy_tokens_for_baseline: We know he 's a heroin addict .

source_bert_toks: we know he ' s a heroin addict .

reference_raw: We know he's drugged with heroin.

reference_spacy_tokens: We know he 's drugged with heroin .


fn_spacy_tokens_for_baseline: Sloane Helicopters moved into its prestigious , purpose - built hangar in Sywell in June 1989 .

source_bert_toks: sloane helicopters moved into its prestigious , purpose - built hangar in sy ##well in june 1989 .

reference_raw: In June 1989, Sloane helicopters moved to a prestigious, purpose-built hanger in Sywell.

reference_spacy_tokens: In June 1989 , Sloane helicopters moved to a prestigious , purpose - built hanger in Sywell .


fn_spacy_tokens_for_baseline: He shares A squalid abandoned house on the outskirts of the city with whoever else can find their way in .

source_bert_toks: he shares a sq ##ual ##id abandoned house on the outskirts of the city with whoever else can find their way in .

reference_raw: Shares a squalid, deserted house on the edge of town with anyone else who can find a way in.

reference_spacy_tokens: Shares a squalid , deserted house on the edge of town with anyone else who can find a way in .


fn_spacy_tokens_for_baseline: The discovery of colourants , flavour enhancers and emulsifiers has unfortunately meant that processed and ready made food can contain ingredients of substandard quality and nutritional value .

source_bert_toks: the discovery of colour ##ants , flavour enhance ##rs and em ##uls ##ifiers has unfortunately meant that processed and ready made food can contain ingredients of sub ##stand ##ard quality and nutritional value .

reference_raw: Unfortunately, the discovery of colourants, flavour enhancers and emulsifiers meant that processed and prepared foods may contain ingredients of inferior quality and nutritional value.

reference_spacy_tokens: Unfortunately , the discovery of colourants , flavour enhancers and emulsifiers meant that processed and prepared foods may contain ingredients of inferior quality and nutritional value .


fn_spacy_tokens_for_baseline: The attacker ransacked the house but got away with just £ 60 .

source_bert_toks: the attacker ran ##sack ##ed the house but got away with just £ ##60 .

reference_raw: The assailant searched the house, but escaped with only 60 pounds.

reference_spacy_tokens: The assailant searched the house , but escaped with only 60 pounds .


fn_spacy_tokens_for_baseline: And opened them sharply at an insistent , warning buzz from her duty station .

source_bert_toks: and opened them sharply at an insistent , warning buzz from her duty station .

reference_raw: And she opened it sharply at the insistent, warning hum of her duty station.

reference_spacy_tokens: And she opened it sharply at the insistent , warning hum of her duty station .


fn_spacy_tokens_for_baseline: Ken was n't lonely , but he was a loner .

source_bert_toks: ken wasn ' t lonely , but he was a lone ##r .

reference_raw: Ken was not alone, but alone.

reference_spacy_tokens: Ken was not alone , but alone .


fn_spacy_tokens_for_baseline: Marshall , who gives these facts in his Rural Economy of Norfolk , supposes that three hundred acres of heathland were divided into thirty fields of ten acres each .

source_bert_toks: marshall , who gives these facts in his rural economy of norfolk , suppose ##s that three hundred acres of heath ##land were divided into thirty fields of ten acres each .

reference_raw: Marshall, who presents these facts in the rural economy of Norfolk, assumes that three hundred acres of land were divided into thirty fields of ten acres each.

reference_spacy_tokens: Marshall , who presents these facts in the rural economy of Norfolk , assumes that three hundred acres of land were divided into thirty fields of ten acres each .


fn_spacy_tokens_for_baseline: It is an offence to cause GBH with intent to prevent lawful apprehension .

source_bert_toks: it is an offence to cause gb ##h with intent to prevent lawful apprehension .

reference_raw: The intention of GBH to prevent legal detention is a crime.

reference_spacy_tokens: The intention of GBH to prevent legal detention is a crime .


fn_spacy_tokens_for_baseline: Doctors had been unable to find a pulse as they hurried to their next Medicash - insured mugging victim .

source_bert_toks: doctors had been unable to find a pulse as they hurried to their next med ##ica ##sh - ins ##ured mug ##ging victim .

reference_raw: The doctors couldn't find a pulse as they hurried to their next Medicash-insured assault victim.

reference_spacy_tokens: The doctors could n't find a pulse as they hurried to their next Medicash - insured assault victim .


fn_spacy_tokens_for_baseline: If I go by what is currently in the system as a guide , Pasadena would owe Enron a little over $ 1 mil .

source_bert_toks: if i go by what is currently in the system as a guide , pasadena would owe en ##ron a little over $ 1 mil .

reference_raw: If I follow what's in the system as a guide, Pasadena will owe Enron a little over a million dollars.

reference_spacy_tokens: If I follow what 's in the system as a guide , Pasadena will owe Enron a little over a million dollars .


fn_spacy_tokens_for_baseline: The growing competition in rail transport resulted in Union Pacific buying the Los Angeles - Salt Lake line .

source_bert_toks: the growing competition in rail transport resulted in union pacific buying the los angeles - salt lake line .

reference_raw: The increasing competition in the rail sector has led the Union Pacific to purchase the L.A. - Salt Lake line.

reference_spacy_tokens: The increasing competition in the rail sector has led the Union Pacific to purchase the L.A. - Salt Lake line .


fn_spacy_tokens_for_baseline: This explains the presence in Guangzhou of the Huaisheng Mosque , reputed to be China 's oldest , and traditionally dated a.d . 627 .

source_bert_toks: this explains the presence in guangzhou of the hua ##ish ##eng mosque , reputed to be china ' s oldest , and traditionally dated a . d . 62 ##7 .

reference_raw: That explains the presence of the Huaisheng Mosque in Guangzhou, which is known to be the oldest in China, and which has a tradition of dating A.D. 627.

reference_spacy_tokens: That explains the presence of the Huaisheng Mosque in Guangzhou , which is known to be the oldest in China , and which has a tradition of dating A.D. 627 .


fn_spacy_tokens_for_baseline: Rob looked quite different , dressed in a white dinner - jacket with a dark crimson bow - tie and matching cummerbund .

source_bert_toks: rob looked quite different , dressed in a white dinner - jacket with a dark crimson bow - tie and matching cum ##mer ##bund .

reference_raw: Rob looked quite different, dressed in a white dinner jacket with a dark crimson bow tie and a matching cummerbund.

reference_spacy_tokens: Rob looked quite different , dressed in a white dinner jacket with a dark crimson bow tie and a matching cummerbund .


fn_spacy_tokens_for_baseline: Priests wishing to concelebrate please bring alb and white stole .

source_bert_toks: priests wishing to con ##cel ##eb ##rate please bring al ##b and white stole .

reference_raw: The priests who want to celebrate, please bring the Alba and the White Stealth.

reference_spacy_tokens: The priests who want to celebrate , please bring the Alba and the White Stealth .


fn_spacy_tokens_for_baseline: IN 1984 , when Britain and China initialled their momentous Joint Declaration on the Question of Hong Kong , the colony still had the successful salesman 's ability to counterfeit boundless enthusiasm .

source_bert_toks: in 1984 , when britain and china initial ##led their moment ##ous joint declaration on the question of hong kong , the colony still had the successful salesman ' s ability to counter ##feit bound ##less enthusiasm .

reference_raw: In 1984, when Britain and China initialled their momentous joint statement on Hong Kong's question, the colony still had a successful salesman's ability to falsify boundless enthusiasm.

reference_spacy_tokens: In 1984 , when Britain and China initialled their momentous joint statement on Hong Kong 's question , the colony still had a successful salesman 's ability to falsify boundless enthusiasm .


fn_spacy_tokens_for_baseline: The tent that was discovered had clearly been occupied by Bonington ; it contained his possessions and therefore leaves the possibility that the notebook could have been his as well as Joe 's or Pete 's .

source_bert_toks: the tent that was discovered had clearly been occupied by bon ##ington ; it contained his possessions and therefore leaves the possibility that the notebook could have been his as well as joe ' s or pete ' s .

reference_raw: The tent he had discovered was obviously occupied by Bonington; it contained his property, leaving the possibility that the notebook might be his or Joe's or Pete's.

reference_spacy_tokens: The tent he had discovered was obviously occupied by Bonington ; it contained his property , leaving the possibility that the notebook might be his or Joe 's or Pete 's .


fn_spacy_tokens_for_baseline: A look of determination spread over several faces as they hurtled from side to side , and several comical scenes were witnessed as spinnakers were flown on the downwind run .

source_bert_toks: a look of determination spread over several faces as they hurt ##led from side to side , and several comical scenes were witnessed as spin ##na ##kers were flown on the down ##wind run .

reference_raw: As they raced from side to side, a look of determination spread across several faces, and a few comic scenes were seen as the spinnakers flowed down the wind.

reference_spacy_tokens: As they raced from side to side , a look of determination spread across several faces , and a few comic scenes were seen as the spinnakers flowed down the wind .


fn_spacy_tokens_for_baseline: Small boats came out to the liner , some bearing vendors of coconuts and bananas , others containing friends and relatives who shouted up names to the rail .

source_bert_toks: small boats came out to the liner , some bearing vendors of coconut ##s and bananas , others containing friends and relatives who shouted up names to the rail .

reference_raw: Small boats approached the liner, some bearing coconut and banana sellers, others with friends and relatives shouting names on the rails.

reference_spacy_tokens: Small boats approached the liner , some bearing coconut and banana sellers , others with friends and relatives shouting names on the rails .


fn_spacy_tokens_for_baseline: 1 Boil the rice for 3 minutes in water , then drain .

source_bert_toks: 1 boil the rice for 3 minutes in water , then drain .

reference_raw: 1 The rice is cooked in water for three minutes, then drained.

reference_spacy_tokens: 1 The rice is cooked in water for three minutes , then drained .


fn_spacy_tokens_for_baseline: The party had been held in nearby Lidget Green to celebrate the christening of Zatun 's three - week - old baby .

source_bert_toks: the party had been held in nearby lid ##get green to celebrate the christ ##ening of za ##tu ##n ' s three - week - old baby .

reference_raw: The party was held near Lidget Green to celebrate the baptism of Zatun's three-week-old child.

reference_spacy_tokens: The party was held near Lidget Green to celebrate the baptism of Zatun 's three - week - old child .


fn_spacy_tokens_for_baseline: So far there have been no injuries and no homes have yet been damaged , but one building storing equipment used by firefighters was burned to the ground .

source_bert_toks: so far there have been no injuries and no homes have yet been damaged , but one building storing equipment used by firefighters was burned to the ground .

reference_raw: There have been no injuries so far and no homes have been damaged, but one of the firemen's storage facilities has been burned to the ground.

reference_spacy_tokens: There have been no injuries so far and no homes have been damaged , but one of the firemen 's storage facilities has been burned to the ground .


fn_spacy_tokens_for_baseline: People who are shy of speaking out in front of all the other governors may feel more confident in a sub - committee .

source_bert_toks: people who are shy of speaking out in front of all the other governors may feel more confident in a sub - committee .

reference_raw: People who are ashamed to speak in front of other governors may feel more confident in the subcommittee.

reference_spacy_tokens: People who are ashamed to speak in front of other governors may feel more confident in the subcommittee .


fn_spacy_tokens_for_baseline: American concerns over Iran 's nuclear program intensified in mid - 2002 , when American intelligence learned of the existence of two secret nuclear facilities .

source_bert_toks: american concerns over iran ' s nuclear program intensified in mid - 2002 , when american intelligence learned of the existence of two secret nuclear facilities .

reference_raw: American concerns about Iran's nuclear program intensified in mid-2002, when U.S. Intelligence learned that two secret nuclear facilities existed.

reference_spacy_tokens: American concerns about Iran 's nuclear program intensified in mid-2002 , when U.S. Intelligence learned that two secret nuclear facilities existed .


fn_spacy_tokens_for_baseline: The barmaid humped the suitcase on to the bed .

source_bert_toks: the bar ##maid hum ##ped the suitcase on to the bed .

reference_raw: The bartender hummed the suitcase to the bed.

reference_spacy_tokens: The bartender hummed the suitcase to the bed .


fn_spacy_tokens_for_baseline: O'Connell Street , the city 's grand boulevard , leads north to Parnell Square .

source_bert_toks: o ' connell street , the city ' s grand boulevard , leads north to par ##nell square .

reference_raw: O'Connell Street, the great boulevard of the city, leads north to Parnell Plaza.

reference_spacy_tokens: O'Connell Street , the great boulevard of the city , leads north to Parnell Plaza .


fn_spacy_tokens_for_baseline: ' You oughta be shamed . '

source_bert_toks: ' you ought ##a be shame ##d . '

reference_raw: "You should be ashamed of yourself."

reference_spacy_tokens: " You should be ashamed of yourself . "


fn_spacy_tokens_for_baseline: For the reasons that I have endeavoured to outline , I think that the assistant recorder came to a correct conclusion and I too would dismiss this appeal .

source_bert_toks: for the reasons that i have endeavour ##ed to outline , i think that the assistant recorder came to a correct conclusion and i too would dismiss this appeal .

reference_raw: For the reasons I have tried to outline, I think the assistant recorder has come to the correct conclusion, and I would also dismiss the appeal.

reference_spacy_tokens: For the reasons I have tried to outline , I think the assistant recorder has come to the correct conclusion , and I would also dismiss the appeal .


fn_spacy_tokens_for_baseline: On his head was the horned - moon helm of Saphery and he swiftly took up position between the queen and the Keeper of Secrets .

source_bert_toks: on his head was the horned - moon helm of sap ##her ##y and he swiftly took up position between the queen and the keeper of secrets .

reference_raw: Saphery's horned moon helmet was on his head, and he quickly took up his position between the Queen and the Keeper of Secrets.

reference_spacy_tokens: Saphery 's horned moon helmet was on his head , and he quickly took up his position between the Queen and the Keeper of Secrets .


fn_spacy_tokens_for_baseline: There were three men -- Han , dressed in dark silks with blood - red headbands about their foreheads .

source_bert_toks: there were three men - - han , dressed in dark silk ##s with blood - red head ##band ##s about their forehead ##s .

reference_raw: There were three men -- Han, dressed in dark silk, with blood-red bands around his brows.

reference_spacy_tokens: There were three men -- Han , dressed in dark silk , with blood - red bands around his brows .


fn_spacy_tokens_for_baseline: A persistent downpour at the track rapidly reduced the going from good to firm to soft , a change which could threaten the participation of Royal Ballerina .

source_bert_toks: a persistent down ##pour at the track rapidly reduced the going from good to firm to soft , a change which could threaten the participation of royal ball ##erina .

reference_raw: The steady rain on the track quickly reduced the transition from good to firm to soft, a change that could threaten Royal Ballerina's participation.

reference_spacy_tokens: The steady rain on the track quickly reduced the transition from good to firm to soft , a change that could threaten Royal Ballerina 's participation .


fn_spacy_tokens_for_baseline: He is also worried Serb guerrillas could start taking hostages in retaliation .

source_bert_toks: he is also worried serb guerrillas could start taking hostages in retaliation .

reference_raw: He's also concerned that Serbian guerrillas might take hostages for revenge.

reference_spacy_tokens: He 's also concerned that Serbian guerrillas might take hostages for revenge .


fn_spacy_tokens_for_baseline: He was dressed in the scarlet and gold of a British field marshal with a tactful Netherlands decoration worn on an orange sash .

source_bert_toks: he was dressed in the scarlet and gold of a british field marshal with a ta ##ct ##ful netherlands decoration worn on an orange sash .

reference_raw: He was dressed in the scarlet and gold of a British field marshal with a tactful Dutch decoration worn on an orange bag.

reference_spacy_tokens: He was dressed in the scarlet and gold of a British field marshal with a tactful Dutch decoration worn on an orange bag .


fn_spacy_tokens_for_baseline: The original Slav settlers came under Byzantine influence until , under the emperor Simeon ( 893 - 927 ) , they were forced to submit to Bulgarian rule .

source_bert_toks: the original sl ##av settlers came under byzantine influence until , under the emperor simeon ( 89 ##3 - 92 ##7 ) , they were forced to submit to bulgarian rule .

reference_raw: The original Slav settlers were under Byzantine influence until they were forced to obey the Bulgarian government under Emperor Simeon (893-927).

reference_spacy_tokens: The original Slav settlers were under Byzantine influence until they were forced to obey the Bulgarian government under Emperor Simeon ( 893 - 927 ) .


fn_spacy_tokens_for_baseline: Since women outlive men in substantial numbers , inadequate housing is more a problem for elderly women than for elderly men .

source_bert_toks: since women out ##li ##ve men in substantial numbers , inadequate housing is more a problem for elderly women than for elderly men .

reference_raw: As women outlive men in significant numbers, poor housing is more a problem for older women than for older men.

reference_spacy_tokens: As women outlive men in significant numbers , poor housing is more a problem for older women than for older men .


fn_spacy_tokens_for_baseline: In trouble after a smuggling affray , early in the nineteenth century , John Kemp escapes to Jamaica and works his way to prosperity as a plantation owner .

source_bert_toks: in trouble after a smuggling af ##fra ##y , early in the nineteenth century , john kemp escapes to jamaica and works his way to prosperity as a plantation owner .

reference_raw: In trouble after a smuggling attack, at the beginning of the nineteenth century, John Kemp fled to Jamaica and worked his way to prosperity as the owner of the plantation.

reference_spacy_tokens: In trouble after a smuggling attack , at the beginning of the nineteenth century , John Kemp fled to Jamaica and worked his way to prosperity as the owner of the plantation .


fn_spacy_tokens_for_baseline: President Vladimir Putin Monday introduced a new convention on the fight against nuclear terrorism and several other documents for ratification by the lower house of Russia 's parliament .

source_bert_toks: president vladimir putin monday introduced a new convention on the fight against nuclear terrorism and several other documents for ratification by the lower house of russia ' s parliament .

reference_raw: President Vladimir Putin Monday introduced a new Nuclear Terrorism Convention and several other documents to be ratified by the lower House of Russian Parliament.

reference_spacy_tokens: President Vladimir Putin Monday introduced a new Nuclear Terrorism Convention and several other documents to be ratified by the lower House of Russian Parliament .


fn_spacy_tokens_for_baseline: He wo n't split on us . '

source_bert_toks: he won ' t split on us . '

reference_raw: He's not going to break up with us.'

reference_spacy_tokens: He 's not going to break up with us . '


fn_spacy_tokens_for_baseline: A BUNGLING bandit botched three hold - ups in an hour -- and ended up £ 200 worse off than when he started .

source_bert_toks: a bun ##gling bandit bot ##ched three hold - ups in an hour - - and ended up £2 ##00 worse off than when he started .

reference_raw: The Bungling Bandit screwed up three stops in an hour-and ended up with two hundred pounds worse off than he had started.

reference_spacy_tokens: The Bungling Bandit screwed up three stops in an hour - and ended up with two hundred pounds worse off than he had started .


fn_spacy_tokens_for_baseline: She ducked her head , and began to cry .

source_bert_toks: she ducked her head , and began to cry .

reference_raw: She bowed her head and began to weep.

reference_spacy_tokens: She bowed her head and began to weep .


fn_spacy_tokens_for_baseline: I 'm so stupid that I started doing cocaine to try to understand him -- to get close to him and understand where he was coming from .

source_bert_toks: i ' m so stupid that i started doing cocaine to try to understand him - - to get close to him and understand where he was coming from .

reference_raw: I'm so stupid, I started making cocaine to try to understand him, to get close to him, to understand where he came from.

reference_spacy_tokens: I 'm so stupid , I started making cocaine to try to understand him , to get close to him , to understand where he came from .


fn_spacy_tokens_for_baseline: The official welcoming party had congregated in front of the limousines , talking amongst themselves .

source_bert_toks: the official welcoming party had cong ##re ##gated in front of the limousine ##s , talking amongst themselves .

reference_raw: The official welcome party gathered before the limos and spoke among themselves.

reference_spacy_tokens: The official welcome party gathered before the limos and spoke among themselves .


fn_spacy_tokens_for_baseline: And is he to carry away his laurels thus unchallenged and undespoiled , while I am famished ?

source_bert_toks: and is he to carry away his laurel ##s thus un ##chal ##len ##ged and und ##es ##po ##iled , while i am fa ##mis ##hed ?

reference_raw: And is he to carry away his laurels so unchallenged and unspoiled, while I'm starving?

reference_spacy_tokens: And is he to carry away his laurels so unchallenged and unspoiled , while I 'm starving ?


fn_spacy_tokens_for_baseline: Mubarak told the London - based Al - Hayat he was willing to take Saddam in as a political refugee " if this means a solution to the problem of the Iraqi people and would prevent a blood - bath in Iraq . "

source_bert_toks: mu ##bara ##k told the london - based al - hay ##at he was willing to take saddam in as a political refugee " if this means a solution to the problem of the iraqi people and would prevent a blood - bath in iraq . "

reference_raw: Mubarak told the London-based Al-Hayat that he was willing to accept Saddam as a political refugee "if it meant solving the Iraqi people's problems and preventing a bloodbath in Iraq."

reference_spacy_tokens: Mubarak told the London - based Al - Hayat that he was willing to accept Saddam as a political refugee " if it meant solving the Iraqi people 's problems and preventing a bloodbath in Iraq . "


fn_spacy_tokens_for_baseline: This allocation of power by Pepin was probably based upon his recognition of a feud between Charles and Carloman who , of course , remained unfriendly towards one another after their respective crownings and inheritances .

source_bert_toks: this allocation of power by pep ##in was probably based upon his recognition of a feud between charles and carlo ##man who , of course , remained un ##fr ##ien ##dly towards one another after their respective crown ##ings and inheritance ##s .

reference_raw: Pepin's division of power was probably based on the recognition of a feud between Charles and Carloman, who, of course, remained hostile to each other after their respective coronations and successions.

reference_spacy_tokens: Pepin 's division of power was probably based on the recognition of a feud between Charles and Carloman , who , of course , remained hostile to each other after their respective coronations and successions .


fn_spacy_tokens_for_baseline: Ratagan said nothing , though fire still smouldered in his cavernous eyes .

source_bert_toks: rat ##aga ##n said nothing , though fire still sm ##ou ##lder ##ed in his cavern ##ous eyes .

reference_raw: Ratagan said nothing, though his cave eyes still smoldered with fire.

reference_spacy_tokens: Ratagan said nothing , though his cave eyes still smoldered with fire .


fn_spacy_tokens_for_baseline: In the Pentagon , decisions about procuring weapons systems are made by civilians , not uniformed officers .

source_bert_toks: in the pentagon , decisions about pro ##cu ##ring weapons systems are made by civilians , not uniformed officers .

reference_raw: In the Pentagon, decisions on the purchase of weapons systems are made by civilians, not uniformed officers.

reference_spacy_tokens: In the Pentagon , decisions on the purchase of weapons systems are made by civilians , not uniformed officers .


fn_spacy_tokens_for_baseline: A boat is like a floating drum and any noise and vibration are magnified through the water .

source_bert_toks: a boat is like a floating drum and any noise and vibration are mag ##nified through the water .

reference_raw: The ship is like a floating drum, and all the noise and vibrations are heightened by the water.

reference_spacy_tokens: The ship is like a floating drum , and all the noise and vibrations are heightened by the water .