fn_spacy_tokens_for_baseline: Then treatment is required .

source_bert_toks: then treatment is required .

reference_raw: Then treatment is necessary.

reference_spacy_tokens: Then treatment is necessary .


fn_spacy_tokens_for_baseline: This thing was invented by one mad professor guy , like Eddison , ' said Sam .

source_bert_toks: this thing was invented by one mad professor guy , like ed ##dis ##on , ' said sam .

reference_raw: A crazy professor like Eddison made it up,' said Sam.

reference_spacy_tokens: A crazy professor like Eddison made it up , ' said Sam .


fn_spacy_tokens_for_baseline: The blood gushed out in hot , scarlet streams whilst its owner , a little balding man , threatened the official with a stream of horrible oaths .

source_bert_toks: the blood gus ##hed out in hot , scarlet streams whilst its owner , a little bald ##ing man , threatened the official with a stream of horrible oath ##s .

reference_raw: Blood flowed in hot, scarlet streams, while the owner, a small balding man, threatened the clerk with a stream of terrible oaths.

reference_spacy_tokens: Blood flowed in hot , scarlet streams , while the owner , a small balding man , threatened the clerk with a stream of terrible oaths .


fn_spacy_tokens_for_baseline: The first was to put it across to laymen , interested in science but inexpert in it .

source_bert_toks: the first was to put it across to lay ##men , interested in science but in ##ex ##per ##t in it .

reference_raw: The first was to hand it over to the laymen, interested in science, but inexperienced.

reference_spacy_tokens: The first was to hand it over to the laymen , interested in science , but inexperienced .


fn_spacy_tokens_for_baseline: Players may admire you for all your footballing achievements , but unless your cufflinks are bigger , shinier and nastier than everyone else 's , respect will forever elude you .

source_bert_toks: players may admire you for all your football ##ing achievements , but unless your cuff ##link ##s are bigger , shin ##ier and nas ##tier than everyone else ' s , respect will forever el ##ude you .

reference_raw: Players may admire you for all your football successes, but if you don't have a bigger, brighter and nastier cuffs than the rest of us, respect will elude you forever.

reference_spacy_tokens: Players may admire you for all your football successes , but if you do n't have a bigger , brighter and nastier cuffs than the rest of us , respect will elude you forever .


fn_spacy_tokens_for_baseline: ' We 'd been seeing each other for a year when he suggested we should move in together .

source_bert_toks: ' we ' d been seeing each other for a year when he suggested we should move in together .

reference_raw: We were dating for a year when he suggested we move in together.

reference_spacy_tokens: We were dating for a year when he suggested we move in together .


fn_spacy_tokens_for_baseline: The worst single incident in the east during this period , however , involved the massacre of over 150 Tamil civilians in Batticaloa district on July 12 .

source_bert_toks: the worst single incident in the east during this period , however , involved the massacre of over 150 tamil civilians in bat ##tical ##oa district on july 12 .

reference_raw: However, the worst single incident in the East during that period was the slaughter of more than 150 Tamil civilians in the Batticaloa district on July 12th.

reference_spacy_tokens: However , the worst single incident in the East during that period was the slaughter of more than 150 Tamil civilians in the Batticaloa district on July 12th .


fn_spacy_tokens_for_baseline: John Parsons in Nice is saddened to see the former world No 1 humbled in another comeback attempt at the age of 35

source_bert_toks: john parsons in nice is sad ##dened to see the former world no 1 humble ##d in another comeback attempt at the age of 35

reference_raw: John Parsons in Nice is sad to see the former world No 1 humiliated in another comeback attempt at the age of 35.

reference_spacy_tokens: John Parsons in Nice is sad to see the former world No 1 humiliated in another comeback attempt at the age of 35 .


fn_spacy_tokens_for_baseline: Both villages offer good waterfront restaurants with homestyle Chinese food , principally seafood fresh from the tank .

source_bert_toks: both villages offer good waterfront restaurants with homes ##tyle chinese food , principally seafood fresh from the tank .

reference_raw: Both villages provide good waterfront restaurants with domestic Chinese food, mainly seafood fresh from the tank.

reference_spacy_tokens: Both villages provide good waterfront restaurants with domestic Chinese food , mainly seafood fresh from the tank .


fn_spacy_tokens_for_baseline: It could not steal upon the country unaware , like a thief in the night .

source_bert_toks: it could not steal upon the country unaware , like a thief in the night .

reference_raw: He couldn't rob a country without knowing it, like a thief in the middle of the night.

reference_spacy_tokens: He could n't rob a country without knowing it , like a thief in the middle of the night .


fn_spacy_tokens_for_baseline: ' Parul knew he had been with other women and they rowed about it .

source_bert_toks: ' par ##ul knew he had been with other women and they rowe ##d about it .

reference_raw: 'Parul knew that he was with other women, and they scurried about him.

reference_spacy_tokens: ' Parul knew that he was with other women , and they scurried about him .


fn_spacy_tokens_for_baseline: I enquired about the possibility of the tickets being changed for a show nearer to my home town .

source_bert_toks: i en ##qui ##red about the possibility of the tickets being changed for a show nearer to my home town .

reference_raw: I asked if I could change the tickets for a show closer to my hometown.

reference_spacy_tokens: I asked if I could change the tickets for a show closer to my hometown .


fn_spacy_tokens_for_baseline: She will begin in a single room , where both her health and aptitude for prison life will be assessed , but may then be moved to a dormitory .

source_bert_toks: she will begin in a single room , where both her health and apt ##itude for prison life will be assessed , but may then be moved to a dormitory .

reference_raw: He'll start in one room, where he'll assess his health and his ability to live in prison, and then he'll be able to move to his bedroom.

reference_spacy_tokens: He 'll start in one room , where he 'll assess his health and his ability to live in prison , and then he 'll be able to move to his bedroom .


fn_spacy_tokens_for_baseline: She dusted some ash from the sleeve of her black , Chinese - style padded jacket .

source_bert_toks: she dust ##ed some ash from the sleeve of her black , chinese - style padded jacket .

reference_raw: She brushed some ash from the sleeve of her black, Chinese-style stuffed jacket.

reference_spacy_tokens: She brushed some ash from the sleeve of her black , Chinese - style stuffed jacket .


fn_spacy_tokens_for_baseline: A series of hijackings and bomb hoaxes in the west of the city was apparently designed to act as a diversion as a mass escape was made .

source_bert_toks: a series of hi ##jack ##ings and bomb hoax ##es in the west of the city was apparently designed to act as a diversion as a mass escape was made .

reference_raw: Apparently, a series of kidnappings and bomb frauds in the west of town had been designed to act as a diversion when a mass escape took place.

reference_spacy_tokens: Apparently , a series of kidnappings and bomb frauds in the west of town had been designed to act as a diversion when a mass escape took place .


fn_spacy_tokens_for_baseline: The corporal shot the Chief an agonized glance .

source_bert_toks: the corporal shot the chief an ago ##ni ##zed glance .

reference_raw: The corporal gave the chief a pained look.

reference_spacy_tokens: The corporal gave the chief a pained look .


fn_spacy_tokens_for_baseline: He curled up and nipped her finger half - heartedly .

source_bert_toks: he curled up and ni ##pped her finger half - hearted ##ly .

reference_raw: He curled up and half-heartedly nibbed her finger.

reference_spacy_tokens: He curled up and half - heartedly nibbed her finger .


fn_spacy_tokens_for_baseline: Austria had meanwhile dispatched several hundred additional troops to its southern border and demanded an explanation for ' extraordinary military activities ' , saying that its airspace had been violated by JNA aircraft .

source_bert_toks: austria had meanwhile dispatched several hundred additional troops to its southern border and demanded an explanation for ' extraordinary military activities ' , saying that its airspace had been violated by j ##na aircraft .

reference_raw: In the meantime, Austria sent several hundred more troops to the southern border and asked for an explanation of the extraordinary military activities , claiming that the JNA aircraft had breached its airspace.

reference_spacy_tokens: In the meantime , Austria sent several hundred more troops to the southern border and asked for an explanation of the extraordinary military activities , claiming that the JNA aircraft had breached its airspace .


fn_spacy_tokens_for_baseline: After the way she 'd upset David 's grandmother on Sunday , she would have to be extremely tactful .

source_bert_toks: after the way she ' d upset david ' s grandmother on sunday , she would have to be extremely ta ##ct ##ful .

reference_raw: After she'd upset David's grandmother on Sunday, she'd have to be very careful.

reference_spacy_tokens: After she 'd upset David 's grandmother on Sunday , she 'd have to be very careful .


fn_spacy_tokens_for_baseline: The violinist is airing his complaints in an interview at his apartment in Manhattan 's great culture gulch , the Upper West Side , on the even of his departure for a long concert tour .

source_bert_toks: the violinist is airing his complaints in an interview at his apartment in manhattan ' s great culture gu ##lch , the upper west side , on the even of his departure for a long concert tour .

reference_raw: The violinist broadcasts his complaints in an interview at his apartment in Manhattan's Great Cultural Gulch on the Upper West Side, even after leaving for a long concert tour.

reference_spacy_tokens: The violinist broadcasts his complaints in an interview at his apartment in Manhattan 's Great Cultural Gulch on the Upper West Side , even after leaving for a long concert tour .


fn_spacy_tokens_for_baseline: The plea therefore shows the insufficiency of that part of the consideration . '

source_bert_toks: the plea therefore shows the ins ##uf ##fi ##ciency of that part of the consideration . '

reference_raw: It is therefore apparent from the plea that this part of the reasoning is inadequate.'

reference_spacy_tokens: It is therefore apparent from the plea that this part of the reasoning is inadequate . '


fn_spacy_tokens_for_baseline: Her head turned restlessly on the pillow as she strove to distance herself from the increasingly excited voice of the commentator and the air - splitting whine of the high - revving engines .

source_bert_toks: her head turned restless ##ly on the pillow as she st ##rove to distance herself from the increasingly excited voice of the commentator and the air - splitting w ##hine of the high - rev ##ving engines .

reference_raw: She turned her head restlessly on the pillow as she tried to distance herself from the ever-increasing voice of the commentator and the air-splitting whine of the high-speed engines.

reference_spacy_tokens: She turned her head restlessly on the pillow as she tried to distance herself from the ever - increasing voice of the commentator and the air - splitting whine of the high - speed engines .


fn_spacy_tokens_for_baseline: Dr Burge has valued schemes as a source of research and some universities are now promoting both industrial contact and research experience .

source_bert_toks: dr bu ##rge has valued schemes as a source of research and some universities are now promoting both industrial contact and research experience .

reference_raw: Dr. Burge has appreciated schemes as a source of research, and some universities are now promoting industrial contact and research experience.

reference_spacy_tokens: Dr. Burge has appreciated schemes as a source of research , and some universities are now promoting industrial contact and research experience .


fn_spacy_tokens_for_baseline: When six cartons of drugs , bandages and serums were heaped on my study floor there was the business of finding out when and how they should be administered .

source_bert_toks: when six cart ##ons of drugs , bandages and serum ##s were heap ##ed on my study floor there was the business of finding out when and how they should be administered .

reference_raw: When six boxes of drugs, bandages, and serum piled up on the floor of my study, it was my job to find out when and how to give them.

reference_spacy_tokens: When six boxes of drugs , bandages , and serum piled up on the floor of my study , it was my job to find out when and how to give them .


fn_spacy_tokens_for_baseline: ' Why anyone should wish to carry out such an evil and depraved attack on a young girl like this is a mystery to us . '

source_bert_toks: ' why anyone should wish to carry out such an evil and de ##pr ##ave ##d attack on a young girl like this is a mystery to us . '

reference_raw: "Why would anyone want to do such an evil and evil attack on a young girl like that is a mystery to us."

reference_spacy_tokens: " Why would anyone want to do such an evil and evil attack on a young girl like that is a mystery to us . "


fn_spacy_tokens_for_baseline: But the trouble was , he was so vile I could n't respect him .

source_bert_toks: but the trouble was , he was so vile i couldn ' t respect him .

reference_raw: The problem was, he was so disgusting that I couldn't respect him.

reference_spacy_tokens: The problem was , he was so disgusting that I could n't respect him .


fn_spacy_tokens_for_baseline: Given its current state of technology and the problems associated with delivering a sophisticated BW agent , it is unlikely that Iran currently has the means to carry out a significant biological attack .

source_bert_toks: given its current state of technology and the problems associated with delivering a sophisticated b ##w agent , it is unlikely that iran currently has the means to carry out a significant biological attack .

reference_raw: Given the current state of the art and the difficulties associated with the delivery of a sophisticated BW agent, it is unlikely that Iran currently has the means to undertake a major bio-attack.

reference_spacy_tokens: Given the current state of the art and the difficulties associated with the delivery of a sophisticated BW agent , it is unlikely that Iran currently has the means to undertake a major bio - attack .


fn_spacy_tokens_for_baseline: Her conjectures as to her possible future occupation lead to a number of wild escapades involving kidnapping and terrorism , as well as to more humble pursuits such as pig - farming .

source_bert_toks: her conjecture ##s as to her possible future occupation lead to a number of wild es ##cap ##ades involving kidnapping and terrorism , as well as to more humble pursuits such as pig - farming .

reference_raw: Its assumptions about its possible future occupation lead to a number of wild escapades involving kidnapping and terrorism, as well as more modest pursuits such as pig farming.

reference_spacy_tokens: Its assumptions about its possible future occupation lead to a number of wild escapades involving kidnapping and terrorism , as well as more modest pursuits such as pig farming .


fn_spacy_tokens_for_baseline: The little helicopter creaked slightly as it relaxed on to its skids and then a kind of ear - splitting silence settled around it as the rotors drifted to a halt .

source_bert_toks: the little helicopter creaked slightly as it relaxed on to its ski ##ds and then a kind of ear - splitting silence settled around it as the rotor ##s drifted to a halt .

reference_raw: The small helicopter squealed a little as it eased into its skids, and then a sort of ear-splitting silence settled around it as the rotors stopped.

reference_spacy_tokens: The small helicopter squealed a little as it eased into its skids , and then a sort of ear - splitting silence settled around it as the rotors stopped .


fn_spacy_tokens_for_baseline: Now he felt playful : he kept tickling the cushion next to him and saying , ' Come here , come here , little Eva , and let me tell you a secret . '

source_bert_toks: now he felt playful : he kept tick ##ling the cushion next to him and saying , ' come here , come here , little eva , and let me tell you a secret . '

reference_raw: Now he felt playful: he kept ticking the pillow beside him and saying, "Come on, come here, little Eva, and I'll tell you a secret."

reference_spacy_tokens: Now he felt playful : he kept ticking the pillow beside him and saying , " Come on , come here , little Eva , and I 'll tell you a secret . "


fn_spacy_tokens_for_baseline: I got a reproof from Dr Kelleher when I facetiously said I 'd grow geraniums in my gas mask .

source_bert_toks: i got a rep ##ro ##of from dr ke ##lle ##her when i face ##tious ##ly said i ' d grow ge ##rani ##ums in my gas mask .

reference_raw: Dr. Kelleher gave me a restraint when I told him face-to-face that I was going to grow geraniums in a gas mask.

reference_spacy_tokens: Dr. Kelleher gave me a restraint when I told him face - to - face that I was going to grow geraniums in a gas mask .


fn_spacy_tokens_for_baseline: ' Sold his soul to the devil in exchange for money , ' says Warner , ' and expects his creditor to come up and claim his own . '

source_bert_toks: ' sold his soul to the devil in exchange for money , ' says warner , ' and expects his credit ##or to come up and claim his own . '

reference_raw: He sold his soul to the devil in exchange for money, Warner says, and he expects his lender to come and take his own.

reference_spacy_tokens: He sold his soul to the devil in exchange for money , Warner says , and he expects his lender to come and take his own .


fn_spacy_tokens_for_baseline: And during that miserable week the wind soughing in the trees and flinging rain against the cottage windows had added to the conspiracy of misery .

source_bert_toks: and during that miserable week the wind so ##ugh ##ing in the trees and fling ##ing rain against the cottage windows had added to the conspiracy of misery .

reference_raw: And during that miserable week, the wind sobbing in the trees and the falling rain against the windows of the cabin added to the plot of misery.

reference_spacy_tokens: And during that miserable week , the wind sobbing in the trees and the falling rain against the windows of the cabin added to the plot of misery .


fn_spacy_tokens_for_baseline: Mam Tor is the first objective on the walk along the ridge which separates the Hope and Edale valleys .

source_bert_toks: ma ##m tor is the first objective on the walk along the ridge which separates the hope and ed ##ale valleys .

reference_raw: Mam Tore is the first target to walk along the ridge that separates the valleys of Hope and Edale.

reference_spacy_tokens: Mam Tore is the first target to walk along the ridge that separates the valleys of Hope and Edale .


fn_spacy_tokens_for_baseline: ' I never realised what a sour stink wet blankets can make .

source_bert_toks: ' i never realised what a sour stink wet blankets can make .

reference_raw: I never realized what a sour, wet blanket can do.

reference_spacy_tokens: I never realized what a sour , wet blanket can do .


fn_spacy_tokens_for_baseline: Many people need our help .

source_bert_toks: many people need our help .

reference_raw: A lot of people need us.

reference_spacy_tokens: A lot of people need us .


fn_spacy_tokens_for_baseline: A South Korean security analyst suggested that DPRK artillery pieces of calibers 170 mm and 240 mm " could fire 10,000 rounds per minute to Seoul and its environs . "

source_bert_toks: a south korean security analyst suggested that d ##pr ##k artillery pieces of caliber ##s 170 mm and 240 mm " could fire 10 , 000 rounds per minute to seoul and its en ##vir ##ons . "

reference_raw: A South Korean security analyst suggested that the DPRK's 170mm and 240mm artillery can fire 10,000 bullets a minute to Seoul and his environs.

reference_spacy_tokens: A South Korean security analyst suggested that the DPRK 's 170 mm and 240 mm artillery can fire 10,000 bullets a minute to Seoul and his environs .


fn_spacy_tokens_for_baseline: DOZENS of firemen fought last night to contain a fire which threatened to destroy outbuildings on an isolated farm .

source_bert_toks: dozens of fire ##men fought last night to contain a fire which threatened to destroy out ##building ##s on an isolated farm .

reference_raw: Dozens of firefighters fought last night to contain a fire that threatened to destroy the buildings on an isolated farm.

reference_spacy_tokens: Dozens of firefighters fought last night to contain a fire that threatened to destroy the buildings on an isolated farm .


fn_spacy_tokens_for_baseline: During each summer 's rainy season , the lake 's waters would spill over its southern rim and slide down towards Florida Bay .

source_bert_toks: during each summer ' s rainy season , the lake ' s waters would spill over its southern rim and slide down towards florida bay .

reference_raw: During each summer's rainy season, the waters of the lake would roll over the southern edge and slide down to the Gulf of Florida.

reference_spacy_tokens: During each summer 's rainy season , the waters of the lake would roll over the southern edge and slide down to the Gulf of Florida .


fn_spacy_tokens_for_baseline: He had slept little these past three and a half weeks , often waking of his own accord in the pre - dawn darkness and walking through to his personal study to attempt to concentrate on papers of state .

source_bert_toks: he had slept little these past three and a half weeks , often waking of his own accord in the pre - dawn darkness and walking through to his personal study to attempt to concentrate on papers of state .

reference_raw: For the last three and a half weeks he had slept very little, often awakening of his own accord in the pre-dawn darkness, and had gone to his private office to try to focus on the papers of the state.

reference_spacy_tokens: For the last three and a half weeks he had slept very little , often awakening of his own accord in the pre - dawn darkness , and had gone to his private office to try to focus on the papers of the state .


fn_spacy_tokens_for_baseline: The enclosed cab is covered in lightly - grained black Tolex with no corner pieces , while the front , which angles gently back towards the top , is more rock'n'roll than it looks .

source_bert_toks: the enclosed cab is covered in lightly - grain ##ed black to ##le ##x with no corner pieces , while the front , which angles gently back towards the top , is more rock ' n ' roll than it looks .

reference_raw: The enclosed cabin is covered with lightly-grained black Tolex with no corner pieces, and the front, which slopes gently back to the top, is more rock and roll than it looks.

reference_spacy_tokens: The enclosed cabin is covered with lightly - grained black Tolex with no corner pieces , and the front , which slopes gently back to the top , is more rock and roll than it looks .


fn_spacy_tokens_for_baseline: The singer , starring in the West End production of Joseph and the Amazing Technicolor Dreamcoat , sued the magazine for insinuating that he was homosexual , and a hypocrite for denying it .

source_bert_toks: the singer , starring in the west end production of joseph and the amazing tech ##nic ##olo ##r dream ##coat , sued the magazine for ins ##in ##uating that he was homosexual , and a h ##yp ##oc ##rite for denying it .

reference_raw: A singer in the West End production of Joseph and the Amazing Technicolor Dreamcoat sued a magazine for insinuating that he was gay, and a hypocrite for denying it.

reference_spacy_tokens: A singer in the West End production of Joseph and the Amazing Technicolor Dreamcoat sued a magazine for insinuating that he was gay , and a hypocrite for denying it .


fn_spacy_tokens_for_baseline: Libya ? s government strongly denies acquiring or producing BW .

source_bert_toks: libya ? s government strongly denies acquiring or producing b ##w .

reference_raw: Libya? The government strongly denies the acquisition or production of BV.

reference_spacy_tokens: Libya ? The government strongly denies the acquisition or production of BV .


fn_spacy_tokens_for_baseline: Behind him , distantly , a bugle was sounding , followed by the clank and shuffle of armoured men running .

source_bert_toks: behind him , distant ##ly , a bug ##le was sounding , followed by the clan ##k and shuffle of armoured men running .

reference_raw: There was a distant bugle behind him, followed by the clanking and scuffling of armored men running.

reference_spacy_tokens: There was a distant bugle behind him , followed by the clanking and scuffling of armored men running .


fn_spacy_tokens_for_baseline: ' But leave him to stew , if that 's your humour . '

source_bert_toks: ' but leave him to stew , if that ' s your humour . '

reference_raw: "But let him choke, if that's your sense of humor."

reference_spacy_tokens: " But let him choke , if that 's your sense of humor . "


fn_spacy_tokens_for_baseline: Ruth followed her into the hallway and was immediately aware of disorder ; open packing - cases and an assortment of clothes and furniture piled up in every inch of space .

source_bert_toks: ruth followed her into the hallway and was immediately aware of disorder ; open packing - cases and an assortment of clothes and furniture piled up in every inch of space .

reference_raw: Ruth followed her into the corridor, instantly aware of the disturbance; open packs and piles of clothing and furniture piled up in every inch of the room.

reference_spacy_tokens: Ruth followed her into the corridor , instantly aware of the disturbance ; open packs and piles of clothing and furniture piled up in every inch of the room .


fn_spacy_tokens_for_baseline: The facility also will be used to assess threat vulnerabilities and potential consequences and conduct forensic analysis of evidence from terrorism and biological crimes .

source_bert_toks: the facility also will be used to assess threat vu ##ln ##era ##bilities and potential consequences and conduct forensic analysis of evidence from terrorism and biological crimes .

reference_raw: It will also be used to assess the vulnerability and potential consequences of threats and to carry out forensic analysis of evidence from terrorism and biological crime.

reference_spacy_tokens: It will also be used to assess the vulnerability and potential consequences of threats and to carry out forensic analysis of evidence from terrorism and biological crime .


fn_spacy_tokens_for_baseline: When we begin to take the law into our own hands we become little better than those individuals who vandalise our homes and mug old ladies .

source_bert_toks: when we begin to take the law into our own hands we become little better than those individuals who van ##dal ##ise our homes and mug old ladies .

reference_raw: When we start taking the law into our own hands, we're no better than the people who vandalize our homes and steal old ladies.

reference_spacy_tokens: When we start taking the law into our own hands , we 're no better than the people who vandalize our homes and steal old ladies .


fn_spacy_tokens_for_baseline: Simply spray Hot Shapes onto clean , dry hair before setting to get instant hold with a glossy finish .

source_bert_toks: simply spray hot shapes onto clean , dry hair before setting to get instant hold with a glossy finish .

reference_raw: Just sprinkle hot shapes on clean, dry hair before setting, so that it can be held with a shiny finish.

reference_spacy_tokens: Just sprinkle hot shapes on clean , dry hair before setting , so that it can be held with a shiny finish .


fn_spacy_tokens_for_baseline: The elitists offer us explanations less ambitious than either of the grand theories , explanations which borrow unashamedly from other conventions and which have obvious gaps and limitations .

source_bert_toks: the eli ##tist ##s offer us explanations less ambitious than either of the grand theories , explanations which borrow una ##sham ##edly from other conventions and which have obvious gaps and limitations .

reference_raw: Elitists offer us less ambitious interpretations than any of the great theories, clarifications that borrow without shame from other conventions, with obvious gaps and limitations.

reference_spacy_tokens: Elitists offer us less ambitious interpretations than any of the great theories , clarifications that borrow without shame from other conventions , with obvious gaps and limitations .


fn_spacy_tokens_for_baseline: Just complete the entry form below and return it -- together with your minimum donation of £ 5 per entry pack -- to Birthright , to arrive by May 18 , 1992 .

source_bert_toks: just complete the entry form below and return it - - together with your minimum donation of £5 per entry pack - - to birth ##right , to arrive by may 18 , 1992 .

reference_raw: Just fill out the entry form below and return it to Birthright - together with a minimal donation of £5 per entry package - until 18 May 1992.

reference_spacy_tokens: Just fill out the entry form below and return it to Birthright - together with a minimal donation of £ 5 per entry package - until 18 May 1992 .


fn_spacy_tokens_for_baseline: An all - out offensive against the Taliban in Swat during the spring succeeded in flushing militants out of the volatile region 's urban centers and towns .

source_bert_toks: an all - out offensive against the taliban in swat during the spring succeeded in flushing militants out of the volatile region ' s urban centers and towns .

reference_raw: In the spring, the full attack on the Taliban in Swat succeeded in rinsing militants from the city centers and cities of the unstable region.

reference_spacy_tokens: In the spring , the full attack on the Taliban in Swat succeeded in rinsing militants from the city centers and cities of the unstable region .


fn_spacy_tokens_for_baseline: It was plain that the existing accommodation -- two classrooms separated by a half - glazed folding partition , a head teacher 's office and WC block -- did not provide an arrangement that could be easily adapted to give convenient living space .

source_bert_toks: it was plain that the existing accommodation - - two classrooms separated by a half - glazed folding partition , a head teacher ' s office and wc block - - did not provide an arrangement that could be easily adapted to give convenient living space .

reference_raw: It was clear that the existing accommodation - two classrooms divided by a half-glazed folding section, the principal teacher's office and the WC block - did not provide an arrangement that could be easily adapted to provide comfortable living space.

reference_spacy_tokens: It was clear that the existing accommodation - two classrooms divided by a half - glazed folding section , the principal teacher 's office and the WC block - did not provide an arrangement that could be easily adapted to provide comfortable living space .


fn_spacy_tokens_for_baseline: ' What do you require ? ' the Counsellor gurgled .

source_bert_toks: ' what do you require ? ' the counsel ##lor gu ##rg ##led .

reference_raw: 'What do you need?' said the counselor.

reference_spacy_tokens: ' What do you need ? ' said the counselor .


fn_spacy_tokens_for_baseline: In fact , no one can foretell whether a given innovation will end up a big business or a modest achievement .

source_bert_toks: in fact , no one can fore ##tell whether a given innovation will end up a big business or a modest achievement .

reference_raw: In fact, no one can predict whether the innovation will turn into a large enterprise or a modest success.

reference_spacy_tokens: In fact , no one can predict whether the innovation will turn into a large enterprise or a modest success .


fn_spacy_tokens_for_baseline: Finally , the application of the rapid test in the programme will be determined by cost effective analysis .

source_bert_toks: finally , the application of the rapid test in the programme will be determined by cost effective analysis .

reference_raw: Finally, a cost-effective analysis will determine the application of the fast test in the programme.

reference_spacy_tokens: Finally , a cost - effective analysis will determine the application of the fast test in the programme .


fn_spacy_tokens_for_baseline: It failed , and the general purged the armed forces and created a power structure that strengthened his supporters ' hold on the military .

source_bert_toks: it failed , and the general purge ##d the armed forces and created a power structure that strengthened his supporters ' hold on the military .

reference_raw: He failed, and the General cleansed the armed forces and created a power structure that strengthened his supporters' hold on the army.

reference_spacy_tokens: He failed , and the General cleansed the armed forces and created a power structure that strengthened his supporters ' hold on the army .


fn_spacy_tokens_for_baseline: The head was then pickled in a ten - foot long tin box , and the rotting body returned to the ocean .

source_bert_toks: the head was then pick ##led in a ten - foot long tin box , and the rotting body returned to the ocean .

reference_raw: Then the head was picked up in a ten-foot-long tin box, and the rotting body returned to the sea.

reference_spacy_tokens: Then the head was picked up in a ten - foot - long tin box , and the rotting body returned to the sea .


fn_spacy_tokens_for_baseline: Boil for 5 minutes on gentle heat then add mushroom -- and simmer in a covered saucepan for a further 7 minutes .

source_bert_toks: boil for 5 minutes on gentle heat then add mushroom - - and sim ##mer in a covered sauce ##pan for a further 7 minutes .

reference_raw: Boil for five minutes on a gentle heat, then add a sponge - and burn in a covered saucepan for another seven minutes.

reference_spacy_tokens: Boil for five minutes on a gentle heat , then add a sponge - and burn in a covered saucepan for another seven minutes .


fn_spacy_tokens_for_baseline: Pumfrey fingered that little bunch of bristles in fond reflection .

source_bert_toks: pu ##m ##frey fingered that little bunch of br ##istles in fond reflection .

reference_raw: Pumfrey fumbled at the small group of bristles in fond thought.

reference_spacy_tokens: Pumfrey fumbled at the small group of bristles in fond thought .


fn_spacy_tokens_for_baseline: As the Byzantine Empire weakened at the end of the first millennium , Crusader forces were sent from Western Europe to counter the Muslim forces and retake Jerusalem for the Christian faith .

source_bert_toks: as the byzantine empire weakened at the end of the first millennium , crusader forces were sent from western europe to counter the muslim forces and re ##take jerusalem for the christian faith .

reference_raw: As the Byzantine Empire subsided at the end of the first millennia, crusaders were sent from Western Europe to fight the Muslim forces and take Jerusalem back to the Christian faith.

reference_spacy_tokens: As the Byzantine Empire subsided at the end of the first millennia , crusaders were sent from Western Europe to fight the Muslim forces and take Jerusalem back to the Christian faith .


fn_spacy_tokens_for_baseline: California wildfires continue to spread

source_bert_toks: california wild ##fires continue to spread

reference_raw: The California wildfires are continuing

reference_spacy_tokens: The California wildfires are continuing


fn_spacy_tokens_for_baseline: The birch forests of Siberia , so upright , so elegant in autumn , had been broken by this winter campaign .

source_bert_toks: the birch forests of siberia , so upright , so elegant in autumn , had been broken by this winter campaign .

reference_raw: The birch woods of Siberia, so erect and so elegant in the fall, were broken by the winter campaign.

reference_spacy_tokens: The birch woods of Siberia , so erect and so elegant in the fall , were broken by the winter campaign .


fn_spacy_tokens_for_baseline: He appeared in July ' 85 , ambling down the 18th fairway at Royal St George 's .

source_bert_toks: he appeared in july ' 85 , am ##bling down the 18th fair ##way at royal st george ' s .

reference_raw: He showed up in July of '85, climbing the 18th Fairway at the Royal St. George's.

reference_spacy_tokens: He showed up in July of ' 85 , climbing the 18th Fairway at the Royal St. George 's .


fn_spacy_tokens_for_baseline: When we launched our boat in Rangkul for the first time and motored towards the islands where the birds were said to nest , it was with considerable relief that we saw there were indeed geese , and they were on eggs .

source_bert_toks: when we launched our boat in rang ##ku ##l for the first time and motor ##ed towards the islands where the birds were said to nest , it was with considerable relief that we saw there were indeed geese , and they were on eggs .

reference_raw: When we first launched our ship in Rangkul and drove to the islands where the birds were said to be nesting, we were very relieved to see that there were indeed gooses on eggs.

reference_spacy_tokens: When we first launched our ship in Rangkul and drove to the islands where the birds were said to be nesting , we were very relieved to see that there were indeed gooses on eggs .


fn_spacy_tokens_for_baseline: Now those enemies were pouring through non - existent defences and laying waste the cities of the Reich .

source_bert_toks: now those enemies were pouring through non - existent defences and laying waste the cities of the reich .

reference_raw: Now these enemies came through the nonexistent defenses and wasted the Empire's cities.

reference_spacy_tokens: Now these enemies came through the nonexistent defenses and wasted the Empire 's cities .


fn_spacy_tokens_for_baseline: Beaverbrook reiterated this position to Berle when the two met on 21 July .

source_bert_toks: beaver ##brook reiterated this position to be ##rle when the two met on 21 july .

reference_raw: When they met on 21 July, Beaverbrook repeated his position to Berle.

reference_spacy_tokens: When they met on 21 July , Beaverbrook repeated his position to Berle .


fn_spacy_tokens_for_baseline: Video posted on the Internet and said to be from the restive central city of Hama showed high school students pouring into the streets in protest after finishing exams Monday .

source_bert_toks: video posted on the internet and said to be from the rest ##ive central city of ham ##a showed high school students pouring into the streets in protest after finishing exams monday .

reference_raw: The video that was posted on the Internet and said it was from the restive central city of Hama showed high-school students pouring into the streets at the end of their rehearsals on Monday.

reference_spacy_tokens: The video that was posted on the Internet and said it was from the restive central city of Hama showed high - school students pouring into the streets at the end of their rehearsals on Monday .


fn_spacy_tokens_for_baseline: At one time the Institute had intended to establish its own college for training , and this was still essential .

source_bert_toks: at one time the institute had intended to establish its own college for training , and this was still essential .

reference_raw: The Institute had once intended to set up its own school for training, which was still necessary.

reference_spacy_tokens: The Institute had once intended to set up its own school for training , which was still necessary .


fn_spacy_tokens_for_baseline: Bill vomits all over the controls .

source_bert_toks: bill vomit ##s all over the controls .

reference_raw: Bill throws up all over the controls.

reference_spacy_tokens: Bill throws up all over the controls .


fn_spacy_tokens_for_baseline: After the cleaning in AlbuFahd , the brothers killed three of the spies in his tribe , and for the first time there was no reaction against the brothers , but instead he came to them , asking for forgiveness , and he 's ready to cooperate .

source_bert_toks: after the cleaning in al ##bu ##fa ##hd , the brothers killed three of the spies in his tribe , and for the first time there was no reaction against the brothers , but instead he came to them , asking for forgiveness , and he ' s ready to cooperate .

reference_raw: After cleaning up in AlbuFahd, the brothers killed three of his tribe's spies, and for the first time there was no response to the brothers, but instead he came to them and asked for forgiveness, and he was prepared to work with them.

reference_spacy_tokens: After cleaning up in AlbuFahd , the brothers killed three of his tribe 's spies , and for the first time there was no response to the brothers , but instead he came to them and asked for forgiveness , and he was prepared to work with them .


fn_spacy_tokens_for_baseline: The existence of the wolves , rumoured for years , was confirmed when two were shot by farmers while attacking calves .

source_bert_toks: the existence of the wolves , rum ##oured for years , was confirmed when two were shot by farmers while attacking calves .

reference_raw: The existence of wolves, rumored to have existed for years, was confirmed when two of them were shot by farmers while attacking calves.

reference_spacy_tokens: The existence of wolves , rumored to have existed for years , was confirmed when two of them were shot by farmers while attacking calves .


fn_spacy_tokens_for_baseline: Despite the lack of convincing evidence of its efficacy many general practitioners believe in the value of counselling and of counsellors in general practice .

source_bert_toks: despite the lack of convincing evidence of its efficacy many general practitioners believe in the value of counsel ##ling and of counsel ##lor ##s in general practice .

reference_raw: Despite the lack of convincing evidence of its effectiveness, many general practitioners believe in the importance of counselling and counselling in general practice.

reference_spacy_tokens: Despite the lack of convincing evidence of its effectiveness , many general practitioners believe in the importance of counselling and counselling in general practice .


fn_spacy_tokens_for_baseline: You 've probably never encountered opposition before , because you 've deliberately gone after the weak who could n't fight back .

source_bert_toks: you ' ve probably never encountered opposition before , because you ' ve deliberately gone after the weak who couldn ' t fight back .

reference_raw: I don't think you've ever met an opposition before, because you've deliberately gone after a weak man who can't defend himself.

reference_spacy_tokens: I do n't think you 've ever met an opposition before , because you 've deliberately gone after a weak man who ca n't defend himself .


fn_spacy_tokens_for_baseline: Mr Devine could face up to 300 lashes for the offence , his MP says that can not be allowed to happen .

source_bert_toks: mr devin ##e could face up to 300 lashes for the offence , his mp says that can not be allowed to happen .

reference_raw: Mr. Devine was able to face up to 300 whips for the crime, and his MP said it couldn't be allowed.

reference_spacy_tokens: Mr. Devine was able to face up to 300 whips for the crime , and his MP said it could n't be allowed .


fn_spacy_tokens_for_baseline: Brightly coloured and bottled in pretty jars , not only do they taste good but they look good too !

source_bert_toks: brightly coloured and bottled in pretty jars , not only do they taste good but they look good too !

reference_raw: It's brightly colored, and it's filled with beautiful glasses, not only does it taste good, but it also looks good!

reference_spacy_tokens: It 's brightly colored , and it 's filled with beautiful glasses , not only does it taste good , but it also looks good !


fn_spacy_tokens_for_baseline: As he pores over all this raw data the field - worker discovers certain interesting patterns and principles in terms of which his information makes sense .

source_bert_toks: as he por ##es over all this raw data the field - worker discovers certain interesting patterns and principles in terms of which his information makes sense .

reference_raw: By pouring over all this raw data, a field worker discovers some interesting patterns and principles that make sense of his information.

reference_spacy_tokens: By pouring over all this raw data , a field worker discovers some interesting patterns and principles that make sense of his information .


fn_spacy_tokens_for_baseline: THE road to Celtic Park was paved with punters .

source_bert_toks: the road to celtic park was paved with punt ##ers .

reference_raw: The road to Celtic Park was littered with punters.

reference_spacy_tokens: The road to Celtic Park was littered with punters .


fn_spacy_tokens_for_baseline: He astounded his American masters by demanding that they give him a more worthwhile job or he would be on his way home .

source_bert_toks: he as ##tou ##nded his american masters by demanding that they give him a more worth ##while job or he would be on his way home .

reference_raw: He surprised his American masters by asking them to give him a more valuable job, or he'd be on his way home.

reference_spacy_tokens: He surprised his American masters by asking them to give him a more valuable job , or he 'd be on his way home .


fn_spacy_tokens_for_baseline: He swung himself astride the dragon awkwardly , because Rincewind was hanging on to his belt .

source_bert_toks: he swung himself astrid ##e the dragon awkwardly , because ri ##nce ##wind was hanging on to his belt .

reference_raw: Clumsily, he swerved astern of the dragon, for Rincewind was clinging to his belt.

reference_spacy_tokens: Clumsily , he swerved astern of the dragon , for Rincewind was clinging to his belt .


fn_spacy_tokens_for_baseline: Carole Meadows gave her a wry smile as she began filling the picnic hamper .

source_bert_toks: carole meadows gave her a wry smile as she began filling the picnic ham ##per .

reference_raw: Carole Meadows smiled sourly as she began filling the picnic basket.

reference_spacy_tokens: Carole Meadows smiled sourly as she began filling the picnic basket .


fn_spacy_tokens_for_baseline: Now that percentage routinely equals a third and twice has been above 40 % .

source_bert_toks: now that percentage routinely equals a third and twice has been above 40 % .

reference_raw: Now this percentage is usually equal to one-third and two-fold is more than 40%.

reference_spacy_tokens: Now this percentage is usually equal to one - third and two - fold is more than 40 % .


fn_spacy_tokens_for_baseline: Credit cards also allow you to convert only just as much as you need into local currencies .

source_bert_toks: credit cards also allow you to convert only just as much as you need into local cu ##rre ##ncies .

reference_raw: Credit cards also allow you to turn into local currency only as much as you need.

reference_spacy_tokens: Credit cards also allow you to turn into local currency only as much as you need .


fn_spacy_tokens_for_baseline: He said you 'd have no idea where to start and , in any event , he had bribed two shepherds to say I 'd gone down to Foxton Mire .

source_bert_toks: he said you ' d have no idea where to start and , in any event , he had bribe ##d two shepherd ##s to say i ' d gone down to fox ##ton mir ##e .

reference_raw: He said you didn't know where to start, and in any case, he bribed two shepherds to tell me that I went to Foxton Mir.

reference_spacy_tokens: He said you did n't know where to start , and in any case , he bribed two shepherds to tell me that I went to Foxton Mir .


fn_spacy_tokens_for_baseline: After all , one feels , Mrs Washington was surely a thrifty housewife ; had the invention of margarine occurred a century sooner than it did , no doubt she would have taken advantage of the development .

source_bert_toks: after all , one feels , mrs washington was surely a th ##rift ##y house ##wife ; had the invention of mar ##gar ##ine occurred a century sooner than it did , no doubt she would have taken advantage of the development .

reference_raw: After all, it seems to me that Mrs. Washington was certainly a thriving housewife; if margarine had been invented a century earlier than that, she would undoubtedly have taken advantage of it.

reference_spacy_tokens: After all , it seems to me that Mrs. Washington was certainly a thriving housewife ; if margarine had been invented a century earlier than that , she would undoubtedly have taken advantage of it .


fn_spacy_tokens_for_baseline: I gave it all I had and , grunting loudly enough to raise the dead , I achieved 3 metres 25 cm .

source_bert_toks: i gave it all i had and , grunt ##ing loudly enough to raise the dead , i achieved 3 metres 25 ##cm .

reference_raw: I gave him everything I had, and, growling so loudly that I could raise the dead, I reached 20 feet.

reference_spacy_tokens: I gave him everything I had , and , growling so loudly that I could raise the dead , I reached 20 feet .


fn_spacy_tokens_for_baseline: That year she had flown from Paris to London for the christening of her sister Pauline 's third child , something she would not normally have done , for she disliked formal family occasions .

source_bert_toks: that year she had flown from paris to london for the christ ##ening of her sister pauline ' s third child , something she would not normally have done , for she disliked formal family occasions .

reference_raw: That year she flew from Paris to London to baptize her sister Pauline's third child, something she wouldn't normally do because she didn't like formal family events.

reference_spacy_tokens: That year she flew from Paris to London to baptize her sister Pauline 's third child , something she would n't normally do because she did n't like formal family events .


fn_spacy_tokens_for_baseline: Did n't they all know about the terrible appearance of the Conablaiche last time , and how it had prowled the country , snatching sleeping children from their beds and tearing out their hearts for its Dark Master .

source_bert_toks: didn ' t they all know about the terrible appearance of the con ##ab ##lai ##che last time , and how it had pro ##wled the country , snatch ##ing sleeping children from their beds and tearing out their hearts for its dark master .

reference_raw: They were not all aware of the horrid appearance of the Conablaiche the last time, and how it had prowled the land, tore the sleeping children from their beds and ripped their hearts out for the Dark Lord.

reference_spacy_tokens: They were not all aware of the horrid appearance of the Conablaiche the last time , and how it had prowled the land , tore the sleeping children from their beds and ripped their hearts out for the Dark Lord .


fn_spacy_tokens_for_baseline: Yet these proportions mask a more alarming phenomenon : the amount of new money that needs to be borrowed each year purely to pay off maturing debt .

source_bert_toks: yet these proportions mask a more alarm ##ing phenomenon : the amount of new money that needs to be borrowed each year purely to pay off mat ##uring debt .

reference_raw: But these ratios mask a more disturbing phenomenon: the amount of new money that you need to borrow every year just to pay off the maturing debt.

reference_spacy_tokens: But these ratios mask a more disturbing phenomenon : the amount of new money that you need to borrow every year just to pay off the maturing debt .


fn_spacy_tokens_for_baseline: His face was non - committal , and Kate felt suddenly shy because of the wave of lust that swept over her as she looked back at his unshaven cheeks .

source_bert_toks: his face was non - commit ##tal , and kate felt suddenly shy because of the wave of lust that swept over her as she looked back at his un ##sha ##ven cheeks .

reference_raw: His face was uncommittal, and Kate felt suddenly ashamed of the wave of lust that swept over her as she looked back at his unshaven face.

reference_spacy_tokens: His face was uncommittal , and Kate felt suddenly ashamed of the wave of lust that swept over her as she looked back at his unshaven face .


fn_spacy_tokens_for_baseline: These lovely curls and the pretty floral headband caught our eye .

source_bert_toks: these lovely curls and the pretty floral head ##band caught our eye .

reference_raw: These beautiful curls and a beautiful flowery band caught our eye.

reference_spacy_tokens: These beautiful curls and a beautiful flowery band caught our eye .


fn_spacy_tokens_for_baseline: The hills loom heavily through the storm , single trees tossed and drenched by the downpour .

source_bert_toks: the hills lo ##om heavily through the storm , single trees tossed and drenched by the down ##pour .

reference_raw: The hills loomed heavily through the storm, the only trees thrown and wet by the rain.

reference_spacy_tokens: The hills loomed heavily through the storm , the only trees thrown and wet by the rain .


fn_spacy_tokens_for_baseline: He must inform the officials to settle the matter .

source_bert_toks: he must inform the officials to settle the matter .

reference_raw: They have to notify the officials to settle the matter.

reference_spacy_tokens: They have to notify the officials to settle the matter .


fn_spacy_tokens_for_baseline: Seven people were reported killed in a series of pre - dawn air raids on two Croat villages , which Yugoslav army commanders said were in retaliation for attacks on an air base in the regional centre of Mostar nearby .

source_bert_toks: seven people were reported killed in a series of pre - dawn air raids on two cr ##oat villages , which yugoslav army commanders said were in retaliation for attacks on an air base in the regional centre of most ##ar nearby .

reference_raw: Seven people were reported to have been killed in a series of pre-dawn air raids on two Croatian villages, reported to have been retaliated by Yugoslav military commanders for attacking an air base in the regional center of Mostar nearby.

reference_spacy_tokens: Seven people were reported to have been killed in a series of pre - dawn air raids on two Croatian villages , reported to have been retaliated by Yugoslav military commanders for attacking an air base in the regional center of Mostar nearby .


fn_spacy_tokens_for_baseline: The Navigator 's large eyes assessed her gown of iridescent Sirian silk tied at the waist with a casual scarlet sash , her silverfur stole , her curly - toed slippers .

source_bert_toks: the navigator ' s large eyes assessed her gown of ir ##ides ##cent sir ##ian silk tied at the waist with a casual scarlet sash , her silver ##fur stole , her curly - toe ##d slip ##pers .

reference_raw: The Navigator's big eyes examined the dress of iridescent Sirian silk tied at the waist with a casual scarlet sass, the stolen silverfur, and the curly-toed slippers.

reference_spacy_tokens: The Navigator 's big eyes examined the dress of iridescent Sirian silk tied at the waist with a casual scarlet sass , the stolen silverfur , and the curly - toed slippers .


fn_spacy_tokens_for_baseline: From Washington 's perspective , " improved implementation of the Agreed Framework " meant an acceleration of safeguards inspections , even though the agreement did not require Pyongyang to submit to full safeguards inspections to verify its past activities until a significant portion of the reactor construction was completed but before the delivery of critical reactor components .

source_bert_toks: from washington ' s perspective , " improved implementation of the agreed framework " meant an acceleration of safeguard ##s inspections , even though the agreement did not require p ##yon ##gy ##ang to submit to full safeguard ##s inspections to verify its past activities until a significant portion of the reactor construction was completed but before the delivery of critical reactor components .

reference_raw: From Washington's point of view, "improved implementation of the agreed framework" meant speeding up security inspections, although the agreement did not require Pyongyang to undergo full security inspections to verify its previous activities until a significant part of the reactor construction was completed, but before the delivery of critical reactor components.

reference_spacy_tokens: From Washington 's point of view , " improved implementation of the agreed framework " meant speeding up security inspections , although the agreement did not require Pyongyang to undergo full security inspections to verify its previous activities until a significant part of the reactor construction was completed , but before the delivery of critical reactor components .


fn_spacy_tokens_for_baseline: Every currently available indicator of health need is inadequate in one way or another .

source_bert_toks: every currently available indicator of health need is inadequate in one way or another .

reference_raw: All currently available health needs indicators are insufficient in one way or another.

reference_spacy_tokens: All currently available health needs indicators are insufficient in one way or another .


fn_spacy_tokens_for_baseline: He magnified that viewpoint , allowing it a quarter of the eye - screen .

source_bert_toks: he mag ##nified that viewpoint , allowing it a quarter of the eye - screen .

reference_raw: He enlarged the viewpoint and gave it a quarter of the screen.

reference_spacy_tokens: He enlarged the viewpoint and gave it a quarter of the screen .


fn_spacy_tokens_for_baseline: We 've had our spats which have lasted a few months , but if anything , I think that sort of thing strengthens a friendship .

source_bert_toks: we ' ve had our spat ##s which have lasted a few months , but if anything , i think that sort of thing strengthen ##s a friendship .

reference_raw: We had our spits that lasted a couple of months, but if anything, I think this kind of thing strengthens friendship.

reference_spacy_tokens: We had our spits that lasted a couple of months , but if anything , I think this kind of thing strengthens friendship .


fn_spacy_tokens_for_baseline: Fujitsu is also a licensee of the Sparc architecture , but does not currently fabricate a device in the HyperSparc class .

source_bert_toks: fuji ##tsu is also a license ##e of the spa ##rc architecture , but does not currently fabric ##ate a device in the hyper ##spar ##c class .

reference_raw: Fujitsu is also a licensee of the Sparc Architecture, but does not currently invent a device in the HyperSparc class.

reference_spacy_tokens: Fujitsu is also a licensee of the Sparc Architecture , but does not currently invent a device in the HyperSparc class .


fn_spacy_tokens_for_baseline: Barry stated that ' stepping aside now is good for the city ' , and denied suggestions that the move was aimed at eliciting sympathy from the jury .

source_bert_toks: barry stated that ' stepping aside now is good for the city ' , and denied suggestions that the move was aimed at eli ##cit ##ing sympathy from the jury .

reference_raw: Barry said that it was good for the city to step aside now, and denied the suggestion that the move was meant to attract sympathy from the jury.

reference_spacy_tokens: Barry said that it was good for the city to step aside now , and denied the suggestion that the move was meant to attract sympathy from the jury .


fn_spacy_tokens_for_baseline: It had to be performed a second time , after the British Consul had taken the couple 's oaths on his diary instead of the Bible .

source_bert_toks: it had to be performed a second time , after the british consul had taken the couple ' s oath ##s on his diary instead of the bible .

reference_raw: It had to be done a second time, after the British Consul had sworn to the couple in his journal instead of the Bible.

reference_spacy_tokens: It had to be done a second time , after the British Consul had sworn to the couple in his journal instead of the Bible .


fn_spacy_tokens_for_baseline: As he did so , he leaned on the horn for a long blast , to let the others know he was clear .

source_bert_toks: as he did so , he leaned on the horn for a long blast , to let the others know he was clear .

reference_raw: He leaned against the corner for a long shot, letting the others know he was clean.

reference_spacy_tokens: He leaned against the corner for a long shot , letting the others know he was clean .


fn_spacy_tokens_for_baseline: Ariel clasps Roukoube and runs towards the sea ; the shadows conceal her , she hears the shot , but then she splashes into the shoals and turns to run along the tideline to keep her bearings in the dark .

source_bert_toks: ariel clasp ##s ro ##uk ##ou ##be and runs towards the sea ; the shadows conceal her , she hears the shot , but then she splash ##es into the sho ##als and turns to run along the tide ##line to keep her bearings in the dark .

reference_raw: Ariel grabs Roukoube and runs to the sea; the shadows hide her, she hears the shot, but then she splashes into the shallows and turns to run along the tidal line to keep her bearings in the darkness.

reference_spacy_tokens: Ariel grabs Roukoube and runs to the sea ; the shadows hide her , she hears the shot , but then she splashes into the shallows and turns to run along the tidal line to keep her bearings in the darkness .


fn_spacy_tokens_for_baseline: She might have gone away ; on the other hand , she might be waiting outside the door , holding her breath and with an attendant clergyman and two bridesmaids standing behind her fingering sacrificial implements .

source_bert_toks: she might have gone away ; on the other hand , she might be waiting outside the door , holding her breath and with an attendant clergyman and two bride ##sma ##ids standing behind her finger ##ing sac ##ri ##fi ##cial implements .

reference_raw: She could have left; on the other hand, she could have waited outside the door, holding her breath, with a servant priest and two bridesmaids standing behind her fingering sacrificial instruments.

reference_spacy_tokens: She could have left ; on the other hand , she could have waited outside the door , holding her breath , with a servant priest and two bridesmaids standing behind her fingering sacrificial instruments .


fn_spacy_tokens_for_baseline: Many Western companies , frustrated by restrictions on sales to the eastern bloc , are likely to find the Soviet technology sales drive particularly galling .

source_bert_toks: many western companies , frustrated by restrictions on sales to the eastern bloc , are likely to find the soviet technology sales drive particularly gall ##ing .

reference_raw: Many Western companies, disappointed by restrictions on sales to the Eastern Bloc, are likely to find Soviet technology sales drives particularly galling.

reference_spacy_tokens: Many Western companies , disappointed by restrictions on sales to the Eastern Bloc , are likely to find Soviet technology sales drives particularly galling .


fn_spacy_tokens_for_baseline: In the midst of the crowd a huddle of men and women were using a flat - topped gravestone as a table .

source_bert_toks: in the midst of the crowd a hu ##ddle of men and women were using a flat - topped graves ##tone as a table .

reference_raw: A crowd of men and women used a flat-topped tombstone as a table in the middle of the crowd.

reference_spacy_tokens: A crowd of men and women used a flat - topped tombstone as a table in the middle of the crowd .


fn_spacy_tokens_for_baseline: Instead of the Baroque or modern architect , Sitte promulgated the values of the mediaeval master builder .

source_bert_toks: instead of the baroque or modern architect , sit ##te prom ##ul ##gated the values of the media ##eva ##l master builder .

reference_raw: Instead of a baroque or modern architect, Sitte proclaimed the values of a medieval main builder.

reference_spacy_tokens: Instead of a baroque or modern architect , Sitte proclaimed the values of a medieval main builder .


fn_spacy_tokens_for_baseline: The superintendent slid out of the car and tried to rub the tiredness from her eyes , respiring the chill of the night like an elixir .

source_bert_toks: the superintendent slid out of the car and tried to rub the tired ##ness from her eyes , res ##pi ##ring the chill of the night like an eli ##xi ##r .

reference_raw: The superintendent slipped out of the car and tried to wipe the fatigue out of her eyes, breathing the chill of the night like an elixir.

reference_spacy_tokens: The superintendent slipped out of the car and tried to wipe the fatigue out of her eyes , breathing the chill of the night like an elixir .


fn_spacy_tokens_for_baseline: A short bus ride away is Cheung Sha Beach , 3 km ( 2 miles ) long , and popular for its white sand and excellent facilities .

source_bert_toks: a short bus ride away is cheung sha beach , 3 km ( 2 miles ) long , and popular for its white sand and excellent facilities .

reference_raw: The short bus ride from here is Cheung Sha Beach, three kilometers (two miles) long, and it's favorite for its white sand and excellent equipment.

reference_spacy_tokens: The short bus ride from here is Cheung Sha Beach , three kilometers ( two miles ) long , and it 's favorite for its white sand and excellent equipment .


fn_spacy_tokens_for_baseline: Sir James Reckitt did some amateur excavating when he lived at the manor and some stones , which could have formed church windows , can still be seen in the gardens of houses since built on the site .

source_bert_toks: sir james rec ##kit ##t did some amateur ex ##ca ##vating when he lived at the manor and some stones , which could have formed church windows , can still be seen in the gardens of houses since built on the site .

reference_raw: Sir James Reckitt had done some amateur digs when he lived in the mansion, and some of the stones that might have formed the windows of the church were still visible in the gardens of the houses since they had been built there.

reference_spacy_tokens: Sir James Reckitt had done some amateur digs when he lived in the mansion , and some of the stones that might have formed the windows of the church were still visible in the gardens of the houses since they had been built there .


fn_spacy_tokens_for_baseline: ' It 's my story , I lived it , ' says Singleton , describing how he convinced a major studio to let an untried student director loose on a feature .

source_bert_toks: ' it ' s my story , i lived it , ' says singleton , describing how he convinced a major studio to let an un ##tri ##ed student director loose on a feature .

reference_raw: "It's my story, I've lived it," Singleton says, describing how he'd persuaded the main studio to let the untried student director go free.

reference_spacy_tokens: " It 's my story , I 've lived it , " Singleton says , describing how he 'd persuaded the main studio to let the untried student director go free .


fn_spacy_tokens_for_baseline: During their lives faithful Roman Catholics are taught that by certain sacraments a person becomes a Christian , obtains ongoing pardon for sins and is prepared for the life hereafter .

source_bert_toks: during their lives faithful roman catholics are taught that by certain sacrament ##s a person becomes a christian , obtain ##s ongoing pardon for sins and is prepared for the life here ##af ##ter .

reference_raw: Throughout their lives, loyal Roman Catholics are taught that by some sacraments, one becomes a Christian, receives continued forgiveness for sins, and is prepared for the life that follows.

reference_spacy_tokens: Throughout their lives , loyal Roman Catholics are taught that by some sacraments , one becomes a Christian , receives continued forgiveness for sins , and is prepared for the life that follows .


fn_spacy_tokens_for_baseline: We also suggest that for VPA there appears to be effects of collinearity between age and hair color , and possibly dose and hair color .

source_bert_toks: we also suggest that for vp ##a there appears to be effects of collin ##ear ##ity between age and hair color , and possibly dose and hair color .

reference_raw: We also suggest that for VPA there appear to be effects of collinearity between age and hair colour, possibly dose and hair colour.

reference_spacy_tokens: We also suggest that for VPA there appear to be effects of collinearity between age and hair colour , possibly dose and hair colour .


fn_spacy_tokens_for_baseline: The storks and cranes ( H ) who forage for their food have a neck with a sagging curve -- elegant , nevertheless

source_bert_toks: the st ##or ##ks and cranes ( h ) who for ##age for their food have a neck with a sa ##gging curve - - elegant , nevertheless

reference_raw: Storks and cranes (H) that feed for food have a neck with a sinuous curve - elegant but elegant

reference_spacy_tokens: Storks and cranes ( H ) that feed for food have a neck with a sinuous curve - elegant but elegant


fn_spacy_tokens_for_baseline: He said in a kindly voice , ' I 'll write you a prescription for sleeping pills , and a mild tranquilliser . '

source_bert_toks: he said in a kindly voice , ' i ' ll write you a prescription for sleeping pills , and a mild tran ##quil ##lis ##er . '

reference_raw: "I'll write you a prescription for sleeping pills and a mild sedative," he said gently.

reference_spacy_tokens: " I 'll write you a prescription for sleeping pills and a mild sedative , " he said gently .


fn_spacy_tokens_for_baseline: Ah sink you weeel remaaamber me , your old chum Erique from 1991 - 2 when ah played for ze Leeds .

source_bert_toks: ah sink you wee ##el re ##ma ##aa ##mber me , your old chu ##m er ##ique from 1991 - 2 when ah played for ze leeds .

reference_raw: Ah sink you weel again, your old friend Erique of 1991-2, when Ah played for Ze Leeds.

reference_spacy_tokens: Ah sink you weel again , your old friend Erique of 1991 - 2 , when Ah played for Ze Leeds .


fn_spacy_tokens_for_baseline: However , while Oracle and Informix have raised their prices , TransTools prices have been reduced .

source_bert_toks: however , while oracle and inform ##ix have raised their prices , trans ##to ##ols prices have been reduced .

reference_raw: However, while Oracle and Informix increased their prices, the prices of TransTools were reduced.

reference_spacy_tokens: However , while Oracle and Informix increased their prices , the prices of TransTools were reduced .


fn_spacy_tokens_for_baseline: Individual bouts are also decided by sudden - death contests .

source_bert_toks: individual bouts are also decided by sudden - death contests .

reference_raw: The individual courses are also decided by a sudden death contest.

reference_spacy_tokens: The individual courses are also decided by a sudden death contest .


fn_spacy_tokens_for_baseline: I have already noted his rejection of utilitarianism as an interpretation of the aim and purpose of life .

source_bert_toks: i have already noted his rejection of ut ##ili ##tarian ##ism as an interpretation of the aim and purpose of life .

reference_raw: I have already seen his refusal to accept utilitarianism as an interpretation of the purpose and purpose of life.

reference_spacy_tokens: I have already seen his refusal to accept utilitarianism as an interpretation of the purpose and purpose of life .


fn_spacy_tokens_for_baseline: The fiddle sobbed and wailed .

source_bert_toks: the fiddle sobbed and wai ##led .

reference_raw: The violin wept and moaned.

reference_spacy_tokens: The violin wept and moaned .


fn_spacy_tokens_for_baseline: But was it a life choice that Bob ever regretted ?

source_bert_toks: but was it a life choice that bob ever regretted ?

reference_raw: But was it a choice of life Bob was ever sorry about?

reference_spacy_tokens: But was it a choice of life Bob was ever sorry about ?


fn_spacy_tokens_for_baseline: Hall will be only the second member of Congress to travel in Iraq since the war , according to Hall 's office .

source_bert_toks: hall will be only the second member of congress to travel in iraq since the war , according to hall ' s office .

reference_raw: According to Hall's office, Hall will be just another member of Congress who's been traveling to Iraq since the war.

reference_spacy_tokens: According to Hall 's office , Hall will be just another member of Congress who 's been traveling to Iraq since the war .


fn_spacy_tokens_for_baseline: Renwick followed slowly , gave her time to take the elevator before he passed the reception desk .

source_bert_toks: ren ##wick followed slowly , gave her time to take the elevator before he passed the reception desk .

reference_raw: Renwick followed slowly, giving her time to take the lift before passing the desk.

reference_spacy_tokens: Renwick followed slowly , giving her time to take the lift before passing the desk .


fn_spacy_tokens_for_baseline: The principal settlements are Yung Shue Wan on Lamma 's northwest , and Sok Kwu Wan , on the east coast .

source_bert_toks: the principal settlements are yun ##g shu ##e wan on lam ##ma ' s northwest , and so ##k kw ##u wan , on the east coast .

reference_raw: The main settlements are Yung Shue Wan on the north-west of Lamma and Sok Kwu Wan on the east coast.

reference_spacy_tokens: The main settlements are Yung Shue Wan on the north - west of Lamma and Sok Kwu Wan on the east coast .


fn_spacy_tokens_for_baseline: ' And all parasites must be destroyed , ' Jinkwa concluded .

source_bert_toks: ' and all parasites must be destroyed , ' jin ##k ##wa concluded .

reference_raw: 'And all the parasites must be destroyed,' said Jinkwa.

reference_spacy_tokens: ' And all the parasites must be destroyed , ' said Jinkwa .


fn_spacy_tokens_for_baseline: It contains elaborate replicas of China 's chief monments in impressive detail , including a scaled - down version of the Great Wall .

source_bert_toks: it contains elaborate replica ##s of china ' s chief mon ##ments in impressive detail , including a scaled - down version of the great wall .

reference_raw: It includes intricate replicas of China's main monments in impressive detail, including the scaled-down version of the Great Wall.

reference_spacy_tokens: It includes intricate replicas of China 's main monments in impressive detail , including the scaled - down version of the Great Wall .


fn_spacy_tokens_for_baseline: Daily newspapers were far more aware of how society was changing and in 1929 London 's Daily Express invited its readers to send in postcards giving their own views on films .

source_bert_toks: daily newspapers were far more aware of how society was changing and in 1929 london ' s daily express invited its readers to send in post ##cards giving their own views on films .

reference_raw: The day-to-day newspapers were much more aware of the change in society, and in 1929 London's Day Express invited its readers to send postcards giving their own views on the films.

reference_spacy_tokens: The day - to - day newspapers were much more aware of the change in society , and in 1929 London 's Day Express invited its readers to send postcards giving their own views on the films .


fn_spacy_tokens_for_baseline: Harry may be reticent about praising his son -- but Barnsley boss Mel Machin certainly is n't .

source_bert_toks: harry may be re ##tic ##ent about praising his son - - but barnsley boss mel mach ##in certainly isn ' t .

reference_raw: Harry may be reluctant to praise his son - but Barnsley's boss, Mel Machin, is not.

reference_spacy_tokens: Harry may be reluctant to praise his son - but Barnsley 's boss , Mel Machin , is not .


fn_spacy_tokens_for_baseline: Khrushchev could never forgive him for the cruelties and stupidities that brought Russia so close to defeat by Hitler .

source_bert_toks: k ##hr ##ush ##chev could never forgive him for the cruel ##ties and stupid ##ities that brought russia so close to defeat by hitler .

reference_raw: Khrushchev had never been able to excuse the cruelty and stupidity that had brought Russia so close to Hitler's defeat.

reference_spacy_tokens: Khrushchev had never been able to excuse the cruelty and stupidity that had brought Russia so close to Hitler 's defeat .


fn_spacy_tokens_for_baseline: At the time of our review , the Logistics Center was on track to meet or exceed its goals .

source_bert_toks: at the time of our review , the logistics center was on track to meet or exceed its goals .

reference_raw: At the time of our review, the Logistics Center was on its way to achieving or exceeding its objectives.

reference_spacy_tokens: At the time of our review , the Logistics Center was on its way to achieving or exceeding its objectives .


fn_spacy_tokens_for_baseline: Collinsworth was among four Marines killed Oct. 21 when a roadside bomb exploded near their Humvee in Al Anbar province , west of Baghdad .

source_bert_toks: collins ##worth was among four marines killed oct . 21 when a roadside bomb exploded near their hum ##ve ##e in al an ##bar province , west of baghdad .

reference_raw: Collinsworth was one of the four Marines killed October 21 when a road bomb blew up near their Humvee in the province of Al Anbar, west of Baghdad.

reference_spacy_tokens: Collinsworth was one of the four Marines killed October 21 when a road bomb blew up near their Humvee in the province of Al Anbar , west of Baghdad .


fn_spacy_tokens_for_baseline: Some 50 vehicles drove the 4-mile circuit including a vintage coach , horse drawn brewery dray , solar powered car , various commercial vehicles including our own , and a few classic cars for good measure .

source_bert_toks: some 50 vehicles drove the 4 - mile circuit including a vintage coach , horse drawn brewery dr ##ay , solar powered car , various commercial vehicles including our own , and a few classic cars for good measure .

reference_raw: About 50 vehicles ran a four-mile radius, including a vintage coach, a horse-drawn brewery, a solar-powered car, a variety of commercial vehicles, including ours, and a few classic cars for good measure.

reference_spacy_tokens: About 50 vehicles ran a four - mile radius , including a vintage coach , a horse - drawn brewery , a solar - powered car , a variety of commercial vehicles , including ours , and a few classic cars for good measure .


fn_spacy_tokens_for_baseline: It must crash and strike sparks above them .

source_bert_toks: it must crash and strike sparks above them .

reference_raw: It's got to crash and hit the sparks over them.

reference_spacy_tokens: It 's got to crash and hit the sparks over them .


fn_spacy_tokens_for_baseline: Perhaps what makes the M. C. R. / S. C. R. relations in this College work is that both groups are accessible to each other for consultation and , very rarely , confrontation .

source_bert_toks: perhaps what makes the m . c . r . / s . c . r . relations in this college work is that both groups are accessible to each other for consultation and , very rarely , confrontation .

reference_raw: Perhaps the reason why the M.C.R./S.C.R. relationship in this college work is that the two groups are available to each other for consultation and, very rarely, for confrontation.

reference_spacy_tokens: Perhaps the reason why the M.C.R./S.C.R. relationship in this college work is that the two groups are available to each other for consultation and , very rarely , for confrontation .


fn_spacy_tokens_for_baseline: ' What was that all about ? ' he asked curiously , pocketing the note without hesitation .

source_bert_toks: ' what was that all about ? ' he asked curiously , pocket ##ing the note without hesitation .

reference_raw: "What's that supposed to mean?" he asked curiously, putting the note in his hand without hesitation.

reference_spacy_tokens: " What 's that supposed to mean ? " he asked curiously , putting the note in his hand without hesitation .


fn_spacy_tokens_for_baseline: Her voice was gruff , and sounded contemptuous , but in her eyes were bewilderment and pain .

source_bert_toks: her voice was gruff , and sounded contempt ##uous , but in her eyes were be ##wil ##der ##ment and pain .

reference_raw: Her voice was gruff and scornful, but there was confusion and pain in her eyes.

reference_spacy_tokens: Her voice was gruff and scornful , but there was confusion and pain in her eyes .


fn_spacy_tokens_for_baseline: Formalin - fixed tissues were embedded in paraffin .

source_bert_toks: formal ##in - fixed tissues were embedded in para ##ffin .

reference_raw: The tissues attached to formalin were inserted into paraffin.

reference_spacy_tokens: The tissues attached to formalin were inserted into paraffin .


fn_spacy_tokens_for_baseline: Every inch of its exterior metal is galvanised against corrosion .

source_bert_toks: every inch of its exterior metal is gal ##vani ##sed against corrosion .

reference_raw: Every inch of the outer metal is galvanized against corrosion.

reference_spacy_tokens: Every inch of the outer metal is galvanized against corrosion .


fn_spacy_tokens_for_baseline: She had met her connection in the usual place but the moment the deal was struck they were busted by three plainclothes policemen who had been watching them from an unmarked car on the opposite side of the road .

source_bert_toks: she had met her connection in the usual place but the moment the deal was struck they were busted by three plain ##cloth ##es policemen who had been watching them from an unmarked car on the opposite side of the road .

reference_raw: She met her connection in the usual place, but by the time the deal was made, three plainclothes cops were arresting them from an unmarked car on the other side of the road.

reference_spacy_tokens: She met her connection in the usual place , but by the time the deal was made , three plainclothes cops were arresting them from an unmarked car on the other side of the road .


fn_spacy_tokens_for_baseline: He wrinkled his nose in distaste at the acrid smell of the place .

source_bert_toks: he wrinkled his nose in di ##sta ##ste at the ac ##rid smell of the place .

reference_raw: The acrid smell of the place made him crumple his nose in disgust.

reference_spacy_tokens: The acrid smell of the place made him crumple his nose in disgust .


fn_spacy_tokens_for_baseline: This article outlines recent research on residential care and its alternatives for troubled youngsters in Flanders , the Netherlands , and the United Kingdom .

source_bert_toks: this article outlines recent research on residential care and its alternatives for troubled young ##sters in flanders , the netherlands , and the united kingdom .

reference_raw: This article describes recent research into housing care and alternatives for troubled young people in Flanders, the Netherlands and the United Kingdom.

reference_spacy_tokens: This article describes recent research into housing care and alternatives for troubled young people in Flanders , the Netherlands and the United Kingdom .


fn_spacy_tokens_for_baseline: Why do people think that inserting a candle into something they have no further use for renders it an indispensable household utensil instead of litter they should be taking home in their rucksacks ?

source_bert_toks: why do people think that insert ##ing a candle into something they have no further use for render ##s it an ind ##is ##pen ##sable household ut ##ens ##il instead of litter they should be taking home in their ru ##cks ##ack ##s ?

reference_raw: Why do people think putting a candle in something they can't use anymore makes it a necessary household dish instead of litter they should take home in their backpacks?

reference_spacy_tokens: Why do people think putting a candle in something they ca n't use anymore makes it a necessary household dish instead of litter they should take home in their backpacks ?


fn_spacy_tokens_for_baseline: Hekmatyar threatened to ' mount the last act ' if the Uzbeks did not vacate Kabul within a week to 10 days .

source_bert_toks: he ##km ##at ##yar threatened to ' mount the last act ' if the u ##zbek ##s did not va ##cate kabul within a week to 10 days .

reference_raw: Hekmatyar threatened to mount the last act unless the Uzbeks evacuated Kabul within a week or ten days.

reference_spacy_tokens: Hekmatyar threatened to mount the last act unless the Uzbeks evacuated Kabul within a week or ten days .


fn_spacy_tokens_for_baseline: The smell of rotten oranges from the alley was strong as the swing - doors were pushed open .

source_bert_toks: the smell of rotten orange ##s from the alley was strong as the swing - doors were pushed open .

reference_raw: When the swing door opened, the smell of rotting oranges from the alley was strong.

reference_spacy_tokens: When the swing door opened , the smell of rotting oranges from the alley was strong .


fn_spacy_tokens_for_baseline: In the summer of 1993 , the Marion County Commission on Youth began what can best be described as a " new era " in its history .

source_bert_toks: in the summer of 1993 , the marion county commission on youth began what can best be described as a " new era " in its history .

reference_raw: In the summer of 1993, the Marion County Youth Commission began what could best be described as a "new era" in the past.

reference_spacy_tokens: In the summer of 1993 , the Marion County Youth Commission began what could best be described as a " new era " in the past .


fn_spacy_tokens_for_baseline: Her cheeks were already aglow from a combination of the heat and the exhilaration of being the centre of attention , and this had lent an extra , youthful radiance to her beauty .

source_bert_toks: her cheeks were already ag ##low from a combination of the heat and the ex ##hila ##ration of being the centre of attention , and this had lent an extra , youthful ra ##dian ##ce to her beauty .

reference_raw: Her face was already aglow from the combination of heat and joy of being the center of attention, and that gave her an extra, young glow.

reference_spacy_tokens: Her face was already aglow from the combination of heat and joy of being the center of attention , and that gave her an extra , young glow .


fn_spacy_tokens_for_baseline: Consigned to the obituary column more times than he 's popped a pill or praised the Lord , Johnny Cash continues to confound critics and medical science by bouncing back every year with a new triumph .

source_bert_toks: con ##si ##gned to the obituary column more times than he ' s popped a pill or praised the lord , johnny cash continues to con ##fo ##und critics and medical science by bouncing back every year with a new triumph .

reference_raw: Consigned to the obituary column more times than he took a pill or praised God, Johnny Cash continues to confuse critics and medical science with a new triumph each year.

reference_spacy_tokens: Consigned to the obituary column more times than he took a pill or praised God , Johnny Cash continues to confuse critics and medical science with a new triumph each year .


fn_spacy_tokens_for_baseline: Sweat soaking into my shirt , my jeans .

source_bert_toks: sweat soaking into my shirt , my jeans .

reference_raw: I'm sweating into my shirt and jeans.

reference_spacy_tokens: I 'm sweating into my shirt and jeans .


fn_spacy_tokens_for_baseline: The Prime Minister 's latest ambition is to close the ozone gap and save the world from the greenhouse effect .

source_bert_toks: the prime minister ' s latest ambition is to close the ozone gap and save the world from the greenhouse effect .

reference_raw: The prime minister's last goal is to close the ozone gap and save the world from the greenhouse effect.

reference_spacy_tokens: The prime minister 's last goal is to close the ozone gap and save the world from the greenhouse effect .


fn_spacy_tokens_for_baseline: Knowledge was taken to be the product of an extended logical essay -- the output of the repeated application in a single coherent text of the technique of examining an assertion to determine all of its implications . '

source_bert_toks: knowledge was taken to be the product of an extended logical essay - - the output of the repeated application in a single coherent text of the technique of examining an assertion to determine all of its implications . '

reference_raw: Knowledge was considered to be the result of an extended logical essay - the result of a reuse in a single, coherent version of the method of examining the claim in order to determine all its consequences.'

reference_spacy_tokens: Knowledge was considered to be the result of an extended logical essay - the result of a reuse in a single , coherent version of the method of examining the claim in order to determine all its consequences . '


fn_spacy_tokens_for_baseline: Kirov exhaled a long , shuddering breath .

source_bert_toks: ki ##rov exhaled a long , shuddering breath .

reference_raw: Kirov took a long, trembling breath.

reference_spacy_tokens: Kirov took a long , trembling breath .


fn_spacy_tokens_for_baseline: As Kate , Michael and Mike Mills each have a crack at the title line , Peter Buck offers one of his neatest trademark guitar hooks .

source_bert_toks: as kate , michael and mike mills each have a crack at the title line , peter buck offers one of his neat ##est trademark guitar hooks .

reference_raw: While Kate, Michael, and Mike Mills each have a crack in the headline, Peter Buck is offering one of his finest brand-new guitar hooks.

reference_spacy_tokens: While Kate , Michael , and Mike Mills each have a crack in the headline , Peter Buck is offering one of his finest brand - new guitar hooks .


fn_spacy_tokens_for_baseline: In the corner , Sue is receiving head from Martin the Brummie and she stares glazedly into space , her pigtails bobbing with the motion .

source_bert_toks: in the corner , sue is receiving head from martin the br ##um ##mie and she stares glazed ##ly into space , her pig ##tails bob ##bing with the motion .

reference_raw: In the corner, Sue receives the head of Martin the Brummie and glares into space, her tail bobbing with movement.

reference_spacy_tokens: In the corner , Sue receives the head of Martin the Brummie and glares into space , her tail bobbing with movement .


fn_spacy_tokens_for_baseline: She drew in deeply and exhaled through her nose , then snapped the cigarette briskly from her mouth and pointed it at him with a flourish .

source_bert_toks: she drew in deeply and exhaled through her nose , then snapped the cigarette brisk ##ly from her mouth and pointed it at him with a flourish .

reference_raw: She took a deep breath and let it out through her nose, then quickly snapped the cigarette out of her mouth and pointed it at him with a flourish.

reference_spacy_tokens: She took a deep breath and let it out through her nose , then quickly snapped the cigarette out of her mouth and pointed it at him with a flourish .


fn_spacy_tokens_for_baseline: Yet anyone who read the popular literature on the subject from the 50s found a massive denunciation of the welfare state which was blamed solely on the growing decline in parental responsibility .

source_bert_toks: yet anyone who read the popular literature on the subject from the 50 ##s found a massive den ##unciation of the welfare state which was blamed solely on the growing decline in parental responsibility .

reference_raw: But anyone who had read the popular literature on the subject in the '50s had found a massive abandonment of the welfare state, blamed solely on the growing decline in parental responsibility.

reference_spacy_tokens: But anyone who had read the popular literature on the subject in the ' 50s had found a massive abandonment of the welfare state , blamed solely on the growing decline in parental responsibility .


fn_spacy_tokens_for_baseline: First , Franco still held out hope of a late Axis victory , believing -- astonishingly -- that Hitler possessed and would soon deploy secret weapons and ' cosmic rays ' .

source_bert_toks: first , franco still held out hope of a late axis victory , believing - - astonishing ##ly - - that hitler possessed and would soon deploy secret weapons and ' cosmic rays ' .

reference_raw: For one thing, Franco was still holding the chance of a late Axis victory, believing - surprisingly - that Hitler had and would soon deploy secret weapons and cosmic rays.

reference_spacy_tokens: For one thing , Franco was still holding the chance of a late Axis victory , believing - surprisingly - that Hitler had and would soon deploy secret weapons and cosmic rays .


fn_spacy_tokens_for_baseline: ' Call me a fucking thief one more time and I 'll smash your fucking face in ! '

source_bert_toks: ' call me a fucking thief one more time and i ' ll smash your fucking face in ! '

reference_raw: "Call me a fucking thief again and I'll break your fucking face!"

reference_spacy_tokens: " Call me a fucking thief again and I 'll break your fucking face ! "


fn_spacy_tokens_for_baseline: The FDA 's US Orphan Drug Act is intended to assist and encourage companies to develop safe and effective therapies for the treatment of rare diseases and disorders .

source_bert_toks: the fda ' s us orphan drug act is intended to assist and encourage companies to develop safe and effective the ##ra ##pies for the treatment of rare diseases and disorders .

reference_raw: The U.S. Orphan Drug Act of the FDA aims to help and encourage companies to develop safe and efficient treatments for rare diseases and disorders.

reference_spacy_tokens: The U.S. Orphan Drug Act of the FDA aims to help and encourage companies to develop safe and efficient treatments for rare diseases and disorders .


fn_spacy_tokens_for_baseline: Marlene 's got what it takes : nothing fazes her , except the ghosts of her past .

source_bert_toks: marlene ' s got what it takes : nothing fa ##zes her , except the ghosts of her past .

reference_raw: Marlene has what it takes: nothing fascinates her but the spirits of her past.

reference_spacy_tokens: Marlene has what it takes : nothing fascinates her but the spirits of her past .


fn_spacy_tokens_for_baseline: The heavies clump downstairs laughing , and they jeer all the way down the garden path .

source_bert_toks: the he ##avi ##es cl ##ump downstairs laughing , and they je ##er all the way down the garden path .

reference_raw: The heavy ones cluster down the stairs laughing and jeering all the way down the garden path.

reference_spacy_tokens: The heavy ones cluster down the stairs laughing and jeering all the way down the garden path .


fn_spacy_tokens_for_baseline: The control unit contains a special storage device or register , the program counter , which contains the address of the store location holding the next instruction to be executed or obeyed .

source_bert_toks: the control unit contains a special storage device or register , the program counter , which contains the address of the store location holding the next instruction to be executed or obeyed .

reference_raw: The control unit shall contain a special storage device or registry, a program counter, containing the address of the storage place where the following instructions are to be executed or followed.

reference_spacy_tokens: The control unit shall contain a special storage device or registry , a program counter , containing the address of the storage place where the following instructions are to be executed or followed .


fn_spacy_tokens_for_baseline: There was only one small regret she had about her tardiness : she was clearly far too late for breakfast , and she was feeling absolutely ravenous !

source_bert_toks: there was only one small regret she had about her tar ##dine ##ss : she was clearly far too late for breakfast , and she was feeling absolutely raven ##ous !

reference_raw: She had only one small regret for her tardiness: she was obviously too late for breakfast, and she felt absolutely hungry!

reference_spacy_tokens: She had only one small regret for her tardiness : she was obviously too late for breakfast , and she felt absolutely hungry !


fn_spacy_tokens_for_baseline: Her lungs burned as she inhaled foam ; she vomited .

source_bert_toks: her lungs burned as she inhaled foam ; she vomit ##ed .

reference_raw: When she breathed the foam, her lungs burned; she vomited.

reference_spacy_tokens: When she breathed the foam , her lungs burned ; she vomited .


fn_spacy_tokens_for_baseline: Werner never met W. E. Taylor [ q.v . ] , whose obituary she wrote ; while not rivalling his mastery of Swahili , she excelled him in her wide command of Bantu languages .

source_bert_toks: werner never met w . e . taylor [ q . v . ] , whose obituary she wrote ; while not rival ##ling his mastery of sw ##ah ##ili , she excelled him in her wide command of ban ##tu languages .

reference_raw: Werner had never met W.E. Taylor [Q.V.], whose obituary she had written; though she did not compete with Swahili's control, she excelled him in her broad command of Bantu languages.

reference_spacy_tokens: Werner had never met W.E. Taylor [ Q.V. ] , whose obituary she had written ; though she did not compete with Swahili 's control , she excelled him in her broad command of Bantu languages .


fn_spacy_tokens_for_baseline: The probability that the particle , say , passes through some particular point is found by adding up the waves associated with every possible history that passes through that point .

source_bert_toks: the probability that the particle , say , passes through some particular point is found by adding up the waves associated with every possible history that passes through that point .

reference_raw: The likelihood of a particle passing through, say, a specific point is found by adding the waves associated with each possible history that passes through that point.

reference_spacy_tokens: The likelihood of a particle passing through , say , a specific point is found by adding the waves associated with each possible history that passes through that point .


fn_spacy_tokens_for_baseline: Conrad was accordingly taken to task for not reporting to Rome and was ( wrongly ) reproved for taking part in the assembly .

source_bert_toks: conrad was accordingly taken to task for not reporting to rome and was ( wrongly ) rep ##roved for taking part in the assembly .

reference_raw: Conrad was therefore assigned a task that he did not report to Rome and was (wrongly) reproached for his participation in the assembly.

reference_spacy_tokens: Conrad was therefore assigned a task that he did not report to Rome and was ( wrongly ) reproached for his participation in the assembly .