fn_spacy_tokens_for_baseline: ' Your goose - bumps are getting goose - bumps , ' he said gently .

source_bert_toks: ' your goose - bumps are getting goose - bumps , ' he said gently .

reference_raw: "Your goose bumps are getting goose bumps," he said softly.

reference_spacy_tokens: " Your goose bumps are getting goose bumps , " he said softly .


fn_spacy_tokens_for_baseline: The sultan responded by sending an army of 7,000 men under Bekir Pasha , the Vizier of Bosnia , to discipline the dayis .

source_bert_toks: the sultan responded by sending an army of 7 , 000 men under be ##kir pasha , the viz ##ier of bosnia , to discipline the day ##is .

reference_raw: The Sultan responded by sending an army of 7,000 men under Bekir Pasha, Bosnia's Visier, to discipline the dayis.

reference_spacy_tokens: The Sultan responded by sending an army of 7,000 men under Bekir Pasha , Bosnia 's Visier , to discipline the dayis .


fn_spacy_tokens_for_baseline: She also upbraids me about the work I am engaged in at Schloss Hartheim .

source_bert_toks: she also up ##bra ##ids me about the work i am engaged in at sc ##hl ##oss hart ##heim .

reference_raw: He's also upbringing me about my job at Schloss Hartheim.

reference_spacy_tokens: He 's also upbringing me about my job at Schloss Hartheim .


fn_spacy_tokens_for_baseline: ' Aye , ' replied a wee voice below , recognising the threat .

source_bert_toks: ' aye , ' replied a wee voice below , rec ##og ##nis ##ing the threat .

reference_raw: 'Yes,' said a weep voice below, acknowledging the threat.

reference_spacy_tokens: ' Yes , ' said a weep voice below , acknowledging the threat .


fn_spacy_tokens_for_baseline: I was to see that the doors were open and the signal of a green or white light in a window which faced the drive was to give notice if all was safe or if the attempt had better be postponed .

source_bert_toks: i was to see that the doors were open and the signal of a green or white light in a window which faced the drive was to give notice if all was safe or if the attempt had better be postponed .

reference_raw: I was supposed to see that the door was open, and the sign of a green or white light in the window facing the driveway was to tell me if everything was secure or if the attempt had to be postponed.

reference_spacy_tokens: I was supposed to see that the door was open , and the sign of a green or white light in the window facing the driveway was to tell me if everything was secure or if the attempt had to be postponed .


fn_spacy_tokens_for_baseline: As evidence of the " ever - faster " nature of the city , by the middle of the 1990s the new approach showed signs of backlash , with many visitors criticizing the mediocrity of the Las Vegas experience .

source_bert_toks: as evidence of the " ever - faster " nature of the city , by the middle of the 1990s the new approach showed signs of backlash , with many visitors criticizing the med ##io ##cr ##ity of the las vegas experience .

reference_raw: In the mid-1990s, as evidence of the "ever-faster" character of the city, the new approach showed signs of backlash, and many visitors criticized the mediocrity of Las Vegas practice.

reference_spacy_tokens: In the mid-1990s , as evidence of the " ever - faster " character of the city , the new approach showed signs of backlash , and many visitors criticized the mediocrity of Las Vegas practice .


fn_spacy_tokens_for_baseline: When Jerry was released from prison , he knew it would take hard work and determination to straighten out his life .

source_bert_toks: when jerry was released from prison , he knew it would take hard work and determination to straighten out his life .

reference_raw: When Jerry got out of jail, he knew it would take a lot of hard work and determination to get his life back together.

reference_spacy_tokens: When Jerry got out of jail , he knew it would take a lot of hard work and determination to get his life back together .


fn_spacy_tokens_for_baseline: ' It 's not too much to say it 's the storm of the century , ' said Joe Friday , director of the National Weather Service .

source_bert_toks: ' it ' s not too much to say it ' s the storm of the century , ' said joe friday , director of the national weather service .

reference_raw: "I don't think it's a storm of the century," said Joe Friday, head of the National Weather Service.

reference_spacy_tokens: " I do n't think it 's a storm of the century , " said Joe Friday , head of the National Weather Service .


fn_spacy_tokens_for_baseline: Eva liked to sprinkle the house with about five papers and three magazines a day , skimming over Vogue and the New Statesman and the Daily Express before dumping the lot into the wastepaper basket beside the bed .

source_bert_toks: eva liked to sp ##rin ##kle the house with about five papers and three magazines a day , ski ##mming over vogue and the new statesman and the daily express before dumping the lot into the waste ##paper basket beside the bed .

reference_raw: Eva liked to spray the house with about five newspapers and three magazines a day, skimming over Vogue and the New Stateman and the Daily Express before she dumped the lot in the trash basket next to her bed.

reference_spacy_tokens: Eva liked to spray the house with about five newspapers and three magazines a day , skimming over Vogue and the New Stateman and the Daily Express before she dumped the lot in the trash basket next to her bed .


fn_spacy_tokens_for_baseline: Eventually I managed to find a page torn from a local bus timetable which showed the Province of Parma .

source_bert_toks: eventually i managed to find a page torn from a local bus timetable which showed the province of parma .

reference_raw: Finally, I found a page ripped from a local bus schedule that showed the province of Parma.

reference_spacy_tokens: Finally , I found a page ripped from a local bus schedule that showed the province of Parma .


fn_spacy_tokens_for_baseline: The animation is full of great touches : for example , a victorious knight removes his helmet and bows to his stricken foe , and the pirate takes a swig from his hip flask .

source_bert_toks: the animation is full of great touches : for example , a victorious knight removes his helmet and bows to his stricken foe , and the pirate takes a sw ##ig from his hip fl ##ask .

reference_raw: The animation is filled with great touches: for example, the victorious knight removes his helmet and bows to his stricken enemy, and the pirate takes a sip from his hip bottle.

reference_spacy_tokens: The animation is filled with great touches : for example , the victorious knight removes his helmet and bows to his stricken enemy , and the pirate takes a sip from his hip bottle .


fn_spacy_tokens_for_baseline: ' But you 've been a marvellous father , super , ' chirruped Deborah .

source_bert_toks: ' but you ' ve been a marvel ##lous father , super , ' chi ##rr ##up ##ed deborah .

reference_raw: 'But you were a wonderful father, super,' said Deborah.

reference_spacy_tokens: ' But you were a wonderful father , super , ' said Deborah .


fn_spacy_tokens_for_baseline: Travis looked surprised , and that aggravated her as much as his reply .

source_bert_toks: travis looked surprised , and that aggravated her as much as his reply .

reference_raw: Travis looked surprised, and that bothered her as much as his answer.

reference_spacy_tokens: Travis looked surprised , and that bothered her as much as his answer .


fn_spacy_tokens_for_baseline: At first it was also quite disorientating but incredibly fascinating as we swam through the clear water amongst a tremendous variety of brightly coloured fish , anemones , coral and sponges .

source_bert_toks: at first it was also quite di ##sor ##ient ##ating but incredibly fascinating as we swam through the clear water amongst a tremendous variety of brightly coloured fish , an ##emon ##es , coral and sponge ##s .

reference_raw: At first, it was quite disorienting, but unbelievably intriguing, as we swam through the clear water between a vast variety of brightly colored fish, anemones, corals, and mushrooms.

reference_spacy_tokens: At first , it was quite disorienting , but unbelievably intriguing , as we swam through the clear water between a vast variety of brightly colored fish , anemones , corals , and mushrooms .


fn_spacy_tokens_for_baseline: This was the beginning of several years of very active rock climbing on many crags .

source_bert_toks: this was the beginning of several years of very active rock climbing on many cr ##ags .

reference_raw: It was the beginning of a few years of very active rock climbing on many rocks.

reference_spacy_tokens: It was the beginning of a few years of very active rock climbing on many rocks .


fn_spacy_tokens_for_baseline: If your food tastes bland at first , add flavour with herbs and spices , particularly garlic .

source_bert_toks: if your food tastes bland at first , add flavour with herbs and spices , particularly garlic .

reference_raw: If your food first tastes thin, add flavour to the herbs and spices, especially garlic.

reference_spacy_tokens: If your food first tastes thin , add flavour to the herbs and spices , especially garlic .


fn_spacy_tokens_for_baseline: Oxborough , 30 , had admitted rape and was convicted of manslaughter .

source_bert_toks: ox ##borough , 30 , had admitted rape and was convicted of mans ##lau ##ght ##er .

reference_raw: Oxborough, 30, confessed to rape and was convicted of murder.

reference_spacy_tokens: Oxborough , 30 , confessed to rape and was convicted of murder .


fn_spacy_tokens_for_baseline: They had been strictly segregated from the ladies and gentlemen who entered by the front entrance and walked on carpet .

source_bert_toks: they had been strictly segregated from the ladies and gentlemen who entered by the front entrance and walked on carpet .

reference_raw: They were strictly separated from the ladies and gentlemen who entered the front door and walked on the carpet.

reference_spacy_tokens: They were strictly separated from the ladies and gentlemen who entered the front door and walked on the carpet .


fn_spacy_tokens_for_baseline: However , reports of transactions of various dual - use material is publicly known .

source_bert_toks: however , reports of transactions of various dual - use material is publicly known .

reference_raw: However, reports of operations of different dual-use materials are known to the public.

reference_spacy_tokens: However , reports of operations of different dual - use materials are known to the public .


fn_spacy_tokens_for_baseline: A phone tiff between him and Fergie was recorded by an eavesdropper , it was reported last night .

source_bert_toks: a phone ti ##ff between him and fe ##rg ##ie was recorded by an ea ##ves ##drop ##per , it was reported last night .

reference_raw: The phone link between him and Fergie was recorded by an eavesdropper, reported yesterday.

reference_spacy_tokens: The phone link between him and Fergie was recorded by an eavesdropper , reported yesterday .


fn_spacy_tokens_for_baseline: The man was thickset and heavy , like a rugby player , the woman thin and bony .

source_bert_toks: the man was thick ##set and heavy , like a rugby player , the woman thin and bony .

reference_raw: The man was thick and heavy, like a rugby player, and the woman was thin and bony.

reference_spacy_tokens: The man was thick and heavy , like a rugby player , and the woman was thin and bony .


fn_spacy_tokens_for_baseline: ' Gary can only answer by performing in the style we have grown accustomed to for the last few seasons . '

source_bert_toks: ' gary can only answer by performing in the style we have grown accustomed to for the last few seasons . '

reference_raw: "Gary can only answer by performing in the style we've been used to in the past few seasons."

reference_spacy_tokens: " Gary can only answer by performing in the style we 've been used to in the past few seasons . "


fn_spacy_tokens_for_baseline: If he sees a gleam of light , it is in the clubs -- some of them anyway -- who tackle the tourists before they play Wales .

source_bert_toks: if he sees a gleam of light , it is in the clubs - - some of them anyway - - who tackle the tourists before they play wales .

reference_raw: If he sees a flash of light, it's in the clubs - some of them, anyway - that deal with tourists before they play Wales.

reference_spacy_tokens: If he sees a flash of light , it 's in the clubs - some of them , anyway - that deal with tourists before they play Wales .


fn_spacy_tokens_for_baseline: Athelstan took the keys of the church , tied by a piece of string to the cord round his waist , and pressed them into Benedicta 's soft , warm hand .

source_bert_toks: at ##hel ##stan took the keys of the church , tied by a piece of string to the cord round his waist , and pressed them into benedict ##a ' s soft , warm hand .

reference_raw: Athelstan took the keys from the church, tied with a piece of rope around his waist, and pressed them into Benedict's soft, warm hand.

reference_spacy_tokens: Athelstan took the keys from the church , tied with a piece of rope around his waist , and pressed them into Benedict 's soft , warm hand .


fn_spacy_tokens_for_baseline: He opened the front door and stood for a moment on the step looking at the glimmer of light touching the pale dome of the church and the glow of the city thrown up against the sky .

source_bert_toks: he opened the front door and stood for a moment on the step looking at the g ##lim ##mer of light touching the pale dome of the church and the glow of the city thrown up against the sky .

reference_raw: He opened the front door and stood for a moment on the stairs, looking at the flash of light that touched the pale dome of the church and the light of the city against the sky.

reference_spacy_tokens: He opened the front door and stood for a moment on the stairs , looking at the flash of light that touched the pale dome of the church and the light of the city against the sky .


fn_spacy_tokens_for_baseline: In your otherwise excellent article you referred to Bob 's evasion of ' the sad dank dustbin of memory ' .

source_bert_toks: in your otherwise excellent article you referred to bob ' s eva ##sion of ' the sad dan ##k dust ##bin of memory ' .

reference_raw: In your otherwise excellent article, you mentioned Bob's escape from the "sad wet dustbin of memory."

reference_spacy_tokens: In your otherwise excellent article , you mentioned Bob 's escape from the " sad wet dustbin of memory . "


fn_spacy_tokens_for_baseline: My sister 's actually benefiting from the new tax cuts , but only because the job market 's been so shitty that she 's been living off of savings bonds .

source_bert_toks: my sister ' s actually benefit ##ing from the new tax cuts , but only because the job market ' s been so shitty that she ' s been living off of savings bonds .

reference_raw: My sister actually benefits from new tax cuts, but only because the labour market is so fucked up, she's on savings bonds.

reference_spacy_tokens: My sister actually benefits from new tax cuts , but only because the labour market is so fucked up , she 's on savings bonds .


fn_spacy_tokens_for_baseline: One cause for concern is that blood flowing through artificial organs tends to clot , which can lead to a stroke or to coronary heart disease .

source_bert_toks: one cause for concern is that blood flowing through artificial organs tends to cl ##ot , which can lead to a stroke or to corona ##ry heart disease .

reference_raw: One of the reasons for concern is that blood flowing through artificial organs tends to coagulate, which may lead to stroke or coronary heart disease.

reference_spacy_tokens: One of the reasons for concern is that blood flowing through artificial organs tends to coagulate , which may lead to stroke or coronary heart disease .


fn_spacy_tokens_for_baseline: But , as broad - minded and liberal as they are , they are choosy and unlikely to hop from one bed to the next .

source_bert_toks: but , as broad - minded and liberal as they are , they are cho ##os ##y and unlikely to hop from one bed to the next .

reference_raw: But as broad and liberal as they are, they're choosy and unlikely to jump from one bed to another.

reference_spacy_tokens: But as broad and liberal as they are , they 're choosy and unlikely to jump from one bed to another .


fn_spacy_tokens_for_baseline: Rarely will a formal dissolution of the firm be a more acceptable method of disassociation from a miscreant partner .

source_bert_toks: rarely will a formal dissolution of the firm be a more acceptable method of di ##sas ##so ##ciation from a mis ##cre ##ant partner .

reference_raw: A formal dissolution of a company will rarely be a more acceptable way of dissociating itself from a rogue partner.

reference_spacy_tokens: A formal dissolution of a company will rarely be a more acceptable way of dissociating itself from a rogue partner .


fn_spacy_tokens_for_baseline: Following their narrow 77 - 74 defeat in Moscow last year , England needed to exact revenge by at least four points to stay on course for next summer 's finals in Germany .

source_bert_toks: following their narrow 77 - 74 defeat in moscow last year , england needed to exact revenge by at least four points to stay on course for next summer ' s finals in germany .

reference_raw: After their close 77-74 defeat in Moscow last year, England had to retaliate by at least four points in order to stay on course for the next summer's finals in Germany.

reference_spacy_tokens: After their close 77 - 74 defeat in Moscow last year , England had to retaliate by at least four points in order to stay on course for the next summer 's finals in Germany .


fn_spacy_tokens_for_baseline: " NATO can only be stopped by a strict denouncement from the nuclear powers , in particular from Russia and China , " he said .

source_bert_toks: " nato can only be stopped by a strict den ##oun ##ce ##ment from the nuclear powers , in particular from russia and china , " he said .

reference_raw: "Only a strict condemnation of nuclear power, especially Russia and China, can stop NATO," he said.

reference_spacy_tokens: " Only a strict condemnation of nuclear power , especially Russia and China , can stop NATO , " he said .


fn_spacy_tokens_for_baseline: To me the small group of birds on the sand - spit looked just like little terns , but it is a bird I have never seen in Shetland , so I am not familiar with it .

source_bert_toks: to me the small group of birds on the sand - spit looked just like little ter ##ns , but it is a bird i have never seen in shetland , so i am not familiar with it .

reference_raw: The small group of birds on the sandpit looked like little terns to me, but it was a bird I'd never seen in Shetland, so I don't know it.

reference_spacy_tokens: The small group of birds on the sandpit looked like little terns to me , but it was a bird I 'd never seen in Shetland , so I do n't know it .


fn_spacy_tokens_for_baseline: The British Council of Shopping Centres , of which the showcase Castlecourt is one of 600 members , is investigating 150 malls built since 1985 .

source_bert_toks: the british council of shopping centres , of which the showcase castle ##court is one of 600 members , is investigating 150 malls built since 1985 .

reference_raw: The British Council of Shopping Centres, of which Castlecourt is one of 600 members, is investigating 150 shopping centres built since 1985.

reference_spacy_tokens: The British Council of Shopping Centres , of which Castlecourt is one of 600 members , is investigating 150 shopping centres built since 1985 .


fn_spacy_tokens_for_baseline: He was a Maniak all right , flying colours , with a pair of sawn - off pumpguns crossed on his back , and a long braided pigtail whipping out like an epileptic snake from under his horned skidlid .

source_bert_toks: he was a mania ##k all right , flying colours , with a pair of saw ##n - off pump ##gun ##s crossed on his back , and a long braid ##ed pig ##tail whipping out like an ep ##ile ##ptic snake from under his horned ski ##dl ##id .

reference_raw: He was a Maniak, all right, flying colors, with a pair of cut-off pumpguns crossed on his back, and a long-tailed pigtail whipping out from under his horned skid like an epileptic snake.

reference_spacy_tokens: He was a Maniak , all right , flying colors , with a pair of cut - off pumpguns crossed on his back , and a long - tailed pigtail whipping out from under his horned skid like an epileptic snake .


fn_spacy_tokens_for_baseline: Psychiatrist Dr Gerald Silverman runs kleptomania therapy groups ( for people who can not control their desires to steal ) , and claims most of his patients shoplift due to emotional worries or personal problems .

source_bert_toks: psychiatrist dr gerald silver ##man runs k ##le ##pt ##oman ##ia therapy groups ( for people who can not control their desires to steal ) , and claims most of his patients shop ##lift due to emotional worries or personal problems .

reference_raw: Psychiatric Dr. Gerald Silverman runs a kleptomania therapy group (for people who can't control their desire to steal) and claims that most of his patients steal because of emotional problems or personal problems.

reference_spacy_tokens: Psychiatric Dr. Gerald Silverman runs a kleptomania therapy group ( for people who ca n't control their desire to steal ) and claims that most of his patients steal because of emotional problems or personal problems .


fn_spacy_tokens_for_baseline: The soundlessness of nature impressed and solaced her .

source_bert_toks: the sound ##lessness of nature impressed and sol ##ace ##d her .

reference_raw: She was impressed and comforted by the soundlessness of nature.

reference_spacy_tokens: She was impressed and comforted by the soundlessness of nature .


fn_spacy_tokens_for_baseline: She uncorked a bottle of scotch and handed him a large slug in a tall tumbler , but even as she reached across to him she saw he was already asleep .

source_bert_toks: she un ##cor ##ked a bottle of scotch and handed him a large slug in a tall tumble ##r , but even as she reached across to him she saw he was already asleep .

reference_raw: She unbuckled a bottle of Scotch and handed him a large bullet in a high tumbler, but even as she reached for it she could see that he was asleep.

reference_spacy_tokens: She unbuckled a bottle of Scotch and handed him a large bullet in a high tumbler , but even as she reached for it she could see that he was asleep .


fn_spacy_tokens_for_baseline: On 13/25 January 1831 the Poles dethroned the Romanovs .

source_bert_toks: on 13 / 25 january 1831 the poles det ##hr ##oned the romano ##vs .

reference_raw: The Poles destroyed the Romanovs on 13/25 January 1831.

reference_spacy_tokens: The Poles destroyed the Romanovs on 13/25 January 1831 .


fn_spacy_tokens_for_baseline: Unemployment still is officially recorded at 16.5 % , the highest rate in Europe , although actual joblessness may be lower .

source_bert_toks: unemployment still is officially recorded at 16 . 5 % , the highest rate in europe , although actual job ##lessness may be lower .

reference_raw: The number of unemployed is still officially 16.5%, which is the highest rate in Europe, although the actual joblessness may be lower.

reference_spacy_tokens: The number of unemployed is still officially 16.5 % , which is the highest rate in Europe , although the actual joblessness may be lower .


fn_spacy_tokens_for_baseline: It was a sad and disillusioning blow for 261 Squadron , as John Pain relates : ' This was the one day when we thought we had the edge .

source_bert_toks: it was a sad and di ##sil ##lusion ##ing blow for 261 squadron , as john pain relates : ' this was the one day when we thought we had the edge .

reference_raw: For the 261 Squadron, as John Pain says, it was a sad and disappointing blow: 'This was the first time we thought we had the advantage.

reference_spacy_tokens: For the 261 Squadron , as John Pain says , it was a sad and disappointing blow : ' This was the first time we thought we had the advantage .


fn_spacy_tokens_for_baseline: Buffalo , New York A three alarm fire at a house owned by John and Evelyn Bencinich , two of the initiators of a lawsuit filed against the Elmwood Village Hotel proposal in Buffalo , required firefighters to rescue eight cats and two dogs in Buffalo , New York today .

source_bert_toks: buffalo , new york a three alarm fire at a house owned by john and evelyn ben ##cini ##ch , two of the in ##itia ##tors of a lawsuit filed against the elm ##wood village hotel proposal in buffalo , required firefighters to rescue eight cats and two dogs in buffalo , new york today .

reference_raw: Buffalo, New York Three alarm fires in a house owned by John and Evelyn Bencinich, two instigators of a lawsuit against the proposal of the Elmwood Village Hotel in Buffalo, required firemen to rescue eight chicks and two dogs today in Buffalo, New York.

reference_spacy_tokens: Buffalo , New York Three alarm fires in a house owned by John and Evelyn Bencinich , two instigators of a lawsuit against the proposal of the Elmwood Village Hotel in Buffalo , required firemen to rescue eight chicks and two dogs today in Buffalo , New York .


fn_spacy_tokens_for_baseline: In order to do this , you may find that first you need to look at your feelings of anger and resentment at your partner for denying you the ordinary experience of conception and pregnancy .

source_bert_toks: in order to do this , you may find that first you need to look at your feelings of anger and resentment at your partner for denying you the ordinary experience of conception and pregnancy .

reference_raw: In order to do so, you may find that you must first look at your feelings of anger and resentment towards your companion for denying you the normal experience of conception and pregnancy.

reference_spacy_tokens: In order to do so , you may find that you must first look at your feelings of anger and resentment towards your companion for denying you the normal experience of conception and pregnancy .


fn_spacy_tokens_for_baseline: Her only daughter , the apple of her eye , had been brawling in the street .

source_bert_toks: her only daughter , the apple of her eye , had been brawl ##ing in the street .

reference_raw: Her only daughter, the apple of her eye, was fighting in the street.

reference_spacy_tokens: Her only daughter , the apple of her eye , was fighting in the street .


fn_spacy_tokens_for_baseline: She clomped down the steps in her ankle boots and blue woollen dress , and stood shyly beside Willie , twisting the hem of her dress in her hand till her knickers came into view .

source_bert_toks: she cl ##omp ##ed down the steps in her ankle boots and blue wool ##len dress , and stood shy ##ly beside willie , twisting the hem of her dress in her hand till her kn ##ick ##ers came into view .

reference_raw: She wrapped her anklets and blue woollen dress around the stairs and stood timidly beside Willie, twisting the hem of her dress in her hand until she could see the panties.

reference_spacy_tokens: She wrapped her anklets and blue woollen dress around the stairs and stood timidly beside Willie , twisting the hem of her dress in her hand until she could see the panties .


fn_spacy_tokens_for_baseline: Blood jetted from his nostrils and Jimmy went backwards over a desk , taking a computer console with him .

source_bert_toks: blood jett ##ed from his nostrils and jimmy went backwards over a desk , taking a computer console with him .

reference_raw: Blood gushed from his nostrils, and Jimmy walked back across the table and took the computer console with him.

reference_spacy_tokens: Blood gushed from his nostrils , and Jimmy walked back across the table and took the computer console with him .


fn_spacy_tokens_for_baseline: Slobodan Milosevic 's admonishments came amid reports from inside Serbian Television that 110 employees have signed a petition demanding media freedom and the ouster of their director .

source_bert_toks: sl ##ob ##oda ##n milos ##evic ' s ad ##mon ##ishment ##s came amid reports from inside serbian television that 110 employees have signed a petition demanding media freedom and the ou ##ster of their director .

reference_raw: Slobodan Milosevic's admonitions came through reports from inside Serbian television that 110 employees signed a petition demanding media freedom and the extermination of their director.

reference_spacy_tokens: Slobodan Milosevic 's admonitions came through reports from inside Serbian television that 110 employees signed a petition demanding media freedom and the extermination of their director .


fn_spacy_tokens_for_baseline: ' The joke is , ' she said , ' that my father was a miser .

source_bert_toks: ' the joke is , ' she said , ' that my father was a mis ##er .

reference_raw: 'It's funny,' she said, 'that my father was a poor man.

reference_spacy_tokens: ' It 's funny , ' she said , ' that my father was a poor man .


fn_spacy_tokens_for_baseline: The other two windows look over the thatched roof of the kitchen hut to a stand of eucalyptus trees , the waters of the lake and the mainland peninsula of Capachica .

source_bert_toks: the other two windows look over the that ##ched roof of the kitchen hut to a stand of eucalyptus trees , the waters of the lake and the mainland peninsula of cap ##achi ##ca .

reference_raw: The other two windows look out over the thatched roof of the kitchen hut to the eucalyptus trees, the lake waters and the mainland peninsula of Capachica.

reference_spacy_tokens: The other two windows look out over the thatched roof of the kitchen hut to the eucalyptus trees , the lake waters and the mainland peninsula of Capachica .


fn_spacy_tokens_for_baseline: Ghastliest colour - clashes , mix - up of furniture styles , bits of suburban fuss , phoney antiques , awful brass ornaments .

source_bert_toks: g ##has ##tl ##iest colour - clashes , mix - up of furniture styles , bits of suburban fuss , phone ##y antiques , awful brass ornaments .

reference_raw: The worst color clashes, the confusion of furniture styles, bits of suburban fuss, fake antiques, terrible brass decorations.

reference_spacy_tokens: The worst color clashes , the confusion of furniture styles , bits of suburban fuss , fake antiques , terrible brass decorations .


fn_spacy_tokens_for_baseline: And when the Thai - language wrestles with new words for alien imports like ice hard water or parachute umbrella for supporting life , some might be amused at how downright literal Thai can be or impressed at how admirably sensible it so often is .

source_bert_toks: and when the thai - language wrestle ##s with new words for alien imports like ice hard water or parachute umbrella for supporting life , some might be amused at how down ##right literal thai can be or impressed at how ad ##mir ##ably sensible it so often is .

reference_raw: And when the Thai language struggles with new words for extraterrestrial imports, such as ice-hard water or parachute umbrellas to support the world, some of them may be amused by how downright literal Thai can be, or impressed by how admirably reasonable it is so often.

reference_spacy_tokens: And when the Thai language struggles with new words for extraterrestrial imports , such as ice - hard water or parachute umbrellas to support the world , some of them may be amused by how downright literal Thai can be , or impressed by how admirably reasonable it is so often .


fn_spacy_tokens_for_baseline: All Giles had wanted in return for the small gifts he showered on her was affection .

source_bert_toks: all giles had wanted in return for the small gifts he showered on her was affection .

reference_raw: All Giles wanted in return for the little gifts he'd given her was love.

reference_spacy_tokens: All Giles wanted in return for the little gifts he 'd given her was love .


fn_spacy_tokens_for_baseline: Mustard seeds may be used either whole or cracked , or pulverized into flour .

source_bert_toks: mustard seeds may be used either whole or cracked , or pu ##lver ##ized into flour .

reference_raw: The mustard seeds can be used either whole or cracked or crushed into flour.

reference_spacy_tokens: The mustard seeds can be used either whole or cracked or crushed into flour .


fn_spacy_tokens_for_baseline: On Monday night , a force made up of Afghan and Western troops captured a suspected Taliban commander they said was responsible for weapons procurement and paymaster duties for a local militant cell in Kandahar district .

source_bert_toks: on monday night , a force made up of afghan and western troops captured a suspected taliban commander they said was responsible for weapons procurement and pay ##master duties for a local militant cell in kan ##dah ##ar district .

reference_raw: On Monday night, a group of Afghan and Western troops captured a suspected Taliban commander who was said to be responsible for the purchase and payment of arms for a local military cell in Kandahar County.

reference_spacy_tokens: On Monday night , a group of Afghan and Western troops captured a suspected Taliban commander who was said to be responsible for the purchase and payment of arms for a local military cell in Kandahar County .


fn_spacy_tokens_for_baseline: Press out the excess moisture , season , and line a baking dish with the spinach .

source_bert_toks: press out the excess moisture , season , and line a baking dish with the spin ##ach .

reference_raw: Press the excess moisture, season, and line the roasting dish with spinach.

reference_spacy_tokens: Press the excess moisture , season , and line the roasting dish with spinach .


fn_spacy_tokens_for_baseline: Roirbak had mistaken her for another boy : a skinny , awkward creature , but pretty in her own way , he conceded .

source_bert_toks: roi ##rba ##k had mistaken her for another boy : a skinny , awkward creature , but pretty in her own way , he conceded .

reference_raw: Roirbak had mistaken her for another boy: a thin, clumsy creature, but beautiful in a way, he admitted.

reference_spacy_tokens: Roirbak had mistaken her for another boy : a thin , clumsy creature , but beautiful in a way , he admitted .


fn_spacy_tokens_for_baseline: But do not deceive yourself into thinking that because your continual disservices to art bring you knighthoods and ribbons , I shall in any way weaken in my attack .

source_bert_toks: but do not dec ##ei ##ve yourself into thinking that because your continual di ##sser ##vic ##es to art bring you knight ##hood ##s and ribbons , i shall in any way weaken in my attack .

reference_raw: But don't fool yourself into thinking that since your constant service to art brings you knighthood and ribbons, I will in any way weaken my attack.

reference_spacy_tokens: But do n't fool yourself into thinking that since your constant service to art brings you knighthood and ribbons , I will in any way weaken my attack .


fn_spacy_tokens_for_baseline: It started last week ( apparently ) when 2 Norwich fans whinged about treatment they got at Leeds when they lost their tickets or something .

source_bert_toks: it started last week ( apparently ) when 2 norwich fans w ##hing ##ed about treatment they got at leeds when they lost their tickets or something .

reference_raw: It started last week (apparently) when two Norwich fans whined about treatment at Leeds when they lost their tickets or something.

reference_spacy_tokens: It started last week ( apparently ) when two Norwich fans whined about treatment at Leeds when they lost their tickets or something .


fn_spacy_tokens_for_baseline: Claes phoned U.N. Secretary General Boutros Boutros - Ghali to inform him of the decision .

source_bert_toks: cl ##ae ##s phone ##d u . n . secretary general bout ##ros bout ##ros - g ##hal ##i to inform him of the decision .

reference_raw: Claes called Secretary-General of the United Nations, Boutros Boutros-Ghali, to inform him of his decision.

reference_spacy_tokens: Claes called Secretary - General of the United Nations , Boutros Boutros - Ghali , to inform him of his decision .


fn_spacy_tokens_for_baseline: Three pieces of evidence corroborate the key assumption that Democratic legislators are more willing to engage in local benefit - seeking than their Republican colleagues .

source_bert_toks: three pieces of evidence co ##rro ##bor ##ate the key assumption that democratic legislators are more willing to engage in local benefit - seeking than their republican colleagues .

reference_raw: Three pieces of evidence confirm the key assumption that democratic legislators are more willing to pursue local benefits than their Republican counterparts.

reference_spacy_tokens: Three pieces of evidence confirm the key assumption that democratic legislators are more willing to pursue local benefits than their Republican counterparts .


fn_spacy_tokens_for_baseline: can always have a doze in your bed .

source_bert_toks: can always have a do ##ze in your bed .

reference_raw: you can always sleep in your bed.

reference_spacy_tokens: you can always sleep in your bed .


fn_spacy_tokens_for_baseline: A bird twittered somewhere .

source_bert_toks: a bird twitter ##ed somewhere .

reference_raw: Somewhere a bird twitched.

reference_spacy_tokens: Somewhere a bird twitched .


fn_spacy_tokens_for_baseline: A few mouldy bones break the surface of the water here and there .

source_bert_toks: a few mo ##uld ##y bones break the surface of the water here and there .

reference_raw: A few fungus bones break the surface of the water from time to time.

reference_spacy_tokens: A few fungus bones break the surface of the water from time to time .


fn_spacy_tokens_for_baseline: ' I 'll get you out a deckchair , ' Gaily said , lacing his shoe .

source_bert_toks: ' i ' ll get you out a deck ##chai ##r , ' gail ##y said , lac ##ing his shoe .

reference_raw: 'I'll get you out of the chair,' said Gaily, tapping his boot.

reference_spacy_tokens: ' I 'll get you out of the chair , ' said Gaily , tapping his boot .


fn_spacy_tokens_for_baseline: " Four Aberdeen Proving Ground employees were taken to a local hospital yesterday after a report of a chemical leak , the third incident in about a week during which workers were at risk of exposure to lethal substances at the Army base in Harford County .

source_bert_toks: " four aberdeen proving ground employees were taken to a local hospital yesterday after a report of a chemical leak , the third incident in about a week during which workers were at risk of exposure to lethal substances at the army base in ha ##rford county .

reference_raw: "Four Aberdeen Proving Ground personnel were taken to a local hospital yesterday after a chemical leak was reported, the third incident in about a week during which workers at Harford County Army base were exposed to lethal substances.

reference_spacy_tokens: " Four Aberdeen Proving Ground personnel were taken to a local hospital yesterday after a chemical leak was reported , the third incident in about a week during which workers at Harford County Army base were exposed to lethal substances .


fn_spacy_tokens_for_baseline: In looking at overall trends , Sotheby 's pointed to the strength of the decorative arts and jewellery , while noting an improvement in results at Impressionist and Modern sales .

source_bert_toks: in looking at overall trends , so ##the ##by ' s pointed to the strength of the decorative arts and jewellery , while noting an improvement in results at impression ##ist and modern sales .

reference_raw: When Sotheby looks at the overall trends, he draws attention to the strength of decorative arts and jewellery, and notes the improvement in performance in Impressionist and Modern Sales.

reference_spacy_tokens: When Sotheby looks at the overall trends , he draws attention to the strength of decorative arts and jewellery , and notes the improvement in performance in Impressionist and Modern Sales .


fn_spacy_tokens_for_baseline: Ultimately the most memorable lines in this volume must be those penned by Bonnard to Matisse in January 1940 : ' When I think of you , I think of a mind cleansed of every old aesthetic convention , and it is that alone that permits a direct view of nature , the greatest joy that can befall a painter .

source_bert_toks: ultimately the most memorable lines in this volume must be those penned by bonn ##ard to mat ##isse in january 1940 : ' when i think of you , i think of a mind clean ##sed of every old aesthetic convention , and it is that alone that permits a direct view of nature , the greatest joy that can be ##fall a painter .

reference_raw: In the end, the most memorable lines in this volume must be those penned by Bonnard to Matisse in January 1940: 'When I think of you, I think of a mind purged from every ancient aesthetic convention, and it is only that allows a direct view of nature, the greatest joy that a painter may have.

reference_spacy_tokens: In the end , the most memorable lines in this volume must be those penned by Bonnard to Matisse in January 1940 : ' When I think of you , I think of a mind purged from every ancient aesthetic convention , and it is only that allows a direct view of nature , the greatest joy that a painter may have .


fn_spacy_tokens_for_baseline: Her tears dried as suddenly as they had appeared .

source_bert_toks: her tears dried as suddenly as they had appeared .

reference_raw: Her tears died as suddenly as they had come.

reference_spacy_tokens: Her tears died as suddenly as they had come .


fn_spacy_tokens_for_baseline: He was toting the gun for a purpose -- to shoot her through the head or knock her unconscious , or both .

source_bert_toks: he was to ##ting the gun for a purpose - - to shoot her through the head or knock her unconscious , or both .

reference_raw: He tossed the gun for a reason-to shoot her in the head, or to knock her unconscious, or both.

reference_spacy_tokens: He tossed the gun for a reason - to shoot her in the head , or to knock her unconscious , or both .


fn_spacy_tokens_for_baseline: She was slim , svelte and sophisticated .

source_bert_toks: she was slim , sv ##elt ##e and sophisticated .

reference_raw: She was slender, shrewd, and sophisticated.

reference_spacy_tokens: She was slender , shrewd , and sophisticated .


fn_spacy_tokens_for_baseline: Recent theories favour identification of the mountain with Bennachie , close to a Roman marching camp revealed in the late 1970s by aerial photography at Durno , 15 miles northeast of Aberdeen .

source_bert_toks: recent theories favour identification of the mountain with ben ##nac ##hi ##e , close to a roman marching camp revealed in the late 1970s by aerial photography at du ##rno , 15 miles northeast of aberdeen .

reference_raw: Recent theories prefer to identify the mountain with Bennachie, near the Roman marching camp, which was discovered in the late 1970s by aerial photography in Durno, 15 miles north-east of Aberdeen.

reference_spacy_tokens: Recent theories prefer to identify the mountain with Bennachie , near the Roman marching camp , which was discovered in the late 1970s by aerial photography in Durno , 15 miles north - east of Aberdeen .


fn_spacy_tokens_for_baseline: Among all these grand people , I see a small woman in a figure - hugging black number with fringes .

source_bert_toks: among all these grand people , i see a small woman in a figure - hugging black number with fringe ##s .

reference_raw: Of all the great people, I see a little woman in a figure-hugging black number with edges.

reference_spacy_tokens: Of all the great people , I see a little woman in a figure - hugging black number with edges .


fn_spacy_tokens_for_baseline: Anderlecht 's Luc Nilis gave Sampdoria a bitter taste of Pancev 's medicine by emulating the Yugoslav with two goals .

source_bert_toks: and ##er ##le ##cht ' s luc ni ##lis gave sam ##pd ##oria a bitter taste of pan ##ce ##v ' s medicine by em ##ulating the yugoslav with two goals .

reference_raw: Anderlecht's Luc Nilis had given Sampdoria a sour taste in Pancev's medicine by emulating Yugoslavia with two goals.

reference_spacy_tokens: Anderlecht 's Luc Nilis had given Sampdoria a sour taste in Pancev 's medicine by emulating Yugoslavia with two goals .


fn_spacy_tokens_for_baseline: While China has publicly declared to be consistently in compliance with the BTWC , past U.S. government reports have alleged that China not only has a small - scale offensive biological weapons program , but has also transferred controlled biological weapons - related items to nations of proliferation concern such as Iran .

source_bert_toks: while china has publicly declared to be consistently in compliance with the bt ##wc , past u . s . government reports have alleged that china not only has a small - scale offensive biological weapons program , but has also transferred controlled biological weapons - related items to nations of proliferation concern such as iran .

reference_raw: While China has made a public declaration that it is consistent with the BTWC, past US government reports claim that China has not only a small-scale offensive biological weapons program, but also transferred controlled biological weapons - related items to proliferation-related countries such as Iran.

reference_spacy_tokens: While China has made a public declaration that it is consistent with the BTWC , past US government reports claim that China has not only a small - scale offensive biological weapons program , but also transferred controlled biological weapons - related items to proliferation - related countries such as Iran .


fn_spacy_tokens_for_baseline: Prue Hines is the cook , offering a four - course meal in the evening accompanied by fine china and candlelight .

source_bert_toks: pr ##ue hines is the cook , offering a four - course meal in the evening accompanied by fine china and candle ##light .

reference_raw: Prue Hines is a chef who offers a four-course meal in the evening, accompanied by fine china and candlelight.

reference_spacy_tokens: Prue Hines is a chef who offers a four - course meal in the evening , accompanied by fine china and candlelight .


fn_spacy_tokens_for_baseline: We left Miami on a Tuesday afternoon and were in A-1 's Los Angeles ' office by midday on Saturday .

source_bert_toks: we left miami on a tuesday afternoon and were in a - 1 ' s los angeles ' office by midday on saturday .

reference_raw: On Tuesday afternoon, we left Miami and were in the L.A. office by noon on Saturday.

reference_spacy_tokens: On Tuesday afternoon , we left Miami and were in the L.A. office by noon on Saturday .


fn_spacy_tokens_for_baseline: It seemed to her that her mind was like an overfilled glass which only she could hold steady .

source_bert_toks: it seemed to her that her mind was like an over ##fi ##lled glass which only she could hold steady .

reference_raw: Her mind seemed like a full glass that only she could hold steady.

reference_spacy_tokens: Her mind seemed like a full glass that only she could hold steady .


fn_spacy_tokens_for_baseline: He sank his voice to a gently reproachful tone .

source_bert_toks: he sank his voice to a gently rep ##ro ##ach ##ful tone .

reference_raw: He lowered his voice to a slightly accusing tone.

reference_spacy_tokens: He lowered his voice to a slightly accusing tone .


fn_spacy_tokens_for_baseline: He was , in fact , a spendthrift .

source_bert_toks: he was , in fact , a spend ##th ##rift .

reference_raw: Actually, he was a spender.

reference_spacy_tokens: Actually , he was a spender .


fn_spacy_tokens_for_baseline: Anna 's blue eyes seemed to see too much , and Merrill had already had enough of that discomfiting shrewdness from Luke .

source_bert_toks: anna ' s blue eyes seemed to see too much , and merrill had already had enough of that disco ##m ##fi ##ting sh ##rew ##d ##ness from luke .

reference_raw: Anna's blue eyes seemed to see too much, and Merrill had had enough of Luke's disconcerting wits.

reference_spacy_tokens: Anna 's blue eyes seemed to see too much , and Merrill had had enough of Luke 's disconcerting wits .


fn_spacy_tokens_for_baseline: We agents , however , must represent anything with the air of a cock - up only as an opportunity to demonstrate the Partei 's brilliance in extricating itself from it .

source_bert_toks: we agents , however , must represent anything with the air of a cock - up only as an opportunity to demonstrate the part ##ei ' s brilliance in ex ##tric ##ating itself from it .

reference_raw: But we agents have to represent anything with the air of a cock-up just to show the Partei's genius in getting out of it.

reference_spacy_tokens: But we agents have to represent anything with the air of a cock - up just to show the Partei 's genius in getting out of it .


fn_spacy_tokens_for_baseline: Most of these claims can not be verified in open sources .

source_bert_toks: most of these claims can not be verified in open sources .

reference_raw: Most of these claims cannot be verified from public sources.

reference_spacy_tokens: Most of these claims can not be verified from public sources .


fn_spacy_tokens_for_baseline: On either side her head gleamed coiled braids of dark - gold hair , almost pale copper in the subdued light of the room .

source_bert_toks: on either side her head gleamed coiled braid ##s of dark - gold hair , almost pale copper in the subdued light of the room .

reference_raw: In the dim light of the room, her head gleamed with coils of dark-gold hair on either side, almost pale copper.

reference_spacy_tokens: In the dim light of the room , her head gleamed with coils of dark - gold hair on either side , almost pale copper .


fn_spacy_tokens_for_baseline: All individual rites underscore her imminent status as a wife and as a mother .

source_bert_toks: all individual rites under ##sco ##re her imminent status as a wife and as a mother .

reference_raw: All individual rituals underline her immediate position as a woman and as a mother.

reference_spacy_tokens: All individual rituals underline her immediate position as a woman and as a mother .


fn_spacy_tokens_for_baseline: It petrifies the governess and she gets into an acute state of anxiety .

source_bert_toks: it pet ##ri ##fies the govern ##ess and she gets into an acute state of anxiety .

reference_raw: She's freezing the governess, and she's in an acute state of anxiety.

reference_spacy_tokens: She 's freezing the governess , and she 's in an acute state of anxiety .


fn_spacy_tokens_for_baseline: ' I expressed suitable penitence .

source_bert_toks: ' i expressed suitable pen ##ite ##nce .

reference_raw: 'I expressed appropriate repentance.

reference_spacy_tokens: ' I expressed appropriate repentance .


fn_spacy_tokens_for_baseline: The man was elderly , bearded , bow - legged in his farm boots , and his old army greatcoat was fastened at the waist with twine , and the man carried a broken shotgun across his forearm .

source_bert_toks: the man was elderly , bearded , bow - legged in his farm boots , and his old army great ##coat was fastened at the waist with twin ##e , and the man carried a broken shotgun across his forearm .

reference_raw: The man was older, bearded, with a bowleg in his farm boots, and his old army greatcoat was strapped to his waist with a string, and he carried a broken shotgun over his forearm.

reference_spacy_tokens: The man was older , bearded , with a bowleg in his farm boots , and his old army greatcoat was strapped to his waist with a string , and he carried a broken shotgun over his forearm .


fn_spacy_tokens_for_baseline: W. Mark Goode , president of Micronyx Inc. , a Richardson , Texas , firm that makes computer - security products , provided a new definition for Mikhail Gorbachev 's campaign for greater openness , known commonly as glasnost .

source_bert_toks: w . mark good ##e , president of micro ##ny ##x inc . , a richardson , texas , firm that makes computer - security products , provided a new definition for mikhail go ##rba ##chev ' s campaign for greater open ##ness , known commonly as g ##las ##nos ##t .

reference_raw: W. Mark Goode, President of Micronyx Inc., Richardson, Texas, a company that manufactures computer security products, provided a new definition for the campaign of Mikhail Gorbachev for greater openness, commonly known as glasnost.

reference_spacy_tokens: W. Mark Goode , President of Micronyx Inc. , Richardson , Texas , a company that manufactures computer security products , provided a new definition for the campaign of Mikhail Gorbachev for greater openness , commonly known as glasnost .


fn_spacy_tokens_for_baseline: Cook slowly , stirring constantly , until thickened but do not allow the sauce to boil or the cream will curdle and the egg will scramble .

source_bert_toks: cook slowly , stirring constantly , until thick ##ened but do not allow the sauce to boil or the cream will cu ##rd ##le and the egg will scramble .

reference_raw: Cook slowly and constantly until it thickens, but does not allow the sauce to boil or the cream to curl and the egg to crawl.

reference_spacy_tokens: Cook slowly and constantly until it thickens , but does not allow the sauce to boil or the cream to curl and the egg to crawl .


fn_spacy_tokens_for_baseline: For the moment , however , the United States should not prejudge the future .

source_bert_toks: for the moment , however , the united states should not pre ##ju ##dge the future .

reference_raw: But for now, the US should not predict the future.

reference_spacy_tokens: But for now , the US should not predict the future .


fn_spacy_tokens_for_baseline: In open hall , I tell you , he spat out his detestation of that man for every page and scullion to hear .

source_bert_toks: in open hall , i tell you , he spat out his det ##est ##ation of that man for every page and sc ##ull ##ion to hear .

reference_raw: I'm telling you, in the open hall, he spat out his hatred for this man for every page and scullion to hear.

reference_spacy_tokens: I 'm telling you , in the open hall , he spat out his hatred for this man for every page and scullion to hear .


fn_spacy_tokens_for_baseline: It has been claimed that interference has disrupted train signals , and electronic equipment from Nintendo Gameboys to video cameras has confused aircraft flight management computers .

source_bert_toks: it has been claimed that interference has disrupted train signals , and electronic equipment from nintendo game ##boys to video cameras has confused aircraft flight management computers .

reference_raw: It was claimed that the interference disrupted the train signals and that the electronic equipment from the Nintendo Gameboys to the video cameras had distorted the flight control computers.

reference_spacy_tokens: It was claimed that the interference disrupted the train signals and that the electronic equipment from the Nintendo Gameboys to the video cameras had distorted the flight control computers .


fn_spacy_tokens_for_baseline: Many events in recent weeks have foreshadowed the poll 's results .

source_bert_toks: many events in recent weeks have fore ##sha ##do ##wed the poll ' s results .

reference_raw: Many events over the last few weeks have eluded the results of the poll.

reference_spacy_tokens: Many events over the last few weeks have eluded the results of the poll .


fn_spacy_tokens_for_baseline: Marsh , the professor of Old Testament , had been a superlative teacher but his health was gone and he was now a passenger .

source_bert_toks: marsh , the professor of old testament , had been a super ##lative teacher but his health was gone and he was now a passenger .

reference_raw: Marsh, the Professor of the Old Testament, was a super-lative teacher, but his health was gone, and now he was a passenger.

reference_spacy_tokens: Marsh , the Professor of the Old Testament , was a super - lative teacher , but his health was gone , and now he was a passenger .


fn_spacy_tokens_for_baseline: But to people who are not trained in science it simply did not seem possible that mankind 's puny factories , and even punier cars and refrigerators , could have an effect on the well - being of the entire world .

source_bert_toks: but to people who are not trained in science it simply did not seem possible that mankind ' s pun ##y factories , and even pun ##ier cars and refrigerator ##s , could have an effect on the well - being of the entire world .

reference_raw: But for people who aren't trained in science, it just didn't seem possible that human puny factories, and even more puny cars and refrigerators, could affect the well-being of the world.

reference_spacy_tokens: But for people who are n't trained in science , it just did n't seem possible that human puny factories , and even more puny cars and refrigerators , could affect the well - being of the world .


fn_spacy_tokens_for_baseline: Customers vary in age , he added , although the younger ones tend to ask for a pea butty a scoop of mushy peas in a bun .

source_bert_toks: customers vary in age , he added , although the younger ones tend to ask for a pea butt ##y a scoop of mu ##sh ##y peas in a bun .

reference_raw: The customers differ in age, he added, though the younger ones tend to ask the pea butt for a cup of mushy peas in a bun.

reference_spacy_tokens: The customers differ in age , he added , though the younger ones tend to ask the pea butt for a cup of mushy peas in a bun .


fn_spacy_tokens_for_baseline: I sort of pummelled him on the chest , that was all .

source_bert_toks: i sort of pu ##mmel ##led him on the chest , that was all .

reference_raw: I kind of hit him in the chest, that's all.

reference_spacy_tokens: I kind of hit him in the chest , that 's all .


fn_spacy_tokens_for_baseline: One writer , signing his letter as " Red - blooded , balanced male , " remarked on the " frequency of women fainting in peals , " and suggested that they " settle back into their traditional role of making tea at meetings .

source_bert_toks: one writer , signing his letter as " red - blooded , balanced male , " remarked on the " frequency of women faint ##ing in pea ##ls , " and suggested that they " settle back into their traditional role of making tea at meetings .

reference_raw: One of the writers, who signed his letter as a red-blooded, balanced man, commented on the "frequency of women fainting in peals," and suggested that they "return to their traditional role of making coffee in meetings.

reference_spacy_tokens: One of the writers , who signed his letter as a red - blooded , balanced man , commented on the " frequency of women fainting in peals , " and suggested that they " return to their traditional role of making coffee in meetings .


fn_spacy_tokens_for_baseline: Contralto huffed and pulled in his chin with foreboding at the angry growls .

source_bert_toks: contra ##lto huffed and pulled in his chin with fore ##bo ##ding at the angry growls .

reference_raw: Contralto crouched and drew his chin in anticipation of the angry snarls.

reference_spacy_tokens: Contralto crouched and drew his chin in anticipation of the angry snarls .


fn_spacy_tokens_for_baseline: The telephone kept on clicking as they took recordings .

source_bert_toks: the telephone kept on clicking as they took recordings .

reference_raw: As they picked up the tapes, the phone kept ringing.

reference_spacy_tokens: As they picked up the tapes , the phone kept ringing .


fn_spacy_tokens_for_baseline: Dark pigments in leaves and flowers contribute to warming ; their sparing use in spring leaves suggests that green pigments alone are sufficient to bring the leaves to optimum temperatures .

source_bert_toks: dark pigment ##s in leaves and flowers contribute to warming ; their spa ##ring use in spring leaves suggests that green pigment ##s alone are sufficient to bring the leaves to opt ##imum temperatures .

reference_raw: The dark pigments in leaves and flowers contribute to warming; their sparse use in spring leaves indicates that the green pigments themselves are sufficient to bring the leaves to optimal temperatures.

reference_spacy_tokens: The dark pigments in leaves and flowers contribute to warming ; their sparse use in spring leaves indicates that the green pigments themselves are sufficient to bring the leaves to optimal temperatures .


fn_spacy_tokens_for_baseline: In fact , the Flamingo would launch over two decades of strong mob presence in Las Vegas .

source_bert_toks: in fact , the flaming ##o would launch over two decades of strong mob presence in las vegas .

reference_raw: In fact, the Flamingo will launch more than two decades of massive Mafia in Las Vegas.

reference_spacy_tokens: In fact , the Flamingo will launch more than two decades of massive Mafia in Las Vegas .


fn_spacy_tokens_for_baseline: To tell the truth , it took me quite a while to realize that the pitiable chirruping I heard all about me was , in fact , human speech .

source_bert_toks: to tell the truth , it took me quite a while to realize that the pit ##iable chi ##rr ##up ##ing i heard all about me was , in fact , human speech .

reference_raw: To tell you the truth, it took me a long time to realize that the melancholy chirp I'd heard about myself was actually human speech.

reference_spacy_tokens: To tell you the truth , it took me a long time to realize that the melancholy chirp I 'd heard about myself was actually human speech .


fn_spacy_tokens_for_baseline: Dozy sales teams can also be motivated by the sniff of citrus without even knowing it , he claims .

source_bert_toks: do ##zy sales teams can also be motivated by the sniff of citrus without even knowing it , he claims .

reference_raw: Dozy sales teams can also be motivated by the smell of citrus without even knowing it.

reference_spacy_tokens: Dozy sales teams can also be motivated by the smell of citrus without even knowing it .


fn_spacy_tokens_for_baseline: Her hands clawed his shoulders .

source_bert_toks: her hands clawed his shoulders .

reference_raw: She clasped his shoulders with her hands.

reference_spacy_tokens: She clasped his shoulders with her hands .


fn_spacy_tokens_for_baseline: In days gone by , the emperor shunned all publicity .

source_bert_toks: in days gone by , the emperor shu ##nne ##d all publicity .

reference_raw: In the days that passed, the Emperor avoided all publicity.

reference_spacy_tokens: In the days that passed , the Emperor avoided all publicity .


fn_spacy_tokens_for_baseline: Execrable presenters get in the way of Shonen Knife and the Stereo MC 's in THE WORD .

source_bert_toks: ex ##ec ##rable presenters get in the way of shone ##n knife and the stereo mc ' s in the word .

reference_raw: Extraordinary presenters stand in the way of the Shonen Knife and the Stereo MC in THE WORD.

reference_spacy_tokens: Extraordinary presenters stand in the way of the Shonen Knife and the Stereo MC in THE WORD .


fn_spacy_tokens_for_baseline: Once out of the village they picked up speed and took a road that would zigzag through five hamlets before bringing them to the only cart track that wound up the lower slopes of the mountain .

source_bert_toks: once out of the village they picked up speed and took a road that would z ##ig ##za ##g through five hamlets before bringing them to the only cart track that wound up the lower slopes of the mountain .

reference_raw: As soon as they left the village, they picked up speed and took a road that would pass through five villages before taking them to the only wagon track that wound up the lower slopes of the mountain.

reference_spacy_tokens: As soon as they left the village , they picked up speed and took a road that would pass through five villages before taking them to the only wagon track that wound up the lower slopes of the mountain .


fn_spacy_tokens_for_baseline: They pulp all the wood , not just part of it ; bleach it with hydrogen peroxide .

source_bert_toks: they pulp all the wood , not just part of it ; b ##lea ##ch it with hydrogen per ##oxide .

reference_raw: They're cutting all the wood, not just part of it; they're bleaching it with hydrogen peroxide.

reference_spacy_tokens: They 're cutting all the wood , not just part of it ; they 're bleaching it with hydrogen peroxide .


fn_spacy_tokens_for_baseline: ' We 're going to hafta give a big coffee party for the auto buyer from Henderson and Company , so make it a nice one . '

source_bert_toks: ' we ' re going to ha ##ft ##a give a big coffee party for the auto buyer from henderson and company , so make it a nice one . '

reference_raw: "We'll have a big coffee party for a car buyer from Henderson and Company, so make it nice."

reference_spacy_tokens: " We 'll have a big coffee party for a car buyer from Henderson and Company , so make it nice . "


fn_spacy_tokens_for_baseline: As a result , Earl Robert had not been the only valuable prisoner taken , a fact that obviously rankled with Matilda .

source_bert_toks: as a result , earl robert had not been the only valuable prisoner taken , a fact that obviously rank ##led with matilda .

reference_raw: As a result, Earl Robert was not the only valuable prisoner who had been captured, a fact that seemed to be in Matilda's rank.

reference_spacy_tokens: As a result , Earl Robert was not the only valuable prisoner who had been captured , a fact that seemed to be in Matilda 's rank .


fn_spacy_tokens_for_baseline: Both books imply what childhood should be like by being very straightforward about the present reality for all too many of the world 's children .

source_bert_toks: both books imply what childhood should be like by being very straightforward about the present reality for all too many of the world ' s children .

reference_raw: Both books suggest what childhood should be like to be very clear about the current reality for too many children in the world.

reference_spacy_tokens: Both books suggest what childhood should be like to be very clear about the current reality for too many children in the world .


fn_spacy_tokens_for_baseline: Upon completion of several uranium exploration projects , Syria began experiments to extract uranium from its vast phosphoric rock reserves .

source_bert_toks: upon completion of several uranium exploration projects , syria began experiments to extract uranium from its vast ph ##os ##ph ##oric rock reserves .

reference_raw: After several uranium research projects have been completed, Syria has begun experiments to extract uranium from its vast phosphoric rock reserves.

reference_spacy_tokens: After several uranium research projects have been completed , Syria has begun experiments to extract uranium from its vast phosphoric rock reserves .


fn_spacy_tokens_for_baseline: With these exceptions , troops lived in barracks , and certainly the officers were rarely posted to their home territories .

source_bert_toks: with these exceptions , troops lived in barracks , and certainly the officers were rarely posted to their home territories .

reference_raw: With these exceptions, the soldiers lived in the huts, and certainly the officers were seldom sent to their home territory.

reference_spacy_tokens: With these exceptions , the soldiers lived in the huts , and certainly the officers were seldom sent to their home territory .


fn_spacy_tokens_for_baseline: For a while there was nothing but the click of ammunition , the scrape of boots , and the stink of Woolley 's rancour .

source_bert_toks: for a while there was nothing but the click of ammunition , the scrape of boots , and the stink of wool ##ley ' s ran ##co ##ur .

reference_raw: For a moment there was nothing but the click of ammunition, the scratching of shoes, and the smell of Woolley's ranch.

reference_spacy_tokens: For a moment there was nothing but the click of ammunition , the scratching of shoes , and the smell of Woolley 's ranch .


fn_spacy_tokens_for_baseline: Swallow , something sticking in my throat .

source_bert_toks: swallow , something sticking in my throat .

reference_raw: Swallow, there's something in my throat.

reference_spacy_tokens: Swallow , there 's something in my throat .


fn_spacy_tokens_for_baseline: Inflation , around 12 % , is lowish but bothersome .

source_bert_toks: inflation , around 12 % , is low ##ish but bother ##some .

reference_raw: The inflation rate, about 12%, is low but annoying.

reference_spacy_tokens: The inflation rate , about 12 % , is low but annoying .


fn_spacy_tokens_for_baseline: ' How much ? ' he asked , still in a sort of trance , turning the brown lustre of her skin into Abyssinian maid and then the Queen of Pleasures .

source_bert_toks: ' how much ? ' he asked , still in a sort of trance , turning the brown lust ##re of her skin into abyss ##inian maid and then the queen of pleasures .

reference_raw: 'How much?' he asked, still in a sort of trance, turning the brown glow of her skin into the maid of Abyssin, then the Queen of Pleasures.

reference_spacy_tokens: ' How much ? ' he asked , still in a sort of trance , turning the brown glow of her skin into the maid of Abyssin , then the Queen of Pleasures .


fn_spacy_tokens_for_baseline: That will allow changes in herbicide susceptibility within a population to be monitored , he explains .

source_bert_toks: that will allow changes in herb ##icide su ##sc ##ept ##ibility within a population to be monitored , he explains .

reference_raw: This would make it possible to monitor changes in the sensitivity of herbicides in the population, he explained.

reference_spacy_tokens: This would make it possible to monitor changes in the sensitivity of herbicides in the population , he explained .


fn_spacy_tokens_for_baseline: The road rolled over a hill and curled down among flesh - pink dunes .

source_bert_toks: the road rolled over a hill and curled down among flesh - pink dunes .

reference_raw: The road rolled over a hill and curled between the fleshy pink dunes.

reference_spacy_tokens: The road rolled over a hill and curled between the fleshy pink dunes .


fn_spacy_tokens_for_baseline: Iran agreed to an IAEA inspection schedule and to a mid - May 2004 deadline for the submission of complete details regarding its nuclear program and goals .

source_bert_toks: iran agreed to an ia ##ea inspection schedule and to a mid - may 2004 deadline for the submission of complete details regarding its nuclear program and goals .

reference_raw: Iran has agreed to an inspection plan for the IAEA and to submit complete information on its nuclear programme and objectives until the middle of May 2004.

reference_spacy_tokens: Iran has agreed to an inspection plan for the IAEA and to submit complete information on its nuclear programme and objectives until the middle of May 2004 .


fn_spacy_tokens_for_baseline: The next five chapters focus on the technical aspects of biological terrorism , including the biological agents of greatest concern ; the technical hurdles associated with their acquisition , production , and delivery ; historical cases of bioterrorism ; and approaches to the prevention and mitigation of bioterrorist incidents .

source_bert_toks: the next five chapters focus on the technical aspects of biological terrorism , including the biological agents of greatest concern ; the technical hurdles associated with their acquisition , production , and delivery ; historical cases of bio ##ter ##ror ##ism ; and approaches to the prevention and mit ##iga ##tion of bio ##ter ##ror ##ist incidents .

reference_raw: The next five sections focus on the technical aspects of bioterrorism, including biological agents of major concern; technical barriers related to their acquisition, production and delivery; historical cases of bioterrorism; and approaches to the prevention and mitigation of bioterrorism incidents.

reference_spacy_tokens: The next five sections focus on the technical aspects of bioterrorism , including biological agents of major concern ; technical barriers related to their acquisition , production and delivery ; historical cases of bioterrorism ; and approaches to the prevention and mitigation of bioterrorism incidents .


fn_spacy_tokens_for_baseline: its underbelly -- such delicate pale treasure !

source_bert_toks: its under ##bell ##y - - such delicate pale treasure !

reference_raw: his belly - such a delicate pale treasure!

reference_spacy_tokens: his belly - such a delicate pale treasure !


fn_spacy_tokens_for_baseline: Peter punted back to the boatyard .

source_bert_toks: peter punt ##ed back to the boat ##yard .

reference_raw: Peter hit the boathouse again.

reference_spacy_tokens: Peter hit the boathouse again .


fn_spacy_tokens_for_baseline: However , it is not surprising that the southern islands , relatively tiny and lacking contiguity with major landmasses , are comparatively poor in phyla , families , genera and species .

source_bert_toks: however , it is not surprising that the southern islands , relatively tiny and lacking con ##ti ##gui ##ty with major land ##mas ##ses , are comparatively poor in ph ##yla , families , genera and species .

reference_raw: It is not surprising, however, that the southern islands, relatively small and lacking consistency with large land masses, are relatively poor in phyla, family, genera and species.

reference_spacy_tokens: It is not surprising , however , that the southern islands , relatively small and lacking consistency with large land masses , are relatively poor in phyla , family , genera and species .


fn_spacy_tokens_for_baseline: The soil should be kept moist , but never saturated , by sprinkling it gently with water from time to time .

source_bert_toks: the soil should be kept moist , but never saturated , by sp ##rin ##kling it gently with water from time to time .

reference_raw: The soil should be kept wet, but not fed, by spraying it gently with water from time to time.

reference_spacy_tokens: The soil should be kept wet , but not fed , by spraying it gently with water from time to time .


fn_spacy_tokens_for_baseline: The group are also computer buffs on a mission to not only push out musical frontiers but combine the whole thing into a total multi - media package .

source_bert_toks: the group are also computer buff ##s on a mission to not only push out musical frontiers but combine the whole thing into a total multi - media package .

reference_raw: This group is also a computer bubble on a mission that not only pushes out musical boundaries, but combines it all into a complete multimedia package.

reference_spacy_tokens: This group is also a computer bubble on a mission that not only pushes out musical boundaries , but combines it all into a complete multimedia package .


fn_spacy_tokens_for_baseline: Four of those arrested are being held on suspicion of armed robbery .

source_bert_toks: four of those arrested are being held on suspicion of armed robbery .

reference_raw: Four of the detained are being held on suspicion of armed theft.

reference_spacy_tokens: Four of the detained are being held on suspicion of armed theft .


fn_spacy_tokens_for_baseline: Coleraine 's assistant manager Eric Bowyer slammed his players for lack of effort .

source_bert_toks: cole ##raine ' s assistant manager eric bow ##yer slammed his players for lack of effort .

reference_raw: Coleraine's assistant manager, Eric Bowyer, hit the players for lack of effort.

reference_spacy_tokens: Coleraine 's assistant manager , Eric Bowyer , hit the players for lack of effort .


fn_spacy_tokens_for_baseline: He was facing the window and seemed to be in a state of dreamy somnolence .

source_bert_toks: he was facing the window and seemed to be in a state of dream ##y so ##m ##no ##lence .

reference_raw: He faced the window and seemed to be sleepy.

reference_spacy_tokens: He faced the window and seemed to be sleepy .


fn_spacy_tokens_for_baseline: They were of abominable quality and obviously not genuine Champagne .

source_bert_toks: they were of ab ##omi ##nable quality and obviously not genuine champagne .

reference_raw: They were repulsive, and apparently not real champagne.

reference_spacy_tokens: They were repulsive , and apparently not real champagne .


fn_spacy_tokens_for_baseline: As Best defied his own name and went from bad to worse , the former United star had pellets injected into his stomach in a failed bid to combat alcoholism ; he spent time in jail for drunk driving , police assault and jumping bail , and at his most desperate offered his services to any football team willing to pay £ 1,000 to include him in their team .

source_bert_toks: as best def ##ied his own name and went from bad to worse , the former united star had pe ##llet ##s injected into his stomach in a failed bid to combat alcoholism ; he spent time in jail for drunk driving , police assault and jumping bail , and at his most desperate offered his services to any football team willing to pay £1 , 000 to include him in their team .

reference_raw: When Best defied his own name and went from bad to bad, the former United Star injected pellets into his stomach in a failed bid to fight alcoholist, spent time in prison for drunk driving, police assault, and jumping bail, and, at the very least, offered his services to any football team willing to pay £1,000 to put him on the team.

reference_spacy_tokens: When Best defied his own name and went from bad to bad , the former United Star injected pellets into his stomach in a failed bid to fight alcoholist , spent time in prison for drunk driving , police assault , and jumping bail , and , at the very least , offered his services to any football team willing to pay £ 1,000 to put him on the team .


fn_spacy_tokens_for_baseline: A man lies on the sidewalk outside Tiffany 's , passers - by just stepping over him .

source_bert_toks: a man lies on the sidewalk outside tiffany ' s , pass ##ers - by just stepping over him .

reference_raw: There's a man lying on the pavement in front of Tiffany's, passersby stepping over him.

reference_spacy_tokens: There 's a man lying on the pavement in front of Tiffany 's , passersby stepping over him .


fn_spacy_tokens_for_baseline: Turning round she saw sunlight gleaming on fair hair and brown skin , the flash of blue from his shirt ; he was standing about thirty feet away , watching .

source_bert_toks: turning round she saw sunlight gleaming on fair hair and brown skin , the flash of blue from his shirt ; he was standing about thirty feet away , watching .

reference_raw: She turned and saw the sunlight shining on her fair hair and brown skin, a flash of blue from his shirt; he stood about thirty feet away, watching.

reference_spacy_tokens: She turned and saw the sunlight shining on her fair hair and brown skin , a flash of blue from his shirt ; he stood about thirty feet away , watching .


fn_spacy_tokens_for_baseline: Thus when choosing fish for the aquarium try to ensure you are providing correct water quality for the species you are acquiring .

source_bert_toks: thus when choosing fish for the aquarium try to ensure you are providing correct water quality for the species you are acquiring .

reference_raw: Therefore, when selecting fish for the aquarium, try to ensure that you provide the right water quality for the species you acquire.

reference_spacy_tokens: Therefore , when selecting fish for the aquarium , try to ensure that you provide the right water quality for the species you acquire .


fn_spacy_tokens_for_baseline: Dressed in black with a white shirt , her blue - black hair severely braided under a black Cordoba hat , she was the very image of the brother whom Maggie had seen and dreamed of so long ago .

source_bert_toks: dressed in black with a white shirt , her blue - black hair severely braid ##ed under a black cordoba hat , she was the very image of the brother whom maggie had seen and dreamed of so long ago .

reference_raw: Dressed in black in a white shirt, her blue-black hair heavily tied under a black Cordoba hat, she was the same image as the brother Maggie had seen and dreamed of so long ago.

reference_spacy_tokens: Dressed in black in a white shirt , her blue - black hair heavily tied under a black Cordoba hat , she was the same image as the brother Maggie had seen and dreamed of so long ago .


fn_spacy_tokens_for_baseline: In his book he seems rather proud of this episode , and I suppose it did foretell the scientist to be .

source_bert_toks: in his book he seems rather proud of this episode , and i suppose it did fore ##tell the scientist to be .

reference_raw: He seems quite proud of the episode in his book, and I think he predicted that he would be.

reference_spacy_tokens: He seems quite proud of the episode in his book , and I think he predicted that he would be .


fn_spacy_tokens_for_baseline: Six pom - poms glide past the end of the table and we realise that one of the dwarves has lost his hat .

source_bert_toks: six po ##m - po ##ms glide past the end of the table and we realise that one of the dwarves has lost his hat .

reference_raw: Six pom-poms slide past the end of the table, and we realize that a dwarf has lost his hat.

reference_spacy_tokens: Six pom - poms slide past the end of the table , and we realize that a dwarf has lost his hat .


fn_spacy_tokens_for_baseline: They form spontaneously in the waters of our planet without the elaborate ' machinery ' that DNA needs ; and they develop flaws spontaneously , some of which can be replicated in subsequent layers of crystal .

source_bert_toks: they form spontaneously in the waters of our planet without the elaborate ' machinery ' that dna needs ; and they develop flaws spontaneously , some of which can be replicate ##d in subsequent layers of crystal .

reference_raw: They form spontaneously in the waters of our planet without the elaborate "machinery" that DNA needs; and they develop flaws spontaneously, some of which can be reproduced in later layers of crystal.

reference_spacy_tokens: They form spontaneously in the waters of our planet without the elaborate " machinery " that DNA needs ; and they develop flaws spontaneously , some of which can be reproduced in later layers of crystal .


fn_spacy_tokens_for_baseline: But Jerry 's troubles did n't end there .

source_bert_toks: but jerry ' s troubles didn ' t end there .

reference_raw: But that's not where Jerry's problems ended.

reference_spacy_tokens: But that 's not where Jerry 's problems ended .


fn_spacy_tokens_for_baseline: The body was left in an open state for several hours prior to the second stage , when the thorax and abdomen were removed and placed in water .

source_bert_toks: the body was left in an open state for several hours prior to the second stage , when the thor ##ax and abdomen were removed and placed in water .

reference_raw: The body was left open for several hours before the second phase, when the chest and abdomen were removed and placed in water.

reference_spacy_tokens: The body was left open for several hours before the second phase , when the chest and abdomen were removed and placed in water .


fn_spacy_tokens_for_baseline: " We will dam the area and skim or pump the oil out , " he said , adding that much of the recovered oil would be sent to refineries .

source_bert_toks: " we will dam the area and ski ##m or pump the oil out , " he said , adding that much of the recovered oil would be sent to ref ##iner ##ies .

reference_raw: "We'll dam the area and skip or pump out the oil," he said, adding that most of the recovered oil would be sent to the refineries.

reference_spacy_tokens: " We 'll dam the area and skip or pump out the oil , " he said , adding that most of the recovered oil would be sent to the refineries .


fn_spacy_tokens_for_baseline: Since Friday morning , around 170 fires have been burning , many of which are believed to be caused by arson .

source_bert_toks: since friday morning , around 170 fires have been burning , many of which are believed to be caused by arson .

reference_raw: There have been about 170 fires burning since the morning, many of which are believed to have been caused by arson.

reference_spacy_tokens: There have been about 170 fires burning since the morning , many of which are believed to have been caused by arson .


fn_spacy_tokens_for_baseline: When her tram clanked to a halt in front of her Maggie climbed aboard and went upstairs .

source_bert_toks: when her tram clan ##ked to a halt in front of her maggie climbed aboard and went upstairs .

reference_raw: When the tram clicked to a stop in front of her, Maggie climbed on deck and went up the stairs.

reference_spacy_tokens: When the tram clicked to a stop in front of her , Maggie climbed on deck and went up the stairs .


fn_spacy_tokens_for_baseline: The lines weave and turn and the stations are not regularly placed .

source_bert_toks: the lines weave and turn and the stations are not regularly placed .

reference_raw: Lines twist and rotate and stations are not positioned regularly.

reference_spacy_tokens: Lines twist and rotate and stations are not positioned regularly .


fn_spacy_tokens_for_baseline: It might not be a bad idea to do that sooner , rather than later .

source_bert_toks: it might not be a bad idea to do that sooner , rather than later .

reference_raw: Maybe it's not too bad to do it sooner rather than later.

reference_spacy_tokens: Maybe it 's not too bad to do it sooner rather than later .


fn_spacy_tokens_for_baseline: In order to re - affirm his declared commitment to a liberal and secular state , Ben Ali retained Mohamed Charfi as Minister for National Education , Higher Education and Scientific Research ; fundamentalist students had demanded his resignation .

source_bert_toks: in order to re - af ##firm his declared commitment to a liberal and secular state , ben ali retained mohamed char ##fi as minister for national education , higher education and scientific research ; fundamental ##ist students had demanded his resignation .

reference_raw: To reaffirm his declared commitment to a liberal and secular state, Ben Ali maintained Mohamed Charfi as Minister of National Education, Higher Education and Science Research; fundamentalist students demanded his resignation.

reference_spacy_tokens: To reaffirm his declared commitment to a liberal and secular state , Ben Ali maintained Mohamed Charfi as Minister of National Education , Higher Education and Science Research ; fundamentalist students demanded his resignation .


fn_spacy_tokens_for_baseline: Then observing himself as he fluttered and flustered the teenaged Lara in a restaurant !

source_bert_toks: then observing himself as he fluttered and flu ##stered the teenage ##d lara in a restaurant !

reference_raw: Then he watched himself flutter and flustrate the teenaged Lara in the restaurant!

reference_spacy_tokens: Then he watched himself flutter and flustrate the teenaged Lara in the restaurant !


fn_spacy_tokens_for_baseline: Then she was out of the water , her feet slapping towards the showers .

source_bert_toks: then she was out of the water , her feet slapping towards the showers .

reference_raw: Then she was out of the water, her feet pounding against the showers.

reference_spacy_tokens: Then she was out of the water , her feet pounding against the showers .


fn_spacy_tokens_for_baseline: Small vans burst into the forecourt through the arch of the gatehouse , to park at the front door and unload pot - plants , piles of plates , crates of wine , trays of freshly baked rolls .

source_bert_toks: small vans burst into the fore ##court through the arch of the gate ##house , to park at the front door and un ##load pot - plants , piles of plates , crates of wine , tray ##s of freshly baked rolls .

reference_raw: Small vans rushed into the courtyard through the archway of the gate, parked in the front door and unloaded pot plants, stacks of plates, crates of wine, platters of freshly baked rolls.

reference_spacy_tokens: Small vans rushed into the courtyard through the archway of the gate , parked in the front door and unloaded pot plants , stacks of plates , crates of wine , platters of freshly baked rolls .


fn_spacy_tokens_for_baseline: However , too much alcohol slows reflexes and can cause aggression or sleepiness , leading to accidents .

source_bert_toks: however , too much alcohol slow ##s reflex ##es and can cause aggression or sleep ##iness , leading to accidents .

reference_raw: But too much alcohol slows reflexes and can cause aggression or somnolence, leading to accidents.

reference_spacy_tokens: But too much alcohol slows reflexes and can cause aggression or somnolence , leading to accidents .


fn_spacy_tokens_for_baseline: Even the horn was of a much lighter colour than usual , although it had been gilded with silver .

source_bert_toks: even the horn was of a much lighter colour than usual , although it had been gilded with silver .

reference_raw: Even the horn was much lighter than usual, though it was golden with silver.

reference_spacy_tokens: Even the horn was much lighter than usual , though it was golden with silver .


fn_spacy_tokens_for_baseline: Then , to my bafflement , I found I was catching up .

source_bert_toks: then , to my ba ##ffle ##ment , i found i was catching up .

reference_raw: Then, to my confusion, I found myself catching up with him.

reference_spacy_tokens: Then , to my confusion , I found myself catching up with him .


fn_spacy_tokens_for_baseline: THE much - maligned men of the Jockey Club have found a ' sugar daddy ' to boost their image with a little cosmetic surgery .

source_bert_toks: the much - mali ##gned men of the jockey club have found a ' sugar daddy ' to boost their image with a little cosmetic surgery .

reference_raw: The most malignant men of the Jockey Club found a "sugar dad" to boost their image with a little cosmetic surgery.

reference_spacy_tokens: The most malignant men of the Jockey Club found a " sugar dad " to boost their image with a little cosmetic surgery .


fn_spacy_tokens_for_baseline: Around 3000 b.c . , native Archaic Indians began to develop a lasting hunting and gathering culture .

source_bert_toks: around 3000 b . c . , native archaic indians began to develop a lasting hunting and gathering culture .

reference_raw: Around 3000 B.C., native archaic Indians began to develop a permanent culture of hunting and harvesting.

reference_spacy_tokens: Around 3000 B.C. , native archaic Indians began to develop a permanent culture of hunting and harvesting .


fn_spacy_tokens_for_baseline: It can not be understood without reference to the growing land hunger and militancy of millions of peasants .

source_bert_toks: it can not be understood without reference to the growing land hunger and mil ##itan ##cy of millions of peasants .

reference_raw: It cannot be understood without reference to the growing famine of the land and the militancy of millions of peasants.

reference_spacy_tokens: It can not be understood without reference to the growing famine of the land and the militancy of millions of peasants .


fn_spacy_tokens_for_baseline: Mark , however , did n't bother to fake his results :

source_bert_toks: mark , however , didn ' t bother to fake his results :

reference_raw: But Mark did not bother to falsify the results:

reference_spacy_tokens: But Mark did not bother to falsify the results :


fn_spacy_tokens_for_baseline: ' Leave , ' brayed a hoarse donkey voice behind her , ' leave , you bloody idiot . '

source_bert_toks: ' leave , ' bray ##ed a hoarse donkey voice behind her , ' leave , you bloody idiot . '

reference_raw: 'Leave,' said a hoarse donkey voice behind her, 'leave it, you bloody idiot.'

reference_spacy_tokens: ' Leave , ' said a hoarse donkey voice behind her , ' leave it , you bloody idiot . '


fn_spacy_tokens_for_baseline: In addition , consultancy , training and information , including a new bi - monthly magazine Adviser and a specially developed electronic database -- ' Lawtel ' -- are available to all UK CABx .

source_bert_toks: in addition , consultancy , training and information , including a new bi - monthly magazine adviser and a specially developed electronic database - - ' law ##tel ' - - are available to all uk cab ##x .

reference_raw: In addition, all UK CABx have access to advice, training and information, including the new bimonthly Magazine Adviser and the specially developed electronic database, "Lawtel".

reference_spacy_tokens: In addition , all UK CABx have access to advice , training and information , including the new bimonthly Magazine Adviser and the specially developed electronic database , " Lawtel " .


fn_spacy_tokens_for_baseline: The ham was desiccated , the scrambled eggs congealed , and the fruit juice fermented .

source_bert_toks: the ham was des ##ic ##cated , the scrambled eggs cong ##eal ##ed , and the fruit juice fe ##rm ##ented .

reference_raw: The ham was dried, the scrambled eggs congealed, and the fruit juice was fermented.

reference_spacy_tokens: The ham was dried , the scrambled eggs congealed , and the fruit juice was fermented .


fn_spacy_tokens_for_baseline: The whole valley round St Nectan 's Glen is teeming with bird life , a paradise for a young ornithologist .

source_bert_toks: the whole valley round st nec ##tan ' s glen is tee ##ming with bird life , a paradise for a young or ##ni ##th ##ologist .

reference_raw: The valley around St. Nectan's Glen is full of bird life, a paradise for a young ornithologist.

reference_spacy_tokens: The valley around St. Nectan 's Glen is full of bird life , a paradise for a young ornithologist .


fn_spacy_tokens_for_baseline: Gina lay beside him ; she had nodded off and was snoring loudly .

source_bert_toks: gina lay beside him ; she had nodded off and was s ##nor ##ing loudly .

reference_raw: Gina was lying next to him; she nodded away and sniffed loudly.

reference_spacy_tokens: Gina was lying next to him ; she nodded away and sniffed loudly .


fn_spacy_tokens_for_baseline: An enormous boxer hurled himself on me in delight , clawing at my chest with the biggest , horniest feet I had seen for a long time .

source_bert_toks: an enormous boxer hurled himself on me in delight , claw ##ing at my chest with the biggest , horn ##iest feet i had seen for a long time .

reference_raw: A huge boxer threw himself at me with joy, clutching at my chest with the largest, horniest legs I'd seen in a long time.

reference_spacy_tokens: A huge boxer threw himself at me with joy , clutching at my chest with the largest , horniest legs I 'd seen in a long time .


fn_spacy_tokens_for_baseline: Muscatel is made from muscat grapes , is sometimes called muscat , and , being relatively cheap and sweet and high in alcohol content , is the booze of choice for a great many wines .

source_bert_toks: mu ##sca ##tel is made from mu ##sca ##t grapes , is sometimes called mu ##sca ##t , and , being relatively cheap and sweet and high in alcohol content , is the boo ##ze of choice for a great many wines .

reference_raw: Muscatel is made from muscat grapes, sometimes referred to as muscats, and, since it is relatively cheap and sweet and has a high alcoholic strength, it is a drink of choice for many wines.

reference_spacy_tokens: Muscatel is made from muscat grapes , sometimes referred to as muscats , and , since it is relatively cheap and sweet and has a high alcoholic strength , it is a drink of choice for many wines .


fn_spacy_tokens_for_baseline: Again his dark eyes surveyed her obvious state of undress .

source_bert_toks: again his dark eyes surveyed her obvious state of und ##ress .

reference_raw: His dark eyes re-examined her apparent state of clothing.

reference_spacy_tokens: His dark eyes re - examined her apparent state of clothing .


fn_spacy_tokens_for_baseline: Samson yowled , let go , and she was over the back of the counter crouching down , pushing and wriggling through stinking legs and skirts that reeked of an unwashed lifetime .

source_bert_toks: samson yo ##wled , let go , and she was over the back of the counter crouch ##ing down , pushing and wr ##ig ##gling through stink ##ing legs and skirts that re ##eke ##d of an un ##washed lifetime .

reference_raw: Samson howled and let go, and she was at the back of the counter, crouching, pushing and squirming through the stinking legs and skirts that reeked of an unwashed life.

reference_spacy_tokens: Samson howled and let go , and she was at the back of the counter , crouching , pushing and squirming through the stinking legs and skirts that reeked of an unwashed life .


fn_spacy_tokens_for_baseline: Empty the fridge , wipe it out , collect up thawed water from its freezer section and leave the door propped open .

source_bert_toks: empty the fridge , wipe it out , collect up tha ##wed water from its freeze ##r section and leave the door propped open .

reference_raw: Empty the refrigerator, wipe it out, collect the melted water from the freezer compartment, and leave the door open.

reference_spacy_tokens: Empty the refrigerator , wipe it out , collect the melted water from the freezer compartment , and leave the door open .


fn_spacy_tokens_for_baseline: Stephanie said that he had been seriously ill and was convalescing .

source_bert_toks: stephanie said that he had been seriously ill and was con ##vale ##sc ##ing .

reference_raw: Stephanie said he was really sick and he was conquering.

reference_spacy_tokens: Stephanie said he was really sick and he was conquering .


fn_spacy_tokens_for_baseline: He reminded her that it was kindness , as she well knew , that had got him into his present pickle .

source_bert_toks: he reminded her that it was kindness , as she well knew , that had got him into his present pick ##le .

reference_raw: He reminded her that it was kindness, as she well knew, that had brought him to his present cucumber.

reference_spacy_tokens: He reminded her that it was kindness , as she well knew , that had brought him to his present cucumber .


fn_spacy_tokens_for_baseline: Chilli and a guacamole - style sauce give a Central American savour to this summery dish .

source_bert_toks: chill ##i and a gu ##aca ##mo ##le - style sauce give a central american sa ##vo ##ur to this summer ##y dish .

reference_raw: Chilli and guacamole sauce give Central American pleasure to this summer meal.

reference_spacy_tokens: Chilli and guacamole sauce give Central American pleasure to this summer meal .


fn_spacy_tokens_for_baseline: His father splashes deep into the water and pulls him out .

source_bert_toks: his father splash ##es deep into the water and pulls him out .

reference_raw: His father plunges deep into the water and pulls him out.

reference_spacy_tokens: His father plunges deep into the water and pulls him out .


fn_spacy_tokens_for_baseline: He is even weighed down with bracelets and anklets , to discourage him from floating up again too soon .

source_bert_toks: he is even weighed down with bracelet ##s and ankle ##ts , to discourage him from floating up again too soon .

reference_raw: He's even burdened with bracelets and knuckles to keep him from rising too early.

reference_spacy_tokens: He 's even burdened with bracelets and knuckles to keep him from rising too early .